Mapping of hormones and cortisol responses in patients after Lyme neuroborreliosis
© Tjernberg et al; licensee BioMed Central Ltd. 2010
Received: 3 July 2009
Accepted: 5 February 2010
Published: 5 February 2010
Persistent symptoms after treatment for neuroborreliosis are common for reasons mainly unknown. These symptoms are often unspecific and could be caused by dysfunctions in endocrine systems, an issue that has not been previously addressed systematically. We therefore mapped hormone levels in patients with previous confirmed Lyme neuroborreliosis of different outcomes and compared them with a healthy control group.
Twenty patients of a retrospective cohort of patients treated for definite Lyme neuroborreliosis were recruited 2.3 to 3.7 years (median 2.7) after diagnosis, together with 23 healthy controls. Lyme neuroborreliosis patients were stratified into two groups according to a symptom/sign score. All participants underwent anthropometric and physiological investigation as well as an extensive biochemical endocrine investigation including a short high-dose adrenocorticotropic hormone stimulation (Synacthen®) test. In addition to hormonal status, we also examined electrolytes, 25-hydroxy-vitamin D and interleukin-6.
Eight patients (40%) had pronounced symptoms 2-3 years after treatment. This group had a higher cortisol response to synacthen as compared with both controls and the Lyme neuroborreliosis patients without remaining symptoms (p < 0.001 for both comparisons). No other significant differences in the various baseline biochemical parameters, anthropometric or physiological data could be detected across groups.
Apart from a positive association between the occurrence of long-lasting complaints after Lyme neuroborreliosis and cortisol response to synacthen, no corticotropic insufficiency or other serious hormonal dysfunction was found to be associated with remaining symptoms after treatment for Lyme neuroborreliosis.
Lyme borreliosis is the most commonly reported tick-transmitted disease in the northern hemisphere . The overall incidence in the south of Sweden has been reported to be 69 per 100 000 inhabitants and year, with marked regional variability. For instance, the incidence in Kalmar County was reported to be 160 per 100 000 inhabitants and year .
Clinical manifestations of Lyme borreliosis are diverse and include erythema migrans, neuroborreliosis, arthritis, lymphocytoma, carditis, and acrodermatitis chronica atrophicans. In Sweden, Lyme neuroborreliosis (LNB) is the second most common manifestation after erythema migrans. Current antibiotic treatment recommendations for LNB comprise either doxycycline, benzyl penicillin or ceftriaxone [1–3].
Residual symptoms after treatment of LNB are common and have been reported by some 25-50% of patients 6-142 months after onset of neurological symptoms [3–5]. Residual symptoms may include arthralgia, musculoskeletal or radicular pain, paresthesia, dysaesthesia together with persistent fatigue and neurocognitive impairment. Although there are theories regarding the background of these persistent symptoms, the pathogenesis is still mainly unknown [6, 7]. Early recognition and treatment of acute LNB seems to be important in order to reduce the risk of persistent symptoms .
It is well known that tuberculosis meningitis and various other infectious diseases can affect and cause dysfunction of the hypothalamus and/or the pituitary gland [8–16]. It has also been proposed that interleukin-6 (IL-6) may stimulate the hypothalamus-pituitary-adrenal (HPA) axis during inflammatory stress , and in healthy individuals a positive correlation between IL-6 levels and cortisol response after a standard short low-dose (1 μg) adrenocorticotropic hormone (ACTH) test has been reported .
In a recent study, isolated corticotropic insufficiency was noted in four of 19 patients (21%) with previous infectious diseases of the central nervous system. The study in fact included four patients with a history of LNB, but no hormonal dysfunction was found in these . Endocrine dysfunctions, with general symptoms and complaints could be one possible explanation, and vitamin D deficiency, linked to diffuse musculoskeletal complaints, could be another explanation for the reported complaints after LNB . Neither of these has been thoroughly investigated in this context previously.
In the present study we therefore aimed at mapping patients having experienced confirmed LNB with and without persistent symptoms and to compare them with healthy controls regarding anthropometric data, various hormone levels, and, in particular, the HPA axis. In addition, we wanted to relate the high-dose ACTH stimulation (Synacthen®) test-induced cortisol response to the level of symptoms as well as to levels of IL-6.
Patients and controls
From the routine laboratory data system of the Department of Microbiology at Kalmar County Hospital, 36 adult patients were identified as having had a positive anti-borrelia antibody index (AI; IDEA™ Lyme Neuroborreliosis kit, Oxoid, Basingstoke, United Kingdom) with purified, native Borrelia afzelii strain DK1 flagellum as test antigen in paired cerebrospinal fluid/serum samples during 2004-2005. According to medical charts at Kalmar County Hospital, seven of these 36 patients were not considered suffering from ongoing LNB. These seven patients were all considered to have other diagnoses based on clinical history, symptoms and laboratory findings.
The remaining 29 patients received a clinical diagnosis of LNB and were treated with doxycycline, in one case together with ceftriaxone. Painful radiculitis was found in 19, unspecific complaints in 11, cranial nerve palsy in 9 and meningitis in 2 patients. Each patient presented with one or multiple features. An IgM or IgG AI of ≥ 0.3 was considered positive according to the manufacturer. Positive IgM AI was found in 13/29 patients (range 0-20.5; median 0.1), and positive IgG AI was found in 29/29 patients (range 0.4-973.4; median 15.8). Positive blood serological results were found in 26 of the 29 patients (Immunetics® Quick ELISA C6 Borrelia Assay Kit, Immunetics Inc., Cambridge, MA, USA).
Although six of these 29 patients lacked pleocytosis (>5*106 leukocytes/L) of the cerebrospinal fluid, they were still clinically diagnosed with LNB according to medical records, based on a typical history of symptoms and findings together with the positive AI, and were therefore treated.
Individuals in this retrospective cohort, consisting of 29 patients, were informed and offered participation in the study. Twenty of these 29 (69%) patients participated in the study during February-May 2008. One additional patient accepted participation, but was on medication with prednisolone due to suspected polymyalgia rheumatica and was therefore not included in the study. The remaining eight patients were reminded by letter after a couple of weeks, but no additional participants were recruited.
In addition, a control group of healthy adult blood donors was recruited. Only subjects with an approved declaration of health and no history of previous Lyme borreliosis infection and a negative borrelia serological test (C6 Lyme ELISA™ Kit, Immunetics®, Boston, MA, USA) were included. Controls using medications, working night shift or having had any previous hormonal disease were also not included. Finally, 23 healthy control individuals participated in the study during February-May 2008. The study was performed according to the Declaration of Helsinki, and the study protocol was reviewed and approved by the regional ethical review board in Linköping, Sweden. All patients and controls gave informed consent.
Study protocol and implementation
A study protocol was designed for the LNB patients in whom 15 different neurological signs together with 25 different symptoms were addressed. Blood pressure, heart rate, weight, length and waist measurement were noted and fasting (minimum 8 hours) blood samples were collected between 8 and 9 a.m. from all participants.
Then, an intramuscular injection with 0.25 mg of Synacthen® (Novartis Pharma AG Basel, Switzerland) was given after which samples for cortisol were taken at 30 and 60 minutes. An experienced nurse, with access to a physician, administered synacthen and supervised the participants. No adverse events occurred during the test. Directly after the injection all LNB patients were neurologically examined and questioned by the same physician (IT) regarding persistent, ongoing symptoms after treatment of LNB. Only neurological signs and symptoms related by the patient to the LNB infection were noted. The neurological examination included systematic testing of cranial nerves, motor and sensory functions, balance, ataxia and reflexes. All results were noted in the study protocol, and all participants were unaware of the other study results. Analyses were performed according to methods and instruments in Additional file 1, Table S1, where reference values also are noted. The highest of the 30 and 60 minute values of synacthen stimulated cortisol minus baseline cortisol level was defined as the absolute cortisol increment (ACI).
Differences between groups were analysed with Kruskal-Wallis non-parametrical test, followed by Mann-Whitney's U-test in case of significance. Due to age differences between blood donors (controls) and LNB patients, adjusting for age was made using factorial ANOVA for the normally distributed parameters (ACI, heart rate and systolic blood pressure) followed by Duncan's test in case of significance. Pearson correlation was used to analyse the coupling between post treatment severity (see results) score and number of symptoms on the one hand and ACI as well as IL-6 values (log-normally distributed, thus using the logarithm values) on the other. A significance level of p < 0.05 was considered statistically significant. Statistica 8.0 was used for statistical calculations.
Symptoms and neurological signs
Twenty LNB patients were included in the study and the median follow-up time from diagnosis was 2.7 years (range 2.3 to 3.7). The most common long-lasting symptoms were arthralgia (40%), balance disorder (35%) and paresthesia (35%) (Additional file 2, Table S2). In the neurological examination, three patients were not fully recovered after facial palsy. No other pathological neurological signs were noted in these patients. In four patients, ataxia, disturbed motor and sensory nerve functions were found (data not shown).
By adding the numbers of symptoms (range 0-25; in the questionnaire) to the number of pathological signs in the neurological examination (range 0-15; according to the study protocol), a post treatment severity (PTS) score was calculated for each LNB patient (range 0-40).
Physiological and biochemical results
Anthropometric and physiological parameters such as body measurements, heart rate and blood pressure is shown together with biochemical results in controls and in the LNB+ and LNB- groups in Additional file 3, Table S3. In a first step, comparisons between all three groups were performed using Kruskal-Wallis test, showing that age (p = 0.002), heart rate (p = 0.010), systolic blood pressure (p = 0.011), follicle-stimulating hormone (FSH; p = 0.033), ACI (p = 0.004) and IL-6 (p = 0.048) were statistically different across groups. Further analyses using Mann-Whitney's U-test showed that controls were younger than LNB+ and LNB- patients (p = 0.001 and 0.023, respectively), but no difference in age was noted in between LNB+ and LNB- patients. Also, higher ACI was found in the LNB+ group compared to both other groups (p = 0.002 for both comparisons), while no differences were found regarding basal concentrations of cortisol or metabolic parameters such as waist measurement or fasting glucose. Heart rate was also found to be higher in the LNB+ group compared to both controls and LNB- groups (p = 0.004 and 0.006, respectively). Furthermore, higher systolic blood pressure (p = 0.003) and levels of FSH (p = 0.01) were noted in the LNB+ group compared to controls. Concentrations of FSH in women are dependent on time of menstruation and rise after menopause and are therefore difficult to compare among groups. Because of the difference in age between groups, statistical correction for age was done. Thereby, ACI still remained higher in the LNB+ group compared to both controls and the LNB- group (p < 0.001 for both comparisons). However, no differences between groups were detected regarding IL-6, heart rate or systolic blood pressure after age correction. Since a diagnosis of LNB without pleocytosis has been debated, we also, as an extra precaution, reanalysed the coupling between PTS score and ACI as well as differences in ACI between groups after exclusion of 4/20 LNB patients (2 LNB+, 2 LNB-) with normal CSF cell counts, with similar results.
Correlations between PTS score and ACI (Figure 1) showed that ACI for LNB patients was significantly correlated to the PTS score (r = 0.68; p = 0.001). The chosen PTS score cut off level of four is also shown in Figure 1, separating the LNB patients into the two subgroups. No correlation between IL-6 and PTS score or IL-6 and ACI was found, not even for healthy controls only (data not shown). Finally, we also determined correlations in LNB patients classified according to self reported symptoms only, i.e. excluding signs in the PTS score. Still, a significant correlation between ACI and the added number of symptoms was found (r = 0.65; p = 0.002, data not shown). No correlation between ACI and the number of pathological neurological signs was found.
All LNB+ and LNB- patients had corticotrophin-releasing hormone (CRH) levels < 1.0 pmol/L, as well as all controls except two (1.2 and 1.9 pmol/L, respectively).
Two of the controls were found to have subclinical autoimmune hypothyroidism based on increased levels of TSH (4.3 and 11.5 mU/L) combined with a decreased level of thyroxine in one case (6.4 pmol/L), as well as positive levels of anti-thyroid peroxidase antibodies in both cases.
One LNB- patient was found to have an increased level of ionized calcium and was after further investigation diagnosed with primary hyperparathyroidism.
We found no significant differences regarding various basal hormonal concentrations when comparing LNB patients of different clinical outcomes 2-3 years post treatment to controls. This finding is clinically relevant in that it indicates that endocrine dysfunction is not a major cause of long-lasting symptoms despite optimal treatment of LNB. However, a positive correlation between the PTS score and ACI was noted. After sub grouping and corrections for age the LNB+ group still had higher ACI than the LNB- group and healthy controls, whereas no differences were found in metabolic parameters such as waist measurement or fasting glucose.
In a recent study it was shown that ACI correlated positively to IL-6 levels in normal subjects , and therefore higher levels of IL-6 in LNB patients with more pronounced symptoms could be expected to correlate with higher ACI. Associations between IL-6 and depression, vital exhaustion and feeling of hopelessness have also been previously reported [21–23]. However, in the present study we did not find a significant correlation between PTS score and IL-6 or between ACI and IL-6, not even when studying the control group only, thereby contradicting the results of Zarkovic et al . We therefore interpret the correlation between patient score and ACI in this study as independent of IL-6 levels. It is however interesting to notice the relation between clinical symptoms and cortisol response to synacthen indicating adrenal hyper-responsiveness in these patients. Some earlier studies have shown super-sensitivity to ACTH stimulation with higher cortisol responses in depressed patients compared to controls [24–26], while others have been unable to differentiate between depressed patients and healthy volunteers [27, 28]. Cortisol response to ACTH stimulation and adrenal gland volume has also been shown to be state-dependent with decreased cortisol response to ACTH and decreased adrenal volume in successfully treated depressed patients [29, 30]. Although a complete evaluation of depression in the LNB patients in this study was not performed, obvious depressive symptoms according to Additonal file 2, Table S2, were not the most common and therefore other causes for the higher ACI in the LNB+ patients may be suspected. It has also been reported that chronic exposure to stressful situations, perhaps such as the persistent symptoms noted in this study, results in tonic changes in the HPA axis . Taken together, further investigation is necessary in order to determine the cause of increased ACI in LNB patients with persistent symptoms and the relation to LNB, depression, stress signalling, cortisol and adrenal gland volume.
In this study, as much as 8/20 (40%) of LNB patients were considered to suffer from persistent symptoms between 2-3 years post treatment. This is in line with previously reported proportions (25-50%) of patients suffering from persistent symptoms after treatment for LNB [3–5]. The figure of 40% could however be overestimated in this study due to an overrepresentation of patients with symptoms participating in the study. It can not be excluded that those eight patients that chose to not participate, were patients with minor or no persistent symptoms and that they therefore were less motivated to participate. Six of those eight patients were younger than 54 years of age, and may also have chosen not to participate due to working conditions as the whole investigation took around two hours of time. One other weakness of this study is that controls are significantly younger than LNB patients. This is because blood donors served as controls, and only few blood donors between 65-70 years of age and no donors above 70 years of age were available for participation. The differences of age between groups were therefore considered and age correction performed in the statistical analyses when appropriate.
In conclusion, this study showed that a high proportion (40%) of LNB patients suffer from persistent symptoms 2-3 years post treatment. Although a positive correlation between ACI and PTS score was found in the LNB group, no major differences regarding various basal hormone levels could be detected comparing the LNB subgroups and the control group. This finding indicates that endocrine dysfunction is not a major cause for long-lasting post-treatment symptoms in LNB.
This study was conducted with support from the Medical Research Council of Southeast Sweden (FORSS). We especially thank Agneta Hallengren for invaluable assistance with patients, Lars Brudin for statistical calculations, Ingela Nilsson and Inga-Lill Björkholm for laboratory analyses.
- Stanek G, Strle F: Lyme borreliosis. Lancet. 2003, 362 (9396): 1639-1647. 10.1016/S0140-6736(03)14798-8.View ArticlePubMedGoogle Scholar
- Berglund J, Eitrem R, Ornstein K, Lindberg A, Ringer A, Elmrud H, Carlsson M, Runehagen A, Svanborg C, Norrby R: An epidemiologic study of Lyme disease in southern Sweden. N Engl J Med. 1995, 333 (20): 1319-1327. 10.1056/NEJM199511163332004.View ArticlePubMedGoogle Scholar
- Berglund J, Stjernberg L, Ornstein K, Tykesson-Joelsson K, Walter H: 5-y Follow-up study of patients with neuroborreliosis. Scand J Infect Dis. 2002, 34 (6): 421-425. 10.1080/00365540110080421.View ArticlePubMedGoogle Scholar
- Treib J, Fernandez A, Haass A, Grauer MT, Holzer G, Woessner R: Clinical and serologic follow-up in patients with neuroborreliosis. Neurology. 1998, 51 (5): 1489-1491.View ArticlePubMedGoogle Scholar
- Vrethem M, Hellblom L, Widlund M, Ahl M, Danielsson O, Ernerudh J, Forsberg P: Chronic symptoms are common in patients with neuroborreliosis -- a questionnaire follow-up study. Acta Neurol Scand. 2002, 106 (4): 205-208. 10.1034/j.1600-0404.2002.01358.x.View ArticlePubMedGoogle Scholar
- Pfister HW, Rupprecht TA: Clinical aspects of neuroborreliosis and post-Lyme disease syndrome in adult patients. Int J Med Microbiol. 2006, 296 (Suppl 40): 11-16. 10.1016/j.ijmm.2005.12.003.View ArticlePubMedGoogle Scholar
- Steiner I: Treating post Lyme disease: trying to solve one equation with too many unknowns. Neurology. 2003, 60 (12): 1888-1889.View ArticlePubMedGoogle Scholar
- Brooks MH, Dumlao JS, Bronsky D, Waldstein SS: Hypophysial tuberculoma with hypopituitarism. Am J Med. 1973, 54 (6): 777-781. 10.1016/0002-9343(73)90065-X.View ArticlePubMedGoogle Scholar
- Hagg E, Astrom L, Steen L: Persistent hypothalamic-pituitary insufficiency following acute meningoencephalitis. A report of two cases. Acta Med Scand. 1978, 203 (3): 231-235.PubMedGoogle Scholar
- Haslam RH, Winternitz WW, Howieson J: Selective hypopituitarism following tuberculous menigitis. Am J Dis Child. 1969, 118 (6): 903-908.PubMedGoogle Scholar
- Ickenstein GW, Klotz JM, Langohr HD: [Virus encephalitis with symptomatic Parkinson syndrome, diabetes insipidus and panhypopituitarism]. Fortschr Neurol Psychiatr. 1999, 67 (10): 476-481. 10.1055/s-2007-994998.View ArticlePubMedGoogle Scholar
- Jew K, Piziak V, Gilliland PF, Hurley DL: Meningoencephalitis complicated by pituitary insufficiency and a spontaneously resolving suprasellar mass. Neurosurgery. 1984, 14 (5): 567-569. 10.1097/00006123-198405000-00008.View ArticlePubMedGoogle Scholar
- Kupari M, Pelkonen R, Valtonen V: Post-encephalitic hypothalamic-pituitary insufficiency. Acta Endocrinol (Copenh). 1980, 94 (4): 433-438.Google Scholar
- Lichtenstein MJ, Tilley WS, Sandler MP: The syndrome of hypothalamic hypopituitarism complicating viral meningoencephalitis. J Endocrinol Invest. 1982, 5 (2): 111-115.View ArticlePubMedGoogle Scholar
- Summers VK, Hipkin LJ, Osborne Hughes R, Davis JC: Panhypopituitarism after cured tuberculous meningitis. Br Med J. 1968, 1 (5588): 359-10.1136/bmj.1.5588.359.View ArticlePubMedPubMed CentralGoogle Scholar
- Vesely DL, Mastrandrea P, Samson C, Argyelan G, Charvit S: Post-herpes encephalitic anterior pituitary insufficiency with hypothermia and hypotension. Am J Med Sci. 2000, 320 (4): 273-277. 10.1097/00000441-200010000-00008.View ArticlePubMedGoogle Scholar
- Mastorakos G, Chrousos GP, Weber JS: Recombinant interleukin-6 activates the hypothalamic-pituitary-adrenal axis in humans. J Clin Endocrinol Metab. 1993, 77 (6): 1690-1694. 10.1210/jc.77.6.1690.PubMedGoogle Scholar
- Zarkovic M, Ignjatovic S, Dajak M, Ciric J, Beleslin B, Savic S, Stojkovic M, Bulat P, Trbojevic B: Cortisol response to ACTH stimulation correlates with blood interleukin 6 concentration in healthy humans. Eur J Endocrinol. 2008, 159 (5): 649-652. 10.1530/EJE-08-0544.View ArticlePubMedGoogle Scholar
- Schaefer S, Boegershausen N, Meyer S, Ivan D, Schepelmann K, Kann PH: Hypothalamic-pituitary insufficiency following infectious diseases of the central nervous system. Eur J Endocrinol. 2008, 158 (1): 3-9. 10.1530/EJE-07-0484.View ArticlePubMedGoogle Scholar
- Plotnikoff GA, Quigley JM: Prevalence of severe hypovitaminosis D in patients with persistent, nonspecific musculoskeletal pain. Mayo Clin Proc. 2003, 78 (12): 1463-1470. 10.4065/78.12.1463.View ArticlePubMedGoogle Scholar
- Musselman DL, Miller AH, Porter MR, Manatunga A, Gao F, Penna S, Pearce BD, Landry J, Glover S, McDaniel JS, et al: Higher than normal plasma interleukin-6 concentrations in cancer patients with depression: preliminary findings. Am J Psychiatry. 2001, 158 (8): 1252-1257. 10.1176/appi.ajp.158.8.1252.View ArticlePubMedGoogle Scholar
- Sjogren E, Leanderson P, Kristenson M, Ernerudh J: Interleukin-6 levels in relation to psychosocial factors: studies on serum, saliva, and in vitro production by blood mononuclear cells. Brain Behav Immun. 2006, 20 (3): 270-278. 10.1016/j.bbi.2005.08.001.View ArticlePubMedGoogle Scholar
- Zautra AJ, Yocum DC, Villanueva I, Smith B, Davis MC, Attrep J, Irwin M: Immune activation and depression in women with rheumatoid arthritis. J Rheumatol. 2004, 31 (3): 457-463.PubMedGoogle Scholar
- Amsterdam JD, Winokur A, Abelman E, Lucki I, Rickels K: Cosyntropin (ACTH alpha 1-24) stimulation test in depressed patients and healthy subjects. Am J Psychiatry. 1983, 140 (7): 907-909.View ArticlePubMedGoogle Scholar
- Jaeckle RS, Kathol RG, Lopez JF, Meller WH, Krummel SJ: Enhanced adrenal sensitivity to exogenous cosyntropin (ACTH alpha 1-24) stimulation in major depression. Relationship to dexamethasone suppression test results. Arch Gen Psychiatry. 1987, 44 (3): 233-240.View ArticlePubMedGoogle Scholar
- Shimoda K, Yamada N, Hanada K, Tsujimoto T, Takahashi S, Takahashi K: Morning and evening adrenocortical responses to ACTH stimulation in endogenously depressed patients: a preliminary report. Jpn J Psychiatry Neurol. 1989, 43 (1): 57-62.PubMedGoogle Scholar
- Amsterdam JD, Maislin G, Abelman E, Berwish N, Winokur A: Adrenocortical responsiveness to the ACTH stimulation test in depressed patients and healthy volunteers. J Affect Disord. 1986, 11 (3): 265-274. 10.1016/0165-0327(86)90078-9.View ArticlePubMedGoogle Scholar
- Rubin RT, Miller TH, Rhodes ME, Czambel RK: Adrenal cortical responses to low- and high-dose ACTH(1-24) administration in major depressives vs. matched controls. Psychiatry Res. 2006, 143 (1): 43-50. 10.1016/j.psychres.2005.10.003.View ArticlePubMedGoogle Scholar
- Rubin RT, Phillips JJ, Sadow TF, McCracken JT: Adrenal gland volume in major depression. Increase during the depressive episode and decrease with successful treatment. Arch Gen Psychiatry. 1995, 52 (3): 213-218.View ArticlePubMedGoogle Scholar
- Thakore JH, Barnes C, Joyce J, Medbak S, Dinan TG: Effects of antidepressant treatment on corticotropin-induced cortisol responses in patients with melancholic depression. Psychiatry Res. 1997, 73 (1-2): 27-32. 10.1016/S0165-1781(97)00106-6.View ArticlePubMedGoogle Scholar
- Armario A: The hypothalamic-pituitary-adrenal axis: what can it tell us about stressors?. CNS Neurol Disord Drug Targets. 2006, 5 (5): 485-501. 10.2174/187152706778559336.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/10/20/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.