- Research article
- Open Access
- Open Peer Review
A longitudinal study of stavudine-associated toxicities in a large cohort of South African HIV infected subjects
© Menezes et al; licensee BioMed Central Ltd. 2011
- Received: 6 April 2011
- Accepted: 17 September 2011
- Published: 17 September 2011
There has been major improvement in the survival of HIV-1 infected individuals since the South African Government introduced highly active anti-retroviral therapy (HAART) in the public sector in 2004. This has brought new challenges which include the effects of stavudine-related toxicities.
Prospective analysis of a cohort of 9040 HIV-infected adults who were initiated on HAART at the Themba Lethu Clinic (TLC) in Johannesburg between April 1, 2004 to December 31, 2007, and followed up until June 30, 2008.
Amongst the 9040 study subjects, 8497(94%) were on stavudine based therapy and 5962 (66%) were women. The median baseline CD4 count was 81 cells/mm3 (IQR 29-149). Median follow up on HAART was 19 months (IQR: 9.1-31.6). The proportion of HAART-related side effects for stavudine compared to non-stavudine containing regimens were, respectively: peripheral neuropathy,17.1% vs. 11.2% (p < 0.001); symptomatic hyperlactataemia, 5.7% vs. 2.2% (p < 0.0005); lactic acidosis, 2.5 vs. 1.3% (p = 0.072); lipoatrophy, 7.3% vs. 4.6% (p < 0.05). Among those on stavudine-based regimens, incidence rates for peripheral neuropathy were 12.1 cases/100 person-years (95%CI 7.0-19.5), symptomatic hyperlactataemia 3.6 cases/100 person-years (95%CI 1.2-7.5), lactic acidosis 1.6 cases/100 person-years (95%CI 0.4-5.2) and lipoatrophy 4.6 cases/100 person-years (95%CI 2.1-9.6). Females experienced more toxicity when compared to males in terms of symptomatic hyperlactataemia (p < 0.0001), lactic acidosis (p < 0.0001), lipoatrophy (p < 0.0001) and hypertension (p < 0.05).
We demonstrate significant morbidity associated with stavudine. These data support the latest WHO guidelines, and provide additional evidence for other resource limited HAART rollout programs considering the implementation of non-stavudine based regimens as first line therapy.
- Human Immunodeficiency Virus
- Peripheral Neuropathy
- Lactic Acidosis
By the end of 2008, an estimated 33.4 million people worldwide were living with human immunodeficiency virus (HIV) infection . Southern Africa continues to bear a disproportionate share of the global burden of HIV with 67% of the HIV infections worldwide, of which 68% of them were amongst adults. This region also accounted for 72% of the world's AIDS related deaths . South Africa's 2009 HIV prevalence rate in the adult population (aged 15-49 years) was estimated to be 17.8% .
There has been an increase in the provision of highly active antiretroviral therapy (HAART), with up to 44% of adults and children estimated to be receiving therapy with a profound reduction in mortality  and, with adherence to HAART it is possible to transform HIV from a fatal infection to a chronic and manageable illness [3–5].
However, some of the anti-retroviral agents used in HAART regimens have severe side effects. Prominent amongst these drugs is stavudine, the use of which is associated with lactic acidosis/symptomatic hyperlactataemia, lipoatrophy, and peripheral neuropathy . Other side effects of stavudine use include dyslipidaemia and insulin resistance, and it is an independent risk factor for the development of new onset diabetes mellitus . Despite these serious side effects up to 60% of HIV-positive patients in low and middle income countries are receiving stavudine [8, 9].
The aim of this study was to make use of a large (N = 9040) clinic-based survey of HIV-positive patients newly initiated onto HAART over a period of three years, to compare and describe the effect of stavudine based therapy on acute and chronic toxicities after initiation of HAART. We present baseline data gathered before the initiation of HAART and data collected for three years with each patient having a minimum of six months of follow-up. This is the largest study of the side effects of stavudine therapy conducted to date in a South African HIV-positive population.
The study population included HIV-1 infected individuals attending the Themba Lethu Clinic, a public sector HAART rollout facility based at the Helen Joseph Hospital, a teaching hospital attached to the University of the Witwatersrand, Johannesburg, South Africa. This clinic provides free antiretroviral therapy and other specialized services, and is one of the largest HAART rollout clinics in Africa. The program is funded by the South African National and Gauteng Departments of Health, with support from Right to Care funded by USAID and PEPFAR.
HAART was initiated in accordance with the 2004 South African National Antiretroviral Treatment Guidelines, which include initiation criteria of a CD4 count ≤ 200 cells/mm3 or WHO stage 4 AIDS defining illness irrespective of CD4 count . The first line therapy consisted of stavudine, lamuvidine and efavirenz or nevirapine; however kaletra (ritonavir/lopinavir) was used as part of the first line therapy regimen if there were contra-indications to other first line drugs . Until October 2007, stavudine was dosed according to patients' body weight: 30 mg for those < 60 kg and 40 mg for those ≥ 60 kg. From October 2007, a universal 30 mg dose was introduced and 40 mg tablets of stavudine were withdrawn from the clinic. Single drug substitutions were permitted depending on the underlying clinical presentation of the patient.
Clinical and laboratory measurements
Patients who met the criteria for initiating of HAART received adherence counseling and screening for opportunistic infections prior to initiation of therapy. A history and physical examination was performed at every visit. All patients had a baseline chest X-ray. Laboratory monitoring was performed according to the clinic protocol. Other serum biochemical tests were carried out as clinically indicated. The results of these tests were not available for analysis as the majority of patients were seen and diagnosed at other clinics where they would present for acute medical problems, and where their HAART regimen was modified. However, their diagnoses and new HAART regimens were captured for this study.
Diagnosis and definitions
Body mass index (BMI) was defined as body weight divided by the height, squared (kg/m2). Patients who presented with symptoms of numbness or dysesthesia after initiation of HAART were defined as having peripheral neuropathy due to HAART, once other causes were excluded. Symptomatic hyperlactataemia was defined as the presence of suggestive symptoms with an uncuffed venous lactate level > 5 mmol/L with no evidence of a metabolic acidosis; and lactic acidosis was defined as an uncuffed lactate > 5 mmol/l and arterial pH < 7.35 or a total venous CO2 < 20 mmol/l, with other causes such as sepsis, renal failure, diabetic ketoacidosis and dehydration excluded. Pancreatitis was defined as the presence of abdominal symptoms with a serum amylase > 125 U/L and lipase > 60 U/L. The definition of lipoatrophy was based on the development of peripheral fat wasting (face, arms, buttocks or thighs) and/or central abdominal fat accumulation, and may include enlarged breasts. This was usually reported by the patient and confirmed by the doctor or, initially diagnosed by the doctor with patient confirmation. Hypertension was defined by the presence of three separate readings of systolic blood pressure > 140 mmHg and a diastolic blood pressure > 90 mmHg. Diabetes was defined as the presence of symptoms with a fasting glucose of > = 7 mmol/L or a random blood glucose of 11.1 mmol/L. Dyslipidaemias were defined by the presence of abnormal lipid levels which included an elevated total cholesterol of > 5 mmol/L, an elevated triglyceride level of > 1.7 mmol/L, and elevated LDL level of > 3 mmol/L.
Data collection and statistical analysis
We analyzed prospectively collected longitudinal cohort data from patients attending the clinic. Clinical data from patient records were captured onto an electronic database via a medical management software system, Therapy Edge-HIV™ (Associated Biological Systems, South Africa). Data was analyzed using the SAS® 9.1 statistical software package (SAS Institute, Inc., North Carolina, USA). Baseline characteristics of the study sample were summarized using simple proportions and medians with interquartile ranges. Differences in proportions of the toxicities were compared by initiating regimen with Chi-squared tests. Study subjects were followed from HAART initiation to the earliest of 1) death; 2) loss to follow up; 3) development of toxicity or 4) censor date 31 December 2008. Incidence rates with 95% confidence intervals for toxicity were calculated and compared by initiating regimen type (stavudine-based versus other). Crude and adjusted estimates of the effect of stavudine use on development of incident toxicity were estimated using Cox proportional hazard models. Models were controlled for confounding by baseline body mass index, CD4 count, age, and gender. Though the majority of subjects initiated HAART prior to the introduction of the universal 30 mg stavudine dose, models were also adjusted for time period in which HAART was initiated (prior to or post October 2007). Kaplan Meier curves were used to estimate crude time to diagnosis of therapy-related complications stratified by initiated regimen. Subjects with existing toxicity at initiation of HAART were excluded from these analyses.
Use of the data for the study was approved by the Human Research Ethics Committee (Medical) of the University of the Witwatersrand.
Baseline characteristics of the study population
Cohort characteristics at baseline
(N = 9040)
< 25 years
> 55 years
(N = 9040)
WHO AIDS classification
(N = 8714)
AZT containing regimen
TDF containing regimen
(N = 9040)
BMI (kg/m 2 )
22.4 ± 5.0 (N = 7010)
CD4 count (cells/mm 3 )
81 (29-149) (N = 7605)
Follow up time on HAART (months)
19.0 (9.1-31.6) (N = 9040)
Ninety four percent of patients were on stavudine based regimens at baseline, with 79% of these initiated on stavudine, lamivudine and efavirenz as per the 2004 South African National guidelines , while a smaller number were initiated on zidovudine- (3.4%) and tenofovir-based regimens (0.7%).
Retention in care
The median time to follow up for this cohort on HAART was 19 months (IQR: 9.1-31.6). At the end of the study period, a total of 6415 patients (71%) were still alive and in care, 469 were confirmed deceased and a further 2156 were considered lost to follow up. Patients were considered lost to follow up if they missed their last scheduled appointment by more than 90 days or at least 180 days had lapsed since their last visit. It can be assumed that some of the patients who are lost to follow up may have died and so in total, there were 2,625 (16.5%) patients in this cohort who were either lost to follow up or dead by the end of the study period (see Figure 1).
Response to HAART
The patients had a median baseline CD4 count of 81 cells/mm3 (IQR 29-149). There was a significant (p < 0.0001) increase in the CD4 count after initiation with a median of 205 cells/mm3 (IQR 132-293) by 6 months on treatment. After six months of therapy, there was no significant change in BMI (means ± SD; 22.4 ± 5.0 and 23.7 ± 5.5 respectively).
Acute and chronic toxicities
Frequency of and time to HAART associated toxic complications by initiating regimen
Stavudine (N = 8497)
Other drugs (N = 543)
Time to diagnosis
Time to diagnosis
Time to diagnosis
Time to diagnosis
25 (4.6) **
Time to diagnosis
Time to diagnosis
Time to diagnosis
Time to diagnosis
Crude and adjusted effects of stavudine use on toxicity initiated on HAART
In terms of the chronic HAART-related metabolic complications, 7.3% presented with lipoatrophy on stavudine based therapy, compared to 4.6% (p < 0.05) patients on non-stavudine based therapy. The median time to development of lipoatrophy was similar across the 2 treatment groups. Lipoatrophy was more predominantly seen in female than male patients (10.0% vs. 1.6%; p < 0.0001). Incidence rates for lipoatrophy were slightly higher in the stavudine based therapy group [3.0/100 person-years (95%CI 1.9-4.4) versus 4.6/100 person-years (95%CI 2.1-9.6)] compared to those on other regimens (Table 3). Only two percent of patients presented with hypertension, while only 0.3% presented with diabetes and 1.3% with dyslipidaemia on stavudine based therapy. Similar proportions developing these conditions were observed in both groups (Table 2). However, hypertension developed more quickly (p < 0.05) in patients taking stavudine than in those not receiving this drug (Table 2). Hypertension was less common in females than males (1.8% vs. 2.4%; p < 0.05) but females and males were equally affected in terms of diabetes and dyslipidaemia.
In multivariate analyses adjusted for age, gender, baseline BMI, CD4 counts and the time period initiating HAART, the use of stavudine continued to be associated with increased hazard of developing several toxicities: peripheral neuropathy (HR 2.02; 95% CI 1.35-3.03), symptomatic hyperlactataemia (HR 2.81; 95% CI 1.26-6.31), lactic acidosis (adjusted HR 2.55; 95% CI 0.81-8.00) and diabetes mellitus (adjusted HR 2.07; 95% CI 0.28-15.21) though some of these estimates lacked precision (Table 3).
Other risk factors for development of toxicity
Age, CD4 counts and WHO staging at baseline did not appear to increase the risk of any adverse events after HAART initiation; however, BMIs at baseline did significantly increase the risk of both symptomatic hyperlactataemia and lactic acidosis. Relative to a baseline BMI of < 25 kg/m2, an increased risk of symptomatic hyperlactataemia was seen for those with a BMI of 25-30 kg/m2 (RR 1.7; 95% CI 1.34-2.14, p < 0.0001) and those with a BMI of > 30 kg/m2 (RR 1.82; 95% CI 1.35-2.44, p < 0.0001). The same was seen with lactic acidosis, where an increased risk was seen for those with a BMI of 25-30 kg/m2 (RR 2.52; 95% CI 1.74-3.65, p < 0.0001) and those with a BMI of > 30 kg/m2 (RR 3.10; 95% CI 2.00-4.79, p < 0.0001) when compared to subjects with a BMI of < 25 kg/m2.
This study describes data of three years of follow up of 9040 HIV-infected adults initiated on anti-retroviral treatment at the Themba Lethu Clinic, Johannesburg, South Africa. This high number of patients demonstrates the ability of rolling out a successful HAART programme despite being in a resource limited environment, and this, at a rapidity and scale that compares with reports from other African countries [6, 11, 12].
Despite the fact that stavudine is associated with significant complications, a large proportion of low and middle-income countries still use stavudine based HAART as first line therapy [8, 9], mainly because of the cost implications of alternative drugs. In the present study nearly 30% of patients had to switch to non-stavudine based regimens, due to major side effects. These findings concur with those from another large study in South Africa where 21% of patients switched regimens over a similar time period .
This study provides estimates of the pattern of toxicities, the predominant ones being peripheral neuropathy, symptomatic hyperlactataemia, and lipoatrophy. Our incidence rates of peripheral neuropathy (12.1/100 person-years) were much higher compared to other African studies: 5.2/100 person-years in Rwanda  and 2.8/100 person-years in another site in South Africa . The variability in these rates could be because there are no grading protocols for the severity of peripheral neuropathies. Our incidence rates of lactic acidosis were similar to a study from another province in South Africa, 1.6 versus 1.9/100 person-years . The proportion of lactic acidosis was slightly higher compared to another study from Botswana , 2.5% versus 1% in our cohort. When compared to this same study , the proportion developing symptomatic hyperlactataemia were much higher in our sample (5.7% versus 2%). The median time to the development of lactic acidosis was a little later in our study when compared to another study from South Africa (10.8 months versus 7.5 months) .
In terms of the chronic toxicities, incidence rates of lipoatrophy were 4.6/100 person-years on stavudine based therapy and 3.0/100 person-years on the non-stavudine based therapy. One study from Rwanda , where patients were also on stavudine based regimens showed a similar incidence rate of lipoatrophy to that reported in the present study at 4.7/100 person-years, while one other study from South Africa  showed a lower incidence rate of 1.4/100 person-years. Another study from Rwanda showed a much higher proportion (34%) of patients developing lipoatrophy . The reason for this wide variation in lipoatrophy rates specifically, is possibly due to different diagnostic criteria used for identifying cases. Thus, in the present study and in the studies showing low but similar rates [6, 13], only cases that were severe enough to warrant a regimen change were noted. In the study showing a much higher proportion, milder cases of lipodystrophy that did not require a regimen change, were also recorded . An objective case definition of lipodystrophy has been developed ; however, it requires access to DEXA and CT imaging technology, which is often not available in resource-limited settings. Therefore, an alternative consensus definition for the diagnosis of lipodystrophy is required for such environments.
A very small number of patients presented with diabetes (0.3%) and dyslipidaemias (1.3%). However, this could be because lipid or glucose levels were only tested when clinically suspected due to cost implications, therefore probably underestimating the true prevalence of dyslipidaemia and diabetes.
The major strength of this study is the large sample size. This cohort is similar to many other resource-limited settings where there is rapid scaling-up of comprehensive HIV care and HAART. It allowed for a relatively long duration of follow up of up to three years and a fairly high retention rate of 70%, with all clinicians working on common protocols for defining the various HAART-associated toxicities. However, despite this, these findings must be considered in the light of potential limitations. It is possible that only severe toxicities that warranted a change in regimen may have been reported and this may have led to an underestimation of the rates of some of the HAART-related toxicities, particularly lipoatrophy. Also, plasma glucose and serum lipid levels were not routinely measured and thus the true rates for glucose intolerance, diabetes and dyslipidemia were not attained. Lower reported rates of the chronic toxicities could also be related to the rates of death (5%) and loss to follow up (24%), the majority of which occurred within the first six months on treatment as described in a previous report .
These results support the move away from stavudine based regimens towards less toxic combination regimens as advocated by the World Health Organisation [19, 20]. South Africa has implemented these treatment guidelines, where tenofovir has now replaced stavudine as first line therapy. However in resource-limited countries, where staduvine is still being used because of cost implications, proper pharmacovigilance systems need to be established and alternative consensus definitions and grading protocols are required for identifying various HAART-related toxicities.
Clinical activities at the Themba Lethu Clinic, Helen Joseph Hospital are supported by the South African National and Gauteng Provincial Departments of Health, with additional funding from the United States President's Emergency Plan for AIDS Relief (PEPFAR) in a grant by USAID to Right to Care and the Helen Joseph Hospital (674-A-00-08-00007-00).
- UNAIDS AIDS epidemic update. 2009, Last accessed on the 07/12//2010, [http://data.unaids.org/pub/Report/2009/JC1700_Epi_Update_2009_en.pdf]
- Department of Health: National Antenatal Sentinel HIV and Syphilis Prevalence Survey in South Africa, 2009. 2010, Last accessed on the 31/08//2011, [http://www.health-e.org.za/documents/85d3dad6136e8ca9d02cceb7f4a36145.pdf]Google Scholar
- Palella FJ, Delaney KM, Moorman AC, Loveless MO, Fuhrer J, Satten GA, Aschman DJ, Holmberg SD: Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV Outpatient Study Investigators. N Engl J Med. 1998, 338: 853-60. 10.1056/NEJM199803263381301.View ArticlePubMedGoogle Scholar
- Hogg RS, O'Shaughnessy MV, Gataric N, Yip B, Craib K, Schechter MT, Montaner JS: Decline in deaths from AIDS due to new antiretrovirals. Lancet. 1997, 349: 1294-View ArticlePubMedGoogle Scholar
- Wit FW, van Leeuwen R, Weverling GJ, Jurriaans S, Nauta K, Steingrover R, Schuijtemaker J, Eyssen X, Fortuin D, Weeda M, de Wolf F, Reiss P, Danner SA, Lange JM: Outcome and predictors of failure of highly active antiretroviral therapy: one-year follow-up of a cohort of human immunodeficiency virus type 1-infected persons. J Infect Dis. 1999, 179: 790-798. 10.1086/314675.View ArticlePubMedGoogle Scholar
- Boulle A, Orrell C, Kaplan R, van Cutsem G, McNally M, Hilderbrand K, Myer L, Egger M, Coetzee D, Maartens G, Wood R, International Epidemiological Database to Evaluate Aids in Southern Africa Collaboration: Substitution due to antiretroviral toxicity or contraindication in the first 3 years of antiretroviral treatment in a large South African cohort. Antivir Ther. 2007, 12: 753-60.PubMedGoogle Scholar
- De Wit S, Sabin CA, Weber R, Worm SW, Reiss P, Cazanave C, El-Sadr W, Monforte A, Fontas E, Law MG, Friis-Møller N, Phillips A, Data Collection on Adverse Events of Anti-HIV Drugs (D:A:D) study: Incidence and risk factors for new onset diabetes in HIV-infected patients. The data collection on adverse events of anti-HIV drugs (D: A: D) study. Diabetes Care. 2008, 31: 1224-1229. 10.2337/dc07-2013.View ArticlePubMedPubMed CentralGoogle Scholar
- Beck EJ, Vitoria M, Mandalia S, Crowley S, Gilks CF, Souteyrand Y: National adult antiretroviral therapy guidelines in resource-limited countries: concordance with 2003 WHO guidelines?. AIDS. 2006, 20: 1471-1479. 10.1097/01.aids.0000237362.26370.f8.View ArticleGoogle Scholar
- Renaud-Théry F, Nguimfack BD, Vitoria M, Lee E, Graaff P, Samb B, Perriëns J: Use of antiretroviral therapy in resource-limited countries in 2006: distribution and uptake of first- and second-line regimens. AIDS. 2007, 21 (Suppl 4): 89-95. 10.1097/01.aids.0000279711.54922.f0.View ArticleGoogle Scholar
- National Department of Health: National Antiretroviral Treatment Guidelines, First Edition 2004. Last accessed on the 31/08/2011, [http://www.doh.gov.za/docs/misc/2004/sec1.pdf]
- Stringer JS, Zulu I, Levy J, Stringer EM, Mwango A, Chi BH, Mtonga V, Reid S, Cantrell RA, Bulterys M, Saaq MS, Marlink RG, Mwinqa A, Ellerbrock TV, Sinkala M: Rapid Scale-up of Antiretroviral Therapy at Primary Care Sites in Zambia - Feasibility and Early Outcomes. JAMA. 2006, 296: 782-793. 10.1001/jama.296.7.782.View ArticlePubMedGoogle Scholar
- Coetzee D, Hildebrand K, Boulle A, Maartens G, Louis F, Labatala V, Reuter H, Ntwana N, Goemaere E: Outcomes after two years of providing antiretroviral treatment in Khayelitsha, South Africa. AIDS. 2004, 18: 887-95. 10.1097/00002030-200404090-00006.View ArticlePubMedGoogle Scholar
- van Griensven J, Zachariah R, Rasschaert F, Mugabo J, Atte EF, Reid T: Stavudine- and nevirapine-related drug toxicity while on generic fixed-dose antiretroviral treatment: incidence, timing and risk factors in a three-year cohort in Kigali, Rwanda. Trans R Soc Trop Med Hyg. 2010, 104: 148-53. 10.1016/j.trstmh.2009.07.009.View ArticlePubMedGoogle Scholar
- Geddes R, Knight S, Moosa MY, Reddi A, Uebel K, Sunpath H: A high incidence of nucleoside reverse transcriptase inhibitor (NRTI)-induced lactic acidosis in HIV-infected patients in a South African context. S Afr Med J. 2006, 96: 722-4.PubMedGoogle Scholar
- Wester CW, Okezie OA, Thomas AM, Bussmann H, Moyo S, Muzenda T, Makhema J, van Widenfelt E, Musonda R, Novitsky V, Gaolathe T, Ndwapi N, Essex M, Kuritzkes DR, DeGruttola V, Marlink RG: Higher-than-expected rates of lactic acidosis among highly active antiretroviral therapy-treated women in Botswana: preliminary results from a large randomized clinical trial. J Acquir Immune Defic Syndr. 2007, 46: 318-22. 10.1097/QAI.0b013e3181568e3f.View ArticlePubMedGoogle Scholar
- Mutimura E, Stewart A, Rheeder P, Crowther NJ: Metabolic function and the prevalence of lipodystrophy in a population of HIV-infected African subjects receiving highly active antiretroviral therapy. J Acquir Immune Defic Syndr. 2007, 46: 451-5. 10.1097/QAI.0b013e318158c0a6.View ArticlePubMedPubMed CentralGoogle Scholar
- Carr A, Emery S, Law M, Puls R, Lundgren JD, Powderly WG: An objective case definition of lipodystrophy in HIV-infected adults: a case-control study. Lancet. 2003, 361: 726-735. 10.1016/S0140-6736(03)12656-6.View ArticlePubMedGoogle Scholar
- Sanne I, Westreich D, Macphail AP, Rubel A, Majuba P, Van Rie A: Long term outcomes of antiretroviral therapy in a large HIV/AIDS care clinic in urban South Africa: a prospective cohort study. J Int AIDS Soc. 2009, 12: 753-760.View ArticleGoogle Scholar
- WHO: Addendum to the 2006 WHO guidelines on antiretroviral therapy for HIV infection in adults and adolescents. Last accessed on the 09/12/2010, [http://www.who.int/hiv/art/ARTadultsaddendum.pdf]
- WHO: Antiretroviral therapy for HIV infection in adults and adolescents: Recommendations for a public health approach (2010 version). Last accessed on the 09/12/2010, [http://whqlibdoc.who.int/publications/2010/9789241599764_eng.pdf]
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/11/244/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.