We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Defining cognitive impairment in people-living-with-HIV: the POPPY study
BMC Infectious Diseasesvolume 16, Article number: 617 (2016)
The reported prevalence of cognitive impairment (CI) varies widely in cohorts of people living with HIV (PLWH); this may partly be due to the use of different diagnostic criteria. Agreement between diagnostic criteria of CI, the optimal definition to use, and associations with patient-reported cognitive symptoms have not been fully investigated.
Two hundred ninety PLWH aged >50 years and 97 matched negative controls completed a detailed assessment of cognitive function and three questions regarding cognitive symptoms. Age- and education-adjusted test scores (T-scores) determined if subjects met the following definitions of CI: Frascati, global deficit score (GDS) and the multivariate normative comparison (MNC) method.
PLWH were more likely than controls to meet each definition of CI (ORs were 2.17, 3.12 and 3.64 for Frascati, GDS and MNC, respectively). Agreement of MNC with Frascati and GDS was moderate (Cohen’s k = 0.42 and 0.48, respectively), whereas that between Frascati and GDS was good (k = 0.74). A significant association was found between all the three criteria and reporting of memory loss but not with attention and reasoning problems. The 41 (14 %) PLWH meeting all the three criteria had the lowest median global T-score (36.9) and highest rate of symptom reporting (42 %).
Different CI criteria show fair diagnostic agreement, likely reflecting their ability to exclude CI in the same group of individuals. Given the lower overall cognitive performance and higher rates of symptom reporting in those meeting all three criteria of CI, further work assessing this as a definition of CI in PLWH is justified.
In recent years, despite the introduction of combination antiretroviral therapy (ART), a high but varying prevalence of cognitive impairment (CI) has been reported among HIV-positive individuals. Robertson et al.  described a 26 % prevalence of CI among HIV-positive subjects who had received ART for at least 20 weeks, while Heaton et al.  reported a prevalence of 36 % among ART-treated asymptomatic individuals. Among those with long-standing viral suppression, Winston et al.  and Simioni et al.  reported prevalences of 51 and 74 %, respectively.
The optimal screening tools to identify CI are unknown. The current European AIDS Clinical Society (EACS) guidelines recommend three questions as one form of assessment to guide the initial evaluation of HIV-positive individuals with suspected cognitive problems . These patient-reported measures may be a quick and practical method of screening for cognitive impairment in clinical practice, however, doubts about their utility remain . When cognitive function is assessed through objective neuropsychological tests, differences in the reported prevalence of CI may be due to the use of different diagnostic criteria. Three criteria in current use include the ‘Frascati’ criteria, proposed by Antinori et al.  and also known as HIV-associated neurocognitive disorder (HAND) criteria, the global deficit score (GDS)  and the multivariate normative comparison (MNC) . These criteria differ in the way they combine scores from a battery of neuropsychological tests to classify subjects as either cognitively impaired or normally functioning. Several studies have reported contrasting results when using different criteria of CI on the same set of patients [10, 11]. However, they only assessed prevalence rates by criteria and did not specifically investigate whether they identified the same people as impaired/not impaired.
The associations between CI and patient-reported outcomes of cognitive function have not been fully investigated and remain unclear. Some studies have found a relationship between subjective cognitive complaints and actual impairment in neuropsychological tests [12, 13], while other studies have not [14, 15]. While these studies tended to include high rates of untreated or unsuppressed subjects, there is currently a lack of data relating cognitive function with self-reported cognitive complaints in populations of well-treated HIV-positive individuals.
The aims of this study are threefold. Firstly, to compare the prevalence of CI in HIV-positive individuals over 50 years of age and demographically matched HIV-negative controls according to the Frascati criteria, GDS and MNC and combinations of these definitions. Secondly, to assess the level of agreement between these three criteria when identifying HIV-positive people with CI. Finally, to investigate the association between different definitions of CI and their combination with patient-reported symptoms of cognitive dysfunction.
Study design and participants
The Pharmacokinetic and Clinical Observations in People Over Fifty (POPPY) study is a prospective, multicentre, observational study that aims to examine the effects of ageing on the clinical outcomes of people living with HIV in UK and Ireland. To address its aims the study has established cohorts of HIV-positive people aged over 50, younger HIV-positive controls less than 50 years old and demographically matched HIV-negative controls aged over 50 years. For the present analysis only the two older cohorts were considered as the purpose of the younger HIV-positive cohort is to provide a younger control group which is not directly relevant to this analysis. HIV-positive participants were recruited at HIV outpatient clinics around UK and Ireland. Inclusion criteria were: documented presence of HIV infection, self-defined white or black-African ethnicity, likely route of HIV acquisition via sexual exposure (either by male to male exposure if white or by heterosexual exposure if white or black-African) and ability to comprehend the study patient information leaflet. HIV-negative controls were frequency matched to the HIV-positive group on gender, ethnicity, sexual orientation and location (in or out of London) and were recruited from sexual health clinics affiliated with the HIV clinics, as well as from community events, churches, adverts in targeted publications and community groups. Recruitment was from January 2013 to September 2014. The study was approved by the UK National Research Ethics Service (NRES; Fulham London, UK number 12/LO/1409). Written informed consent was obtained from all participants prior to undertaking any study specific procedures.
All enrolled participants completed questionnaires detailing physical and mental health status. In particular, participants answered the three questions on cognitive symptoms described by the EACS guidelines  regarding memory loss (do you experience frequent memory loss [e.g., do you forget the occurrence of special events even the more recent ones, appointments, etc.]?), reasoning (do you feel that you are slower when reasoning, planning activities, or solving problems?) and attention (do you have difficulties paying attention [e.g., to a conversation, book or movie]?). Individuals answering ‘Yes, definitely’, as opposed to ‘Never’ and ‘Hardly ever’ were classified as experiencing the related cognitive symptom. In addition a positive answer to at least two of the three questions was considered indicative of self-reported cognitive problems.
Assessment of cognitive function
Assessment of cognitive function was performed using the CogState battery , a computerized battery of neuropsychological tests that has been used in different clinical settings [17–20], including HIV-positive cohorts [21–24]. The battery covered six cognitive domains commonly affected by HIV-associated CI, including visual learning, psychomotor function, visual attention, executive function, verbal learning and working memory (see Additional file 1: Table S1 for details of individual tests and how they map onto cognitive domains). Raw test scores were log-transformed or arcsine root–transformed where necessary (as recommended by the CogState guidelines for analysis) and converted into demographically-adjusted T scores (with a mean of 50 and a standard deviation of 10) using the scores of the HIV-negative group as normative scores. Briefly, a linear regression was fit for each test in order to estimate regression coefficients for age, gender, ethnicity and education using scores from the HIV-negative group. These regression coefficients were then used to determine the normative scores depending on subjects’ age, gender, ethnicity and education. The difference between the normative score and the actual score for each subject was then standardized into T-scores. A single T-score was calculated for each of the 6 cognitive domains by averaging individual test T-scores within each domain. A global T-score was also obtained by averaging T-scores across the six domains. For all T-scores a higher value indicates better cognitive function.
Classification of CI
For each subject, the T-scores were then used to determine if the individuals met three definitions of CI, Frascati, GDS and MNC, using published methods. Frascati and GDS are the most extensively adopted definitions in previous studies of CI in HIV, while the MNC is a relatively newer approach showing promising results in reducing the false positive rate . First, according to the Frascati criteria , CI was defined as at least two cognitive domain T-scores below 40 (i.e., one or more standard deviations below the average normative score). Second, a GDS  was computed for each subject by converting domain T-scores into deficit scores (0: T-score ≥ 40, 1: 34 < T-score < 40, 2: 29 < T-score ≤ 34, 3: 24 < T-score ≤ 29, 4: 19 < T-score ≤ 24, 5: T-score ≤ 19). An overall GDS was obtained by averaging domain deficit scores and CI was defined as a mean score equal or greater than 0.5. Finally, the MNC method  was applied. The MNC is a statistical method that simultaneously compares multiple cognitive scores of each study participant to the average scores of the same tests in the control group (in our case the HIV-negative group), taking into account the variances and covariance between all scores. For each participant, a continuous measure of the deviation of the participant’s cognitive profile from the average cognitive profile in the control group is then obtained. If this deviation (also called Hotelling’s T2) exceeds a critical value associated with a 5 % significance the individual is classified as cognitively impaired (so that the chance of erroneously concluding that an individual has CI while this is not the case, i.e., the false positive rate, is approximately 5 %). Definitions of CI included the three criteria listed above plus all combinations of patients meeting individual criteria and two or all three of these criteria.
Group comparisons of baseline characteristics were assessed using Chi-square, Wilcoxon rank-sum and t-tests (two-tailed) as appropriate. Comparisons of the prevalence of CI in HIV-positive and HIV-negative persons were performed using the Chi-square test with odds ratios used to provide a comparative estimate of the prevalence in the two groups. The agreement between criteria of CI was assessed using Cohen’s κ statistics  and interpreted following Landis and Koch  guidelines. The null hypothesis that Cohen’s κ equals zero (i.e., no agreement between criteria other than what would be expected by chance) was tested using the asymptotic test . Internal consistency between the three patient-reported cognitive problems was assessed using Cronbach’s α. Associations between each definition of CI and self-reported cognitive problems were assessed using the Chi-square test. All analyses were performed using SAS v9.4 with p-values <0.05 considered as statistically significant.
A total of 290 HIV-positive and 97 HIV-negative participants were enrolled into the study between January 2013 and September 2014 and completed the CogState battery. Demographic, lifestyle and HIV-related characteristics are summarised in Table 1. Groups were highly comparable in terms of age (median age [IQR] was 57 [53, 62] and 58 [54, 62] years in HIV-positive and HIV-negative participants, respectively; p = 0.22), ethnicity (p = 0.47), country of birth (p = 0.92), educational attainment (p = 0.14), alcohol consumption (p = 0.13) and smoking status (p = 0.79). HIV-positive participants were more likely to be male (88.3 % vs. 66.0 %, p < 0.01), gay or homosexual (71.7 % vs. 41.2 %, p < 0.01) and to have reported recreational drug use in the 6 months preceding study entry (27.9 % vs. 12.4 %, p < 0.01) compared to HIV-negative controls. HIV-positives had been diagnosed with HIV for a median (IQR) of 16.8 (10.2, 22.9) years previously, and around 96.9 % were on ART with a median (IQR) CD4+ cell count of 610 (478, 780) cells/μL.
Cognitive test results and prevalence of CI
Overall performance of HIV-positive subjects was poorer than HIV-negative controls with a median (IQR) global T-score of 48.6 (43.5, 52.3) compared to 50.8 (46.0, 55.7) for the controls (p < 0.01). Significantly lower scores in the HIV-positive group, as compared to the HIV-negative group, were found for the cognitive domains: psychomotor function (median [IQR]: 48.4 [40.5, 54.4] vs 50.8 [45.4, 57.0], p < 0.01), visual attention (48.6 [39.7, 55.0] vs 50.9 [44.5, 57.0], p = 0.03) and verbal learning (47.0 [38.9, 53.6] vs 51.6 [45.3, 57.2], p < 0.01). In contrast, no significant group difference was found for the cognitive domains of visual learning (49.3 [42.7, 54.0] vs 50.8 [46.0, 55.7], p = 0.06), executive function (50.5 [45.9, 55.4] vs 50.4 [46.2, 54.8], p = 0.83) and working memory (50.1 [43.9, 54.4] vs 51.4 [46.0, 54.9], p = 0.15). The prevalence of CI in the HIV-positive group varied from 34.5 % according to GDS, 30.0 % according to Frascati and 22.1 % for the MNC. Similarly, the prevalence of CI varied in the HIV-negative group from 14.4 % (GDS) to 16.5 % (Frascati) and 7.2 % (MNC). According to all the three criteria, HIV-positive participants were significantly more likely of having CI than HIV-negative controls; OR (95 % CI) were 2.17 (1.20–3.92, p = 0.01) for Frascati, 3.12 (1.69–5.78, p < 0.01) for GDS and 3.64 (1.61–8.24, p < 0.01) for MNC.
Agreement between definitions of CI
Overlap in the classification of CI between the three criteria and Cohen’s κ statistics are reported in Fig. 1. Overall 169 (58.3 %) HIV-positive individuals did not meet any of the three definitions of CI while 41 (14.1 %) were classified as cognitively impaired by all the three definitions. Thirty-six (12.4 %) met Frascati and GDS only, 10 (3.4 %) met GDS and MNC only and 2 (0.7 %) met Frascati and MNC only. Frascati and GDS showed a substantial agreement (κ = 0.74, p < 0.01) while Frascati and MNC, and GDS and MNC showed moderate agreement (κ = 0.42 and κ = 0.48, respectively; p < 0.01 for each). Definitions showed better agreement when tested on the HIV-negative group: κ = 0.84 (p < 0.01) for Frascati and GDS, κ = 0.57 (p < 0.01) for Frascati and MNC and κ = 0.53 (p < 0.01) for GDS and MNC. Cognitive scores in individual domains of HIV-positive individuals meeting each of the three definition were similar (Fig. 2).
Association between definitions of CI and self-reported cognitive problems
Overall, 14, 15 and 17 HIV-positive individuals did not answer or had missing information on memory loss, reasoning and attention problems, respectively. Among those with complete information, 79 (28.6 %) reported frequent memory loss, 105 (38.2 %) reported reasoning problems and 79 (28.9 %) attention problems; moreover 90 (32.5 %) reported at least two of the three problems. Internal consistency of the three patient-reported measures was excellent with a Cronbach’s α (95 % CI) of 0.9 (0.82, 0.98). A significant association was found between memory loss and all the three definitions of CI (Table 2): using the Frascati criteria, 38 % of subjects with CI reported frequent memory loss, while only 25 % did so among those without CI (p = 0.02), with GDS the proportions were 40 and 23 % (p < 0.01) for those with and without CI, respectively, and with MNC 41 and 25 % (p = 0.02). There was no strong evidence for associations between reasoning problems and self-reported attention problems with definitions of CI, regardless of the definition (Reasoning: p = 0.77, p = 0.24 and p = 0.42 for Frascati, GDS and MNC, respectively; Attention: p = 0.59, p = 0.07 and p = 0.28 for Frascati, GDS and MNC, respectively).
Cognitive function and self-reported symptoms and overlap between definitions of CI
Those meeting all three definitions (n = 41, 14.1 %) had a low median global T-score (36.9, Fig. 3), indicating poorer cognitive function, and approximately 41.5 % reported at least two of memory loss, reasoning and attention problems. In particular, performances in the psychomotor (median score: 26) and visual attention (33.1) domains were particularly poor. The 36 (12.4 %) subjects with CI according to Frascati and GDS (but not MNC) demonstrated similar cognitive function: 13 of them (36.1 %) reported at least two cognitive problems and the median global T-score was 41.9. On the other hand, the 11 (3.8 %) subjects identified as cognitively impaired only by MNC performed generally better (median global T-score equals to 48.0) and a lower proportion (18.2 %) reported two or more cognitive problems.
HIV-positive individuals exhibit poorer cognitive function when compared to an appropriate HIV-negative control group. Although the difference in the overall cognitive score is statistically significant, this would not be considered clinically meaningful (for T-scores, a 5-point difference is usually considered relevant from a clinical point of view ). The prevalence of CI in older HIV-positive individuals may vary from 35 to 22 % depending on the criteria used.
Commonly-used criteria of CI show fair agreement, especially Frascati and GDS. However, this agreement is mainly driven by the ability of criteria to exclude CI in the same set of subjects rather than their ability to identify CI. As expected, subjects meeting all the criteria have generally poorer cognitive function (with particularly poor performances in the psychomotor and visual attention domains) and are more likely to experience cognitive problems. Similar cognitive scores were also observed in subjects classified as impaired by Frascati and GDS (but not MNC).
Consistent with several published studies [14, 15], but contrary to others [12, 13], the associations with self-reported cognitive symptoms are generally poor for all the three definitions of CI considered. Whilst CI, defined with all three criteria, correlate with memory loss, this is not the case for either attention or reasoning problems. These results, based on a cohort of mainly treated and virally-suppressed subjects, shed further light on the association between patient-reported and objective cognitive impairment in the post-ART era. The lack of association found may reflect the pattern of cognitive changes we observed, namely, poorer verbal learning (which may relate to patient reported memory problems) but no significant differences in executive function (reasoning) or working memory (attention). These results suggest a potential lack of a clear relationship between subjective measures of cognitive function and more objective measures based on neuropsychological tests, particularly in those with mild impairment. Several reasons may account for this lack of association, such as the over-reporting of cognitive symptoms and the subjectivity of the EACS questions. Moreover, depressive disorders have been previously reported to affect both subjective and objective cognitive function , and can therefore confound the association between the two. We did not co-vary depression in our analyses, but from preliminary analysis, depression did not seem to change the associations between definitions of CI and patient-reported symptoms (data not shown).
A missing answer to questions about cognitive complaints may, in theory, be informative as it may indicate poor understanding or attention. However, almost 95 % of data was complete so it’s unlikely that the exclusion of this small group of individuals from analyses has introduced substantial bias. Although ART prescribing was in line with national guidelines, 3.1 % of enrolled HIV-positive individuals were not receiving suppressive antiretroviral therapy at study entry. This is justified by the aim of the study of recruiting a ‘real-world’ sample of PLWH in UK and Ireland. Nonetheless those not receiving ART had a median CD4+ cell count of 664 cells/μL, which makes it unlikely that lack of suppression of HIV replication in a minority of the sample has led to substantial bias to our findings.
Given the lack of a gold standard in defining CI, it is difficult to ascertain the validity of different definitions. An optimal definition of CI would capture subjects with the lowest cognitive performance scores and the greatest number of cognitive symptom complaints. In our study we observed the lowest overall cognitive score in subjects meeting all three definitions (median global T-score of 36.9 for those meeting Frascati, MNC and GDS). Moreover, in this group of subject, the number reporting cognitive complaints was highest (41.5 %). Given these findings, we consider further work to assess longitudinal outcomes in HIV-positive individuals meeting this definition of CI within the POPPY study, compared to other definitions of cognitive impairment, is justified.
Other definitions of cognitive impairment in PLWH, such as the Frascati criteria, have been criticised for overcalling the number of PLWH with cognitive deficits . On the converse argument, the Frascati criteria has attempted to define the presence of cognitive deficits prior to the onset of clinical symptomatology and classifies large numbers of subjects with CI. The rationale behind such criteria being interventions at an early stage of disease, if effective, may prevent the onset of clinically apparent conditions. However, to date, longitudinal data both in the HIV-field and in other neurodegenerative diseases have not provided convincing evidence for the diagnosis of a pre-morbid cognitive state [30, 31].
There are several other problems when utilising non-stringent definitions of CI. Firstly, as large numbers of patients will meet a diagnostic criteria, unnecessary anxiety for patients could be created. Secondly, non-stringent definitions will include subjects with cognitive impairment but will also include subjects who do not have cognitive impairment. Within interventional trials, this may lead to the null hypothesis being proven when in fact an intervention does work. By including patients without a disease state in an interventional study, the results of the study may suggest an effective interventions has no effect whereas, if the effective intervention was trialled in the diseased population, an effect may be observed.
Commonly-used criteria of CI show fair agreement, especially in identifying subjects without CI. However their association with patient-reported symptoms is generally weak and we hypothesise that our POPPY Study definition of cognitive impairment may be a pragmatic approach to adopt at the current time. Our definition, by defining subjects with the highest rates of symptomatology and the lowest global cognitive score is likely to capture patients with true pathological cognitive impairment and requires validation within other HIV-cohorts and in longitudinal settings.
European AIDS Clinical Society
Global deficit score
HIV-associated neurocognitive disorder
Multivariate normative comparison
People living with HIV
Pharmacokinetic and Clinical Observations in People Over Fifty
Robertson KR, Smurzynski M, Parsons TD, Wu K, Bosch RJ, Wu J, et al. The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS. 2007;21(14):1915–21.
Heaton RK, Franklin DR, Ellis RJ, McCutchan JA, Letendre SL, LeBlanc S, et al. HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: differences in rates, nature, and predictors. J Neurovirol. 2011;17(1):3–16. doi:10.1007/s13365-010-0006-1.
Winston A, Arenas-Pinto A, Stöhr W, Fisher M, Orkin CM, Aderogba K, et al. Neurocognitive function in HIV infected patients on antiretroviral therapy. 2013.
Simioni S, Cavassini M, Annoni J-M, Abraham AR, Bourquin I, Schiffer V, et al. Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS. 2010;24(9):1243–50.
EACS. Guidelines version 8.0 October 2015. 2015.
Reid LM, MacLullich AM. Subjective memory complaints and cognitive impairment in older people. Dement Geriatr Cogn Disord. 2006;22(5-6):471–85.
Antinori A, Arendt G, Becker J, Brew B, Byrd D, Cherner M, et al. Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007;69(18):1789–99.
Carey CL, Woods SP, Gonzalez R, Conover E, Marcotte TD, Grant I, et al. Predictive validity of global deficit scores in detecting neuropsychological impairment in HIV infection. J Clin Exp Neuropsychol. 2004;26(3):307–19.
Huizenga HM, Smeding H, Grasman RPPP, Schmand B. Multivariate normative comparisons. Neuropsychologia. 2007;45(11):2534–42. http://dx.doi.org/10.1016/j.neuropsychologia.2007.03.011.
Su T, Schouten J, Geurtsen GJ, Wit FW, Stolte IG, Prins M, et al. Multivariate normative comparison, a novel method for more reliably detecting cognitive impairment in HIV infection. AIDS. 2015;29(5):547–57. doi:10.1097/qad.0000000000000573.
Gisslén M, Price RW, Nilsson S. The definition of HIV-associated neurocognitive disorders: are we overestimating the real prevalence? BMC Infect Dis. 2011;11(1):1.
Knippels HM, Goodkin K, Weiss JJ, Wilkie FL, Antoni MH. The importance of cognitive self-report in early HIV-1 infection: validation of a cognitive functional status subscale. AIDS. 2002;16(2):259–67.
Carter SL, Rourke SB, Murji S, Shore D, Rourke BP. Cognitive complaints, depression, medical symptoms, and their association with neuropsychological functioning in HIV infection: a structural equation model analysis. Neuropsychology. 2003;17(3):410.
Hinkin CH, van Gorp WG, Satz P, Marcotte T, Durvasula RS, Wood S, et al. Actual versus self-reported cognitive dysfunction in HIV-1 infection: memory-metamemory dissociations. J Clin Exp Neuropsychol. 1996;18(3):431–43.
Van Gorp WG, Satz P, Hinkin C, Selnes O, Miller EN, McArthur J, et al. Metacognition in HIV-1 seropositive asymptomatic individuals: self-ratings versus objective neuropsychological performance. J Clin Exp Neuropsychol. 1991;13(5):812–9.
Cogstate website. 2016. https://cogstate.com/. Accessed 17 October 2016.
Darby DG, Pietrzak RH, Fredrickson J, Woodward M, Moore L, Fredrickson A, et al. Intraindividual cognitive decline using a brief computerized cognitive screening test. Alzheimers Dement. 2012;8(2):95–104.
Harrison J, Maruff P. Measuring the mind: assessing cognitive change in clinical drug trials. Expert Rev Clin Pharmacol. 2008;1(4):471.
Maruff P, Thomas E, Cysique L, Brew B, Collie A, Snyder P, et al. Validity of the CogState brief battery: relationship to standardized tests and sensitivity to cognitive impairment in mild traumatic brain injury, schizophrenia, and AIDS dementia complex. Arch Clin Neuropsychol. 2009;24(2):165–78.
Steinberg SI, Sammel MD, Harel BT, Schembri A, Policastro C, Bogner HR, et al. Exercise, sedentary pastimes, and cognitive performance in healthy older adults. Am J Alzheimers Dis Other Demen. 2015; 30(3):290-98.
Cysique LA, Maruff P, Darby D, Brew BJ. The assessment of cognitive function in advanced HIV-1 infection and AIDS dementia complex using a new computerised cognitive test battery. Arch Clin Neuropsychol. 2006;21(2):185–94.
McDonnell J, Haddow L, Daskalopoulou M, Lampe F, Speakman A, Gilson R, et al. Minimal cognitive impairment in UK HIV-positive men who have sex with men: effect of case definitions and comparison with the general population and HIV-negative men. J Acquir Immune Defic Syndr (1999). 2014;67(2):120.
Overton ET, Kauwe JS, Paul R, Tashima K, Tate DF, Patel P, et al. Performances on the CogState and standard neuropsychological batteries among HIV patients without dementia. AIDS Behav. 2011;15(8):1902–9.
Garvey LJ, Yerrakalva D, Winston A. Correlations between computerized battery testing and a memory questionnaire for identification of neurocognitive impairment in HIV type 1-infected subjects on stable antiretroviral therapy. AIDS Res Hum Retrovir. 2009;25(8):765–9.
Fleiss JL, Cohen J, Everitt B. Large sample standard errors of kappa and weighted kappa. Psychol Bull. 1969;72(5):323.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. John Wiley & Sons, New York; 2013.
Nakasujja N, Miyahara S, Evans S, Lee A, Musisi S, Katabira E, et al. Randomized trial of minocycline in the treatment of HIV-associated cognitive impairment. Neurology. 2013;80(2):196–202.
Fellows RP, Byrd DA, Morgello S. Major depressive disorder, cognitive symptoms, and neuropsychological performance among ethnically diverse HIV+ men and women. J Int Neuropsychol Soc. 2013;19(02):216–25.
Heaton RK, Franklin DR, Deutsch R, Letendre S, Ellis RJ, Casaletto K, et al. Neurocognitive change in the era of HIV combination antiretroviral therapy: the longitudinal CHARTER study. Clin Infect Dis. 2015;60(3):473–80.
Donovan NJ, Amariglio RE, Zoller AS, Rudel RK, Gomez-Isla T, Blacker D, et al. Subjective cognitive concerns and neuropsychiatric predictors of progression to the early clinical stages of Alzheimer disease. Am J Geriatr Psychiatry. 2014;22(12):1642–51.
POPPY Management Team: Marta Boffito, Paddy Mallon, Frank Post, Caroline Sabin, Memory Sachikonye, Alan Winston
Scientific Steering Committee: Jane Anderson, David Asboe, Marta Boffito, Lucy Garvey, Paddy Mallon, Frank Post, Anton Pozniak, Caroline Sabin, Memory Sachikonye, Jaime Vera, Ian Williams, Alan Winston
POPPY Sites and Trials Unit:
• Elton John Centre, Brighton and Sussex University Hospital (Martin Fisher, Amanda Clarke, Jaime Vera, Andrew Bexley, Celia Richardson)
• St Stephen’s Centre, Chelsea and Westminster Hospital (Marta Boffito, David Asboe, Anton Pozniak, Chris Higgs, Elisha Seah, Stephen Fletcher, Michelle Anthonipillai, Ashley Moyes, Katie Deats)
• Homerton Sexual Health Services, Homerton University Hospital (Jane Anderson, Sifiso Mguni, Rebecca Clark, Rhiannon Nevin-Dolan)
• Caldecot Centre, King’s College Hospital (Frank Post, Lucy Campbell, Selin Yurdakul, Sara Okumu, Louise Pollard)
• HIV Molecular Research Group, Mater Misericordiae University Hospital (Paddy Mallon, Alan Macken, Bijan Ghavani-Kia, Joanne Maher, Maria Byrne, Ailbhe Flaherty)
• Department of Infection and Population Health, University College London (Ian Williams, Damilola Otiko, Laura Phillips)
• St. Mary’s Hospital London, Imperial College Healthcare NHS Trust (Alan Winston, Lucy Garvey, Matthew Stott, Linda McDonald)
• Imperial Clinical Trials Unit, Imperial College London (Andrew Whitehouse, Laura Burgess, Daphne Babalis)
The POPPY study is funded from investigator initiated grants from BMS, Gilead Sciences, Janssen, Merck and ViiV Healthcare (EudraCT Number: 2012-003581-40; Sponsor Protocol Number: CRO1992).
Availability of data and materials
Authors do not wish to share the data in compliance of the consent agreement signed by all study participants.
DDF contributed to study concept and design, analysis and interpretation of data, drafting of manuscript. JU contributed to study concept and design, interpretation of data, critical revision of manuscript. FAP contributed to the acquisition of data, critical revision of manuscript. JHV, IW, MB, MS, JA, PWGM contributed to the acquisition of data. AW and CAS contributed to study concept and design, interpretation of data, critical revision of manuscript. All authors read and approved the final manuscript.
A.W. has received honoraria or research grants from or been a consultant or investigator in clinical trials sponsored by Abbott, Boehringer Ingelheim, Bristol-Myers Squibb, Gilead Sciences, GlaxoSmithKline, Janssen-Cilag, Roche, Pfizer and ViiV Healthcare. Other authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study was approved by the UK National Research Ethics Service (NRES; Fulham London, UK number 12/LO/1409). Written informed consent was obtained from all participants prior to undertaking any study specific procedures.
Cognitive tests administered by cognitive domain. (DOCX 13 kb)