- Research article
- Open Access
The transition to Xpert MTB/RIF ultra: diagnostic accuracy for pulmonary tuberculosis in Kampala, Uganda
BMC Infectious Diseases volume 21, Article number: 49 (2021)
The World Health Organization (WHO) has endorsed the next-generation Xpert MTB/RIF Ultra (Ultra) cartridge, and Uganda is currently transitioning from the older generation Xpert MTB/RIF (Xpert) cartridge to Ultra as the initial diagnostic test for pulmonary tuberculosis (TB). We assessed the diagnostic accuracy of Ultra for pulmonary TB among adults in Kampala, Uganda.
We sampled adults referred for Xpert testing at two hospitals and a health center over a 12-month period. We enrolled adults with positive Xpert and a random 1:1 sample with negative Xpert results. Expectorated sputum was collected for Ultra, and for solid and liquid culture testing for Xpert-negative patients. We measured sensitivity and specificity of Ultra overall and by HIV status, prior history of TB, and hospitalization, in reference to Xpert and culture results. We also assessed how classification of results in the new “trace” category affects Ultra accuracy.
Among 698 participants included, 211 (30%) were HIV-positive and 336 (48%) had TB. The sensitivity of Ultra was 90.5% (95% CI 86.8–93.4) and specificity was 98.1% (95% CI 96.1–99.2). There were no significant differences in sensitivity and specificity by HIV status, prior history of TB or hospitalization. Xpert and Ultra results were concordant in 670 (96%) participants, with Ultra having a small reduction in specificity (difference 1.9, 95% CI 0.2 to 3.6, p=0.01). When “trace” results were considered positive for all patients, sensitivity increased by 2.1% (95% CI 0.3 to 3.9, p=0.01) without a significant reduction in specificity (− 0.8, 95% CI − 0.3 to 2.0, p=0.08).
After 1 year of implementation, Ultra had similar performance to Xpert. Considering “trace” results to be positive in all patients increased case detection without significant loss of specificity. Longitudinal studies are needed to compare the benefit of greater diagnoses to the cost of overtreatment.
Nucleic acid amplification testing (NAAT) is recommended by the World Health Organization (WHO) as an initial test for pulmonary TB. In particular, WHO has endorsed Xpert MTB/RIF (Cepheid, Sunnyvale, CA USA), and 34.4 million Xpert MTB/RIF (Xpert) cartridges have been procured globally . However, Xpert sensitivity has been sub-optimal for smear-negative pulmonary TB . Consequently, the next-generation cartridge, Xpert MTB/RIF Ultra (Ultra), includes two multi-copy amplification targets, a larger DNA reaction chamber, and fully nested nucleic acid amplification to lower the limit of detection from 113 colony forming units (cfu)/mL to 16 cfu/ml, which is similar to growth detection . Based on a multi-center assessment demonstrating increased sensitivity , the WHO recommended that Ultra replace Xpert as the initial diagnostic test .
Ultra cartridges are now expected to be widely used, including with the Gene Xpert Edge and Omni systems in lower-level facilities where patients more often seek initial medical care . While the hope is that the lower limit of detection will increase case detection of patients with less advanced disease, there is also concern for reduced specificity and increased false-positive results, particularly among the category of “trace” results or in patients with past tuberculosis history .
During Uganda’s transition from Xpert to Ultra, we conducted a 12-month cross-sectional study to 1) assess the diagnostic accuracy of Ultra for pulmonary TB in adults, 2) determine changes in accuracy by HIV, prior history of TB, and inpatient status, and 3) characterize the impact of trace results on Ultra accuracy.
Study design and population
From April 2018 to April 2019, we conducted a cross sectional study of patients with presumed pulmonary TB at Kiruddu Hospital pulmonary ward and outpatient chest clinic, Mulago Hospital TB ward, and Kisenyi Health Center IV outpatient clinic in Kampala, Uganda. As previously described , we included adults (> 18 years) who were referred by clinicians for sputum-based TB testing (i.e., Xpert). We excluded participants who received anti-TB treatment or antibiotics with anti-TB activity such as fluoroquinolones in the prior 12 months, or who refused or were unable to provide informed consent. To select participants, we reviewed the facility Xpert testing log daily. On each day, we enrolled all participants with Xpert-positive results and a random 1:1 sample of Xpert-negative patients identified from the log. The study and full protocol (available on request) was reviewed and approved by the Makerere University School of Medicine Research and Ethics Committee, the Uganda National Council for Science and Technology and the University of California San Francisco Committee on Human Research. This study was performed according to the Standards for Reporting of Diagnostic Accuracy Studies (STARD) guidelines .
After consent, all eligible participants completed a survey on demographics and medical history. Each participant provided up to two sputum samples: one for Ultra testing (all participants) and one for solid (Lowenstein-Jensen [LJ]) and liquid (BACTEC MGIT 960, Becton Dickinson, USA) mycobacterial cultures (Xpert-negative participants only). Positive cultures were confirmed using Ziehl-Neelsen (ZN) staining and M. tuberculosis (MTB) complex speciation testing (MPT64TB Ag kit, SD Bioline, South Korea). Trained laboratory technologists conducted all TB testing following standard protocols for Xpert, Ultra , and mycobacterial culture . Laboratory staff were blinded to Xpert results at the time of Ultra or culture testing. Participants with negative or unknown HIV status underwent HIV testing per national guidelines, and CD4 cell count was measured for HIV-positive participants. To assess any additional microbiological evidence for false-positive results, Determine TB LAM (Alere, Waltham, USA) was performed on urine samples following standard protocols .
We used a composite microbiological reference standard. Participants were defined as having pulmonary TB if MTB was detected by sputum Xpert or mycobacterial culture (solid or liquid). We considered patients not to have pulmonary TB if Xpert was negative and at least two culture results (solid or liquid) were negative without contamination. For the primary analysis, an Ultra-trace result was defined as TB if the participant was HIV positive per WHO recommendations .
Descriptive statistics were used to summarize the demographic and clinical characteristics of study participants. The sensitivity and specificity of sputum Xpert Ultra was calculated with exact binomial 95% confidence interval (CI) using our reference standard definition of TB. We compared sensitivity and specificity by HIV status, CD4 cell count category, prior history of TB, and inpatient status using Chi-squared or Fisher’s Exact test as appropriate. We conducted a sensitivity analysis on Ultra trace results, comparing diagnostic accuracy if trace results were considered positive for all participants or no participants using McNemar’s paired test of proportions. We used STATA 15 (Stata Corp, College Station, TX, USA) to perform all analyses.
Study population characteristics
During the 12-month study period, we identified 475 patients with positive Xpert results in the facility testing logs. Of the 475 patients, 311 (65%) met eligibility criteria and were enrolled (Fig. 1). We randomly selected and enrolled 387 Xpert-negative participants, of whom 25 were subsequently found to be culture-positive for MTB. Thus, 698 participants (336 with and 362 without TB) were included in the final analysis. The median age was 32 years (IQR 25–40), 436 (62%) were male, over a third (42%) had BMI < 18.5, and 211 (30%) were HIV-positive, of whom 46 (22%) had CD4 cell count < 100 cells/μL (Table 1). Most participants were identified in the outpatient setting (n=620, 89%), and the median Karnofsky score was 80 (IQR 70–90).
Diagnostic accuracy of Xpert ultra
Sputum Ultra had a sensitivity of 90.5% (95% CI 86.8 to 93.4) and specificity of 98.1% (95% CI 96.1–99.2) (Table 2). Xpert and Ultra were concordant in 670/698 (96%) participants. Of the 28 discordant results, 14 (50%) were Ultra-positive and Xpert-negative (7 culture-positive), while 14 were Ultra-negative but Xpert-positive. Consequently, the sensitivity of Ultra was not significantly different from that of Xpert (90.5% vs. 92.6%, difference − 2.1, 95% CI − 5 to + 0.1, p=0.1). However, the seven false-positive Ultra results led to a small reduction in specificity of 1.9% (95% CI 0.2 to 3.6, p=0.01) compared to Xpert. Of note, 18 participants with positive cultures (5% of 336 TB cases) had negative Xpert and Ultra results.
Among patients with positive Xpert and Ultra results, rifampicin resistance results were concordant in 285/297 (96%) patients. Three patients had rifampicin resistance detected by Ultra but not Xpert, and one patient had rifampicin resistance detected by Xpert but not Ultra. Rifampicin resistance results were indeterminate in two patients by Ultra (all due to trace results, Xpert RIF negative), and in one patient by Xpert (Ultra RIF negative). Two of the discordant results were missing on Ultra and were not resistant on Xpert, while the three results missing on Xpert were not resistant on Ultra.
Subgroup analysis of ultra performance
As shown in Table 2, Ultra sensitivity and specificity did not differ by HIV status (sensitivity difference 0.96, 95% CI − 6.1 to 8.0, p=0.79; specificity difference − 2.3, 95% CI − 6.0 to 1.33, p=0.1). Ultra sensitivity was also similar among HIV-positive patients with CD4 cell count < 100 cells/μL vs. higher CD4 cell counts (difference 8.6, 95% CI − 2.0 to 19.3, p=0.2). There was also no difference among patients with and without a prior history of TB (sensitivity 85.7% vs. 90.9%, difference − 5.2, 95% CI − 18.5 to 8.2, p=0.37; specificity 95.0% vs. 98.7%, difference − 3.7, 95% CI − 9.3 to 2.0, p=0.06) or among inpatients vs. outpatients (sensitivity 87.2% vs. 90.9%, difference 3.7, 95% CI − 7.3 to 14.7, p=0.46; specificity 100% vs 97.8%, difference 2.2, 95% CI 0.6 to 3.7, p=0.35).
False-positive and trace ultra results
Of the seven patients with false-positive Ultra results, four were HIV-positive (including one with CD4 cell count < 100 cells/μL), of which one had a prior history of TB and all had trace results. Of the remaining three HIV negative participants, two had a prior history of TB.
There were 21 trace Ultra results. Of the 11 HIV-positive patients with trace results (Table 3), eight had microbiological evidence of TB (two Xpert-positive with a very low semi-quantitative result, five culture-positive and one urine Determine TB LAM-positive). Of the 10 HIV-negative patients with trace results, 8 had microbiological evidence of TB (four Xpert positive with low [N=1] or very low [N=3] semi-quantitative results, three culture-positive, and one urine Determine TB LAM-positive). Thus, 16 of 21 (76%) patients with trace results had microbiologic evidence of TB.
We examined how classification of trace results impacted Ultra accuracy (Table 4). When trace results were defined as positive for all patients, Ultra sensitivity and specificity were 92.6% (95% CI 89.2 to 95.1) and 97.2% (95% CI 95.0 to 98.7), respectively, representing a 2.1% increase in sensitivity (95% CI 0.3 to 3.9, p=0.01) and a non-significant 0.8% reduction in specificity (95% CI − 0.3 to 2.0, p=0.08) compared to when trace results were considered to be positive only in HIV-positive patients as per WHO guidelines. When trace results were defined to be negative for all patients, Ultra sensitivity and specificity were 88.4% (95% CI 84.5 to 91.6) and 99.2% (95%CI 97.6 to 99.8), respectively, representing a 2.1% reduction in sensitivity (95% CI − 3.9 to − 0.3, p=0.01) and non-significant 1.1% increase in specificity (95% CI − 0.2 to 2.5, p=0.05) compared to the current guidelines.
As Uganda is transitioning from Xpert to Ultra, we found that Xpert Ultra had high sensitivity and specificity for pulmonary TB overall (90.5% sensitive and 98.1% specific) and across key sub-groups defined by HIV status, prior history of TB, and hospitalization. Expanding the definition of a positive test to include trace results among HIV-negative patients increased Ultra sensitivity without a significant loss of specificity. Our findings suggest that as Ultra replaces Xpert in Kampala for routine TB testing at health facilities, diagnostic accuracy may remain stable overall, but that expanding the definition of a positive test to include all trace results could increase case detection.
The accuracy of Ultra for pulmonary TB diagnosis was similar to previous studies. A recent meta-analysis of 10 studies found that Ultra could detect pulmonary TB with a sensitivity of 88.5% and specificity of 96.7% . Among HIV-positive patients, we also found a similar Ultra sensitivity to other studies in HIV-endemic settings that found an 87–90% sensitivity without significant difference compared to HIV-negative patients [3, 13]. Some studies have found that a previous history of TB reduced Ultra specificity [3, 14, 15], whereas we did not perhaps because we excluded patients who had TB in the past 1 year. The role of hospitalization has not been previously evaluated and we did not find a significant difference in inpatients vs. outpatients.
We did not find a significant difference in sensitivity of Xpert vs. Ultra. This is in contrast to a multicenter study that found Ultra was 5.4% more sensitive overall and 13% more sensitive in HIV-positive patients . The lower yield in our study is likely due to the small proportion of culture-positive patients that were not detected by Xpert (for example, 7% in our study compared to 17% in Dorman et al. ), and potentially the inclusion of Xpert in our reference standard. At the same time, multiple studies in Brazil and South Africa also had high concordance between Ultra and Xpert without a significant difference in overall sensitivity [13, 15, 16]. Nonetheless, this finding is surprising given that we had a high prevalence of HIV-positive patients and outpatients, both of whom would be expected to have lower bacillary burden and greater yield with Ultra over Xpert. In addition, 5% of culture-confirmed cases were both Ultra- and Xpert-negative. This underscores the continued need for novel diagnostics that can increase the yield of TB case detection in patients with paucibacillary disease.
The reduction in specificity of Ultra vs. Xpert has been documented in several studies [3, 13, 15, 17]. Four of seven false positive results were trace results among HIV positive patients, of which one had additional evidence of TB disease with a positive Determine TB LAM result. While this is consistent with past studies that found the majority of false positives were due to trace results [3, 13], we had few overall false positives and only three had a prior history of TB. As a consequence, we did not find a significant increase in specificity when trace results were defined as negative. Conversely, expanding the definition of a positive test to include trace results in HIV-negative patients increased sensitivity without a significant loss of specificity, because the majority of HIV-negative patients with trace results had microbiologically-confirmed TB.
The decision to define trace results as positive or negative requires a balance between greater case detection and cost of overtreatment . A modeling study found that while Ultra trace results increased overtreatment by more than 50%, it also averted deaths by that amount . The authors further concluded that Ultra and trace results will have the greatest benefit in settings with high HIV and TB prevalence and TB mortality. As Uganda is one of those settings, further cost-effectiveness studies are needed to guide the role of trace results, especially in facilities where health workers may not have access to culture or other testing to confirm the diagnosis.
To evaluate the performance of Ultra in Uganda, we enrolled a sample from three major medical centers in Kampala with high HIV prevalence . However, this study has some limitations. We did not confirm positive sputum Xpert results with culture, and did not confirm rifampin resistance with drug susceptibility testing. However, Xpert has been shown to have very high specificity (> 98%) for TB and rifampin resistance . As smear microscopy was not done on Xpert positive samples, we could not stratify Xpert Ultra performance by smear status. We also did not have the ability to have follow-up visits to repeat Ultra testing on trace results to assess additional yield. In addition, follow-up visits would have been helpful to further characterize patients with both false-positive and trace Ultra results.
As Uganda and similar high burden settings transition to Ultra, it is important to characterize the diagnostic accuracy and anticipate any change compared to Xpert for appropriate resource allocation to manage TB cases. Based on two hospitals and a health center in Kampala, Ultra has high accuracy for pulmonary TB among adults with and without HIV. Longitudinal studies are needed to characterize the ongoing impact of Xpert Ultra and trace results on TB case detection and management.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Human Immunodeficiency Virus
Nucleic acid amplification testing
World Health Organization
Xpert MTB/RIF Ultra
Cazabon D, Pande T, Kik S, Van Gemert W, Sohn H, Denkinger C, et al. Market penetration of Xpert MTB/RIF in high tuberculosis burden countries: A trend analysis from 2014–2016. Gates Open Res. 2018;2:35.
Chakravorty S, Simmons AM, Rowneki M, Parmar H, Cao Y, Ryan J, et al. The new Xpert MTB/RIF ultra: improving detection of mycobacterium tuberculosis and resistance to rifampin in an assay suitable for point-of-care testing. MBio. 2017;8(4):e00812–7.
Dorman SE, Schumacher SG, Alland D, Nabeta P, Armstrong DT, King B, et al. Xpert MTB/RIF ultra for detection of mycobacterium tuberculosis and rifampicin resistance: a prospective multicentre diagnostic accuracy study. Lancet Infect Dis. 2018;18(1):76–84.
World Health Organization. WHO meeting report of a technical expert consultation: Non-inferiority analysis of Xpert MTB/RIF Ultra compared to Xpert MTB/RIF. Available at: https://www.who.int/tb/publications/2017/XpertUltra/en/. Last accessed 4 Aug 2019.2017.
World Health Organization. Global tuberculosis report 2019.2019 14 Dec 2019. Available from: https://apps.who.int/iris/bitstream/handle/10665/329368/9789241565714-eng.pdf?ua=1.
Global Laboratory Initiative. Planning for country transition to Xpert® MTB/RIF Ultra Cartridges. Available at: http://www.stoptb.org/wg/gli/assets/documents/gli_ultra.pdf. Last Accessed 28 Jan 2020.
Andama A, Jaganath D, Crowder R, Asege L, Nakaye M, Katumba D, et al. Accuracy and incremental yield of urine Xpert MTB/RIF ultra versus determine TB-LAM for diagnosis of pulmonary tuberculosis. Diagn Microbiol Infect Dis. 2020;96(1):114892.
Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.
Stop TB Partnership Global Laboratory Initiative. Mycobacteriology Laboratory Manual. Available at: http://www.stoptb.org/wg/gli/assets/documents/gli_mycobacteriology_lab_manual_web.pdf. Last accessed 4 Aug 2019.2014.
World Health Organization. Lateral flow urine Lipoarabinomannan assay (LF-LAM): for the diagnosis and screening of active tuberculosis in people living with HIV. Geneva: World Health Organization; 2016. Available at https://www.who.int/tb/publications/factsheet_lf_lam.pdf. Last accessed 27 Jan 2020.
World Health Organization. WHO meeting report of a technical expert consultation: non-inferiority analysis of Xpert MTB/RIF ultra compared to Xpert MTB/RIF. Geneva: World Health Organization; 2017. Available at: https://www.who.int/tb/publications/2017/XpertUltra/en/. Last accessed 18 Jan 2020.
Zhang M, Xue M, J-q H. Diagnostic accuracy of the new Xpert MTB/RIF ultra for tuberculosis disease: a preliminary systematic review and meta-analysis. Int J Infect Dis. 2020;90:35–45.
Berhanu RH, David A, da Silva P, Shearer K, Sanne I, Stevens W, Scott L. Performance of Xpert MTB/RIF, Xpert Ultra, and Abbott RealTime MTB for Diagnosis of Pulmonary Tuberculosis in a High-HIV-Burden Setting. J Clin Microbiol. 2018;56(12):e00560-18. https://doi.org/10.1128/jcm.00560-18.
Esmail A, Tomasicchio M, Meldau R, Makambwa E, Dheda K. Comparison of Xpert MTB/RIF (G4) and Xpert ultra, including trace readouts, for the diagnosis of pulmonary tuberculosis in a TB and HIV endemic setting. Int J Infect Dis. 2020;95:246–52.
Mishra H, Reeve BWP, Palmer Z, Caldwell J, Dolby T, Naidoo CC, et al. Xpert MTB/RIF ultra and Xpert MTB/RIF for diagnosis of tuberculosis in an HIV-endemic setting with a high burden of previous tuberculosis: a two-cohort diagnostic accuracy study. Lancet Respir Med. 2020;8(4):368–82.
Pereira GR, Barbosa MS, Dias NJD, FDF d S, Rauber KA, Silva DR. Evaluation of Xpert MTB/RIF Ultra performance for pulmonary tuberculosis (TB) diagnosis in a city with high TB incidence in Brazil. Respir Med. 2020;162:105876.
Opota O, Zakham F, Mazza-Stalder J, Nicod L, Greub G, Jaton K. Added Value of Xpert MTB/RIF Ultra for Diagnosis of Pulmonary Tuberculosis in a Low-Prevalence Setting. J Clin Microbiol. 2019;57(2):e01717–8.
Kendall EA, Schumacher SG, Denkinger CM, Dowdy DW. Estimated clinical impact of the Xpert MTB/RIF ultra cartridge for diagnosis of pulmonary tuberculosis: a modeling study. PLoS Med. 2017;14(12):e1002472.
World Health Organization. Uganda Tuberculosis Profile. Available at https://extranet.who.int/sree/Reports?op=Replet&name=/WHO_HQ_Reports/G2/PROD/EXT/TBCountryProfile&ISO2=UG&outtype=PDF. Accessed 12 Feb 2020.
Horne DJ, Kohli M, Zifodya JS, Schiller I, Dendukuri N, Tollefson D, et al. Xpert MTB/RIF and Xpert MTB/RIF Ultra for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2019;6:Cd009593.
We thank the patients and staff of Kiruddu Hospital, Kisenyi Health Center IV and Mulago National Referral Hospital, the staff and management of Mycobacteriology laboratory at the Makerere University College of Health Sciences, and Christine Bachman and Dr. Puneet Dewan of the Global Good Fund, Intellectual Ventures Laboratory.
Funding was supported by the Bill and Melinda Gates Foundation Trust through Global Good Fund at Intellectual Ventures. AA is a PhD student at Makerere University (Kampala, Uganda) and supported by The Pulmonary Complications of AIDS Research Training (PART) Program (National Institutes of Health-Fogarty International Center D43TW009607). DJ is a Fellow in the Pediatric Scientist Development Program and is supported by K12 HD000850 from the Eunice Kennedy Shriver National Institute of Child Health and Human Development. The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Ethics approval and consent to participate
All participants completed a written informed consent, and the study was approved by the Makerere University School of Medicine Research and Ethics Committee, the Uganda National Council for Science and Technology and the University of California San Francisco Committee on Human Research.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Andama, A., Jaganath, D., Crowder, R. et al. The transition to Xpert MTB/RIF ultra: diagnostic accuracy for pulmonary tuberculosis in Kampala, Uganda. BMC Infect Dis 21, 49 (2021). https://doi.org/10.1186/s12879-020-05727-8
- Xpert ultra
- Xpert MTB/RIF