- Open Access
Development of diagnostic algorithm using machine learning for distinguishing between active tuberculosis and latent tuberculosis infection
BMC Infectious Diseases volume 22, Article number: 965 (2022)
The discrimination between active tuberculosis (ATB) and latent tuberculosis infection (LTBI) remains challenging. The present study aims to investigate the value of diagnostic models established by machine learning based on multiple laboratory data for distinguishing Mycobacterium tuberculosis (Mtb) infection status.
T-SPOT, lymphocyte characteristic detection, and routine laboratory tests were performed on participants. Diagnostic models were built according to various algorithms.
A total of 892 participants (468 ATB and 424 LTBI) and another 263 participants (125 ATB and 138 LTBI), were respectively enrolled at Tongji Hospital (discovery cohort) and Sino-French New City Hospital (validation cohort). Receiver operating characteristic (ROC) curve analysis showed that the value of individual indicator for differentiating ATB from LTBI was limited (area under the ROC curve (AUC) < 0.8). A total of 28 models were successfully established using machine learning. Among them, the AUCs of 25 models were more than 0.9 in test set. It was found that conditional random forests (cforest) model, based on the implementation of the random forest and bagging ensemble algorithms utilizing conditional inference trees as base learners, presented best discriminative power in segregating ATB from LTBI. Specially, cforest model presented an AUC of 0.978, with the sensitivity of 93.39% and the specificity of 91.18%. Mtb-specific response represented by early secreted antigenic target 6 (ESAT-6) and culture filtrate protein 10 (CFP-10) spot-forming cell (SFC) in T-SPOT assay, as well as global adaptive immunity assessed by CD4 cell IFN-γ secretion, CD8 cell IFN-γ secretion, and CD4 cell number, were found to contribute greatly to the cforest model. Superior performance obtained in the discovery cohort was further confirmed in the validation cohort. The sensitivity and specificity of cforest model in validation set were 92.80% and 89.86%, respectively.
Cforest model developed upon machine learning could serve as a valuable and prospective tool for identifying Mtb infection status. The present study provided a novel and viable idea for realizing the clinical diagnostic application of the combination of machine learning and laboratory findings.
The first study to establish 28 models using machine learning for TB diagnosis.
The first TB diagnostic model based on routine, TB-specific and non-specific tests.
Cforest model presented excellent performance in discriminating ATB from LTBI.
Tuberculosis (TB), caused by Mycobacterium tuberculosis (Mtb) infection, is one of the leading contagious diseases globally, with approximately 10.6 million new cases and 1.6 million deaths in 2021 . Individuals infected with Mtb can be classified into active TB (ATB) and latent TB infection (LTBI) based on their clinical manifestations . The accurate and rapid differential diagnosis between these two states is essential for TB management and the final realization of ending TB [3,4,5]. Currently, identifying Mtb infection status remains an issue despite intensive achieved efforts [6, 7]. Therefore, the development of novel and effective diagnostic strategies should be a strategic priority in combating the disease.
Existing gold-standard approaches, including acid-fast staining, mycobacterial culture, and molecular tests, failed to meet clinical needs for TB diagnostics due to either limited sensitivity or time-consuming . Many emerging omics-based approaches including transcriptomics [9, 10], proteomics [11, 12], and metabolomics [13, 14], have been developed for TB diagnostics. Nevertheless, these tests are currently unable to be applied into clinical practice as a consequence of high dependence of instrument, poor reproducibility, and the lack of wide-range validation .
The delay in TB diagnosis was probably partially bridled by insufficient use of obtained data from laboratory. Studies from many teams and our own pervious investigation demonstrated that the diagnostic value of data from routine laboratory tests should not be neglected. Laboratory data revealing host characteristics in different dimensions have potential for the diagnosis of TB [16, 17]. Results from blood examination, biochemical tests, coagulation detection, and T-SPOT assay showed mediocre value in identifying Mtb infection status [18, 19]. In addition, the value of the detection targeting lymphocyte number and function for TB diagnostics was also confirmed by two recent reports [20, 21]. Although these tests were of limited discriminatory value when they were used separately, the diagnostic performance of these data could be effectively improved when the data is integrated with appropriate algorithm. The rapid development of artificial intelligence has given a lot of emerging opportunities to laboratory data for this purpose. In this study, we developed diagnostic algorithm using machine learning based on multiple-test data for distinguishing ATB from LTBI and validated it.
The current study was carried out from January 2018 to January 2022. The study participants in discovery cohort were recruited at Tongji Hospital (the largest tertiary hospital in central China with 5500 beds). The study participants in validation cohort were enrolled at Sino-French New City Hospital (a branch hospital of Tongji Hospital with 1600 beds). Participants in two cohorts were included based on positive T-SPOT results. Participants were classified as ATB patients and LTBI individuals on the grounds of clinical and laboratory evaluation. ATB was diagnosed by positive Mtb culture and/or GeneXpert MTB/RIF for the allocated samples including bronchoalveolar lavage fluid and sputum. LTBI was defined by positive T-SPOT result without symptomatic, radiological or microbiological evidences of ATB as well as the history of TB. Specially, the symptoms compatible of ATB in the current study included prolonged cough, chest pain, fever, and night sweats. Patients with the following condition were excluded from the study: (1) having anti-TB treatment within 1 month prior to the enrollment; (2) being younger than 18 years old. This study was approved by the ethics committee of Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology.
Routine laboratory tests
Blood routine examination and detection of biochemical, coagulation and inflammatory indicators were performed on each participant. Briefly, ethylenediaminetetraacetic acid-anticoagulated peripheral blood was collected for routine blood examination. The following indicators were obtained: white blood cell count (WBC), neutrophil count (NEUT), lymphocyte count (LYMPH), monocyte count (MONO), eosinophil count (EO), basophil count (BASO), red blood cell count (RBC), hemoglobin (HGB), hematocrit (HCT), coefficient variation of red blood cell volume distribution width (RDW_CV), standard deviation in red cell distribution width (RDW_SD), platelet count (PLT), platelet larger cell ratio (P_LCR), plateletcrit (PCT), and platelet distribution width (PDW). Heparin anticoagulating peripheral blood was collected for biochemical indicators detection. The following parameters were obtained: total protein (TP), albumin (ALB), globulin (GLB), total cholesterol (T_CHOL), triglyceride (TG), calcium (Ca), chlorine (Cl), kalium (K), natrium (Na), phosphor (P), magnesium (Mg), and hypersensitive C-reactive protein (HsCRP). Sodium citrate anti-coagulated peripheral blood was collected for coagulation indicator detection. The following indexes were obtained: activated partial thromboplastic time (APTT), fibrinogen (FIB), prothrombin time (PT), thrombin time (TT), d-dimer (D_D), and erythrocyte sedimentation rate (ESR). The used instruments included XN-9000 Sysmex (Sysmex Co., Kobe, Japan), ROCHE COBAS (Mannheim, Germany), STA-R coagulation analyzers (Diagnostic Stago, France), and Monitor100 (SYSMEX).
Heparin anticoagulated peripheral blood was collected for T-SPOT assay (Oxford Immunotec, Oxford, UK). Briefly, the isolated peripheral blood mononuclear cells (PBMCs) (2.5 × 105) were added to 96-well plates precoated with anti-IFN-γ antibody. Four wells were prepared for the test: medium, early secreted antigenic target 6 (ESAT-6), and culture filtrate protein 10 (CFP-10), phytohemagglutinin (PHA). Plates were incubated for 16–20 h at 37 °C with 5% CO2 and developed using an anti-IFN-γ antibody conjugate and substrate to detect the presence of secreted IFN-γ. Spot-forming cell (SFC) in each well was counted by ELISPOT reader (CTL Analyzers, Cleveland, OH, USA). The result was regarded as positive when ESAT-6 minus medium or CFP-10 minus medium ≥ 6. The result was regarded as negative if both ESAT-6 minus medium and CFP-10 minus medium ≤ 5. The result was considered as undetermined when the spot number in PHA well was < 20 or spot number in medium well was > 10.
Lymphocyte subset number and IFN-γ secretion ability detection
Heparinized peripheral blood was collected for the measurement of lymphocyte subset number and lymphocyte IFN-γ secretion ability. The numbers of CD4+ T cells, CD8+ T cells, NK cells, and B cells were determined by using TruCOUNT tubes and BD lymphocyte subset reagent kit (BD Biosciences, San Jose, CA, USA). A volume of 50 µL peripheral blood was labeled with antibody cocktail for 20 min in room temperature. After adding 450 µL of FACS lysing solution, samples were analyzed with FACSCanto flow cytometer. TruCOUNT beads were gated based on side scatter and fluorescence intensity. CD3+CD4+CD8− and CD3+CD4−CD8+ cells were respectively defined as CD4+ T cells and CD8+ T cells. CD16+CD56+ cells and CD19+ cells in CD3− cells were respectively defined as NK cells and B cells. Lymphocyte IFN-γ secretion ability detection was performed under phorbol-12-myristate-13-acetate/Ionomycin/ionomycin (PMA/Ionomycin) stimulation as described in previous study . The procedure was as the following: (1) 100 µL peripheral blood was diluted with 400 µL of IMDM medium (Gibco, Grand Island, NY, USA); (2) the diluted peripheral blood was incubated in the presence of Leukocyte Activation Cocktail (Becton Dickinson GolgiPlug™) for 4 h; (3) the cells were labeled with antibodies including anti-CD45, anti-CD3, anti-CD4, anti-CD8, and anti-CD56 for 20 min at room temperature; (4) the cells were fixed and permeabilized; (5) the cells were stained with intracellular anti-IFN-γ antibody; and (6) the cells were analyzed with FACSCanto flow cytometer. The percentages of IFN-γ+ cells in cell subsets were defined as IFN-γ secretion ability of them. Specially, the percentage of IFN-γ+ cells in CD3+CD4+CD8− cells was regarded as CD4+ T cell IFN-γ secretion ability; the percentage of IFN-γ+ cells in CD3+CD4−CD8+ cells was regarded as CD8+ T cell IFN-γ secretion ability; the percentage of IFN-γ+ cells in CD3−CD56+ cells was regarded as NK cell IFN-γ secretion ability.
Establishment of diagnostic models
Diagnostic models were established using machine learning by the R package “mlr3” and related packages. Multiple data acquired from study participants in discovery cohort was randomly divided at a 3:1 ratio. The large one (3/4) was utilized for modelling (training set), whereas the small one (1/4) was applied as test set. The models established in discovery cohort were further verified using an independent cohort (validation set). Machine learning learners used were generated using R packages “mlr3”, “mlr3learners”, and “mlr3extralearners”. The probability ranging between 0 and 1 for ATB diagnosis for each case was obtained by the prediction of the model. The performance of models was evaluated by measures involved in R package “mlr3”. The importance of indicators in the contribution to the model was also evaluated.
Continuous variables were represented as mean ± standard deviation (SD) or medians. Categorical variables were expressed as number (%). Student’s t test and Mann–Whitney U test were applied for the comparison of continuous variables. Chi-square test and Fisher’s exact test were used for the comparison of categorical variables. P < 0.05 represented that statistical difference existed. Cor linear regression was performed to evaluate whether there is a linear correlation between various indicators. Tree-leaf clustering, principal components analysis (PCA), t-distributed stochastic neighbor embedding (t-SNE), and uniform manifold approximation and projection (UMAP) were utilized to visualize the differentiation of multiple results. Receiver operating characteristic (ROC) curves were created to evaluate the performance of various indicators and models for discriminating ATB from LTBI. Area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (PLR), negative likelihood ratio (NLR), as well as accuracy, together with their 95% confidence intervals (CI), were calculated. The comparison between AUCs was achieved by DeLong’s test . The tools involved in data analysis and graphing throughout the study included R 4.0.2 program (R Core Team), GraphPad Prism Software 6.0 (GraphPad Software, Inc, San Diego, CA, USA), Java (TM) SE Development Kit 11.0.14 (Oracle), SPSS Software 25.0 (Social Sciences Inc, Chicago, Illinois, USA), and MedCalc 11.6 (MedCalc, Mariakerke, Belgium).
Characteristics of recruited participants
A total of 468 patients with ATB and 424 individuals with LTBI were recruited in discovery cohort, while 125 patients with ATB and 138 individuals with LTBI were enrolled in validation cohort (Table 1). There is a preponderance of male cases in both ATB group and LTBI group. Diabetes mellitus is the major underlying disease in both two groups. There was no significant difference in the age and sex distribution between ATB group and LTBI group in both discovery and validation cohorts.
Performance of individual indicators for distinguishing ATB from LTBI
Most indicators showed significant differences between ATB patients and LTBI individuals. It was observed that the levels of ESAT-6 SFC, CFP-10 SFC, WBC, NEUT, RDW_CV, RDW_SD, GLB, TG, K, APTT, PT, FIB, D_D, ESR, and HsCRP were significantly higher in ATB patients than those in LTBI individuals (Fig. 1A). On the contrary, the levels of CD4 cell number, CD8 cell number, NK cell number, B cell number, CD4 cell IFN-γ secretion, CD8 cell IFN-γ secretion, NK cell IFN-γ secretion, LYMPH, EO, BASO, RBC, HGB, HCT, ALB, T_CHOL, Cl, Ca, Na, and TT were significantly lower in ATB patients than those in LTBI individuals (Fig. 1A). There was no statistical difference in the levels of MONO, PLT, P_LCR, PCT, PDW, TP, P, and Mg between ATB patients and LTBI individuals. The capability of individual indicator to distinguish ATB patients from LTBI individuals was determined using ROC curve analysis. It was found that the AUCs of 8 indicators were more than 0.7, while the AUCs of the remaining 34 indicators were under 0.7 (Fig. 1B, C). Specially, CFP-10 SFC, HsCRP, ESAT-6 SFC, D_D, ESR, CD4 cell IFN-γ secretion, CD4 cell number, and HGB were the most accurate biomarkers in differentiating ATB from LTBI (Fig. 1B, C).
Establishing diagnostic models using machine learning
Given the fact that the combination of various biomarkers has shown better performance than single biomarker in TB diagnostic field, we attempted to investigate the diagnostic potential of the combination of multiple indicators using machine learning. Cluster analysis and dimension reduction were applied to evaluate the distribution of ATB patients and LTBI individuals based on various indicators. leaf clustering advocated the possibility of the combination of these indicators for the discrimination between ATB and LTBI (Fig. 2A). We further conducted dimension reduction. Consistent with leaf clustering, dimension reduction performed by PCA, tSNE and UMAP analysis also corroborated that the multiple data had the potential to segregate ATB from LTBI (Fig. 2B–D).
Based on the synergistic effects of various indicators denoted by the above findings, 28 diagnostic models were successfully established using machine learning in accordance with laboratory data. ROC curve analysis was performed and the results demonstrated that most established models could successfully differentiate ATB from LTBI with AUCs more than 0.9. Among them, conditional random forests (cforest) model performed better in comparison to other models. Cforest model is an implementation of the random forest and bagging ensemble algorithms utilizing conditional inference trees as base learners. The cforest algorithm could use multiple decision trees to achieve a robust prediction. The model could also avoid overfitting issue since it takes the average and cancels out the biases. ROC curve analysis provided an AUC of 0.995 (95% CI 0.991–0.998) for cforest model in training set (n = 669, 347 ATB and 322 LTBI). The cutoff of 0.5 rendered 98.85% (95% CI 97.07–99.55%) sensitivity and 95.65% (95% CI 92.84–97.39%) specificity. Meanwhile, cforest model differentiated ATB from LTBI with an AUC of 0.978 (95% CI 0.962–0.993) corresponding to a sensitivity of 93.39% (95% CI 87.50–96.61%) and specificity of 91.18% (95% CI 84.08–95.29%) in test set (n = 223, 121 ATB and 102 LTBI) (Table 2, Fig. 3A). CFP-10 SFC, ESAT-6 SFC, HCT, CD4 cell IFN-γ secretion, FIB, CD8 cell IFN-γ secretion, and CD4 cell number were the indicators with the highest contribution to cforest model (Fig. 3A). Among these parameters, CFP-10 SFC and ESAT-6 SFC indicated the specific response of the host against Mtb. In addition, CD4 cell IFN-γ secretion, CD8 cell IFN-γ secretion, and CD4 cell number indicated the global adaptive immunity of the host. Apart from cforest model, other models also showed effective discriminatory value. For example, the sensitivity and specificity of bart model in test set were 89.26% (95% CI 82.48–93.61%) and 90.20% (95% CI 82.89–94.59%), respectively (Table 2, Fig. 3B). Gamboost model distinguished patients with ATB from those with LTBI with an AUC of 0.969 (95% CI 0.949–0.988) and demonstrated a sensitivity of 85.12% (95% CI 77.71–90.38%) and specificity of 92.16% (95% CI 85.28–95.97%) in test set (Table 2, Fig. 3C). Besides, the sensitivity and specificity for gbm model in test set were 87.60% (95% CI 80.55–92.34%) and 88.24% (95% CI 80.55–93.14%), with an AUC of 0.968 (95% CI 0.949–0.987) (Table 2, Fig. 3D). Meanwhile, log_reg model established based on logistic regression had an AUC of 0.951 (95% CI 0.924–0.978) for discriminating ATB patients from LTBI individuals in test set (Table 2, Fig. 3G). The sensitivity and specificity of log_reg model were 87.60% (95% CI 80.55–92.34%) and 93.14% (95% CI 86.51–96.64%), respectively (Table 2, Fig. 3G). The AUCs of ROC curves of various models for ATB versus LTBI were presented in Fig. 3. The performance parameters for all models in training set and test set were shown in Fig. 5A, B and Additional file 1: Fig. S1A-B.
Validation of diagnostic models in another cohort
An independent validation is indispensable for determining the robustness of a developed model based on machine learning. Therefore, another cohort (validation set) was included for the purpose in the study. Consistent with the observation in discovery cohort, cforest model exhibited significant discriminatory ability in validation cohort. Cforest model presented an AUC of 0.963 (95% CI 0.940–0.986) in validation set, with a sensitivity of 92.80% (95% CI 86.88–96.17%) and specificity of 89.86% (95% CI 83.69–93.86%) (Table 3, Fig. 4A). The utility of other models was summarized in Figs. 4, 5C, and Additional file 1: Fig. S1C.
It is a growing notion that single biomarker is insufficient for differentiating Mtb infection status, while the powerful combination of multiple indicators would be trend for enhancing the utility [24, 25]. Nonetheless, the loss of diagnostic performance attributed to the unreasonable combination of data is usually easily neglected. There are many reasons for this outcome, including the researchers’ lack of perception over data characteristics as well as inappropriate selection of approaches for modelling. Although previous studies have explored the difference in many indexes for TB diagnostics, poor data utilization might exist in the combination of them. In recent years, with the in-depth study of multidimensional data analysis, algorithm-based machine learning shines brilliantly, especially in the field with the classification as the core [26, 27]. Therefore, it is a priority to rationally use algorithms to maximize diagnostic performance on multidimensional data. On the basis of the entry point, the present study investigated the potential of diagnostic models established using various algorithms involved in machine learning for segregating ATB from LTBI.
The study population contained two cohorts. One cohort was included as a discovery resource to develop diagnostic models using machine learning for differentiating ATB from LTBI, whereas another one was enrolled to validate the performance and availability the established models. The included indicators cover TB-specific immunological test (T-SPOT), non-specific immunological features (lymphocyte subset number and IFN-γ secretion ability), and routine laboratory tests. Therefore, our findings are relatively highly credible, inclusive and generalizable. Cforest model presented excellent performance in both discovery and validation cohort. The AUCs more than 0.96 in both test and validation set evidenced the potential diagnostic value of cforest model for differentiating ATB from LTBI. Cforest is a random forest algorithm based on conditional inference trees. It is a fast-learning rule that combines multiple decision trees together. Moreover, it can balance the errors of the data and generate classifiers with high accuracy. Remarkably, we found that cforest model outperformed log_reg model that was usually used in most previous studies (Z = 2.254, P = 0.024). This evidence suggested that the insufficient data value mining existed in many studies. Therefore, rational use of artificial intelligence in medical decision might be a developmental trend of precision medicine in the future. In addition, many of these models were comparable in terms of AUC. Meanwhile, there is a strong positive correlation in predictive values among various models (Additional file 2: Fig. S2). This observation indicated that the predictive trends were basically consistent across almost all models. However, there were subtle differences in data integration.
It was observed that CFP-10 SFC, ESAT-6 SFC, CD4 cell IFN-γ secretion, CD4 cell number, CD8 cell IFN-γ secretion, and FIB were dominant in contributing to the performance of many models including cforest model, bart model, gamboost model, gbm model and glmnet model. This finding denoted that complementary effect exists between specific and non-specific immune response in improving the diagnostic performance, while routine laboratory test could stabilize and locally optimize the model. Thus, most indicators of little significance when used separately could play a large or small role in constructing the model. Actually, this is also the advantage of machine learning. An appropriate and ideal algorithm could fully exploit the value of each data while avoiding overfitting.
Some points should be mentioned in this study. The development of algorithms used for classification is rapid. The current study comprehensively attempted the learners involved in “mlr3” as well as its auxiliary packages. The obtained results denoted that the models built based on these algorithms could be basically used for the effective diagnosis of TB. Nevertheless, cforest model performed better than the others in terms of performance. It means that various algorithms provide inconsistent advantages for classification under different data condition. On the one hand, the reasonable application of algorithm is based on the design of the algorithm itself. On the other hand, it also depends on the characteristics of the data, including the dimension of the data and the correlation between each other. The phenomenon suggests that more comprehensive consideration should be implemented in combining test data to maximize the efficiency for the diagnosis and prognosis of TB in the future.
On the whole, our model employed TB-specific and non-specific immunological indicators, as well as multi-dimensional routine laboratory tests (blood routine examination, biochemistry, coagulation, inflammatory reaction). These detections were usually available and could represent the host characteristics under Mtb infection in relatively comprehensive dimensions. Meanwhile, the reasonable use of machine learning algorithm and discovery-validation design involved in this study support the excellent performance and robustness of the model. Although the current trend is towards to POC test, the model established in the present study could still serve as an auxiliary or supplementary tool in TB diagnosis since it could be generated by the quick combination of the existing indicators. Therefore, the established model would be advantageous in clinical application.
Several limitations should be mentioned in the study. First, although the present study enrolled cohorts from two centers, the sample size in each center was limited. Thus, the robustness of the model built through machine learning needs further validation with large sample size to seek the applicability of the model. Second, since the existence of ATB patients with negative T-SPOT results has been reported by many studies [28,29,30], the lack of these cases in the current study might influence the performance of the established model. Therefore, more validation should be performed to access the efficacy of the model in the future. Third, given that fact that all participants in the current study were enrolled from a hospital setting, there would be some selection biases, in particular for LTBI individuals. Further inclusion in a community setting is needed to reduce selection biases and determine the efficiency of the established model more precisely. Fourth, the classification of Mtb infection status became more detailed in recent years, especially for the subclinical TB [31, 32]. Our study only classified the participants into ATB and LTBI. Thus, the more precise classification is required when developing diagnostic model in the future. Fifth, the advantage of machine learning usually exhibited its advantage under large amounts of dimensions. In spite of dozens of indicators included in our study, more emerging potential indicators, especially involved in omics [33,34,35,36] and flow cytometry , should be incorporated in the future to further strengthen the diagnostic performance of model. Finally, in addition to data itself, the parameter regulation can also affect the utility of the model, Therefore, more optimized algorithm and parameter setting should be further developed to achieve the maximum diagnostic efficacy in the future.
Overall, the present study highlights the potential of cforest model based on laboratory data as a useful and anticipated tool in identifying Mtb infection status. Besides, it could serve as a tool to complement pathogenic detection to achieve ATB diagnosis in clinical setting. Furthermore, the successful implementation of our study provides novel insights on the integration of data from different dimensions, and lays foundation for realizing the effective combination of laboratory data and emerging artificial intelligence for TB diagnosis.
Availability of data materials
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Latent tuberculosis infection
Area under the receiver operating characteristic curve
Early secreted antigenic target 6
Culture filtrate protein 10
Peripheral blood mononuclear cells
Receiver operating characteristic
Positive predictive value
Negative predictive value
Positive likelihood ratio
Negative likelihood ratio
White blood cell count
Red blood cell count
Coefficient variation of red blood cell volume distribution width
Standard deviation in red cell distribution width
Platelet larger cell ratio
Platelet distribution width
Hypersensitive C-reactive protein
Activated partial thromboplastic time
Erythrocyte sedimentation rate
Principal components analysis
T-distributed stochastic neighbor embedding
Uniform manifold approximation and projection
World Health Organization: Global tuberculosis report 2022. https://www.appswhoint/iris/rest/bitstreams/1474924/retrieve 2022, 27 Oct 2022. Geneva, Switzerland.
Luo Y, Suliman S, Asgari S, Amariuta T, Baglaenko Y, Martinez-Bonet M, Ishigaki K, Gutierrez-Arcelus M, Calderon R, Lecca L, et al. Early progression to active tuberculosis is a highly heritable trait driven by 3q23 in Peruvians. Nat Commun. 2019;10(1):3765.
World Health Organization: The end TB strategy. https://www.appswhoint/iris/rest/bitstreams/1271371/retrieve 2015, 16 Aug 2015. Geneva, Switzerland.
Gong W, Wu X. Differential diagnosis of latent tuberculosis infection and active tuberculosis: a key to a successful tuberculosis control strategy. Front Microbiol. 2021;12: 745592.
World Health Organization: A Global Strategy for tuberculosis research and innovation. https://www.appswhoint/iris/rest/bitstreams/1312195/retrieve 2020, 19 Oct 2020. Geneva, Switzerland.
Furin J, Cox H, Pai M. Tuberculosis. The Lancet. 2019;393(10181):1642–56.
MacLean E, Broger T, Yerlikaya S, Fernandez-Carballo BL, Pai M, Denkinger CM. A systematic review of biomarkers to detect active tuberculosis. Nat Microbiol. 2019;4(5):748–58.
World Health Organization: Implementing tuberculosis diagnostics: A policy framework. https://www.appswhoint/iris/rest/bitstreams/720125/retrieve 2015, 24 Apr 2015. Geneva, Switzerland.
Singhania A, Wilkinson RJ, Rodrigue M, Haldar P, O’Garra A. The value of transcriptomics in advancing knowledge of the immune response and diagnosis in tuberculosis. Nat Immunol. 2018;19(11):1159–68.
Turner CT, Gupta RK, Tsaliki E, Roe JK, Mondal P, Nyawo GR, Palmer Z, Miller RF, Reeve BW, Theron G, et al. Blood transcriptional biomarkers for active pulmonary tuberculosis in a high-burden setting: a prospective, observational, diagnostic accuracy study. Lancet Respir Med. 2020;8(4):407–19.
Yang Q, Chen Q, Zhang M, Cai Y, Yang F, Zhang J, Deng G, Ye T, Deng Q, Li G, et al. Identification of eight-protein biosignature for diagnosis of tuberculosis. Thorax. 2020;75(7):576–83.
Togun T, Hoggart CJ, Agbla SC, Gomez MP, Egere U, Sillah AK, Saidy B, Mendy F, Pai M, Kampmann B. A three-marker protein biosignature distinguishes tuberculosis from other respiratory diseases in Gambian children. EBioMedicine. 2020;58: 102909.
Dai Y, Shan W, Yang Q, Guo J, Zhai R, Tang X, Tang L, Tan Y, Cai Y, Chen X. Biomarkers of iron metabolism facilitate clinical diagnosis in Mycobacterium tuberculosis infection. Thorax. 2019;74(12):1161–7.
Albors-Vaquer A, Rizvi A, Matzapetakis M, Lamosa P, Coelho AV, Patel AB, Mande SC, Gaddam S, Pineda-Lucena A, Banerjee S, et al. Active and prospective latent tuberculosis are associated with different metabolomic profiles: clinical potential for the identification of rapid and non-invasive biomarkers. Emerg Microbes Infect. 2020;9(1):1131–9.
Noursadeghi M, Gupta RK. New insights into the limitations of host transcriptional biomarkers of tuberculosis. Am J Respir Crit Care Med. 2021;204(12):1363–5.
Luo Y, Xue Y, Lin Q, Tang G, Yuan X, Mao L, Song H, Wang F, Sun Z. A combination of iron metabolism indexes and tuberculosis-specific antigen/phytohemagglutinin ratio for distinguishing active tuberculosis from latent tuberculosis infection. Int J Infect Dis. 2020;97:190–6.
Luo Y, Xue Y, Yuan X, Lin Q, Tang G, Mao L, Song H, Wang F, Sun Z. Combination of prealbumin and tuberculosis-specific antigen/phytohemagglutinin ratio for discriminating active tuberculosis from latent tuberculosis infection. Int J Clin Pract. 2021;75(4): e13831.
Luo Y, Tang G, Yuan X, Lin Q, Mao L, Song H, Xue Y, Wu S, Ouyang R, Hou H, et al. Combination of blood routine examination and T-SPOT.TB assay for distinguishing between active tuberculosis and latent tuberculosis infection. Front Cell Infect Microbiol. 2021;11:575650.
Luo Y, Xue Y, Song H, Tang G, Liu W, Bai H, Yuan X, Tong S, Wang F, Cai Y, et al. Machine learning based on routine laboratory indicators promoting the discrimination between active tuberculosis and latent tuberculosis infection. J Infect. 2022;84:648–57.
Luo Y, Xue Y, Cai Y, Lin Q, Tang G, Song H, Liu W, Mao L, Yuan X, Zhou Y, et al. Lymphocyte non-specific function detection facilitating the stratification of Mycobacterium tuberculosis infection. Front Immunol. 2021;12: 641378.
Luo Y, Xue Y, Tang G, Cai Y, Yuan X, Lin Q, Song H, Liu W, Mao L, Zhou Y, et al. Lymphocyte-related immunological indicators for stratifying mycobacterium tuberculosis infection. Front Immunol. 2021;12: 658843.
Luo Y, Xie Y, Zhang W, Lin Q, Tang G, Wu S, Huang M, Yin B, Huang J, Wei W, et al. Combination of lymphocyte number and function in evaluating host immunity. Aging. 2019;11(24):12685–707.
DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.
Luo Y, Tang G, Lin Q, Mao L, Xue Y, Yuan X, Ouyang R, Wu S, Yu J, Zhou Y, et al. Combination of mean spot sizes of ESAT-6 spot-forming cells and modified tuberculosis-specific antigen/phytohemagglutinin ratio of T-SPOT.TB assay in distinguishing between active tuberculosis and latent tuberculosis infection. J Infect. 2020;81(1):81–9.
Luo Y, Xue Y, Tang G, Lin Q, Song H, Liu W, Yin B, Huang J, Wei W, Mao L, et al. Combination of HLA-DR on Mycobacterium tuberculosis-specific cells and tuberculosis antigen/phytohemagglutinin ratio for discriminating active tuberculosis from latent tuberculosis infection. Front Immunol. 2021;12: 761209.
Xing Z, Ding W, Zhang S, Zhong L, Wang L, Wang J, Wang K, Xie Y, Zhao X, Li N, et al. Machine learning-based differentiation of nontuberculous mycobacteria lung disease and pulmonary tuberculosis using CT images. Biomed Res Int. 2020;2020:6287545.
Zhou Z, Zhou X, Cheng L, Wen L, An T, Gao H, Deng H, Yan Q, Zhang X, Li Y, et al. Machine learning algorithms utilizing blood parameters enable early detection of immunethrombotic dysregulation in COVID-19. Clin Transl Med. 2021;11(9): e523.
Liao CH, Lai CC, Tan CK, Chou CH, Hsu HL, Tasi TH, Huang YT, Hsueh PR. False-negative results by enzyme-linked immunospot assay for interferon-gamma among patients with culture-confirmed tuberculosis. J Infect. 2009;59(6):421–3.
Nguyen DT, Teeter LD, Graves J, Graviss EA. Characteristics Associated with Negative Interferon-gamma Release Assay Results in Culture-Confirmed Tuberculosis Patients, Texas, USA, 2013–2015. Emerg Infect Dis. 2018;24(3):534–40.
Pan L, Jia H, Liu F, Sun H, Gao M, Du F, Xing A, Du B, Sun Q, Wei R et al: Risk factors for false-negative T-SPOT.TB assay results in patients with pulmonary and extra-pulmonary TB. J Infect 2015, 70(4):367–380.
Lau A, Lin C, Barrie J, Winter C, Armstrong G, Egedahl ML, Doroshenko A, Heffernan C, Asadi L, Fisher D, et al. The radiographic and mycobacteriologic correlates of subclinical pulmonary TB in Canada: a retrospective cohort study. Chest. 2022;162(2):309–20.
Drain PK, Bajema KL, Dowdy D, Dheda K, Naidoo K, Schumacher SG, Ma S, Meermeier E, Lewinsohn DM, Sherman DR. Incipient and subclinical tuberculosis: a clinical review of early stages and progression of infection. Clin Microbiol Rev. 2018;31(4):e00021.
Cai Y, Dai Y, Wang Y, Yang Q, Guo J, Wei C, Chen W, Huang H, Zhu J, Zhang C, et al. Single-cell transcriptomics of blood reveals a natural killer cell subset depletion in tuberculosis. EBioMedicine. 2020;53: 102686.
Garay-Baquero DJ, White CH, Walker NF, Tebruegge M, Schiff HF, Ugarte-Gil C, Morris-Jones S, Marshall BG, Manousopoulou A, Adamson J, et al. Comprehensive plasma proteomic profiling reveals biomarkers for active tuberculosis. JCI Insight. 2020;5(18): e137427.
Ho J, Bokil NJ, Nguyen PTB, Nguyen TA, Liu MY, Hare N, Fox GJ, Saunders BM, Marks GB, Britton WJ. A transcriptional blood signature distinguishes early tuberculosis disease from latent tuberculosis infection and uninfected individuals in a Vietnamese cohort. J Infect. 2020;81(1):72–80.
Hoang LT, Jain P, Pillay TD, Tolosa-Wright M, Niazi U, Takwoingi Y, Halliday A, Berrocal-Almanza LC, Deeks JJ, Beverley P, et al. Transcriptomic signatures for diagnosing tuberculosis in clinical practice: a prospective, multicentre cohort study. Lancet Infect Dis. 2021;21(3):366–75.
Mpande CAM, Musvosvi M, Rozot V, Mosito B, Reid TD, Schreuder C, Lloyd T, Bilek N, Huang H, Obermoser G, et al. Antigen-specific T-cell activation distinguishes between recent and remote tuberculosis infection. Am J Respir Crit Care Med. 2021;203(12):1556–65.
The authors would like to thank all participants who contributed to this study and site staff at the clinical laboratory of Tongji hospital (Wuhan, China) for their contributions to the study. The authors appreciate Mauro AA Castro and Rui Wei for their technical support and advice throughout the study.
This work was supported by grants from the Fundamental Research Funds for the Central Universities (No. 2021yjsCXCY088) and the Special Foundation for National Science and Technology Basic Research Program of China (No. 2019FY101206).
Ethics approval and consent to participate
Ethical approval for this study was obtained from the ethics committee of the Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, and it was complied with the ethical guidelines of the Declaration of Helsinki. All methods were performed in accordance with the relevant guidelines and regulations. The informed consent was provided by each participant.
Consent to publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Ying Luo: Lead contact
Additional file 1: Figure S1.
Radar plot showing the performance parameters of 28 models after normalization. (A) training set. (B) test set. (C) validation set.
Additional file 2: Figure S2.
Triangular chart showing the correlation between predictive values of various diagnostic models in (A) training set, (B) test set, and (C) validation set.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Luo, Y., Xue, Y., Liu, W. et al. Development of diagnostic algorithm using machine learning for distinguishing between active tuberculosis and latent tuberculosis infection. BMC Infect Dis 22, 965 (2022). https://doi.org/10.1186/s12879-022-07954-7
- Diagnostic algorithm
- Machine learning
- Active tuberculosis
- Latent tuberculosis infection