- Research article
- Open Access
Potential of novel Mycobacterium tuberculosis infection phase-dependent antigens in the diagnosis of TB disease in a high burden setting
BMC Infectious Diseases volume 12, Article number: 10 (2012)
Confirming tuberculosis (TB) disease in suspects in resource limited settings is challenging and calls for the development of more suitable diagnostic tools. Different Mycobacterium tuberculosis (M.tb) infection phase-dependent antigens may be differentially recognized in infected and diseased individuals and therefore useful as diagnostic tools for differentiating between M.tb infection states. In this study, we assessed the diagnostic potential of 118 different M.tb infection phase-dependent antigens in TB patients and household contacts (HHCs) in a high-burden setting.
Antigens were evaluated using the 7-day whole blood culture technique in 23 pulmonary TB patients and in 19 to 21 HHCs (total n = 101), who were recruited from a high-TB incidence community in Cape Town, South Africa. Interferon-gamma (IFN-γ) levels in culture supernatants were determined by ELISA.
Eight classical TB vaccine candidate antigens, 51 DosR regulon encoded antigens, 23 TB reactivation antigens, 5 TB resuscitation promoting factors (rpfs), 6 starvation and 24 other stress response-associated TB antigens were evaluated in the study. The most promising antigens for ascertaining active TB were the rpfs (Rv0867c, Rv2389c, Rv2450c, Rv1009 and Rv1884c), with Areas under the receiver operating characteristics curves (AUCs) between 0.72 and 0.80. A combination of M.tb specific ESAT-6/CFP-10 fusion protein, Rv2624c and Rv0867c accurately predicted 73% of the TB patients and 80% of the non-TB cases after cross validation.
IFN-γ responses to TB rpfs show promise as TB diagnostic candidates and should be evaluated further for discrimination between M.tb infection states.
The diagnosis of tuberculosis (TB) disease remains a challenge in resource-limited settings. This is particularly due to limitations in sputum smear microscopy , the cheapest and widely used test in such settings. Several attempts have been made towards the development of better diagnostic tests for TB . The most significant development in the field has been the introduction of the automated real-time sputum processing molecular beacon assay, XpertMTB/RIF assay (Cepheid Inc., CA, USA)  into clinical practice but the relatively high operating costs preclude its use in resource-poor settings which often suffer from the highest TB burdens . Furthermore, the dependence of most of these tests on sputum implies that they are not suitable for patients with difficulties in providing good quality sputum samples such as children, extrapulmonary TB cases, or in cases where the sputum itself is negative (for example, many patients with HIV-Mycobacterium tuberculosis (M.tb) co-infections). Immunodiagnostic assays might hold promise in such cases  especially if they can be developed into point-of-care tests.
One of the most notable advances in the development of immunodiagnostic tools for M.tb has been the advent of the interferon gamma release assays (IGRAs). Commercially available IGRAs include the ELISA-based Quantiferon TB Gold assays (Cellestis, Victoria, Australia) and the ELISPOT-based T SPOT.TB test (Oxford Immunotec, Abington, UK). Notwithstanding the proven usefulness of these assays in the diagnosis of M.tb infection, especially in comparison to the tuberculin skin test (TST) [5–7], an important limitation of the tests is that they do not discriminate between latent M.tb infection (LTBI) and active TB disease. This implies limited utility in high-burden settings where the prevalence of LTBI is usually high. In order to develop T cell-based assays for the diagnosis of active TB, it is imperative to identify new host markers expressed in response to established M.tb-dependent antigens, such as those used in IGRAs (ESAT-6, CFP-10, TB7.7), or novel M.tb antigens uniquely recognized by patients with active TB or LTBI.
In response to the continued pressure mounted by host immune responses in the course of M.tb infection, the bacterium is believed to respond by self-regulating the expression of many genes [8, 9]. Using in vivo and in vitro models believed to mimic the conditions encountered within the host by the tubercle bacillus as infection progresses from latency to active disease, investigators have been able to identify infection phase-dependent genes with diagnostic potential [10, 11]. In the present study, we assessed the potential diagnostic utilities of 118 M.tb infection phase-dependent antigens in TB patients and household contacts (HHCs) in a high-TB burden population. As part of a large ongoing TB biomarker study, we investigated the antigens in a 7-day diluted whole blood assay for their diagnostic potential for active TB.
Participants were recruited from the Ravensmead/Uitsig community in Cape Town, South Africa, as part of an ongoing Bill and Melinda Gates Foundation funded Grand Challenges in Global Health (GC6-74) study (http://www.biomarkers-for-tb.net/). Participants included in this study were enrolled between October 2006 and April 2007. All TB patients were self-reporting, untreated cases with a first episode of TB and were acid fast bacilli (AFB) positive on two sputum smears. HHCs had been living in the same house as an adult TB case who was diagnosed not more than 2 months before recruitment of the contact. All HHCs had antero-posterior view chest X-rays and assisted sputum samples taken. The X-rays were all evaluated as normal and the sputum samples found negative for AFB. Demographic data was collected on all participants and a clinical questionnaire completed. All participants tested negative with an HIV rapid test (Abbot Determine™ HIV 1/2; Abbott, Wiesbaden, Germany). Inclusion criteria for all participants were: age between 18 and 60 years, willingness to undergo HIV testing and to give written informed consent for participation in the study. Exclusion criteria for all participants included HIV infection, previous or current TB treatment, participation in a drug or vaccine trial at or within the 6 months preceding recruitment, other chronic illnesses and pregnancy. At enrolment, 10 ml of heparinized blood was collected from all participants and transported within 2 h of collection to the laboratory where a 7-day whole blood assay (WBA) (described below) was performed. Ethical approval for the study was obtained from the Committee for Human Research of the University of Stellenbosch.
A total of 118 M.tb infection phase-dependent antigens (112 recombinant proteins and 8 peptide pools) were evaluated in the study. Eight of these antigens (ESAT-6/CFP-10 fusion protein (ESAT-6/CFP-10fp), TB10.4 (Rv0288), TB10.3 (Rv3019c), TB7.7 (Rv2654c), Ag85A (Rv3804c), Ag85B (Rv1886c), HSP65 (Rv0440), ESAT-6(Rv3875)), were well-characterized TB antigens and were evaluated as "control antigens". Fifty-one antigens were DosR-induced antigens, 23 were reactivation antigens, 5 were rpfs, 6 were starvation antigens (other than Rv2654c) and the other 24 are known to be associated with stress conditions (Additional file 1: Tables S1, Additional file 2: Table S2, Additional file 3: Table S3, Additional file 4: Table S4, Additional file 5: Table S5, Additional file 6: Table S6). One of the peptide pools (Rv2659) was evaluated in three separate pools (pools A-C) while Ag85A and Ag85B were evaluated together in culture. With the exception of ESAT-6 and Rv3407, all the recombinant proteins were produced at Leiden University Medical Center (LUMC), The Netherlands. Recombinant ESAT-6 and all peptide pools were from SSI, and Rv3407 from the Max Plank Institute for Infection Biology (Berlin, Germany).
For the antigens that were available as peptide pools, there were 6 to 13 peptides in each pool. Each of the peptides was 15 amino acids long. There were eight amino acid overlaps between the peptides in each pool (Additional file 7: Table S7).
Recombinant antigens were produced as previously described . Briefly, M.tb genes were amplified by PCR from genomic DNA of M.tb and cloned using the Gateway technology platform (Invitrogen, Carlsbad, CA) with pDEST17 expression vector containing an N-terminal histidine tag (Invitrogen). Sequencing was performed on selected clones to confirm identity of all cloned DNA fragments. Recombinant proteins were over expressed in E. coli BL21(DE3) and purified as described to remove any traces of endotoxin. Each purified recombinant protein was analyzed by 12% SDS-PAGE followed by Coomassie Brilliant Blue staining and Western-blotting with an anti-His antibody (Invitrogen) to confirm size and purity. Endotoxin contents were below 50 IU/mg recombinant protein as tested using a Limulus Amebocyte Lysate (LAL) assay (Cambrex, East Rutherford, NJ), and less than 0.1 IU/mg in some cases. Recombinant proteins were tested to exclude protein non-specific T cell stimulation and cellular toxicity in IFN-γ release assays using PBMC of in vitro PPD-negative, healthy Dutch donors recruited at the Blood bank Sanquin, Leiden, The Netherlands. None of these controls had experienced any known prior contact with TB patients.
Whole blood assay
Antigens were evaluated at a final concentration of 10 μg/ml as previously described . Briefly, antigens were reconstituted as instructed by the respective manufacturers, to a concentration of 20 μg/ml, after which they were aliquoted into 96-well U-bottom plates (100 μl per well) in triplicates. Antigen plates were then frozen at -80°C until the day of WBA. On the day of WBA, antigen plates were thawed and 100 μl of 1 in 5 diluted whole blood [diluted with pre-warmed (37°C) medium (RPMI 1640 containing L-glutamine) (Sigma)], was added to the antigen and control wells. Plates were then incubated until day 7 in a humidified, 5% CO2, 37°C incubator. 150 μl of supernatant was harvested from each of the three antigen/control wells, pooled in a micro centrifuge tube (total of 450 μl per antigen per study participant), divided into 3 aliquots and frozen at -80°C until further use. The unstimulated control wells received medium without antigen while the positive control wells received phytohaemagglutinin (PHA) (Sigma) at 0.5 μg/ml.
ELISAs were performed using a pair of monoclonal antibodies from BD Pharmingen™, (BD Biosciences). Briefly, 96-well flat-bottomed micro-titre plates (Nunc) were coated with 2 μg/ml (50 μl) of the purified mouse anti-human IFN-γ monoclonal capture antibody (diluted in 0.1 M NaHCO3). After overnight incubation at 4°C, plates were washed and blocked with 10% heat-inactivated fetal calf serum (150 μl) in phosphate buffered saline for 2 h (room temperature). After another wash, serial dilutions of recombinant human IFN-γ standard (BD Pharmingen™), and the samples (100 μl per well), were added to the designated wells, and plates incubated overnight at 4°C. Plates were then washed and 1 μg/ml (100 μl) of the biotinylated mouse-anti-human IFN-γ detection antibody (BD Pharmingen™) added. After 1 h incubation (room temperature) and a further wash, 2.5 μg/ml (100 μl) of streptavidin peroxidase (Sigma) was added to all wells, followed by addition of the substrate (O-phenylene diamine-dihydrochloride [Sigma]) (200 μl/well). Plates were then incubated in the dark for 25 mins and the optical densities read at 450 nm. All samples, standards and controls were assayed in duplicate. IFN-γ concentrations were calculated from a four-parameter logistic curve using the microplate manager software (Bio Rad Laboratories). A PHA-stimulated internal positive control supernatant (evaluated on all plates to assess the variability of the ELISA assay) had an average interplate coefficient of variation of 3.6% (95% confidence interval, 2.7-4.6%).
Although the ELISA used in our study has been used in other published studies [13–15], the standard curve for the assay ranged from 31-4000 pg/ml and many of the responses elicited by the antigens we have tested fell below the lowest point on the curve. To verify our observations, we re-evaluated the supernatants from promising antigens by a commercially available IFN-γ ELISA kit (Quantiferon TB Gold (QFT) ELISA, Cellestis, Australia). According to the manufacturer, the detection limit of the QFT ELISA is 0.05 IU/ml (about 2 pg/ml). The validation ELISA (QFT ELISA) was performed according to the manufacturer's instructions.
IFN-γ responses obtained with the Quantiferon ELISA (in IU/ml) were converted to pg/ml by multiplying by 40 . Differences in IFN-γ levels elicited by the antigens were evaluated by the Mann Whitney U test for nonparametric data analysis. Optimal cut-off levels for differentiating between TB disease and no TB were ascertained by receiver operating characteristics (ROC) analysis using the "R" statistical programming language. The predictive abilities of combinations of antigens to differentiate between TB disease and no TB was investigated by performing best subsets general discriminant analysis (GDA), with leave-one-out cross validation as described previously . A 5% significance level was used as guideline for determining significant associations. The data were analyzed using the Statistica 8 software, (Statsoft, Ohio, USA) and GraphPad prism, version 5.00 for Windows (GraphPad Software, San Diego, California, USA).
A total of 124 participants, 23 TB patients and 101 HHCs were enrolled in the study. The mean (± standard deviation) age of participants was 31.7 (± 15.3) years and 76 (61.3%) were female. Although neither IGRA nor TST results were available for the HHCs, it is known from our previous studies that 78-89% of adult HIV-negative TB HHCs from the study community are TST positive (10 mm cut-off) with a mean TST induration of about 23 mm [5, 13, 17]. All the antigens (n = 118) were evaluated in all TB patients (n = 23) and in groups of 19 to 21 HHCs. Because of the large number of antigens evaluated in the study, only antigens for which reportable data was generated are shown in the results section of the main manuscript. The diagnostic accuracy data for all the other antigens is shown in Additional file 8: Table S8 and Additional file 9: Figure S1. The detailed description of all the antigens evaluated in the study is shown in Additional file 1: Table S1, Additional file 2: Table S2, Additional file 3: Table S3, Additional file 4: Table S4, Additional file 5: Table S5, Additional file 6: Table S6, Additional file 7: Table S7.
IFN-γ responses in assay controls
The median IFN-γ concentration detected in the unstimulated control supernatants in both TB patients and HHCs was 0 pg/ml (range 0.0-4.3 pg/ml in TB patients and 0.0-585.4 pg/ml in HHCs). There was no significant difference in the unstimulated IFN-γ responses between the TB patients and HHCs (p = 0.10). The median IFN-γ concentration detected in PHA-stimulated supernatants in HHCs (1331.0 pg/ml, range, 0.0 to > 4000 pg/ml), was significantly higher than that observed in TB patients (326.6 pg/ml, range, 0.0 to > 4000 pg/ml) (p = 0.01), as previously observed . The IFN-γ response obtained for the unstimulated control for each participant was subtracted from all antigen/control-stimulated levels before further analysis of the data.
IFN-γ production in response to classical TB antigens
Eight M.tb classical antigens (Additional file 1: Table S1) were evaluated in this study. TB10.4 and TB7.7 were available as peptide pools while all other classical antigens were recombinant proteins. Ag85A and Ag85B were pooled and tested as a single condition.
ESAT-6/CFP-10fp, ESAT-6, TB10.4 and TB10.3 were the most frequently recognized antigens in TB patients and HHCs. Recognition of TB7.7, Ag85A and B and HSP65 was poor in both subject groups (Figure 1). There were no significant differences in the IFN-γ responses elicited by any of the antigens between the two study groups (p values all > 0.05, range, 0.06-0.98). Similarly, when the ability of the antigens to differentiate between TB patients and HHCs was evaluated using ROC analysis, the antigen with the highest area under the ROC curve (AUC) was ESAT-6 (AUC of 0.66). The AUCs for all the classical TB antigens were between 0.44 and 0.66 (Additional file 8: Table S8, Additional file 9: Figure S1).
DosR regulon encoded antigens
Fifty-one DosR regulon encoded antigens (Additional file 2: Table S2) were evaluated in this study. All antigens were recombinant proteins. These antigens were more frequently recognized in HHCs, confirming previous work [13, 19–21]. When antigen induced IFN-γ levels were compared between the two subject groups, the difference in IFN-γ responses were significant for 14 of the 51 antigens evaluated, namely: Rv1735c, Rv2006, Rv2625c, Rv1996, Rv2032, Rv2629, Rv3126c, Rv0081, Rv2631, Rv3130c, Rv2624c, Rv2007c, Rv2028c and Rv3134 (Table 1). The p-values for the differences in IFN-γ for six other antigens showed a trend for differential IFN-γ induction (range of p-values, 0.06 - 0.08), namely: Rv2029c, Rv2030c, Rv3129, Rv2630, Rv3133c and Rv3127 (Additional file 8: Table S8).
When the data was analyzed by ROC analysis, 8 of the 14 antigens that showed significant differences with the Mann Whitney U test (Rv2625c, Rv1996, Rv2032, Rv0081, Rv2624c,Rv2006, Rv2629 and Rv2007c) differentiated between the two groups with AUCs above 0.70 (Table 1, Figure 2). The diagnostic potentials of all the other DosR encoded antigens evaluated is shown in Additional file 8: Table S8 and the ROC curves are shown in (Additional file 9: Figure S1).
TB reactivation antigens
A total of 23 TB reactivation associated antigens (Additional file 3: Table S3) were evaluated in this study. All antigens were available as recombinant proteins. Recognition of most of these antigens was poor in both TB patients and HHCs (data not shown). Two of the most frequently recognized of these antigens (Rv1131 and Rv1471) discriminated between the TB cases and HHCs with p values < 0.05. When the data was assessed by ROC analysis, however, only Rv1131 discriminated between the TB cases and HHCs with an AUC ≥ 0.70 (Additional file 8: Table S8, Additional file 9: Figure S1).
Resuscitation promoting factors (rpfs)
All of the five known M.tb rpfs (Additional file 4: Table S4) were evaluated in this study as recombinant proteins. All rpfs elicited significantly higher IFN-γ responses in HHCs (Table 2) with AUCs ranging from 0.72 to 0.80 (Figure 3) in discriminating TB from non TB.
Starvation antigens and other stress induced proteins
Twenty-four other recombinant antigens, most of which are associated with stress conditions  (Additional file 5: Table S5) and 7 starvation induced antigens, all peptide pools (Additional file 6: Table S6), were evaluated in this study. Recognition of these antigens was poor in both TB cases and HHCs. There was no significant difference in the IFN-γ levels elicited by any of the antigens between the TB cases and HHCs (range of p-values, 0.21-0.94). The antigen with the highest AUC for differentiating between the two groups after ROC analysis was Rv0244 (AUC = 0.61). The data indicating the diagnostic potential of these and all the other antigens evaluated in the study is shown in Additional file 8: Table S8 and the ROC curves are shown in (Additional file 9: Figure S1).
Ability of combinations of antigens to discriminate between TB disease and no TB
To investigate whether the discriminative abilities of the antigens could be enhanced when used in combinations, IFN-γ data obtained for all antigens and controls were fitted into general discriminant analysis (GDA) models. Optimal prediction of the presence or absence of active TB was achieved when antigens were used in combinations of four. The most frequently occurring antigens in the top 10 four-antigen combinations that best predicted the presence or absence of TB disease were Rv2032 and ESAT-6/CFP-10fp (or ESAT-6 alone), appearing in all 10 antigen combinations (Figure 4). Addition of two other antigens (Rv1733c + Rv1736c(C-terminal part) or Rv1997c + Rv1733c) to ESAT-6/CFP-10fp and Rv2032 correctly classified 90% of the TB cases and 84% of the HHCs after leave-one-out cross validation.
Validation of ELISA results with the Quantiferon TB Gold ELISA kit
The standard curve for the ELISA employed in this study ranged from 31 pg/ml to 4000 pg/ml. Although the standard curve was useful at detecting high magnitude IFN-γ responses, IFN-γ responses below 31 pg/ml could not be reliably estimated. As optimal cut-off values obtained for the most promising antigens evaluated in this study (after background correction) were as low as 0.5 pg/ml, we performed validation of the results with another ELISA (the commercially available QFT ELISA kit). Supernatants from the best discriminatory antigens (the top five single DosR antigens (Rv2032c, Rv2625c, Rv1996, Rv0081, Rv2624c) and the top three rpfs (Rv0867c, Rv1009 and Rv2389c)) were re-evaluated. This was done in 15 TB cases and 15 HHCs who were randomly selected from our sample bank. Unstimulated control and ESAT-6/CFP-10fp stimulated supernatants from these 30 subjects were also evaluated.
Of the nine antigens re-evaluated by the QFT ELISA, significant differences between the TB cases and HHCs were only obtained for the three rpfs (Table 3). Likewise, after ROC analysis, all 3 rpfs discriminated between the TB cases and HHCs with AUCs > 0.73 (Table 3). When the predictive abilities of antigen combinations were evaluated by GDA, the most accurate antigen model (ESAT-6/CFP-10fp + Rv2624c + Rv0867c) accurately classified 83% of all study participants into their respective groups. After leave-one-out cross validation the prediction accuracy was 73% for TB cases and 80% for HHCs (Table 4). The most frequently occurring antigens in the top 10 GDA combinations were ESAT-6/CFP-10fp, Rv2624c and Rv2032 (Figure 5) and all the promising antigen combinations included ESAT-6/CFP-10fp, Rv2624c and one of the three rpfs (Rv0867c, Rv1009, and Rv2389c) (Table 4).
The diagnostic potential of 118 M.tb infection phase-dependent antigens was investigated in this study. Rpfs were the most discriminatory antigens with combinations of antigens correctly predicting up to 73% of the TB cases and up to 80% of HHCs after cross-validation.
The classical M.tb antigens, evaluated here as 'control antigens', have been extensively studied. Most of these antigens are strongly recognized with high IFN-γ production in TB patients or infected individuals [23–28] and are key components of candidate TB vaccines [29–39] or form part of antigen cocktails that are used in diagnostic tests. The frequent recognition of ESAT-6/CFP-10fp (and ESAT-6 alone) in both TB cases and HHCs, justifies the use of these antigens in all commercially available IGRAs. Recognition of TB7.7 (used in the QFT In Tube test, Cellestis, Australia), Ag85A/B and HSP65 was poor. This is in agreement with earlier studies, which suggest that the majority of response to M.tb infection is largely driven by ESAT-6 and CFP-10, with TB7.7 providing only a small extra benefit (author's unpublished data). When previously evaluated in serodiagnostic approaches, Ag 85A and B also performed poorly  while detection of antibodies or antigens to HSP65 in serum and CSF, respectively, diagnosed active TB with an accuracy above 80% [41, 42]. The poor recognition of Ag85A and B, TB7.7 and HSP65 as assessed by IFN-γ production in our study group may suggest that the conditions under which the antigens were tested was not optimal, or perhaps that the humoral and cell mediated responses to these antigens are different. It may also imply that the worth of testing candidate vaccines based on these antigens needs to be reassessed in certain populations. However, it has been shown that responses to TB antigens could be enhanced if antigens are delivered using vectors such as the Bordetella pertusis adenylate cyclase vector , use of other adjuvants  or the addition of IL-7  and IL-12  into cultures. It is not known if addition of cytokines might have improved upon the diagnostic ability of the antigens. Whether some of these antigens would perform better if used in serological assays [41, 42] requires further investigation. However, the World Health Organization has recently cautioned against the use of serological tests for the diagnosis of TB disease .
The DosR regulon of M.tb is upregulated when M.tb is subjected to conditions that mimic latency including hypoxia, nutrient starvation, low nitric oxide or low pH [10, 19, 47–50]. IFN-γ responses elicited by 14 of the DosR antigens evaluated in this study were significantly higher in HHCs compared to TB cases, and 8 of these antigens (Rv2032, Rv2625c, Rv1996, Rv0081, Rv2624c, Rv2006, Rv2629 and Rv2007c) showed promise as diagnostic candidates after ROC analysis, although this promising accuracy was not confirmed by the validation for the five antigens re-evaluated. The inclusion of some DosR regulon encoded antigens into GDA models that best predicted active TB or no TB disease, along with ESAT-6/CFP-10fp or rpfs, may suggest that these antigens are useful diagnostic candidates and need further evaluation in larger studies. The finding that DosR antigens are more frequently recognized in HHCs (many of whom we would expect to be latently infected and all of whom have at least been exposed to M.tb) has also been observed in other studies [13, 19–21]. Recognition of the DosR antigen Rv2628 was associated with cured tuberculosis and remote infection in a study in Italy . Moreover, an increased frequency of the response to Rv2628 at the site of TB disease in patients with active TB has been found .
Like the DosR antigens, the reactivation antigens and the rpfs were more frequently recognized in HHCs, with the rpfs being the most discriminatory between the TB and non-TB cases. Rpfs are growth-promoting proteins and have been shown to resuscitate dormant bacteria, as well as enhance the growth of bacteria, including M.tb in both liquid and solid media . M.tb rpfs have been shown to be immunogenic in TST-positive individuals and to elicit strong CD4 and CD8 T cell-dependent responses in vitro, in long-term latently infected individuals [21, 54]. The more frequent recognition of rpfs (believed to be predominantly expressed during the exponential growth phases [53, 55]), in latently infected individuals is consistent with the notion that M.tb exists in a dormant, non-replicating or only slowly replicating state in LTBI [56, 57]. As has been suggested previously, the bacteria may indeed still be replicating but are controlled by the host immune response in an 'active infection' . As suggested by Commandeur et al. , the presence of some of the rpfs in culture filtrate may imply higher availability and recognition by immune cells. Furthermore, the existence of M.tb in different metabolic states in its host during infection  would imply that T cells are exposed (although perhaps in different amounts) to antigens from different infection phases in vivo-hence their recognition in in vitro stimulation assays. This would also explain the recognition of DosR antigens in TB patients. Whatever the case, antigens that are recognized in both TB patients and latently infected individuals are less well suited for discriminating between different M.tb infection states but could add to the currently used RD1 antigens in the diagnosis of M.tb infection provided they are potent cytokine inducers in short-term culture assays.
To the best of our knowledge, no other study has investigated such a large number of different M.tb infection phase-dependent antigens as diagnostic candidates in a high TB-endemic setting; and little or no information is currently available about the diagnostic potential of most of the antigens investigated in this study. More studies are therefore needed in different population groups to verify the findings of this first screening study. A serious concern in the possible use of new antigens such as those investigated in this study for diagnostic purposes is a lack of specificity for M.tb. Some of the DosR antigens evaluated in this study have been shown to be expressed in BCG vaccine strains  but BCG vaccination was reported not to induce T cell responses to DosR antigens, likely because BCG fails to establish long-lived latent infections and therefore may not express (or under express) these antigens in vivo following vaccination .
Although none of the classical TB antigens were capable of discriminating between active TB and no TB, ESAT-6/CFP-10fp was included in most of the top GDA models that best discriminated between the presence and absence of TB disease. It is known that the measurement of IFN-γ elicited by ESAT-6/CFP-10 does not discriminate between active TB and LTBI. However, it has proven to be an excellent marker of M.tb infection and this is consistent with the inclusion of ESAT-6/CFP-10fp into all the best discriminatory models. The results suggest that evaluating the DosR antigens or rpfs, which were most predominantly recognized in HHCs, in combination with ESAT-6/CFP-10 could enhance our ability to differentiate LTBI from TB disease in RD1 antigen-positive individuals. When IFN-γ responses against the different antigens were analysed only amongst participants that responded to ESAT-6/CFP-10fp, significant p-values were obtained for all the five rpfs (Rv0867c, Rv2389c, Rv2450c, Rv1009, Rv1884c), 11 DosR encoded antigens (Rv3129, Rv2625c, Rv1996, Rv2032, Rv3126c, Rv2631, Rv3130c, Rv2624c, Rv2007c, Rv3131, Rv3127) and two TB reactivation antigens (Rv1471, Rv3862c). Furthermore, the AUCs for all these 18 antigens in discriminating between TB disease and no TB in the ESAT-6/CFP-10fp responsive participants was above 0.70 (data not shown). Because of the explorative nature of this study, the contributions of the different antigens in the predictive models will need to be investigated further in ongoing follow-up studies.
The main limitations of our study include the relatively small sample size, the use of 7-day WBA instead of overnight assays which would be more suitable for a diagnostic study, and the unavailability of accurate LTBI diagnostic data for the HHCs. The HHCs that participated in this study were recruited from a high TB endemic area [3, 60] where it is known that up to 89% of HHCs may be TST positive, with 74% being QFT positive in a previous study [5, 13, 17]. However the M.tb infection status of participants recruited into future follow up studies should be better characterized, so as to enable a more accurate estimation of the discriminative abilities of the antigens between active TB disease and LTBI. This could be done by means of IGRAs and appropriate contact scores based on TB exposure gradient as has been done previously [5, 6, 61]. For the majority of the antigens evaluated in this study, no information was previously available about their immunogenicity in M.tb infected individuals. We therefore chose to evaluate the antigens using a long-term whole blood culture assay in order to detect any existing immune responses to the antigens, including memory responses. Future evaluation of diagnostic candidates should be done in larger numbers of participants, in overnight assays to detect effector cell responses, and preferably using a prospective study design. Potentially useful candidates should also be evaluated in children, immunocompromised individuals, extrapulmonary TB cases and also in individuals with other lung diseases. Because of the need for new TB diagnostic tests to be rapid and less technically demanding, the use of other platforms such as serodiagnosis and the possibility of employing cocktails of antigens should be evaluated. Our data indicates that the two ELISAs employed in this study might not deliver comparable results as only three of the eight promising antigens re-evaluated with the QFT ELISA showed the same promising accuracy obtained with the "BD ELISA". The reasons behind this discrepancy were not investigated further in this study as these technical issues are beyond the scope of this screening study that was designed to identify possible diagnostic antigen candidates. The discrepancies could however, be due to technical aspects that might be inherent in the two ELISAs (the "BD ELISA" with an 8-point 4PL standard curve ranging from 31 pg/ml to 4000 pg/ml versus the QFT ELISA with a 3-point linear standard curve ranging from 0.25 IU/ml to 4.0 IU/ml). ELISA assays used in future studies should be carefully selected, taking into consideration technical aspects including detection limits, to enable more accurate detection of a broad range of IFN-γ responses. Finally, multiplex cytokine analysis assays could be used to evaluate other biomarkers [1, 17, 62] in supernatants from antigens that did or did not elicit IFN-γ responses since the lack of an IFN-γ response does not necessarily imply that the antigen is not recognized by T cells. The possibility of establishing a useful diagnostic signature comprising a pattern of host responses to different M.tb antigens should be investigated.
In conclusion, IFN-γ responses to TB rpfs associate with latency and show promise as TB diagnostic candidates. The findings of this study are preliminary and require validation in other studies and in other settings.
Chegou NN, Hoek KG, Kriel M, Warren RM, Victor TC, Walzl G: Tuberculosis assays: past, present and future. Expert Rev Anti Infect Ther. 2011, 9: 457-469. 10.1586/eri.11.23.
Boehme CC, Nabeta P, Hillemann D, Nicol M, Shenai S, Krapp F, et al: Rapid Molecular Detection of Tuberculosis and Rifampicin Resistance. N Engl J Med. 2010, 363: 1070-1081. 10.1056/NEJMe1008496.
WHO REPORT 2009. Global Tuberculosis Control: Epidemiology, Strategy, Financing. [http://www.who.int/tb/publications/global_report/2009/pdf/full_report.pdf]
Munk ME, Arend SM, Brock I, Ottenhoff TH, Andersen P: Use of ESAT-6 and CFP-10 antigens for diagnosis of extrapulmonary tuberculosis. J Infect Dis. 2001, 183: 175-176. 10.1086/317663.
Hesseling AC, Mandalakas AM, Kirchner HL, Chegou NN, Marais BJ, Stanley K, et al: Highly discordant T cell responses in individuals with recent exposure to household tuberculosis. Thorax. 2009, 64: 840-846. 10.1136/thx.2007.085340.
Mandalakas AM, Hesseling AC, Chegou NN, Kirchner HL, Zhu X, Marais BJ, et al: High level of discordant IGRA results in HIV-infected adults and children. Int J Tuberc Lung Dis. 2008, 12: 417-423.
Diel R, Goletti D, Ferrara G, Bothamley G, Cirillo D, Kampmann B, et al: Interferon-gamma release assays for the diagnosis of latent Mycobacterium tuberculosis infection: a systematic review and meta-analysis. Eur Respir J. 2011, 37: 88-99. 10.1183/09031936.00115110.
Demissie A, Leyten EM, Abebe M, Wassie L, Aseffa A, Abate G, et al: Recognition of stage-specific mycobacterial antigens differentiates between acute and latent infections with Mycobacterium tuberculosis. Clin Vaccine Immunol. 2006, 13: 179-186. 10.1128/CVI.13.2.179-186.2006.
Honer zu BK, Russell DG: Mycobacterial persistence: adaptation to a changing environment. Trends Microbiol. 2001, 9: 597-605. 10.1016/S0966-842X(01)02238-7.
Zvi A, Ariel N, Fulkerson J, Sadoff JC, Shafferman A: Whole genome identification of Mycobacterium tuberculosis vaccine candidates by comprehensive data mining and bioinformatic analyses. BMC Med Genomics. 2008, 1: 18-10.1186/1755-8794-1-18.
Mukamolova GV, Kaprelyants AS, Young DI, Kell DB: A bacterial cytokine. Proc Natl Acad Sci. 1998, 95: 8916-8921. 10.1073/pnas.95.15.8916.
Franken KL, Hiemstra HS, van Meijgaarden KE, Subronto Y, den HJ, Ottenhoff TH, et al: Purification of his-tagged proteins by immobilized chelate affinity chromatography: the benefits from the use of organic solvent. Protein Expr Purif. 2000, 18: 95-99. 10.1006/prep.1999.1162.
Black GF, Thiel BA, Ota MO, Parida SK, Adegbola R, Boom WH, et al: Immunogenicity of novel DosR regulon-encoded candidate antigens of Mycobacterium tuberculosis in three high-burden populations in Africa. Clin Vaccine Immunol. 2009, 16: 1203-1212. 10.1128/CVI.00111-09.
Black GF, Fine PEM, Warndorff DK, Floyd S, Weir RE, Blackwell JM, et al: Relationship between IFN-gamma and skin test responsiveness to Mycobacterium tuberculosis PPD in healthy, non-BCG-vaccinated young adults in Northern Malawi. Int J Tuberc Lung Dis. 2001, 5: 664-672.
Weir RE, Brennan PJ, Butlin CR, Dockrell HM: Use of a whole blood assay to evaluate in vitro T cell responses to new leprosy skin test antigens in leprosy patients and healthy subjects. Clin Exp Immunol. 1999, 116: 263-269. 10.1046/j.1365-2249.1999.00892.x.
Desem N, Jones SL: Development of a human gamma interferon enzyme immunoassay and comparison with tuberculin skin testing for detection of Mycobacterium tuberculosis infection. Clin Diagn Lab Immunol. 1998, 5: 531-536.
Chegou NN, Black GF, Kidd M, van Helden PD, Walzl G: Host markers in Quantiferon supernatants differentiate active TB from latent TB infection: preliminary report. BMC Pulm Med. 2009, 9: 21-10.1186/1471-2466-9-21.
Sahiratmadja E, Alisjahbana B, de BT, Adnan I, Maya A, Danusantoso H, et al: Dynamic changes in pro- and anti-inflammatory cytokine profiles and gamma interferon receptor signaling integrity correlate with tuberculosis disease activity and response to curative treatment. Infect Immun. 2007, 75: 820-829. 10.1128/IAI.00602-06.
Leyten EM, Lin MY, Franken KL, Friggen AH, Prins C, van Meijgaarden KE, et al: Human T-cell responses to 25 novel antigens encoded by genes of the dormancy regulon of Mycobacterium tuberculosis. Microbes Infect. 2006, 8: 2052-2060. 10.1016/j.micinf.2006.03.018.
Commandeur S, Lin MY, van Meijgaarden KE, Friggen AH, Franken KL, Drijfhout JW, et al: Double- and monofunctional CD4(+) and CD8(+) T-cell responses to Mycobacterium tuberculosis DosR antigens and peptides in long-term latently infected individuals. Eur J Immunol.
Schuck SD, Mueller H, Kunitz F, Neher A, Hoffmann H, Franken KL, et al: Identification of T-cell antigens specific for latent mycobacterium tuberculosis infection. PLoS One. 2009, 4: e5590-10.1371/journal.pone.0005590.
Schnappinger D, Ehrt S, Voskuil MI, Liu Y, Mangan JA, Monahan IM, et al: Transcriptional Adaptation of Mycobacterium tuberculosis within Macrophages: Insights into the Phagosomal Environment. J Exp Med. 2003, 198: 693-704. 10.1084/jem.20030846.
Friedland JS, Shattock R, Remick DG, Griffin GE: Mycobacterial 65-kD heat shock protein induces release of proinflammatory cytokines from human monocytic cells. Clin Exp Immunol. 1993, 91: 58-62.
Lewthwaite JC, Coates AR, Tormay P, Singh M, Mascagni P, Poole S, et al: Mycobacterium tuberculosis chaperonin 60.1 is a more potent cytokine stimulator than chaperonin 60.2 (Hsp 65) and contains a CD14-binding domain. Infect Immun. 2001, 69: 7349-7355. 10.1128/IAI.69.12.7349-7355.2001.
Geluk A, Lin MY, van Meijgaarden KE, Leyten EM, Franken KL, Ottenhoff TH, et al: T-Cell Recognition of the HspX Protein of Mycobacterium tuberculosis Correlates with Latent M. tuberculosis Infection but Not with M. bovis BCG Vaccination. Infect Immun. 2007, 75: 2914-2921. 10.1128/IAI.01990-06.
Antas PR, Cardoso FL, Pereira KC, Franken KL, Cunha KS, Klatser P, et al: T cell immune responses to mycobacterial antigens in Brazilian tuberculosis patients and controls. Trans R Soc Trop Med Hyg. 2005, 99: 699-707. 10.1016/j.trstmh.2005.05.002.
Skjot RL, Oettinger T, Rosenkrands I, Ravn P, Brock I, Jacobsen S, et al: Comparative evaluation of low-molecular-mass proteins from Mycobacterium tuberculosis identifies members of the ESAT-6 family as immunodominant T-cell antigens. Infect Immun. 2000, 68: 214-220. 10.1128/IAI.68.1.214-220.2000.
Skjot RL, Brock I, Arend SM, Munk ME, Theisen M, Ottenhoff TH, et al: Epitope mapping of the immunodominant antigen TB10.4 and the two homologous proteins TB10.3 and TB12.9, which constitute a subfamily of the esat-6 gene family. Infect Immun. 2002, 70: 5446-5453. 10.1128/IAI.70.10.5446-5453.2002.
Wang LM, Bai YL, Shi CH, Gao H, Xue Y, Jiang H, et al: Immunogenicity and protective efficacy of a DNA vaccine encoding the fusion protein of mycobacterium heat shock protein 65 (Hsp65) with human interleukin-2 against Mycobacterium tuberculosis in BALB/c mice. APMIS. 2008, 116: 1071-1081. 10.1111/j.1600-0463.2008.01095.x.
Shi C, Yuan S, Zhang H, Zhang T, Wang L, Xu Z: Cell-mediated immune responses and protective efficacy against infection with Mycobacterium tuberculosis induced by Hsp65 and hIL-2 fusion protein in mice. Scand J Immunol. 2009, 69: 140-149. 10.1111/j.1365-3083.2008.02207.x.
Palma C, Iona E, Giannoni F, Pardini M, Brunori L, Orefici G, et al: The Ag85B protein of Mycobacterium tuberculosis may turn a protective immune response induced by Ag85B-DNA vaccine into a potent but non-protective Th1 immune response in mice. Cell Microbiol. 2007, 9: 1455-1465. 10.1111/j.1462-5822.2007.00884.x.
Palma C, Iona E, Giannoni F, Pardini M, Brunori L, Fattorini L, et al: The LTK63 adjuvant improves protection conferred by Ag85B DNA-protein prime-boosting vaccination against Mycobacterium tuberculosis infection by dampening IFN-gamma response. Vaccine. 2008, 26: 4237-4243. 10.1016/j.vaccine.2008.05.050.
Forbes EK, Sander C, Ronan EO, McShane H, Hill AV, Beverley PC, et al: Multifunctional, high-level cytokine-producing Th1 cells in the lung, but not spleen, correlate with protection against Mycobacterium tuberculosis aerosol challenge in mice. J Immunol. 2008, 181: 4955-4964.
Tchilian EZ, Desel C, Forbes EK, Bandermann S, Sander CR, Hill AV, et al: Immunogenicity and protective efficacy of prime-boost regimens with recombinant (delta)ureC hly+ Mycobacterium bovis BCG and modified vaccinia virus ankara expressing M. tuberculosis antigen 85A against murine tuberculosis. Infect Immun. 2009, 77: 622-631. 10.1128/IAI.00685-08.
Brookes RH, Hill PC, Owiafe PK, Ibanga HB, Jeffries DJ, Donkor SA, et al: Safety and immunogenicity of the candidate tuberculosis vaccine MVA85A in West Africa. PLoS One. 2008, 3: e2921-10.1371/journal.pone.0002921.
Hawkridge T, Scriba TJ, Gelderbloem S, Smit E, Tameris M, Moyo S, et al: Safety and immunogenicity of a new tuberculosis vaccine, MVA85A, in healthy adults in South Africa. J Infect Dis. 2008, 198: 544-552. 10.1086/590185.
Pardini M, Giannoni F, Palma C, Iona E, Cafaro A, Brunori L, et al: Immune response and protection by DNA vaccines expressing antigen 85B of Mycobacterium tuberculosis. FEMS Microbiol Lett. 2006, 262: 210-215. 10.1111/j.1574-6968.2006.00390.x.
Dietrich J, Aagaard C, Leah R, Olsen AW, Stryhn A, Doherty TM, et al: Exchanging ESAT6 with TB10.4 in an Ag85B fusion molecule-based tuberculosis subunit vaccine: efficient protection and ESAT6-based sensitive monitoring of vaccine efficacy. J Immunol. 2005, 174: 6332-6339.
Hervas-Stubbs S, Majlessi L, Simsova M, Morova J, Rojas MJ, Nouze C, et al: High frequency of CD4+ T cells specific for the TB10.4 protein correlates with protection against Mycobacterium tuberculosis infection. Infect Immun. 2006, 74: 3396-3407. 10.1128/IAI.02086-05.
Kumar G, Dagur PK, Singh M, Yadav VS, Dayal R, Singh HB, et al: Diagnostic potential of Ag85C in comparison to various secretory antigens for childhood tuberculosis. Scand J Immunol. 2008, 68: 177-183. 10.1111/j.1365-3083.2008.02133.x.
Rajan AN, Kashyap RS, Purohit HJ, Taori GM, Daginawala HF: Serodiagnosis of tuberculosis based on the analysis of the 65 kD heat shock protein of Mycobacterium tuberculosis. Int J Tuberc Lung Dis. 2007, 11: 792-797.
Mudaliar AV, Kashyap RS, Purohit HJ, Taori GM, Daginawala HF: Detection of 65 kD heat shock protein in cerebrospinal fluid of tuberculous meningitis patients. BMC Neurol. 2006, 6: 34-10.1186/1471-2377-6-34.
Connell TG, Shey MS, Seldon R, Rangaka MX, van CG, Simsova M, et al: Enhanced ex vivo stimulation of Mycobacterium tuberculosis-specific T cells in human immunodeficiency virus-infected persons via antigen delivery by the Bordetella pertussis adenylate cyclase vector. Clin Vaccine Immunol. 2007, 14: 847-854. 10.1128/CVI.00041-07.
Feske M, Nudelman RJ, Medina M, Lew J, Singh M, Couturier J, et al: Enhancement of human antigen-specific memory T-cell responses by interleukin-7 may improve accuracy in diagnosing tuberculosis. Clin Vaccine Immunol. 2008, 15: 1616-1622. 10.1128/CVI.00185-08.
Geluk A, van der Ploeg-van Schip JJ, van Meijgaarden KE, Commandeur S, Drijfhout JW, Benckhuijsen WE, et al: Enhancing sensitivity of detection of immune responses to Mycobacterium leprae peptides in whole-blood assays. Clin Vaccine Immunol. 2010, 17: 993-1004. 10.1128/CVI.00046-10.
World Health Organisation. WHO warns against the use of inaccurate blood tests for active tuberculosis. [http://www.who.int/mediacentre/news/releases/2011/tb_20110720/en/index.html]
Honaker RW, Stewart A, Schittone S, Izzo A, Klein MR, Voskuil MI: Mycobacterium bovis BCG vaccine strains lack narK2 and narX induction and exhibit altered phenotypes during dormancy. Infect Immun. 2008, 76: 2587-2593. 10.1128/IAI.01235-07.
Wayne LG, Sohaskey CD: Nonreplicating persistence of mycobacterium tuberculosis. Annu Rev Microbiol. 2001, 55: 139-163. 10.1146/annurev.micro.55.1.139.
Lin MY, Ottenhoff TH: Not to wake a sleeping giant: new insights into host-pathogen interactions identify new targets for vaccination against latent Mycobacterium tuberculosis infection. Biol Chem. 2008, 389: 497-511. 10.1515/BC.2008.057.
Roupie V, Romano M, Zhang L, Korf H, Lin MY, Franken KL, et al: Immunogenicity of eight dormancy regulon-encoded proteins of Mycobacterium tuberculosis in DNA-vaccinated and tuberculosis-infected mice. Infect Immun. 2007, 75: 941-949. 10.1128/IAI.01137-06.
Goletti D, Butera O, Vanini V, Lauria FN, Lange C, Franken KL, et al: Response to Rv2628 latency antigen associates with cured tuberculosis and remote infection. Eur Respir J. 2010, 36: 135-142. 10.1183/09031936.00140009.
Chiacchio T, Petruccioli E, Vanini V, Butera O, Cuzzi G, Petrone L, et al: Higher frequency of T-Cell response to M. tuberculosis latency antigen Rv2628 at the site of active tuberculosis disease than in peripheral blood. PLoS One. 2011, 6: e27539-10.1371/journal.pone.0027539.
Wu X, Yang Y, Han Y, Zhang J, Liang Y, Li H, et al: Effect of recombinant Rv1009 protein on promoting the growth of Mycobacterium tuberculosis. J Appl Microbiol. 2008, 105: 1121-1127. 10.1111/j.1365-2672.2008.03850.x.
Commandeur S, van Meijgaarden KE, Lin MY, Franken KL, Friggen AH, Drijfhout JW, et al: Identification of human T-cell responses to Mycobacterium tuberculosis resuscitation-promoting factors in long-term latently infected individuals. Clin Vaccine Immunol. 2011, 18: 676-683. 10.1128/CVI.00492-10.
Tufariello JM, Mi K, Xu J, Manabe YC, Kesavan AK, Drumm J, et al: Deletion of the Mycobacterium tuberculosis resuscitation-promoting factor Rv1009 gene results in delayed reactivation from chronic tuberculosis. Infect Immun. 2006, 74: 2985-2995. 10.1128/IAI.74.5.2985-2995.2006.
Hernandez-Pando R, Chacon-Salinas R, Serafin-Lopez J, Estrada I: Immunology, Pathogenesis, Virulence. Tuberculosis 2007: From Basic Science to Patient Care. Edited by: Palomino JC, Leao SC, Ritacco V. 2007, 157-206.
Kaufmann SH, Parida SK: Tuberculosis in Africa: learning from pathogenesis for biomarker identification. Cell Host Microbe. 2008, 4: 219-228. 10.1016/j.chom.2008.08.002.
Young DB, Gideon HP, Wilkinson RJ: Eliminating latent tuberculosis. Trends Microbiol. 2009, 17: 183-188. 10.1016/j.tim.2009.02.005.
Lin MY, Geluk A, Smith SG, Stewart AL, Friggen AH, Franken KL, et al: Lack of immune responses to Mycobacterium tuberculosis DosR regulon proteins following Mycobacterium bovis BCG vaccination. Infect Immun. 2007, 75: 3523-3530. 10.1128/IAI.01999-06.
Marais BJ, Rabie H, Cotton MF: TB and HIV in children - advances in prevention and management. Paediatr Respir Rev. 2011, 12: 39-45. 10.1016/j.prrv.2010.09.002.
Shams H, Weis SE, Klucar P, Lalvani A, Moonan PK, Pogoda JM, et al: Enzyme-linked immunospot and tuberculin skin testing to detect latent tuberculosis infection. Am J Respir Crit Care Med. 2005, 172: 1161-1168. 10.1164/rccm.200505-748OC.
Walzl G, Ronacher K, Hanekom W, Scriba TJ, Zumla A: Immunological biomarkers of tuberculosis. Nat Rev Immunol. 2011, 11: 343-354. 10.1038/nri2960.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/12/10/prepub
We are grateful to Professor Martin Kidd of the Centre for Statistical Consultation of the University of Stellenbosch for assistance with the analysis of the data. This work received financial support from the Bill & Melinda Gates Foundation Grand Challenge 6 (BMGFGC6, grant no 37772), Principal Investigator SHE Kaufmann.
The authors declare that they have no competing interests.
KLF and AHF produced all recombinant antigens and TMD produced the peptide pools for the study. THO, TMD, SHEK, MRK, SKP, GW, GFB and NNC helped in designing the study. NNC, GFB, GW, AGL, KS and PNE helped in recruitment of the participants and/or performed the whole blood assays and ELISAs. NNC, GW, THO, GFB, SHEK, TMD helped in analyzing the data or provided intellectual input, and in writing the manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 8: Table S8. Median levels of IFN-γ (pg/ml) and Inter quartile range (25th to 75th percentile, in parenthesis) elicited upon stimulation of whole blood with different M.tb infection phase-dependent antigens and abilities to discriminate between pulmonary TB disease (in 23 cases) and no TB disease (in 19-21 household contacts). AUC = Area under the curve, 95% CI = 95% Confidence interval. The p-values shown are Mann Whitney U test P values for differences between the TB cases and HHCs. The cut-off values are for the sensitivity and specificity for TB disease. Antigens were sorted according to AUC (highest to lowest) for discriminating between TB disease and no TB disease. (XLSX 25 KB)
About this article
Cite this article
Chegou, N.N., Black, G.F., Loxton, A.G. et al. Potential of novel Mycobacterium tuberculosis infection phase-dependent antigens in the diagnosis of TB disease in a high burden setting. BMC Infect Dis 12, 10 (2012). https://doi.org/10.1186/1471-2334-12-10
- Receiver Operating Characteristic
- Tuberculin Skin Test
- Peptide Pool
- Receiver Operating Characteristic Analysis
- General Discriminant Analysis