- Research article
- Open access
- Published:
Specificity of a whole blood IGRA in German nursing students
BMC Infectious Diseases volume 11, Article number: 245 (2011)
Abstract
Background
Interferon-gamma release assays (IGRA) are used for tuberculosis (TB) screening in healthcare workers (HCWs). However, data on specificity of IGRA in serial testing of HCWs is sparse. Therefore the specificity and the negative predictive value of the IGRA - QuantiFERON-TB Gold In-Tube (QFT) - in German nursing students was investigated.
Methods
194 nursing students at the start of their professional career were tested with the QFT. 14 nursing students were excluded from the specificity analysis, due to exposure to mycobacterium tuberculosis. Two of these subjects were QFT- positive. None of them developed disease during the year of follow-up. A study group of 180 students, all with very low risk of prior TB infection, remained in the specificity analysis. Subjects were monitored for at least two years with respect to the development of active TB disease. IGRA was performed at the start of the training and after one year.
Results
The mean age of the study group (n = 180) was 23 years (range 18-53) with 70.9% female and 99.4% German born. The specificity of QFT was 98.9% (178/180; 95% CI 0.96-0.99); lowering the cut-off from 0.35 IU/ml to 0.1 IU/ml would have decreased specificity only slightly to 97.8% (176/180; 95% CI 0.94-0.99). Of the 154 nursing students available for re-testing, one student who initially scored positive reverted to negative, and one student initially negative converted to positive. None of the monitored group with initially negative QFT results developed TB disease, indicating a high negative predictive value of the IGRA in this population.
Conclusions
Following our data, QFT can serve as an effective tool in pre-employment TB screenings for HCWs. As its negative results were stable over time, specificity of the QFT in serial testing of HCWs is high. As the risk of acquiring TB infection in the German healthcare system appears to be low, our data supports the recommendation of performing TB screening only in those HCWs with known contact to TB patients or infectious materials.
Background
Screening healthcare workers (HCWs) for latent tuberculosis infection (LTBI) and active tuberculosis (TB) disease is a fundamental aspect of infection control programmes in hospitals [1]. The tuberculin skin test (TST) was the first method available for detecting LTBI. However, the TST has known limitations, including cross-reactivity with bacillus Calmette-Guérin (BCG) and non-tuberculous mycobacteria (NTM) infections [2]. Recently, new in-vitro assays have been developed that measure interferon (IFN)-γ released by sensitised T cells after stimulation with Mycobacterium tuberculosis antigens. These tests are more specific than the TST since they use antigens not shared by any of the BCG vaccine strains and only by few NTM species (namely M. marinum, M. szulgai, M. kansasii, and M. riyadhense [3] that are still rarely detected in clinical settings, but that often have clinical relevance [4] Although in most slow-growing NTM-species ESX-5, a duplication of RD1 and its secretion system (ESX-1) has been detected, the secretion products seem to be secretion system specific [5] and thus do not seem to influence the specificity of the IGRA-assays. Interferon-γ release assays (IGRAs) also have the advantage of correlating better with surrogate measures of exposure to M. tuberculosis [6–8] and have a higher predictive value for LTBI progression to active TB disease in close contact in low-incidence settings [9].
Despite a steadily increasing flood of studies on the use of interferon gamma release assays (IGRAs) in detecting latent TB infection (LTBI), the number of studies evaluating specificity, i.e. measuring a test's ability to score LTBI-free subjects as test-negative, is small [10]. Due to the lack of a gold standard to ascertain LTBI in a study individual, specificity can only be measured in healthy subjects who report no known risk for prior M. tuberculosis (MTB) exposure and - as far as possible - in an environment that itself offers little or no chance of spontaneous, unrecognised transmission to the test population. Therefore, studies to test a hypothesis of high specificity should be conducted in low prevalence countries where the risk of unnoticed exposure to MTB can be considered negligible. As a more specific test will produce fewer positive results than a less specific test with identical sensitivity, doubts may arise as to the sensitivity of the more specific test. In the absence of a gold standard, reliable proxy measurements for sensitivity are needed. The negative predictive value (NPV), i.e. the probability that a test-negative person is actually negative, is one such proxy for sensitivity. In the case of tests for LTBI, where the consequence of a false negative test may only become apparent long after the test date, the NPV of a test can only be measured in terms of its NPV for progression to active TB disease. As HCWs may be subjected to serial testing for LTBI over the course of their careers, high specificity of the test applied is of particular importance. Some paper gave concern to the specificity of the QFT as they observed high conversion and reversion rates. Therefore we examined the accuracy and specificity of the QFT in a follow-up study on low exposed students entering nursing schools in a low- incidence country.
Methods
Study design
Our study group consisted of nursing students (18 years of age or older), trained for work in nursing homes and hospitals, starting their professional career in healthcare institutions operated by the healthcare provider Vivantes (*Institut für berufliche Bildung im Gesundheitswesen (IbBG) Vivantes) in Berlin. Participation was on a voluntary basis. Participants were asked to complete a standardised questionnaire before starting their career in healthcare; questions addressed national origin, whether foreign born, how long they had been living in Germany, possible risk factors for prior exposure to MTB, history of TB disease, inclusion in TB contact tracing exercises in the past, and BCG vaccination status.
One year after enrollment, a second QFT was performed and a new standardised questionnaire was implemented, soliciting information as to specific activities undertaken in the course of the year. Questions addressed the wards or fields of healthcare to which the participants had been assigned, the time period spent there, contact with TB patients and, if any, type and duration of contact. In addition, participants were quizzed on non-professional TB risks such as cases of TB disease in the family or among friends and acquaintances, or journeys of two weeks or longer to high-incidence countries during the first year of work. Each individual was monitored with respect to the development of TB disease for a further year.
Student nurses with risk factors for prior TB infection, including birth in a country with a high TB prevalence, were not taken into account during the analysis of specificity. The study design was approved by the Ethics Committee of the Hamburg Medical Council in Hamburg, Germany.
Definitions of specificity and negative predictive value (NPV) for progression
Specificity is defined as the number of true negatives divided by the sum of true negatives and false positives. The NPV for progression to active TB is defined as the proportion of test-negative subjects that do not progress to active tuberculosis in a longitudinal follow-up study of individuals tested for LTBI. This value reflects a test's ability to correctly predict that an individual who tested negative for LTBI will not develop active tuberculosis later on in life, assuming that no further exposure to MTB takes place. As only subjects infected with M. tuberculosis can develop the disease, the NPV can be measured by following subjects that tested negative for LTBI over time and quantifying the number that have remained free from progression to active disease.
QuantiFERON Gold In-Tube (QFT) was performed according to the manufacturer's instructions (Cellestis Ltd., Chadstone, Australia). As recommended, the cut-off value for a positive test was IFN-γ ≥ 0.35 IU/ml for the TB-antigen minus NIL, provided the NIL control was < 8.0 IU/ml and the TB-antigen minus NIL response was at least 25% of the NIL response. The result was indeterminate if the NIL was > 8.0 IU/ml or if not positive and the mitogen control minus NIL value was ≤ 0.5 IU/ml. All other result profiles provided a negative result. The validated linear range of the QFT ELISA, as reported by the manufacturer, is 0 to 10 IU/ml, thus any value above 10 IU/ml is reported as > 10 IU/ml.
Statistical analysis
The categorical data was compared using the Pearson's χ2 test or Fisher's exact test, when expected sample sizes comprised fewer than five subjects. The Wilcoxon signed-rank sum test was performed to determine whether the means of two repeated measurements of IFN-γ concentrations differed. All P values reported are based on two-tailed comparisons with statistical significance set at P < 0.05. Statistical analyses were performed using SPSS version 18.0 for Windows (SPSS, Inc., Chicago, IL) and BIAS version 8.3.6 for Windows (Epsilon, Inc., Frankfurt, Germany).
Results
Study group at the start
In all, 194 persons were enrolled between 1 October 2008 and 30 April 2009. The cohort was observed until 30 April 2011 (Figure 1) with a mean period between the first and second IGRA of 17 month (standard deviation 2 month). Of the participants, 104 were distributed to 69 different departments (e.g. gastroenterology, psychiatry, infection ward, etc.) in 33 different hospitals or 68 different departments of these hospitals. The other 90 nursing students worked in numerous nursing homes, rehabilitation centres and mobile nursing services. There were 13 members born in intermediate or high-prevalence TB countries (Cameroon, Poland, Ethiopia, Nepal, Romania, Pakistan, Kosovo, Turkey, Albania, Russia), of whom a 20-year-old woman who moved from Ethiopia to Germany in 2002 was QFT-positive (2.05 IU/ml), all other 12 subjects had negative QFT-results. One 18-year-old German male student had a positive QFT with high INF-γ concentration (> 10 IU/ml) due probably to close contact with an infectious TB patient as this student had worked in healthcare before the training started. However, this link could not be established with certainty. These 14 students were excluded from the specificity analysis. Details of the study population are shown in Table 1.
Specificity
Of the remaining 180 subjects with very low risk of MTB infection, two study members, females aged 22 and 42 years, were QFT-positive with a difference of TB antigen-NIL of 1.75 IU/ml and 0.67 IU/ml, respectively. None of the study members had an indeterminate result (Figure 2). None of the study population showed high nil- controls (range from 0.00 to 0.18 IU/ml). Therefore, nobody was IGRA-negative due to the fact of a high nil control. Estimated specificity for the QFT was therefore 98.9% (178/180; 95% CI 0.96-0.999). The mean age of the specificity group was 22.96 ± SD 5.78 (min, max: 18, 53). Members were predominately female (128, 71.1%), and 86 (47.8%) had been BCG vaccinated, of whom BCG vaccination was certificated by a vaccination pass in 85 and one women without certification had a vaccination scar. There was no statistical difference between BCG-vaccines with respect to gender and country of birth. 179 of the low-risk persons were born in Germany, whereas the remaining subject, a 47-year-old man was born in Chile. A lowering of any cut-off value in a test compromises specificity for the supposed benefit of added sensitivity. In our study, if the cut-off (TB AG-NIL) is lowered to 0.10 IU/ml, only two more subjects would be positive with values of 0.19 IU/ml and 0.22 IU/ml; this would reduce our specificity estimate only slightly, to 176/180 (97.8%; 95% CI 0.94-0.99).
Follow up results
Of the 194 study participants initially included in the study, 154 were retested one year after enrollment. The remaining 40 student nurses (20.6%) had dropped out of the training programme. Among the 154 retested healthcare workers, one reverted from a positive to a negative QFT result (from 1.75 IU/ml to 0.00 IU/ml) and one of the persons initially negative converted from negative to positive (from 0.01 IU/ml to 0.68 IU/ml) (Figure 3). The average IFN-γ level of the tested individuals was unchanged between the first testing and the second testing (p = 0.28, n.s.) with a mean of 0.053 ± 0.043 SD in the first and 0.039 ± 0.097 SD in the second QFT. There was no statistical difference between the 40 subjects who dropped out and the remaining 154 HCWs with respect to age, sex, BCG vaccination and origin. 35 of the 154 (22.7%) students had contact to patients with active TB (22 sputum positive patients) during the year between the first and the second QFT tests. However, the student with a conversion in QFT result worked in a nursing home and had no known contact to TB patients (data not shown). Nonetheless, they were followed for progression to active TB for the whole two years. The NPV for progression was 100%, i.e. not a single one of the healthcare workers developed TB disease during the study period
Discussion
To our knowledge, this is the first specificity study which includes repeated testing and a follow-up period for calculating the NPV of the IGRA. As stipulated by the regulatory frameworks of the respective countries, individuals with contact to infectious TB cases must be investigated so as to prevent the spread of TB disease. However, testing of larger groups of persons in low-incidence countries without any known TB risk is difficult to execute, given ethical considerations. As a result, the number of persons whose presumed lack of infection with MTB is confirmed by a negative IGRA result is relatively low and study groups are quite heterogeneous. The general situation, therefore, does not lend itself to the performance of specificity studies.
Up to now, only six published studies evaluated the specificity of commercially available IGRAs, i.e. QFT and/or T-SPOT.TB, in a total of 736 subjects with valid IGRA results fulfilling the inclusion criteria, i.e. excluding studies performed in intermediate-incidence countries. The study conducted by Detjen et al. included 45 children with confirmed non-TB lymphadenitis or respiratory infections [11], Pallazo et al. [12] included 24 healthy blood donors as controls for TB suspects, and Ruhwald et al. [13] 86 high school students and 38 members of the high school staff. In the paper published by Franken et al. [14] 168 recruits in the Dutch Armed Forces could be considered as having little risk. Wang et al. [15] included 97 adult university volunteers and eleven hospital children, and the study by Bienek and Chang [16] comprised 278 persons in the low-risk group of U.S.-born Navy recruits. According to these studies, the specificity of the IGRAs ranged from 96.9% (95% CI 94.2-98.6%) [10] for the T-SPOT.TB ("European cut-off" without any grey zone) to 100% (95% CI 97.6-100%) for the QFT.
Our study of healthcare trainees just starting their active careers confirms the high specificity of the QFT at nearly 99% and thus presents numbers nearly identical to the estimates of between 98.8% and 100% of the four already published studies in which the specificity of QFT was examined. In addition, however, we retested our individuals after one year and followed them for two years in order to investigate whether a false-negative person not recognised by the test would develop TB disease in the near future. Of the 152 retested persons with initial QFT-negative results who were monitored for at least two years, none fell ill and therefore the NPV for progression was 100%. However, one of the 152 retested participants with an initial QFT-negative result, a student nurse in a nursing home, converted to a positive result. As there was no source of infection identified, the reason for the conversion remains unexplained. Some studies about serial testing in HCWs suggested the use of a grey zone from > 0.2 to 0.7 IU/ml for the QFT results in serial examinations [17–19]. Using this grey zone in our study we found no conversion. As LTBI prevalence in geriatric nurses was reported to be higher than in other HCWs [20] and the student worked in a nursing home, the conversion might be caused by a fresh infection of an unknown source occurring after the first testing. Over the same period, the individual who initially scored positive then reverted to negative.
No further latent TB infection appears to have occurred, although the medical activities of the study participants were carried out in 68 different hospitals (or different departments of those hospitals, including infection wards), in nursing homes and mobile nursing services and 35 students indicated that they had contact to TB patients. This data indicates that in Germany the chance of acquiring TB infection through work in the healthcare sector is low. Schablon et al. [21] tested 2,028 employees in the healthcare sector with the QFT test between December 2005 and May 2009, either in the course of contact tracing or in serial testing of TB high-risk groups pursuant to German OSH legislation, but even then a positive IGRA was found in only 9.9% of the HCWs.
Nevertheless, it was highlighted in a recent systematic review that conversion of IGRA serial testing results is common among HCWs [22]. Two recent serial testing studies among German HCWs found conversion rates of between 1.9% [17] and 5.2% [18]. In Portuguese HCWs the conversion rate was 11% [19]. The higher conversion rate in Portuguese HCWs compared to in German HCWs is in agreement with the higher TB incidence in the Portuguese population. Furthermore, the conversion rates are similar to those described in a meta-analysis for the TST [23]. In the three above-mentioned studies, serial testing was performed because of known contact to TB patients or infectious materials. Only 14.3% of the student nurses had contact to TB patients within the one year between the two QFTs. Exposure was therefore lower than in the two other German serial testing studies [17, 18] and a low conversion rate was expected. The conversion rate actually observed was as low as 0.7% (1 out of 153). This indicates a high specificity of the QFT and a good reproducibility of negative QFT results.
The inclusion of a follow-up period in our specificity analysis strengthens our study. However, our study also has limitations. First of all the sample size is rather small. Furthermore, the study was carried out in a population that was not completely free of potential exposure to MTB. But as only one conversion occurred, results were not substantially diluted by performing our study with nursing students.
Conclusions
Based on our data, it must be asked whether comprehensive serial testing of HCWs following pre-employment screening remains an expedient preventive measure, at least outside of high-risk settings such as TB wards or laboratories. However, as the reproducibility of negative QFT is high, QFT could conceivably be used to monitor the hygiene standards in wards where contact to TB patients or infectious material is to be suspected.
References
Jensen PA, Lambert LA, Iademarco MF, Ridzon R: Guidelines for preventing the transmission of Mycobacterium tuberculosis in health-care settings, 2005. MMWR Recomm Rep. 2005, 54 (RR-17): 1-141.
Menzies D: What does tuberculin reactivity after bacille Calmette-Guerin vaccination tell us?. Clin Infect Dis. 2000, 31 (Suppl 3): S71-S74.
van Ingen J, de Zwaan R, Dekhuijzen R, Boeree M, van Soolingen D: Region of Difference 1 in Nontuberculous Mycobacterium Species Adds a Phylogenetic and Taxonomical Character. Journal of Bacteriology. 2009, 5865-5867.
van Ingen J, Bendien SA, de Lange WCM, Hoefsloot W, Dekhuijzen PNR, Boeree MJ, van Soolingen D: Clinical relevance of non-tuberculous mycobacteriaisolated in the Nijmegen-Arnhem region, The Netherlands. thorax.bmj.com on August 23, 2011 online first
Abdallah AM, Verboom T, Weerdenburg EM, Gey van Pittius NC, Mahasha PW, Jiménez C, Marcela Parra M, Nathalie Cadieux N, Brennan MJ, Appelmelk B, Bitter W: PPE and PE_PGRS proteins of Mycobacterium marinum are transported via the type VII secretion system ESX-5. Molecular Microbiology. 2009, 73 (3): 329-340. 10.1111/j.1365-2958.2009.06783.x.
Nahid P, Pai M, Hopewell PC: Advances in the diagnosis and treatment of tuberculosis. Proc Am Thorac Soc. 2006, 3 (1): 103-110. 10.1513/pats.200511-119JH.
Diel R, Loddenkemper R, Meywald-Walter K, Gottschalk R, Nienhaus A: Comparative Performance of Tuberculin Skin Test, QuantiFERON-TB-Gold In Tube Assay, and T-Spot.TB Test in Contact Investigations for Tuberculosis. Chest. 2009, 135 (4): 1010-1018. 10.1378/chest.08-2048.
Diel R, Loddenkemper R, Nienhaus A: Evidence based comparison of commercial interferon-gamma release assays for detecting active tuberculosis -- a meta-analysis. Chest. 2010, 137 (4): 952-968. 10.1378/chest.09-2350.
Diel R, Loddenkemper R, Niemann S, Meywald-Walter K, Nienhaus A: Negative and Positive Predictive Value of a Whole-Blood IGRA for Developing Active TB - An Update. Am J Respir Crit Care Med. 2011, 183 (1): 88-95. 10.1164/rccm.201006-0974OC.
Diel R, Goletti D, Ferrara G, Bothamley G, Cirillo D, Kampmann B, Lange C, Losi M, Markova R, Migliori GB, et al: Interferon-{gamma} release assays for the diagnosis of latent M. tuberculosis infection: A systematic review and meta-analysis. Eur Respir J. 2011, 37 (1): 88-99. 10.1183/09031936.00115110.
Detjen AK, Keil T, Roll S, Hauer B, Mauch H, Wahn U, Magdorf K: Interferon-gamma release assays improve the diagnosis of tuberculosis and nontuberculous mycobacterial disease in children in a country with a low incidence of tuberculosis. Clin Infect Dis. 2007, 45 (3): 322-328. 10.1086/519266.
Palazzo R, Spensieri F, Massari M, Fedele G, Frasca L, Carrara S, Goletti D, Ausiello CM: Use of whole-blood samples in in-house bulk and single-cell antigen-specific gamma interferon assays for surveillance of Mycobacterium tuberculosis infections. Clin Vaccine Immunol. 2008, 15 (2): 327-337. 10.1128/CVI.00342-07.
Ruhwald M, Petersen J, Kofoed K, Nakaoka H, Cuevas LE, Lawson L, Squire SB, Eugen-Olsen J, Ravn P: Improving T-cell assays for the diagnosis of latent TB infection: potential of a diagnostic test based on IP-10. PLoS ONE. 2008, 3 (8): e2858-10.1371/journal.pone.0002858.
Franken WP, Timmermans JF, Prins C, Slootman EJ, Dreverman J, Bruins H, van Dissel JT, Arend SM: Comparison of Mantoux and QuantiFERON TB Gold tests for diagnosis of latent tuberculosis infection in Army personnel. Clin Vaccine Immunol. 2007, 14 (4): 477-480. 10.1128/CVI.00463-06.
Wang SH, Powell DA, Nagaraja HN, Morris JD, Schlesinger LS, Turner J: Evaluation of a modified interferon-gamma release assay for the diagnosis of latent tuberculosis infection in adult and paediatric populations that enables delayed processing. Scand J Infect Dis. 2010, 42: 845-50. 10.3109/00365548.2010.498021.
Bienek DR, Chang CK: Evaluation of an interferon-gamma release assay, T-SPOT.TB, in a population with a low prevalence of tuberculosis. Int J Tuberc Lung Dis. 2009, 13: 1416-21.
Ringshausen FC, Nienhaus A, Schablon A, Schlosser S, Schultze-Werninghaus G, Rohde G: Predictors of persistently positive Mycobacterium-tuberculosis-specific interferon-gamma responses in the serial testing of health care workers. BMC Infect Dis. 2010, 10 (1): 220-10.1186/1471-2334-10-220.
Schablon A, Harling M, Diel R, Ringshausen FC, Torres CJ, Nienhaus A: Serial testing with an interferon-gamma release assay in German healthcare workers. GMS Krankenhhyg Interdiszip. 2010, 5 (2):
Torres Costa J, Silva R, Sa R, Cardoso MJ, Nienhaus A: Serial testing with the interferon-gamma release assay in Portuguese healthcare workers. Int Arch Occup Enviro Health. 2011, 84 (4): 461-469. 10.1007/s00420-010-0571-x.
Nienhaus A, Schablon A, Loddenkemper R, Hauer B, Wolf N, Diel R: Prevalence of latent tuberculosis infection in healthcare workers in geriatric care. Pneumologie. 2007, 61 (9): 613-616. 10.1055/s-2007-980104.
Schablon A, Harling M, Diel R, Nienhaus A: Risk of latent TB infection in individuals employed in the healthcare sector in Germany: a multicentre prevalence study. BMC Infect Dis. 2010, 10-107.
Zwerling A, van den Hof S, Scholten J, Cobelens F, Menzies D, Pai M: Interferon-gamma release assays for tuberculosis screening of healthcare workers: a systematic review. Thorax. 2011
Baussano I, Nunn P, Williams B, Pivetta E, Bugiani M, Scano F: Tuberculosis among health care workers. Emerg Infect Dis. 2011, 17 (3): 488-94.
Pre-publication history
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/11/245/prepub
Acknowledgements
The authors would like to thank Petra Kuhnert for her skilful and dedicated work and all trainees for their study participation. The study was fully funded by an unrestricted grant from the Institution for Statutory Accident Insurance and Prevention in the Health and Welfare Services.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
RD has received reimbursement for attending scientific conferences and/or fees for speaking from Cellestis and Oxford Immunotec. The content of this paper has not been influenced by those companies.
The authors declare that they have no competing interests.
Authors' contributions
AS participated in the design of the study, was responsible for the data management and was a key party involved in the drafting of. AN conceived the study and has been involved in revising the draft critically for important intellectual content. FCR has been involved in revising the draft critically for important intellectual content. GD and WP participated in the design of the study, made substantial contributions to the acquisition of data and were in involved in writing the draft. UA participated in the design of the study, made substantial contributions to the acquisition of data and was in involved in writing the draft. RD performed the statistical analysis and wrote the draft of the manuscript.
All authors read and approved the final manuscript.
Anja Schablon, Roland Diel contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Schablon, A., Diel, R., Diner, G. et al. Specificity of a whole blood IGRA in German nursing students. BMC Infect Dis 11, 245 (2011). https://doi.org/10.1186/1471-2334-11-245
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1471-2334-11-245