- Research article
- Open Access
Performance of seven serological assays for diagnosing tularemia
BMC Infectious Diseases volume 14, Article number: 234 (2014)
Tularemia is a rare zoonotic disease caused by the Gram-negative bacterium Francisella tularensis. Serology is frequently the preferred diagnostic approach, because the pathogen is highly infectious and difficult to cultivate. The aim of this retrospective study was to determine the diagnostic accuracy of tularemia specific tests.
The Serazym®Anti-Francisella tularensis ELISA, Serion ELISA classic Francisella tularensis IgG/IgM, an in-house ELISA, the VIRapid® Tularemia immunochromatographic test, an in-house antigen microarray, and a Western Blot (WB) assay were evaluated. The diagnosis tularemia was established using a standard micro-agglutination assay. In total, 135 sera from a series of 110 consecutive tularemia patients were tested.
The diagnostic sensitivity and diagnostic specificity of the tests were VIRapid (97.0% and 84.0%), Serion IgG (96.3% and 96.8%), Serion IgM (94.8% and 96.8%), Serazym (97.0% and 91.5%), in-house ELISA (95.6% and 76.6%), WB (93.3% and 83.0%), microarray (91.1% and 97.9%).
The diagnostic value of the commercial assays was proven, because the diagnostic accuracy was >90%. The diagnostic sensitivity of the in-house ELISA and the WB were acceptable, but the diagnostic accuracy was <90%. Interestingly, the antigen microarray test was very specific and had a very good positive predictive value.
Tularemia is a zoonotic disease caused by Francisella tularensis, a highly infectious, facultative intracellular, Gram-negative bacterium. The clinical presentation in humans depends on the route of infection and varies from relatively mild skin lesions and lymphadenopathy to life-threatening pneumonia and/or septicemia . Due to the low infectious dose and the ease of dissemination by aerosols, this bacterium was categorized as a highly dangerous biological agent by the Centers for Disease Control in Atlanta (Georgia, USA) [2–4].
The diagnostic repertoire comprises cultivation methods, PCR assays, and serological tests [5–8]. Because of the high risk of laboratory infections associated with cultivation of F. tularensis, serology is frequently preferred. Serological assays are usually easy to perform, allow high throughput, and cause little risk of infection for laboratory workers [9–12]. However, some patients never seroconvert, while others stay seropositive for years after an infection, and/or may have cross- reacting antibodies due to infections with other bacteria (e.g. Yersinia spp., Brucella spp.) [13, 14].
The aim of this study was to compare novel assays with well-established diagnostic tools using a comprehensive collection of human sera.
The present retrospective study was conducted in accordance with the STARD guidelines to assess the diagnostic accuracy and the clinical value of the respective assays [15, 16]. The study population included a consecutive series of 110 patients in an endemic area of tularemia in Serbia that had a history of potential risk of exposure and/or had clinical symptoms compatible with tularemia. In accordance with WHO guidelines, patients with typical symptoms were regarded as tularemia cases, if at least one serum sample was positive in the micro-agglutination assay (MAT) for tularemia . If the first serum sample was negative, paired serum samples were tested after two weeks or later. In total 135 sera were collected between 1999 and 2009. Patients were excluded, if documentation was not complete or if the sample volume was not sufficient to perform all diagnostic tests assessed in this study. All patients signed an informed consent and the use of the samples for this study was granted by the Ethics Committee of the Medical Faculty, Niš University (Number 01-4608-3, 9th July 2009).
In order to assess potential cross-reactivity, 94 sera of humans without known history of tularemia were tested including 20 seropositive samples from patients with culture-proven brucellosis from Lebanon. The company “Mikrogen” (Martinsried, Germany) kindly provided 74 sera collected from blood donors in Germany, which had been purchased from the Bavarian Red Cross (Munich, Germany). All control sera were anonymized in relation to patient data.
This test was performed in Serbia to establish the diagnosis and was regarded as the reference method in this study. Briefly, serial 2-fold dilutions of sera (25 μl) were mixed with an equal volume of formalin-inactivated F. tularensis subsp. holarctica (LVS) whole cell suspension (OD560 = 1.0). The reactions were performed in round-bottom microtiter-plates (96-well; NUNC, Roskilde, Denmark). The plates were read out after incubation at 37°C for 18 h. Agglutinations at dilutions of 1:20 or higher were considered MAT positive.
All commercial assays were performed and interpreted according to the manufacturer’s instructions:
The Serazym® Anti-Francisella tularensis ELISA (Serazym ELISA) (Seramun Diagnostica GmbH, Heidesee OT Wolzig, Germany) detects all classes of antibodies. The Serion ELISA classic Francisella tularensis IgG/IgM (IgG Serion ELISA/IgM Serion ELISA) (Institut Virion/Serion GmbH, Würzburg, Germany) allows separate detection of IgG and IgM. The VIRapid® (VIRapid) (Vircell S.L., Santa Fé, Spain) is an immunochromatographic lateral flow test (ICT) (Figure 1).
The Yersinia recomline kit (Yersinia IgG 2.0 kit, Mikrogen) was used to determine, which sera had anti-Yersinia antibodies that could potentially cause cross-reactions.
In-house developed assays
The in-house ELISA was designed to detect anti-Francisella IgG antibodies. The assay published by Porsch-Ozcürümez et al.  was performed with some modifications. Briefly, the coating antigen was a purified lipopolysaccharide (LPS) obtained from F. tularensis subsp. holarctica (ATCC 29684) (Micromun, Greifswald, Germany). The secondary antibody was a horseradish peroxidase-conjugated goat anti-human IgG (Millipore, Schwalbach, Germany). Receiver operating characteristic (ROC) curves were used to determine the cut-off value (MedCalc Software Version 13.0.4, Oostend, Belgium).
The Western Blot assay (WB) was developed as a modification of the test published by Schmitt et al. . The F. tularensis LPS was purchased from Micromun. The secondary antibody was a purified recombinant protein A/G, which was alkaline phosphatase labeled (Pierce Biotechnology, Rockford, Illinois, USA) diluted 1:5,000.
The microarray detecting anti-Francisella antibodies used two different preparations of antigen: Whole-cell bacterial antigen of Francisella tularensis subsp. holarctica strain LVS and commercially available purified LPS were compared. Whole-cell bacterial antigen was obtained after growth for 48 h on Cysteine Heart Agar enriched with chocolatized red blood cells at 37°C in ambient atmosphere. Bacterial pellets were harvested and diluted in phosphate-buffered saline containing 5–20 mM sucrose to final antigen concentrations between 0.5 and 1 mg protein/ml. Subsequently, the antigen preparations were spotted onto microarray chips as previously described  and assembled in the ArrayStrip 8-well microtiter strip format (Alere Technologies GmbH, Jena, Germany). To evaluate the impact of the secondary antibody (Protein A/G-HRP, Thermo Fisher Scientific GmbH, Schwerte, Germany) on the background, it was added to the tularemia antigens without the patient sera. Results from this analysis showed no direct reactivity due to the secondary antibody.
Antigen-antibody reaction in array strip vessels
Examination of sera was conducted using the Protein Binding Kit (Alere Technologies GmbH) with the following modifications: The incubation buffer P1 was supplemented with 1% (w/v) milk powder (Marvel; Premier International Foods UK Ltd, Dublin, Ireland), and blocking buffer consisted of P1 containing 3% (w/v) milk powder. All incubation and washing steps were performed at 37°C using a heated horizontal tube shaker (BioShake iQ; Quantifoil Instruments GmbH, Jena, Germany). The ArrayStrips were initially conditioned with 100 μl of incubation buffer at 400 strokes per minute (spm) for 5 min. The supernatant was discarded and the microarrays were blocked by incubation with 100 μl blocking buffer at 300 spm for 5 min. Prior to incubation, serum samples were diluted 1:100 in incubation buffer in a separate tube. After transfer of 100 μl of diluted serum into the array vessel, the antigen-antibody reaction was allowed to proceed at 300 spm for 30 min. The supernatant was discarded, and the arrays were washed using 150 μl incubation buffer at 400 rpm for 5 min. The supernatant was again discarded and the arrays were incubated with 100 μl of a 1:10,000 dilution of HRP-conjugated Protein A/G (Thermo Fisher Scientific GmbH) in incubation buffer at 300 spm for 30 min. Subsequently, the ArrayStrips were washed in two steps as above. Finally, 100 μl of the ready-to-use HRP substrate D1 (part of the Protein Binding Kit, Alere Technologies GmbH) were added for staining (25°C, 10 min, no shaking). Before the final reading, the staining solution was completely removed. The outcome of the antigen-antibody reaction was measured using an ArrayMate transmission reader (Alere Technologies GmbH). Signal intensity data were processed using the Iconoclust software, version 3.3 (Alere Technologies GmbH). Pilot tests with positive and negative control sera were used to empirically determine a cut-off value of 0.3 intensity units (data not shown).
The diagnostic value was determined based on the following parameters: Diagnostic sensitivity = [TP/(TP + FN)] × 100; Diagnostic specificity = [TN/(TN + FP)] × 100; Positive Predictive Value (PPV) = [TP/(TP + FP)] × 100; Negative Predictive Value (NPV) = [TN/(TN + FN)] × 100; Diagnostic accuracy = (TP + TN)/(TP + TN + FP + FN) × 100. (TP = true positive, TN = true negative, FN = false negative, FP = false positive).
The parameters used to assess the diagnostic accuracy for all serological assays are presented in Table 1. The diagnostic sensitivity and diagnostic specificity of the tests were: VIRapid (97.0% and 84.0%), Serion IgG (96.3% and 96.8%), Serion IgM (94.8% and 96.8%), Serazym (97.0% and 91.5%), in-house ELISA (cut-off = 0.18; 95.6% and 76.6%), WB (93.3% and 83.0%), microarray (91.1% and 97.9%). The cut-off for the in-house ELISA was set to 0.18 based on a ROC analysis in order to achieve a relatively high diagnostic sensitivity (Figure 2, Additional file 1).
The microarray test with spotted whole antigen of F. tularensis was used for the final evaluation, because pilot experiments showed that spotted LPS lead to many false negative results. The results of the Yersinia recomline kit showed that 48% of the sera of tularemia cases (65/135) and 39% of non-tularemia sera (37/94) had antibodies against Yersinia spp., but their relevance regarding cross-reactions could not be determined. In the microarray no cross-reactions with anti-Brucella antibodies in 20 serologically positive sera of culture-proven brucellosis patients were observed in the microarray. Cross-reactions with anti-Brucella antibodies were observed in the following assays: VIRapid , Serion IgG , Serion IgM , Serazym , in-house ELISA , WB .
Tularemia is a zoonotic disease that has broken out naturally in many countries in recent years. The disease requires special attention because F. tularensis can be used as a bioterrorist agent [3, 4, 18]. Infections may remain undiagnosed, because the symptoms of tularemia are frequently non-specific [17, 18]. This has serious consequences, because F. tularensis is resistant to cephalosporins and delayed adequate antibiotic therapy can lead to complications or even death [19–21]. In the past, several serological assays have been established and evaluated . However, laboratories still face a capacity gap regarding reliable bedside tests and simple tools to assess cross-reactions. Although tularemia is endemic in many European countries, cases occur only sporadically . Therefore, laboratories are requested to perform diagnostic tests for tularemia only rarely, which may make it less attractive to set up and validate ELISAs and WB assays. For field-use, a non-commercial in-house ICT was developed to support a presumptive diagnosis of tularemia . However, routine laboratories and other first responders need ready-to-use commercial products that are certified for in vitro diagnostic use.
In this study, seven different serological assays for tularemia were evaluated including a commercially available ICT, and an antigen microarray. The assays were tested with a comprehensive number of sera obtained from tularemia cases and a collection of potentially cross-reacting sera with anti-Brucella and anti-Yersinia antibodies. The commercial ELISA assays showed excellent performance regarding diagnostic specificity and diagnostic sensitivity and proved their diagnostic value.
Schmitt et al.  showed that the combination of an in-house ELISA and a WB assay was suitable for screening and found no cross-reactions with antibodies against Brucella spp., E. coli, Salmonella spp., or Yersinia enterocolitica. Although the in-house ELISA in our study had an acceptable diagnostic sensitivity of 95.6% (cut-off = 0.18), the diagnostic accuracy of this ELISA and also of the WB assays established in this study were not as expected, because the correspondence with the reference test was <90%. This might be explained by the use of different staining protocols to detect the antigen-antibody reaction. In other studies, anti-human anti-IgG antibodies were used as secondary antibodies, whereas we used alkaline phosphatase-labeled protein A/G for the WB assay and protein G labeled with HRP for the in-house ELISA. This combination was chosen, because it allows the use of the assays for samples of various mammal species, which is important for screening the animal reservoir and indicator animals [6, 10, 11]. Interestingly, a recently published competitive ELISA using biotin-labelled anti-LPs Mabs, streptavidin-peroxidase and tetramethylbenzidine as enzyme substrate allowed screening of humans (and animals, i.e. rabbits and mice) with a diagnostic sensitivity and diagnostic specificity of 93.9 and 96.1%, respectively .
The VIRapid assay has a very good diagnostic sensitivity (97.0%) and is a useful hand-held test kit for field or bedside use, when only small numbers of samples need to be tested. This is in line with the good results obtained in a study in Turkey that included 236 sera of 109 tularemia cases where the test showed a diagnostic sensitivity of 99.3% and a diagnostic specificity of 94.6%. A study in Spain with 321 patients also found a diagnostic sensitivity of 95.5% and a diagnostic specificity of 100% . In Turkey, 4 out of 50 (8%) sera of brucellosis patients cross-reacted, while in the present study, this was observed in 7 out of 20 serologically and culture-proven Brucella positive samples .
The microarray showed a good diagnostic specificity (97.9%) and may be a promising tool for simultaneous detection of antibodies to different antigens and for assessing cross-reactions. Therefore, studies are ongoing to combine Francisella antigens with those of other zoonotic pathogens on a microarray. Anti-Yersinia antibodies can be expected in approximately one third of the population and cross-reactions with tularemia might play a role . However, our data do not allow reliable conclusions.
A limitation of this study is the relatively low number of non-tularemia sera (n = 94). Therefore, the value of these tests could not be assessed for use in large-scale seroprevalence studies.
In our hands, the commercial ELISA assays have proven to be the method of choice for testing large numbers of samples. The VIRapid is of practical use as a bedside diagnostic assay to corroborate a clinical diagnosis, but it is neither designed nor useful for high throughput screening. The microarray is a promising tool for assessing cross-reactions and studies are ongoing to combine these targets with other zoonotic pathogens.
Ellis J, Oyston PC, Green M, Titball RW: Tularemia. Clin Microbiol Rev. 2002, 15 (4): 631-646. 10.1128/CMR.15.4.631-646.2002.
Sjostedt A: Tularemia: history, epidemiology, pathogen physiology, and clinical manifestations. Ann N Y Acad Sci. 2007, 1105: 1-29. 10.1196/annals.1409.009.
Rotz LD, Khan AS, Lillibridge SR, Ostroff SM, Hughes JM: Public health assessment of potential biological terrorism agents. Emerg Infect Dis. 2002, 8 (2): 225-230. 10.3201/eid0802.010164.
Dennis DT, Inglesby TV, Henderson DA, Bartlett JG, Ascher MS, Eitzen E, Fine AD, Friedlander AM, Hauer J, Layton M, Lillibridge SR, McDade JE, Osterholm MT, O’Toole T, Parker G, Perl TM, Russell PK, Tonat K, Working Group on Civilian Biodefense: Tularemia as a biological weapon: medical and public health management. JAMA. 2001, 285 (21): 2763-2773. 10.1001/jama.285.21.2763.
Splettstoesser W, Guglielmo-Viret V, Seibold E, Thullier P: Evaluation of an immunochromatographic test for rapid and reliable serodiagnosis of human tularemia and detection of Francisella tularensis-specific antibodies in sera from different mammalian species. J Clin Microbiol. 2010, 48 (5): 1629-1634. 10.1128/JCM.01475-09.
Splettstoesser WD, Tomaso H, Al Dahouk S, Neubauer H, Schuff-Werner P: Diagnostic procedures in tularaemia with special focus on molecular and immunological techniques. J Vet Med B Infect Dis Vet Public Health. 2005, 52 (6): 249-261. 10.1111/j.1439-0450.2005.00863.x.
Grunow R, Splettstoesser W, McDonald S, Otterbein C, O’Brien T, Morgan C, Aldrich J, Hofer E, Finke EJ, Meyer H: Detection of Francisella tularensis in biological specimens using a capture enzyme-linked immunosorbent assay, an immunochromatographic handheld assay, and a PCR. Clin Diagn Lab Immunol. 2000, 7 (1): 86-90.
Johansson A, Berglund L, Eriksson U, Goransson I, Wollin R, Forsman M, Tarnvik A, Sjostedt A: Comparative analysis of PCR versus culture for diagnosis of ulceroglandular tularemia. J Clin Microbiol. 2000, 38 (1): 22-26.
WHO: World health organization guidelines on Tularaemia. Epidemic and Pandemic Alert and Response. 2007, Geneva: World Health Organization
Schmitt P, Splettstoesser W, Porsch-Ozcürümez M, Finke EJ, Grunow R: A novel screening ELISA and a confirmatory Western blot useful for diagnosis and epidemiological studies of tularemia. Epidemiol Infect. 2005, 133 (4): 759-766. 10.1017/S0950268805003742.
Porsch-Ozcürümez M, Kischel N, Priebe H, Splettstoesser W, Finke EJ, Grunow R: Comparison of enzyme-linked immunosorbent assay, Western blotting, microagglutination, indirect immunofluorescence assay, and flow cytometry for serological diagnosis of tularemia. Clin Diagn Lab Immunol. 2004, 11 (6): 1008-1015.
Rusnak JM, Kortepeter MG, Hawley RJ, Anderson AO, Boudreau E, Eitzen E: Risk of occupationally acquired illnesses from biological threat agents in unvaccinated laboratory workers. Biosecur Bioterror. 2004, 2 (4): 281-293. 10.1089/bsp.2004.2.281.
Ericsson M, Sandstrom G, Sjostedt A, Tarnvik A: Persistence of cell-mediated immunity and decline of humoral immunity to the intracellular bacterium Francisella tularensis 25 years after natural infection. J Infect Dis. 1994, 170 (1): 110-114. 10.1093/infdis/170.1.110.
Bockemühl J, Roth J: Brucella titers in subclinical infections due to Yersinia enterocolitica serotype O:9 in a pig-breeding farm (author’s transl). Zentralbl Bakteriol Orig A. 1978, 240 (1): 86-93.
Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Moher D, Rennie D, de Vet HC, Lijmer JG: Standards for reporting of diagnostic accuracy group: the STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration: the standards for reporting of diagnostic accuracy group. Croat Med J. 2003, 44 (5): 639-50.
Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC: Standards for reporting of diagnostic accuracy group: towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative: the standards for reporting of diagnostic accuracy group. Croat Med J. 2003, 44 (5): 635-8.
Anjum MF, Tucker JD, Sprigings KA, Woodward MJ, Ehricht R: Use of miniaturized protein arrays for Escherichia coli O serotyping. Clin Vaccine Immunol. 2006, 13 (5): 561-567. 10.1128/CVI.13.5.561-567.2006.
Tärnvik A, Priebe HS, Grunow R: Tularaemia in Europe: an epidemiological overview. Scand J Infect Dis. 2004, 36 (5): 350-5. 10.1080/00365540410020442.
Eliasson H, Back E: Tularaemia in an emergent area in Sweden: an analysis of 234 cases in five years. Scand J Infect Dis. 2007, 39 (10): 880-889. 10.1080/00365540701402970.
Evans ME, Gregory DW, Schaffner W, McGee ZA: Tularemia: a 30-year experience with 88 cases. Medicine (Baltimore). 1985, 64 (4): 251-269.
Meric M, Willke A, Finke EJ, Grunow R, Sayan M, Erdogan S, Gedikoglu S: Evaluation of clinical, laboratory, and therapeutic features of 145 tularemia cases: the role of quinolones in oropharyngeal tularemia. APMIS. 2008, 116 (1): 66-73. 10.1111/j.1600-0463.2008.00901.x.
Sharma N, Hotta A, Yamamoto Y, Fujita O, Uda A, Morikawa S, Yamada A, Tanabayashi K: Detection of Francisella tularensis-specific antibodies in patients with tularemia by a novel competitive enzyme-linked immunosorbent assay. Clin Vaccine Immunol. 2013, 20 (1): 9-16. 10.1128/CVI.00516-12.
Cubero Ribas A, Menegotto F, González Cabrero S, Gutiérrez P, Bratos Pérez MA, Delgado JM, Orduña A: Evaluación de un nuevo test inmunocromatográfico (Virapid®Tularemia) para el diagnóstico serológico de tularemia humana. 2011, Malaga, Spain.
Kiliç S, Celebi B, Yeşilyurt M: Evaluation of a commercial immunochromatographic assay for the serologic diagnosis of tularemia. Diagn Microbiol Infect Dis. 2012, 74 (1): 1-5. 10.1016/j.diagmicrobio.2012.05.030.
Tomaso H, Mooseder G, Dahouk SA, Bartling C, Scholz HC, Strauss R, Treu TM, Neubauer H: Seroprevalence of anti-Yersinia antibodies in healthy Austrians. Eur J Epidemiol. 2006, 21 (1): 77-81. 10.1007/s10654-005-5047-z.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/14/234/prepub
We are grateful to Renate Danner, Karola Zmuda, Elke Mueller, Anika Ruppert, Sabine Scharf, and Susann Bahrmann for their excellent technical assistance. Vircell kindly provided test strips. The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 222633 and grant agreement n° 261810.
The VIRapid Tularemia assay was kindly provided by Vircell (Vircell S.L., Santa Fé, Spain).
VC supervised the ELISA, WB and hand-held ICT and drafted the manuscript. MD investigated and treated the patients in Serbia. AR conducted all experiments using the protein microarray, processed the numerical data and participated in the design of the serology microarray. PO supervised ELISAs and WB and drafted the manuscript. DK and WM established the in-house ELISA and the WB. KS conceived the design of the serology microarray, participated in data processing and wrote part of the manuscript. GA diagnosed the brucellosis cases in Lebanon and revised the manuscript. RD performed the ROC analysis and drafted parts of the manuscript. HT designed the study, coordinated the experiments, and finalized the manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1: Receiver operating characteristic (ROC) curves data used to determine the cut-off value for the in-house ELISA (MedCalc Software Version 13.0.4, Oostend, Belgium).(PDF 400 KB)
About this article
Cite this article
Chaignat, V., Djordjevic-Spasic, M., Ruettger, A. et al. Performance of seven serological assays for diagnosing tularemia. BMC Infect Dis 14, 234 (2014). https://doi.org/10.1186/1471-2334-14-234
- Diagnostic sensitivity
- Diagnostic specificity