Skip to main content
Download PDF

Clinical evaluation of commercial nucleic acid amplification tests in patients with suspected sepsis

BMC Infectious Diseases volume 15, Article number: 199 (2015) Cite this article

Abstract

Background

Sepsis is a serious medical condition requiring timely administered, appropriate antibiotic therapy. Blood culture is regarded as the gold standard for aetiological diagnosis of sepsis, but it suffers from low sensitivity and long turnaround time. Thus, nucleic acid amplification tests (NAATs) have emerged to shorten the time to identification of causative microbes. The aim of the present study was to evaluate the clinical utility in everyday practice in the emergency department of two commercial NAATs in patients suspected with sepsis.

Methods

During a six-week period, blood samples were collected consecutively from all adult patients admitted to the general emergency department for suspicion of a community-onset sepsis and treated with intravenous antibiotics. Along with conventional blood cultures, multiplex PCR (Magicplex™) was performed on whole blood specimens whereas portions from blood culture bottles were used for analysis by microarray-based assay (Prove-it™). The aetiological significance of identified organisms was determined by two infectious disease physicians based on clinical presentation and expected pathogenicity.

Results

Among 382 episodes of suspected sepsis, clinically relevant microbes were detected by blood culture in 42 episodes (11%), by multiplex PCR in 37 episodes (9.7%), and by microarray in 32 episodes (8.4%). Although moderate agreement with blood culture (kappa 0.50), the multiplex PCR added diagnostic value by timely detection of 15 clinically relevant findings in blood culture-negative specimens. Results of the microarray corresponded very well to those of blood culture (kappa 0.90), but were available just marginally prior to blood culture results.

Conclusions

The use of NAATs on whole blood specimens in adjunct to current culture-based methods provides a clinical add-on value by allowing for detection of organisms missed by blood culture. However, the aetiological significance of findings detected by NAATs should be interpreted with caution as the high analytical sensitivity may add findings that do not necessarily corroborate with the clinical diagnosis.

Peer Review reports

Background

Sepsis is a major cause of morbidity and mortality in all high income as well as middle and low income countries [1-5]. About 20 million cases of sepsis are estimated to occur each year around the world accounting for up to 135,000 deaths in Europe and 215,000 in the United States [1,4]. Recent studies from different countries show that the incidence of sepsis as well as the number of sepsis-related deaths is continuously increasing [3,6-11].

At present, blood culture is considered the gold standard for aetiological diagnosis in sepsis. Although blood culture is associated with high specificity in species identification, it is limited by a substantial time delay and low sensitivity, especially for slow-growing and fastidious organisms [12,13]. In an effort to address some of the limitations with blood culture, nucleic acid amplification tests (NAATs) have been developed to improve the sensitivity and decrease the time to identification of microorganisms causing bacteraemia. Several commercial multiplex assays, based on different techniques such as conventional polymerase chain reaction (PCR) (VYOO®, Analytik Gena, Germany), real-time PCR (Magicplex™ Sepsis Real-time Test, Seegene, Korea; LightCycler® SeptiFast, Roche, Switzerland; Sepsitest™, Molzym, Germany) and microarray (Prove-it™ Sepsis, Mobidiag, Finland) are now on the market. These assays have been tested in several studies [14-24] but rarely is there a clinical validation of the results.

The aim of this population-based study was therefore to evaluate the clinical utility of two commercial NAATs, Magicplex™ Sepsis Real-time Test and Prove-it™ Sepsis, in patients with suspected sepsis. Magicplex™ Sepsis Real-time Test is a PCR-based test screening for 73 species of Gram positive bacteria, twelve species of Gram negative, and six species of fungi and three resistance genes (mecA, vanA, and vanB) directly in whole blood samples. The microarray-based assay called Prove-it™ Sepsis combines genome amplification by conventional PCR and microarray technology for simultaneous identification of over 60 bacterial pathogens, and 13 fungal pathogens, and three resistance genes (mecA, vanA, and vanB) in positive blood cultures.

Methods

Patients and specimens

From September 2011 to June 2012, a prospective observational study of the incidence of community-onset severe sepsis and septic shock in adults was conducted at Skaraborg Hospital, in the western region of Sweden. During a limited period of the prospective study, from February to April 2012, NAATs were performed as part of routine patient care in addition to blood culture in all patients >18 years admitted to the emergency department for suspicion of community-onset sepsis. All patients received oral and written information about the study. In patients suspected to have sepsis or severe sepsis, it is mandatory to rapidly make appropriate sampling for microbiological diagnosis before antibiotic treatment is instituted. This microbiological testing, using appropriate and approved tests, needed no patient consent according to the Swedish Law. The diagnostic tests were made upon arrival to the emergency department and no additional sampling was made. Some patients were too sick and/or died within 24 hours and could never give an informed consent. Those patients who could not give an informed consent, were evaluated anonymously, only for diagnosis and results of commercially available tests used for diagnostic purposes of the suspected sepsis. The Regional Ethics Committee in Gothenburg (no. 376–11) approved the study and the consent process.

Blood culture

In this study, an episode was defined as each separate case of clinically suspected community-onset sepsis treated with intravenous antibiotics. Only one episode per patient and admission were included in the final data analysis to avoid bias. For each episode, two sets of blood cultures from two different puncture sites were collected before administration of the first dose of intravenous antibiotics. However, for a few episodes, due to feasibility, only one set of blood culture was collected. Blood cultures were conducted in BacT/ALERT® FN (bioMérieux, France). Typing and definite species identification with MALDI-TOF MS was performed on a Microflex LT mass spectrometer (Bruker Daltonics, United States) with BioTyper software v2.0 using default parameter settings. Spectral scores above 2.0 were used as cut-off for correct identification. Antibiotic susceptibility was determined by accredited laboratory methods according to EUCAST guidelines (www.eucast.org).

Multiplex PCR assay

The test procedure for Magicplex™ was performed on 1 mL fresh whole blood (EDTA) collected before administration of antibiotics and not older than 24 hours. DNA extraction from whole blood was performed using the SelectNA Blood Pathogen Kit (Molzym, Germany). The first steps of the extraction, lysis of human cells and digestion of human DNA, were manually performed according to the manufacturer’s instructions. Pure bacterial/fungal DNA was then extracted automatically from the prelysed samples on the instrument Nordiag Arrow/Liaison IXT (DiaSorin, Italy). The first PCR, producing amplicon banks, was performed using the kit Magicplex Sepsis Amplification on a GeneAmp PCR System 9700 (Applied Biosystems, United States). Real-time PCR was then performed with the Magicplex Screening Real-time Detection Kit on a CFX96 (Bio-Rad, United States). The screening revealed the presence of Gram positive or Gram negative bacteria, drug resistance genes or fungi. Species identification was performed with the Magicplex ID 1-ID 9 Real-time Detection Kit on samples that became positive in the screening step. All PCR-reactions were set up in a UV-box according to the recommendations from the manufacturer. The dedicated software Seegene viewer was used to interpret the analysis data, where the result from every sample is presented in a table as Detected or Not detected. A whole process control was included in the assay. If this was valid, the assay result could be interpreted.

Microarray-based assay

Prove-it™ was performed on aliquots derived from blood culture bottles removed from the automated blood culture system. After removal, the bottles were stored in 4°C between 1–2 days until DNA extraction was performed. For each episode, aliquots were taken from that pair of blood culture bottles, one aerobic and one anaerobic bottle, derived from the first puncture site. A volume of 200 μL was withdrawn from each bottle. Regardless if the blood culture bottles were found positive or negative, sample volumes from each pair of bottles was pooled together prior to DNA extraction. DNA was extracted using 400 μL of sample volume and eluted in a final volume of 200 μL using a MagNA Pure Nucleic Acid Isolation Kit I on a MagNAPure Compact System (Roche Applied Science, Switzerland). The procedure for the microarray assay was performed according to protocols provided by the manufacturer. Briefly, both a bacterial and a fungal PCR master mix were prepared. The PCR reactions were set up in a laminar airflow bench where no amplified PCR products were handled. After PCR amplification, the bacterial PCR product and the fungal PCR product derived from the same episode were added to the same well of the microarray. Subsequently, hybridization and staining procedures were performed. For detection and analysis of the samples, the dedicated software Prove-it™ Advisor was used. Based on the outcomes of several built-in controls, the software evaluated whether the performance of the assay is acceptable. All analysis parameters were adjusted automatically without any manual involvement.

Data interpretation and statistical analysis

All records of the patients and microbial findings were assessed by two senior physicians in infectious diseases (LL and GJ). The clinical judgment was based on the patient history with special reference to sudden onset of fever, rigors, gastrointestinal symptoms, tachypnea, mental confusion, pain out of proportion, and muscle weakness. Physical examination was done with attention to blood pressure <90 mm Hg, respiratory rate >20/min, and oxygen saturation <90%. Standard biomarkers included serum lactate, leucocyte cell count, neutrophil-lymphocyte count ratio, and C-reactive protein. Judgment was also based on imaging and microbiological testing of suspected infectious foci including culture, PCR, and antigen test, apart from the NAAT assays described in detail above.

It remains challenging to determine the aetiological significance of organisms detected in blood. This applies especially to NAATs, but also to conventional blood culture although to a lesser degree. In this study, decisions of aetiological significance of detected organisms were made based on expected pathogenicity (Table 1) and clinical presentation as previously described [25,26]. Detected organisms were interpreted as clinically relevant, of unknown significance or contaminant according to the algorithm described in Figure 1. Organisms detected only by a NAAT were also regarded as clinically relevant, but with more stringent criteria than positive blood culture results. Microorganisms of unknown aetiological significance are findings considered not consistent with the clinical diagnosis having no implications for the medical management of the patients. However, links between the microorganism and the medical condition of the patient cannot be excluded.

Table 1 Schematic distribution of microorganisms according to expected pathogenic potential
Full size table
Figure 1
figure 1

Algorithm for deciding on clinical relevance of microbial findings in blood by blood culture [25] or NAAT. Other cultures were made from clinically relevant sites before administration of intravenous antibiotics. On suspicion of pneumonia or sepsis with unknown focus, a pulmonary X-ray was performed. Ultrasound, computed tomography scan, and magnetic resonance imaging were used when deemed necessary for diagnosing the site of infection. BC blood culture; NAAT nucleic acid amplification test.

Full size image

McNemar’s test was conducted for comparing proportions in paired samples, whereas z test was performed for comparing proportions in independent samples. A two-sided p value of <0.05 was considered statistically significant. Concordances between blood culture and NAATs were tested with kappa statistics for inter-rater agreement; cut-off values for the kappa value have been described elsewhere; 0.41-0.60 are considered of moderate agreement, and those of 0.81-1.00 of very good agreement [27]. Statistical analyses were performed using Matlab v. 7.10 (The Mathworks, Inc., United States).

Results

A total of 375 patients entered this study. Eight patients were admitted twice during the study period, resulting in a total of 383 episodes analysed with blood culture and both NAATs. For the multiplex PCR, the whole process control was invalid or partially invalid in 45 (12%) of the 383 blood samples initially tested. These samples were retested on a ten-fold dilution of the extracted DNA. After the re-run, one sample did still not give a final result and was excluded from further analysis, making a total of 382 episodes.

At least one microorganism was detected in 138 episodes by either method. Microorganisms defined as commensals (Table 1) were considered to be contaminants and excluded from analysis if only found on a single occasion regardless of detection method. In total, 89 clinically relevant findings or findings of unknown significance were identified in 77 episodes (20%). A detailed description including clinical comments for these findings can be found in Additional file 1. In eight episodes, a clinically relevant finding was detected by blood culture in a bottle not included in that pair of bottles from which aliquots for the microarray analysis was derived. Thus, these eight episodes were excluded from the analysis of the microarray results.

For blood culture, the result of species identification was usually available 6–7 hours after a bottle has flagged positive (Figure 2). The turnaround time for the multiplex PCR assay was estimated to around seven hours. For the microarray, the turnaround time from positive blood culture bottle to species identification was approximately four hours. The diagnostic performance for blood culture and the NAATs are shown in Table 2.

Figure 2
figure 2

Workflows and turnaround times for the detection methods used in the present study.

Full size image
Table 2 Diagnostic performance of blood culture, multiplex PCR, and microarray a
Full size table

Multiplex PCR assay

The rate of episode positivity for multiplex PCR was 14% (53/382), whereas the rate of episode positivity for blood culture was 11% (42/382, p = 0.61). Cohen’s kappa coefficient for agreement between the results of multiplex PCR and blood culture was 0.52 (95% CI 0.37-0.66).

In total, 37 clinically relevant findings in 37 episodes and 23 findings of unknown significance in 21 episodes were detected by multiplex PCR. For blood culture, 44 findings in 42 episodes were clinically relevant and one finding of unknown significance. The multiplex PCR and blood culture results agreed for 22 clinically relevant findings (Figure 3A). Multiplex PCR missed 22 clinically relevant findings in 20 episodes and one finding of unknown significance. On the other hand, 38 findings identified by multiplex PCR in 35 episodes were not detected by blood culture. Fifteen of these 38 findings were considered as clinically relevant; five of these 15 findings were considered as proven aetiology of the infections since the same bacteria were found by culture from the site of infection (Table 3). The remaining ten findings made by multiplex PCR were negative in blood culture and other diagnostic tests, but consistent with the clinical diagnosis and therefore regarded as clinically relevant (Table 3). Twenty-three of the 38 findings detected by multiplex PCR but not by blood culture were regarded to be of unknown significance. Ten were findings of Gram positive bacteria, eleven were findings of Gram negative bacteria and two were findings of Candida species (Table 4).

Figure 3
figure 3

Microbial concordances between blood culture and NAATs. A Number of microbes detected by blood culture and/or multiplex PCR. B Number of microbes detected by blood culture and/or microarray. BC blood culture; CRF clinically relevant finding; CNRF clinically not relevant finding; OUS finding of unknown significance.

Full size image
Table 3 Clinically relevant microbial findings made by multiplex PCR but not by blood culture
Full size table
Table 4 Microbial findings of unknown significance made by multiplex PCR but not by blood culture
Full size table

Microarray-based assay

The rate of episode positivity for the microarray assay was 8.4% (32/382) and for blood culture 8.9% (34/382, p = 0.37). Cohen kappa statistic for agreement between the results of microarray and blood culture was 0.92 (95% CI 0.84-0.99).

In total, 32 clinically relevant findings in 31 episodes and five findings of unknown significance in five episodes were detected by microarray. The results between microarray and blood culture showed concordance for 30 clinically relevant findings (Figure 3B). The microarray failed to detect four clinically relevant findings detected by blood culture. However, two of these findings belonged to species not covered by the microarray panel (Streptococcus anginosus and Streptococcus group G). The microarray identified one clinically relevant finding and five findings of unknown significance not detected by either blood culture or multiplex PCR (Table 5).

Table 5 Microbial findings made by microarray but not by blood culture
Full size table

Discussion

The focus of this study is on the clinical utility of two commercial NAATs in the aetiological diagnosis of patients with suspected sepsis. We found that the multiplex PCR assay added diagnostic value by timely detection of clinically relevant microbes missed by blood culture. The results of the microarray-based assay corresponded well to those of blood culture, but its clinical utility is reduced by the prerequisite of time-consuming cultivation.

Currently, blood culture is considered the gold standard for aetiological diagnosis of sepsis although it suffers from having a low sensitivity. It can only detect viable microorganisms, and the medium is not optimized for culturing fungi and fastidious bacteria. Thus, blood culture can be considered to be a poor gold standard, which implies difficulties in evaluating novel sepsis tests since no other laboratory reference standard for sepsis diagnosis exists. For that reason, different reference standards have been used in studies assessing sepsis tests. Some have used blood culture results alone as gold standard [20,28], whereas others have considered all pathogenic findings detected by any method [16,29]. We assessed the performances of blood culture and the two NAATs by classifying all findings judged as clinically relevant as “true positives”. The diagnostic sensitivity for multiplex PCR (64%, Table 2) was comparable with the rate in a similar study by Carrara et al. (65%, p = 0.91) [16], as well as the specificity (96% vs. 92%, p = 0.05) [16]. However, Loonen et al. have reported significantly lower sensitivity (37%, p < 0.001) and specificity (77%, p = 0.0001) for Magicplex™ [19]. For the microarray assay, we observed a significantly lower diagnostic sensitivity (62% vs. 96%, p < 0.0001, Table 2) whereas the specificity was equal (99% vs. 99%, p = 1.0) compared with a previous study [20]. The use of different gold standards and study populations may explain observed differences in the performance characteristics [16,19,20,30].

Although the multiplex PCR assay could not detect all clinically relevant microbes, it offered added diagnostic value by the detection of several important pathogens not detected by the conventional culture-based method (Table 3). Consequently, the concordance between the results of blood culture and multiplex PCR assay is moderate (kappa 0.50) (Table 2), whereas the microarray results showed a high degree of agreement with the results of blood culture (kappa 0.90) (Table 2). These results could be expected since the microarray assay is performed on aliquots derived from blood culture bottles, whereas the multiplex PCR is performed on microbial DNA extracted from a different whole blood sample than the cultured portion.

A remarkable finding is that multiplex PCR of only 1 mL whole blood reached a sensitivity of 64% compared to 72% for culture using 32–40 mL blood, despite more stringent criteria for clinical relevance in the PCR case. However, both methods failed to detect a number of sepsis cases. From a strictly quantitative aspect, the detection level for microorganisms in blood samples at a given time, the diagnostic sensitivity, is depending on the concentration of microorganisms and the volume sampled. The extent of variation in the yield of bacteria in time is not known. In bacteraemia, an average concentration of 0.25 CFU/mL blood was reported by Arpi et al. [31]. Jonsson et al. [32] theoretically calculated the probability of detecting bacteria as a function of the concentration in blood and found empirically by blood culture that 29% of all cases with Escherichia coli and 18% of S. aureus bacteraemia had a most probable concentration of only 0.036 CFU/mL. The gain in yield of microorganisms by increasing the volume of cultured blood in more modern automated culture systems was emphasized by Cockerhill et al. [33] and Lee et al. [34]. To obtain a >99% sensitivity with these systems, four blood cultures, each involving 20 mL is needed [34]. The gain is probably due to the detection of the most minute concentrations, either by enhanced culture systems or overcoming the effects of early antibiotic therapy by resins.

NAATs introduced to diagnose sepsis by sampling blood may add new information implying higher analytical sensitivity. By definition, the analytical sensitivity of an assay refers to the smallest value of the analyte that can be resolved with a given degree of confidence and is not synonymous with the diagnostic sensitivity. A single bacterial cell is obviously the smallest theoretical unit that can be applied for blood culture or culture in a wider sense. With NAATs, a single bacterial cell, dead or alive, may contain multiples of a certain target sequence, e.g., in bacteria the conserved 16S rRNA gene sequence is often used as PCR template due to its high copy number in each cell. The downside of using detection methods with high analytical sensitivity, such as PCR, is the increased number of findings of unknown significance as well as contaminants. We then have to cope with unexpected microbial findings that do not necessarily corroborate with the clinical picture, as translocation of bacteria and fungi over the mucosal gut barrier in patients with malignancies or on parenteral nutrition is an increasing diagnostic dilemma. Thus, we are urged to tighten the communication between the laboratory and the clinicians to organise, assemble and critically review the unexpected findings.

There is also a qualitative aspect. Certain species seem to correlate better with genuine sepsis than others, i.e., Enterobacteriaceae spp. and pneumococci [35]. The detection of identical microorganisms from multiple sampling sites or occasions is another genuine marker for true bacteraemia. This further implies that a single finding of a microbe with one detection system, e.g., culture, may move the interpretation from probable to proven if the same finding is done with e.g., PCR. However, true bacteraemia also occurs in patients void of an inflammatory response. This shall not be regarded as a benign finding until the following factors are ruled out. First, translocation of bacteria from the gut to the bloodstream may occur in patients with malfunctioning mucosal barriers. Well known examples are E. cloacae (occult malignancy) [35], Streptococcus group G, i.e., Streptococcus dysgalactiae subsp. equisimilis (haematological malignancy and solid tumours) [36], and the former Streptococcus bovis group, i.e., S. gallolyticus subsp. gallolyticus and subsp. pasteurianus (colonic cancer), and S. infantarius (cancer of the bile tree or pancreas) [37]. Experimental work on animals showed an increased risk for bacterial translocation for subjects fed exclusively by the parenteral route [38]. Finally, there are a large number of conditions linked to immunodeficiencies where both mucosal barriers and normal inflammatory response are malfunctioning. A significant microbial finding, e.g., single detection of a species with significant pathogenic profile or multiple detection of the same but low-pathogenic species, should alert the clinician independent of clinical signs of sepsis and whether the detection method was culture or molecular. Combining the methods might therefore provide important clinical information concerning not only the acute infection but also underlying conditions.

In our laboratory, it usually takes around 6–7 hours after a blood culture bottle has flagged positive before the isolate has grown enough on the plates enabling species identification within minutes by MALDI-TOF MS (Figure 2). At the same time a primary reading of the antibiogram is done and aids to disclose resistant strains of Staphylococcus aureus, Enterobacteriaceae spp. and non-fermenters. However, the time needed for species identification by conventional culture-based methods differs between clinical laboratories depending on routines. For the microarray, the turnaround time from positive bottle to microorganism identification was about four hours including preparation of blood culture bottles and DNA extraction. We estimated that the use of the microarray would save 2–3 hours compared to routine methods, but it is more labour intensive. For both blood culture and microarray, the incubation time of typically 1–3 days must also be considered. However, a time saving was obtained using multiplex PCR with an estimated turnaround time of only seven hours since this assay was performed directly on whole blood sample requiring no incubation time.

For the multiplex PCR assay, the whole process control was invalid or partially invalid in 45 (12%) of the 383 blood samples initially tested. According to the manufacturer, the whole process control indicates whether the process has functioned optimally or not. No further information is given when the whole process control is flagged as invalid. We speculated that a very high DNA concentration in the samples either inhibited the PCR reaction or the purification process. Therefore, these samples were retested on a ten-fold dilution of the extracted DNA and all but one sample then gave a final result. The high rate of invalid whole process control thus reduces the clinical utility of multiplex PCR since such samples need to be retested.

Our study has several limitations. One of the most important is that TATs were not precisely measured, just roughly estimated, mainly due to handling procedures. In addition, none of the NAATs were run 24/7; multiplex PCR was performed once daily whereas the microarray was ran every second day.

Conclusions

Our results indicate that the use of multiplex PCR assays on whole blood specimens may shorten the time to identifying causative agents in blood. As for the microarray-based assay, it corresponds well to blood culture, but the prerequisite of time-consuming cultivation reduces its clinical utility. Most important, we found that the multiplex PCR assay has the potential to serve as a complement to blood culture in detecting clinically relevant microbes in blood. However, it should be stressed that the aetiological significance of findings detected by PCR-based assays should be interpreted with caution as the high analytical sensitivity may add findings that do not necessarily corroborate with the clinical diagnosis. Improving PCR technology, e.g., repeated sampling or increasing diagnostic sensitivity by processing a larger volume of blood, by faster and automated analysis will make NAATs a better tool for diagnosing septic patients.

Abbreviations

NAAT:

nucleic acid amplification test

NPV:

negative predictive value

PCR:

polymerase chain reaction

PPV:

positive predictive value

References

  1. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–10.

    Article  CAS  PubMed  Google Scholar 

  2. Ebrahim GJ. Sepsis, septic shock and the systemic inflammatory response syndrome. J Trop Pediatr. 2011;57(2):77–9.

    Article  CAS  PubMed  Google Scholar 

  3. Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348(16):1546–54.

    Article  PubMed  Google Scholar 

  4. Davies A, Green C, Hutton J. Severe sepsis: a European estimate of the burden of disease in IC. Intensive Care Med. 2001;27 Suppl 2:S284.

    Google Scholar 

  5. Zaidi AK, Thaver D, Ali SA, Khan TA. Pathogens associated with sepsis in newborns and young infants in developing countries. Pediatr Infect Dis J. 2009;28(1 Suppl):S10–18.

    Article  PubMed  Google Scholar 

  6. Degoricija V, Sharma M, Legac A, Gradiser M, Sefer S, Vucicevic Z. Survival analysis of 314 episodes of sepsis in medical intensive care unit in university hospital: impact of intensive care unit performance and antimicrobial therapy. Croat Med J. 2006;47(3):385–97.

    PubMed  PubMed Central  Google Scholar 

  7. Dombrovskiy VY, Martin AA, Sunderram J, Paz HL. Facing the challenge: decreasing case fatality rates in severe sepsis despite increasing hospitalizations. Crit Care Med. 2005;33(11):2555–62.

    Article  PubMed  Google Scholar 

  8. Dombrovskiy VY, Martin AA, Sunderram J, Paz HL. Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003. Crit Care Med. 2007;35(5):1244–50.

    Article  PubMed  Google Scholar 

  9. Finfer S, Bellomo R, Lipman J, French C, Dobb G, Myburgh J. Adult-population incidence of severe sepsis in Australian and New Zealand intensive care units. Intensive Care Med. 2004;30(4):589–96.

    Article  PubMed  Google Scholar 

  10. Harrison DA, Welch CA, Eddleston JM. The epidemiology of severe sepsis in England, Wales and Northern Ireland, 1996 to 2004: secondary analysis of a high quality clinical database, the ICNARC Case Mix Programme Database. Crit Care. 2006;10(2):R42.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Sundararajan V, Macisaac CM, Presneill JJ, Cade JF, Visvanathan K. Epidemiology of sepsis in Victoria, Australia. Crit Care Med. 2005;33(1):71–80.

    Article  PubMed  Google Scholar 

  12. Marlowe EM, Gibson L, Hogan J, Kaplan S, Bruckner DA. Conventional and molecular methods for verification of results obtained with BacT/Alert Nonvent blood culture bottles. J Clin Microbiol. 2003;41(3):1266–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Reimer LG, Wilson ML, Weinstein MP. Update on detection of bacteremia and fungemia. Clin Microbiol Rev. 1997;10(3):444–65.

    CAS  PubMed  PubMed Central  Google Scholar 

  14. Bloos F, Hinder F, Becker K, Sachse S, Mekontso Dessap A, Straube E, et al. A multicenter trial to compare blood culture with polymerase chain reaction in severe human sepsis. Intensive Care Med. 2010;36(2):241–7.

    Article  CAS  PubMed  Google Scholar 

  15. Bloos F, Sachse S, Kortgen A, Pletz MW, Lehmann M, Straube E, et al. Evaluation of a polymerase chain reaction assay for pathogen detection in septic patients under routine condition: an observational study. PLoS One. 2012;7(9), e46003.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Carrara L, Navarro F, Turbau M, Seres M, Moran I, Quintana I, et al. Molecular diagnosis of bloodstream infections with a new dual priming oligonucleotide-based multiplex PCR assay. J Med Microbiol. 2013;62:1673–9.

    Article  PubMed  Google Scholar 

  17. Fitting C, Parlato M, Adib-Conquy M, Memain N, Philippart F, Misset B, et al. DNAemia detection by multiplex PCR and biomarkers for infection in systemic inflammatory response syndrome patients. PLoS One. 2012;7(6), e38916.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Josefson P, Stralin K, Ohlin A, Ennefors T, Dragsten B, Andersson L, et al. Evaluation of a commercial multiplex PCR test (SeptiFast) in the etiological diagnosis of community-onset bloodstream infections. Eur J Clin Microbiol Infect Dis. 2011;30(9):1127–34.

    Article  CAS  PubMed  Google Scholar 

  19. Loonen AJ, de Jager CP, Tosserams J, Kusters R, Hilbink M, Wever PC, et al. Biomarkers and molecular analysis to improve bloodstream infection diagnostics in an emergency care unit. PLoS One. 2014;9(1), e87315.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Tissari P, Zumla A, Tarkka E, Mero S, Savolainen L, Vaara M, et al. Accurate and rapid identification of bacterial species from positive blood cultures with a DNA-based microarray platform: an observational study. Lancet. 2010;375(9710):224–30.

    Article  CAS  PubMed  Google Scholar 

  21. Wellinghausen N, Kochem AJ, Disque C, Muhl H, Gebert S, Winter J, et al. Diagnosis of bacteremia in whole-blood samples by use of a commercial universal 16S rRNA gene-based PCR and sequence analysis. J Clin Microbiol. 2009;47(9):2759–65.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Westh H, Lisby G, Breysse F, Boddinghaus B, Chomarat M, Gant V, et al. Multiplex real-time PCR and blood culture for identification of bloodstream pathogens in patients with suspected sepsis. Clin Microbiol Infect. 2009;15(6):544–51.

    Article  CAS  PubMed  Google Scholar 

  23. Yanagihara K, Kitagawa Y, Tomonaga M, Tsukasaki K, Kohno S, Seki M, et al. Evaluation of pathogen detection from clinical samples by real-time polymerase chain reaction using a sepsis pathogen DNA detection kit. Crit Care. 2010;14(4):R159.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Dark P, Blackwood B, Gates S, McAuley D, Perkins GD, McMullan R, et al. Accuracy of LightCycler((R)) SeptiFast for the detection and identification of pathogens in the blood of patients with suspected sepsis: a systematic review and meta-analysis. Intensive Care Med. 2015;41(1):21–33.

    Article  CAS  PubMed  Google Scholar 

  25. Weinstein MP. Blood culture contamination: persisting problems and partial progress. J Clin Microbiol. 2003;41(6):2275–8.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Weinstein MP, Doern GV. A critical appraisal of the role of the clinical microbiology laboratory in the diagnosis of bloodstream infections. J Clin Microbiol. 2011;49(9 Supplement):S26–9.

    Article  PubMed Central  Google Scholar 

  27. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.

    Article  CAS  PubMed  Google Scholar 

  28. Fernandez-Cruz A, Marin M, Kestler M, Alcala L, Rodriguez-Creixems M, Bouza E. The value of combining blood culture and SeptiFast data for predicting complicated bloodstream infections caused by Gram-positive bacteria or Candida species. J Clin Microbiol. 2013;51(4):1130–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Lucignano B, Ranno S, Liesenfeld O, Pizzorno B, Putignani L, Bernaschi P, et al. Multiplex PCR allows rapid and accurate diagnosis of bloodstream infections in newborns and children with suspected sepsis. J Clin Microbiol. 2011;49(6):2252–8.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Chang SS, Hsieh WH, Liu TS, Lee SH, Wang CH, Chou HC, et al. Multiplex PCR system for rapid detection of pathogens in patients with presumed sepsis - a systemic review and meta-analysis. PLoS One. 2013;8(5), e62323.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Arpi M, Bentzon MW, Jensen J, Frederiksen W. Importance of blood volume cultured in the detection of bacteremia. Eur J Clin Microbiol Infect Dis. 1989;8(9):838–42.

    Article  CAS  PubMed  Google Scholar 

  32. Jonsson B, Nyberg A, Henning C. Theoretical aspects of detection of bacteraemia as a function of the volume of blood cultured. APMIS. 1993;101(8):595–601.

    Article  CAS  PubMed  Google Scholar 

  33. Cockerill 3rd FR, Wilson JW, Vetter EA, Goodman KM, Torgerson CA, Harmsen WS, et al. Optimal testing parameters for blood cultures. Clin Infect Dis. 2004;38(12):1724–30.

    Article  PubMed  Google Scholar 

  34. Lee A, Mirrett S, Reller LB, Weinstein MP. Detection of bloodstream infections in adults: how many blood cultures are needed? J Clin Microbiol. 2007;45(11):3546–8.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Weinstein MP, Towns ML, Quartey SM, Mirrett S, Reimer LG, Parmigiani G, et al. The clinical significance of positive blood cultures in the 1990s: a prospective comprehensive evaluation of the microbiology, epidemiology, and outcome of bacteremia and fungemia in adults. Clin Infect Dis. 1997;24(4):584–602.

    Article  CAS  PubMed  Google Scholar 

  36. Auckenthaler R, Hermans PE, Washington 2nd JA. Group G streptococcal bacteremia: clinical study and review of the literature. Rev Infect Dis. 1983;5(2):196–204.

    Article  CAS  PubMed  Google Scholar 

  37. Corredoira J, Alonso MP, Coira A, Varela J. Association between Streptococcus infantarius (formerly S. bovis II/1) bacteremia and noncolonic cancer. J Clin Microbiol. 2008;46(4):1570.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Alverdy JC, Aoys E, Moss GS. Total parenteral nutrition promotes bacterial translocation from the gut. Surgery. 1988;104(2):185–90.

    CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This study was supported by research grants from the Swedish Knowledge Foundation, regional funds in Västra Götaland, Clinical Research Fund Skaraborg Hospital, and Unilabs R&D Fund. The funding bodies had no involvement in the study design; collection, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. Department of Infectious Diseases, Skaraborg Hospital, SE-541 85, Skövde, Sweden

    Lars Ljungström & Gunnar Jacobsson

  2. Department of Clinical Microbiology, Unilabs AB, SE-541 85, Skövde, Sweden

    Helena Enroth, Berndt EB Claesson, Jesper Karlsson, Berit Fröberg & Anna-Karin Brodin

  3. Systems Biology Research Centre, School of Biosciences, University of Skövde, SE-541 28, Skövde, Sweden

    Ida Ovemyr, Anna-Karin Pernestig & Diana Karlsson

  4. Institute of Biomedicine, Sahlgrenska Academy, Gothenburg University, SE-402 34, Gothenburg, Sweden

    Rune Andersson

Authors
  1. Lars Ljungström
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Helena Enroth
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Berndt EB Claesson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ida Ovemyr
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jesper Karlsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Berit Fröberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Anna-Karin Brodin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Anna-Karin Pernestig
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Gunnar Jacobsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Rune Andersson
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Diana Karlsson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Diana Karlsson.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

LL coordinated the collection of the clinical specimens, participated in the design of the study, compiled the clinical data, assessed patient records and microbial findings, and helped draft the manuscript. HE coordinated the multiplex PCR analyses, participated in the design of the study, and helped draft the manuscript. BEBC was responsible for the culture methods, formulated the ideas of detection levels, participated in the design of the study, and helped draft the manuscript. IO performed the microarray analyses. JK, BF, and AKB performed the multiplex PCR analyses. AKP participated in the design of the study. GJ participated in the design of the study, assessed patient records and microbial findings. RA participated in the design of the study. DK coordinated the microarray analyses, participated in the design of the study, analysed the data, and drafted the manuscript. All authors revised the manuscript critically for important intellectual content and approved the final manuscript.

Additional file

Additional file 1:

All 77 episodes for which at least one microbial finding judged as clinically relevant or of unknown significance was detected with blood culture and/or NAATs. Table with all microbial findings judged as clinically relevant or of unknown significance detected by blood culture and/or NAATs.

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ljungström, L., Enroth, H., Claesson, B.E. et al. Clinical evaluation of commercial nucleic acid amplification tests in patients with suspected sepsis. BMC Infect Dis 15, 199 (2015). https://doi.org/10.1186/s12879-015-0938-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-015-0938-4

Keywords

  • Blood culture
  • Magicplex™
  • Prove-it™
  • sepsis diagnostic
  • multiplex PCR
  • microarray

BMC Infectious Diseases

ISSN: 1471-2334

Contact us