Skip to content

Advertisement

BMC Infectious Diseases

Research article
Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Clinical evaluation of commercial nucleic acid amplification tests in patients with suspected sepsis

  • Lars Ljungström1,
  • Helena Enroth2,
  • Berndt EB Claesson2,
  • Ida Ovemyr3,
  • Jesper Karlsson2,
  • Berit Fröberg2,
  • Anna-Karin Brodin2,
  • Anna-Karin Pernestig3,
  • Gunnar Jacobsson1,
  • Rune Andersson4 and
  • Diana Karlsson3Email author
BMC Infectious Diseases201515:199

https://doi.org/10.1186/s12879-015-0938-4

©  Ljungström et al.; licensee BioMed Central. 2015

Received: 4 February 2015

Accepted: 22 April 2015

Published: 28 April 2015

Open Peer Review reports

Abstract

Background

Sepsis is a serious medical condition requiring timely administered, appropriate antibiotic therapy. Blood culture is regarded as the gold standard for aetiological diagnosis of sepsis, but it suffers from low sensitivity and long turnaround time. Thus, nucleic acid amplification tests (NAATs) have emerged to shorten the time to identification of causative microbes. The aim of the present study was to evaluate the clinical utility in everyday practice in the emergency department of two commercial NAATs in patients suspected with sepsis.

Methods

During a six-week period, blood samples were collected consecutively from all adult patients admitted to the general emergency department for suspicion of a community-onset sepsis and treated with intravenous antibiotics. Along with conventional blood cultures, multiplex PCR (Magicplex™) was performed on whole blood specimens whereas portions from blood culture bottles were used for analysis by microarray-based assay (Prove-it™). The aetiological significance of identified organisms was determined by two infectious disease physicians based on clinical presentation and expected pathogenicity.

Results

Among 382 episodes of suspected sepsis, clinically relevant microbes were detected by blood culture in 42 episodes (11%), by multiplex PCR in 37 episodes (9.7%), and by microarray in 32 episodes (8.4%). Although moderate agreement with blood culture (kappa 0.50), the multiplex PCR added diagnostic value by timely detection of 15 clinically relevant findings in blood culture-negative specimens. Results of the microarray corresponded very well to those of blood culture (kappa 0.90), but were available just marginally prior to blood culture results.

Conclusions

The use of NAATs on whole blood specimens in adjunct to current culture-based methods provides a clinical add-on value by allowing for detection of organisms missed by blood culture. However, the aetiological significance of findings detected by NAATs should be interpreted with caution as the high analytical sensitivity may add findings that do not necessarily corroborate with the clinical diagnosis.

Keywords

Blood cultureMagicplex™Prove-it™sepsis diagnosticmultiplex PCRmicroarray

Background

Sepsis is a major cause of morbidity and mortality in all high income as well as middle and low income countries [1-5]. About 20 million cases of sepsis are estimated to occur each year around the world accounting for up to 135,000 deaths in Europe and 215,000 in the United States [1,4]. Recent studies from different countries show that the incidence of sepsis as well as the number of sepsis-related deaths is continuously increasing [3,6-11].

At present, blood culture is considered the gold standard for aetiological diagnosis in sepsis. Although blood culture is associated with high specificity in species identification, it is limited by a substantial time delay and low sensitivity, especially for slow-growing and fastidious organisms [12,13]. In an effort to address some of the limitations with blood culture, nucleic acid amplification tests (NAATs) have been developed to improve the sensitivity and decrease the time to identification of microorganisms causing bacteraemia. Several commercial multiplex assays, based on different techniques such as conventional polymerase chain reaction (PCR) (VYOO®, Analytik Gena, Germany), real-time PCR (Magicplex™ Sepsis Real-time Test, Seegene, Korea; LightCycler® SeptiFast, Roche, Switzerland; Sepsitest™, Molzym, Germany) and microarray (Prove-it™ Sepsis, Mobidiag, Finland) are now on the market. These assays have been tested in several studies [14-24] but rarely is there a clinical validation of the results.

The aim of this population-based study was therefore to evaluate the clinical utility of two commercial NAATs, Magicplex™ Sepsis Real-time Test and Prove-it™ Sepsis, in patients with suspected sepsis. Magicplex™ Sepsis Real-time Test is a PCR-based test screening for 73 species of Gram positive bacteria, twelve species of Gram negative, and six species of fungi and three resistance genes (mecA, vanA, and vanB) directly in whole blood samples. The microarray-based assay called Prove-it™ Sepsis combines genome amplification by conventional PCR and microarray technology for simultaneous identification of over 60 bacterial pathogens, and 13 fungal pathogens, and three resistance genes (mecA, vanA, and vanB) in positive blood cultures.

Methods

Patients and specimens

From September 2011 to June 2012, a prospective observational study of the incidence of community-onset severe sepsis and septic shock in adults was conducted at Skaraborg Hospital, in the western region of Sweden. During a limited period of the prospective study, from February to April 2012, NAATs were performed as part of routine patient care in addition to blood culture in all patients >18 years admitted to the emergency department for suspicion of community-onset sepsis. All patients received oral and written information about the study. In patients suspected to have sepsis or severe sepsis, it is mandatory to rapidly make appropriate sampling for microbiological diagnosis before antibiotic treatment is instituted. This microbiological testing, using appropriate and approved tests, needed no patient consent according to the Swedish Law. The diagnostic tests were made upon arrival to the emergency department and no additional sampling was made. Some patients were too sick and/or died within 24 hours and could never give an informed consent. Those patients who could not give an informed consent, were evaluated anonymously, only for diagnosis and results of commercially available tests used for diagnostic purposes of the suspected sepsis. The Regional Ethics Committee in Gothenburg (no. 376–11) approved the study and the consent process.

Blood culture

In this study, an episode was defined as each separate case of clinically suspected community-onset sepsis treated with intravenous antibiotics. Only one episode per patient and admission were included in the final data analysis to avoid bias. For each episode, two sets of blood cultures from two different puncture sites were collected before administration of the first dose of intravenous antibiotics. However, for a few episodes, due to feasibility, only one set of blood culture was collected. Blood cultures were conducted in BacT/ALERT® FN (bioMérieux, France). Typing and definite species identification with MALDI-TOF MS was performed on a Microflex LT mass spectrometer (Bruker Daltonics, United States) with BioTyper software v2.0 using default parameter settings. Spectral scores above 2.0 were used as cut-off for correct identification. Antibiotic susceptibility was determined by accredited laboratory methods according to EUCAST guidelines (www.eucast.org).

Multiplex PCR assay

The test procedure for Magicplex™ was performed on 1 mL fresh whole blood (EDTA) collected before administration of antibiotics and not older than 24 hours. DNA extraction from whole blood was performed using the SelectNA Blood Pathogen Kit (Molzym, Germany). The first steps of the extraction, lysis of human cells and digestion of human DNA, were manually performed according to the manufacturer’s instructions. Pure bacterial/fungal DNA was then extracted automatically from the prelysed samples on the instrument Nordiag Arrow/Liaison IXT (DiaSorin, Italy). The first PCR, producing amplicon banks, was performed using the kit Magicplex Sepsis Amplification on a GeneAmp PCR System 9700 (Applied Biosystems, United States). Real-time PCR was then performed with the Magicplex Screening Real-time Detection Kit on a CFX96 (Bio-Rad, United States). The screening revealed the presence of Gram positive or Gram negative bacteria, drug resistance genes or fungi. Species identification was performed with the Magicplex ID 1-ID 9 Real-time Detection Kit on samples that became positive in the screening step. All PCR-reactions were set up in a UV-box according to the recommendations from the manufacturer. The dedicated software Seegene viewer was used to interpret the analysis data, where the result from every sample is presented in a table as Detected or Not detected. A whole process control was included in the assay. If this was valid, the assay result could be interpreted.

Microarray-based assay

Prove-it™ was performed on aliquots derived from blood culture bottles removed from the automated blood culture system. After removal, the bottles were stored in 4°C between 1–2 days until DNA extraction was performed. For each episode, aliquots were taken from that pair of blood culture bottles, one aerobic and one anaerobic bottle, derived from the first puncture site. A volume of 200 μL was withdrawn from each bottle. Regardless if the blood culture bottles were found positive or negative, sample volumes from each pair of bottles was pooled together prior to DNA extraction. DNA was extracted using 400 μL of sample volume and eluted in a final volume of 200 μL using a MagNA Pure Nucleic Acid Isolation Kit I on a MagNAPure Compact System (Roche Applied Science, Switzerland). The procedure for the microarray assay was performed according to protocols provided by the manufacturer. Briefly, both a bacterial and a fungal PCR master mix were prepared. The PCR reactions were set up in a laminar airflow bench where no amplified PCR products were handled. After PCR amplification, the bacterial PCR product and the fungal PCR product derived from the same episode were added to the same well of the microarray. Subsequently, hybridization and staining procedures were performed. For detection and analysis of the samples, the dedicated software Prove-it™ Advisor was used. Based on the outcomes of several built-in controls, the software evaluated whether the performance of the assay is acceptable. All analysis parameters were adjusted automatically without any manual involvement.

Data interpretation and statistical analysis

All records of the patients and microbial findings were assessed by two senior physicians in infectious diseases (LL and GJ). The clinical judgment was based on the patient history with special reference to sudden onset of fever, rigors, gastrointestinal symptoms, tachypnea, mental confusion, pain out of proportion, and muscle weakness. Physical examination was done with attention to blood pressure <90 mm Hg, respiratory rate >20/min, and oxygen saturation <90%. Standard biomarkers included serum lactate, leucocyte cell count, neutrophil-lymphocyte count ratio, and C-reactive protein. Judgment was also based on imaging and microbiological testing of suspected infectious foci including culture, PCR, and antigen test, apart from the NAAT assays described in detail above.

It remains challenging to determine the aetiological significance of organisms detected in blood. This applies especially to NAATs, but also to conventional blood culture although to a lesser degree. In this study, decisions of aetiological significance of detected organisms were made based on expected pathogenicity (Table 1) and clinical presentation as previously described [25,26]. Detected organisms were interpreted as clinically relevant, of unknown significance or contaminant according to the algorithm described in Figure 1. Organisms detected only by a NAAT were also regarded as clinically relevant, but with more stringent criteria than positive blood culture results. Microorganisms of unknown aetiological significance are findings considered not consistent with the clinical diagnosis having no implications for the medical management of the patients. However, links between the microorganism and the medical condition of the patient cannot be excluded.
Table 1

Schematic distribution of microorganisms according to expected pathogenic potential

True pathogens

Possible pathogens

Bacteroides fragilis group

Aerococcus spp.

Candida spp.

Anaerobic Gram positive cocci

Clostridium spp. other than C. perfringens

Lactobacillus spp.

Enterobacteriaceae spp.

Non-fermenting Gram negative rods

Enterococcus spp.

Viridans group streptococci

Former Streptococcus bovis group

 

Fusobacterium spp.

 

Haemophilus spp.

Commensals (common contaminants)

aHACEK group

Listeria spp.

Bacillus spp.

Mycobacterium spp.

Coagulase-negative staphylococci

Neisseria spp.

Corynebacterium spp.

Pasteurella spp.

Propionibacterium spp.

Porphyromonas spp.

 

Prevotella spp.

 

Pseudomonas aeruginosa

 

Staphylococcus aureus

 

Staphylococcus lugdunensis

 

Stenotrophomonas maltophilia

 

Streptococcus anginosus group

 

Streptococcus group A, B, C, G

 

Streptococcus pneumoniae

 

aHACEK group includes: Haemophilus parainfluenzae, Haemophilus aphrophilus, Haemophilus paraphropilus, Actinobacillus actinomycetemcomitans, Aggregatibacter aphrophiuls, Cardiobacterium hominis, Eikenella corrodens, and Kingella kingae.

Figure 1

Algorithm for deciding on clinical relevance of microbial findings in blood by blood culture [25] or NAAT. Other cultures were made from clinically relevant sites before administration of intravenous antibiotics. On suspicion of pneumonia or sepsis with unknown focus, a pulmonary X-ray was performed. Ultrasound, computed tomography scan, and magnetic resonance imaging were used when deemed necessary for diagnosing the site of infection. BC blood culture; NAAT nucleic acid amplification test.

McNemar’s test was conducted for comparing proportions in paired samples, whereas z test was performed for comparing proportions in independent samples. A two-sided p value of <0.05 was considered statistically significant. Concordances between blood culture and NAATs were tested with kappa statistics for inter-rater agreement; cut-off values for the kappa value have been described elsewhere; 0.41-0.60 are considered of moderate agreement, and those of 0.81-1.00 of very good agreement [27]. Statistical analyses were performed using Matlab v. 7.10 (The Mathworks, Inc., United States).

Results

A total of 375 patients entered this study. Eight patients were admitted twice during the study period, resulting in a total of 383 episodes analysed with blood culture and both NAATs. For the multiplex PCR, the whole process control was invalid or partially invalid in 45 (12%) of the 383 blood samples initially tested. These samples were retested on a ten-fold dilution of the extracted DNA. After the re-run, one sample did still not give a final result and was excluded from further analysis, making a total of 382 episodes.

At least one microorganism was detected in 138 episodes by either method. Microorganisms defined as commensals (Table 1) were considered to be contaminants and excluded from analysis if only found on a single occasion regardless of detection method. In total, 89 clinically relevant findings or findings of unknown significance were identified in 77 episodes (20%). A detailed description including clinical comments for these findings can be found in Additional file 1. In eight episodes, a clinically relevant finding was detected by blood culture in a bottle not included in that pair of bottles from which aliquots for the microarray analysis was derived. Thus, these eight episodes were excluded from the analysis of the microarray results.

For blood culture, the result of species identification was usually available 6–7 hours after a bottle has flagged positive (Figure 2). The turnaround time for the multiplex PCR assay was estimated to around seven hours. For the microarray, the turnaround time from positive blood culture bottle to species identification was approximately four hours. The diagnostic performance for blood culture and the NAATs are shown in Table 2.
Figure 2

Workflows and turnaround times for the detection methods used in the present study.

Table 2

Diagnostic performance of blood culture, multiplex PCR, and microarray a

 

Sensitivity

Specificity

PPV

NPV

Accuracy

(95% CI)

(95% CI)

(95% CI)

(95% CI)

(95% CI)

Blood culture

72% (61–84)

99% (99–100)

98% (93–100)

94% (92–97)

95% (92–97)

Multiplex PCR

64% (51–76)

96% (93–98)

73% (60–85)

94% (91–96)

91% (88–94)

Microarray

62% (49–75)

99% (97–100)

86% (75–97)

95% (92–97)

94% (91–96)

NPV negative predictive value; PPV positive predictive value.

aFor each method, all episodes were classified according following criteria: i) true positive – episode positive for at least one clinically relevant finding; ii) false positive - episode positive only for finding(s) of unknown significance; iii) false negative - episode negative with the method, but positive for at least one clinically relevant finding detected by another method; iv) true negative - episode negative with the method and for which no clinically relevant findings were detected by any method.

Multiplex PCR assay

The rate of episode positivity for multiplex PCR was 14% (53/382), whereas the rate of episode positivity for blood culture was 11% (42/382, p = 0.61). Cohen’s kappa coefficient for agreement between the results of multiplex PCR and blood culture was 0.52 (95% CI 0.37-0.66).

In total, 37 clinically relevant findings in 37 episodes and 23 findings of unknown significance in 21 episodes were detected by multiplex PCR. For blood culture, 44 findings in 42 episodes were clinically relevant and one finding of unknown significance. The multiplex PCR and blood culture results agreed for 22 clinically relevant findings (Figure 3A). Multiplex PCR missed 22 clinically relevant findings in 20 episodes and one finding of unknown significance. On the other hand, 38 findings identified by multiplex PCR in 35 episodes were not detected by blood culture. Fifteen of these 38 findings were considered as clinically relevant; five of these 15 findings were considered as proven aetiology of the infections since the same bacteria were found by culture from the site of infection (Table 3). The remaining ten findings made by multiplex PCR were negative in blood culture and other diagnostic tests, but consistent with the clinical diagnosis and therefore regarded as clinically relevant (Table 3). Twenty-three of the 38 findings detected by multiplex PCR but not by blood culture were regarded to be of unknown significance. Ten were findings of Gram positive bacteria, eleven were findings of Gram negative bacteria and two were findings of Candida species (Table 4).
Figure 3

Microbial concordances between blood culture and NAATs. A Number of microbes detected by blood culture and/or multiplex PCR. B Number of microbes detected by blood culture and/or microarray. BC blood culture; CRF clinically relevant finding; CNRF clinically not relevant finding; OUS finding of unknown significance.

Table 3

Clinically relevant microbial findings made by multiplex PCR but not by blood culture

Patient

Multiplex PCR results

Clinical diagnosis

1

Enterobacter aerogenes

Abdominal abscess.

2

Enterococcus faecalis a

Acute pyelonephritis. Grew E. faecalis in the urine.

3

Escherichia coli a

Acute pyelonephritis. Grew E. faecalis in the urine.

4

Escherichia coli a

Acute pyelonephritis. Grew E. faecalis in the urine.

5

Escherichia coli a

Acute pyelonephritis. Grew E. faecalis in the urine.

6

Escherichia coli

Acute cholecystitis. Elevated liver enzymes and positive computed tomography scan. Three months earlier, the patient had an acute cholecystitis with E. coli in blood cultures.

7

Escherichia coli

Acute pyelonephritis. Urine culture could not be obtained.

8

Escherichia coli

Abdominal abscess after appendectomy.

9

Klebsiella oxytoca

Perianal abscess.

10

Klebsiella pneumoniae

Acute pyelonephritis. Urine culture could not be obtained.

11

Staphylococcus aureus a

Infected leg ulcer. Grew S. aureus in the ulcer.

12

Stenotrophomonas maltophilia

Infected chronic leg ulcer.

13

Streptococcus pneumoniae

Clinical pneumonia, confirmed by chest x-ray.

14

Streptococcus pneumoniae

Fever, respiratory distress, pulmonary fibrosis. No other diagnosis was made. Chest x-ray inconclusive for pneumonia.

15

Streptococcus spp.

Acute cholangitis. Elevated liver enzymes and positive computed tomography scan.

aConsidered as proven aetiology since the same species were found by culture from the site of infection.

Table 4

Microbial findings of unknown significance made by multiplex PCR but not by blood culture

Patient

Multiplex PCR results

Clinical diagnosis

1

Acinetobacter baumannii

Acute pyelonephritis due to E. coli.

2

Acinetobacter baumannii

Infected chronic leg ulcer. A. baumannii not cultured from wound.

3a

Acinetobacter baumannii, Stenotrophomonas maltophilia

Infected chronic leg ulcers.

4

Acinetobacter baumannii

Pulmonary embolism.

5

Candida krusei

Pneumonia verified by chest X-ray.

6

Candida parapsilosis

Acute pyelonephritis due to E. coli.

7

Enterobacter cloacae

Polycytemia vera. Fever and respiratory distress. Believed to have an adverse reaction to hydroxyurea. Infiltrate on chest X-ray. PCR from nasopharynx positive for human metapneumovirus and coronavirus.

8

Enterococcus faecalis

Acute pyelonephritis due to E. coli.

9

Enterococcus gallinarium

Nausea. No other diagnosis was made.

10

Escherichia coli

Acute otitis media. No other cultures were positive.

11

Klebsiella oxytoca

S. aureus endocarditis.

12

Klebsiella pneumoniae

Acute vomiting and fever. No other diagnosis was made.

13

Pseudomonas aeruginosa

Acute pyelonephritis due to E. coli.

14a

Staphylococcus aureus, Streptococcus spp.

Influenza A verified by PCR.

15

Staphylococcus aureus

Pneumonia due to K. pneumoniae. Lymphoma.

16

Staphylococcus aureus

Pneumonia. Verified by chest X-ray.

17

Stenotrophomonas maltophilia

Pulmonary fibrosis and suspected pneumonia.

18

Streptococcus agalactiae

Arrived with severe sepsis. Diseased within 24 hours.

19

Streptococcus pneumoniae

Acute diabetic ketoacidosis. PCR from nasopharynx positive for human rhinovirus. Highly elevated neutrophil count.

20

Streptococcus pneumoniae

Acute pyelonephritis due to E. coli.

21

Streptococcus spp.

Goiter.

aTwo microbial findings of unknown significance in the same patient.

Microarray-based assay

The rate of episode positivity for the microarray assay was 8.4% (32/382) and for blood culture 8.9% (34/382, p = 0.37). Cohen kappa statistic for agreement between the results of microarray and blood culture was 0.92 (95% CI 0.84-0.99).

In total, 32 clinically relevant findings in 31 episodes and five findings of unknown significance in five episodes were detected by microarray. The results between microarray and blood culture showed concordance for 30 clinically relevant findings (Figure 3B). The microarray failed to detect four clinically relevant findings detected by blood culture. However, two of these findings belonged to species not covered by the microarray panel (Streptococcus anginosus and Streptococcus group G). The microarray identified one clinically relevant finding and five findings of unknown significance not detected by either blood culture or multiplex PCR (Table 5).
Table 5

Microbial findings made by microarray but not by blood culture

Patient

Microarray results

Clinical diagnosis

1

Enterobacter cloacae b

Tendinitis of the hand due to S. aureus.

2

Enterobacter cloacae b

Acute pyelonephritis due to E. faecalis.

3

Enterobacter cloacae b

Neutropenic fever.

4

Enterococcus faecalis a

Acute bronchitis. E. faecalis in urine.

5

Staphylococcus aureus b

Pneumonia.

6

Staphylococcus aureus b

Acute pyelonephritis due to E. coli.

aClinically relevant microbial finding.

bMicrobial finding of unknown significance.

Discussion

The focus of this study is on the clinical utility of two commercial NAATs in the aetiological diagnosis of patients with suspected sepsis. We found that the multiplex PCR assay added diagnostic value by timely detection of clinically relevant microbes missed by blood culture. The results of the microarray-based assay corresponded well to those of blood culture, but its clinical utility is reduced by the prerequisite of time-consuming cultivation.

Currently, blood culture is considered the gold standard for aetiological diagnosis of sepsis although it suffers from having a low sensitivity. It can only detect viable microorganisms, and the medium is not optimized for culturing fungi and fastidious bacteria. Thus, blood culture can be considered to be a poor gold standard, which implies difficulties in evaluating novel sepsis tests since no other laboratory reference standard for sepsis diagnosis exists. For that reason, different reference standards have been used in studies assessing sepsis tests. Some have used blood culture results alone as gold standard [20,28], whereas others have considered all pathogenic findings detected by any method [16,29]. We assessed the performances of blood culture and the two NAATs by classifying all findings judged as clinically relevant as “true positives”. The diagnostic sensitivity for multiplex PCR (64%, Table 2) was comparable with the rate in a similar study by Carrara et al. (65%, p = 0.91) [16], as well as the specificity (96% vs. 92%, p = 0.05) [16]. However, Loonen et al. have reported significantly lower sensitivity (37%, p < 0.001) and specificity (77%, p = 0.0001) for Magicplex™ [19]. For the microarray assay, we observed a significantly lower diagnostic sensitivity (62% vs. 96%, p < 0.0001, Table 2) whereas the specificity was equal (99% vs. 99%, p = 1.0) compared with a previous study [20]. The use of different gold standards and study populations may explain observed differences in the performance characteristics [16,19,20,30].

Although the multiplex PCR assay could not detect all clinically relevant microbes, it offered added diagnostic value by the detection of several important pathogens not detected by the conventional culture-based method (Table 3). Consequently, the concordance between the results of blood culture and multiplex PCR assay is moderate (kappa 0.50) (Table 2), whereas the microarray results showed a high degree of agreement with the results of blood culture (kappa 0.90) (Table 2). These results could be expected since the microarray assay is performed on aliquots derived from blood culture bottles, whereas the multiplex PCR is performed on microbial DNA extracted from a different whole blood sample than the cultured portion.

A remarkable finding is that multiplex PCR of only 1 mL whole blood reached a sensitivity of 64% compared to 72% for culture using 32–40 mL blood, despite more stringent criteria for clinical relevance in the PCR case. However, both methods failed to detect a number of sepsis cases. From a strictly quantitative aspect, the detection level for microorganisms in blood samples at a given time, the diagnostic sensitivity, is depending on the concentration of microorganisms and the volume sampled. The extent of variation in the yield of bacteria in time is not known. In bacteraemia, an average concentration of 0.25 CFU/mL blood was reported by Arpi et al. [31]. Jonsson et al. [32] theoretically calculated the probability of detecting bacteria as a function of the concentration in blood and found empirically by blood culture that 29% of all cases with Escherichia coli and 18% of S. aureus bacteraemia had a most probable concentration of only 0.036 CFU/mL. The gain in yield of microorganisms by increasing the volume of cultured blood in more modern automated culture systems was emphasized by Cockerhill et al. [33] and Lee et al. [34]. To obtain a >99% sensitivity with these systems, four blood cultures, each involving 20 mL is needed [34]. The gain is probably due to the detection of the most minute concentrations, either by enhanced culture systems or overcoming the effects of early antibiotic therapy by resins.

NAATs introduced to diagnose sepsis by sampling blood may add new information implying higher analytical sensitivity. By definition, the analytical sensitivity of an assay refers to the smallest value of the analyte that can be resolved with a given degree of confidence and is not synonymous with the diagnostic sensitivity. A single bacterial cell is obviously the smallest theoretical unit that can be applied for blood culture or culture in a wider sense. With NAATs, a single bacterial cell, dead or alive, may contain multiples of a certain target sequence, e.g., in bacteria the conserved 16S rRNA gene sequence is often used as PCR template due to its high copy number in each cell. The downside of using detection methods with high analytical sensitivity, such as PCR, is the increased number of findings of unknown significance as well as contaminants. We then have to cope with unexpected microbial findings that do not necessarily corroborate with the clinical picture, as translocation of bacteria and fungi over the mucosal gut barrier in patients with malignancies or on parenteral nutrition is an increasing diagnostic dilemma. Thus, we are urged to tighten the communication between the laboratory and the clinicians to organise, assemble and critically review the unexpected findings.

There is also a qualitative aspect. Certain species seem to correlate better with genuine sepsis than others, i.e., Enterobacteriaceae spp. and pneumococci [35]. The detection of identical microorganisms from multiple sampling sites or occasions is another genuine marker for true bacteraemia. This further implies that a single finding of a microbe with one detection system, e.g., culture, may move the interpretation from probable to proven if the same finding is done with e.g., PCR. However, true bacteraemia also occurs in patients void of an inflammatory response. This shall not be regarded as a benign finding until the following factors are ruled out. First, translocation of bacteria from the gut to the bloodstream may occur in patients with malfunctioning mucosal barriers. Well known examples are E. cloacae (occult malignancy) [35], Streptococcus group G, i.e., Streptococcus dysgalactiae subsp. equisimilis (haematological malignancy and solid tumours) [36], and the former Streptococcus bovis group, i.e., S. gallolyticus subsp. gallolyticus and subsp. pasteurianus (colonic cancer), and S. infantarius (cancer of the bile tree or pancreas) [37]. Experimental work on animals showed an increased risk for bacterial translocation for subjects fed exclusively by the parenteral route [38]. Finally, there are a large number of conditions linked to immunodeficiencies where both mucosal barriers and normal inflammatory response are malfunctioning. A significant microbial finding, e.g., single detection of a species with significant pathogenic profile or multiple detection of the same but low-pathogenic species, should alert the clinician independent of clinical signs of sepsis and whether the detection method was culture or molecular. Combining the methods might therefore provide important clinical information concerning not only the acute infection but also underlying conditions.

In our laboratory, it usually takes around 6–7 hours after a blood culture bottle has flagged positive before the isolate has grown enough on the plates enabling species identification within minutes by MALDI-TOF MS (Figure 2). At the same time a primary reading of the antibiogram is done and aids to disclose resistant strains of Staphylococcus aureus, Enterobacteriaceae spp. and non-fermenters. However, the time needed for species identification by conventional culture-based methods differs between clinical laboratories depending on routines. For the microarray, the turnaround time from positive bottle to microorganism identification was about four hours including preparation of blood culture bottles and DNA extraction. We estimated that the use of the microarray would save 2–3 hours compared to routine methods, but it is more labour intensive. For both blood culture and microarray, the incubation time of typically 1–3 days must also be considered. However, a time saving was obtained using multiplex PCR with an estimated turnaround time of only seven hours since this assay was performed directly on whole blood sample requiring no incubation time.

For the multiplex PCR assay, the whole process control was invalid or partially invalid in 45 (12%) of the 383 blood samples initially tested. According to the manufacturer, the whole process control indicates whether the process has functioned optimally or not. No further information is given when the whole process control is flagged as invalid. We speculated that a very high DNA concentration in the samples either inhibited the PCR reaction or the purification process. Therefore, these samples were retested on a ten-fold dilution of the extracted DNA and all but one sample then gave a final result. The high rate of invalid whole process control thus reduces the clinical utility of multiplex PCR since such samples need to be retested.

Our study has several limitations. One of the most important is that TATs were not precisely measured, just roughly estimated, mainly due to handling procedures. In addition, none of the NAATs were run 24/7; multiplex PCR was performed once daily whereas the microarray was ran every second day.

Conclusions

Our results indicate that the use of multiplex PCR assays on whole blood specimens may shorten the time to identifying causative agents in blood. As for the microarray-based assay, it corresponds well to blood culture, but the prerequisite of time-consuming cultivation reduces its clinical utility. Most important, we found that the multiplex PCR assay has the potential to serve as a complement to blood culture in detecting clinically relevant microbes in blood. However, it should be stressed that the aetiological significance of findings detected by PCR-based assays should be interpreted with caution as the high analytical sensitivity may add findings that do not necessarily corroborate with the clinical diagnosis. Improving PCR technology, e.g., repeated sampling or increasing diagnostic sensitivity by processing a larger volume of blood, by faster and automated analysis will make NAATs a better tool for diagnosing septic patients.

Abbreviations

NAAT: 

nucleic acid amplification test

NPV: 

negative predictive value

PCR: 

polymerase chain reaction

PPV: 

positive predictive value

Declarations

Acknowledgements

This study was supported by research grants from the Swedish Knowledge Foundation, regional funds in Västra Götaland, Clinical Research Fund Skaraborg Hospital, and Unilabs R&D Fund. The funding bodies had no involvement in the study design; collection, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.

Authors’ Affiliations

(1)
Department of Infectious Diseases, Skaraborg Hospital, Skövde, Sweden
(2)
Department of Clinical Microbiology, Skövde, Sweden
(3)
Systems Biology Research Centre, School of Biosciences, University of Skövde, Skövde, Sweden
(4)
Institute of Biomedicine, Sahlgrenska Academy, Gothenburg University, Gothenburg, Sweden

References

  1. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–10.View ArticlePubMedGoogle Scholar
  2. Ebrahim GJ. Sepsis, septic shock and the systemic inflammatory response syndrome. J Trop Pediatr. 2011;57(2):77–9.View ArticlePubMedGoogle Scholar
  3. Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003;348(16):1546–54.View ArticlePubMedGoogle Scholar
  4. Davies A, Green C, Hutton J. Severe sepsis: a European estimate of the burden of disease in IC. Intensive Care Med. 2001;27 Suppl 2:S284.Google Scholar
  5. Zaidi AK, Thaver D, Ali SA, Khan TA. Pathogens associated with sepsis in newborns and young infants in developing countries. Pediatr Infect Dis J. 2009;28(1 Suppl):S10–18.View ArticlePubMedGoogle Scholar
  6. Degoricija V, Sharma M, Legac A, Gradiser M, Sefer S, Vucicevic Z. Survival analysis of 314 episodes of sepsis in medical intensive care unit in university hospital: impact of intensive care unit performance and antimicrobial therapy. Croat Med J. 2006;47(3):385–97.PubMedPubMed CentralGoogle Scholar
  7. Dombrovskiy VY, Martin AA, Sunderram J, Paz HL. Facing the challenge: decreasing case fatality rates in severe sepsis despite increasing hospitalizations. Crit Care Med. 2005;33(11):2555–62.View ArticlePubMedGoogle Scholar
  8. Dombrovskiy VY, Martin AA, Sunderram J, Paz HL. Rapid increase in hospitalization and mortality rates for severe sepsis in the United States: a trend analysis from 1993 to 2003. Crit Care Med. 2007;35(5):1244–50.View ArticlePubMedGoogle Scholar
  9. Finfer S, Bellomo R, Lipman J, French C, Dobb G, Myburgh J. Adult-population incidence of severe sepsis in Australian and New Zealand intensive care units. Intensive Care Med. 2004;30(4):589–96.View ArticlePubMedGoogle Scholar
  10. Harrison DA, Welch CA, Eddleston JM. The epidemiology of severe sepsis in England, Wales and Northern Ireland, 1996 to 2004: secondary analysis of a high quality clinical database, the ICNARC Case Mix Programme Database. Crit Care. 2006;10(2):R42.View ArticlePubMedPubMed CentralGoogle Scholar
  11. Sundararajan V, Macisaac CM, Presneill JJ, Cade JF, Visvanathan K. Epidemiology of sepsis in Victoria, Australia. Crit Care Med. 2005;33(1):71–80.View ArticlePubMedGoogle Scholar
  12. Marlowe EM, Gibson L, Hogan J, Kaplan S, Bruckner DA. Conventional and molecular methods for verification of results obtained with BacT/Alert Nonvent blood culture bottles. J Clin Microbiol. 2003;41(3):1266–9.View ArticlePubMedPubMed CentralGoogle Scholar
  13. Reimer LG, Wilson ML, Weinstein MP. Update on detection of bacteremia and fungemia. Clin Microbiol Rev. 1997;10(3):444–65.PubMedPubMed CentralGoogle Scholar
  14. Bloos F, Hinder F, Becker K, Sachse S, Mekontso Dessap A, Straube E, et al. A multicenter trial to compare blood culture with polymerase chain reaction in severe human sepsis. Intensive Care Med. 2010;36(2):241–7.View ArticlePubMedGoogle Scholar
  15. Bloos F, Sachse S, Kortgen A, Pletz MW, Lehmann M, Straube E, et al. Evaluation of a polymerase chain reaction assay for pathogen detection in septic patients under routine condition: an observational study. PLoS One. 2012;7(9), e46003.View ArticlePubMedPubMed CentralGoogle Scholar
  16. Carrara L, Navarro F, Turbau M, Seres M, Moran I, Quintana I, et al. Molecular diagnosis of bloodstream infections with a new dual priming oligonucleotide-based multiplex PCR assay. J Med Microbiol. 2013;62:1673–9.View ArticlePubMedGoogle Scholar
  17. Fitting C, Parlato M, Adib-Conquy M, Memain N, Philippart F, Misset B, et al. DNAemia detection by multiplex PCR and biomarkers for infection in systemic inflammatory response syndrome patients. PLoS One. 2012;7(6), e38916.View ArticlePubMedPubMed CentralGoogle Scholar
  18. Josefson P, Stralin K, Ohlin A, Ennefors T, Dragsten B, Andersson L, et al. Evaluation of a commercial multiplex PCR test (SeptiFast) in the etiological diagnosis of community-onset bloodstream infections. Eur J Clin Microbiol Infect Dis. 2011;30(9):1127–34.View ArticlePubMedGoogle Scholar
  19. Loonen AJ, de Jager CP, Tosserams J, Kusters R, Hilbink M, Wever PC, et al. Biomarkers and molecular analysis to improve bloodstream infection diagnostics in an emergency care unit. PLoS One. 2014;9(1), e87315.View ArticlePubMedPubMed CentralGoogle Scholar
  20. Tissari P, Zumla A, Tarkka E, Mero S, Savolainen L, Vaara M, et al. Accurate and rapid identification of bacterial species from positive blood cultures with a DNA-based microarray platform: an observational study. Lancet. 2010;375(9710):224–30.View ArticlePubMedGoogle Scholar
  21. Wellinghausen N, Kochem AJ, Disque C, Muhl H, Gebert S, Winter J, et al. Diagnosis of bacteremia in whole-blood samples by use of a commercial universal 16S rRNA gene-based PCR and sequence analysis. J Clin Microbiol. 2009;47(9):2759–65.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Westh H, Lisby G, Breysse F, Boddinghaus B, Chomarat M, Gant V, et al. Multiplex real-time PCR and blood culture for identification of bloodstream pathogens in patients with suspected sepsis. Clin Microbiol Infect. 2009;15(6):544–51.View ArticlePubMedGoogle Scholar
  23. Yanagihara K, Kitagawa Y, Tomonaga M, Tsukasaki K, Kohno S, Seki M, et al. Evaluation of pathogen detection from clinical samples by real-time polymerase chain reaction using a sepsis pathogen DNA detection kit. Crit Care. 2010;14(4):R159.View ArticlePubMedPubMed CentralGoogle Scholar
  24. Dark P, Blackwood B, Gates S, McAuley D, Perkins GD, McMullan R, et al. Accuracy of LightCycler((R)) SeptiFast for the detection and identification of pathogens in the blood of patients with suspected sepsis: a systematic review and meta-analysis. Intensive Care Med. 2015;41(1):21–33.View ArticlePubMedGoogle Scholar
  25. Weinstein MP. Blood culture contamination: persisting problems and partial progress. J Clin Microbiol. 2003;41(6):2275–8.View ArticlePubMedPubMed CentralGoogle Scholar
  26. Weinstein MP, Doern GV. A critical appraisal of the role of the clinical microbiology laboratory in the diagnosis of bloodstream infections. J Clin Microbiol. 2011;49(9 Supplement):S26–9.View ArticlePubMed CentralGoogle Scholar
  27. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.View ArticlePubMedGoogle Scholar
  28. Fernandez-Cruz A, Marin M, Kestler M, Alcala L, Rodriguez-Creixems M, Bouza E. The value of combining blood culture and SeptiFast data for predicting complicated bloodstream infections caused by Gram-positive bacteria or Candida species. J Clin Microbiol. 2013;51(4):1130–6.View ArticlePubMedPubMed CentralGoogle Scholar
  29. Lucignano B, Ranno S, Liesenfeld O, Pizzorno B, Putignani L, Bernaschi P, et al. Multiplex PCR allows rapid and accurate diagnosis of bloodstream infections in newborns and children with suspected sepsis. J Clin Microbiol. 2011;49(6):2252–8.View ArticlePubMedPubMed CentralGoogle Scholar
  30. Chang SS, Hsieh WH, Liu TS, Lee SH, Wang CH, Chou HC, et al. Multiplex PCR system for rapid detection of pathogens in patients with presumed sepsis - a systemic review and meta-analysis. PLoS One. 2013;8(5), e62323.View ArticlePubMedPubMed CentralGoogle Scholar
  31. Arpi M, Bentzon MW, Jensen J, Frederiksen W. Importance of blood volume cultured in the detection of bacteremia. Eur J Clin Microbiol Infect Dis. 1989;8(9):838–42.View ArticlePubMedGoogle Scholar
  32. Jonsson B, Nyberg A, Henning C. Theoretical aspects of detection of bacteraemia as a function of the volume of blood cultured. APMIS. 1993;101(8):595–601.View ArticlePubMedGoogle Scholar
  33. Cockerill 3rd FR, Wilson JW, Vetter EA, Goodman KM, Torgerson CA, Harmsen WS, et al. Optimal testing parameters for blood cultures. Clin Infect Dis. 2004;38(12):1724–30.View ArticlePubMedGoogle Scholar
  34. Lee A, Mirrett S, Reller LB, Weinstein MP. Detection of bloodstream infections in adults: how many blood cultures are needed? J Clin Microbiol. 2007;45(11):3546–8.View ArticlePubMedPubMed CentralGoogle Scholar
  35. Weinstein MP, Towns ML, Quartey SM, Mirrett S, Reimer LG, Parmigiani G, et al. The clinical significance of positive blood cultures in the 1990s: a prospective comprehensive evaluation of the microbiology, epidemiology, and outcome of bacteremia and fungemia in adults. Clin Infect Dis. 1997;24(4):584–602.View ArticlePubMedGoogle Scholar
  36. Auckenthaler R, Hermans PE, Washington 2nd JA. Group G streptococcal bacteremia: clinical study and review of the literature. Rev Infect Dis. 1983;5(2):196–204.View ArticlePubMedGoogle Scholar
  37. Corredoira J, Alonso MP, Coira A, Varela J. Association between Streptococcus infantarius (formerly S. bovis II/1) bacteremia and noncolonic cancer. J Clin Microbiol. 2008;46(4):1570.View ArticlePubMedPubMed CentralGoogle Scholar
  38. Alverdy JC, Aoys E, Moss GS. Total parenteral nutrition promotes bacterial translocation from the gut. Surgery. 1988;104(2):185–90.PubMedGoogle Scholar

Copyright

© Ljungström et al.; licensee BioMed Central. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement

BMC Infectious Diseases

ISSN: 1471-2334

Contact us