A composite score combining procalcitonin, C-reactive protein and temperature has a high positive predictive value for the diagnosis of intensive care-acquired infections

Early identification of nosocomial infections is crucial to therapeutic decision-making, allowing both early antimicrobial therapy and source eradication which determine outcome [1]. However, early discrimination between sepsis due to nosocomial infection (NI) and systemic inflammatory response syndrome (SIRS) is challenging in clinical practice. Indeed, in early sepsis, clinical signs related to the focus of infection may be minimal or obscured by non-specific symptoms of SIRS common to various non-infectious inflammatory conditions. Definitive diagnosis of infection is defined as the identification of pathogens in a biological sample from a normally sterile tissue or fluid [2]. However, this definition still relies on clinical suspicion of infection since colonizing pathogens may be present without leading to the pathogen-related damage which defines infection [2]. The reliance of diagnosis on clinical suspicion rather than identification of pathogens is particularly true for nosocomial infection which occurs in hospitalized patients, increasingly colonized by various pathogens over time. This absence of any “gold-standard” of infection (with some exceptions such as bacterial meningitis, fungemia etc.…) has resulted in a decades-long quest for biomarkers of infection capable of assisting or even redefining the diagnosis of infection.

In the ICU, early, sensitive, and specific laboratory tests would be crucial to guide clinicians in identifying infected patients who could benefit from prompt empirical antibiotic therapy and to avoid unnecessary antibiotic treatments.

The aim of our prospective cohort study was to test the hypothesis that inflammatory biomarkers procalcitonine (PCT) and C-reactive protein (CRP), in addition to routine biomarkers such as white blood-cell count (WBC) and clinical markers such as fever, could assist in the early identification of patients with ICU-acquired nosocomial infection.

During the study period, 267 patients were admitted to our ICU. One hundred and twenty-six patients were excluded (24 obstetrical patients, 8 patients under 18 years of age, 81 patients who stayed less than 4 days, and 4 patients who had treatment limited or withdrawn). One hundred and forty-one patients were included in the study, 116 non-infected among which 88 were non-infected and discharged alive from the ICU. Twenty-five patients were diagnosed with infections acquired in the ICU.

Age, sex distribution and severity of illness upon ICU admission were not statistically different between patients with ICU-acquired infection (n = 25) and non-infected (n = 88) (Table 1). Concerning ICU-acquired infections, 11 BSI, 9 VAP, 2 catheter-related infections and 3 fungemia were recorded. Nosocomial infection occurred 11 days (8–14) after ICU admission. The median number of days without antibiotics before nosocomial infection diagnosis was 5 days (3.5-5.5) and the median of duration of mechanical ventilation and length of ICU stay were significantly higher in patients with ICU-acquired infection compared to non-infected patients: 25 days (15–33) vs. 10 days (5–14), p < 0.001; and 29 days (22–39) vs. 12 days (7–18), p < 0.0001. SIRS criteria were present at D0 in 100% of infected patients vs. 74% of non-infected patients (p = 0.01). The median of SOFA score was significantly higher in infected compared to non-infected patients: 8 (6–12) vs. 1 (0–3.5) at D0 and 7 (5–9) vs. 3 (2–6) at D-4, p < 0.001. Time-dependent analysis of both PCT and CRP during the 4 days prior to diagnosis of nosocomial infection showed a significant increase in infected patients whereas PCT and CRP levels decreased over the time in the non-infected group (Figure 1). PCT and CRP D0 median concentrations were both significantly increased in the infected group compared non-infected group, 3.6 ng/mL (0.92-25) vs. 0.2 ng/mL (0.1-0.9) and 173 mg/L (126–188) vs. 57 mg/L (31–101), p < 0.001, respectively. A similar result was obtained for maximal daily temperature: the median value of maximal daily temperature at D0 was significantly increased in the infected group compared to the non-infected one: 39°C (38.2-39.5) versus 37.8°C (37.5–38.1), p < 0.001. WBC values from D-4 to D0 were not significantly different between infected and non-infected patients. Dynamic data on PCT, CRP, WBC and temperature from D-4 to D0 are shown in Figure 1.

Characteristics of patient population	NI - (88)	NI + (25)	p
Age (years)	55 (45–65)	55 (47–59)	0.34
Sex (male/female)	48/40	17/8	0.38
SAPS II score at admission	45 (31–55)	50 (38–57)	0.43
Admission diagnosis, n (%)			0.07
Acute respiratory failure	26 (30)	5 (20)
Neurologic failure	22 (25)	5 (20)
Cardiovascular failure	16 (18)	3 (12)
Polytrauma	10 (11)	6 (24)
Post operative	3 (3)	5 (20)
Miscellaneous	11 (13)	1 (4)
Site of infection, n (%)
Bacteremia		11 (44)
Pneumonia		9 (36)
Catheter related infection		2 (8)
Candidemia		3 (12)
Delay of NI, days		11 (8–14)
Number of days without antibiotics before NI		5 (3.5-5.5)
Central venous catheter, n (%)	60 (68)	25 (100)	0.005
Duration of central venous catheter, days	11 (8–17)	22 (14–35)	0.001
MV, n (%)	58 (66)	24 (96)	0.02
Duration of MV, days	10 (5–14)	25 (15–33)	0.0007
Length of ICU stay, days	12 (7–18)	29 (22–39)	< 0.0001

Data are presented as n (%) and median values (lower and upper quartiles). NI: Nosocomial Infection. SAPS: Simplified Acute Physiologic Score. MV: mechanical ventilation. ICU: Intensive Care Unit.

ROC curves were plotted to compare the detection of nosocomial infection by PCT, CRP, WBC, and temperature at D0. The AUC of D0 WBC was poor of only 0.62. However the AUC for D0 temperature was 0.88 and temperature at D0 > 38.6°C resulted in a sensitivity/specificity of 76%/94%. AUCs for PCT and CRP D0 were 0.84 and 0.88 respectively, and were not significantly different (p = 0.67) indicating that the tests globally performed similarly in discriminating nosocomial infection. However, using the best cut-offs for PCT and CRP D0 values which were 1.86 ng/mL and 88 mg/L respectively, the resulting sensitivity/specificity were inverted: low specificity/high sensitivity of 68%/91% for PCT and high sensitivity/low specificity of 92%/70% for CRP. The best cut-off values and AUCs for all clinical and biological makers are shown in Table 4 and ROC curves are represented in Figure 2. The combination of the three markers with AUCs > 0,8 over their respective optimal thresholds, D0 PCT > 1.86 ng/mL, D0 CRP > 88 mg/L and D0 temperature > 38°C, was present in 56% of infected patients compared to 1% of non-infected patients. A composite marker was therefore constructed, combining PCT, CRP levels and temperature at D0 (score = 0.068 × D0 PCT + 0.005 × D0 CRP + 0.7 × Temperature D0). The AUC for this composite score was 0.90, the best cut-off for the composite score was 28, resulting in a sensitivity/specificity of 80%/97%. Similarly to D0 values, although AUCs for ΔCRP and ΔPCT were not statistically different (0,83 and 0,85), ΔPCT, with a > 0.49 ng/mL threshold resulted in a low sensitivity/high specificity of 68%/94% while ΔCRP, with a threshold > 12 mg/L, resulted in high sensitivity/low specificity of 92%/71% for identifying nosocomial infection.

	AUC	Cut-off level	Sensitivity (%)	Specificity (%)	PPV	NPV
PCT D0	0.84	1.86 ng/mL	68	91	68	91
CRP D0	0.88	88 mg/L	92	70	47	97
WBC D0	0.62	12120/mm3	64	68	36	87
Temperature D0	0.88	38.6°C	76	94	79	94
Composite score D0	0.90	28	80	97	87	94
ΔPCT	0.83	0.49 ng/mL	68	94	77	91
ΔCRP	0.85	12 mg/L	92	71	48	97

Data are presented as % unless otherwise stated. AUC: area under the receiver-operating-characteristic curve; NPV: negative predictive value; PPV: positive predictive value.

By studying simple and routinely used clinical and biological markers of infection in patients with confirmed nosocomial infection compared to non-infected ICU patients we determined that three parameters, temperature > 38.6°C, PCT > 1.86 ng/mL, and CRP > 88 mg/L, could perform well in discriminating infected from non-infected patients (AUCs of 0.88, 0.84, and 0.88 respectively). The complementary sensitivity/specificity profiles of each marker (76%/94% for fever, 68%/91% for PCT, and 92%/70% for CRP) allowed the construction of a composite score (score = 0.068 × D0 PCT + 0.005 × D0 CRP + 0.7 × temperature) more discriminating and highly specific than each single component (AUC of 0.90 and sensitivity of 97%).

Given the absence of any gold standard of infection we used the same methodology as Povoa et al. [7] and distinguished between patients with a confirmed diagnosis of noscomial infection, with all the limitations inherent to diagnosis of infection in the ICU, and patients discharged from the ICU without being treated by antimicrobials and therefore very unlikely to be infected.

Although one of the most frequently measured parameters in the ICU setting and non invasive, body temperature remains a poor indicator of infection [9]. Temperature can be influenced by a number of non-infectious factors, such as non-infectious causes of fever and antipyretic therapy [10]. Nevertheless, in the present study, temperature appeared to perform reasonably well for identifying nosocomial infection, with an AUC of 0.88. The best temperature cut-off value was 38.6°C, resulting in a sensitivity-specificity of 76%/94%.

Our data support the view of some authors that leucocyte count has little value in discriminating patients with nosocomial infection [7]. In our study, AUC of WBC was 0.62, indicating that WBC was close to the line of non discrimination.

PCT is secreted as part of the systemic inflammatory response to infection and serum values are greatly based on the type and severity of infection. Interpretation of the literature is further complicated by frequent discrepancies or variations in the choice of the cut-off value of PCT, etiologies of infection, severity of infection, and study populations [11, 12]. Serum values of PCT vary greatly based on the type and severity of infection. The highest PCT concentrations have been reported in patients with septic shock, and patients with severe sepsis had significantly higher PCT levels than patients with sepsis or SIRS [13].

In the present study, we used an ultrasensitive assay for PCT, capable of measuring low levels to identify even “subclinical” inflammatory states before the development of clinically evident sepsis. The best cut-off value of PCT for identifying ICU-acquired infection was 1.86 ng/mL, with high specificity (91%) but low sensitivity (68%).

Few studies have analysed the behaviour of PCT in nosocomial ICU-acquired infection. In cardiac surgery patients, PCT measurement was found a reliable marker for diagnosis of infection: with a cut-off of 1 ng/mL allowing a sensitivity of 85% and a specificity of 95% [14]. In another study, PCT was useful in the diagnosis of VAP with a cuff-off value of 3.9 ng/mL allowing a specificity of 100% at the cost of a sensitivity of 41% [15].

In a recent study assessing PCT monitoring in the early diagnosis of nosocomial infection, PCT at D0 was the best predictor of proven infection. A cut-off value of 0.44 ng/mL provided sensitivity and specificity of 65.2% and 83%, respectively for discriminating patients with proven nosocomial infection from clinically suspected but non-proven nosocomial infection [16].

Several reports suggested that PCT should replace CRP as a marker of infection in the ICU setting [17, 18]. In certain situations, especially to differentiate bacteremic from non-bacteremic infections, PCT was reported to be superior to CRP [19]. A cut-off value of 0.4 ng/mL was associated with a negative predictive value of 98%. However, well-designed studies have shown that PCT is neither a better nor an earlier diagnostic marker of infection than CRP [20–22].

In a previous meta-analysis performed by Tang et al., PCT could not reliably differentiate sepsis from other non-infectious causes of systemic inflammatory response syndrome in critically ill adult patients [23]. On the other hand, in another review, PCT concentration was found to be better than CRP for diagnosis of bacterial infection [12]. However, this review included studies across a wide range of age group, clinical setting and spectrum diseases: 46% were paediatric patients and 57% did not have SIRS. Additionally, in some clinical situations of infectious origin commonly found in ICU, PCT can be normal or even undetectable early course of infections [24], localised infections [25], or subacute endocarditis [19, 26, 27].

CRP is an acute-phase protein, member of the pentraxin family of proteins, whose hepatic synthesis is triggered by cytokine release due to any cause of inflammation, infectious or not. In the present study, CRP D0 had the highest AUC (0.88) and a cut-off of 88 mg/L had a sensitivity of 92% and a specificity of 70% to identify patients with ICU-acquired infection. Povoa et al. studied the role of CRP to detect infections in critically ill patients [28]. In that study, the combination of CRP > 87 mg/L and body temperature > 38.2°C was associated with infection diagnosis with a specificity of 100%. A study using the methodology we based our study upon, found that daily CRP monitoring could be used as a marker of infection prediction [7]. Patients presenting maximum daily CRP variation > 4.1 mg/dL and a CRP level > 87 mg/L had an 88% risk of infection.

As all preceding studies we have confirmed that no single parameter or biomarker can reliably assist the clinician in diagnosing infection in the ICU. This is most probably due to: the lack of any possible gold standard for the diagnosis of infection and the extreme heterogeneity of infection in the ICU as to causal pathogen, underlying diseases, host-response, therapy, evolution and outcome. Facing these problems, our subsequent combination of diagnostic makers appears a useful approach to improve the accuracy in diagnosing nosocomial infection in ICU patients. Our results showed that combining PCT, CRP and temperature D0 was discriminant (highest AUC = 0.90) and highly specific (specificity of 97%). We found in our study a complementarity of CRP and PCT, with low specificity/high sensitivity for PCT and high sensitivity/low specificity for CRP. Such a combined clinical and multibiomarker approach for prediction has been proposed in another highly heterogenous complex disease in the ICU: adult respiratory distress syndrome (ARDS). Ware et al., studying the prediction of mortality in the ARDS cohort from the NHLBI studies, found that a combination of biomarkers and clinical predictors was superior to clinical predictors or biomarkers alone [29].

Some limitations of the present investigation should be noted. Our findings are based on a single centre study, one should be cautious in or extrapolating these data. Our findings cannot be generalised to specific diseases (pancreatitis, burns) or settings (cardiovascular surgical patients, neonatal/paediatric patients). Due to our study design, our findings might be only applicable to patients with late-onset nosocomial infection. Likewise, our focus on late-onset nosocomial infection led to a small number (17%) of documented infections which could also be a limitation.

It must also be acknowledged that CRP at D0 had a negative predictive value higher than our composite score (97% vs. 94%), showing that low CRP, under the threshold of 88 mg/L could assist clinicians in eliminating the diagnosis of nosocomial infection. However, the composite score had by far the highest positive predictive value (87% vs. 47%), suggesting that it could best be used in encouraging clinicians to initiate antimicrobial therapy when faced with a suspected diagnosis of nosocomial infection and a CRP over 88 mg/L.

The sequential measurements of serum PCT and CRP might be reliable and complementary biomarkers in early identification of ICU-acquired nosocomial infection. Combining CRP and PCT levels with temperature is an original approach which may increase diagnostic specificity. More prospective and large-scale studies are required to define the best approach.