Infection Probability Score, APACHE II and KARNOFSKY scoring systems as predictors of bloodstream infection onset in hematology-oncology patients

Bloodstream infections are an important cause of morbidity and mortality in immunocompromised populations [1]. Patients with hematologic malignancies such as acute leukemia, malignant lymphoma, and multiple myeloma are at increased risk for healthcare-associated bloodstream infections because of the intensive cytotoxic chemotherapy, which often renders them pancytopenic for long periods of time [2]. Several clinical trials showed improved survival with the use of immediate empirical broad-spectrum antimicrobial therapy at onset of fever, which has become the standard procedure [3, 4]. Despite such an immediate approach, Bloodstream Infections (BSIs) in neutropenic patients often cause considerable morbidity and mortality. The high mortality is partly related to BSIs caused by microorganisms resistant to broad-spectrum antibiotics [5].

Laboratory-based strategies for the surveillance of bloodstream infections in the hematology department should be reported periodically, and used for longitudinal assessment [6]. Such data can then inform decisions about screening, prophylaxis and empirical therapy. If clinical data are also collected for surveillance purposes (e.g presence of CVC, risk factors for the development of bacteraemia), an understanding of the required resources and prevention strategies should also be available [7]. In patients with suspected bloodstream infections and new skin lesions, urgent biopsy of necrotizing hematologic lesions should be performed to aid in the diagnosis of disseminated mould infection. Non-culture based diagnosis techniques have been used for the early detection of fungaemia in hematology patients but are not recommended for routine use in the clinical practice [8]. In addition, the benefit of prophylaxis for the reduction of disease incidence must be weighed against the potential for the selection of resistant isolates [9]. Implementation of infection control practices is required, particularly for the control of transmission of multi-resistant organisms [10]. Surveillance may be justified in case of hospital outbreaks or periods of increasing endemicity, to facilitate the isolation and barrier precautions for the patients who are colonized or infected with multi-resistant organisms. For clusters or outbreaks of hospital infections, appropriate investigation, including environmental sampling, clinical screening and risk factor analysis may be required [11].

In Greece, the data concerning BSIs occurring in haematology/oncology units are sparse. Therefore, the surveillance and early identification of patients at high risk for developing BSIs might be useful for the development of preventive measures. The objective of this study was to assess the predictive power of three systems: Infection Probability Score (IPS), APACHE II and Karnofsky score for the onset of BSIs in hematology/oncology patients, which will provide a basis to design more effective guidelines for the prevention and treatment of these infections.

A retrospective review of all records during a seven-month period (1/4/2007-30/10/2007) was conducted in the hematology-oncology unit of a general hospital in Athens, Greece. All patients who were hospitalized for more than 48 hours in the hematology-oncology unit were included in the analysis. The surveillance of nosocomial BSI was performed by the physician in charge of the patient and a specifically trained nurse. It included a daily clinical examination of the patients and daily reviewing of the patient's medical records, Kardex data, temperature charts, information from the nursing and the medical staff, and all the microbiological data of a positive blood result.

Data were collected by using an anonymous standardized case-record form. Patient data consisted of I) demographic characteristics: age, length of stay, outcome (survivors or non-survivors), II) risk factors: underlying malignancy, underlying diseases: Infection on admission, diabetes mellitus, short or long term presence of an indwelling central venous catheter (CVC), total parenteral nutrition, duration of neutropenia, exposure to chemotherapy, antibiotics or corticosteroid therapy and prior surgical procedure.

The diagnosis and the source of blood-stream infection were determined by the physician in charge and a specifically trained nurse, and were based on objective clinical evidence, microbiological data, clinical judgment and the definitions proposed by CDC. Blood cultures were performed in aerobic and anaerobic bottles and incubated in an automatic system. Bacteria were identified using standard microbiological methods. Antimicrobial therapy was given and adapted according to the susceptibility testing by the physician in charge of the patient. Patients were followed daily for BSI from admission until discharge or death. Patients were diagnosed with BSI on the date of the first positive result. The diagnosis of BSIs was based on definitions proposed by the Centers for Disease Control and Prevention [12].

As it is displayed in Table 2, the mean APACHE II score did not differ statistically (p = 0.876) between those with a BSI and those without BSI. On the contrary IPS score was significantly (p = 0.010) higher in the patients with a BSI (11.06 ± 5.10) as opposed to those without BSI (6.59 ± 6.41).

The patients who developed a BSI were mainly females (p = 0.004), with twofold higher time for mean length of hospital stay (p < 0.001), with fourfold higher time for mean length of neutropenia (p < 0.001), with neutropenia < 500 (p < 0.001), suffered mainly from acute myeloid leukemia (p < 0.001), had been exposed to antibiotics (p = 0.045) and chemotherapy (p = 0.023), had a surgery (p = 0.048) and a Hickman catheter (p = 0.025) as compared to patients without BSI (Table 2).

The cumulative incidence of BSI was 16.7% and the incidence rate of BSI was 7.74 per 1,000 patient-days or 21.99 per 1,000 patient-days at risk. The most common isolates were gram-negative (44.4%) and gram positive (44.4%) microorganisms.

A retrospective study was conducted in order to examine the predictive power of three different scoring systems for BSI in a hematological unit. The literature regarding predictive power of IPS in hematology/oncology patients is sparse. Most of the information about the epidemiology of BSIs and outcome is extrapolated from studies of hospitalized patients in general hospitals or from studies of patients in University hospitals [18] or, more specifically, from studies of neutropenic cancer patients [19]. In our study, the incidence density of BSIs (21.99 per 1,000 patient-days at risk) was higher than that reported by previous studies (11.2 per 1000 patient-days at risk) [20]. Furthermore in the current study the crude mortality (5.9%) was lower than that reported elsewhere [21]. One of the major problems associated with comparison studies, is the difficulty in interpretation caused by variability in study designs and efficacy or outcome measures [22]. Furthermore, many patients with neutropenia have complex medical profiles, leading to increased physician concern and a tendency to modify regimens during the treatment course of febrile episodes. Such modifications generally are made in a setting of inadequate information or lack of definitive diagnosis. It has been estimated that empiric regimens may be modified in 40% to 60% of cases [23].

Furthermore, we found that the most common isolates were gram-negative (44.4%) and gram positive (44.4%) microorganisms. Our findings are very similar to those reported in other studies [24]. It is noteworthy that a considerable shift in the spectrum of pathogens isolated from blood cultures of febrile neutropenic cancer patients in the USA has emerged since 1995, with Gram-positive cocci increasing from 62% to 76% of isolates [21], Gram-negative bacilli declining from 21.5% to 14% and fungi declining from 15 to 8%. Based on consecutive clinical trials conducted by the European Organization on the Research and treatment of cancer (EORTC) between 1973 and 2000, a shift toward the predominance of Cram-positive bacteria has also been reported however, during the most recent time period (1998 - 2000), Gram- positive and Gram-negative isolates have been involved in the same magnitude [24].

A number of epidemiological factors may have contributed to this changing pattern. Firstly, this period corresponds to the uptake of widespread empiric antibiotic therapy for febrile neutropenia especially fluroquinolones and third/fourth generation cephalosporines), with resulting selection pressure for gram-positive bacteria [25]. Secondly, the use of more intensive treatments with more severe oral mucositis may provide a frequent portal of entry for gram-positive organisms. Thirdly, increased utility of medium to long-term venous access devises for patients with malignancy may increase gram-positive blood stream infections (particularly staphylococcal infections [26]. Finally, local infection control practices may impact upon the number of infections and spectrum of causative organisms. Further investigation of the data of patients with BSIs showed that most patients had received third/fourth generation cephalosporines (53%) and quinolones (35.3%), and they had central venous (11%) and Hickman catheters. Our findings highlight that the ongoing co-operation between haematologists, oncologists and infectious disease specialists is important to detect trends in epidemiology, which can be used to design empirical antibiotic regimens and guide infection control policies [27].

The mean IPS score was higher in patients with a BSI. This is a common finding in the two other researches supporting the discriminative adequacy of the tool [13, 28]. The two previous studies have confirmed the predictive power of the IPS for the onset of a Healthcare Associated Infection (HCAI). The current study extends the use of IPS as a predictor of the onset of a BSI. Additionally, the IPS separated infected from non-infected patients already on the first day of evaluation [28]. This finding enables the therapeutic team to early detect the infected patients, as well as to avoid the administration of unnecessary antibiotics to the patients that are unlikely considered to be infected. Further studies with a bigger sample would be useful to give more evidence to this argument.

Between the three different prognostic scoring systems, IPS had the best sensitivity in predicting BSI. It is worth noting that IPS as a risk factor for BSIs in cancer patients has never being studied before. A previous study has used IPS to predict the need for mechanical ventilation and the duration of mechanical ventilation [29] and for the prediction of HCAI in the ICU patients [28]. In a previous study [28] the cutoff point for the prediction of a HAI was 14 with a positive predictive value of 53.6% and a negative predictive value of 89.5%. In our study the cutoff point for the prediction of a BSI was 10 with a positive predictive value of 37% and a negative predictive value of 92.5%. The patients were considered as unlikely to be infected with a BSI if they had a score < 10 points. An IPS score >10 represents an argument against a BSI onset in oncology-hematology patients and should be considered as a complementary tool for the early detection of a BSI. In the present study the best cut-off value of IPS for the prediction of a BSI was 10 as opposed to 14 that has been previously reported from Martini et al. [28] and Peres-Bota [13]. One possible explanation is that the present research has been conducted in a sample of hematology/oncology patients who had a different nosological profile compared to the ICU patients. Furthermore Martini et al. [28] have used a priori the cut-off value 14 without testing its sensitivity and specificity as opposed to our study that has used ROC analysis to find the best cut-off value. A further research is needed to compare IPS scores between several categories of patients. A multi-centered study would be useful to test the reliability of the tool in patients with a similar pathology.

The AUC value of IPS is associated with a good test as it is above 0.70 with means that the probability that the patients will be correctly classified as an infected person is 72%. It may be considered that a bigger sample of bloodstream infected person would help us to make safer conclusions. Furthermore it could be argued that the tool is more sensitive in predicting the onset of a HAI compared with the onset of a BSI. In conclusion the calculation of the IPS score is simple and the variables used can be obtained routinely, without additional costs. Additionally it is easy to be used from the clinicians.

To reduce the risk of BSIs and associated mortality in the hematology population, a number of strategies may be implemented including the routine use of IPS. Early identification of a changing spectrum and antimicrobial sensitivity of isolates should always be monitored. Frequently, a multi-disciplinary approach is recommended, to facilitate certain interventions such as typing of isolates, ward cleaning and structural modification of clinical areas. Guidelines for empirical antibiotic therapy for febrile neutropenia must be based upon the risk of infection in specific hematology patients and the local epidemiology and susceptibility of infecting isolates.