Accuracy of a score predicting the presence of an atypical pathogen in hospitalized patients with moderately severe community-acquired pneumonia
BMC Infectious Diseases volume 22, Article number: 424 (2022)
Atypical pathogens (AP), present in some patients with community-acquired pneumonia (CAP), are intrinsically resistant to betalactam drugs, the mainstay of empirical antibiotic treatment. Adding antibiotic coverage for AP increases the risk of adverse effects and antimicrobial selection pressure, while withholding such coverage may worsen the prognosis if an AP is causative. A clinical model predicting the presence of AP would allow targeting atypical coverage for patients most likely to benefit.
This is a secondary analysis of a multicentric randomized controlled trial that included 580 adults patients hospitalized for CAP. A predictive score was built using independent predictive factors for AP identified through multivariate analysis. Accuracy of the score was assessed using area under the receiver operating curve (AUROC), sensitivity, and specificity.
Prevalence of AP was 5.3%. Age < 75 years (OR 2.7, 95% CI 1.2–6.2), heart failure (OR 2.6, 95% CI 1.1–6.1), absence of chest pain (OR 3.0, 95% CI 1.1–8.2), natremia < 135 mmol/L (OR 3.0, 95% CI 1.4–6.6) and contracting the disease in autumn (OR 2.7, 95% CI 1.3–5.9) were independently associated with AP. A predictive score using these factors had an AUROC of 0.78 (95% CI 0.71–0.85). A score of 0 or 1 (present in 33% of patients) had 100% sensitivity and 35% specificity.
Use of a score built on easily obtained clinical and laboratory data would allow safe withholding of atypical antibiotic coverage in a significant number of patients, with an expected positive impact on bacterial resistance and drug adverse effects.
Trial registration: NCT00818610.
Beta lactam drugs are the mainstay of empirical antibiotic treatment for community-acquired pneumonia (CAP). Beta lactams provide coverage for Streptococcus pneumoniae, the most frequently identified bacterial pathogen, and for other typical pathogens (e.g. Hemophilus influenzae; Moraxella catarrhalis) [1,2,3]. However other causative agents named atypical pathogens such as Mycoplasma pneumoniae, Chlamydophila pneumoniae and Legionella pneumophila are intrinsically resistant to beta lactam drugs . Atypical pathogens can usually be treated with macrolides, fluoroquinolones, or doxycycline. S.pneumoniae and other typical pathogens cannot be reliably discriminated from atypical pathogens on clinical presentation.  The overall prevalence of CAP caused by an atypical pathogen among adults is 10–20%, with wide variations between studies [4, 6]. The two more frequent atypical pathogens are L. pneumophila and M. pneumoniae, the prevalence of C. pneumoniae being less than 1% in recent studies [7, 8]. While M. pneumoniae causes mostly a mild and self-limiting disease, L. pneumophila can cause severe CAP [9, 10].
A microbiological diagnosis is usually not available immediately upon patient’s admission and the antimicrobial therapy is therefore begun empirically. Moreover, with more than half of all pneumonia not having a proven microbiological aetiology, the full course of the antibiotic treatment often remains empirical [3, 11].
Though current treatment guidelines recommend empiric coverage of both typical and atypical pathogens for severe CAP, adding empiric coverage for atypical pathogens in moderately severe CAP, i.e. patients hospitalized for pneumonia in a non-critical care setting, is left to physician’s judgement. [12,13,14] Adding coverage for atypical pathogens implies combination therapy of a beta lactam with a macrolide or doxycycline, or monotherapy with a respiratory fluoroquinolone.
Thus, there is a dilemma between covering atypical pathogens in all patients with moderately severe CAP to avoid the potential severe outcome of untreated L. pneumophila (and to a lesser extent M. pneumoniae) and to shorten symptom duration, and unnecessarily broadening the antibiotic coverage, thus increasing the risk of adverse effects and promoting bacterial resistance. A simple prediction model aiming to exclude the presence of atypical pathogens based on demographic and clinical information routinely obtained upon emergency room admission would allow targeting atypical coverage towards patients most likely to benefit. While a few scores predicting the presence of L. pneumophila have been described, none have been published to our knowledge to predict the presence of M. pneumoniae in adults. We aimed to derive a score predicting the presence of L.pneumophila or M.pneumoniae from a prospective cohort of patients hospitalized for CAP.
Population and tests
We conducted a secondary analysis of a Swiss multicentric randomized controlled trial testing two empiric antimicrobial treatment strategies in adult patients hospitalized for moderately severe CAP from 2009 to 2013 (NCT00818610) . The study was approved by the competent ethics committee and conducted in 6 acute care hospitals, including two university hospitals from 2009 to 2013. Included patients had two or more symptoms or signs of pneumonia and a new lung infiltrate demonstrated on conventional chest radiography. Patients were excluded if they had severe immunosuppression, were hospitalized during the last 14 days, lived in a nursing home, had been treated with any antibiotic in the last 48 h or had severe pneumonia (Pneumonia Severity Index (PSI) category V or direct admission to the intensive care unit).
Upon arrival, two pairs of blood cultures, a urine sample for the detection of antigens for L. pneumophila, and an oropharyngeal swab for the detection of C. pneumoniae and M. pneumoniae by polymerase chain reaction (PCR) were obtained for all patients. Urine samples were also tested for S.pneumoniae antigen detection in a majority of patients. Sputum was obtained for culture in all patients able to expectorate, and pleural fluid was sampled for culture according to recommendations. Use of specific culture media for Legionella sp or PCR testing of sputum samples was done upon physician request. PCR for respiratory viruses on either sputum or oropharyngeal swab could be performed if requested by the physician in charge of the patient but were not systematic. Demographic data (including the presence of comorbidities), vital signs, the results of routinely obtained blood tests and of chest X-rays were collected prospectively according to the protocol.
An atypical pathogen (AP) was considered the causative agent of pneumonia if the patient had a positive culture or PCR or urinary antigen detection for L. pneumophila; or if the oropharyngeal swab was positive for M. pneumoniae in the absence of another detected bacterial pathogen. Patients with another aetiology or no identified pathogen formed the non-atypical pathogen group (NAP).
All patients were included in the analysis. We used frequencies, percentage, mean with standard deviations and median with interquartile range for descriptive purposes. Characteristics of AP and NAP patients were compared using Mann–Whitney U test for continuous variables, and Fisher's exact test or Chi-square test for categorical variables, as appropriate.
Factors associated with AP with a p-value < 0.1 were entered in a multivariate logistic regression model, using backward elimination. Because the number of AP patients was 31, a maximum of 6 variables were accepted in the final model . The baseline dataset included 580 patients. No imputation was made for missing values (complete case analysis). Goodness-of-Fit was assessed with Hosmer and Lemeshow Test.
A predictive score was elaborated using the independent predictive factors identified in the multivariate analysis. The continuous variables were dichotomized at the best discriminative cut-off selected using the receiver operating characteristic (ROC) curve and Youden Index.
Each predictive factor was assigned a number of points weighted according to Beta coefficient, and the final score was computed by summing the points of all factors present in an individual patient. A ROC curve for the score was built. For each possible cut-off, the sensitivity, specificity, positive and negative predictive value, positive and negative likelihood ratio, and diagnostic odds-ratio were computed . Because the main aim of this score was to exclude the presence of an atypical pathogen, the threshold with a high sensitivity and negative predictive value was sought.
The study sample was determined by the design of the original study. All p-values are two-tailed and considered significant for p < 0.05. Data were analysed using IBM SPSS Statistics for Windows, Version 25.0. Armonk, NY: IBM Corp. Released 2017.
Five hundred eighty patients were included in the original cohort. Median age was 76 years (IQR 64–84), and median PSI score was 85 (IQR 68–103). An oropharyngeal swab for detection of M. pneumoniae or C. pneumoniae by PCR was available in 564 patients (97%), and urine was tested for the presence of L. pneumophila antigen in 545 (94%). Atypical pathogens were diagnosed in 31 patients: 16 were L. pneumophila and 15 M. pneumoniae. No patient was diagnosed with C. pneumoniae. The NAP group was composed of 549 patients with 149 having a proven aetiology (88 S. pneumoniae and 61 other bacteria) and 400 with unknown aetiology after all microbiological investigations, including a negative oropharyngeal swab for M. pneumoniae and urinary antigen testing for L. pneumophila.
Univariate comparisons between AP and NAP are displayed in Table 1. There was a higher temperature (p = 0.03) and a trend towards a younger age in the AP group (p = 0.09). Absence of chest pain (p = 0.05) and presence of acute confusion (p < 0.01) were more frequent in the AP group, and there was a trend towards a higher prevalence of non-productive cough in the AP group.
A lower natremia was significantly associated with AP (p < 0.01). CRP was significantly higher in the AP group (p < 0.01). The leukocytes count tended to be lower in the AP group (p = 0.09).
Other biomarkers such as urea, glucose, hematocrit, procalcitonin and platelet count, or presence of a pleural effusion on chest X-rays, did not significantly differ between groups.
Heart failure was significantly more prevalent in the AP group (p = 0.03). All other comorbidities such as chronic obstructive pulmonary disease (COPD), chronic liver disease, chronic renal disease and active cancer did not significantly differ between the aetiological groups, nor did the number of individual comorbidities, alcohol abuse, or previous antibiotic use.
When looking at the seasonal distribution of the different aetiologies, the atypical pathogens were more prevalent in autumn (p < 0.01).
Predictive model specification
Nine variables differed between the AP and NAP groups with a p < 0.1. We excluded CRP because it was only available in 230 patients, and confusion, because less than 10% of all patients presented this symptom. Therefore, 7 variables were entered in the multivariate model: age, heart failure, chest pain, temperature, inclusion in autumn, natremia and leucocytes count. Temperature and leucocytes count were dismissed by the backward selection, leaving 5 variables in the final model with a confirmed goodness-of-fit (p = 0.30 by Hosmer and Lemeshow Test) (Table 2). Two patients were excluded by the procedure due to an incomplete data set.
Both the presence of heart failure (p = 0.02) and contracting pneumonia during autumnal months (p = 0.01) were positive predictive factors for the presence of atypical pathogens. The presence of chest pain (p = 0.01), advanced age (p < 0.01) and higher natremia (p = 0.01) were independent negative predictive factors.
Using the Youden Index, the optimal cut-off were 75 years for age and 135 mmol/L for natremia. After dichotomization of the two variables, all variables remained independent predictive factors in multivariate analysis.
Because the five independent predictive factors can be easily obtained at admission, they were incorporated in a predictive score. Beta coefficients being all close to one, the same weight was allocated to all factors, and the score equals the number of factors present, for a total ranging between zero and five. The mnemonic “CASH-75” can be used to recall the factors composing the score (Table 3). The higher the score, the more probable the presence of an atypical bacteria (Table 4).
PPV positive predictive value, NPV negative predictive value, LR + positive likelihood ratio, LR− negative likelihood ratio, DOR diagnostic odds-ratio
With a cut-off set at < 2, a negative test would predict the absence of an atypical pathogen with a sensitivity of 100% and a negative predictive value of 100%. With a cut-off of < 3, the specificity increases to 73%, the sensitivity decreases to 70%, but the negative predictive value remains high at 98%. The cut-off of < 3 has the highest diagnostic odds-ratio.
We found that heart failure, absence of chest pain, contracting the disease in autumn, lower natremia and younger age were all independently associated with an atypical aetiology of pneumonia in hospitalized, adult, immunocompetent patients with moderately severe CAP.
A younger age, a higher body temperature and a lower leukocytes count have been associated with the presence of an atypical pathogen in previous studies . Hyponatremia [19,20,21,22,23,24,25,26], absence of chest pain [23, 24, 27, 28], and contracting the disease in summer or autumn [29,30,31] are well-described predicting factors for Legionella sp infection.
Chronic heart failure as a risk factor for AP was an unexpected finding. Heart failure has been associated with a significantly lower risk of Legionella sp infection in some, [20, 25] but not all studies. [32, 33] The relations between pneumonia and heart failure are complex and multidirectional. Heart failure is a known risk factor for pneumonia, and pneumonia frequently triggers acute heart failure and other cardiovascular events. Whether the observed association between chronic heart failure and increased risk of AP is causal or a chance finding should be investigated in other populations.
Confusion was significantly associated with the presence of an atypical pathogen in univariate, as extensively described in other studies [22, 34, 35]. We chose to exclude confusion form the multivariate analysis because its prevalence was lower in our population than in observational studies, probably because our patients were included in an interventional trial and had to sign an informed consent form. This low incidence meant that the impact of confusion on the multivariate model was expected to be low.
With an AUC of 0.78 (95% CI = 0.71–0.85), the accuracy of the CASH-75 score is comparable with other scores used for predicting the aetiology of pneumonia. The Legionella score proposed by Fiumefreddo et al. has an AUC of 0.86 in the derivation study and of 0.73 and 0.91 in validation studies [25, 36]. Unfortunately, we could not attempt to validate this score in our population, because LDH and C-reactive protein (two of its 6 criteria) were not measured in all patients. The Winthrop-University Hospital (WUH) criteria by Cunha predicts the presence of L. pneumophila with 21 different clinical features and a weighted point system. While the original study does not state accuracy, a validation study has described an AUC between 0.68 and 0.72 . The CBPIS scoring system is a weighted point system described by Keller et al. with an AUC calculated at 0.76 . The New Score proposed by Saraya et al. was derived on a cohort of only 102 patients, with an AUC between 0.62 and 0.68 . We did not find any score or clinical rule predicting the presence of any atypical pathogens, i.e. not only L. pneumophila but also M. pneumoniae or C. pneumoniae.
We aimed to build a score easy to use at the bedside. All the information needed to compute the CASH-75 score can be obtained through readily available information and routine laboratory tests. The absence of weighting of the different items confers simplicity to this score, enhancing its potential usefulness in a busy clinical setting.
We chose to compare patients with AP to both patients with another aetiology (eg. typical bacterial pathogens) and patients without any identified pathogen. It can be argued that some patients without identified pathogens had viral pneumonia and as such would not need any antibiotic treatment. Though this assumption is probably true, some of these patients may as well have infection with an undetected bacterial pathogen [38, 39]. At present, international guidelines do not recommend withholding antibiotics in patients with viral pneumonia, as associated bacterial infection cannot be reliably ruled-out . As our main aim was to allow safe withholding of atypical coverage in all patients presenting with pneumonia, we thought that it was more appropriate to include in the analysis patients without detected pathogens.
The main usefulness of the CASH-75 score is to exclude an atypical bacteria as the causative pathogen in order to safely withdraw atypical coverage from the empiric antibiotic treatment. For this purpose, there are two candidate cut-offs. The first one, < 2, has a sensitivity and negative predictive value of 100%. Using this cut-off, antibiotic coverage for atypical pathogens would have been avoided in 193/578 (33%) patients with a score of 0 or 1, without missing any cases of atypical pathogen. Based on the highest diagnostic odds-ratio, the ideal cut-off is < 3. Using this cut-off, atypical antibiotic coverage would be withheld in 400/ 578 (69%) patients, at the cost of 9 CAP caused by atypical pathogens not being covered by an adequate antibiotic. Both cut-offs may help reduce the prescription of atypical coverage before obtaining the results of any microbiological investigation. This may lead to less bacterial resistance, less drug adverse effects and drug interactions.
This study has several strengths; it was conducted using a prospective multicentric cohort with thorough adjudication of the presence of pneumonia. The protocol mandated search for typical and atypical pathogens in all patients, hence minimizing the risks of misclassification. Patients were representative of older individuals admitted at the hospital in Switzerland.
Nevertheless, some limitations must be recognized. Not all variables of interest described in the literature were available in our patients. For example, the smoker status remained unknown and the LDH were not measured, both being described in other studies as significant predictive factors for the presence of L. pneumophila. Because no systematic attempt was made to detect L.pneumophila or M.pneumoniae by culture or PCR in the sputum, we cannot completely exclude the presence of these pathogens in the NAP group creating a possible classification bias. However, all patients were tested for the presence of either pathogens with PCR on an oropharyngeal swab (M. pneumoniae) or urinary antigen detection (L. pneumophila), making significant misclassification unlikely. The diagnosis was confirmed by chest-X ray, which has lower accuracy than CT-scan for pneumonia . However, chest X-ray remains a frequently used tool to confirm pneumonia in clinical studies.
Finally, despite the model fulfilling the goodness-of-fit hypothesis, the total number of patients in the AP group was low, and overfitting of the score is a possibility, reinforcing the need for external validation.
Some characteristics can help predict an atypical aetiology in patients hospitalized for moderately severe pneumonia. Provided its accuracy is confirmed in other cohorts, the CASH-75 score could help exclude the presence of atypical bacteria using simple, easy to obtain variables. This would enable a safe antibiotic stewardship guided by the CASH-75 score, with beneficial effects on bacterial resistance, drug adverse events and interactions, while maintaining lower costs.
Availability of data and materials
The datasets generated during the original study and analyzed during the current study are not publicly available due to the absence of adequate repository when the original study was conducted, but are available from the corresponding author on reasonable request.
Shoar S, Musher DM. Etiology of community-acquired pneumonia in adults: a systematic review. Pneumonia (Nathan). 2020;12:11.
Torres A, et al. Pneumonia. Nat Rev Dis Primers. 2021;7(1):25.
Torres A, et al. The aetiology and antibiotic management of community-acquired pneumonia in adults in Europe: a literature review. Eur J Clin Microbiol Infect Dis. 2014;33(7):1065–79.
Cilloniz C, et al. Community-acquired pneumonia related to intracellular pathogens. Intensive Care Med. 2016;42(9):1374–86.
Farr BM, et al. Prediction of microbial aetiology at admission to hospital for pneumonia from the presenting clinical features. British Thoracic Society Pneumonia Research Subcommittee. Thorax. 1989;44(12):1031–5.
Arnold FW, et al. A worldwide perspective of atypical pathogens in community-acquired pneumonia. Am J Respir Crit Care Med. 2007;175(10):1086–93.
Wellinghausen N, et al. Low prevalence of Chlamydia pneumoniae in adults with community-acquired pneumonia. Int J Med Microbiol. 2006;296(7):485–91.
Senn L, et al. Does respiratory infection due to Chlamydia pneumoniae still exist? Clin Infect Dis. 2011;53(8):847–8.
von Baum H, et al. Mycoplasma pneumoniae pneumonia revisited within the German Competence Network for Community-acquired pneumonia (CAPNETZ). BMC Infect Dis. 2009;9:62.
Allgaier J, et al. Risk factors, management, and outcomes of Legionella pneumonia in a large, nationally representative sample. Chest. 2021;159(5):1782–92.
Jain S, et al. Community-acquired pneumonia requiring hospitalization among US adults. N Engl J Med. 2015;373(5):415–27.
Metlay JP, et al. Diagnosis and treatment of adults with community-acquired pneumonia. An official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America. Am J Respir Crit Care Med. 2019;200(7):e45–67.
Ewig S, Giesa C. Update: guidelines for the treatment and prevention of adult community-acquired pneumonia 2016: what is new? MMW Fortschr Med. 2017;159(3):51–2.
Woodhead M, et al. Guidelines for the management of adult lower respiratory tract infections–full version. Clin Microbiol Infect. 2011;17(Suppl 6):E1-59.
Garin N, et al. beta-Lactam monotherapy vs beta-lactam-macrolide combination treatment in moderately severe community-acquired pneumonia: a randomized noninferiority trial. JAMA Intern Med. 2014;174(12):1894–901.
Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol. 2007;165(6):710–8.
Glas AS, et al. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56(11):1129–35.
Lui G, et al. Role of “atypical pathogens” among adult hospitalized patients with community-acquired pneumonia. Respirology. 2009;14(8):1098–105.
Plouffe JF. Importance of atypical pathogens of community-acquired pneumonia. Clin Infect Dis. 2000;31(Suppl 2):S35–9.
Fiumefreddo R, et al. Clinical predictors for Legionella in patients presenting with community-acquired pneumonia to the emergency department. BMC Pulm Med. 2009;9:4.
Saraya T, et al. A novel diagnostic scoring system to differentiate between Legionella pneumophila Pneumonia and Streptococcus pneumoniae Pneumonia. Intern Med. 2018;57(17):2479–87.
Fernandez-Sabe N, et al. Clinical diagnosis of Legionella pneumonia revisited: evaluation of the Community-Based Pneumonia Incidence Study Group scoring system. Clin Infect Dis. 2003;37(4):483–9.
Sopena N, et al. Comparative study of the clinical presentation of Legionella pneumonia and other community-acquired pneumonias. Chest. 1998;113(5):1195–200.
Viasus D, et al. Community-acquired Legionella pneumophila pneumonia: a single-center experience with 214 hospitalized sporadic cases over 15 years. Medicine (Baltimore). 2013;92(1):51–60.
Haubitz S, et al. Ruling out Legionella in community-acquired pneumonia. Am J Med. 2014;127(10):1010.e11-9.
Arancibia F, et al. Importance of Legionella pneumophila in the etiology of severe community-acquired pneumonia in Santiago Chile. Chest. 2014;145(2):290–6.
Falco V, et al. Legionella pneumophila. A cause of severe community-acquired pneumonia. Chest. 1991;100(4):1007–11.
Gupta SK, Imperiale TF, Sarosi GA. Evaluation of the Winthrop-University Hospital criteria to identify Legionella pneumonia. Chest. 2001;120(4):1064–71.
Farnham A, et al. Legionnaires’ disease incidence and risk factors, New York, New York, USA, 2002–2011. Emerg Infect Dis. 2014;20(11):1795–802.
Garcia-Vidal C, et al. Rainfall is a risk factor for sporadic cases of Legionella pneumophila pneumonia. PLoS ONE. 2013;8(4): e61036.
Cilloniz C, et al. Seasonality of pathogens causing community-acquired pneumonia. Respirology. 2017;22(4):778–85.
Kenagy E, et al. Risk factors for Legionella longbeachae Legionnaires’ disease New Zealand. Emerg Infect Dis. 2017;23(7):1148–54.
von Baum H, Luck C. Community-acquired Legionella pneumonia: data from the CAPNETZ study. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2011;54(6):688–92.
Roed T, Schonheyder HC, Nielsen H. Predictors of positive or negative Legionella urinary antigen test in community-acquired pneumonia. Infect Dis (Lond). 2015;47(7):484–90.
Miyashita N, et al. Clinical presentation of legionella pneumonia: evaluation of clinical scoring systems and therapeutic efficacy. J Infect Chemother. 2017;23(11):727–32.
Bolliger R, et al. Validation of a Prediction Rule for Legionella Pneumonia in Emergency Department Patients. Open Forum Infect Dis. 2019;6(7):ofz268.
Cunha BA. Clinical features of legionnaires’ disease. Semin Respir Infect. 1998;13(2):116–27.
Gadsby NJ, et al. Comprehensive molecular testing for respiratory pathogens in community-acquired pneumonia. Clin Infect Dis. 2016;62(7):817–23.
Musher DM, Abers MS, Bartlett JG. Evolving understanding of the causes of pneumonia in adults, with special attention to the role of pneumococcus. Clin Infect Dis. 2017;65(10):1736–44.
Prendki V, et al. Low-dose CT for the diagnosis of pneumonia in elderly patients: a prospective, interventional cohort study. Eur Respir J. 2018. https://doi.org/10.1183/13993003.02375-2017.
The original study was supported by a grant from the Swiss National Science Foundation (3200BO-120074) and grants from the Clinical Trial Unit and the Department of Internal Medicine of Geneva University Hospitals. No financial support was used for the present study.
Ethics approval and consent to participate
The ethics committees of all participating hospitals and Swissmedic, the Swiss regulatory agency for therapeutic products, approved the protocol of the original study (CER 06-259), which was performed in accordance with the Declaration of Helsinki. All patients provided written informed consent.
Consent for publication
The authors have no conflicts of interest to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Chauffard, A., Bridevaux, PO., Carballo, S. et al. Accuracy of a score predicting the presence of an atypical pathogen in hospitalized patients with moderately severe community-acquired pneumonia. BMC Infect Dis 22, 424 (2022). https://doi.org/10.1186/s12879-022-07423-1