Skip to main content

Prognostic accuracy of SIRS criteria and qSOFA score for in-hospital mortality among influenza patients in the emergency department

Abstract

Background

The seasonal influenza epidemic is an important public health issue worldwide. Early predictive identification of patients with potentially worse outcome is important in the emergency department (ED). Similarly as with bacterial infection, influenza can cause sepsis. This study was conducted to investigate the effectiveness of the Systemic Inflammatory Response Syndrome (SIRS) criteria and the quick Sequential Organ Failure Assessment (qSOFA) score as prognostic predictors for ED patients with influenza.

Methods

This single-center, retrospective cohort study investigated data that was retrieved from a hospital-based research database. Adult ED patients (age ≥ 18 at admission) with laboratory-proven influenza from 2010 to 2016 were included for data analysis. The initial SIRS and qSOFA scores were both collected. The primary outcome was the utility of each score in the prediction of in-hospital mortality.

Results

For the study period, 3561 patients met the study inclusion criteria. The overall in-hospital mortality was 2.7% (95 patients). When the qSOFA scores were 0, 1, 2, and 3, the percentages of in-hospital mortality were 0.6, 7.2, 15.9, and 25%, respectively. Accordingly, the odds ratios (ORs) were 7.72, 11.92, and 22.46, respectively. The sensitivity and specificity was 24 and 96.2%, respectively, when the qSOFA score was ≥2. However, the SIRS criteria showed no significant associations with the primary outcome. The area under the receiver operating characteristic curve (AUC) was 0.864, which is significantly higher than that with SIRS, where the AUC was 0.786 (P < 0.01).

Conclusions

The qSOFA score potentially is a useful prognostic predictor for influenza and could be applied in the ED as a risk stratification tool. However, qSOFA may not be a good screening tool for triage because of its poor sensitivity. The SIRS criteria showed poor predictive performance in influenza for mortality as an outcome. Further research is needed to determine the role of these predictive tools in influenza and in other viral infections.

Peer Review reports

Background

Worldwide, influenza has long been a threat to public health [1]. Patients’ outcomes in influenza range from simple upper respiratory infection (URI) to acute lung injury (ALI), acute respiratory distress syndrome (ARDS), and multiorgan dysfunction syndrome. Influenza progresses rapidly and leads to morbidity and mortality within days [2]. Furthermore, influenza increases the mortality of vulnerable patient groups [3]. A modeling study estimated the global influenza-associated respiratory mortality in 33 countries between 1999 and 2015 and showed that the estimated mean annual influenza-associated respiratory excess mortality rate ranged from 0.1 to 6.4, 2.9 to 44.0, and 17.9 to 223.5 per 100,000 individuals in individuals younger than 65 years, between 65 and 74 years, and ≥ 75 years, respectively [4]. A global pandemic of influenza (H1N1) occurred in 2009 and caused more than 18,000 deaths worldwide [5]. Another localized outbreak took place in Taiwan from late 2015 to early 2016, resulting in more than 2000 severe influenza cases (85.5 per million population) and over 160 deaths (6.9 per million) nationwide during this period [6, 7].

Early recognition of patients with potentially worse outcomes is important in the emergency department (ED) [8]. The first clinical prediction rule of influenza infection, comprising 9 parameters, was published in 2004 [9]. In 2011, Oh et al. reported four risk factors associated with disease severity: altered mental status, hypoxia, bilateral lung infiltration, and old age [10]. The geriatric influenza death (GID) score and the Shock Index were recently reported to be prediction rules for patients with influenza [11]. However, not all prediction rules that have been described have provided satisfactory diagnostic strength. Moreover, some laboratory tests in these studies were not routinely checked in the ED and, therefore, they may not be feasible in all EDs. A simple and accurate prediction rule is yet to be developed.

Similar to bacterial infections, the Influenza virus triggers the host immune system and generates a proinflammatory response. A prolonged and excessive inflammatory response results in severe sepsis and poor outcomes [12]. An influenza infection shares many common pathways with the immune response to bacteria and can trigger a similar physiologic inflammatory cascade [12, 13]. Furthermore, influenza could impair antibacterial immune defense mechanisms [14,15,16,17,18] and lead to secondary bacterial sepsis [19, 20]. A multinational multicenter cross-sectional study in Asia found that 4% of all sepsis was caused by influenza viruses [21].

In 1992, the American College of Chest Physicians (ACCP) and Society of Critical Care Medicine (SCCM) Consensus Conference committee introduced the Systemic Inflammatory Response Syndrome (SIRS) criteria to define sepsis and predict in-hospital mortality. The SIRS is a scoring tool that combines data on vital signs and white blood cell (WBC) [8]. In 2016, sepsis was redefined as a “life-threatening organ dysfunction caused by a dysregulated host response to infection” by the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) [22]. Instead of the SIRS criteria, Sepsis-3 developed the quick Sequential (Sepsis-related) Organ Failure Assessment (qSOFA) score – a simplified version of the SOFA score – as a new sepsis screening tool for use outside the intensive care unit (ICU) [23]. The items included in the qSOFA are readily available in the ED after triage. The performance of the qSOFA score in predicting adverse outcomes has been validated among patients in various clinical settings [24,25,26,27,28,29,30]. Most of the results of previous research suggested that the qSOFA score is specific but lacks sensitivity in predicting risk of either mortality or ICU admission [31]. We theorized that the qSOFA score could be a more accurate diagnostic tool compared to SIRS in patients with influenza.

This study was undertaken to evaluate the diagnostic accuracy of the SIRS criteria and qSOFA score in predicting the in-hospital mortality of patients with an influenza infection. An accurate prediction tool will aid early risk stratification and rapid treatment of patients with influenza in the ED.

Methods

Study design and setting

This single-center, retrospective cohort study included patients who visited the ED of Linkou Chang Gung Memorial Hospital from 2010 to 2016. The Linkou Chang Gung Memorial Hospital is a tertiary-care medical center in Taiwan with 3406 bed, and, on average, there were approximately 17,000 ED visits per month in 2019. All of the patients’ data were retrieved from the Chang Gung Research Database (CGRD). This large database contains all necessary records from every visiting patient, including details of their vital signs, blood tests, image reports, diagnosis, treatments, and daily medical records of doctors and nursing staff. All data are de-identified and encrypted to protect the participants’ privacy.

Patients with flu-like syndrome in the ED were evaluated by at least one emergency physician and managed by the guidelines approved by our ED committee. Most of these patients received the rapid influenza diagnostic test (RIDT) or influenza reverse transcription-polymerase chain reaction (RT-PCR) test. However, to avoid ED crowding, some patients with minor symptoms would be discharged home directly without further examinations, such as radiographic, laboratory, or flu investigations. This study was approved by the Institute Review Board, Chung Gang Memorial Hospital.

Selection of participants

Patients aged 18 years or older visiting the ED were enrolled in the analysis if they had a diagnosis of influenza, confirmed by either positive RIDT or RT-PCR test. If patients visited the ED more than once within 30 days with the same diagnosis, they were considered to have the same influenza episode, and data from their last visit would be included in this study.

Measurements

The vital signs and Glasgow Coma Scale (GCS) score recorded at triage were collated. The qSOFA score ranges from 0 to 3, with one point for each of the following: respiratory rate ≥ 22 breaths per minute, altered mentation, and systolic blood pressure ≤ 100 mmHg. We defined altered mentation as a GCS score < 15 at triage or decreased coma scale compared to the baseline level. A positive qSOFA score was defined as a score of 2 or higher. In addition, we collected SIRS criteria, including body temperature > 38 °C or < 36.0 °C, heart rate > 90 beats per min, respiratory rate ≥ 20 breaths per min, WBC count > 12,000 or < 4000 cells/mm3, or > 10% immature (band) forms. The SIRS score ranges from 0 to 4, and a positive SIRS score was defined as 2 or more points.

All the results of initial laboratory tests in the ED were extracted from the electronic medical records; trained hospital personnel who were blinded to the objective of the study calculated the qSOFA and SIRS scores. For patients without blood tests, we defined the WBC score of SIRS as 0, because these patients were relatively few and were discharged after a physician’s assessment. Associated data were obtained, including sex, age, and comorbidities. We used the Charlson Comorbidity Index (CCI) [32] to define the comorbid condition of all patients. Data on all patient outcomes, including ICU admission and in-hospital mortality, were collected.

Outcomes

The primary outcome of this study was in-hospital mortality, including all deaths that occurred in the ED, ordinary ward, and ICU. The secondary outcome was the ICU admission, comprising two patient groups: one group included patients who were initially hospitalized in the general ward and later transferred to the ICU, and the other group included patients who were directly admitted to the ICU from the ED.

Statistical analysis

Data from the CGRD were statistically analyzed, and results were presented as means and standard deviations for continuous variables as well as numbers and percentages for categorical variables. Moreover, we calculated the percentages of outcomes by each level of SIRS and qSOFA. Logistic regression models were built to evaluate the predictive ability of these two scoring tools for ICU admission and in-hospital mortality. Akaike’s Information Criterion (AIC) and receiver operating characteristics (ROC) curves with c-statistics were used to compare the predictive performance of the tools. All statistical analyses were undertaken using SAS 9.4 (SAS Institute, Cary, NC, USA) and Stata 14 (StataCorp, College Station, TX, USA). Significance level α was set at 0.05.

Results

There were 1,183,226 ED visits to Chung Gang Memorial Hospital, Linkou, from January 2010 to December 2016, and the patient disposition flow diagram is shown in Fig. 1. In total, 27,550 patients underwent either RIDT or RT-PCR. Among all of the patients who visited the ED, 9693 patients tested positive for influenza A or B; of these, 3561 were adults and have been included in our analysis. Four major seasonal influenza epidemics were recorded between 2010 and 2016 in Taiwan (Fig. 2) and patient numbers increased accordingly in the CGRD. The largest outbreak occurred in late 2015 and early 2016, with more than 350 visits of adult patients with influenza per month.

Fig. 1
figure 1

The flow chart of sample selection for analysis

Fig. 2
figure 2

Number of emergency department visits with positive influenza diagnostic test by months

Baseline patient characteristics are shown in Table 1. The mean age of patients in this study population was 48 years, and 1716 patients (48.9%) were male. The CCI (mean ± SD) was 3.94 ± 4.19. Of the patients with influenza, 1527 (42.9%) were hospitalized (Table 2) and 286 (8.0%) were admitted to the ICU. The overall in-hospital mortality in this study population was 2.7%. Only 31 patients (0.9%) were readmitted within 72 h after direct discharge from the ED. The primary outcome of in-hospital mortality rate was 0.6, 7.2, 15.9, and 25% when the qSOFA score was 0, 1, 2, and 3, respectively. Patients with qSOFA scores of 0, 1, 2, and 3 had ICU admission rates of 2.8, 21, 34.8, and 58.3%, respectively (Fig. 3a). Furthermore, we compared the performance of SIRS criteria for predicting in-hospital mortality, which was not associated with the SIRS criteria based on our results (Fig. 3b).

Table 1 Baseline characteristics of patients with influenza
Table 2 Distribution of study outcomes
Fig. 3
figure 3

The quick Sequential (Sepsis-related) Organ Failure Assessment (qSOFA) and Systemic Inflammatory Response Syndrome (SIRS) models by outcomes

In-hospital mortality increased significantly in relation to male sex, age, CCI, and qSOFA score (Table 3). The crude OR was 12.1 (95% confidence interval [CI] 6.9–21.0), 29.6 (15.3–57.3), and 52.1 (13–209.3) for qSOFA scores of 1, 2, and 3, respectively, which showed significant differences. The adjusted OR by c-statistics was 7.7 (95% CI 4.4–13.7), 11.9 (5.7–24.8), and 22.5 (4.3–116.3) when the qSOFA score was 1, 2, and 3, respectively.

Table 3 Logistic regression models for predicting in-hospital mortality

The area under the receiver operating characteristic curve (AUC) of the qSOFA model for predicting in-hospital mortality was 0.861, which was significantly higher than the AUC of the SIRS model (0.79; Fig. 4). When the qSOFA score was ≥2, which is the cutoff point defined by Sepsis-3, the qSOFA had high predictive accuracy for ICU admission and in-hospital mortality (94.5 and 94.7%, respectively) although the sensitivity was low (26.3 and 24%, respectively). If the cutoff point was set as a qSOFA score ≥ 1, this would ensure the best Youden Index (0.587 for ICU admission, 0.590 for in-hospital mortality) as well as better sensitivity (82.1 and 82.7%, respectively), which could facilitate clinical decision-making by emergency physicians.

Fig. 4
figure 4

Receiver operating characteristic (ROC) curves of Systemic Inflammatory Response Syndrome (SIRS) model and quick Sequential (Sepsis-related) Organ Failure Assessment (qSOFA) model for predicting in-hospital mortality

In the SIRS model, when the SIRS score was ≥2 (the cutoff point defined by Sepsis-2), accuracy was merely 25.9 and 25.6% for ICU admission and in-hospital mortality, respectively (Table 4). To obtain the best Youden Index (0.195 for ICU admission, 0.207 for in-hospital mortality), the cutoff point should be a SIRS score ≥ 3. However, the sensitivity, specificity, and likelihood ratio of SIRS ≥3 were poorer than those of qSOFA ≥1. Thus, the qSOFA score is a better tool to predict influenza outcomes.

Table 4 Predictive performance of SIRS and qSOFA model in each cutoff point

Discussion

Worldwide, influenza epidemics emerge almost every year and patient visits to the ED increase dramatically during the flu seasons. Most influenza infections are self-limiting and manageable with symptomatic treatment, and antiviral therapy might not be necessary in most patients. However, during the outbreak in Taiwan in 2015–2016, we observed extremely rapid disease progression in some patients. Severely ill patients may progress to acute hypoxic respiratory failure within 24 h even if the initial chest x-ray shows normal findings. Therefore, a simple early prognostic indicator might be clinically important to an emergency physician. In the present study, we found that the qSOFA score was a better prognostic indicator compared with the SIRS criteria.

Since the qSOFA score was developed, many people have evaluated its clinical value for sepsis. Some articles reported that the qSOFA as a good prognostic predictor [25, 33], whereas other studies found that the qSOFA may not be an adequate screening tool in the ED because of its poor sensitivity [34,35,36]. A recent meta-analysis showed that the qSOFA was better than the SIRS was in predicting in-hospital mortality of sepsis [37], and a similar finding was observed in our cohort. The predictive performance of the qSOFA was better than that of the SIRS (good accuracy, but poor sensitivity) in the prognostication of patients with influenza, and we rationalized that this finding was related to the septic reaction induced by the influenza or a secondary bacterial infection.

The SIRS criteria have been used to predict outcomes in influenza. Tai et al. conducted a retrospective study that included 409 geriatric ED patients (age ≥ 65 years) who tested positive on RIDT [38] and found that SIRS criteria ≥3 was an acceptable predictor of mortality in this group of patients (OR 3.37, 95% CI 1.05–10.73; sensitivity 60, 95% CI 46–80%; specificity 70, 95% CI 66–75%). The present study included all adult patients with influenza, not merely elderly patients, and we included patients with positive RT-PCR test results for influenza to reduce bias. We found that the SIRS had poor predictivity for outcomes in influenza.

Several previous studies have reported the use of different prognostic scales of pneumonia to evaluate influenza [39,40,41,42,43,44]. Myles et al. [39] compared the performance of Community Assessment Tools (CATs), CURB-65 score, and the Pandemic Medical Early Warning Score in influenza. They found the CATs were a useful triage tool to predict severe outcomes. However, theirs was a case–control study and was limited to H1N1 infections, which might have conferred some bias. Another retrospective study used eight different scoring tools, including CURB-65, Mortality in Emergency Department Sepsis (MEDS) score, the Nursing Home-Acquired Pneumonia score, PMEWS, Pneumonia Severity Index, severity score for the elderly with community-acquired pneumonia score, SMART-COP Score, and Simple Triage Scoring System, to predict the outcomes of influenza in the ED [40, 43]. These researchers found that the PSI and MEDS scores were moderately predictive of in-hospital mortality, and the SMARTCOP score was a good predictor of ICU admission. In the present study, we did not compare these pneumonia scales because all of these scoring tools need further radiographic or laboratory investigations. We did not routinely arrange these exams for every patient with flu-like symptoms in the ED. In addition, the qSOFA score is much easier and simpler to use for the frontline ED staff. Further prospective studies are required to define the roles of these scoring tools for influenza in the ED.

Other studies have attempted to use serum biomarkers to predict outcomes in patients with influenza. Zimmerman et al. reported that serum levels of C-reactive protein were an early predictor of outcome in the ED [45]. Another report concluded that serum level of lactate dehydrogenase > 600 IU/L was associated with mortality in influenza-induced pneumonia [46]. However, both of the abovementioned studies were limited to H1N1 influenza. Moreover, serum biomarkers were not optimal as early prognostic predictors because we blood tests will not be conducted for every patient with influenza in a busy ED, especially during an epidemic outbreak.

Patel et al. developed a predictive classification tree model to estimate the mortality rates of the human highly pathogenic avian influenza (HPAI) A/H5N1 based on significant predictors of influenza mortality, including age, duration from symptom onset to hospitalization, country, and per capita government health expenditure. However, the quality of data was inconsistent [47]. Those authors included 617 H5N1 cases in their meta-analysis of articles published in any language. There were wide variations in their database, such as with regard to surveillance and clinical care, vaccination policy, lack of data on antiviral treatment, and time from illness onset to the initiation of antiviral treatment. Furthermore, the abovementioned study was limited to HPAI A/H5N1 and did not include all influenza.

Patients with a qSOFA score ≥ 1 might already have clinically apparent illness. Emergency physicians might not always need the qSOFA score to facilitate patient disposition. However, this quantitative scoring tool could generate a more objective and more representative picture of every individual with influenza. In addition, in our data, the CCI, admission rate, and mortality rate were relatively higher than in previous studies. This means that our cohort had more severe illness and was therefore much closely representative of the real ED. We believe that our results are reliable and can be applied in clinical practice, especially in the ED.

Limitations

This study has strength in numbers, although it was a single-center retrospective study with the inherent limitations of this study design. In addition, we might not have ordered an influenza test for everyone presenting to the ED with fever or URI symptoms, especially in the non-flu season. Moreover, all tests for influenza generate false negatives. These factors might induce some bias. Further studies are required to confirm our findings and prospectively validate the use of qSOFA in this specific patient population.

The definition of “altered mentation” with regard to the qSOFA score has two versions in the literature. One includes a GCS score ≤ 13, which was mentioned in the original study of Sepsis-3 [23]. The other was a GCS score < 15, according to the definitions of sepsis and septic specified by the Third International Consensus [22]. In the present study, we used the GCS score < 15 for analysis. This might have caused an overestimated qSOFA score because of patients with unclear baseline mental status due to underlying disease.

Conclusions

The qSOFA score is potentially a useful prognostic predictor for influenza and could be applied in the ED after triage, as an early risk stratification tool. Patients with an initial qSOFA score ≥ 1 might need to be hospitalized patients whereas those with a qSOFA score of 3 might need intensive monitoring and aggressive treatment and ICU admission might be indicated. However, the qSOFA may not be a good screening triage tool because of its poor sensitivity in the detection of high-risk patients. The SIRS criteria had poor predictive performance for influenza outcomes. Further studies are needed to determine whether there exists any role for the SIRS criteria and to confirm a role for the qSOFA score in the assessment of patients with influenza as well as other viral respiratory infections.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ALI:

Acute lung injury

ARDS:

Acute respiratory distress syndrome

ACCP:

American College of Chest Physicians

AIC:

Akaike Information Criterion

AUROC:

Area under the receiver operating characteristic curve

CGRD:

Chang Gung Research Database

CCI:

Charlson Comorbidity Index

CI:

Confidence interval

CATs:

Community assessment tools

CAP:

Severity Score for the Elderly with community-acquired pneumonia

ED:

Emergency department

GID:

Geriatric influenza death

GCS:

Glasgow Coma Scale

HPAI:

Highly pathogenic avian influenza

ICU:

Intensive care unit

LDH:

Lactate dehydrogenase

MEDS:

Mortality in Emergency Department Sepsis score

NHAP:

Nursing Home-Acquired Pneumonia score

PMEWS:

Pandemic Medical Early Warning Score

PSI:

Pneumonia Severity Index

qSOFA:

quick Sequential (Sepsis-related) Organ Failure Assessment

RIDT:

Rapid influenza diagnostic test

RT-CPR:

Reverse transcription-polymerase chain reaction

ROC:

Receiver operating characteristic

SCCM:

Society of Critical Care Medicine

STSS:

Simple Triage Scoring System

SIRS:

Systemic Inflammatory Response Syndrome

URI:

Upper respiratory infection

WBC:

White blood cell

References

  1. Cox NJ, Subbarao K. Global epidemiology of influenza: past and present. Annu Rev Med. 2000;51:407–21.

    Article  CAS  PubMed  Google Scholar 

  2. Harper SA, Bradley JS, Englund JA, File TM, Gravenstein S, Hayden FG, et al. Seasonal influenza in adults and children--diagnosis, treatment, chemoprophylaxis, and institutional outbreak management: clinical practice guidelines of the Infectious Diseases Society of America. Clin Infect Dis. 2009;48:1003–32.

    Article  CAS  PubMed  Google Scholar 

  3. Nguyen JL, Yang W, Ito K, Matte TD, Shaman J, Kinney PL. Seasonal influenza infections and cardiovascular disease mortality. JAMA Cardiol. 2016;1:274–81.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Iuliano AD, Roguski KM, Chang HH, Muscatello DJ, Palekar R, Tempia S, et al. Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. Lancet. 2018;391:1285–300.

    Article  PubMed  Google Scholar 

  5. World Health Organization. Pandemic (H1N1) 2009 - update 112. https://www.who.int/csr/don/2010_08_06/en. Accessed 30th Aug 2017.

  6. Zheng J, Huo X, Huai Y, Xiao L, Jiang H, Klena J, et al. Epidemiology, seasonality and treatment of hospitalized adults and adolescents with influenza in Jingzhou, China, 2010-2012. PLoS One. 2016;11:e0150713.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  7. Hsieh YC, Tsao KC, Huang CT, Chang KY, Huang YC, Gong YN. Clinical characteristics of patients with laboratory-confirmed influenza a (H1N1) pdm09 during the 2013/2014 and 2015/2016 clade 6B/6B.1/6B.2-predominant outbreaks. Sci Rep. 2018;8:15636.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM consensus conference committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101:1644–55.

    Article  CAS  PubMed  Google Scholar 

  9. Hak E, Wei F, Nordin J, Mullooly J, Poblete S, Nichol KL. Development and validation of a clinical prediction rule for hospitalization due to pneumonia or influenza or death during influenza epidemics among community-dwelling elderly persons. J Infect Dis. 2004;189(3):450–8.

    Article  PubMed  Google Scholar 

  10. Oh WS, Lee SJ, Lee CS, Hur JA, Hur AC, Park YS, et al. A prediction rule to identify severe cases among adult patients hospitalized with pandemic influenza a (H1N1) 2009. J Korean Med Sci. 2011;26:499–506.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Chung JY, Hsu CC, Chen JH, Chen WL, Lin HJ, Guo HR, et al. Geriatric influenza death (GID) score: a new tool for predicting mortality in older people with influenza in the emergency department. Sci Rep. 2018;8:9312.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. Florescu DF, Kalil AC. The complex link between influenza and severe sepsis. Virulence. 2014;5:137–42.

    Article  PubMed  Google Scholar 

  13. Ljungstrom LR, Jacobsson G, Claesson BEB, Andersson R, Enroth H. Respiratory viral infections are underdiagnosed in patients with suspected sepsis. Eur J Clin Microbiol Infect Dis. 2017;36:1767–76.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Kleinerman ES, Daniels CA, Polisson RP, Snyderman R. Effect of virus infection on the inflammatory response. Depression of macrophage accumulation in influenza-infected mice. Am J Pathol. 1976;85:373–82.

    CAS  PubMed  PubMed Central  Google Scholar 

  15. Abramson JS, Giebink GS, Quie PG. Influenza a virus-induced polymorphonuclear leukocyte dysfunction in the pathogenesis of experimental pneumococcal otitis media. Infect Immun. 1982;36:289–96.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Nickerson CL, Jakab GJ. Pulmonary antibacterial defenses during mild and severe influenza virus infection. Infect Immun. 1990;58:2809–14.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Hinshaw VS, Olsen CW, Dybdahl-Sissoko N, Evans D. Apoptosis: a mechanism of cell killing by influenza a and B viruses. J Virol. 1994;68:3667–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Colamussi ML, White MR, Crouch E, Hartshorn KL. Influenza a virus accelerates neutrophil apoptosis and markedly potentiates apoptotic effects of bacteria. Blood. 1999;93:2395–403.

    Article  CAS  PubMed  Google Scholar 

  19. Kalil AC, Thomas PG. Influenza virus-related critical illness: pathophysiology and epidemiology. Crit Care. 2019;23:258.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Jain S, Benoit SR, Skarbinski J, Bramley AM, Finelli L. Pandemic influenza AVHIT: influenza-associated pneumonia among hospitalized patients with 2009 pandemic influenza a (H1N1) virus--United States, 2009. Clin Infect Dis. 2012;54:1221–9.

    Article  CAS  PubMed  Google Scholar 

  21. Southeast Asia Infectious Disease Clinical Research N. Causes and outcomes of sepsis in Southeast Asia: a multinational multicentre cross-sectional study. Lancet Glob Health. 2017;5:e157–67.

    Article  Google Scholar 

  22. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315:801–10.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315:762–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Donnelly JP, Safford MM, Shapiro NI, Baddley JW, Wang HE. Application of the third international consensus definitions for sepsis (Sepsis-3) classification: a retrospective population-based cohort study. Lancet Infect Dis. 2017;17:661–70.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Freund Y, Lemachatti N, Krastinova E, Van Laer M, Claessens YE, Avondo A, et al. Prognostic accuracy of Sepsis-3 criteria for in-hospital mortality among patients with suspected infection presenting to the emergency department. JAMA. 2017;317:301–8.

    Article  PubMed  Google Scholar 

  26. Giamarellos-Bourboulis EJ, Tsaganos T, Tsangaris I, Lada M, Routsi C, Sinapidis D, et al. Validation of the new Sepsis-3 definitions: proposal for improvement in early risk identification. Clin Microbiol Infect. 2017;23:104–9.

    Article  CAS  PubMed  Google Scholar 

  27. Lamontagne F, Harrison DA, Rowan KM. qSOFA for identifying sepsis among patients with infection. JAMA. 2017;317:267–8.

    Article  PubMed  Google Scholar 

  28. Muller M, Guignard V, Schefold JC, Leichtle AB, Exadaktylos AK, Pfortmueller CA. Utility of quick sepsis-related organ failure assessment (qSOFA) to predict outcome in patients with pneumonia. PLoS One. 2017;12:e0188913.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  29. Ranzani OT, Prina E, Menendez R, Ceccato A, Cilloniz C, Mendez R, et al. New sepsis definition (Sepsis-3) and community-acquired pneumonia mortality. A validation and clinical decision-making study. Am J Respir Crit Care Med. 2017;196:1287–97.

    Article  PubMed  Google Scholar 

  30. Henning DJ, Puskarich MA, Self WH, Howell MD, Donnino MW, Yealy DM, et al. An emergency department validation of the SEP-3 sepsis and septic shock definitions and comparison with 1992 consensus definitions. Ann Emerg Med. 2017;70:544–52 e545.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Song JU, Sin CK, Park HK, Shim SR, Lee J. Performance of the quick sequential (sepsis-related) organ failure assessment score as a prognostic tool in infected patients outside the intensive care unit: a systematic review and meta-analysis. Crit Care. 2018;22:28.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.

    Article  CAS  PubMed  Google Scholar 

  33. Finkelsztein EJ, Jones DS, Ma KC, Pabon MA, Delgado T, Nakahira K, et al. Comparison of qSOFA and SIRS for predicting adverse outcomes of patients with suspicion of sepsis outside the intensive care unit. Crit Care. 2017;21:73.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Peake SL. Delaney a, bailey M, Bellomo R; ARISE investigators. Potential impact of the 2016 consensus definitions of sepsis and septic shock on future sepsis research. Ann Emerg Med. 2017;70:553–61 e551.

    Article  PubMed  Google Scholar 

  35. Hwang SY, Jo IJ, Lee SU, Lee TR, Yoon H, Cha WC, et al. Low accuracy of positive qSOFA criteria for predicting 28-day mortality in critically ill septic patients during the early period after emergency department presentation. Ann Emerg Med. 2018;71(1):1–9.e2.

    Article  PubMed  Google Scholar 

  36. Haydar S, Spanier M, Weems P, Wood S, Strout T. Comparison of QSOFA score and SIRS criteria as screening mechanisms for emergency department sepsis. Am J Emerg Med. 2017;35:1730–3.

    Article  PubMed  Google Scholar 

  37. Serafim R, Gomes JA, Salluh J, Povoa P. A comparison of the quick-SOFA and systemic inflammatory response syndrome criteria for the diagnosis of sepsis and prediction of mortality: a systematic review and meta-analysis. Chest. 2018;153:646–55.

    Article  PubMed  Google Scholar 

  38. Tai HC, Yeh CC, Chen YA, Hsu CC, Chen JH, Chen WL, et al. Utilization of systemic inflammatory response syndrome criteria in predicting mortality among geriatric patients with influenza in the emergency department. BMC Infect Dis. 2019;19:639.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  39. Myles PR, Nguyen-Van-Tam JS, Lim WS, Nicholson KG, Brett SJ, Enstone JE, et al. Comparison of CATs, CURB-65 and PMEWS as triage tools in pandemic influenza admissions to UK hospitals: case control analysis using retrospective data. PLoS One. 2012;7:e34428.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Estella A. Usefulness of CURB-65 and pneumonia severity index for influenza a H1N1v pneumonia. Monaldi Arch Chest Dis. 2012;77:118–21.

    CAS  PubMed  Google Scholar 

  41. Mulrennan S, Tempone SS, Ling IT, Williams SH, Gan GC, Murray RJ, et al. Pandemic influenza (H1N1) 2009 pneumonia: CURB-65 score for predicting severity and nasopharyngeal sampling for diagnosis are unreliable. PLoS One. 2010;5:e12849.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  42. Fujikura Y, Kawano S, Kouzaki Y, Shinoda M, Hara Y, Shinkai M, et al. Mortality and severity evaluation by routine pneumonia prediction models among Japanese patients with 2009 pandemic influenza a (H1N1) pneumonia. Respir Investig. 2014;52:280–7.

    Article  PubMed  Google Scholar 

  43. Muller MP, McGeer AJ, Hassan K, Marshall J, Christian M, Toronto Invasive Bacterial Disease Network. Evaluation of pneumonia severity and acute physiology scores to predict ICU admission and mortality in patients hospitalized for influenza. PLoS One. 2010;5:e9563.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  44. Choi WI, Yim JJ, Park J, Kim SC, Na MJ, Lee WY, et al. Clinical characteristics and outcomes of H1N1-associated pneumonia among adults in South Korea. Int J Tuberc Lung Dis. 2011;15:270–5.

    PubMed  Google Scholar 

  45. Zimmerman O, Rogowski O, Aviram G, Mizrahi M, Zeltser D, Justo D, et al. C-reactive protein serum levels as an early predictor of outcome in patients with pandemic H1N1 influenza a virus infection. BMC Infect Dis. 2010;10:288.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  46. Reyes S, Montull B, Martinez R, Cordoba J, Molina JM, Marti V, et al. Risk factors of a/H1N1 etiology in pneumonia and its impact on mortality. Respir Med. 2011;105:1404–11.

    Article  CAS  PubMed  Google Scholar 

  47. Patel RB, Mathur MB, Gould M, Uyeki TM, Bhattacharya J, Xiao Y, et al. Demographic and clinical predictors of mortality from highly pathogenic avian influenza a (H5N1) virus infection: CART analysis of international cases. PLoS One. 2014;9:e91630.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

Download references

Acknowledgements

The authors thank the Center for Big Data Analytics and Statistics of Chang-Gung Memorial Hospital for their assistance with statistical analyses of the data presented in this manuscript.

Funding

This study was financially supported by the Chang-Gung Memorial Hospital research funding (grant nos. CORPG3F0911 and CORPG3F0911) to CHL. None of the sponsors participated in this study.

Author information

Authors and Affiliations

Authors

Contributions

SEC and CHL conceived and designed the study, undertook data acquisition, carried out data analysis and data interpretation. HJT provided statistical expertise. SEC wrote the manuscript draft. CHL, CJS, THS, and CHC undertook critical revision of the manuscript for important intellectual content. All authors read and approved the final version of this manuscript.

Corresponding author

Correspondence to Chih-Huang Li.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Institute Review Board, Chung Gang Memorial Hospital. All the patient data and used in the study was anonymized and de-identified.

Consent for publication

Not applicable. All patient data were retrieved from the Chang Gung Research Database (CGRD), de-identified, and encrypted to protect patient confidentiality.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chu, SE., Seak, CJ., Su, TH. et al. Prognostic accuracy of SIRS criteria and qSOFA score for in-hospital mortality among influenza patients in the emergency department. BMC Infect Dis 20, 385 (2020). https://doi.org/10.1186/s12879-020-05102-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-020-05102-7

Keywords