Skip to main content

Two-stage prediction model for in-hospital mortality of patients with influenza infection

Abstract

Background

Infleunza is a challenging issue in public health. The mortality and morbidity associated with epidemic and pandemic influenza puts a heavy burden on health care system. Most patients with influenza can be treated on an outpatient basis but some required critical care. It is crucial for frontline physicians to stratify influenza patients by level of risk. Therefore, this study aimed to create a prediction model for critical care and in-hospital mortality.

Methods

This retrospective cohort study extracted data from the Chang Gung Research Database. This study included the patients who were diagnosed with influenza between 2010 and 2016. The primary outcome of this study was critical illness. The secondary analysis was to predict in-hospital mortality. A two-stage-modeling method was developed to predict hospital mortality. We constructed a multiple logistic regression model to predict the outcome of critical illness in the first stage, then S1 score were calculated. In the second stage, we used the S1 score and other data to construct a backward multiple logistic regression model. The area under the receiver operating curve was used to assess the predictive value of the model.

Results

In the present study, 1680 patients met the inclusion criteria. The overall ICU admission and in-hospital mortality was 10.36% (174 patients) and 4.29% (72 patients), respectively. In stage I analysis, hypothermia (OR = 1.92), tachypnea (OR = 4.94), lower systolic blood pressure (OR = 2.35), diabetes mellitus (OR = 1.87), leukocytosis (OR = 2.22), leukopenia (OR = 2.70), and a high percentage of segmented neutrophils (OR = 2.10) were associated with ICU admission. Bandemia had the highest odds ratio in the Stage I model (OR = 5.43). In stage II analysis, C-reactive protein (OR = 1.01), blood urea nitrogen (OR = 1.02) and stage I model’s S1 score were assocaited with in-hospital mortality. The area under the curve for the stage I and II model was 0.889 and 0.766, respectively.

Conclusions

The two-stage model is a efficient risk-stratification tool for predicting critical illness and mortailty. The model may be an optional tool other than qSOFA and SIRS criteria.

Peer Review reports

Background

Influenza has a long history worldwide, but remains a challenging issue in public health. Epidemic waves of seasonal influenza affect health institutes and governments every year. A modeling study investigating the number of influenza-associated respiratory deaths that occurred globally between 1999 and 2015 estimated that 291,243–645,832 respiratory deaths associated with seasonal influenza occurred each year (4.0–8.8 per 100,000 individuals). Mortality rates were highest among people aged 75 years or older (51.3–99.4 per 100,000 individuals) [1]. Influenza pandemics in 1918, 1957, 1968, 1977 and 2009 had catastrophic effects on the medical system and caused many deaths. In 1918, a pandemic caused by the virus H1N1 led to more than 50 million deaths worldwide [2]. In a 2009 pandemic caused by H1N1pdm09, the World Health Organization reported a global total of 18,449 laboratory-confirmed deaths by 1 August 2010 [3]. A modeling study implied that the true burden of mortality from H1N1pdm09 during the 2009 pandemic was probably even higher, with the authors estimating that respiratory mortality was about ten times higher than laboratory-confirmed mortality [4]. The mortality and morbidity associated with epidemic and pandemic influenza puts a heavy burden on hospitals, long-term care units, community clinics, and national health organizations by increasing admission rates. In addition, influenza has a major socioeconomic impact because it causes high levels of worker absenteeism and productivity loss. In the USA, the total economic burden of the 2003 influenza epidemic was US$87.1 billion and the annual burden per capita ranged from US$92 to US$299 [5]. In South Africa, the mean annual economic burden of influenza was estimated at US$270.5 million, while the mean annual burden per capita was US$5.1. The cost per capita in South Africa was lower than it was in European countries and the USA, but was similar to costs per capita in middle-income Asian countries [6].

Vaccines have been developed to reduce influenza infections and lessen the burden of influenza. The WHO recommends that four key populations be prioritized for influenza vaccination: pregnant women, children younger than 5 years of age, people aged 65 years and older, and individuals with underlying health conditions [7]. Vaccines are deployed by many countries each year. However, the protective capacity of a vaccine is affected by the degree of antigenic match between the vaccine and the circulating influenza strains. A vaccine may only provide 50–70% protection, especially in elderly people and people with chronic diseases [2]. This means that some populations are at risk for influenza infection even when a vaccination program is in place [2].

Most patients with mild influenza can be treated on an outpatient basis. Patients with severe influenza, in contrast, require hospitalization or even admission to intensive care units [8]. Influenza can lead to pneumonia, encephalitis, myocarditis, rhabdomyolysis, acute respiratory distress syndrome, and other severe complications, especially among young children (less than 5 years old), elderly people (older then 65 years old), and immunocompromised people [9].

It is crucial for frontline medical units, especially emergency departments (EDs) and urgent care units, to stratify patients with influenza infection by level of risk. Accurate identification of patients who can be safely discharged and patients who need to be admitted to hospital is important from both clinical and economic perspectives. Some studies have attempted to evaluate the efficacy of various tools for predicting risk of mortality in patients with influenza infection. The predictive tools assessed in these studies consider systemic inflammatory response syndrome (SIRS), quick Sequential Organ Failure Assessment scores (qSOFA), and clinical parameters like sex, age, triage category and underlying comorbidities [10,11,12,13,14]. In a single-center, retrospective cohort study conducted in Taiwan, Chu et al. reported that the area under the receiver operating characteristic curve (AUROC) of a qSOFA model for predicting in-hospital mortality in influenza patients was 0.864 [12]. The AUROC of a SIRS model was 0.786 [12]. However, there are discrepancies between the results of the various studies. There is no consensus that one tool is better than the others. Moreover, the primary outcome of the studies investigating the prognostic accuracy of qSOFA and SIRS is in-hospital mortality or 30-day mortality. In practice, frontline clinicians want to identify influenza patients who need admission or critical care in addition to patients who are at higher risk of mortality. Therefore, this study aimed to identify risk factors for needing critical care and to create a prediction model for critical care and in-hospital mortality.

Materials and methods

Data sources

We extracted data from the Chang Gung Research Database (CGRD) for this registry-based, retrospective cohort study. The CGRD is a de-identified database derived from the original electronic medical records of Chang Gung Memorial Hospital (CGMH), which is the largest hospital system in Taiwan. It is comprised of seven medical institutes and has 10,070 beds. In 2015, there were over 8,500,000 visits to the outpatient departments of the CGMH and 500,000 visits to the EDs [15]. The CGRD provided all the information required for our study, including patient vital signs, demographic details, laboratory test results, radiology reports, diagnoses, medical history, prescriptions, ED dispositions, and final dispositions of hospitalization and daily medical records. This eliminated the need to extract data manually from electronic medical records or charts. Diagnoses were made and recorded using ICD-10 codes. (For more information on diagnostic categories and clinical data, please refer to Supplementary Tables 1 and 2).

To ensure patients’ privacy, the hospital identification numbers of all patients were encrypted. Data are requested from CGRD via a formal query that is approved by an institutional committee and executed by an analyst. This study was based on a protocol approved by the institutional review board of Chang Gung Memorial Hospital. (201901325B0D001).

Study cohort

Between 2010 and 2016, a total of 6413 ED patients were diagnosed with influenza at the CGMH Linkou branch (ICD-10 codes: J09, J10, J11). We excluded patients who were under 18 years of age, had an unidentified virus type, or did not receive a complete blood count test. Ultimately, 1680 ED patients were included in the sample used for data analysis. If a patient was readmitted within 72 h, the admissions were treated as a single episode. We extracted these patients’ laboratory data and clinical outcomes from electronic medical records in the CGRD system (Fig. 1).

Fig. 1
figure 1

Flow chart of data extraction from Chang Gung Research Database (CGRD)

Outcome assessment

The primary outcome of this study was critical illness, which was defined as admission to the ICU or death from severe complicated influenza. The secondary analysis classified influenza patients according to cause of hospital admission and aimed to predict in-hospital mortality.

Covariates

We extracted patients’ age, sex, triage category, influenza type, laboratory data, baseline vital signs, underlying diseases, and outcomes from the CGRD. Laboratory data included complete blood count (CBC), white blood cell differential count, and levels of blood urea nitrogen (BUN), creatinine, aspartate transaminase (AST), alanine transaminase (ALT), C-reactive protein (CRP), sodium, potassium, and chloride. Supplementary Table 2 shows the cut-off values used for some variables in the predictive models, which were based on laboratory reference ranges and qSOFA and SIRS criteria.

Statistical analysis

For descriptive statistics, data on continuous variables are presented as mean and standard deviation or median and interquartile ranges. Data on categorical variables are presented as counts and percentages. The results of univariate analysis exploring predictors of critical illness (for all ED patients) and mortality (for patients admitted to hospital) are expressed as odds ratios (ORs) with 95% confidence intervals (CIs) determined through simple logistic regression. We developed a two-stage modeling method to predict hospital mortality in influenza patients. In the first stage, we constructed a multiple logistic regression model to predict the outcome of critical illness for all ED influenza patients. The variables included were age, sex, vital signs, history, and CBC test results. Stepwise regression was used to identify variables associated with risk. After the first model was constructed, we calculated S1 score to predict critical illness (in-hospital cardiac arrest and ICU admission). In the second stage, we used inpatient data, S1 score, and other laboratory test values to construct a backward multiple logistic regression model. At each stage, we built a nomogram to illustrate the prediction model. The concordance index, which was obtained from the area under the receiver operating curve (AUROC), was used to assess the predictive value of the model. Statistical analysis was completed using SAS 9.4 and R-Studio. A two-tailed p-value of less than 0.05 was considered statistically significant.

Validation

In order to evaluate the effect of the prediction model, validation is needed. Meanwhile, we also extracted data of Kaohsiung branch hospitals from CGRD for model validation according to the consistent inclusion/exclusion criteria. These two branches are both tertiary hospitals and totally separated in the way of patient source and geographic. Linkou branch is located in the northern part of Taiwan while Kaohsiung branch is located in the southern part of Taiwan. Therefore, the possibility of overlapping of patient source is minimum or negligible.

The data of 919 influenza patients has been compared with modeling group and described in the appendix (Supplementary Table 3). We also use the area under the curve (AUC) of a receiver operating curve (ROC) to evaluate stage I and stage II for validation prediction model.

Results

Patient inclusion and outcomes

A total of 1,183,266 patients visited the ED of the CGMH Linkou branch between 2010 and 2016. Within this group, 27,550 patients received a rapid diagnostic test for influenza and 6413 patients were diagnosed with influenza (Fig. 1). We chose to focus on the adult population, and therefore excluded 1782 patients who were younger than 18 years old. An additional 60 patients were excluded because the type of influenza was not recorded, and 2876 patients were excluded because CBC test data were missing. We eliminated six patients who were readmitted within 72 h to avoid duplication. Finally, we excluded one patient who died in the ED.

Consequently, the sample used in our analysis included 1680 patients. The sample was divided into two groups: patients who were discharged home and patients who were admitted to hospital. In total, 508 (30.2%) patients were admitted to the hospital, including 334 (65.7%) who were admitted to ordinary wards only and 174 (34.3%) who were transferred to the ICU. Of the patients treated in ordinary wards, 297 (89.0%) were discharged alive and 37 (11.0%) died in hospital. Of the patients transferred to the ICU, 139 (79.9%) were discharged alive and 35 (20.1%) died in hospital.

Data extraction

We extracted the clinical information for the 1680 patients from the CGRD. The information extracted included patients’ age, sex, triage category, influenza type, triage vital signs, and underlying comorbidities. We also extracted patients’ laboratory data, including complete blood count, white blood cell differential count, and biochemistry data (Table 1). The ICU admission rate was 10.36% (174/1680) while the mortality rate was 4.29% (72/1680). In our sample, 211 patients were in critical condition and were admitted to the ICU or died in hospital. The remaining 1469 patients were considered less critical and were discharged from the ED or discharged alive after receiving only general care in ordinary wards.

Table 1 Baseline characteristics of 1680 in influenza patients in ED

The mean age was 51.40 ± 19.45 years. Fifty-two percent were women. Most patients who visited the ED were classified as triage category III (n = 939 [55.89%]). Most of the patients tested had influenza A (n = 1311 [78.04%]) and the remainder had influenza B (n = 369 [21.96%]). The mean body temperature measured when initial vital signs were assessed for ED triage was 38.14 °C ± 1.24, which is considered febrile. One-hundred and fifty-six patients (9.29%) scored less than 15 points on the Glasgow coma scale, implying altered mental status. The median level of C-reactive protein was 28.56 mg/L, which is above the normal range.

Univariate analysis for predicting critical care and in-hospital mortality in patients diagnosed with influenza.

The results of the univariate analysis (Table 2) indicated that elderly people (> 65 years) were at higher risk of admission to the ICU (OR = 1.7, 95% CI). Analysis by sex showed that males were more likely to require critical care than were females (OR = 1.74, 95% CI:1.30–2.34). Patients with a history of comorbidities (e.g., hypertension, diabetes mellitus, coronary artery disease, stroke, ESRD, or intracerebral hemorrhage) were at higher risk of critical illness, with ORs ranging from 1.61 to 2.53 and all p-values less than 0.05.

Table 2 Univariate analysis for predicting Critical care in patients diagnosed with influenza

Out of 1680 patients in this study, 508 were hospitalized. Fourteen percent (72/508) died in hospital, either on the ward or in the ICU. We explored the laboratory data of hospitalized patients in more detail (Table 3). There were associations between in-hospital mortality and laboratory values, including creatinine (OR = 1.17, 95% CI:1.07–1.27), BUN (OR = 1.02, 95% CI:1.01–1.03) and CRP (OR = 1.01, 95% CI:1.001–1.010).

Table 3 Univariate analysis of Laboratory data for predicting in-hospital death in 508 admitted-to-ward patients

Two-stage model for predicting in-hospital mortality in influenza patients

Multiple logistic regression analysis was used to identify risk factors for admission to critical care and in-hospital mortality. These risk factors are summarized in Table 4. In the Stage I model predicting critical illness (i.e., requiring admission to the ICU), hypothermia (versus normal temperature) appeared to be a risk factor (OR = 1.92, 95% CI: 1.04–3.56). Tachypnea (OR = 4.94, 95% CI: 3.47–7.03), lower systolic blood pressure (OR = 2.35 95% CI: 1.25–4.43), diabetes mellitus (OR = 1.87, 95% CI: 1.28–2.72), leukocytosis (OR = 2.22, 95% CI: 1.45–3.38), leukopenia (OR = 2.70, 95% CI: 1.56–4.66), and a high percentage of segmented neutrophils (OR = 2.10, 95% CI: 1.39–3.16) were also associated with admission to critical care in our analysis. Bandemia was associated with the highest odds ratio in the Stage I model (OR = 5.43, 95% CI: 3.27–9.01).

Table 4 Two-Stage model estimates by multiple logistic regression

In the Stage II model predicting in-hospital cardiac arrest, we used laboratory data and the Stage I model’s S1 score for critical illness to predict in-hospital mortality using multiple logistic regression. Backward selection showed that after adjustment CRP and BUN were significant risk factors for in-hospital mortality. Figure 2 shows the nomogram for the two models, allowing for rapid estimation of risk in clinical practice.

Fig. 2
figure 2

Nomogram: scoring system for predicting risk of critical illness (a) and in-hospital death (b)

After developing our 2-stage prediction model, we used data of Kaohsiung branch hospital for validation. The AUC for the stage I model (S-I AUC) for predicting critical illness was 0.889 when using validation data. The AUC for the stage II model (S-II AUC) for predicting in-hospital mortality was 0.766 when using validation data.

Discussion

Many scoring systems and parameters are used to predict the prognosis of sepsis patients. However, only a few focus on influenza patients. After the Third International Consensus Definitions for Sepsis and Septic Shock proposed the use of qSOFA to assess the prognosis of sepsis patients in 2016 [16], there were many studies comparing the accuracy of qSOFA and SIRS. Several studies focused on influenza patients. In general, qSOFA scores were considered superior to SIRS for predicting mortality risk in influenza patients [12, 13]. However, SIRS criteria remain useful for identifying infection and predicting prognosis. Several predictors identified in our study, including body temperature (BT), respiratory rate (RR), and white blood count (WBC), are among the clinical criteria for systemic inflammatory response syndrome (SIRS). Furthermore, systolic blood pressure is a criterion used in qSOFA. However, our predictive model showed no significant association between hyperthermia (BT > 38 °C) and the outcomes of interest. This is not compatible with SIRS criteria.

The debate on the biological significance of fever has been no consensus since the time of Hippocrates. Romanovsky and Szekely [17] proposed that fever as part of early phase syndrome of infection, which also included hyperalgesia, weakness, hypertension, motor agitation as an adaptation of infection develops in organism. The late phase syndrome, as the disease already progressed, may presents hypothermia, hypoalgesia, motor depression, normo- or hypotension. The late phase syndrome represents that energy saving strategies of organism, as a result of energy resources have been reduced by the costly early phase syndrome. Thus, hypothermia may be a sign of disease progression. However, the causative relationship between the thermoregulatory manifestations is beyond the scope of the objective of our study. A meta-analysis [18] reported that septic patients with fever estimated mortality rate was ~ 22%, which was higher (~ 31%) in normothermic patients, while it was the highest (~ 47%) in the hypothermic patients. In a retrospective study [19], if found that sepsis patients with hypothermia within 24 h is associated with increased short- (day 28) and long-term (1 year) mortality. The study also proposed that hypothermia maybe a useful prognostic factor for sepsis-induced immunosuppression. Therefore, it is reasonable to consider and explain that hypothermia is a poor prognosis factor in infection or sepsis patients.

Diabetes mellitus is thought to be associated with sepsis-related outcomes. A systematic review and meta-analysis including 234 articles and a total of 610,782 participants evaluated risk factors for severe outcomes in patients with seasonal and pandemic influenza [20]. The study reported that diabetes mellitus was associated with a higher risk of ICU admission and mortality in pandemic influenza (OR = 2.21, 95% CI: 1.37–3.58). However, for seasonal influenza, diabetes mellitus was associated only with a higher risk for hospital admission. In our model, bandemia was the strongest predictor and had the highest OR. This finding is compatible with the geriatric influenza death (GID) score developed by Chung, C.Y. et al. for predicting mortality in older people with influenza in the ED [21]. Their retrospective study used scores comprised of five independent predictors, including bandemia. As in our study, bandemia had the highest OR (OR = 7.97, 95% CI: 2.14–29.65). However, their study population was limited to people over 65 years old and the cut-off value for bandemia differed from that used in our study (3% versus 10%).

SIRS criteria and qSOFA scores have been used to predict outcomes for influenza patients in the ED. Chu, S. E et al. conducted a retrospective study that included 3561 ED patients with positive influenza tests and reported that qSOFA was a useful predictor of prognosis for influenza patients (12). When qSOFA scores were greater than or equal to three, qSOFA showed high specificity for ICU admission (sensitivity 3.2%, specificity 99.7%) and mortality (OR = 22.46, 95% CI: 4.33–116.61; sensitivity 1.3%, specificity 99.7). However, it may not be a good tool for screening and triage because of its poor sensitivity. A retrospective study conducted by Tai et al. recruited 409 geriatric patients in the ED and reported that SIRS scores greater than or equal to three showed moderate performance for prediction of mortality (OR = 3.37, 95% CI: 1.05–10.73; sensitivity 60%, specificity 70%). Other studies have challenged the value of qSOFA and SIRS criteria in predicting mortality and complications in the ED, even in sepsis patients [22, 23].

In the present study, we developed a two-stage model to predict outcomes in different patient groups. The model enabled excellent and detailed risk stratification. In the stage I model, we calculated the risk of ICU admission based on body temperature, respiration, systolic blood pressure, diabetes mellitus, and white blood cell differential count, omitting multiple serum biomarkers. In stage II, we aimed to identify admitted patients who were at higher risk of in-hospital mortality using the results of additional laboratory tests (Fig. 2). Risks could be calculated using S1 score, blood urea nitrogen, and C-reactive protein level. The model had excellent discrimination and a good fit. The receiver operating characteristic (ROC) curves for critical illness and in-hospital mortality are shown in Fig. 3. The area under the curve (AUC) for our stage I model predicting critical illness was 0.856. The AUC for the stage II model predicting in-hospital mortality was 0.757, indicating that the two-stage model had excellent discrimination.

Fig. 3
figure 3

Model prediction assessment for analyzed data (Linkou branch) and validation data (the other 5 branches)

Limitations

Although this single-center retrospective study had a large sample size and is of significant value, it has some limitations. The Linkou branch of the CGMH is a tertiary hospital in northern Taiwan. Our validation data came from the Kaohsiung branch of the CGMH, which is another tertiary hospital in the south of Taiwan. The severity of comorbidities and the prevalence of specific diseases are significantly higher in the CGRD than in Taiwan’s general population, which may have biased our study. The model may need to be applied with caution in smaller medical settings. However, our data came from the CGRD (168,000 cases visiting the ED per year); thus, our model is still strongly predictive of critical care admission and in-hospital mortality.

Conclusion

The two-stage model is an efficient and excellent risk-stratification tool for predicting critical illness and mortality. The model may be an optional tool other than qSOFA and SIRS criteria for helping clinical physicians with the disposition of ED patients with influenza.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ALT:

Alanine transaminase

AST:

Aspartate transaminase

AUC:

Area under the curve

AUROC:

Area under the receiver operating characteristic curve

BT:

Body temperature

BUN:

Blood urea nitrogen

CBC:

Complete blood count

CGMH:

Chang Gung Memorial Hospital

CGRD:

Chang Gung Research Database

CI:

Confidence intervals

CRP:

C-reactive protein

EDs:

Emergency departments

ORs:

Odds ratios

qSOFA:

Quick Sequential Organ Failure Assessment

ROC:

Receiver operating characteristic

RR:

Respiratory rate

SIRS:

Systemic inflammatory response syndrome

WBC:

White blood count

References

  1. Iuliano AD, Roguski KM, Chang HH, Muscatello DJ, Palekar R, Tempia S, et al. Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. Lancet. 2018;391(10127):1285–300. https://doi.org/10.1016/S0140-6736(17)33293-2.

    Article  PubMed  Google Scholar 

  2. Kageyama S. Pandemic influenza: a never-ending story. Yonago Acta Med. 2011;54(3):41–8.

    PubMed  PubMed Central  Google Scholar 

  3. WHO. https://www.who.int/csr/don/2010_08_06/en/. Accessed 23 Dec 2020.

  4. Simonsen L, Spreeuwenberg P, Lustig R, Taylor RJ, Fleming DM, Kroneman M, et al. Global mortality estimates for the 2009 influenza pandemic from the GLaMOR project: a modeling study. PLoS Med. 2013;10(11):e1001558. https://doi.org/10.1371/journal.pmed.1001558.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Klepser ME. Socioeconomic impact of seasonal (epidemic) influenza and the role of over-the-counter medicines. Drugs. 2014;74(13):1467–79. https://doi.org/10.1007/s40265-014-0245-1.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Tempia S, Moyes J, Cohen AL, Walaza S, Edoka I, McMorrow ML, et al. Health and economic burden of influenza-associated illness in South Africa, 2013-2015. Influenza Other Respir Viruses. 2019;13(5):484–95. https://doi.org/10.1111/irv.12650.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Sullivan SG, Price OH, Regan AK. Burden, effectiveness and safety of influenza vaccines in elderly, paediatric and pregnant populations. Ther Adv Vaccines Immunother. 2019;7:2515135519826481.

    PubMed  PubMed Central  Google Scholar 

  8. Choi WS, Baek JH, Seo YB, Kee SY, Jeong HW, Lee HY, et al. Severe influenza treatment guideline. Korean J Intern Med. 2014;29(1):132–47. https://doi.org/10.3904/kjim.2014.29.1.132.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Kalil AC, Thomas PG. Influenza virus-related critical illness: pathophysiology and epidemiology. Crit Care. 2019;23(1):258. https://doi.org/10.1186/s13054-019-2539-x.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Alshahrani M, Alsubaie A, Alshamsy A, Alkhliwi B, Alshammari H, Alshammari M, et al. Can the emergency department triage category and clinical presentation predict hospitalization of H1N1 patients? Open Access Emerg Med. 2019;11:221–8. https://doi.org/10.2147/OAEM.S204110.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Chang SH, Yeh CC, Chen YA, Hsu CC, Chen JH, Chen WL, et al. Quick-SOFA score to predict mortality among geriatric patients with influenza in the emergency department. Medicine (Baltimore). 2019;98(23):e15966. https://doi.org/10.1097/MD.0000000000015966.

    Article  Google Scholar 

  12. Chu SE, Seak CJ, Su TH, Chaou CH, Tseng HJ, Li CH. Prognostic accuracy of SIRS criteria and qSOFA score for in-hospital mortality among influenza patients in the emergency department. BMC Infect Dis. 2020;20(1):385. https://doi.org/10.1186/s12879-020-05102-7.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Papadimitriou-Olivgeris M, Gkikopoulos N, Wust M, Ballif A, Simonin V, Maulini M, et al. Predictors of mortality of influenza virus infections in a Swiss hospital during four influenza seasons: role of quick sequential organ failure assessment. Eur J Intern Med. 2020;74:86–91. https://doi.org/10.1016/j.ejim.2019.12.022.

    Article  PubMed  Google Scholar 

  14. Tai HC, Yeh CC, Chen YA, Hsu CC, Chen JH, Chen WL, et al. Utilization of systemic inflammatory response syndrome criteria in predicting mortality among geriatric patients with influenza in the emergency department. BMC Infect Dis. 2019;19(1):639. https://doi.org/10.1186/s12879-019-4288-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Tsai MS, Lin MH, Lee CP, Yang YH, Chen WC, Chang GH, et al. Chang gung research database: a multi-institutional database consisting of original medical records. Biom J. 2017;40(5):263–9.

    Google Scholar 

  16. Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, et al. Assessment of clinical criteria for Sepsis: for the third international consensus definitions for Sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):762–74. https://doi.org/10.1001/jama.2016.0288.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Romanovsky AA, Székely M. Fever and hypothermia: two adaptive thermoregulatory responses to systemic inflammation. Med Hypotheses. 1998;50(3):219–26. https://doi.org/10.1016/S0306-9877(98)90022-6.

    Article  CAS  PubMed  Google Scholar 

  18. Rumbus Z, Garami A. Fever, hypothermia, and mortality in sepsis: Comment on: Rumbus Z, Matics R, Hegyi P, Zsiboras C, Szabo I, Illes A, Petervari E, Balasko M, Marta K, Miko A, Parniczky A, Tenk J, Rostas I, Solymar M, Garami A. Fever is associated with reduced, hypothermia with increased mortality in septic patients: a meta-analysis of clinical trials. PLoS One. 2017;12(1):e0170152. https://doi.org/10.1371/journal.pone.0170152 Temperature (Austin) 2018, 6(2):101–103.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Drewry AM, Fuller BM, Skrupky LP, Hotchkiss RS. The presence of hypothermia within 24 hours of sepsis diagnosis predicts persistent lymphopenia. Crit Care Med. 2015;43(6):1165–9. https://doi.org/10.1097/CCM.0000000000000940.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Mertz D, Kim TH, Johnstone J, Lam PP, Science M, Kuster SP, et al. Populations at risk for severe or complicated influenza illness: systematic review and meta-analysis. BMJ. 2013;347(aug23 1):f5061. https://doi.org/10.1136/bmj.f5061.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Chung JY, Hsu CC, Chen JH, Chen WL, Lin HJ, Guo HR, et al. Geriatric influenza death (GID) score: a new tool for predicting mortality in older people with influenza in the emergency department. Sci Rep. 2018;8(1):9312. https://doi.org/10.1038/s41598-018-27694-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. Tusgul S, Carron PN, Yersin B, Calandra T, Dami F. Low sensitivity of qSOFA, SIRS criteria and sepsis definition to identify infected patients at risk of complication in the prehospital setting and at the emergency department triage. Scand J Trauma Resusc Emerg Med. 2017;25(1):108. https://doi.org/10.1186/s13049-017-0449-y.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Askim A, Moser F, Gustad LT, Stene H, Gundersen M, Asvold BO, et al. Poor performance of quick-SOFA (qSOFA) score in predicting severe sepsis and mortality - a prospective study of patients admitted with infection to the emergency department. Scand J Trauma Resusc Emerg Med. 2017;25(1):56. https://doi.org/10.1186/s13049-017-0399-4.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The authors received no specific funding for this work.

Author information

Authors and Affiliations

Authors

Contributions

CYC conceived and designed the study. CWC, CLC and CYC undertook data acquisition, carried out data analysis and data interpretation. HJT and KHH provided statistical expertise. CWC and CLC wrote the manuscript draft. CHL, CJS, CJN and CYC undertook critical revision of the manuscript for important intellectual content. All authors read and approved the final version of this manuscript.

Corresponding author

Correspondence to Cheng-Yu Chien.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Institute Review Board, Chung Gang Memorial Hospital (201901325B0D001). We confirm that all methods were performed in accordance with the relevant guidelines and regulations from the Institute Review Board. Informed consent for study participation is not applicable because all the patient data extracted from the Chang Gung Research Database in this study was anonymized and de-identified.

Consent for publication

Not applicable. All patient data were retrieved from the Chang Gung Research Database (CGRD), de-identified, and encrypted to protect patient confidentiality.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary Table 1.

ICD9/10 of disease.

Additional file 2: Supplementary Table 2. 

Cut-off values and references of the data.

Additional file 3: Supplementary Table 3.

Information from validation data compared with modeling data.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cheong, CW., Chen, CL., Li, CH. et al. Two-stage prediction model for in-hospital mortality of patients with influenza infection. BMC Infect Dis 21, 451 (2021). https://doi.org/10.1186/s12879-021-06169-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-021-06169-6