Skip to main content
Download PDF

Predicting progression to severe COVID-19 using the PAINT score

BMC Infectious Diseases volume 22, Article number: 498 (2022) Cite this article

Abstract

Objectives

One of the major challenges in treating patients with coronavirus disease 2019 (COVID-19) is predicting the severity of disease. We aimed to develop a new score for predicting progression from mild/moderate to severe COVID-19.

Methods

A total of 239 hospitalized patients with COVID-19 from two medical centers in China between February 6 and April 6, 2020 were retrospectively included. The prognostic abilities of variables, including clinical data and laboratory findings from the electronic medical records of each hospital, were analysed using the Cox proportional hazards model and Kaplan–Meier methods. A prognostic score was developed to predict progression from mild/moderate to severe COVID-19.

Results

Among the 239 patients, 216 (90.38%) patients had mild/moderate disease, and 23 (9.62%) progressed to severe disease. After adjusting for multiple confounding factors, pulmonary disease, age > 75, IgM, CD16+/CD56+ NK cells and aspartate aminotransferase were independent predictors of progression to severe COVID-19. Based on these five factors, a new predictive score (the ‘PAINT score’) was established and showed a high predictive value (C-index = 0.91, 0.902 ± 0.021, p < 0.001). The PAINT score was validated using a nomogram, bootstrap analysis, calibration curves, decision curves and clinical impact curves, all of which confirmed its high predictive value.

Conclusions

The PAINT score for progression from mild/moderate to severe COVID-19 may be helpful in identifying patients at high risk of progression.

Peer Review reports

Introduction

In December 2019, a cluster of pneumonia cases of unknown origin was reported in Wuhan [1, 2]. The pathogen of the novel pneumonia was identified to be a novel β-coronavirus, currently named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), and has close phylogenetic similarity to SARS-CoV [3]. SARS-CoV-2 infection has been named coronavirus disease 2019 (COVID-19) by the World Health Organization (WHO) [4].

COVID-19 has now become a worldwide health concern. The estimated overall case-fatality rate for COVID-19 is approximately 1–2.3%, which is similar to that of Spanish influenza (2–3%) and much higher than that of seasonal influenza (0.1%) [5,6,7]. The severity of COVID-19 has been classified as mild, moderate, severe and critical per the WHO-China Joint Mission [8]. Among a total of 72 314 case records from the Chinese Center for Disease Control and Prevention, approximately 81% of COVID-19 cases were defined as mild, 14% of COVID-19 cases were severe, and 5% were critical [5]. The overall hospital mortality of COVID-19 cases is approximately 15–20%, but it is up to 40–49% among critical cases requiring intensive care unit admission [2, 5]. Therefore, it is important to evaluate the risk factors for disease progression in COVID-19 patients. Early identification of COVID-19 patients with possible progression of the disease is particularly important for optimal treatment choice and reducing mortality.

Studies have revealed some changes in haematologic and immunologic tests and have investigated risk factors for mortality and outcomes in patients with COVID-19 [2, 7, 9,10,11,12,13]. Older age, high Sequential Organ Failure Assessment (SOFA) score, d-dimer greater than 1 µg/mL, lymphocytopenia and history of coronary vascular disease were reported to increase the risk of death in patients with COVID-19 [7, 9,10,11].

Moreover, score prediction models, such as prognostic nutritional index (PNI), Systemic immune-inflammatory index (SII) have been used to predict prognosis in COVID-19 patients and other diseases [14,15,16,17,18]. However, the risk factors related to the progression of COVID-19 symptoms from mild/moderate to severe are still limited and need to be assessed. The immune response and inflammatory cytokines are important to analyse to elucidate the mechanisms of host responses and pathogenesis of COVID-19 [10, 19,20,21]. In addition to decreased T cells, natural killer (NK) cell immunotypes were recently reported to be related to COVID-19 disease severity [19, 22]. We enrolled patients with COVID-19 from two medical centres in China and aimed to evaluate the risk factors for progression to severe-stage disease based on the new combined score including NK cell information.

Materials and methods

Study design and participants

This study was a retrospective, multicentre study. Laboratory-confirmed COVID-19 admitted cases from Renmin Hospital of Wuhan University and West China Hospital of Sichuan University were reviewed. We included adult patients (aged ≥ 18 years) admitted between February 6 and April 6, 2020, with SARS-CoV-2 infection confirmed by RT-PCR. Informed consent was exempted because it was reported as grouped data with no identifying factors.

The diagnosis of COVID-19 was made according to the WHO interim guidance [23]. The severity of COVID-19 was assessed according to the Seventh Version of the Novel Coronavirus Pneumonia Diagnosis and Treatment Guidance from the National Health Commission of China [24]. According to the guidelines, patients were categorized into the mild, moderate, severe, or critical group upon admission [24].

Data collection

The clinical data, laboratory data and radiological data of all COVID-19 patients were obtained from the electronic medical records of the treating hospital. Data were reviewed and verified by a team of physicians (Dongbo Wu, Wei Jiang, Changhai Liu, Ming Wang and Lang Bai). Any missing or unclear records were collated and clarified through communication with local medical staff or patients and their families.

Detailed demographic information, comorbidities, symptoms, and disease severity of all patients were recorded or diagnosed on admission. Clinical and virological characteristics were recorded, e.g., age, sex, past medical history, and clinical findings, e.g., white blood cell (WBC) count, neutrophil count (NEU), lymphocyte count (LYM), haemoglobin (HGB), platelet count (PLT), prothrombin time (PT), D-dimer, alanine aminotransferase (ALT), aspartate aminotransferase (AST), γ-glutamyl transpeptidase (GGT), albumin (ALB), total bilirubin (TBIL), direct bilirubin (DBIL), uric acid (UA), creatinine (Cr), creatine kinase (CK), lactate dehydrogenase (LDH), brain natriuretic peptide (BNP), procalcitonin (PCT), c-reactive protein (CRP), neutrophils/lymphocyte ratio (NLR), other biochemical parameters and SARS-CoV2 RNA test results. There were no cases lost to follow-up in this study.

Statistical analysis

The baseline clinical characteristics and outcomes of the patients were assessed. Categorical data are presented as frequencies (percentages); continuous variables are presented as medians (range, minimum–maximum). The demographic, clinical and laboratory characteristics of COVID-19 patients were compared among groups. The Mann–Whitney U test was used to compare continuous variables. The χ2 test with Yates’ correction was used for 2 × 2 contingency data, and Pearson’s χ2 test was used for contingency data for variables with more than two categories.

To explore risk factors, or their interactions, associated with COVID-19 severity, univariable and multivariable logistic regression models were used to estimate odds ratios (ORs) and 95% confidence intervals (CIs). A Cox proportional hazards model was constructed sequentially introduced variables, and a significance level of p > 0.05 was used to remove variables from the model. Final model selection was performed by backward selection of all factors. Schoenfeld and Martingale residuals were used to check the proportional hazards assumption and nonlinearity, respectively.

Survival curves were compared using the Kaplan–Meier method (log-rank test) since time-to-mortality and time-to-event are crucial in interpreting the results. Estimates of adjusted hazard ratios (HRs), 95% CIs, and p values are displayed. Harrell’s concordance index (C-index) was used to assess the score’s discrimination ability. C-index values and the corresponding 95% CIs were estimated for each main study time point. In addition, bootstrapping, calibration curves, decision curves and clinical impact curves were applied to verify the nomogram. A two-sided p < 0.05 was considered statistically significant. All statistical analyses were performed using R software (version 3.5.2, http://CRAN.R-project.org, R Foundation, Vienna, Austria).

Ethics approval and consent to participate

This study was approved by the Ethics Committee of West China Hospital of Sichuan University (NO. 2020-444) and was allowed exemption from the requirement of informed consent. All research was conducted in accordance with the Declaration of Helsinki. Raw data generated or analysed during this study are provided in Additional file 8. 

Results

Demographic and clinical characteristics of the study population

A total of 239 COVID-19 patients were included in this study. In the present cohort, 216 (90.38%) patients had mild/moderate disease, and 23 (9.62%) patients experienced progression to severe disease. The demographic and clinical characteristics of the study population are presented in Table 1. The median age was 58 years (range 26–90 years), and 58.20% (139/239) were male. The median maximum temperature was 38 °C (range 36.0–41.0).

Table 1 Demographic and clinical characteristics of the study population
Full size table

When comparing demographic data at admission, patients with progression to severe disease were more likely to be male and older aged (> 75 years) than patients without progression (p < 0.05, Table 1). The clinical manifestations were mainly as follows (Table 1): fever 77.8% (186/239), cough 60.3% (144/239), expectoration 23.8% (57/239), dyspnoea 10.5% (25/239), chest pain 4.6% (11/239), angina 4.2% (11/239), fatigue 28.5% (68/239), myalgia 9.2% (22/239), headache 5.0% (12/239), vomiting 1.7% (4/239) and diarrhoea 18% (43/239).

The clinical characteristics of the study population are summarized in Table 2. When comparing biochemical indexes of COVID-19 between moderate cases with and without progression, we found that there were significant differences in lymphocytes, NLR, CRP, AST, TBIL, DBIL, Cr, urea, glucose, sodium, PT, CD3+ T cells, CD4+ T cells, CD8+ T cells, CD19+ T cells, CD16+/ CD56+ NK cells between patients with and without progression (all p < 0.05); detailed information are listed in Table 2.

Table 2 The lab test and clinical characteristics of the study population
Full size table

Univariant and multivariant Cox regression model for progression from mild/moderate to severe disease

When exploring risk factors for progression from mild/moderate to severe COVID-19, we compared the demographic and clinical data of moderate cases and cases with progression to severe disease. Using univariant and multivariant Cox regression models, the results showed a significant difference in pulmonary disease (11.20, 95% CI 2.50–49.70, p = 0.001), age over 75 (3.92, 95% CI 1.61–9.73, p = 0.003), IgM (6.31, 95% CI 1.99–19.60, p = 0.002), CD16+/CD56+ NK cells (3.40, 95% CI 1.31–9.13, p = 0.014) and AST (4.60, 95% CI 1.31–16.00, p = 0.018) (Table 3), which were the 5 independent risk factors for progression from mild/moderate to severe disease (Fig. 1). However, there were no significant impacts by other variables in our study population (see Additional file 6: Table S1). We also used the global Schoenfeld test of Cox diagnostic deviance and Cox proportional hazards model fit to evaluate these five independent risk factors for progression from mild/moderate to severe disease, which suggested good performance (see Additional file 1: Fig. S1, Additional file 2: Fig. S2, Additional file 3: Fig. S3).

Table 3 Univariant and multivariant COX regression model for progression from mild/moderate cases into severe case
Full size table
Fig. 1
figure 1

Forest plot of significant factors in the Cox proportional hazards regression model. Shown in the figure are the HR and the 95% CI associated with the end point

Full size image

Moreover, the Kaplan–Meier survival curve analysis and log-rank test showed a significant difference in survival curve in COVID-19 patients categorized by pulmonary disease, age, IgM, CD16 + /CD56 + NK cells and AST (see Additional file 4: Fig. S4a–e).

Development of a predictive score for progression from moderate to severe disease

Predictors including pulmonary disease, age, IgM, CD16 + /CD56 + NK cells and AST were enrolled in the development of predictive scores for COVID-19 patient progression from mild/moderate to severe disease. The new predictive score (pulmonary disease, age, IgM, CD16+/CD56+ NK cell, AST; PAINT score) = (pulmonary disease) × 2.4174 + (age > 75) × 1.3594 + (IgM < 0.84) × 1.8399 + (CD16+/CD56+ NK cell < 116.5) × 1.2246 + (AST > 25) × 1.5182.

The points contributing to each variable are shown in Additional file 5: Fig. S5. To demonstrate the ability of the new predictive score to identify more severe patients for early clinical treatment, Kaplan–Meier survival curve analysis was used to find the best cut-off value; a value of 14.687 points was found to divide the patients into mild/moderate and progression to severe disease groups (P = 0.001, Fig. 2).

Fig. 2
figure 2

Kaplan–Meier survival curve analysis of the PAINT score

Full size image

We performed ROC analysis to evaluate the efficacy of the PAINT score model for predicting COVID-19 patients’ progression from mild/moderate to severe disease. We compared the PAINT score with the qSOFA and CURB-65 (confusion, uraemia, respiratory rate, BP, age > 65 years) scores. As demonstrated in Fig. 3, the C-index of the new predictive progression model for predicting progression from mild/moderate to severe disease was 0.902 ± 0.021. However, the C-index of the qSOFA and CURB-65 scores for the prediction of progression was 0.534 ± 0.027 and 0.561 ± 0.058, respectively. We also compared the new predictive progression model with the 5 independent risk factors (pulmonary disease, age, IgM, CD16 + /CD56 + NK cells and AST), and the C-index for the prediction of progression was 0.5432 ± 0.034, 0.639 ± 0.052, 0.683 ± 0.044, 0.647 ± 0.050 and 0.716 ± 0.036, respectively (see Additional file 7: Table S2). Moreover, we evaluated the predictive value of the PNI and SII score in our study population, the C-index was 0.814 ± 0.042 and 0.769 ± 0.039, respectively (see Additional file 7: Table S2). These findings suggested that the PAINT score might be suitable for predicting progression from mild/moderate to severe disease.

Fig. 3
figure 3

ROC analysis was used to evaluate the efficacy of the PAINT score model for predicting COVID-19 patients’ progression from mild/moderate to severe disease. C-index values and the corresponding 95% CIs were estimated for each of the main study time points to assess the score’s discrimination ability. P values represent the statistical significance of the differences between the new score and the other prognostic score or factor

Full size image

For internal validation of the ability of the new predictive progression model, we performed concordance index analysis to evaluate the discrimination of the PAINT score. Better discrimination was observed with our PAINT score than with the qSOFA and CURB-65 scores (Fig. 4a). Moreover, we performed 1000 bootstrap internal validations, and our new predictive PAINT score also showed better discrimination (Fig. 4b).

Fig. 4
figure 4

For internal validation of the discriminability of the PAINT score model, we performed concordance index analysis (A) and 1000 bootstrap replicates (B)

Full size image

Nomogram, calibration, decision curve and clinical impact curve for progression from mild/moderate to severe disease

In our study population, we used 5 variables (pulmonary disease, age, IgM, CD16 + /CD56 + NK cells and AST) to predict 28-day progression from mild/moderate to severe disease. According to the principles of nomogram score construction, each variable is given different points and weights. The nomogram score is shown in Fig. 5a. We evaluated the score of each variable in turn according to its clinical characteristics and examination results and then summarized the score according to the total score of the 5 variables. Based on the total score, the probability of progression to severe COVID-19 can be determined. The calibration curves for 28-day progression were also well defined in the internal validation set (Fig. 5b). Nomogram and decision curve analyses also indicated good performance of the PAINT score (Fig. 5c). Clinical impact curves were used to assess the clinical usefulness of the risk prediction nomogram (Fig. 5d).

Fig. 5
figure 5

Nomogram, calibration curve, decision curves and clinical impact curves for progression from mild/moderate to severe disease. a Nomogram. To use the nomogram, the value of an individual patient is located on each variable axis, and a line is drawn upward to determine the number of points received for each variable value. The sum of these numbers is located on the total point axis, and a line is drawn downward to the survival axes to determine the likelihood of 28-day progression to severe disease. b Calibration. The nomogram-predicted probability of nonsevere survival is plotted on the x-axis, and that of actual nonsevere survival is plotted on the y-axis. c Decision curve. The abscissa of this graph is the threshold probability, and the ordinate is the net benefit. d Clinical impact curve. The red curve (number of high-risk individuals) indicates the number of people who are classified as positive (high risk) by the model at each threshold probability; the blue curve (number of high-risk individuals with outcome) is the number of true positives at each threshold probability

Full size image

Discussion

By using univariant and multivariant Cox regression models, we identified five independent risk factors (pulmonary disease, age, IgM, CD16+/CD56+ NK cell and AST) for progression to severe COVID-19 in the present study. We developed a new predictive score, the PAINT score, for progression to severe disease and found that a value of 14.687 points divided the patients into mild/moderate and progression to severe disease groups. We also established a new nomogram score to predict 28-day progression from mild/moderate to severe disease. These results may be important to predict progression of moderate COVID-19 to severe disease and may be helpful in identifying cases of potential progression in a timely manner to improve the prognosis.

SARS-CoV-2 is a single-stranded RNA virus that infects cells through its structural spike (S) protein binding the angiotensin-converting enzyme 2 (ACE2) receptor [25]. Then, the type 2 transmembrane serine protease (TMPRSS2) receptor cleaves ACE2, activating the S protein, which promotes virus uptake and mediates SARS-CoV-2 entry into host cells [2, 25]. Both ACE2 and TMPRSS2 are expressed in host cells, particularly the alveolar epithelial type II cells of COVID-19 patients [20]. COVID-19 has various clinical manifestations, and the common symptoms in hospitalized patients include fever (70–90%), dry cough (60–86%), shortness of breath (53–80%), fatigue (38%), myalgias (15–44%), nausea/vomiting or diarrhoea (15–39%), headache, weakness (25%), and rhinorrhoea (7%) [2]. In a retrospective study of 548 patients with COVID-19 in China, most patients with severe/critical and fatal disease presented with sputum and dyspnoea much more often than those with mild/moderate disease on admission who survived [4]. Eighty-one percent of patients had mild manifestations, 14% had severe manifestations, and 5% had critical manifestations (defined as respiratory failure, septic shock, and/or multiple organ dysfunction). A study of 20,133 hospitalized patients in the UK reported that the most common major comorbidities were chronic cardiac disease (30.9%), diabetes (20.7%), chronic pulmonary disease excluding asthma (17.7%), and chronic kidney disease (16.2%) [26]. In our study population, the most common major comorbidity was pulmonary disease. Moreover, we found that pulmonary disease was an independent risk factor for progression to severe COVID-19. The limited sample size may be responsible for this difference with the previous UK report [26].

We used Cox regression methods to explore the risk factors related to progression to severe COVID-19. Risk factors related to progression were reported in nonsevere COVID-19 patients, such as lymphocyte count, neutrophil count, CD4+ and CD8+ T cell counts, CRP, D-dimer, interleukin-6, interleukin-8, lactate dehydrogenase, age, dyspnoea on admission, and hypertension [10, 27,28,29]. From the present study, there were significant differences in lymphocytes, NLR, CRP, AST, Cr, CD3+ T cells, CD4+ T cells, CD8+ T cells, CD19+ T cells, and CD16+/CD56+ NK cells in mild/moderate COVID-19 cases with and without progression. We also found that pulmonary comorbidities had an impact on the risk of progression. In another study, four variables (comorbidity, dyspnoea on admission, lactate dehydrogenase and lymphocyte count) were included in a predictive model. A total score of 6 points was used to divide patients into high-risk and low-risk groups [27]. Moreover, the risk factors for progression to severe illness in COVID-19 patients with cancer not only included the previous variables of older age, interleukin 6, procalcitonin, D-dimer, and lymphocytes but also included tumour stage, tumour necrosis factor α, N-terminal pro-B-type natriuretic peptide, CD4+ T cells and albumin–globulin ratio [12, 13, 30]. Many reports have linked diabetes and obesity to more severe COVID-19 illness and worth progress [31]. In our study cohort, 10.5% patients had diabetes mellitus, including 9.3% in patients without progression and 21.7% in patients with progression. However, there was no significant difference of diabetes in patients with and without progression. This may be because of our sample size. It is necessary to further expand the sample size in the future study.

There were many predict score models for disease severity in COVID-19 patients, including early warning score, National Early Warning Score 2, q-COVID score, prognostic nutritional index score, Brescia‑COVID Respiratory Severity Scale score, systemic immune-inflammatory index score, COVID-GRAM score, etc. [18, 32,33,34] However, the important information of immune cells was not involved. To predict the risk of progression, we developed the new, predictive PAINT score which contained the NK cells. Using a value of 14.687 points, we could divide the patients into mild/moderate and progression to severe disease groups, with a higher C-index (0.902 ± 0.021) than that obtained with the qSOFA (0.534 ± 0.027), CURB-65 scores (0.561 ± 0.058), PNI score (0.814 ± 0.042) and SII score (0.769 ± 0.039). The internal validation of discrimination and 1000 bootstrap replicates showed the good ability of our new predictive progression model. Moreover, other risk models for COVID-19 death or mortality were reported and evaluated, such as APACHE II, SIRS, SOFA, qSOFA, COVID-19 score, COVID-PIRO score, the COVID-19 Risk of Complications Score, Pneumonia Severity Index, etc. [35,36,37,38] The Specification and validation of COVID-19 scoring systems should be performed and verified in the large real-world cohort study in the future.

The immune response to SARS-CoV-2 is key for the control and resolution of COVID-19 infection. T cells also play important roles in the immune response to SARS-CoV-2 infection. Lymphocytopenia was found to be one of the most common features in laboratory tests of COVID-19 patients, and reduced CD4+ and CD8+ T cell counts were predictive of disease progression [10, 11]. In addition to decreased levels of CD3+/CD4+ T lymphocytes, CD3+/CD8+ T lymphocytes and CD19+ B lymphocytes, CD16+/CD56+ NK cells were also decreased in the peripheral blood of COVID-19 patients, and these cells may play critical roles in the inflammatory cytokine storm [21]. NK immunotypes are related to COVID-19 disease severity, and high expression of perforin, NKG2C, and Ksp37 in NK cells may reflect the increased presence of adaptive NK cells in the circulation of patients with severe disease [19]. This may be the mechanism of NK cell activation in COVID-19 and the potential role of NK cells in host protection and immunopathology [19]. Compared with mild cases, significantly lower levels of immune cells including CD3 + T cell, CD4 + T cell, CD8 + T cell, B cell and NK cell were found in severe cases [39,40,41,42]. In our cohort, CD3+ T cells, CD4+ T cells, CD8+ T cells, CD19+ T cells, and CD16+/ CD56+ NK cells showed significant differences in mild/moderate COVID-19 cases with and without progression. Moreover, CD16+/CD56+ NK cells were also independent risk factors for progression from moderate to severe disease. In a multi-center study, Benjamin Kramer et al. [42] reported that the dysfunction of NK cell not only affects antiviral immune responses but may also be related to the development of fibrotic lung disease in severe COVID-19 cases. From the pathologic mechanism, untimely early production of TGFβ and associated NK cell dysfunction is a hallmark of severe COVID-19 [43]. TGFβ-mediated impairment of NK cell function may reduce virus control and be detrimental in severe COVID-19 cases [43]. A detailed map of the NK cell activation landscape in COVID-19 disease might be a meaningful indicator of progression.

Our study has several limitations. First, the study population only included patients from Renmin Hospital of Wuhan University (Central China region) and West China Hospital of Sichuan University (Southwest China region). The study sample size was relatively small, it must still be considered preliminary information. We plan to apply the PAINT score to further validate the predict value in the future studies. Second, the data were obtained from the electronic medical database of the two hospitals. Some cases had incomplete records for the exposure history and laboratory examinations, and some patients were diagnosed in the outpatient department, with incomplete medical records and laboratory testing that was only briefly documented. Third, many patients remained in the hospital, and the outcomes were unknown at the time of data collection. Fourth, detailed follow-up information was not included in our study results. Therefore, the uncertainty of bias might have inevitably affected our assessment. Further evaluation may be needed to validate our predictive model.

Conclusion

In conclusion, pulmonary disease, age, IgM, CD16 + /CD56 + NK cells and AST were independent predictors of progression for patients with COVID-19 in the present study. A predictive model for progression to severe COVID-19 based on the PAINT score might be helpful to identify patients at risk of progression. Moreover, more intensive surveillance and appropriate therapy should be considered in patients at high risk of progression to improve their prognosis in clinical practice. Future studies with larger numbers of patients will be useful for updating and validating this PAINT score to improve identification of patients at risk of progression to severe COVID-19.

Availability of data and materials

Additional file 8 is included. All data generated or analysed during this study are included in this published article and its additional information files.

References

  1. Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, Zhang L, Fan G, Xu J, Gu X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506.

    Article  CAS  Google Scholar 

  2. Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Pathophysiology, transmission, diagnosis, and treatment of coronavirus disease 2019 (COVID-19): a review. JAMA. 2020;324(8):782–93.

    Article  CAS  Google Scholar 

  3. Liu Y, Yan LM, Wan L, Xiang TX, Le A, Liu JM, Peiris M, Poon LLM, Zhang W. Viral dynamics in mild and severe cases of COVID-19. Lancet Infect Dis. 2020;20(6):656–7.

    Article  CAS  Google Scholar 

  4. Chen R, Sang L, Jiang M, Yang Z, Jia N, Fu W, Xie J, Guan W, Liang W, Ni Z, et al. Longitudinal hematologic and immunologic variations associated with the progression of COVID-19 patients in China. J Allergy Clin Immunol. 2020;146(1):89–100.

    Article  CAS  Google Scholar 

  5. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72314 cases from the Chinese center for disease control and prevention. JAMA. 2020;323(13):1239–42.

    Article  CAS  Google Scholar 

  6. Gates B. Responding to COVID-19—a once-in-a-century pandemic? N Engl J Med. 2020;382(18):1677–9.

    Article  CAS  Google Scholar 

  7. Chang MC, Park YK, Kim BO, Park D. Risk factors for disease progression in COVID-19 patients. BMC Infect Dis. 2020;20(1):445.

    Article  CAS  Google Scholar 

  8. WorldHealthOrgnization. Report of the WHO-China Joint Mission on Coronavirus Disease 2019 (COVID-19). In.; 2020: WHO Coronavirus Disease (COVID-19) Dashboard.

  9. Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, Xiang J, Wang Y, Song B, Gu X, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395(10229):1054–62.

    Article  CAS  Google Scholar 

  10. Zhang X, Tan Y, Ling Y, Lu G, Liu F, Yi Z, Jia X, Wu M, Shi B, Xu S, et al. Viral and host factors related to the clinical outcome of COVID-19. Nature. 2020;583(7816):437–40.

    Article  CAS  Google Scholar 

  11. Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, Liu L, Shan H, Lei CL, Hui DSC, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708–20.

    Article  CAS  Google Scholar 

  12. Assessing Risk Factors for Severe COVID-19 Illness. https://www.cdc.gov/coronavirus/2019-ncov/COVID-data/investigations-discovery/assessing-risk-factors.html.

  13. Harizi C, Cherif I, Najar N, Osman M, Mallekh R, Ayed OB, Ayedi Y, Dhaouadi S, Hchaichi A, Safer M, et al. Characteristics and prognostic factors of COVID-19 among infected cases: a nationwide Tunisian analysis. BMC Infect Dis. 2021;21(1):140.

    Article  CAS  Google Scholar 

  14. Liu C, Li L, Song K, Zhan ZY, Yao Y, Gong H, Chen Y, Wang Q, Dong X, Xie Z, et al. A nomogram for predicting mortality in patients with COVID-19 and solid tumors: a multicenter retrospective cohort study. J Immunother Cancer. 2020;8(2): e001314.

    Article  Google Scholar 

  15. Chen R, Liang W, Jiang M, Guan W, Zhan C, Wang T, Tang C, Sang L, Liu J, Ni Z, et al. Risk factors of fatal outcome in hospitalized subjects with coronavirus disease 2019 from a nationwide analysis in China. Chest. 2020;158(1):97–105.

    Article  CAS  Google Scholar 

  16. Jehi L, Ji X, Milinovich A, Erzurum S, Rubin BP, Gordon S, Young JB, Kattan MW. Individualizing risk prediction for positive coronavirus disease 2019 testing: results from 11,672 patients. Chest. 2020;158(4):1364–75.

    Article  CAS  Google Scholar 

  17. Vultaggio A, Vivarelli E, Virgili G, Lucenteforte E, Bartoloni A, Nozzoli C, Morettini A, Berni A, Malandrino D, Rossi O, et al. Prompt predicting of early clinical deterioration of moderate-to-severe COVID-19 patients: usefulness of a combined score using IL-6 in a preliminary study. J Allergy Clin Immunol Pract. 2020;8(8):2575-2581.e2572.

    Article  Google Scholar 

  18. Nalbant A, Demirci T, Kaya T, Aydın A, Altındiş M, Güçlü E. Can prognostic nutritional index and systemic immune-inflammatory index predict disease severity in COVID-19? Int J Clin Pract. 2021;75(10): e14544.

    Article  CAS  Google Scholar 

  19. Maucourant C, Filipovic I, Ponzetta A, Aleman S, Cornillet M, Hertwig L, Strunz B, Lentini A, Reinius B, Brownlie D, et al. Natural killer cell immunotypes related to COVID-19 disease severity. Sci Immunol. 2020;5(50):eabd6832.

    Article  CAS  Google Scholar 

  20. Sungnak W, Huang N, Bécavin C, Berg M, Queen R, Litvinukova M, Talavera-López C, Maatz H, Reichart D, Sampaziotis F, et al. SARS-CoV-2 entry factors are highly expressed in nasal epithelial cells together with innate immune genes. Nat Med. 2020;26(5):681–7.

    Article  CAS  Google Scholar 

  21. Wu Y, Huang X, Sun J, Xie T, Lei Y, Muhammad J, Li X, Zeng X, Zhou F, Qin H, et al. Clinical characteristics and immune injury mechanisms in 71 patients with COVID-19. mSphere. 2020;5(4):e00362-e320.

    Article  CAS  Google Scholar 

  22. Li M, Guo W, Dong Y, Wang X, Dai D, Liu X, Wu Y, Li M, Zhang W, Zhou H, et al. Elevated exhaustion levels of NK and CD8(+) T cells as indicators for progression and prognosis of COVID-19 disease. Front Immunol. 2020;11: 580237.

    Article  CAS  Google Scholar 

  23. WorldHealthOrgnization. Clinical management of severe acute respiratory infections when novel coronavirus is suspected: What to do and what not to do. In.; 2020.

  24. Chinese management guideline for COVID-19 (Trail version 7.0). http://www.nhc.gov.cn/yzygj/s7653p/202003/46c9294a7dfe4cef80dc7f5912eb1989/files/ce3e6945832a438eaae415350a8ce964.pdf.

  25. Hoffmann M, Kleine-Weber H, Schroeder S, Krüger N, Herrler T, Erichsen S, Schiergens TS, Herrler G, Wu NH, Nitsche A, et al. SARS-CoV-2 cell entry depends on ACE2 and TMPRSS2 and is blocked by a clinically proven protease inhibitor. Cell. 2020;181(2):271-280.e278.

    Article  CAS  Google Scholar 

  26. Docherty AB, Harrison EM, Green CA, Hardwick HE, Pius R, Norman L, Holden KA, Read JM, Dondelinger F, Carson G, et al. Features of 20 133 UK patients in hospital with COVID-19 using the ISARIC WHO Clinical Characterisation Protocol: prospective observational cohort study. BMJ. 2020;369: m1985.

    Article  Google Scholar 

  27. Ji M, Yuan L, Shen W, Lv J, Li Y, Chen J, Zhu C, Liu B, Liang Z, Lin Q, et al. A predictive model for disease progression in non-severely ill patients with coronavirus disease 2019. Eur Respir J. 2020;56(1):2001234.

    Article  CAS  Google Scholar 

  28. Yu C, Zhou M, Liu Y, Guo T, Ou C, Yang L, Li Y, Li D, Hu X, Shuai L, et al. Characteristics of asymptomatic COVID-19 infection and progression: a multicenter, retrospective study. Virulence. 2020;11(1):1006–14.

    Article  CAS  Google Scholar 

  29. Moutchia J, Pokharel P, Kerri A, McGaw K, Uchai S, Nji M, Goodman M. Clinical laboratory parameters associated with severe or critical novel coronavirus disease 2019 (COVID-19): a systematic review and meta-analysis. PLoS ONE. 2020;15(10): e0239802.

    Article  CAS  Google Scholar 

  30. Tian J, Yuan X, Xiao J, Zhong Q, Yang C, Liu B, Cai Y, Lu Z, Wang J, Wang Y, et al. Clinical characteristics and risk factors associated with COVID-19 disease severity in patients with cancer in Wuhan, China: a multicentre, retrospective, cohort study. Lancet Oncol. 2020;21(7):893–903.

    Article  CAS  Google Scholar 

  31. Apicella M, Campopiano MC, Mantuano M, Mazoni L, Coppelli A, Del Prato S. COVID-19 in people with diabetes: understanding the reasons for worse outcomes. Lancet Diabetes Endocrinol. 2020;8(9):782–92.

    Article  CAS  Google Scholar 

  32. Veldhuis L, Ridderikhof ML, Schinkel M, van den Bergh J, Beudel M, Dormans T, Douma R, van den Oever NG, de Haan L, Koopman K, et al. Early warning scores to assess the probability of critical illness in patients with COVID-19. Emerg Med J. 2021;38(12):901–5.

    Article  Google Scholar 

  33. De Socio GV, Gidari A, Sicari F, Palumbo M, Francisci D. National Early Warning Score 2 (NEWS2) better predicts critical Coronavirus Disease 2019 (COVID-19) illness than COVID-GRAM, a multi-centre study. Infection. 2021;49(5):1033–8.

    Article  Google Scholar 

  34. San I, Gemcioglu E, Baser S, Yilmaz Cakmak N, Erden A, Izdes S, Catalbas R, Davutoglu M, Karabuga B, Ates I. Brescia-COVID Respiratory Severity Scale (BRCSS) and Quick SOFA (qSOFA) score are most useful in showing severity in COVID-19 patients. Sci Rep. 2021;11(1):21807.

    Article  CAS  Google Scholar 

  35. Jin M, Lu Z, Zhang X, Wang Y, Wang J, Cai Y, Tian K, Xiong Z, Zhong Q, Ran X, et al. Clinical characteristics and risk factors of fatal patients with COVID-19: a retrospective cohort study in Wuhan, China. BMC Infect Dis. 2021;21(1):951.

    Article  CAS  Google Scholar 

  36. Obremska M, Pazgan-Simon M, Budrewicz K, Bilaszewski L, Wizowska J, Jagielski D, Jankowska-Polanska B, Nadolny K, Madowicz J, Zuwala-Jagiello J, et al. Simple demographic characteristics and laboratory findings on admission may predict in-hospital mortality in patients with SARS-CoV-2 infection: development and validation of the COVID-19 score. BMC Infect Dis. 2021;21(1):945.

    Article  CAS  Google Scholar 

  37. Halalau A, Imam Z, Karabon P, Mankuzhy N, Shaheen A, Tu J, Carpenter C. External validation of a clinical risk score to predict hospital admission and in-hospital mortality in COVID-19 patients. Ann Med. 2021;53(1):78–86.

    Article  CAS  Google Scholar 

  38. Bradley J, Sbaih N, Chandler TR, Furmanek S, Ramirez JA, Cavallazzi R. Pneumonia severity index and CURB-65 are good predictors of mortality in hospitalized patients with SARS-CoV-2 community-acquired pneumonia. Chest. 2021, S0012-3692(21):04257-04254.

  39. Zhang Z, Ai G, Chen L, Liu S, Gong C, Zhu X, Zhang C, Qin H, Hu J, Huang J. Associations of immunological features with COVID-19 severity: a systematic review and meta-analysis. BMC Infect Dis. 2021;21(1):738.

    Article  CAS  Google Scholar 

  40. Liu K, Yang T, Peng XF, Lv SM, Ye XL, Zhao TS, Li JC, Shao ZJ, Lu QB, Li JY, et al. A systematic meta-analysis of immune signatures in patients with COVID-19. Rev Med Virol. 2021;31(4): e2195.

    Article  CAS  Google Scholar 

  41. Krämer B, Knoll R, Bonaguro L, ToVinh M, Raabe J, Astaburuaga-García R, Schulte-Schrepping J, Kaiser KM, Rieke GJ, Bischoff J, et al. Early IFN-α signatures and persistent dysfunction are distinguishing features of NK cells in severe COVID-19. Immunity. 2021;54(11):2650-2669.e2614.

    Article  Google Scholar 

  42. Leem G, Cheon S, Lee H, Choi SJ, Jeong S, Kim ES, Jeong HW, Jeong H, Park SH, Kim YS, et al. Abnormality in the NK-cell population is prolonged in severe COVID-19 patients. J Allergy Clin Immunol. 2021;148(4):996-1006.e1018.

    Article  CAS  Google Scholar 

  43. Witkowski M, Tizian C, Ferreira-Gomes M, Niemeyer D, Jones TC, Heinrich F, Frischbutter S, Angermair S, Hohnstein T, Mattiola I, et al. Untimely TGFβ responses in COVID-19 limit antiviral functions of NK cells. Nature. 2021;600(7888):295–301.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We would like to thank all study participants, their families, the medical staff, and the participating hospitals for their support in the present study.

Funding

This work was supported by the Special Funds for Prevention and Control of COVID-19 of Sichuan University and West China Hospital (NO. 2020scunCoV10004 and NO. HX-2019-nCoV-010) and the China Postdoctoral Science Foundation (2020M670059ZX).

Author information

Author notes

  1. Ming Wang, Dongbo Wu and Chang-Hai Liu contributed equally to this work

Authors and Affiliations

  1. Center of Infectious Diseases, West China Hospital, Sichuan University, 37 Guoxue Lane, Chengdu, Sichuan Province, 610041, People’s Republic of China

    Ming Wang, Dongbo Wu, Chang-Hai Liu, Wei Jiang & Lang Bai

  2. COVID-19 Medical Team (Hubei) of West China Hospital, Sichuan University, Chengdu, 610041, People’s Republic of China

    Ming Wang, Dongbo Wu, Wei Wang, Lang Bai & Hong Tang

  3. The People’s Hospital of Qianxi, Qianxi, 551500, People’s Republic of China

    Yan Li

  4. The People’s Hospital of Duyun, Duyun, 558000, People’s Republic of China

    Jianghong Hu

  5. Emergency Department, West China Hospital, Sichuan University, Chengdu, 610041, People’s Republic of China

    Wei Wang

  6. Department of Obstetrics and Gynecology, Renmin Hospital of Wuhan University, Wuhan, 430060, People’s Republic of China

    Qifan Zhang & Zhixin Huang

Authors
  1. Ming Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dongbo Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chang-Hai Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jianghong Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Wei Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Qifan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Zhixin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Lang Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Hong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HT, BL, MW, DW and CL designed the study, analysed the data, wrote the paper, and reviewed and edited the paper. MW, YL, JH, WJ and WW performed the data analysis and literature search and constructed the figures. ZH, QZ, DW, WW, YL, JH, and MW collected the data in Wuhan, analysed the data and designed the study. DW, MW, WJ and CL collected the data in Chengdu. All authors read and approved the final manuscript. 

Corresponding authors

Correspondence to Lang Bai or Hong Tang.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Medical Ethics Committee of West China Hospital of Sichuan University [2020 approved (444)] (in related files). The study was performed according to the ethical guidelines expressed in the Declaration of Helsinki and the International Conference on Harmonization Guidelines for Good Clinical Practice. Informed consent was obtained from all subjects.

Consent for publication

“NA”. All author agreed with present manuscript and publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Figure S1.

Global Schoenfeld test cox diagnostics deviance to evaluate five independent risk factors for progression from mild/moderate into sever cases. Schoenfeld residual were displays in graphs. (a) Pulmonary disease, (b) Age, (c) IgM, (d) CD16+/CD56+ NK cell, (e) AST.

Additional file 2: Figure S2.

Dfbeta were displayed by diagnostics graphs presenting goodness of Cox Proportional Hazards Model fit.

Additional file 3: Figure S3.

Deviance residuals were displayed by diagnostics graphs presenting goodness of Cox Proportional Hazards Model fit. (a) pulmonary disease, (b) Age, (c) IgM, (d) CD16+/CD56+ NK cell, (e) AST.

Additional file 4: Figure S4.

The Kaplan–Meier survival curve analysis and log-rank test of each independent predictors showed a significant difference in survival curve in COVID-19 patients. (a) Pulmonary disease, (b) Age, (c) IgM, (d) CD16+/CD56+ NK cell, (e) AST.

Additional file 5: Figure S5.

The Principal Component Analysis (PCA) showed the configuration of biomarkers on biplot represented the relationship between variables and principal (a, b).

Additional file 6: Table S1.

Univariant logistic regression model for progression from mild/moderate cases into severe cases.

Additional file 7: Table S2.

The C-index for the prediction of progression for predicting progression from mild/moderate cases into severe cases.

Additional file 8.

Supplmentary data raw data.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, M., Wu, D., Liu, CH. et al. Predicting progression to severe COVID-19 using the PAINT score. BMC Infect Dis 22, 498 (2022). https://doi.org/10.1186/s12879-022-07466-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-022-07466-4

Keywords

BMC Infectious Diseases

ISSN: 1471-2334

Contact us