|Year : 2021 | Volume
| Issue : 6 | Page : 274-280
A nomogram for predicting acute respiratory distress syndrome in COVID-19 patients
Ning Ding, Yang Zhou, Guifang Yang, Xiangping Chai
Department of Emergency Medicine, The Second Xiangya Hospital; Emergency Medicine and Difficult Diseases Institute, Central South University, Changsha 410000, China
|Date of Submission||24-Mar-2021|
|Date of Decision||24-May-2021|
|Date of Acceptance||25-May-2021|
|Date of Web Publication||25-Jun-2021|
Department of Emergency Medicine, The Second Xiangya Hospital; Emergency Medicine and Difficult Diseases Institute, Central South University, Changsha 410000
Source of Support: Key Research and Development Program of Hunan Province (NO. 2020SK3004); Emergency Project of Prevention and Control for COVID-19 of Central South University (No. 160260005), Conflict of Interest: None
Objective: To predict the in-hospital incidence of acute respiratory distress syndrome (ARDS) in COVID-19 patients by developing a predictive nomogram.
Methods: Patients with COVID-19 admitted to Changsha Public Health Centre between 30 January 2020, and 22 February 2020 were enrolled in this study. Clinical characteristics and laboratory variables were analyzed and compared between patients with or without ARDS. Clinical characteristics and laboratory variables that were risk factors of ARDS were screened by the least absolute shrinkage and selection operator binary logistic regression. Based on risk factors, a prediction model was established by logistic regression and the final nomogram prognostic model was performed. The calibration curve was applied to evaluate the consistency between the nomogram and the ideal observation.
Results: A total of 113 patients, including 99 non-ARDS patients and 14 ARDS patients were included in this study. Eight variables including hypertension, chronic obstructive pulmonary disease, cough, lactate dehydrogenase, creatine kinase, white blood count, body temperature, and heart rate were included in the model. The area under receiver operating characteristic curve, specificity, sensitivity, and accuracy of the full model were 0.969, 1.000, 0.857, and 0.875, respectively. The calibration curve also showed good agreement between the predicted and observed values in the model.
Conclusions: The nomogram can be used to predict the in-hospital incidence of ARDS in COVID-19 patients.
Keywords: Nomogram; Acute respiratory distress syndrome; COVID-19
|How to cite this article:|
Ding N, Zhou Y, Yang G, Chai X. A nomogram for predicting acute respiratory distress syndrome in COVID-19 patients. Asian Pac J Trop Med 2021;14:274-80
|How to cite this URL:|
Ding N, Zhou Y, Yang G, Chai X. A nomogram for predicting acute respiratory distress syndrome in COVID-19 patients. Asian Pac J Trop Med [serial online] 2021 [cited 2022 Jul 2];14:274-80. Available from: https://www.apjtm.org/text.asp?2021/14/6/274/318303
| 1. Introduction|| |
Evidence indicated that severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), as the pathogen of COVID-19, was a new type of coronavirus. It could result in multiple system infections in humans, especially in the respiratory system, and in some cases, it may lead to acute respiratory distress syndrome (ARDS), even multiple organ failure and death with the progression of the disease.
ARDS is one of the most common complications of COVID-19, and it is more likely to lead to poor clinical outcomes. An observation study showed that 75% of 36 patients with COVID-19 were transferred to the intensive care unit (ICU) due to the development of ARDS. Another report by Huang et al. reported a proportion of 85%. Early identification and prediction of the incidence of ARDS are extremely important. However, the accurate model for predicting the risk of developing ARDS in patients with COVID-19 is limited. Nomogram, as a statistical model constructed based on different clinical and laboratory variables, has been widely applied to predict clinical outcomes in different diseases,.
Therefore, in this study, we analyzed the clinical characteristics in COVID-19 patients with ARDS and explored an easily applicable nomogram to provide further guidance on medical treatment.
| 2. Subjects and methods|| |
2.1. Patients and study design
This was a retrospective single-center study conducted between 30 January 2020 and 22 February 2020. We analyzed data of patients with COVID-19 admitted to Changsha Public Health Centre, which was the only designated tertiary hospital for COVID-19 patients in Changsha. All the patients were diagnosed with SARS-CoV-2 infection based on the World Health Organization interim guidance. Inclusion criteria were set as follows: age ≥18 and confirmed diagnosis of COVID-19. Patients missing >5% individual data and age <18 were excluded. This study was approved by the institutional ethics board of the Second Xiangya Hospital, Central South University (Changsha, China, No. LYF2020044).
2.2. Study variables
All candidate predictors were collected based on relevant literature reported,,, and associated clinical evidences. We collected the patient demographic information (age and gender); history of travel within the past two weeks, body temperature, systolic blood pressure, diastolic blood pressure, heart rate, and duration (days) from illness onset to hospital admission; underling diseases [hypertension, cardiovascular disease, diabetes, cerebrovascular disease, chronic obstructive pulmonary disease (COPD), and chronic liver disease], laboratory tests [erythrocyte sedimentation rate, C-reactive protein, procalcitonin, liver and renal function, blood chemistry, coagulation test, complete blood count, lactate dehydrogenase (LDH) and creatine kinase (CK)], and symptoms of onset illness.
ARDS was diagnosed by a decrease in the PaO2/FiO2 index below 300 mmHg according to the Berlin definition. Arterial blood gas analysis was performed for patients who had a dyspnea during hospitalization. In-hospital incidence of ARDS was calculated.
2.4. Variables selection and model establishment
In the study, there were several variables, while the number of patients was relatively low. To avoid overfitting of the model, the least absolute shrinkage and selection operator (LASSO) algorithm was used to further screen the predictive variables among previously selected variables. Ten-fold cross-validation was utilized for the tuning parameter (lambda) selection in the LASSO model. A prediction model was established by logistic regression and the final nomogram prognostic model was performed. Moreover, calibration curves were plotted to improve the perfect nomogram’s prediction.
2.5. Statistical analysis
All variables of the patients were presented as means±standard deviations or medians (interquartile ranges, IQR) for continuous variables, and categories variables were presented as frequencies and percentages. The groups for normally and skewed distributed continuous variables used one-way ANOVA and Kruskal-Wallis tests, respectively, and categorical variables used the chi-squared test. The LASSO binary logistic regression analysis was performed by the R package “glmet”. The nomogram and decision curve were established by the “rms” package and packages R. The receiver operating characteristic curves were plotted and the area under receiver operating characteristic curve was accessed. We used 500 bootstraps resamples to compute the area under receiver operating characteristic curve with a 95% CI. Then we displayed the sensitivity, specificity, and accuracy of the stepwise model by bootstrap. The statistical analyses were performed with statistical packages R (http://www.R-project.org) and Empower-Stats. A P-value <0.05 was considered statistically significant.
| 3. Results|| |
3.1. Base clinical characteristics
Initially, a total of 121 COVID-19 patients were involved. However, 16 patients were excluded based on certain criteria discussed previously, a total of 113 patients including 14 patients in the ARDS group and 99 patients in the non-ARDS group were involved in this study [Figure 1]. In this cohort study, the baseline characteristics of the patients were shown in [Table 1]. The patients who developed ARDS were older, had higher body temperature and faster heart rates, and they were also more likely to have hypertension and symptoms of fever and dyspnea (all P<0.05). Laboratory tests were performed at the patients’ first admission to the hospital. The level of C-reactive protein, LDH, CK, and aspartate aminotransferase were significantly higher in ARDS patients than those without ARDS (all P<0.05). Prothrombin time was significantly longer, and the levels of albumin, white blood count (WBC), lymphocyte, and monocyte were significantly lower in ARDS patients (all P<0.05).
|Table 1: The demographic and baseline characteristics of the study patients.|
Click here to view
3.2. Feature extraction and selection
The LASSO algorithm was used to extract predictive variables. The best match variables were selected from the value of lambda that gives minimum mean cross-validated error. In the end, only 8 variables were extracted from the 50 variables [Figure 2]A and [Figure 2]B, including hypertension, COPD, cough, LDH, CK, WBC, body temperature, and heart rate.
|Figure 2: The least absolute shrinkage and selection operator algorithm and 10-fold cross validation were used to extract the optimal subset of all variables. (A) Optimal variables selection according to the area under the curve value. When the value in (λ) increased to -3.174 8, the area under the curve value reached the peak corresponding to the optimal number of predictive variables. (B) The least absolute shrinkage and selection operator coefficient profiles of the 50 variables. The vertical line was drawn at the value selected by 10-fold cross validation, where the optimal λ resulted in 8 nonzero coefficients.|
Click here to view
3.3. Nomogram construction and validation
To better predict the ratio of developing ARDS, we created a nomogram which could represent different patients’ prediction based on their characteristics [Figure 3]A. Eight variables including hypertension, COPD, cough, LDH, CK, WBC, body temperature, and heart rate were regarded as highly clinically appropriate to accumulatively determine ARDS occurrences. High body temperature, fast heart rate, cough as well as comorbidities including COPD and hypertension were risk factors for developing ARDS. Risk of developing ARDS was also increased with elevating levels of LDH and CK, while decreased level of WBC.
|Figure 3: Development and performance of a nomogram. (A) Nomogram based on white blood count (WBC), lactate dehydrogenase (LDH), creatine kinase (CK), heart rate, hypertension, cough, temperature, and chronic obstructive pulmonary disease (COPD). (B) Calibration curves of the nomogram in the training. The horizontal axis is the predicted incidence of the acute respiratory distress syndrome (ARDS). The vertical axis is the observed incidence of the ARDS. The red line on the diagonal is the reference line, indicating that the predicted value is equal to the actual value. The black line is the calibration curve, and the yellow area on both sides represents the 95% CI. (C) The predictive abilities of the full models. (D) Clinical impact curve of the nomogram for predicting the probability of ARDS had superior standardized net benefit.|
Click here to view
In the nomogram, the total points were obtained by adding the point of each variable, which were corresponding to the incidence of ARDS.
The calibration curve of the nomogram demonstrated a good fit [Figure 3]B and [Figure 3]C. The calibration curve also showed good consistency between the predicted and observed values in the model. The predictive capability of the full model was shown in [Figure 3]C. The area under receiver operating characteristic curve, specificity, sensitivity, and accuracy of the full model were 0.969, 1.000, 0.857 and 0.875, respectively. The decision curve showed that the nomogram had superior standardized net benefit and was good at predicting the possibility of the patients to develop ARDS [Figure 3]D.
| 4. Discussion|| |
Severe acute respiratory syndrome coronavirus 2, the virus which is responsible for coronavirus disease, uses an angiotensin-2-converting enzyme as a cell receptor in humans. Available data suggests that around 40% of patients with COVID-19 developed ARDS. Early evaluating and predicting the in-hospital incidence of ARDS in patients can help to improve their clinical prognosis. In this study, we established a model based on 8 variables from the data of 113 patients with COVID-19, including COPD, hypertension, cough, heart rate, body temperature, WBC, LDH and CK, and the model performed well in predicting incidence of ARDS.
In this model, high body temperature, fast heart rate, and cough were risk factors [Figure 3]A, which were all common clinical characteristics of pneumonia presented in previous studies,,,,. Moreover, higher body temperature and elevated heart rate in pneumonia were associated with severe inflammation response and hypoxia, which also showed a significant higher prevalence in ARDS patients,. In this study, we speculated that elevated heart rates occurred in ARDS group due to systemic inflammatory reaction and intense sympathetic activation. Researches showed that WBC was an indicator of the systemic inflammatory response, and could be a potential marker for evaluating the severity and prognosis in various disorders,. However, our results suggested that WBC decreased with the increasing incidence of ARDS in COVID-19 patients [Figure 3]A. The reason may be explained by the different types of pathogen infections. Previous studies verified that SARS-CoV-2 could invade the respiratory system, impair cells and tissues, induce immune reaction which results in changes of peripheral white blood cells, leading to decreased leukocytes and lymphocytes,,. In addition, researches demonstrated that patients with comorbidity were more likely to have poor clinical outcomes. COPD was one of the maximum features in our model [Figure 3]A. Experimental and clinical studies verified that COPD patients were more susceptible to pathogen infection, resulting in impaired lung function and the incidence of ARDS.
In our study, the relative maximum features were LDH and CK. The levels of LDH and CK significantly increased in patients with ARDS. LDH and CK were not only markers of inflammation but also indicators of prognosis in critical illness,. Liu et al. reported that patients with acute lung injury also had elevated levels of enzymes including LDH and CK due to inflammation and oxidative stress. Esteves et al. found that LDH was a diagnostic biomarker of pneumocystis pneumonia in patients, which was in agreement with our results. Recent studies also reported that, with the increasing level of viral load detected from respiratory tracts, lung functions were getting worse in COVD-19 patients. Finally, the eight variables discussed above were selected as predictive indexes by LASSO regression.
To the best of our knowledge, this is one of the first studies to develop a nomogram for predicting the in-hospital incidence of ARDS in COVID-19 patients, which would help physicians calculate the probability of ARDS and adjust a patient’s individualized medical treatments accordingly. Furthermore, patients who are more likely to develop ARDS during hospitalization could be monitored closely and moved to ICU promptly. Individualized managements including ventilation support can be applied earlier too. Considering that the incidence of ARDS in the cohort was about 12.38% (14/113), this study provides a useful tool for predicting ARDS in COVID-19.
However, there are limitations. (1) The sample size is relatively small and the nomogram needs to be validated by a larger population. (2) All the patients included were Chinese, so caution must be considered while applying the proposed nomogram to patients of other ethnicities. (3) This study was retrospective and there might be patient selection biases though we tried our best to minimize the bias by analyzing all the possible factors including underling comorbidities, signs, symptoms and laboratory test results. The model needs to be validated for future studies with larger sample sizes that can be conducted in multi-centers. Further studies should focus on finding effective treatments like drugs and interventions for patients with early-stage of ARDS.
In the study, the proposed nomogram can be used to predict the inhospital incidence of ARDS in COVID-19 patients which would help physicians make individualized treatment plans.
Conflict of interest statement
The authors declare that they have no conflict of interest.
Key Research and Development Program of Hunan Province (NO. 2020SK3004); Emergency Project of Prevention and Control for COVID-19 of Central South University (No. 160260005).
Conception and design by N.D., Y.Z., G.Y., X.C.; Administrative support by X.C.; Provision of study materials or patients by N.D.; Collection and assembly of data: N.D.; Data analysis and interpretation: Y.Z., G.Y., X.C.; Manuscript writing: N.D., Y.Z.; Final approval of manuscript by all the authors.
| References|| |
Chen L, Liu W, Zhang Q, Xu K, Ye G, Wu W, et al. RNA based mNGS approach identifies a novel human coronavirus from two individual pneumonia cases in 2019 Wuhan outbreak. Emerg Microb Infect
Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med
Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med
Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA
Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet
Gandaglia G, Ploussard G, Valerio M, Mattei A, Fiori C, Fossati N, et al. A novel nomogram to identify candidates for extended pelvic lymph node dissection among patients with clinically localized prostate cancer diagnosed with magnetic resonance imaging-targeted and systematic biopsies. Europ Urol
Berardi G, Morise Z, Sposito C, Igarashi K, Panetta V, Simonelli I, et al. Development of a nomogram to predict outcome after liver resection for hepatocellular carcinoma in child-pugh B cirrhosis. J Hepatol
Ranieri VM, Pettila V, Karvonen MK, Jalkanen J, Nightingale P, Brealey D, et al. Effect of intravenous interferon beta-1a on death and days free from mechanical ventilation among patients with moderate to severe acute respiratory distress syndrome: A randomized clinical trial. JAMA
Nair AS, Pulipaka SK, Kodisharapu PK, Christopher A. Anti-fibrotic drugs dealing with pulmonary fibrosis after COVID-19-associated acute respiratory distress syndrome. J Acute Dis
2021. doi: 10.4103/2221-6189.318642.
Zhang JJ, Dong X, Cao YY, Yuan YD, Yang YB, Yan YQ, et al. Clinical characteristics of 140 patients infected by SARS-CoV-2 in Wuhan, China. Allergy
Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus-infected pneumonia. N Engl J Med
Tian S, Hu N, Lou J, Chen K, Kang X, Xiang Z, et al. Characteristics of COVID-19 infection in Beijing. J Infect
Chan JF, Yuan S, Kok KH, To KK, Chu H, Yang J, et al. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: A study of a family cluster. Lancet
Sandfort V, Johnson AEW, Kunz LM, Vargas JD, Rosing DR. Prolonged elevated heart rate and 90-day survival in acutely ill patients: Data from the MIMIC- III database. Intens Care Med
Yang W, Cao Q, Qin L, Wang X, Cheng Z, Pan A, et al. Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): A multi-center study in Wenzhou city, Zhejiang, China. J Infect
Riche F, Gayat E, Barthelemy R, Le Dorze M, Mateo J, Payen D. Reversal of neutrophil-to-lymphocyte count ratio in early versus late death from septic shock. Critic Care
Hwang SY, Shin TG, Jo IJ, Jeon K, Suh GY, Lee TR, et al. Neutrophil-to-lymphocyte ratio as a prognostic marker in critically-ill septic patients. Am J Emerg Med
Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: A descriptive study. Lancet
Chang D, Lin M, Wei L, Xie L, Zhu G, Dela Cruz CS, et al. Epidemiologic and clinical characteristics of novel coronavirus infections involving 13 patients outside Wuhan, China. JAMA
Xu XW, Wu XX, Jiang XG, Xu KJ, Ying LJ, Ma CL, et al. Clinical findings in a group of patients infected with the 2019 novel coronavirus (SARS-Cov-2) outside of Wuhan, China: Retrospective case series. BMJ
m606. doi: 10.1136/bmj.m606.
Groll DL, Heyland DK, Caeser M, Wright JG. Assessment of long-term physical function in acute respiratory distress syndrome (ARDS) patients: Comparison of the charlson comorbidity index and the functional comorbidity index. Am J Phys Med Rehab
Ito JT, Lourenco JD, Righetti RF, Tiberio I, Prado CM, Lopes F. Extracellular matrix component remodeling in respiratory diseases: What has been found in clinical and experimental studies? Cells
Lu J, Wei Z, Jiang H, Cheng L, Chen Q, Chen M, et al. Lactate dehydrogenase is associated with 28-day mortality in patients with sepsis: A retrospective observational study. J Surg Res
Belopolskaya OB, Smelaya TV, Moroz VV, Golubev AM, Salnikova LE. Clinical associations of host genetic variations in the genes of cytokines in critically ill patients. Clin Exp Immunol
Liu Y, Yang Y, Zhang C, Huang F, Wang F, Yuan J, et al. Clinical and biochemical indexes from 2019-nCoV infected patients linked to viral loads and lung injury. Sci China Life Sci
Esteves F, Cale SS, Badura R, de Boer MG, Maltez F, Calderon EJ, et al. Diagnosis of pneumocystis pneumonia: Evaluation of four serologic biomarkers. Clin Microbiol Infect
[Figure 1], [Figure 2], [Figure 3]