Skip to main content
Top
Published in: Respiratory Research 1/2022

01-12-2022 | Rheumatoid Arthritis | Research

Prediction of long-term mortality by using machine learning models in Chinese patients with connective tissue disease-associated interstitial lung disease

Authors: Di Sun, Yu Wang, Qing Liu, Tingting Wang, Pengfei Li, Tianci Jiang, Lingling Dai, Liuqun Jia, Wenjing Zhao, Zhe Cheng

Published in: Respiratory Research | Issue 1/2022

Login to get access

Abstract

Background

The exact risk assessment is crucial for the management of connective tissue disease-associated interstitial lung disease (CTD-ILD) patients. In the present study, we develop a nomogram to predict 3‑ and 5-year mortality by using machine learning approach and test the ILD-GAP model in Chinese CTD-ILD patients.

Methods

CTD-ILD patients who were diagnosed and treated at the First Affiliated Hospital of Zhengzhou University were enrolled based on a prior well-designed criterion between February 2011 and July 2018. Cox regression with the least absolute shrinkage and selection operator (LASSO) was used to screen out the predictors and generate a nomogram. Internal validation was performed using bootstrap resampling. Then, the nomogram and ILD-GAP model were assessed via likelihood ratio testing, Harrell’s C index, integrated discrimination improvement (IDI), the net reclassification improvement (NRI) and decision curve analysis.

Results

A total of 675 consecutive CTD-ILD patients were enrolled in this study, during the median follow-up period of 50 (interquartile range, 38–65) months, 158 patients died (mortality rate 23.4%). After feature selection, 9 variables were identified: age, rheumatoid arthritis, lung diffusing capacity for carbon monoxide, right ventricular diameter, right atrial area, honeycombing, immunosuppressive agents, aspartate transaminase and albumin. A predictive nomogram was generated by integrating these variables, which provided better mortality estimates than ILD-GAP model based on the likelihood ratio testing, Harrell’s C index (0.767 and 0.652 respectively) and calibration plots. Application of the nomogram resulted in an improved IDI (3- and 5-year, 0.137 and 0.136 respectively) and NRI (3- and 5-year, 0.294 and 0.325 respectively) compared with ILD-GAP model. In addition, the nomogram was more clinically useful revealed by decision curve analysis.

Conclusions

The results from our study prove that the ILD-GAP model may exhibit an inapplicable role in predicting mortality risk in Chinese CTD-ILD patients. The nomogram we developed performed well in predicting 3‑ and 5-year mortality risk of Chinese CTD-ILD patients, but further studies and external validation will be required to determine the clinical usefulness of the nomogram.
Literature
1.
go back to reference Spagnolo P, Distler O, Ryerson CJ, Tzouvelekis A, Lee JS, Bonella F, et al. Mechanisms of progressive fibrosis in connective tissue disease (CTD)-associated interstitial lung diseases (ILDs). Ann Rheum Dis. 2021;80(2):143–50.CrossRefPubMed Spagnolo P, Distler O, Ryerson CJ, Tzouvelekis A, Lee JS, Bonella F, et al. Mechanisms of progressive fibrosis in connective tissue disease (CTD)-associated interstitial lung diseases (ILDs). Ann Rheum Dis. 2021;80(2):143–50.CrossRefPubMed
2.
go back to reference Mathai SC, Danoff SK. Management of interstitial lung disease associated with connective tissue disease. BMJ (Clinical research ed). 2016;352:h6819.PubMedCentral Mathai SC, Danoff SK. Management of interstitial lung disease associated with connective tissue disease. BMJ (Clinical research ed). 2016;352:h6819.PubMedCentral
3.
go back to reference Suzuki A, Kondoh Y, Fischer A. Recent advances in connective tissue disease related interstitial lung disease. Expert Rev Respir Med. 2017;11(7):591–603.CrossRefPubMed Suzuki A, Kondoh Y, Fischer A. Recent advances in connective tissue disease related interstitial lung disease. Expert Rev Respir Med. 2017;11(7):591–603.CrossRefPubMed
4.
go back to reference Demoruelle MK, Mittoo S, Solomon JJ. Connective tissue disease-related interstitial lung disease. Best Pract Res Clin Rheumatol. 2016;30(1):39–52.CrossRefPubMed Demoruelle MK, Mittoo S, Solomon JJ. Connective tissue disease-related interstitial lung disease. Best Pract Res Clin Rheumatol. 2016;30(1):39–52.CrossRefPubMed
5.
go back to reference Ryerson CJ, Vittinghoff E, Ley B, Lee JS, Mooney JJ, Jones KD, et al. Predicting survival across chronic interstitial lung disease: the ILD-GAP model. Chest. 2014;145(4):723–8.CrossRefPubMed Ryerson CJ, Vittinghoff E, Ley B, Lee JS, Mooney JJ, Jones KD, et al. Predicting survival across chronic interstitial lung disease: the ILD-GAP model. Chest. 2014;145(4):723–8.CrossRefPubMed
6.
go back to reference McVeigh CM, Cairns AP. Diagnosis and management of ankylosing spondylitis. BMJ (Clinical research ed). 2006;333(7568):581–5.CrossRef McVeigh CM, Cairns AP. Diagnosis and management of ankylosing spondylitis. BMJ (Clinical research ed). 2006;333(7568):581–5.CrossRef
7.
go back to reference Sharp GC, Irvin WS, Tan EM, Gould RG, Holman HR. Mixed connective tissue disease–an apparently distinct rheumatic disease syndrome associated with a specific antibody to an extractable nuclear antigen (ENA). Am J Med. 1972;52(2):148–59.CrossRefPubMed Sharp GC, Irvin WS, Tan EM, Gould RG, Holman HR. Mixed connective tissue disease–an apparently distinct rheumatic disease syndrome associated with a specific antibody to an extractable nuclear antigen (ENA). Am J Med. 1972;52(2):148–59.CrossRefPubMed
8.
go back to reference Vitali C, Bombardieri S, Moutsopoulos HM, Coll J, Gerli R, Hatron PY, et al. Assessment of the European classification criteria for Sjogren’s syndrome in a series of clinically defined cases: results of a prospective multicentre study. The European Study Group on Diagnostic Criteria for Sjogren’s Syndrome. Ann Rheum Dis. 1996;55(2):116–21.CrossRefPubMedPubMedCentral Vitali C, Bombardieri S, Moutsopoulos HM, Coll J, Gerli R, Hatron PY, et al. Assessment of the European classification criteria for Sjogren’s syndrome in a series of clinically defined cases: results of a prospective multicentre study. The European Study Group on Diagnostic Criteria for Sjogren’s Syndrome. Ann Rheum Dis. 1996;55(2):116–21.CrossRefPubMedPubMedCentral
9.
go back to reference Wolf L, Sheahan M, McCormick J, Michel B, Moskowitz RW. Classification criteria for systemic lupus erythematosus. Frequency in normal patients. JAMA. 1976;236(13):1497–9.CrossRefPubMed Wolf L, Sheahan M, McCormick J, Michel B, Moskowitz RW. Classification criteria for systemic lupus erythematosus. Frequency in normal patients. JAMA. 1976;236(13):1497–9.CrossRefPubMed
10.
go back to reference Bohan A, Peter JB. Polymyositis and dermatomyositis (first of two parts). N Engl J Med. 1975;292(7):344–7.CrossRefPubMed Bohan A, Peter JB. Polymyositis and dermatomyositis (first of two parts). N Engl J Med. 1975;292(7):344–7.CrossRefPubMed
11.
go back to reference Preliminary criteria for the classification of systemic sclerosis (scleroderma). Subcommittee for scleroderma criteria of the American Rheumatism Association Diagnostic and Therapeutic Criteria Committee. Arthritis Rheum. 1980;23(5):581–90. Preliminary criteria for the classification of systemic sclerosis (scleroderma). Subcommittee for scleroderma criteria of the American Rheumatism Association Diagnostic and Therapeutic Criteria Committee. Arthritis Rheum. 1980;23(5):581–90.
12.
go back to reference Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham CO 3rd, et al. 2010 Rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Arthritis Rheum. 2010;62(9):2569–81.CrossRefPubMed Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham CO 3rd, et al. 2010 Rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Arthritis Rheum. 2010;62(9):2569–81.CrossRefPubMed
13.
go back to reference Hu Y, Wang LS, Wei YR, Du SS, Du YK, He X, et al. Clinical characteristics of connective tissue disease-associated interstitial lung disease in 1,044 Chinese patients. Chest. 2016;149(1):201–8.CrossRefPubMed Hu Y, Wang LS, Wei YR, Du SS, Du YK, He X, et al. Clinical characteristics of connective tissue disease-associated interstitial lung disease in 1,044 Chinese patients. Chest. 2016;149(1):201–8.CrossRefPubMed
14.
go back to reference Brusca RM, Pinal-Fernandez I, Psoter K, Paik JJ, Albayda J, Mecoli C, et al. The ILD-GAP risk prediction model performs poorly in myositis-associated interstitial lung disease. Respir Med. 2019;150:63–5.CrossRefPubMedPubMedCentral Brusca RM, Pinal-Fernandez I, Psoter K, Paik JJ, Albayda J, Mecoli C, et al. The ILD-GAP risk prediction model performs poorly in myositis-associated interstitial lung disease. Respir Med. 2019;150:63–5.CrossRefPubMedPubMedCentral
15.
go back to reference Mango RL, Matteson EL, Crowson CS, Ryu JH, Makol A. Assessing mortality models in systemic sclerosis-related interstitial lung disease. Lung. 2018;196(4):409–16.CrossRefPubMed Mango RL, Matteson EL, Crowson CS, Ryu JH, Makol A. Assessing mortality models in systemic sclerosis-related interstitial lung disease. Lung. 2018;196(4):409–16.CrossRefPubMed
16.
go back to reference Kam MLW, Li HH, Tan YH, Low SY. Validation of the ILD-GAP model and a local nomogram in a singaporean cohort. Respiration. 2019;98(5):383–90.CrossRefPubMed Kam MLW, Li HH, Tan YH, Low SY. Validation of the ILD-GAP model and a local nomogram in a singaporean cohort. Respiration. 2019;98(5):383–90.CrossRefPubMed
17.
go back to reference Yunt ZX, Chung JH, Hobbs S, Fernandez-Perez ER, Olson AL, Huie TJ, et al. High resolution computed tomography pattern of usual interstitial pneumonia in rheumatoid arthritis-associated interstitial lung disease: relationship to survival. Respir Med. 2017;126:100–4.CrossRefPubMed Yunt ZX, Chung JH, Hobbs S, Fernandez-Perez ER, Olson AL, Huie TJ, et al. High resolution computed tomography pattern of usual interstitial pneumonia in rheumatoid arthritis-associated interstitial lung disease: relationship to survival. Respir Med. 2017;126:100–4.CrossRefPubMed
18.
go back to reference Kim EJ, Elicker BM, Maldonado F, Webb WR, Ryu JH, Van Uden JH, et al. Usual interstitial pneumonia in rheumatoid arthritis-associated interstitial lung disease. Eur Respir J. 2010;35(6):1322–8.CrossRefPubMed Kim EJ, Elicker BM, Maldonado F, Webb WR, Ryu JH, Van Uden JH, et al. Usual interstitial pneumonia in rheumatoid arthritis-associated interstitial lung disease. Eur Respir J. 2010;35(6):1322–8.CrossRefPubMed
19.
go back to reference Chung JH, Chawla A, Peljto AL, Cool CD, Groshong SD, Talbert JL, et al. CT scan findings of probable usual interstitial pneumonitis have a high predictive value for histologic usual interstitial pneumonitis. Chest. 2015;147(2):450–9.CrossRefPubMed Chung JH, Chawla A, Peljto AL, Cool CD, Groshong SD, Talbert JL, et al. CT scan findings of probable usual interstitial pneumonitis have a high predictive value for histologic usual interstitial pneumonitis. Chest. 2015;147(2):450–9.CrossRefPubMed
20.
go back to reference Kelly CA, Saravanan V, Nisar M, Arthanari S, Woodhead FA, Price-Forbes AN, et al. Rheumatoid arthritis-related interstitial lung disease: associations, prognostic factors and physiological and radiological characteristics–a large multicentre UK study. Rheumatology (Oxford). 2014;53(9):1676–82.CrossRef Kelly CA, Saravanan V, Nisar M, Arthanari S, Woodhead FA, Price-Forbes AN, et al. Rheumatoid arthritis-related interstitial lung disease: associations, prognostic factors and physiological and radiological characteristics–a large multicentre UK study. Rheumatology (Oxford). 2014;53(9):1676–82.CrossRef
21.
go back to reference Fu Q, Wang L, Li L, Li Y, Liu R, Zheng Y. Risk factors for progression and prognosis of rheumatoid arthritis-associated interstitial lung disease: single center study with a large sample of Chinese population. Clin Rheumatol. 2019;38(4):1109–16.CrossRefPubMed Fu Q, Wang L, Li L, Li Y, Liu R, Zheng Y. Risk factors for progression and prognosis of rheumatoid arthritis-associated interstitial lung disease: single center study with a large sample of Chinese population. Clin Rheumatol. 2019;38(4):1109–16.CrossRefPubMed
22.
go back to reference Hull RP, Goldsmith DJ. Nephrotic syndrome in adults. BMJ (Clinical research ed). 2008;336(7654):1185–9.CrossRef Hull RP, Goldsmith DJ. Nephrotic syndrome in adults. BMJ (Clinical research ed). 2008;336(7654):1185–9.CrossRef
23.
go back to reference Lawrence YA, Steiner JM. Laboratory evaluation of the liver. Vet Clin North Am Small Anim Pract. 2017;47(3):539–53.CrossRefPubMed Lawrence YA, Steiner JM. Laboratory evaluation of the liver. Vet Clin North Am Small Anim Pract. 2017;47(3):539–53.CrossRefPubMed
24.
go back to reference Li R, Zhu WJ, Wang F, Tang X, Luo F. AST/ALT ratio as a predictor of mortality and exacerbations of PM/DM-ILD in 1 year-a retrospective cohort study with 522 cases. Arthritis Res Ther. 2020;22(1):202.CrossRefPubMedPubMedCentral Li R, Zhu WJ, Wang F, Tang X, Luo F. AST/ALT ratio as a predictor of mortality and exacerbations of PM/DM-ILD in 1 year-a retrospective cohort study with 522 cases. Arthritis Res Ther. 2020;22(1):202.CrossRefPubMedPubMedCentral
25.
go back to reference Akirov A, Masri-Iraqi H, Atamna A, Shimon I. Low albumin levels are associated with mortality risk in hospitalized patients. Am J Med. 2017;130(12):1465.CrossRefPubMed Akirov A, Masri-Iraqi H, Atamna A, Shimon I. Low albumin levels are associated with mortality risk in hospitalized patients. Am J Med. 2017;130(12):1465.CrossRefPubMed
26.
go back to reference Grimminger J, Ghofrani HA, Weissmann N, Klose H, Grimminger F. COPD-associated pulmonary hypertension: clinical implications and current methods for treatment. Expert Rev Respir Med. 2016;10(7):755–66.CrossRefPubMed Grimminger J, Ghofrani HA, Weissmann N, Klose H, Grimminger F. COPD-associated pulmonary hypertension: clinical implications and current methods for treatment. Expert Rev Respir Med. 2016;10(7):755–66.CrossRefPubMed
27.
go back to reference Wang Z, Chesler NC. Pulmonary vascular mechanics: important contributors to the increased right ventricular afterload of pulmonary hypertension. Exp Physiol. 2013;98(8):1267–73.CrossRefPubMedPubMedCentral Wang Z, Chesler NC. Pulmonary vascular mechanics: important contributors to the increased right ventricular afterload of pulmonary hypertension. Exp Physiol. 2013;98(8):1267–73.CrossRefPubMedPubMedCentral
28.
go back to reference Castelino FV, Varga J. Interstitial lung disease in connective tissue diseases: evolving concepts of pathogenesis and management. Arthritis Res Ther. 2010;12(4):213.CrossRefPubMedPubMedCentral Castelino FV, Varga J. Interstitial lung disease in connective tissue diseases: evolving concepts of pathogenesis and management. Arthritis Res Ther. 2010;12(4):213.CrossRefPubMedPubMedCentral
30.
go back to reference Witt LJ, Demchuk C, Curran JJ, Strek ME. Benefit of adjunctive tacrolimus in connective tissue disease-interstitial lung disease. Pulm Pharmacol Ther. 2016;36:46–52.CrossRefPubMedPubMedCentral Witt LJ, Demchuk C, Curran JJ, Strek ME. Benefit of adjunctive tacrolimus in connective tissue disease-interstitial lung disease. Pulm Pharmacol Ther. 2016;36:46–52.CrossRefPubMedPubMedCentral
31.
go back to reference Young A, Koduri G, Batley M, Kulinskaya E, Gough A, Norton S, et al. Mortality in rheumatoid arthritis. Increased in the early course of disease, in ischaemic heart disease and in pulmonary fibrosis. Rheumatology. 2007;46(2):350–7.CrossRefPubMed Young A, Koduri G, Batley M, Kulinskaya E, Gough A, Norton S, et al. Mortality in rheumatoid arthritis. Increased in the early course of disease, in ischaemic heart disease and in pulmonary fibrosis. Rheumatology. 2007;46(2):350–7.CrossRefPubMed
32.
go back to reference Olson AL, Swigris JJ, Sprunger DB, Fischer A, Fernandez-Perez ER, Solomon J, et al. Rheumatoid arthritis-interstitial lung disease-associated mortality. Am J Respir Crit Care Med. 2011;183(3):372–8.CrossRefPubMedPubMedCentral Olson AL, Swigris JJ, Sprunger DB, Fischer A, Fernandez-Perez ER, Solomon J, et al. Rheumatoid arthritis-interstitial lung disease-associated mortality. Am J Respir Crit Care Med. 2011;183(3):372–8.CrossRefPubMedPubMedCentral
33.
go back to reference Tibshirani R. The lasso method for variable selection in the Cox model. Stat Med. 1997;16(4):385–95.CrossRefPubMed Tibshirani R. The lasso method for variable selection in the Cox model. Stat Med. 1997;16(4):385–95.CrossRefPubMed
34.
go back to reference Ley B, Ryerson CJ, Vittinghoff E, Ryu JH, Tomassetti S, Lee JS, et al. A multidimensional index and staging system for idiopathic pulmonary fibrosis. Ann Intern Med. 2012;156(10):684–91.CrossRefPubMed Ley B, Ryerson CJ, Vittinghoff E, Ryu JH, Tomassetti S, Lee JS, et al. A multidimensional index and staging system for idiopathic pulmonary fibrosis. Ann Intern Med. 2012;156(10):684–91.CrossRefPubMed
35.
go back to reference Jones PW, Quirk FH, Baveystock CM. The St George’s respiratory questionnaire. Respir Med. 1991;85(Suppl B):25–31.CrossRefPubMed Jones PW, Quirk FH, Baveystock CM. The St George’s respiratory questionnaire. Respir Med. 1991;85(Suppl B):25–31.CrossRefPubMed
36.
go back to reference Schurink CAM, Nieuwenhoven CAV, Jacobs JA, Rozenberg-Arska M, Joore HCA, Buskens E, et al. Clinical pulmonary infection score for ventilator-associated pneumonia: accuracy and inter-observer variability. Intensive Care Med. 2004;30(2):217–24.CrossRefPubMed Schurink CAM, Nieuwenhoven CAV, Jacobs JA, Rozenberg-Arska M, Joore HCA, Buskens E, et al. Clinical pulmonary infection score for ventilator-associated pneumonia: accuracy and inter-observer variability. Intensive Care Med. 2004;30(2):217–24.CrossRefPubMed
37.
go back to reference Valencia M, Badia JR, Cavalcanti M, Ferrer M, Agusti C, Angrill J, et al. Pneumonia severity index class v patients with community-acquired pneumonia: characteristics, outcomes, and value of severity scores. Chest. 2007;132(2):515–22.CrossRefPubMed Valencia M, Badia JR, Cavalcanti M, Ferrer M, Agusti C, Angrill J, et al. Pneumonia severity index class v patients with community-acquired pneumonia: characteristics, outcomes, and value of severity scores. Chest. 2007;132(2):515–22.CrossRefPubMed
Metadata
Title
Prediction of long-term mortality by using machine learning models in Chinese patients with connective tissue disease-associated interstitial lung disease
Authors
Di Sun
Yu Wang
Qing Liu
Tingting Wang
Pengfei Li
Tianci Jiang
Lingling Dai
Liuqun Jia
Wenjing Zhao
Zhe Cheng
Publication date
01-12-2022
Publisher
BioMed Central
Published in
Respiratory Research / Issue 1/2022
Electronic ISSN: 1465-993X
DOI
https://doi.org/10.1186/s12931-022-01925-x

Other articles of this Issue 1/2022

Respiratory Research 1/2022 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.