Skip to main content
Top
Published in: European Radiology 5/2017

01-05-2017 | Computer Applications

Multicentre external validation of the BIMC model for solid solitary pulmonary nodule malignancy prediction

Authors: Gian Alberto Soardi, Simone Perandini, Anna Rita Larici, Annemilia del Ciello, Giovanna Rizzardi, Antonio Solazzo, Laura Mancino, Marco Bernhart, Massimiliano Motton, Stefania Montemezzi

Published in: European Radiology | Issue 5/2017

Login to get access

Abstract

Objectives

To provide multicentre external validation of the Bayesian Inference Malignancy Calculator (BIMC) model by assessing diagnostic accuracy in a cohort of solitary pulmonary nodules (SPNs) collected in a clinic-based setting. To assess model impact on SPN decision analysis and to compare findings with those obtained via the Mayo Clinic model.

Methods

Clinical and imaging data were retrospectively collected from 200 patients from three centres. Accuracy was assessed by means of receiver-operating characteristic (ROC) areas under the curve (AUCs). Decision analysis was performed by adopting both the American College of Chest Physicians (ACCP) and the British Thoracic Society (BTS) risk thresholds.

Results

ROC analysis showed an AUC of 0.880 (95 % CI, 0.832-0.928) for the BIMC model and of 0.604 (95 % CI, 0.524-0.683) for the Mayo Clinic model. Difference was 0.276 (95 % CI, 0.190-0.363, P < 0.0001). Decision analysis showed a slightly reduced number of false-negative and false-positive results when using ACCP risk thresholds.

Conclusions

The BIMC model proved to be an accurate tool when characterising SPNs. In a clinical setting it can distinguish malignancies from benign nodules with minimal errors by adopting current ACCP or BTS risk thresholds and guiding lesion-tailored diagnostic and interventional procedures during the work-up.

Key Points

The BIMC model can accurately discriminate malignancies in the clinical setting
The BIMC model showed ROC AUC of 0.880 in this multicentre study
The BIMC model compares favourably with the Mayo Clinic model
Literature
1.
go back to reference Ost D, Fein AM, Feinsilver SH (2007) The solitary pulmonary nodule. N Engl J Med 348:2535–2542CrossRef Ost D, Fein AM, Feinsilver SH (2007) The solitary pulmonary nodule. N Engl J Med 348:2535–2542CrossRef
2.
go back to reference Gould MK, Donington J, Lynch WR et al (2013) Evaluation of individuals with pulmonary nodules: when is it lung cancer?: Diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest 143:e93S–e120SCrossRefPubMedPubMedCentral Gould MK, Donington J, Lynch WR et al (2013) Evaluation of individuals with pulmonary nodules: when is it lung cancer?: Diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest 143:e93S–e120SCrossRefPubMedPubMedCentral
3.
go back to reference Callister ME, Baldwin DR, Akram AR et al (2015) British Thoracic Society guidelines for the investigation and management of pulmonary nodules. Thorax 70:ii1–ii54CrossRefPubMed Callister ME, Baldwin DR, Akram AR et al (2015) British Thoracic Society guidelines for the investigation and management of pulmonary nodules. Thorax 70:ii1–ii54CrossRefPubMed
4.
go back to reference Soardi GA, Perandini S, Motton M, Montemezzi S (2015) Assessing probability of malignancy in solid solitary pulmonary nodules with a new Bayesian calculator: improving diagnostic accuracy by means of expanded and updated features. Eur Radiol 25:155–162CrossRefPubMed Soardi GA, Perandini S, Motton M, Montemezzi S (2015) Assessing probability of malignancy in solid solitary pulmonary nodules with a new Bayesian calculator: improving diagnostic accuracy by means of expanded and updated features. Eur Radiol 25:155–162CrossRefPubMed
5.
go back to reference Hansell DM, Bankier AA, MacMahon H, McLoud TC, Müller NL, Remy J (2008) Fleischner Society: glossary of terms for thoracic imaging. Radiology 246:697–722CrossRefPubMed Hansell DM, Bankier AA, MacMahon H, McLoud TC, Müller NL, Remy J (2008) Fleischner Society: glossary of terms for thoracic imaging. Radiology 246:697–722CrossRefPubMed
6.
go back to reference Swensen SJ, Silverstein MD, Ilstrup DM et al (1997) The probability of malignancy in solitary pulmonary nodules. Application to small radiologically indeterminate nodules. Arch Intern Med 157:849–855CrossRefPubMed Swensen SJ, Silverstein MD, Ilstrup DM et al (1997) The probability of malignancy in solitary pulmonary nodules. Application to small radiologically indeterminate nodules. Arch Intern Med 157:849–855CrossRefPubMed
7.
go back to reference Herder GJ, van Tinteren H, Golding RP et al (2005) Clinical prediction model to characterize pulmonary nodules: validation and added value of 18F-fluorodeoxyglucose positron emission tomography. Chest 128:2490–2496CrossRefPubMed Herder GJ, van Tinteren H, Golding RP et al (2005) Clinical prediction model to characterize pulmonary nodules: validation and added value of 18F-fluorodeoxyglucose positron emission tomography. Chest 128:2490–2496CrossRefPubMed
8.
go back to reference Al-Ameri A, Malhotra P, Thygesen H et al (2015) Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 89:27–30CrossRefPubMed Al-Ameri A, Malhotra P, Thygesen H et al (2015) Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 89:27–30CrossRefPubMed
9.
go back to reference Isbell JM, Deppen S, Putnam JB Jr et al (2011) Existing general population models inaccurately predict lung cancer risk in patients referred for surgical evaluation. Ann Thorac Surg 91:227–233CrossRefPubMedPubMedCentral Isbell JM, Deppen S, Putnam JB Jr et al (2011) Existing general population models inaccurately predict lung cancer risk in patients referred for surgical evaluation. Ann Thorac Surg 91:227–233CrossRefPubMedPubMedCentral
10.
go back to reference Perandini S, Soardi GA, Motton M, Dallaserra C, Montemezzi S (2014) Limited value of logistic regression analysis in solid solitary pulmonary nodules characterization: a single-center experience on 288 consecutive cases. J Surg Oncol 110:883–887CrossRefPubMed Perandini S, Soardi GA, Motton M, Dallaserra C, Montemezzi S (2014) Limited value of logistic regression analysis in solid solitary pulmonary nodules characterization: a single-center experience on 288 consecutive cases. J Surg Oncol 110:883–887CrossRefPubMed
11.
go back to reference Perandini S, Soardi GA, Motton M, Montemezzi S (2015) Critique of Al-Ameri et al. (2015) - Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 90:118–119CrossRefPubMed Perandini S, Soardi GA, Motton M, Montemezzi S (2015) Critique of Al-Ameri et al. (2015) - Risk of malignancy in pulmonary nodules: a validation study of four prediction models. Lung Cancer 90:118–119CrossRefPubMed
Metadata
Title
Multicentre external validation of the BIMC model for solid solitary pulmonary nodule malignancy prediction
Authors
Gian Alberto Soardi
Simone Perandini
Anna Rita Larici
Annemilia del Ciello
Giovanna Rizzardi
Antonio Solazzo
Laura Mancino
Marco Bernhart
Massimiliano Motton
Stefania Montemezzi
Publication date
01-05-2017
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 5/2017
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-016-4538-5

Other articles of this Issue 5/2017

European Radiology 5/2017 Go to the issue