Skip to main content
Top
Published in: BMC Cardiovascular Disorders 1/2018

Open Access 01-12-2018 | Research article

Coronary calcium score improves the estimation for pretest probability of obstructive coronary artery disease and avoids unnecessary testing in individuals at low extreme of traditional risk factor burden: validation and comparison of CONFIRM score and genders extended model

Authors: Minghui Wang, Yujie Liu, Xiujun Zhou, Jia Zhou, Hong Zhang, Ying Zhang

Published in: BMC Cardiovascular Disorders | Issue 1/2018

Login to get access

Abstract

Background

Reliability of models for estimating pretest probability (PTP) of obstructive coronary artery disease (CAD) has not been investigated in individuals at low extreme of traditional risk factor (RF) burden. Thus, we sought to validate and compare CONFIRM score and Genders extended model (GEM) among these individuals.

Methods

We identified symptomatic individuals with 0 or 1 RF who underwent coronary calcium scan and coronary computed tomographic angiography (CCTA). Follow-up clinical data were also recorded. PTP of obstructive CAD for every individual was estimated according to CONFIRM score and GEM, respectively. Area under the receiver operating characteristic curve (AUC), integrated discrimination improvement (IDI), net reclassification improvement (NRI) and Hosmer–Lemeshow (H-L) test were used to assess the performance of models.

Results

There were 1201 individuals with 0 RF and 2415 with 1 RF. The AUC for GEM was significantly larger than that for CONFIRM score, no matter in individuals with 0 (0.843 v.s. 0.762, p < 0.0001) or 1 (0.823 v.s. 0.752, p < 0.0001) RF. Compared to CONFIRM score, GEM demonstrated positive IDI (5% in individuals with 0 RF and 8% in individuals with 1 RF), positive NRI (41.50% in individuals with 0 RF and 40.19% in individuals with 1 RF), better prediction of clinical events and less discrepancy between observed and predicted probabilities, resulting in a significant decrease of unnecessary testing, especially in negative individuals.

Conclusion

In individuals at low extreme of traditional RF burden of CAD, the addition of coronary calcium score provided a more accurate estimation for PTP and application of GEM instead of CONFIRM score could avoid unnecessary testing.
Literature
1.
go back to reference Genders TS, Meijboom WB, Meijs MF, Schuijf JD, Mollet NR, Weustink AC, et al. CT coronary angiography in patients suspected of having coronary artery disease: decision making from various perspectives in the face of uncertainty. Radiology. 2009;253:734–44.CrossRefPubMed Genders TS, Meijboom WB, Meijs MF, Schuijf JD, Mollet NR, Weustink AC, et al. CT coronary angiography in patients suspected of having coronary artery disease: decision making from various perspectives in the face of uncertainty. Radiology. 2009;253:734–44.CrossRefPubMed
2.
go back to reference Genders TS, Petersen SE, Pugliese F, Dastidar AG, Fleischmann KE, Nieman K, et al. The optimal imaging strategy for patients with stable chest pain: a cost-effectiveness analysis. Ann Intern Med. 2015;162:474–84.CrossRefPubMed Genders TS, Petersen SE, Pugliese F, Dastidar AG, Fleischmann KE, Nieman K, et al. The optimal imaging strategy for patients with stable chest pain: a cost-effectiveness analysis. Ann Intern Med. 2015;162:474–84.CrossRefPubMed
3.
go back to reference Min JK, Gilmore A, Budoff MJ, Berman DS, O’Day K. Cost-effectiveness of coronary CT angiography versus myocardial perfusion SPECT for evaluation of patients with chest pain and no known coronary artery disease. Radiology. 2010;254:801–8.CrossRefPubMed Min JK, Gilmore A, Budoff MJ, Berman DS, O’Day K. Cost-effectiveness of coronary CT angiography versus myocardial perfusion SPECT for evaluation of patients with chest pain and no known coronary artery disease. Radiology. 2010;254:801–8.CrossRefPubMed
4.
go back to reference Task Force M, Montalescot G, Sechtem U, Achenbach S, Andreotti F, Arden C, et al. ESC guidelines on the management of stable coronary artery disease: the task force on the management of stable coronary artery disease of the European Society of Cardiology. Eur Heart J. 2013;34:2949–3003.CrossRef Task Force M, Montalescot G, Sechtem U, Achenbach S, Andreotti F, Arden C, et al. ESC guidelines on the management of stable coronary artery disease: the task force on the management of stable coronary artery disease of the European Society of Cardiology. Eur Heart J. 2013;34:2949–3003.CrossRef
5.
go back to reference Fihn SD, Blankenship JC, Alexander KP, Bittl JA, Byrne JG, Fletcher BJ, et al. ACC/AHA/AATS/PCNA/SCAI/STS focused update of the guideline for the diagnosis and Management of Patients with Stable Ischemic Heart Disease. J Am Coll Cardiol. 2014;64:1929–49.CrossRefPubMed Fihn SD, Blankenship JC, Alexander KP, Bittl JA, Byrne JG, Fletcher BJ, et al. ACC/AHA/AATS/PCNA/SCAI/STS focused update of the guideline for the diagnosis and Management of Patients with Stable Ischemic Heart Disease. J Am Coll Cardiol. 2014;64:1929–49.CrossRefPubMed
6.
go back to reference Genders TS, Steyerberg EW, Alkadhi H, Leschka S, Desbiolles L, Nieman K, et al. A clinical prediction rule for the diagnosis of coronary artery disease: validation, updating, and extension. Eur Heart J. 2011;32:1316–30.CrossRefPubMed Genders TS, Steyerberg EW, Alkadhi H, Leschka S, Desbiolles L, Nieman K, et al. A clinical prediction rule for the diagnosis of coronary artery disease: validation, updating, and extension. Eur Heart J. 2011;32:1316–30.CrossRefPubMed
7.
go back to reference Zhou J, Liu Y, Huang L, Tan Y, Li X, Zhang H, et al. Validation and comparison of four models to calculate pretest probability of obstructive coronary artery disease in a Chinese population: a coronary computed tomographic angiography study. J Cardiovasc Comput Tomogr. 2017;11:317–23.CrossRefPubMed Zhou J, Liu Y, Huang L, Tan Y, Li X, Zhang H, et al. Validation and comparison of four models to calculate pretest probability of obstructive coronary artery disease in a Chinese population: a coronary computed tomographic angiography study. J Cardiovasc Comput Tomogr. 2017;11:317–23.CrossRefPubMed
8.
go back to reference Genders TSS, Coles A, Hoffmann U, Patel MR, Mark DB, Lee KL, et al. The external validity of prediction models for the diagnosis of obstructive coronary artery disease in patients with stable chest pain: insights from the PROMISE trial. JACC Cardiovasc Imaging. 2017;11:437–46.CrossRefPubMed Genders TSS, Coles A, Hoffmann U, Patel MR, Mark DB, Lee KL, et al. The external validity of prediction models for the diagnosis of obstructive coronary artery disease in patients with stable chest pain: insights from the PROMISE trial. JACC Cardiovasc Imaging. 2017;11:437–46.CrossRefPubMed
9.
go back to reference Almeida J, Fonseca P, Dias T, Ladeiras-Lopes R, Bettencourt N, Ribeiro J, et al. Comparison of coronary artery disease consortium 1 and 2 scores and Duke clinical score to predict obstructive coronary disease by invasive coronary angiography. Clin Cardiol. 2016;39:223–8.CrossRefPubMed Almeida J, Fonseca P, Dias T, Ladeiras-Lopes R, Bettencourt N, Ribeiro J, et al. Comparison of coronary artery disease consortium 1 and 2 scores and Duke clinical score to predict obstructive coronary disease by invasive coronary angiography. Clin Cardiol. 2016;39:223–8.CrossRefPubMed
10.
go back to reference Min JK, Dunning A, Gransar H, Achenbach S, Lin FY, Al-Mallah M, et al. Medical history for prognostic risk assessment and diagnosis of stable patients with suspected coronary artery disease. Am J Med. 2015;128:871–8.CrossRefPubMedPubMedCentral Min JK, Dunning A, Gransar H, Achenbach S, Lin FY, Al-Mallah M, et al. Medical history for prognostic risk assessment and diagnosis of stable patients with suspected coronary artery disease. Am J Med. 2015;128:871–8.CrossRefPubMedPubMedCentral
11.
go back to reference Genders TS, Steyerberg EW, Hunink MG, Nieman K, Galema TW, Mollet NR, et al. Prediction model to estimate presence of coronary artery disease: retrospective pooled analysis of existing cohorts. BMJ. 2012;344:e3485.CrossRefPubMedPubMedCentral Genders TS, Steyerberg EW, Hunink MG, Nieman K, Galema TW, Mollet NR, et al. Prediction model to estimate presence of coronary artery disease: retrospective pooled analysis of existing cohorts. BMJ. 2012;344:e3485.CrossRefPubMedPubMedCentral
12.
go back to reference Genders TS, Ferket BS, Hunink MG. The quantitative science of evaluating imaging evidence. JACC Cardiovasc Imaging. 2017;10:264–75.CrossRefPubMed Genders TS, Ferket BS, Hunink MG. The quantitative science of evaluating imaging evidence. JACC Cardiovasc Imaging. 2017;10:264–75.CrossRefPubMed
13.
go back to reference Diamond GA. A clinically relevant classification of chest discomfort. J Am Coll Cardiol. 1983;1:574–5.CrossRefPubMed Diamond GA. A clinically relevant classification of chest discomfort. J Am Coll Cardiol. 1983;1:574–5.CrossRefPubMed
14.
go back to reference Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol. 1990;15:827–32.CrossRefPubMed Agatston AS, Janowitz WR, Hildner FJ, Zusmer NR, Viamonte M, Detrano R. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol. 1990;15:827–32.CrossRefPubMed
15.
go back to reference Cury RC, Abbara S, Achenbach S, Agatston A, Berman DS, Budoff MJ, et al. CAD-RADS(TM) coronary artery disease - reporting and data system. An expert consensus document of the Society of Cardiovascular Computed Tomography (SCCT), the American College of Radiology (ACR) and the north American Society for Cardiovascular Imaging (NASCI). Endorsed by the American College of Cardiology. J Cardiovasc Comput Tomogr. 2016;10:269–81.CrossRefPubMed Cury RC, Abbara S, Achenbach S, Agatston A, Berman DS, Budoff MJ, et al. CAD-RADS(TM) coronary artery disease - reporting and data system. An expert consensus document of the Society of Cardiovascular Computed Tomography (SCCT), the American College of Radiology (ACR) and the north American Society for Cardiovascular Imaging (NASCI). Endorsed by the American College of Cardiology. J Cardiovasc Comput Tomogr. 2016;10:269–81.CrossRefPubMed
16.
go back to reference Bittencourt MS, Hulten E, Polonsky TS, Hoffman U, Nasir K, Abbara S, et al. European Society of Cardiology-Recommended Coronary Artery Disease Consortium Pretest Probability Scores More Accurately Predict Obstructive Coronary Disease and Cardiovascular Events than the diamond and Forrester score: the partners registry. Circulation. 2016;134:201–11.CrossRefPubMed Bittencourt MS, Hulten E, Polonsky TS, Hoffman U, Nasir K, Abbara S, et al. European Society of Cardiology-Recommended Coronary Artery Disease Consortium Pretest Probability Scores More Accurately Predict Obstructive Coronary Disease and Cardiovascular Events than the diamond and Forrester score: the partners registry. Circulation. 2016;134:201–11.CrossRefPubMed
17.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed
18.
go back to reference Pencina MJ, D'Agostino RB Sr, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72. discussion 207-12CrossRefPubMed Pencina MJ, D'Agostino RB Sr, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72. discussion 207-12CrossRefPubMed
19.
go back to reference Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. 2007;35:2052–6.CrossRefPubMed Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. 2007;35:2052–6.CrossRefPubMed
20.
go back to reference Rovai D, Neglia D, Lorenzoni V, Caselli C, Knuuti J, Underwood SR. Limitations of chest pain categorization models to predict coronary artery disease. Am J Cardiol. 2015;116:504–7.CrossRefPubMed Rovai D, Neglia D, Lorenzoni V, Caselli C, Knuuti J, Underwood SR. Limitations of chest pain categorization models to predict coronary artery disease. Am J Cardiol. 2015;116:504–7.CrossRefPubMed
21.
go back to reference Akita Chun A, McGee SR. Bedside diagnosis of coronary artery disease: a systematic review. Am J Med. 2004;117:334–43.CrossRef Akita Chun A, McGee SR. Bedside diagnosis of coronary artery disease: a systematic review. Am J Med. 2004;117:334–43.CrossRef
22.
go back to reference Cheng VY, Berman DS, Rozanski A, Dunning AM, Achenbach S, Al-Mallah M, et al. Performance of the traditional age, sex, and angina typicality-based approach for estimating pretest probability of angiographically significant coronary artery disease in patients undergoing coronary computed tomographic angiography: results from the multinational coronary CT angiography evaluation for clinical outcomes: an international multicenter registry (CONFIRM). Circulation. 2011;124:2423–32. 1–8CrossRefPubMedPubMedCentral Cheng VY, Berman DS, Rozanski A, Dunning AM, Achenbach S, Al-Mallah M, et al. Performance of the traditional age, sex, and angina typicality-based approach for estimating pretest probability of angiographically significant coronary artery disease in patients undergoing coronary computed tomographic angiography: results from the multinational coronary CT angiography evaluation for clinical outcomes: an international multicenter registry (CONFIRM). Circulation. 2011;124:2423–32. 1–8CrossRefPubMedPubMedCentral
23.
go back to reference Takamura K, Kondo T, Fujimoto S, Hiki M, Matsumori R, Kawaguchi Y, et al. Incremental predictive value for obstructive coronary artery disease by combination of Duke clinical score and Agatston score. Eur Heart J Cardiovasc Imaging. 2016;17:550–6.CrossRefPubMed Takamura K, Kondo T, Fujimoto S, Hiki M, Matsumori R, Kawaguchi Y, et al. Incremental predictive value for obstructive coronary artery disease by combination of Duke clinical score and Agatston score. Eur Heart J Cardiovasc Imaging. 2016;17:550–6.CrossRefPubMed
24.
go back to reference Di Carli MF, Geva T, Davidoff R. The future of cardiovascular imaging. Circulation. 2016;133:2640–61.CrossRefPubMed Di Carli MF, Geva T, Davidoff R. The future of cardiovascular imaging. Circulation. 2016;133:2640–61.CrossRefPubMed
25.
go back to reference Nieuwlaat R, Schwalm JD, Khatib R, Yusuf S. Why are we failing to implement effective therapies in cardiovascular disease? Eur Heart J. 2013;34:1262–9.CrossRefPubMed Nieuwlaat R, Schwalm JD, Khatib R, Yusuf S. Why are we failing to implement effective therapies in cardiovascular disease? Eur Heart J. 2013;34:1262–9.CrossRefPubMed
26.
go back to reference Zhou J, Yang JJ, Yang X, Chen ZY, He B, Du LS, et al. Impact of clinical guideline recommendations on the application of coronary computed tomographic angiography in patients with suspected stable coronary artery disease. Chin Med J. 2016;129:135–41.CrossRefPubMedPubMedCentral Zhou J, Yang JJ, Yang X, Chen ZY, He B, Du LS, et al. Impact of clinical guideline recommendations on the application of coronary computed tomographic angiography in patients with suspected stable coronary artery disease. Chin Med J. 2016;129:135–41.CrossRefPubMedPubMedCentral
27.
go back to reference Douglas PS, Hoffmann U, Patel MR, Mark DB, Al-Khalidi HR, Cavanaugh B, et al. Outcomes of anatomical versus functional testing for coronary artery disease. N Engl J Med. 2015;372:1291–300.CrossRefPubMedPubMedCentral Douglas PS, Hoffmann U, Patel MR, Mark DB, Al-Khalidi HR, Cavanaugh B, et al. Outcomes of anatomical versus functional testing for coronary artery disease. N Engl J Med. 2015;372:1291–300.CrossRefPubMedPubMedCentral
28.
go back to reference Rozanski A, Gransar H, Hayes SW, Min J, Friedman JD, Thomson LE, et al. Temporal trends in the frequency of inducible myocardial ischemia during cardiac stress testing: 1991 to 2009. J Am Coll Cardiol. 2013;61:1054–65.CrossRefPubMed Rozanski A, Gransar H, Hayes SW, Min J, Friedman JD, Thomson LE, et al. Temporal trends in the frequency of inducible myocardial ischemia during cardiac stress testing: 1991 to 2009. J Am Coll Cardiol. 2013;61:1054–65.CrossRefPubMed
29.
go back to reference Douglas PS, Pontone G, Hlatky MA, Patel MR, Norgaard BL, Byrne RA, et al. Clinical outcomes of fractional flow reserve by computed tomographic angiography-guided diagnostic strategies vs. usual care in patients with suspected coronary artery disease: the prospective longitudinal trial of FFR(CT): outcome and resource impacts study. Eur Heart J. 2015;36:3359–67.CrossRefPubMedPubMedCentral Douglas PS, Pontone G, Hlatky MA, Patel MR, Norgaard BL, Byrne RA, et al. Clinical outcomes of fractional flow reserve by computed tomographic angiography-guided diagnostic strategies vs. usual care in patients with suspected coronary artery disease: the prospective longitudinal trial of FFR(CT): outcome and resource impacts study. Eur Heart J. 2015;36:3359–67.CrossRefPubMedPubMedCentral
30.
go back to reference Kruk M, Noll D, Achenbach S, Mintz GS, Pręgowski J, Kaczmarska E, et al. Impact of coronary artery calcium characteristics on accuracy of CT angiography. J Am Coll Cardiol Img. 2014;7:49–58.CrossRef Kruk M, Noll D, Achenbach S, Mintz GS, Pręgowski J, Kaczmarska E, et al. Impact of coronary artery calcium characteristics on accuracy of CT angiography. J Am Coll Cardiol Img. 2014;7:49–58.CrossRef
Metadata
Title
Coronary calcium score improves the estimation for pretest probability of obstructive coronary artery disease and avoids unnecessary testing in individuals at low extreme of traditional risk factor burden: validation and comparison of CONFIRM score and genders extended model
Authors
Minghui Wang
Yujie Liu
Xiujun Zhou
Jia Zhou
Hong Zhang
Ying Zhang
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Cardiovascular Disorders / Issue 1/2018
Electronic ISSN: 1471-2261
DOI
https://doi.org/10.1186/s12872-018-0912-3

Other articles of this Issue 1/2018

BMC Cardiovascular Disorders 1/2018 Go to the issue