Skip to main content
Top
Published in: Population Health Metrics 1/2015

Open Access 01-12-2015 | Research

Validation of a new predictive risk model: measuring the impact of the major modifiable risks of death for patients and populations

Authors: Stephen S. Lim, Emily Carnahan, Eugene C. Nelson, Catherine W. Gillespie, Ali H. Mokdad, Christopher J. L. Murray, Elliott S. Fisher

Published in: Population Health Metrics | Issue 1/2015

Login to get access

Abstract

Background

Modifiable risks account for a large fraction of disease and death, but clinicians and patients lack tools to identify high risk populations or compare the possible benefit of different interventions.

Methods

We used data on the distribution of exposure to 12 major behavioral and biometric risk factors inthe US population, mortality rates by cause, and estimates of the proportional hazards of risk factor exposure from published systematic reviews to develop a risk prediction model that estimates an adult’s 10 year mortality risk compared to a population with optimum risk factors. We compared predicted risk to observed mortality in 8,241 respondents in NHANES 1988-1994 and NHANES 1999-2004 with linked mortality data up to the end of 2006.

Results

Predicted risk showed good discrimination with an area under the receiver operating characteristic (ROC) curve of 0.84 (standard error 0.01) for women and 0.84 (SE 0.01) for men. Across deciles of predicted risk, mortality was accurately predicted in men ((Χ2 statistic = 12.3 for men, p=0.196) but slightly overpredicted in the highest decile among women (Χ2 statistic = 22.8, p=0.002). Mortality risk was highly concentrated; for example, among those age 30-44 years, 5.1 % (95 % CI 4.1 % - 6.0 %) of the male and 5.9 % (95 % CI 4.8 % - 6.9 %) of the female population accounted for 25 % of the risk of death.

Conclusion

The risk model accurately predicted mortality in a representative sample of the US population and could be used to help inform patient and provider decision-making, identify high risk groups, and monitor the impact of efforts to improve population health.
Appendix
Available only for authorised users
Literature
1.
go back to reference Committee on Quality of Health Care in America - Institute of Medicine. Crossing the Quality Chasm. A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001. Committee on Quality of Health Care in America - Institute of Medicine. Crossing the Quality Chasm. A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.
2.
go back to reference Danaei G, Ding EL, Mozaffarian D, Taylor B, Rehm J, Murray CJ, et al. The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med. 2009;6(4):e1000058. PubMed Pubmed Central PMCID: PMC2667673. Epub 2009/04/29. eng.CrossRefPubMedPubMedCentral Danaei G, Ding EL, Mozaffarian D, Taylor B, Rehm J, Murray CJ, et al. The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med. 2009;6(4):e1000058. PubMed Pubmed Central PMCID: PMC2667673. Epub 2009/04/29. eng.CrossRefPubMedPubMedCentral
3.
go back to reference Danaei G, Rimm EB, Oza S, Kulkarni SC, Murray CJ, Ezzati M. The promise of prevention: the effects of four preventable risk factors on national life expectancy and life expectancy disparities by race and county in the United States. PLoS Med. 2010;7(3):e1000248. PubMed Pubmed Central PMCID: PMC2843596. Epub 2010/03/31. eng.CrossRefPubMedPubMedCentral Danaei G, Rimm EB, Oza S, Kulkarni SC, Murray CJ, Ezzati M. The promise of prevention: the effects of four preventable risk factors on national life expectancy and life expectancy disparities by race and county in the United States. PLoS Med. 2010;7(3):e1000248. PubMed Pubmed Central PMCID: PMC2843596. Epub 2010/03/31. eng.CrossRefPubMedPubMedCentral
4.
go back to reference Thorpe KE, Florence CS, Howard DH, Joski P. The impact of obesity on rising medical spending. Health Affairs (Project Hope). 2004;Suppl Web Exclusives:W4–480-6. PubMed Epub 2004/10/22. eng. Thorpe KE, Florence CS, Howard DH, Joski P. The impact of obesity on rising medical spending. Health Affairs (Project Hope). 2004;Suppl Web Exclusives:W4–480-6. PubMed Epub 2004/10/22. eng.
5.
go back to reference Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J. 1991;121(1 Pt 2):293–8. PubMed Epub 1991/01/01. eng.CrossRefPubMed Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J. 1991;121(1 Pt 2):293–8. PubMed Epub 1991/01/01. eng.CrossRefPubMed
6.
go back to reference Fineberg HV. The paradox of disease prevention: celebrated in principle, resisted in practice. JAMA. 2013;310(1):85–90. PubMed Epub 2013/07/04. eng.CrossRefPubMed Fineberg HV. The paradox of disease prevention: celebrated in principle, resisted in practice. JAMA. 2013;310(1):85–90. PubMed Epub 2013/07/04. eng.CrossRefPubMed
8.
go back to reference Yourman LC, Lee SJ, Schonberg MA, Widera EW, Smith AK. Prognostic indices for older adults: a systematic review. JAMA. 2012;307(2):182–92. PubMed Epub 2012/01/12. eng.CrossRefPubMedPubMedCentral Yourman LC, Lee SJ, Schonberg MA, Widera EW, Smith AK. Prognostic indices for older adults: a systematic review. JAMA. 2012;307(2):182–92. PubMed Epub 2012/01/12. eng.CrossRefPubMedPubMedCentral
9.
go back to reference Lim SS, Vos T, Flaxman AD, Danaei G, Shibuya K, Adair-Rohani H, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2224–60. PubMed Epub 2012/12/19. eng.CrossRefPubMedPubMedCentral Lim SS, Vos T, Flaxman AD, Danaei G, Shibuya K, Adair-Rohani H, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2224–60. PubMed Epub 2012/12/19. eng.CrossRefPubMedPubMedCentral
10.
go back to reference Murray CJ, Lopez AD. Alternative projections of mortality and disability by cause 1990–2020: Global Burden of Disease Study. Lancet. 1997;349(9064):1498–504. PubMed Epub 1997/05/24. eng.CrossRefPubMed Murray CJ, Lopez AD. Alternative projections of mortality and disability by cause 1990–2020: Global Burden of Disease Study. Lancet. 1997;349(9064):1498–504. PubMed Epub 1997/05/24. eng.CrossRefPubMed
11.
go back to reference Akhoundi FH, Ghorbani A, Soltani A, Meysamie A. Favorable functional outcomes in acute ischemic stroke patients with subclinical hypothyroidism. Neurology. 2011;77(4):349–54. PubMed Epub 2011/07/01. eng.CrossRefPubMed Akhoundi FH, Ghorbani A, Soltani A, Meysamie A. Favorable functional outcomes in acute ischemic stroke patients with subclinical hypothyroidism. Neurology. 2011;77(4):349–54. PubMed Epub 2011/07/01. eng.CrossRefPubMed
12.
go back to reference Fillinger M. Who should we operate on and how do we decide: predicting rupture and survival in patients with aortic aneurysm. Semin Vasc Surg. 2007;20(2):121–7. PubMed Epub 2007/06/21. eng.CrossRefPubMed Fillinger M. Who should we operate on and how do we decide: predicting rupture and survival in patients with aortic aneurysm. Semin Vasc Surg. 2007;20(2):121–7. PubMed Epub 2007/06/21. eng.CrossRefPubMed
13.
go back to reference D’Agostino RB, Russell MW, Huse DM, Ellison RC, Silbershatz H, Wilson PW, et al. Primary and subsequent coronary risk appraisal: new results from the Framingham study. Am Heart J. 2000;139(2 Pt 1):272–81. PubMed Epub 2000/01/29. eng.CrossRefPubMed D’Agostino RB, Russell MW, Huse DM, Ellison RC, Silbershatz H, Wilson PW, et al. Primary and subsequent coronary risk appraisal: new results from the Framingham study. Am Heart J. 2000;139(2 Pt 1):272–81. PubMed Epub 2000/01/29. eng.CrossRefPubMed
14.
go back to reference Goel A, Pinckney RG, Littenberg B. APACHE II predicts long-term survival in COPD patients admitted to a general medical ward. J Gen Intern Med. 2003;18(10):824–30. PubMed Pubmed Central PMCID: PMC1494923. Epub 2003/10/03. eng.CrossRefPubMedPubMedCentral Goel A, Pinckney RG, Littenberg B. APACHE II predicts long-term survival in COPD patients admitted to a general medical ward. J Gen Intern Med. 2003;18(10):824–30. PubMed Pubmed Central PMCID: PMC1494923. Epub 2003/10/03. eng.CrossRefPubMedPubMedCentral
15.
go back to reference Schoonhoven L, Grobbee DE, Donders AR, Algra A, Grypdonck MH, Bousema MT, et al. Prediction of pressure ulcer development in hospitalized patients: a tool for risk assessment. Qual Saf Health Care. 2006;15(1):65–70. PubMed Pubmed Central PMCID: PMC2563999. Epub 2006/02/04. eng.CrossRefPubMedPubMedCentral Schoonhoven L, Grobbee DE, Donders AR, Algra A, Grypdonck MH, Bousema MT, et al. Prediction of pressure ulcer development in hospitalized patients: a tool for risk assessment. Qual Saf Health Care. 2006;15(1):65–70. PubMed Pubmed Central PMCID: PMC2563999. Epub 2006/02/04. eng.CrossRefPubMedPubMedCentral
16.
go back to reference Loeppke R, Taitel M, Haufle V, Parry T, Kessler RC, Jinnett K. Health and productivity as a business strategy: a multiemployer study. J Occup Environ Med. 2009;51(4):411–28. PubMed Epub 2009/04/03. eng.CrossRefPubMed Loeppke R, Taitel M, Haufle V, Parry T, Kessler RC, Jinnett K. Health and productivity as a business strategy: a multiemployer study. J Occup Environ Med. 2009;51(4):411–28. PubMed Epub 2009/04/03. eng.CrossRefPubMed
17.
go back to reference O’Donnell MP. Health promotion in the workplace: CengageBrain.com; 2001. O’Donnell MP. Health promotion in the workplace: CengageBrain.com; 2001.
18.
go back to reference Preston SH, Heuveline P, Guillot M. Demography: Measuring and modeling population processes. Pop Dev Rev. 2001;27:365.CrossRef Preston SH, Heuveline P, Guillot M. Demography: Measuring and modeling population processes. Pop Dev Rev. 2001;27:365.CrossRef
19.
go back to reference Coale A, Guo G. Revised regional model life tables at very low levels of mortality. Population Index. 1989 Winter;55(4):613-43. PubMed Epub 1989/01/01. eng. Coale A, Guo G. Revised regional model life tables at very low levels of mortality. Population Index. 1989 Winter;55(4):613-43. PubMed Epub 1989/01/01. eng.
20.
go back to reference Ezzati M, Hoorn SV, Rodgers A, Lopez AD, Mathers CD, Murray CJ. Estimates of global and regional potential health gains from reducing multiple major risk factors. Lancet. 2003;362(9380):271–80. PubMed Epub 2003/08/02. eng.CrossRefPubMed Ezzati M, Hoorn SV, Rodgers A, Lopez AD, Mathers CD, Murray CJ. Estimates of global and regional potential health gains from reducing multiple major risk factors. Lancet. 2003;362(9380):271–80. PubMed Epub 2003/08/02. eng.CrossRefPubMed
21.
go back to reference Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2095–128. PubMed Epub 2012/12/19. eng.CrossRefPubMed Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2095–128. PubMed Epub 2012/12/19. eng.CrossRefPubMed
22.
go back to reference Naghavi M, Makela S, Foreman K, O’Brien J, Pourmalek F, Lozano R. Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metrics. 2010;8:9. PubMed Pubmed Central PMCID: PMC2873308. Epub 2010/05/13. eng.CrossRef Naghavi M, Makela S, Foreman K, O’Brien J, Pourmalek F, Lozano R. Algorithms for enhancing public health utility of national causes-of-death data. Popul Health Metrics. 2010;8:9. PubMed Pubmed Central PMCID: PMC2873308. Epub 2010/05/13. eng.CrossRef
23.
go back to reference Hosmer DW, Lemeshow S. Applied logistic regression: Wiley-Interscience. 2000.CrossRef Hosmer DW, Lemeshow S. Applied logistic regression: Wiley-Interscience. 2000.CrossRef
25.
go back to reference Kannel WB, Dawber TR, Kagan A, Revotskie N, Stokes 3rd J. Factors of risk in the development of coronary heart disease--six year follow-up experience. The Framingham Study. Ann Intern Med. 1961;55:33–50. PubMed Epub 1961/07/01. eng.CrossRefPubMed Kannel WB, Dawber TR, Kagan A, Revotskie N, Stokes 3rd J. Factors of risk in the development of coronary heart disease--six year follow-up experience. The Framingham Study. Ann Intern Med. 1961;55:33–50. PubMed Epub 1961/07/01. eng.CrossRefPubMed
26.
go back to reference Truett J, Cornfield J, Kannel W. A multivariate analysis of the risk of coronary heart disease in Framingham. J Chronic Dis. 1967;20(7):511–24. PubMed Epub 1967/07/01. eng.CrossRefPubMed Truett J, Cornfield J, Kannel W. A multivariate analysis of the risk of coronary heart disease in Framingham. J Chronic Dis. 1967;20(7):511–24. PubMed Epub 1967/07/01. eng.CrossRefPubMed
27.
go back to reference Lloyd-Jones DM. Cardiovascular risk prediction: basic concepts, current status, and future directions. Circulation. 2010;121(15):1768–77. PubMed Epub 2010/04/21. eng.CrossRefPubMed Lloyd-Jones DM. Cardiovascular risk prediction: basic concepts, current status, and future directions. Circulation. 2010;121(15):1768–77. PubMed Epub 2010/04/21. eng.CrossRefPubMed
29.
go back to reference Ma J, Berra K, Haskell WL, Klieman L, Hyde S, Smith MW, et al. Case management to reduce risk of cardiovascular disease in a county health care system. Arch Intern Med. 2009;169(21):1988–95. PubMed Pubmed Central PMCID: PMC3000904. Epub 2009/11/26. eng.CrossRefPubMedPubMedCentral Ma J, Berra K, Haskell WL, Klieman L, Hyde S, Smith MW, et al. Case management to reduce risk of cardiovascular disease in a county health care system. Arch Intern Med. 2009;169(21):1988–95. PubMed Pubmed Central PMCID: PMC3000904. Epub 2009/11/26. eng.CrossRefPubMedPubMedCentral
30.
go back to reference Meyer GS, Nelson EC, Pryor DB, James B, Swensen SJ, Kaplan GS, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012;21(11):964–8. PubMed Pubmed Central PMCID: PMC3594932. Epub 2012/08/16. eng.CrossRefPubMedPubMedCentral Meyer GS, Nelson EC, Pryor DB, James B, Swensen SJ, Kaplan GS, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012;21(11):964–8. PubMed Pubmed Central PMCID: PMC3594932. Epub 2012/08/16. eng.CrossRefPubMedPubMedCentral
31.
go back to reference Yusuf S, Hawken S, Ounpuu S, Dans T, Avezum A, Lanas F, et al. Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case–control study. Lancet. 2004;364(9438):937–52. PubMed Epub 2004/09/15. eng.CrossRefPubMed Yusuf S, Hawken S, Ounpuu S, Dans T, Avezum A, Lanas F, et al. Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case–control study. Lancet. 2004;364(9438):937–52. PubMed Epub 2004/09/15. eng.CrossRefPubMed
32.
go back to reference Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4. PubMed Epub 2010/07/22. eng.CrossRefPubMed Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4. PubMed Epub 2010/07/22. eng.CrossRefPubMed
Metadata
Title
Validation of a new predictive risk model: measuring the impact of the major modifiable risks of death for patients and populations
Authors
Stephen S. Lim
Emily Carnahan
Eugene C. Nelson
Catherine W. Gillespie
Ali H. Mokdad
Christopher J. L. Murray
Elliott S. Fisher
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2015
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/s12963-015-0059-8

Other articles of this Issue 1/2015

Population Health Metrics 1/2015 Go to the issue