Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Research article

Evaluating risk factor assumptions: a simulation-based approach

Authors: Carolyn M Rutter, Diana L Miglioretti, James E Savarino

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Background

Microsimulation models are an important tool for estimating the comparative effectiveness of interventions through prediction of individual-level disease outcomes for a hypothetical population. To estimate the effectiveness of interventions targeted toward high risk groups, the mechanism by which risk factors influence the natural history of disease must be specified. We propose a method for evaluating these risk factor assumptions as part of model-building.

Methods

We used simulation studies to examine the impact of risk factor assumptions on the relative rate (RR) of colorectal cancer (CRC) incidence and mortality for a cohort with a risk factor compared to a cohort without the risk factor using an extension of the CRC-SPIN model for colorectal cancer. We also compared the impact of changing age at initiation of screening colonoscopy for different risk mechanisms.

Results

Across CRC-specific risk factor mechanisms, the RR of CRC incidence and mortality decreased (towards one) with increasing age. The rate of change in RRs across age groups depended on both the risk factor mechanism and the strength of the risk factor effect. Increased non-CRC mortality attenuated the effect of CRC-specific risk factors on the RR of CRC when both were present. For each risk factor mechanism, earlier initiation of screening resulted in more life years gained, though the magnitude of life years gained varied across risk mechanisms.

Conclusions

Simulation studies can provide insight into both the effect of risk factor assumptions on model predictions and the type of data needed to calibrate risk factor models.
Literature
1.
go back to reference Rutter CM, Zaslavsky AM, Feuer EJ: Dynamic microsimulation models for health outcomes: A review. Med Decis Making. 2010, Rutter CM, Zaslavsky AM, Feuer EJ: Dynamic microsimulation models for health outcomes: A review. Med Decis Making. 2010,
2.
go back to reference Vogelaar I, Van Ballegooijen M, Schrag D, Boer R, Winawer SJ, Habbema JD, Zauber AG: How much can current interventions reduce colorectal cancer mortality in the U.S.?. Cancer. 2006, 107: 1623-1633.CrossRef Vogelaar I, Van Ballegooijen M, Schrag D, Boer R, Winawer SJ, Habbema JD, Zauber AG: How much can current interventions reduce colorectal cancer mortality in the U.S.?. Cancer. 2006, 107: 1623-1633.CrossRef
4.
go back to reference Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, Kuntz KM: Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force. Ann Intern Med. 2008, 149 (9): 659-669.CrossRefPubMedPubMedCentral Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, Kuntz KM: Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force. Ann Intern Med. 2008, 149 (9): 659-669.CrossRefPubMedPubMedCentral
5.
go back to reference Lieberman DA, Prindiville S, Weiss DG, Willett W: Risk factors for advanced colonic neoplasia and hyperplastic polyps in asymptomatic individuals. JAMA. 2003, 290 (22): 2959-2967. 10.1001/jama.290.22.2959.CrossRefPubMed Lieberman DA, Prindiville S, Weiss DG, Willett W: Risk factors for advanced colonic neoplasia and hyperplastic polyps in asymptomatic individuals. JAMA. 2003, 290 (22): 2959-2967. 10.1001/jama.290.22.2959.CrossRefPubMed
6.
go back to reference Heavey PM, McKenna D, Rowland IR: Colorectal cancer and the relationship between genes and the environment. Nutr Cancer. 2004, 48 (2): 124-141. 10.1207/s15327914nc4802_2.CrossRefPubMed Heavey PM, McKenna D, Rowland IR: Colorectal cancer and the relationship between genes and the environment. Nutr Cancer. 2004, 48 (2): 124-141. 10.1207/s15327914nc4802_2.CrossRefPubMed
7.
go back to reference Lansdorp-Vogelaar I, van Ballegooijen M, Zauber AG, Boer R, Wilschut J, Winawer SJ, Habbema JD: Individualizing colonoscopy screening by sex and race. Gastrointest Endosc. 2009, 70 (1): 96-108. 10.1016/j.gie.2008.08.040. 108 e101-124CrossRefPubMedPubMedCentral Lansdorp-Vogelaar I, van Ballegooijen M, Zauber AG, Boer R, Wilschut J, Winawer SJ, Habbema JD: Individualizing colonoscopy screening by sex and race. Gastrointest Endosc. 2009, 70 (1): 96-108. 10.1016/j.gie.2008.08.040. 108 e101-124CrossRefPubMedPubMedCentral
8.
go back to reference U.S. Department of Health and Human Services: Healthy People 2010. 2000, Washington, DC: U.S. Government Printing Office, With Understanding and Improving Health and Objectives for Improving Health. 2 vols. edn, 2 U.S. Department of Health and Human Services: Healthy People 2010. 2000, Washington, DC: U.S. Government Printing Office, With Understanding and Improving Health and Objectives for Improving Health. 2 vols. edn, 2
9.
go back to reference IOM (Institute of Medicine): Initial National Priorities for Comparative Effectiveness Research. 2009, Washington, DC:: The National Academies Press IOM (Institute of Medicine): Initial National Priorities for Comparative Effectiveness Research. 2009, Washington, DC:: The National Academies Press
10.
go back to reference Edwards BK, Ward E, Kohler BA, Eheman C, Zauber AG, Anderson RN, Jemal A, Schymura MJ, Lansdorp-Vogelaar I, Seeff LC: Annual report to the nation on the status of cancer, 1975-2006, featuring colorectal cancer trends and impact of interventions (risk factors, screening, and treatment) to reduce future rates. Cancer. 2009, 116 (3): 544-573.CrossRef Edwards BK, Ward E, Kohler BA, Eheman C, Zauber AG, Anderson RN, Jemal A, Schymura MJ, Lansdorp-Vogelaar I, Seeff LC: Annual report to the nation on the status of cancer, 1975-2006, featuring colorectal cancer trends and impact of interventions (risk factors, screening, and treatment) to reduce future rates. Cancer. 2009, 116 (3): 544-573.CrossRef
11.
go back to reference Knudsen AB: Explaining secular trends in colorectal cancer incidence and mortality with an empirically-calibrated microsimulation model. 2005, Cambridge, MA: Harvard University Knudsen AB: Explaining secular trends in colorectal cancer incidence and mortality with an empirically-calibrated microsimulation model. 2005, Cambridge, MA: Harvard University
12.
go back to reference Simon MS, Thomson CA, Pettijohn E, Kato I, Rodabough RJ, Lane D, Hubbell FA, O'Sullivan MJ, Adams-Campbell L, Mouton CP: Racial Differences in Colorectal Cancer Incidence and Mortality in the Women's Health Initiative. Cancer Epidemiol Biomarkers Prev. 2011, 20 (7): 1368-1378. 10.1158/1055-9965.EPI-11-0027.CrossRefPubMedPubMedCentral Simon MS, Thomson CA, Pettijohn E, Kato I, Rodabough RJ, Lane D, Hubbell FA, O'Sullivan MJ, Adams-Campbell L, Mouton CP: Racial Differences in Colorectal Cancer Incidence and Mortality in the Women's Health Initiative. Cancer Epidemiol Biomarkers Prev. 2011, 20 (7): 1368-1378. 10.1158/1055-9965.EPI-11-0027.CrossRefPubMedPubMedCentral
13.
go back to reference Polite BN, Dignam JJ, Olopade OI: Colorectal cancer model of health disparities: understanding mortality differences in minority populations. J Clin Oncol. 2006, 24: 2179-2187. 10.1200/JCO.2005.05.4775.CrossRefPubMed Polite BN, Dignam JJ, Olopade OI: Colorectal cancer model of health disparities: understanding mortality differences in minority populations. J Clin Oncol. 2006, 24: 2179-2187. 10.1200/JCO.2005.05.4775.CrossRefPubMed
15.
go back to reference Cheng X, Chen VW, Steele B, Ruiz B, Fulton J, Liu L, Carozza SE, Greenlee R: Subsite-specific incidence rate and stage of disease in colorectal cancer by race, gender, and age group in the United States, 1992-1997. Cancer. 2001, 92 (10): 2547-2554. 10.1002/1097-0142(20011115)92:10<2547::AID-CNCR1606>3.0.CO;2-K.CrossRefPubMed Cheng X, Chen VW, Steele B, Ruiz B, Fulton J, Liu L, Carozza SE, Greenlee R: Subsite-specific incidence rate and stage of disease in colorectal cancer by race, gender, and age group in the United States, 1992-1997. Cancer. 2001, 92 (10): 2547-2554. 10.1002/1097-0142(20011115)92:10<2547::AID-CNCR1606>3.0.CO;2-K.CrossRefPubMed
16.
go back to reference Doubeni CA, Field TS, Buist DS, Korner EJ, Bigelow C, Lamerato L, Herrinton L, Quinn VP, Hart G, Hornbrook MC: Racial differences in tumor stage and survival for colorectal cancer in an insured population. Cancer. 2007, 109 (3): 612-620. 10.1002/cncr.22437.CrossRefPubMed Doubeni CA, Field TS, Buist DS, Korner EJ, Bigelow C, Lamerato L, Herrinton L, Quinn VP, Hart G, Hornbrook MC: Racial differences in tumor stage and survival for colorectal cancer in an insured population. Cancer. 2007, 109 (3): 612-620. 10.1002/cncr.22437.CrossRefPubMed
17.
go back to reference Jessup JM, McGinnis LS, Steele GD, Menck HR, Winchester DP: The National Cancer Data Base. Report on colon cancer. Cancer. 1996, 78 (4): 918-926. 10.1002/(SICI)1097-0142(19960815)78:4<918::AID-CNCR32>3.0.CO;2-W.CrossRefPubMed Jessup JM, McGinnis LS, Steele GD, Menck HR, Winchester DP: The National Cancer Data Base. Report on colon cancer. Cancer. 1996, 78 (4): 918-926. 10.1002/(SICI)1097-0142(19960815)78:4<918::AID-CNCR32>3.0.CO;2-W.CrossRefPubMed
18.
go back to reference Penn E, Garrow D, Romagnuolo J: Influence of race and sex on prevalence and recurrence of colon polyps. Arch Intern Med. 2010, 170 (13): 1127-1132. 10.1001/archinternmed.2010.152.CrossRefPubMed Penn E, Garrow D, Romagnuolo J: Influence of race and sex on prevalence and recurrence of colon polyps. Arch Intern Med. 2010, 170 (13): 1127-1132. 10.1001/archinternmed.2010.152.CrossRefPubMed
19.
go back to reference Francois F, Park J, Bini EJ: Colon pathology detected after a positive screening flexible sigmoidoscopy: a prospective study in an ethnically diverse cohort. Am J Gastroenterol. 2006, 101 (4): 823-830. 10.1111/j.1572-0241.2006.00433.x.CrossRefPubMed Francois F, Park J, Bini EJ: Colon pathology detected after a positive screening flexible sigmoidoscopy: a prospective study in an ethnically diverse cohort. Am J Gastroenterol. 2006, 101 (4): 823-830. 10.1111/j.1572-0241.2006.00433.x.CrossRefPubMed
20.
go back to reference Lieberman DA, Holub JL, Moravec MD, Eisen GM, Peters D, Morris CD: Prevalence of colon polyps detected by colonoscopy screening in asymptomatic black and white patients. JAMA. 2008, 300 (12): 1417-1422. 10.1001/jama.300.12.1417.CrossRefPubMed Lieberman DA, Holub JL, Moravec MD, Eisen GM, Peters D, Morris CD: Prevalence of colon polyps detected by colonoscopy screening in asymptomatic black and white patients. JAMA. 2008, 300 (12): 1417-1422. 10.1001/jama.300.12.1417.CrossRefPubMed
21.
go back to reference Rutter CM, Savarino JE: An evidence-based microsimulation model for colorectal cancer. Cancer Epidemiol Biomarkers Prev. 2010, 19 (August, 2010): 1992-2002.CrossRefPubMedPubMedCentral Rutter CM, Savarino JE: An evidence-based microsimulation model for colorectal cancer. Cancer Epidemiol Biomarkers Prev. 2010, 19 (August, 2010): 1992-2002.CrossRefPubMedPubMedCentral
22.
go back to reference Rutter CM, Miglioretti DL, Savarino JE: Bayesian calibration of microsimulation models. J Am Stat Assoc. 2009, 104 (488): 1338-1350. 10.1198/jasa.2009.ap07466.CrossRefPubMedPubMedCentral Rutter CM, Miglioretti DL, Savarino JE: Bayesian calibration of microsimulation models. J Am Stat Assoc. 2009, 104 (488): 1338-1350. 10.1198/jasa.2009.ap07466.CrossRefPubMedPubMedCentral
23.
go back to reference Chen TH, Yen MF, Lai MS, Koong SL, Wang CY, Wong JM, Prevost TC, Duffy SW: Evaluation of a selective screening for colorectal carcinoma: the Taiwan Multicenter Cancer Screening (TAMCAS) project. Cancer. 1999, 86 (7): 1116-1128. 10.1002/(SICI)1097-0142(19991001)86:7<1116::AID-CNCR4>3.0.CO;2-D.CrossRefPubMed Chen TH, Yen MF, Lai MS, Koong SL, Wang CY, Wong JM, Prevost TC, Duffy SW: Evaluation of a selective screening for colorectal carcinoma: the Taiwan Multicenter Cancer Screening (TAMCAS) project. Cancer. 1999, 86 (7): 1116-1128. 10.1002/(SICI)1097-0142(19991001)86:7<1116::AID-CNCR4>3.0.CO;2-D.CrossRefPubMed
24.
go back to reference Launoy G, Smith TC, Duffy SW, Bouvier V: Colorectal cancer mass-screening: estimation of faecal occult blood test sensitivity, taking into account cancer mean sojourn time. Int J Cancer. 1997, 73 (2): 220-224. 10.1002/(SICI)1097-0215(19971009)73:2<220::AID-IJC10>3.0.CO;2-J.CrossRefPubMed Launoy G, Smith TC, Duffy SW, Bouvier V: Colorectal cancer mass-screening: estimation of faecal occult blood test sensitivity, taking into account cancer mean sojourn time. Int J Cancer. 1997, 73 (2): 220-224. 10.1002/(SICI)1097-0215(19971009)73:2<220::AID-IJC10>3.0.CO;2-J.CrossRefPubMed
25.
go back to reference Prevost TC, Launoy G, Duffy SW, Chen HH: Estimating sensitivity and sojourn time in screening for colorectal cancer: a comparison of statistical approaches. Am J Epidemiol. 1998, 148 (6): 609-619.CrossRefPubMed Prevost TC, Launoy G, Duffy SW, Chen HH: Estimating sensitivity and sojourn time in screening for colorectal cancer: a comparison of statistical approaches. Am J Epidemiol. 1998, 148 (6): 609-619.CrossRefPubMed
27.
go back to reference Hixson LJ, Fennerty MB, Sampliner RE, McGee D, Garewal H: Prospective study of the frequency and size distribution of polyps missed by colonoscopy. J Natl Cancer Inst. 1990, 82 (22): 1769-1772. 10.1093/jnci/82.22.1769.CrossRefPubMed Hixson LJ, Fennerty MB, Sampliner RE, McGee D, Garewal H: Prospective study of the frequency and size distribution of polyps missed by colonoscopy. J Natl Cancer Inst. 1990, 82 (22): 1769-1772. 10.1093/jnci/82.22.1769.CrossRefPubMed
28.
go back to reference Rex DK, Cutler CS, Lemmel GT, Rahmani EY, Clark DW, Helper DJ, Lehman GA, Mark DG: Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology. 1997, 112 (1): 24-28. 10.1016/S0016-5085(97)70214-2.CrossRefPubMed Rex DK, Cutler CS, Lemmel GT, Rahmani EY, Clark DW, Helper DJ, Lehman GA, Mark DG: Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology. 1997, 112 (1): 24-28. 10.1016/S0016-5085(97)70214-2.CrossRefPubMed
29.
go back to reference van Rijn JC, Reitsma JB, Stoker J, Bossuyt PM, van Deventer SJ, Dekker E: Polyp miss rate determined by tandem colonoscopy: a systematic review. Am J Gastroenterol. 2006, 101 (2): 343-350. 10.1111/j.1572-0241.2006.00390.x.CrossRefPubMed van Rijn JC, Reitsma JB, Stoker J, Bossuyt PM, van Deventer SJ, Dekker E: Polyp miss rate determined by tandem colonoscopy: a systematic review. Am J Gastroenterol. 2006, 101 (2): 343-350. 10.1111/j.1572-0241.2006.00390.x.CrossRefPubMed
30.
go back to reference Wilkins T, LeClaire B, Smolkin M, Davies K, Thomas A, Taylor ML, Stayer S: Screening colonoscopies by primary care physicians: A meta-analysis. Ann Fam Med. 2009, 7: 56-62. 10.1370/afm.939.CrossRefPubMedPubMedCentral Wilkins T, LeClaire B, Smolkin M, Davies K, Thomas A, Taylor ML, Stayer S: Screening colonoscopies by primary care physicians: A meta-analysis. Ann Fam Med. 2009, 7: 56-62. 10.1370/afm.939.CrossRefPubMedPubMedCentral
31.
go back to reference Berger JO: Statistical decision theory and Bayesian analysis. 1985, New York: Springer-Verlag, 2CrossRef Berger JO: Statistical decision theory and Bayesian analysis. 1985, New York: Springer-Verlag, 2CrossRef
32.
go back to reference Simpson EH: The Interpretation of Interaction in Contingency Tables. Journal of the Royal Statistical Society Series B - Methodological. 1951, 13 (2): 238-241. Simpson EH: The Interpretation of Interaction in Contingency Tables. Journal of the Royal Statistical Society Series B - Methodological. 1951, 13 (2): 238-241.
33.
go back to reference Greenland S, Robins JM, Pearl J: Confounding and Collapsibility in Causal Inference. Stat Sci. 1999, 14 (1): 29-46. 10.1214/ss/1009211805.CrossRef Greenland S, Robins JM, Pearl J: Confounding and Collapsibility in Causal Inference. Stat Sci. 1999, 14 (1): 29-46. 10.1214/ss/1009211805.CrossRef
34.
go back to reference Doubeni CA, Laiyemo AO, Reed G, Field TS, Fletcher RH: Socioeconomic and racial patterns of colorectal cancer screening among Medicare enrollees in 2000 to 2005. Cancer Epidemiol Biomarkers Prev. 2009, 18 (8): 2170-2175. 10.1158/1055-9965.EPI-09-0104.CrossRefPubMedPubMedCentral Doubeni CA, Laiyemo AO, Reed G, Field TS, Fletcher RH: Socioeconomic and racial patterns of colorectal cancer screening among Medicare enrollees in 2000 to 2005. Cancer Epidemiol Biomarkers Prev. 2009, 18 (8): 2170-2175. 10.1158/1055-9965.EPI-09-0104.CrossRefPubMedPubMedCentral
35.
go back to reference Jerant AF, Fenton JJ, Franks P: Determinants of racial/ethnic colorectal cancer screening disparities. Arch Intern Med. 2008, 168 (12): 1317-1324. 10.1001/archinte.168.12.1317.CrossRefPubMed Jerant AF, Fenton JJ, Franks P: Determinants of racial/ethnic colorectal cancer screening disparities. Arch Intern Med. 2008, 168 (12): 1317-1324. 10.1001/archinte.168.12.1317.CrossRefPubMed
36.
go back to reference Soneji S, Iyer SS, Armstrong K, Asch DA: Racial disparities in stage-specific colorectal cancer mortality: 1960-2005. Am J Public Health. 2010, 100 (10): 1912-1916. 10.2105/AJPH.2009.184192.CrossRefPubMedPubMedCentral Soneji S, Iyer SS, Armstrong K, Asch DA: Racial disparities in stage-specific colorectal cancer mortality: 1960-2005. Am J Public Health. 2010, 100 (10): 1912-1916. 10.2105/AJPH.2009.184192.CrossRefPubMedPubMedCentral
Metadata
Title
Evaluating risk factor assumptions: a simulation-based approach
Authors
Carolyn M Rutter
Diana L Miglioretti
James E Savarino
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-55

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue