Skip to main content
Top
Published in: BMC Cancer 1/2013

Open Access 01-12-2013 | Research article

An assessment of existing models for individualized breast cancer risk estimation in a screening program in Spain

Authors: Arantzazu Arrospide, Carles Forné, Montse Rué, Núria Torà, Javier Mar, Marisa Baré

Published in: BMC Cancer | Issue 1/2013

Login to get access

Abstract

Background

The aim of this study was to evaluate the calibration and discriminatory power of three predictive models of breast cancer risk.

Methods

We included 13,760 women who were first-time participants in the Sabadell-Cerdanyola Breast Cancer Screening Program, in Catalonia, Spain. Projections of risk were obtained at three and five years for invasive cancer using the Gail, Chen and Barlow models. Incidence and mortality data were obtained from the Catalan registries. The calibration and discrimination of the models were assessed using the Hosmer-Lemeshow C statistic, the area under the receiver operating characteristic curve (AUC) and the Harrell’s C statistic.

Results

The Gail and Chen models showed good calibration while the Barlow model overestimated the number of cases: the ratio between estimated and observed values at 5 years ranged from 0.86 to 1.55 for the first two models and from 1.82 to 3.44 for the Barlow model. The 5-year projection for the Chen and Barlow models had the highest discrimination, with an AUC around 0.58. The Harrell’s C statistic showed very similar values in the 5-year projection for each of the models. Although they passed the calibration test, the Gail and Chen models overestimated the number of cases in some breast density categories.

Conclusions

These models cannot be used as a measure of individual risk in early detection programs to customize screening strategies. The inclusion of longitudinal measures of breast density or other risk factors in joint models of survival and longitudinal data may be a step towards personalized early detection of BC.
Appendix
Available only for authorised users
Literature
2.
go back to reference Cronin KA, Feuer EJ, Clarke LD, Plevritis SK: Impact of adjuvant therapy and mammography on U.S. mortality from, to 2000: comparison of mortality results from the CISNET breast cancer base case analysis. J Natl Cancer Inst Monogr. 1975, 2006 (36): 112-121.CrossRef Cronin KA, Feuer EJ, Clarke LD, Plevritis SK: Impact of adjuvant therapy and mammography on U.S. mortality from, to 2000: comparison of mortality results from the CISNET breast cancer base case analysis. J Natl Cancer Inst Monogr. 1975, 2006 (36): 112-121.CrossRef
3.
go back to reference Vilaprinyo E, Puig T, Rue M: Contribution of early detection and adjuvant treatments to breast cancer mortality reduction in Catalonia, Spain. PLoS One. 2012, 7 (1): e30157-10.1371/journal.pone.0030157.CrossRefPubMedPubMedCentral Vilaprinyo E, Puig T, Rue M: Contribution of early detection and adjuvant treatments to breast cancer mortality reduction in Catalonia, Spain. PLoS One. 2012, 7 (1): e30157-10.1371/journal.pone.0030157.CrossRefPubMedPubMedCentral
4.
go back to reference El-Bastawissi AY, White E, Mandelson MT, Taplin SH: Reproductive and hormonal factors associated with mammographic breast density by age (United States). Cancer Causes Control. 2000, 11 (10): 955-963. 10.1023/A:1026514032085.CrossRefPubMed El-Bastawissi AY, White E, Mandelson MT, Taplin SH: Reproductive and hormonal factors associated with mammographic breast density by age (United States). Cancer Causes Control. 2000, 11 (10): 955-963. 10.1023/A:1026514032085.CrossRefPubMed
5.
go back to reference Titus-Ernstoff L, Tosteson AN, Kasales C, Weiss J, Goodrich M, Hatch EE, et al: Breast cancer risk factors in relation to breast density (United States). Cancer Causes Control. 2006, 17 (10): 1281-1290. 10.1007/s10552-006-0071-1.CrossRefPubMedPubMedCentral Titus-Ernstoff L, Tosteson AN, Kasales C, Weiss J, Goodrich M, Hatch EE, et al: Breast cancer risk factors in relation to breast density (United States). Cancer Causes Control. 2006, 17 (10): 1281-1290. 10.1007/s10552-006-0071-1.CrossRefPubMedPubMedCentral
6.
go back to reference Feuer EJ: Modeling the Impact of Adjuvant Therapy and Screening Mammography on U.S. Breast Cancer Mortality Between 1975 and 2000: Introduction to the Problem. J Natl Cancer Inst Monogr. 2000, 2006 (36): 2-6.CrossRef Feuer EJ: Modeling the Impact of Adjuvant Therapy and Screening Mammography on U.S. Breast Cancer Mortality Between 1975 and 2000: Introduction to the Problem. J Natl Cancer Inst Monogr. 2000, 2006 (36): 2-6.CrossRef
7.
go back to reference Fryback DG, Stout NK, Rosenberg MA, Trentham-Dietz A, Kuruchittham V, Remington PL: The Wisconsin breast cancer epidemiology simulation model. J Natl Cancer Inst Monogr. 2006, 36: 37-47.CrossRefPubMed Fryback DG, Stout NK, Rosenberg MA, Trentham-Dietz A, Kuruchittham V, Remington PL: The Wisconsin breast cancer epidemiology simulation model. J Natl Cancer Inst Monogr. 2006, 36: 37-47.CrossRefPubMed
8.
go back to reference Lee SJ, Zelen M: A stochastic model for predicting the mortality of breast cancer. J Natl Cancer Inst Monogr. 2006, 36: 79-86.CrossRefPubMed Lee SJ, Zelen M: A stochastic model for predicting the mortality of breast cancer. J Natl Cancer Inst Monogr. 2006, 36: 79-86.CrossRefPubMed
9.
go back to reference Schousboe JT, Kerlikowske K, Loh AJ, Cummings SR: Personalizing mammography by breast density and other risk factors for breast cancer: analysis of health benefits and cost-effectiveness. Ann Intern Med. 2011, 155: 10-20. 10.7326/0003-4819-155-1-201107050-00003.CrossRefPubMedPubMedCentral Schousboe JT, Kerlikowske K, Loh AJ, Cummings SR: Personalizing mammography by breast density and other risk factors for breast cancer: analysis of health benefits and cost-effectiveness. Ann Intern Med. 2011, 155: 10-20. 10.7326/0003-4819-155-1-201107050-00003.CrossRefPubMedPubMedCentral
10.
go back to reference Gail MH, Brinton LA, Byar DP, Corle DK, Green SB, Schairer C, et al: Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989, 81 (24): 1879-1886. 10.1093/jnci/81.24.1879.CrossRefPubMed Gail MH, Brinton LA, Byar DP, Corle DK, Green SB, Schairer C, et al: Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989, 81 (24): 1879-1886. 10.1093/jnci/81.24.1879.CrossRefPubMed
11.
go back to reference Chen J, Pee D, Ayyagari R, Graubard B, Schairer C, Byrne C, et al: Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density. J Natl Cancer Inst. 2006, 98 (17): 1215-1226. 10.1093/jnci/djj332.CrossRefPubMed Chen J, Pee D, Ayyagari R, Graubard B, Schairer C, Byrne C, et al: Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density. J Natl Cancer Inst. 2006, 98 (17): 1215-1226. 10.1093/jnci/djj332.CrossRefPubMed
12.
go back to reference Barlow WE, White E, Ballard-Barbash R, Vacek PM, Titus-Ernstoff L, Carney PA, et al: Prospective breast cancer risk prediction model for women undergoing screening mammography. J Natl Cancer Inst. 2006, 98 (17): 1204-1214. 10.1093/jnci/djj331.CrossRefPubMed Barlow WE, White E, Ballard-Barbash R, Vacek PM, Titus-Ernstoff L, Carney PA, et al: Prospective breast cancer risk prediction model for women undergoing screening mammography. J Natl Cancer Inst. 2006, 98 (17): 1204-1214. 10.1093/jnci/djj331.CrossRefPubMed
13.
go back to reference Parmigiani G, Berry DA, Aguilar O: Determining carrier probabilities for breast cancer-susceptibility genes BRCA1 and BRCA2. Am J Hum Genet. 1998, 62 (1): 145-158. 10.1086/301670.CrossRefPubMedPubMedCentral Parmigiani G, Berry DA, Aguilar O: Determining carrier probabilities for breast cancer-susceptibility genes BRCA1 and BRCA2. Am J Hum Genet. 1998, 62 (1): 145-158. 10.1086/301670.CrossRefPubMedPubMedCentral
14.
go back to reference Tyrer J, Duffy SW, Cuzick J: A breast cancer prediction model incorporating familial and personal risk factors. Stat Med. 2004, 23 (7): 1111-1130. 10.1002/sim.1668.CrossRefPubMed Tyrer J, Duffy SW, Cuzick J: A breast cancer prediction model incorporating familial and personal risk factors. Stat Med. 2004, 23 (7): 1111-1130. 10.1002/sim.1668.CrossRefPubMed
15.
go back to reference Baré M, Montes J, Florensa R, Sentís M, Donoso L: Factors related to non-participation in a population-based breast cancer screening programme. Eur J Cancer Prev. 2003, 12 (6): 487-494. 10.1097/00008469-200312000-00007.CrossRefPubMed Baré M, Montes J, Florensa R, Sentís M, Donoso L: Factors related to non-participation in a population-based breast cancer screening programme. Eur J Cancer Prev. 2003, 12 (6): 487-494. 10.1097/00008469-200312000-00007.CrossRefPubMed
16.
go back to reference Baré M, Bonfill X, Andreu X: Relationship between the method of detection and prognostic factors for breast cancer in a community with a screening programme. J Med Screen. 2006, 13 (4): 183-191.PubMed Baré M, Bonfill X, Andreu X: Relationship between the method of detection and prognostic factors for breast cancer in a community with a screening programme. J Med Screen. 2006, 13 (4): 183-191.PubMed
17.
go back to reference American College of Radiology: The American College of Radiology Breast Imaging Reporting and Data System (BI-RADS). 2003, Reston (VA): American College of Radiology, 3 American College of Radiology: The American College of Radiology Breast Imaging Reporting and Data System (BI-RADS). 2003, Reston (VA): American College of Radiology, 3
18.
go back to reference Costantino JP, Gail MH, Pee D, Anderson S, Redmond CK, Benichou J, et al: Validation studies for models projecting the risk of invasive and total breast cancer incidence. J Natl Cancer Inst. 1999, 91 (18): 1541-1548. 10.1093/jnci/91.18.1541.CrossRefPubMed Costantino JP, Gail MH, Pee D, Anderson S, Redmond CK, Benichou J, et al: Validation studies for models projecting the risk of invasive and total breast cancer incidence. J Natl Cancer Inst. 1999, 91 (18): 1541-1548. 10.1093/jnci/91.18.1541.CrossRefPubMed
19.
go back to reference Anderson SJ, Ahnn S, Duff K: NSABP Biostatistical Center Technical Report. 1992, Pittsburgh (PA): Department of Biostatistics, University of Pittsburgh Anderson SJ, Ahnn S, Duff K: NSABP Biostatistical Center Technical Report. 1992, Pittsburgh (PA): Department of Biostatistics, University of Pittsburgh
20.
go back to reference Vilaprinyo E, Gispert R, Martínez-Alonso M, Carles M, Pla R, Espinas JA, et al: Competing risks to breast cancer mortality in Catalonia. BMC Cancer. 2008, 8: 331-10.1186/1471-2407-8-331.CrossRefPubMedPubMedCentral Vilaprinyo E, Gispert R, Martínez-Alonso M, Carles M, Pla R, Espinas JA, et al: Competing risks to breast cancer mortality in Catalonia. BMC Cancer. 2008, 8: 331-10.1186/1471-2407-8-331.CrossRefPubMedPubMedCentral
21.
go back to reference Wolfram Research, Inc.: Mathematica version 7. 2008, USA: Wolfram Research Wolfram Research, Inc.: Mathematica version 7. 2008, USA: Wolfram Research
22.
23.
go back to reference Harrell F, Califf R, Pryor D, Lee K, Rosati R: Evaluating the yield of medical tests. JAMA. 1982, 247 (18): 2543-2546. 10.1001/jama.1982.03320430047030.CrossRefPubMed Harrell F, Califf R, Pryor D, Lee K, Rosati R: Evaluating the yield of medical tests. JAMA. 1982, 247 (18): 2543-2546. 10.1001/jama.1982.03320430047030.CrossRefPubMed
24.
go back to reference Harrell F, Lee K, Mark D: Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.CrossRefPubMed Harrell F, Lee K, Mark D: Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.CrossRefPubMed
25.
go back to reference StataCorp: Stata Statistical Software: Release 11. 2009, College Station, TX: StataCorp LP StataCorp: Stata Statistical Software: Release 11. 2009, College Station, TX: StataCorp LP
26.
go back to reference Decarli A, Calza S, Masala G, Specchia C, Palli D, Gail MH: Gail model for prediction of absolute risk of invasive breast cancer: independent evaluation in the Florence-European Prospective Investigation Into Cancer and Nutrition cohort. J Natl Cancer Inst. 2006, 98 (23): 1686-1693. 10.1093/jnci/djj463.CrossRefPubMed Decarli A, Calza S, Masala G, Specchia C, Palli D, Gail MH: Gail model for prediction of absolute risk of invasive breast cancer: independent evaluation in the Florence-European Prospective Investigation Into Cancer and Nutrition cohort. J Natl Cancer Inst. 2006, 98 (23): 1686-1693. 10.1093/jnci/djj463.CrossRefPubMed
27.
go back to reference Pastor-Barriuso R, Ascunce N, Ederra M, Erdozáin N, Murillo A, Alés-Martínez JE, et al: Recalibration of the Gail model for predicting invasive breast cancer risk in Spanish women: a population-based cohort study. Breast Cancer Res Treat. 2013, 138 (1): 249-259. 10.1007/s10549-013-2428-y.CrossRefPubMedPubMedCentral Pastor-Barriuso R, Ascunce N, Ederra M, Erdozáin N, Murillo A, Alés-Martínez JE, et al: Recalibration of the Gail model for predicting invasive breast cancer risk in Spanish women: a population-based cohort study. Breast Cancer Res Treat. 2013, 138 (1): 249-259. 10.1007/s10549-013-2428-y.CrossRefPubMedPubMedCentral
28.
go back to reference Banegas MP, Gail MH, LaCroix A, Thompson B, Martinez ME, Wactawski-Wende J, et al: Evaluating breast cancer risk projections for Hispanic women. Breast Cancer Res Treat. 2012, 132 (1): 347-353. 10.1007/s10549-011-1900-9.CrossRefPubMed Banegas MP, Gail MH, LaCroix A, Thompson B, Martinez ME, Wactawski-Wende J, et al: Evaluating breast cancer risk projections for Hispanic women. Breast Cancer Res Treat. 2012, 132 (1): 347-353. 10.1007/s10549-011-1900-9.CrossRefPubMed
29.
go back to reference Tice JA, Cummings SR, Smith-Bindman R, Ichikawa L, Barlow WE, Kerlikowske K: Using clinical factors and mammographic breast density to estimate breast cancer risk: development and validation of a new predictive model. Ann Intern Med. 2008, 148 (5): 337-347. 10.7326/0003-4819-148-5-200803040-00004.CrossRefPubMedPubMedCentral Tice JA, Cummings SR, Smith-Bindman R, Ichikawa L, Barlow WE, Kerlikowske K: Using clinical factors and mammographic breast density to estimate breast cancer risk: development and validation of a new predictive model. Ann Intern Med. 2008, 148 (5): 337-347. 10.7326/0003-4819-148-5-200803040-00004.CrossRefPubMedPubMedCentral
30.
go back to reference Darabi H, Czene K, Zhao W, Liu J, Hall P, Humphreys K: Breast cancer risk prediction and individualised screening based on common genetic variation and breast density measurement. Breast Cancer Res. 2012, 14 (1): R25-10.1186/bcr3110.CrossRefPubMedPubMedCentral Darabi H, Czene K, Zhao W, Liu J, Hall P, Humphreys K: Breast cancer risk prediction and individualised screening based on common genetic variation and breast density measurement. Breast Cancer Res. 2012, 14 (1): R25-10.1186/bcr3110.CrossRefPubMedPubMedCentral
31.
go back to reference Pastor Climente I, Morales Suarez-Varela M, Llopis González A, Magraner Gil JF: Application of the Gail method of calculating risk in the population of Valencia. Clin Transl Oncol. 2005, 7 (8): 336-343. 10.1007/BF02716549.CrossRefPubMed Pastor Climente I, Morales Suarez-Varela M, Llopis González A, Magraner Gil JF: Application of the Gail method of calculating risk in the population of Valencia. Clin Transl Oncol. 2005, 7 (8): 336-343. 10.1007/BF02716549.CrossRefPubMed
33.
go back to reference Buron A, Vernet M, Roman M, Checa MA, Pérez JM, Sala M, et al: Can the Gail model increase the predictive value of a positive mammogram in a European population screening setting? Results from a Spanish cohort. Breast Cancer Res. 2013, 22 (1): 83-88. Buron A, Vernet M, Roman M, Checa MA, Pérez JM, Sala M, et al: Can the Gail model increase the predictive value of a positive mammogram in a European population screening setting? Results from a Spanish cohort. Breast Cancer Res. 2013, 22 (1): 83-88.
34.
go back to reference Boyd NF, Martin LJ, Yaffe MJ, Minkin S: Mammographic density and breast cancer risk: current understanding and future prospects. Breast Cancer Res. 2011, 13 (6): 223-10.1186/bcr2942.CrossRefPubMedPubMedCentral Boyd NF, Martin LJ, Yaffe MJ, Minkin S: Mammographic density and breast cancer risk: current understanding and future prospects. Breast Cancer Res. 2011, 13 (6): 223-10.1186/bcr2942.CrossRefPubMedPubMedCentral
35.
go back to reference Chiu SY-H, Duffy S, Yen AM-F, Tabár L, Smith RA, Chen H-H: Effect of baseline breast density on breast cancer incidence, stage, mortality, and screening parameters: 25-year follow-up of a Swedish mammographic screening. Cancer Epidemiol Biomarkers Prev. 2010, 19 (5): 1219-1228. 10.1158/1055-9965.EPI-09-1028.CrossRefPubMed Chiu SY-H, Duffy S, Yen AM-F, Tabár L, Smith RA, Chen H-H: Effect of baseline breast density on breast cancer incidence, stage, mortality, and screening parameters: 25-year follow-up of a Swedish mammographic screening. Cancer Epidemiol Biomarkers Prev. 2010, 19 (5): 1219-1228. 10.1158/1055-9965.EPI-09-1028.CrossRefPubMed
36.
go back to reference Garrido-Estepa M, Ruiz-Perales F, Miranda J, Ascunze N, González-Roman I, Sánchez-Contador C, et al: Evaluation of mammographic density patterns: reproducibility and concordance among scales. BMC Cancer. 2010, 10: 485-CrossRefPubMedPubMedCentral Garrido-Estepa M, Ruiz-Perales F, Miranda J, Ascunze N, González-Roman I, Sánchez-Contador C, et al: Evaluation of mammographic density patterns: reproducibility and concordance among scales. BMC Cancer. 2010, 10: 485-CrossRefPubMedPubMedCentral
37.
go back to reference Martin KE, Helvie MA, Zhou C, Roubidoux MA, Bailey JE, Paramagul C, et al: Mammographic density measured with quantitative computer-aided method: comparison with radiologists’ estimates and BI-RADS categories. Radiology. 2006, 240: 656-665. 10.1148/radiol.2402041947.CrossRefPubMed Martin KE, Helvie MA, Zhou C, Roubidoux MA, Bailey JE, Paramagul C, et al: Mammographic density measured with quantitative computer-aided method: comparison with radiologists’ estimates and BI-RADS categories. Radiology. 2006, 240: 656-665. 10.1148/radiol.2402041947.CrossRefPubMed
38.
go back to reference Kerlikowske K, Ichikawa L, Miglioretti DL, Buist DSM, Vacek PM, Smith-Bindman R, et al: Longitudinal measurement of clinical mammographic breast density to improve estimation of breast cancer risk. J Natl Cancer Inst. 2007, 99 (5): 386-395. 10.1093/jnci/djk066.CrossRefPubMed Kerlikowske K, Ichikawa L, Miglioretti DL, Buist DSM, Vacek PM, Smith-Bindman R, et al: Longitudinal measurement of clinical mammographic breast density to improve estimation of breast cancer risk. J Natl Cancer Inst. 2007, 99 (5): 386-395. 10.1093/jnci/djk066.CrossRefPubMed
39.
go back to reference Pérez Lacasta M, Gregori A, Carles M, Gispert R, Martinez-Alonso M, Vilaprinyo E, et al: The evolution of breast cancer mortality and the dissemination of mammography in Catalonia: an analysis by health region. Rev Esp Salud Publica. 2010, 84 (6): 691-703. 10.1590/S1135-57272010000600002.CrossRefPubMed Pérez Lacasta M, Gregori A, Carles M, Gispert R, Martinez-Alonso M, Vilaprinyo E, et al: The evolution of breast cancer mortality and the dissemination of mammography in Catalonia: an analysis by health region. Rev Esp Salud Publica. 2010, 84 (6): 691-703. 10.1590/S1135-57272010000600002.CrossRefPubMed
Metadata
Title
An assessment of existing models for individualized breast cancer risk estimation in a screening program in Spain
Authors
Arantzazu Arrospide
Carles Forné
Montse Rué
Núria Torà
Javier Mar
Marisa Baré
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2013
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/1471-2407-13-587

Other articles of this Issue 1/2013

BMC Cancer 1/2013 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine