Skip to main content
Top
Published in: BMC Cancer 1/2019

Open Access 01-12-2019 | Breast Cancer | Research article

Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data

Authors: Yuan Xu, Shiying Kong, Winson Y. Cheung, Antoine Bouchard-Fortier, Joseph C. Dort, Hude Quan, Elizabeth M. Buie, Geoff McKinnon, May Lynn Quan

Published in: BMC Cancer | Issue 1/2019

Login to get access

Abstract

Background

Recurrence is not explicitly documented in cancer registry data that are widely used for research. Patterns of events after initial treatment such as oncology visits, re-operation, and receipt of subsequent chemotherapy or radiation may indicate recurrence. This study aimed to develop and validate algorithms for identifying breast cancer recurrence using routinely collected administrative data.

Methods

The study cohort included all young (≤ 40 years) breast cancer patients (2007–2010), and all patients receiving neoadjuvant chemotherapy (2012–2014) in Alberta, Canada. Health events (including mastectomy, chemotherapy, radiation, biopsy and specialist visits) were obtained from provincial administrative data. The algorithms were developed using classification and regression tree (CART) models and validated against primary chart review.

Results

Among 598 patients, 121 (20.2%) had recurrence after a median follow-up of 4 years. The high sensitivity algorithm achieved 94.2% (95% CI: 90.1–98.4%) sensitivity, 93.7% (91.5–95.9%) specificity, 79.2% (72.5–85.8%) positive predictive value (PPV), and 98.5% (97.3–99.6%) negative predictive value (NPV). The high PPV algorithm had 75.2% (67.5–82.9%) sensitivity, 98.3% (97.2–99.5%) specificity, 91.9% (86.6–97.3%) PPV, and 94% (91.9–96.1%) NPV. Combining high PPV and high sensitivity algorithms with additional (7.5%) chart review to resolve discordant cases resulted in 94.2% (90.1–98.4%) sensitivity, 98.3% (97.2–99.5%) specificity, 93.4% (89.1–97.8%) PPV, and 98.5% (97.4–99.6%) NPV.

Conclusion

The proposed algorithms based on routinely collected administrative data achieved favorably high validity for identifying breast cancer recurrences in a universal healthcare system in Canada.
Appendix
Available only for authorised users
Literature
1.
go back to reference Carrell DS, Halgrim S, Tran DT, et al. Using natural language processing to improve efficiency of manual chart abstraction in research: the case of breast cancer recurrence. Am J Epidemiol. 2014;179:749–58.CrossRef Carrell DS, Halgrim S, Tran DT, et al. Using natural language processing to improve efficiency of manual chart abstraction in research: the case of breast cancer recurrence. Am J Epidemiol. 2014;179:749–58.CrossRef
2.
go back to reference Warren JL, Yabroff KR. Challenges and opportunities in measuring cancer recurrence in the United States. J Natl Cancer Inst. 2015;107. Warren JL, Yabroff KR. Challenges and opportunities in measuring cancer recurrence in the United States. J Natl Cancer Inst. 2015;107.
3.
go back to reference Chubak J, Yu O, Pocobelli G, et al. Administrative data algorithms to identify second breast cancer events following early-stage invasive breast cancer. J Natl Cancer Inst. 2012;104:931–40.CrossRef Chubak J, Yu O, Pocobelli G, et al. Administrative data algorithms to identify second breast cancer events following early-stage invasive breast cancer. J Natl Cancer Inst. 2012;104:931–40.CrossRef
4.
go back to reference Hassett MJ, Uno H, Cronin AM, Carroll NM, Hornbrook MC, Ritzwoller D. Detecting lung and colorectal Cancer recurrence using structured clinical/administrative data to enable outcomes research and population health management. Med Care. 2017;55:e88–98.CrossRef Hassett MJ, Uno H, Cronin AM, Carroll NM, Hornbrook MC, Ritzwoller D. Detecting lung and colorectal Cancer recurrence using structured clinical/administrative data to enable outcomes research and population health management. Med Care. 2017;55:e88–98.CrossRef
5.
go back to reference Kroenke CH, Chubak J, Johnson L, Castillo A, Weltzien E, Caan BJ. Enhancing breast cancer recurrence algorithms through selective use of medical record data. J Natl Cancer Inst. 2016;108. Kroenke CH, Chubak J, Johnson L, Castillo A, Weltzien E, Caan BJ. Enhancing breast cancer recurrence algorithms through selective use of medical record data. J Natl Cancer Inst. 2016;108.
6.
go back to reference Aday LA, Andersen RM. The national profile of access to medical care: where do we stand? Am J Public Health. 1984;74:1331–9.CrossRef Aday LA, Andersen RM. The national profile of access to medical care: where do we stand? Am J Public Health. 1984;74:1331–9.CrossRef
7.
go back to reference Ayanian JZ, Kohler BA, Abe T, Epstein AM. The relation between health insurance coverage and clinical outcomes among women with breast cancer. N Engl J Med. 1993;329:326–31.CrossRef Ayanian JZ, Kohler BA, Abe T, Epstein AM. The relation between health insurance coverage and clinical outcomes among women with breast cancer. N Engl J Med. 1993;329:326–31.CrossRef
8.
go back to reference Hayward RA, Shapiro MF, Freeman HE, Corey CR. Who gets screened for cervical and breast cancer? Results from a new national survey. Arch Intern Med. 1988;148:1177–81.CrossRef Hayward RA, Shapiro MF, Freeman HE, Corey CR. Who gets screened for cervical and breast cancer? Results from a new national survey. Arch Intern Med. 1988;148:1177–81.CrossRef
9.
go back to reference Quan ML, Austin J, Lam N, Quinn R. Diagnostic delay in young women with breast cancer: a population-based analysis. J Clin Oncol. 2014;32:92.CrossRef Quan ML, Austin J, Lam N, Quinn R. Diagnostic delay in young women with breast cancer: a population-based analysis. J Clin Oncol. 2014;32:92.CrossRef
10.
go back to reference Graham PJ, Brar MS, Foster T, et al. Neoadjuvant chemotherapy for breast cancer, is practice changing? A population-based review of current surgical trends. Ann Surg Oncol. 2015;22:3376–82.CrossRef Graham PJ, Brar MS, Foster T, et al. Neoadjuvant chemotherapy for breast cancer, is practice changing? A population-based review of current surgical trends. Ann Surg Oncol. 2015;22:3376–82.CrossRef
11.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. CRC Press. 1984. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. CRC Press. 1984.
12.
go back to reference LeBlanc MaT R. Combining estimates in regression and classification. J Am Stat Assoc. 1996;91:1641–50. LeBlanc MaT R. Combining estimates in regression and classification. J Am Stat Assoc. 1996;91:1641–50.
13.
go back to reference Frayne SM, Miller DR, Sharkansky EJ, et al. Using administrative data to identify mental illness: what approach is best? Am J Med Qual. 2010;25:42–50.CrossRef Frayne SM, Miller DR, Sharkansky EJ, et al. Using administrative data to identify mental illness: what approach is best? Am J Med Qual. 2010;25:42–50.CrossRef
14.
go back to reference Borzecki AM, Wong AT, Hickey EC, Ash AS, Berlowitz DR. Identifying hypertension-related comorbidities from administrative data: what's the optimal approach? Am J Med Qual. 2004;19:201–6.CrossRef Borzecki AM, Wong AT, Hickey EC, Ash AS, Berlowitz DR. Identifying hypertension-related comorbidities from administrative data: what's the optimal approach? Am J Med Qual. 2004;19:201–6.CrossRef
15.
go back to reference Chubak J, Pocobelli G, Weiss NS. Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. 2012;65:343–9 e2.CrossRef Chubak J, Pocobelli G, Weiss NS. Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. 2012;65:343–9 e2.CrossRef
16.
go back to reference Winkelmayer WC, Schneeweiss S, Mogun H, Patrick AR, Avorn J, Solomon DH. Identification of individuals with CKD from Medicare claims data: a validation study. Am J Kidney Dis. 2005;46:225–32.CrossRef Winkelmayer WC, Schneeweiss S, Mogun H, Patrick AR, Avorn J, Solomon DH. Identification of individuals with CKD from Medicare claims data: a validation study. Am J Kidney Dis. 2005;46:225–32.CrossRef
17.
go back to reference Warren JL, Feuer E, Potosky AL, Riley GF, Lynch CF. Use of Medicare hospital and physician data to assess breast cancer incidence. Med Care. 1999;37:445–56.CrossRef Warren JL, Feuer E, Potosky AL, Riley GF, Lynch CF. Use of Medicare hospital and physician data to assess breast cancer incidence. Med Care. 1999;37:445–56.CrossRef
18.
go back to reference Earle CC, Nattinger AB, Potosky AL, et al. Identifying cancer relapse using SEER-Medicare data. Med Care. 2002;40:IV–75-81.CrossRef Earle CC, Nattinger AB, Potosky AL, et al. Identifying cancer relapse using SEER-Medicare data. Med Care. 2002;40:IV–75-81.CrossRef
19.
go back to reference Benchimol EIMD, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64:8.CrossRef Benchimol EIMD, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64:8.CrossRef
20.
go back to reference Early Breast Cancer Trialists' Collaborative G. Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005;365:1687–717.CrossRef Early Breast Cancer Trialists' Collaborative G. Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005;365:1687–717.CrossRef
21.
go back to reference Hudis CA, Barlow WE, Costantino JP, et al. Proposal for standardized definitions for efficacy end points in adjuvant breast cancer trials: the STEEP system. J Clin Oncol. 2007;25:2127–32.CrossRef Hudis CA, Barlow WE, Costantino JP, et al. Proposal for standardized definitions for efficacy end points in adjuvant breast cancer trials: the STEEP system. J Clin Oncol. 2007;25:2127–32.CrossRef
22.
go back to reference Ahern TP, Pedersen L, Tarp M, et al. Statin prescriptions and breast cancer recurrence risk: a Danish nationwide prospective cohort study. J Natl Cancer Inst. 2011;103:1461–8.CrossRef Ahern TP, Pedersen L, Tarp M, et al. Statin prescriptions and breast cancer recurrence risk: a Danish nationwide prospective cohort study. J Natl Cancer Inst. 2011;103:1461–8.CrossRef
Metadata
Title
Development and validation of case-finding algorithms for recurrence of breast cancer using routinely collected administrative data
Authors
Yuan Xu
Shiying Kong
Winson Y. Cheung
Antoine Bouchard-Fortier
Joseph C. Dort
Hude Quan
Elizabeth M. Buie
Geoff McKinnon
May Lynn Quan
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2019
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/s12885-019-5432-8

Other articles of this Issue 1/2019

BMC Cancer 1/2019 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine