Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

Validation of colorectal cancer surgery data from administrative data sources

Authors: Xue Li, Charlotte King, Christopher deGara, Jonathon White, Marcy Winget

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Surgery is the primary treatment for colorectal cancer for both curative and palliative intent. Availability of high quality surgery data is essential for assessing many aspects of the quality of colorectal cancer care. The objective of this study was to determine the quality of different administrative data sources in identifying surgery for colorectal cancer with respect to completeness and accuracy.

Methods

All residents in Alberta, Canada who were diagnosed with invasive colorectal cancer in years 2000-2005 were identified from the Alberta Cancer Registry and included in the study. Surgery data for these patients were obtained from the Cancer Registry (which collects the date of surgery for which the primary tumor was removed) and compared to surgery data obtained from two different administrative data sources: Physician Billing and Hospital Inpatient data. Sensitivity, specificity, positive predictive value, negative predictive value and observed agreement were calculated compared to the Cancer Registry data.

Results

The Physician Billing data alone or combined with Hospital Inpatient data demonstrated equally high sensitivity (97% for both) and observed agreement with the Cancer Registry data (93% for both) for identifying surgeries. The Hospital Inpatient data, however, had the highest specificity (80%). The positive predictive value varied by disease stage and across data sources for stage IV (99% for stages I-III and 83-89% for stage IV), the specificity is better for colon cancer surgeries (72-85%) than for rectal cancer surgeries (60-73%); validation measures did not vary over time.

Conclusion

Physician Billing data identify the colorectal cancer surgery more completely than Hospital Inpatient data although both sources have a high level of completeness.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mirza MS, Longman RJ, Farrokhyar F, Sheffield JP, Kennedy RH: Long-term outcomes for laparoscopic versus open resection of nonmetastatic colorectal cancer. J Laparoendosc Adv Surg Tech A. 2008, 18: 679-685. 10.1089/lap.2007.0169.CrossRefPubMed Mirza MS, Longman RJ, Farrokhyar F, Sheffield JP, Kennedy RH: Long-term outcomes for laparoscopic versus open resection of nonmetastatic colorectal cancer. J Laparoendosc Adv Surg Tech A. 2008, 18: 679-685. 10.1089/lap.2007.0169.CrossRefPubMed
2.
go back to reference Kahnamoui K, Cadeddu M, Farrokhyar F, Anvari M: Laparoscopic surgery for colon cancer: a systematic review. Can J Surg. 2007, 50: 48-57.PubMedPubMedCentral Kahnamoui K, Cadeddu M, Farrokhyar F, Anvari M: Laparoscopic surgery for colon cancer: a systematic review. Can J Surg. 2007, 50: 48-57.PubMedPubMedCentral
3.
go back to reference Nenshi R, Baxter N, Kennedy E, Schultz SE, Gunraj N, Wilton AS, Urbach DR, Simunovic M: Surgery for Colorectal Cancer. Cancer Surgery in Ontario: ICES Atlas. Edited by: Urbach DR, Simunovic M, Schultz SE. 2008, Toronto, ON: Institute for Clinical Evaluative Sciences Nenshi R, Baxter N, Kennedy E, Schultz SE, Gunraj N, Wilton AS, Urbach DR, Simunovic M: Surgery for Colorectal Cancer. Cancer Surgery in Ontario: ICES Atlas. Edited by: Urbach DR, Simunovic M, Schultz SE. 2008, Toronto, ON: Institute for Clinical Evaluative Sciences
4.
go back to reference Lavery IC, Lopez-Kostner F, Pelley RJ, Fine RM: Treatment of colon and rectal cancer. Surg Clin North Am. 2000, 80: 535-569. 10.1016/S0039-6109(05)70200-0. ixCrossRefPubMed Lavery IC, Lopez-Kostner F, Pelley RJ, Fine RM: Treatment of colon and rectal cancer. Surg Clin North Am. 2000, 80: 535-569. 10.1016/S0039-6109(05)70200-0. ixCrossRefPubMed
5.
go back to reference Turner D, Hildebrand KJ, Fradette K, Latosinsky S: Same question, different data source, different answers? Data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007, 3: 46-54.PubMedPubMedCentral Turner D, Hildebrand KJ, Fradette K, Latosinsky S: Same question, different data source, different answers? Data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007, 3: 46-54.PubMedPubMedCentral
6.
go back to reference Lipscomb J, Gillespie TW: State-level cancer quality assessment and research: building and sustaining the data infrastructure. Cancer J. 2011, 17: 246-256. 10.1097/PPO.0b013e3182296422.CrossRefPubMedPubMedCentral Lipscomb J, Gillespie TW: State-level cancer quality assessment and research: building and sustaining the data infrastructure. Cancer J. 2011, 17: 246-256. 10.1097/PPO.0b013e3182296422.CrossRefPubMedPubMedCentral
7.
go back to reference Beatty JD, Adachi M, Bonham C, Atwood M, Potts MS, Hafterson JL, Aye RW: Utilization of cancer registry data for monitoring quality of care. Am J Surg. 2011, 201: 645-649. 10.1016/j.amjsurg.2011.01.004.CrossRefPubMed Beatty JD, Adachi M, Bonham C, Atwood M, Potts MS, Hafterson JL, Aye RW: Utilization of cancer registry data for monitoring quality of care. Am J Surg. 2011, 201: 645-649. 10.1016/j.amjsurg.2011.01.004.CrossRefPubMed
8.
go back to reference Du X, Freeman JL, Warren JL, Nattinger AB, Zhang D, Goodwin JS: Accuracy and completeness of Medicare claims data for surgical treatment of breast cancer. Med Care. 2000, 38: 719-727. 10.1097/00005650-200007000-00004.CrossRefPubMed Du X, Freeman JL, Warren JL, Nattinger AB, Zhang D, Goodwin JS: Accuracy and completeness of Medicare claims data for surgical treatment of breast cancer. Med Care. 2000, 38: 719-727. 10.1097/00005650-200007000-00004.CrossRefPubMed
9.
go back to reference Meguerditchian AN, Stewart A, Roistacher J, Watroba N, Cropp M, Edge SB: Claims data linked to hospital registry data enhance evaluation of the quality of care of breast cancer. J Surg Oncol. 2010, 101: 593-599. 10.1002/jso.21528.CrossRefPubMed Meguerditchian AN, Stewart A, Roistacher J, Watroba N, Cropp M, Edge SB: Claims data linked to hospital registry data enhance evaluation of the quality of care of breast cancer. J Surg Oncol. 2010, 101: 593-599. 10.1002/jso.21528.CrossRefPubMed
10.
go back to reference Abraham NS, Cohen DC, Rivers B, Richardson P: Validation of administrative data used for the diagnosis of upper gastrointestinal events following nonsteroidal anti-inflammatory drug prescription. Aliment Pharmacol Ther. 2006, 24: 299-306. 10.1111/j.1365-2036.2006.02985.x.CrossRefPubMed Abraham NS, Cohen DC, Rivers B, Richardson P: Validation of administrative data used for the diagnosis of upper gastrointestinal events following nonsteroidal anti-inflammatory drug prescription. Aliment Pharmacol Ther. 2006, 24: 299-306. 10.1111/j.1365-2036.2006.02985.x.CrossRefPubMed
11.
go back to reference International Classification of Diseases for Oncology. Edited by: Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin DM, Whelan S. 2000, Geneva, Switzerland: World Health Organization International Classification of Diseases for Oncology. Edited by: Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin DM, Whelan S. 2000, Geneva, Switzerland: World Health Organization
12.
go back to reference Collaborative Staging Task Force of the American Joint Committee on Cancer: Collaborative Staging Manual and Coding Instructions, version 01.04.00. NIH Publication Number 04-5496. Incorporates updates through September 8, 2006. 2004, Jointly published by American Joint Committee on Cancer (Chicago, IL) and U.S. Department of Health and Human Services (Bethesda, MD), Chicago, IL Collaborative Staging Task Force of the American Joint Committee on Cancer: Collaborative Staging Manual and Coding Instructions, version 01.04.00. NIH Publication Number 04-5496. Incorporates updates through September 8, 2006. 2004, Jointly published by American Joint Committee on Cancer (Chicago, IL) and U.S. Department of Health and Human Services (Bethesda, MD), Chicago, IL
13.
go back to reference Tucker TC, Howe HL, Weir HK: Certification for population-based cancer registries. J Reg Mgmt. 1999, 26: 24-27. Tucker TC, Howe HL, Weir HK: Certification for population-based cancer registries. J Reg Mgmt. 1999, 26: 24-27.
14.
go back to reference Gwet K: Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. 2002, Volume 2nd Gwet K: Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. 2002, Volume 2nd
15.
go back to reference Viera AJ, Garrett JM: Understanding interobserver agreement: the kappa statistic. Fam Med. 2005, 37: 360-363.PubMed Viera AJ, Garrett JM: Understanding interobserver agreement: the kappa statistic. Fam Med. 2005, 37: 360-363.PubMed
16.
go back to reference Soeken KL, Prescott PA: Issues in the use of kappa to estimate reliability. Med Care. 1986, 24: 733-741. 10.1097/00005650-198608000-00008.CrossRefPubMed Soeken KL, Prescott PA: Issues in the use of kappa to estimate reliability. Med Care. 1986, 24: 733-741. 10.1097/00005650-198608000-00008.CrossRefPubMed
17.
go back to reference Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.CrossRefPubMed Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.CrossRefPubMed
18.
go back to reference Cicchetti DV, Feinstein AR: High agreement but low kappa: II resolving the paradoxes. J Clin Epidemiol. 1990, 43: 551-558. 10.1016/0895-4356(90)90159-M.CrossRefPubMed Cicchetti DV, Feinstein AR: High agreement but low kappa: II resolving the paradoxes. J Clin Epidemiol. 1990, 43: 551-558. 10.1016/0895-4356(90)90159-M.CrossRefPubMed
19.
go back to reference Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Med Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Med Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed
20.
go back to reference Kahn LH, Blustein J, Arons RR, Yee R, Shea S: The validity of hospital administrative data in monitoring variations in breast cancer surgery. Am J Public Health. 1996, 86: 243-245. 10.2105/AJPH.86.2.243.CrossRefPubMedPubMedCentral Kahn LH, Blustein J, Arons RR, Yee R, Shea S: The validity of hospital administrative data in monitoring variations in breast cancer surgery. Am J Public Health. 1996, 86: 243-245. 10.2105/AJPH.86.2.243.CrossRefPubMedPubMedCentral
21.
go back to reference Cooper GS, Virnig B, Klabunde CN, Schussler N, Freeman J, Warren JL: Use of SEER-Medicare data for measuring cancer surgery. Med Care. 2002, 40: IV-8-CrossRef Cooper GS, Virnig B, Klabunde CN, Schussler N, Freeman J, Warren JL: Use of SEER-Medicare data for measuring cancer surgery. Med Care. 2002, 40: IV-8-CrossRef
Metadata
Title
Validation of colorectal cancer surgery data from administrative data sources
Authors
Xue Li
Charlotte King
Christopher deGara
Jonathon White
Marcy Winget
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-97

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue