Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Validation of administrative data sources for endoscopy utilization in colorectal cancer diagnosis

Authors: Xue Li, Robert Hilsden, Shakhawat Hossain, John Fleming, Marcy Winget

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

Validation of administrative data is important to assess potential sources of bias in outcome evaluation and to prevent dissemination of misleading or inaccurate information. The purpose of the study was to determine the completeness and accuracy of endoscopy data in several administrative data sources in the year prior to colorectal cancer diagnosis as part of a larger project focused on evaluating the quality of pre-diagnostic care.

Methods

Primary and secondary data sources for endoscopy were collected from the Alberta Cancer Registry, cancer medical charts and three different administrative data sources. 1672 randomly sampled patients diagnosed with invasive colorectal cancer in years 2000–2005 in Alberta, Canada were included. A retrospective validation study of administrative data for endoscopy in the year prior to colorectal cancer diagnosis was conducted. A gold standard dataset was created by combining all the datasets. Number and percent identified, agreement and percent unique to a given data source were calculated and compared across each dataset and to the gold standard with respect to identifying all patients who underwent endoscopy and all endoscopies received by those patients.

Results

The combined administrative data and physician billing data identified as high or higher percentage of patients who had one or more endoscopy (84% and 78%, respectively) and total endoscopy procedures (89% and 81%, respectively) than the chart review (78% for both).

Conclusions

Endoscopy data has a high level of completeness and accuracy in physician billing data alone. Combined with hospital in/outpatient data it is more complete than chart review alone.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Logan JR, Lieberman DA: The use of databases and registries to enhance colonoscopy quality. Gastrointest Endosc Clin N Am. 2010, 20: 717-34. 10.1016/j.giec.2010.07.007.CrossRefPubMed Logan JR, Lieberman DA: The use of databases and registries to enhance colonoscopy quality. Gastrointest Endosc Clin N Am. 2010, 20: 717-34. 10.1016/j.giec.2010.07.007.CrossRefPubMed
3.
go back to reference Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P: Assessing the accuracy of administrative data in health information systems. Medical Care. 2004, 42: 1066-72. 10.1097/00005650-200411000-00005.CrossRefPubMed Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P: Assessing the accuracy of administrative data in health information systems. Medical Care. 2004, 42: 1066-72. 10.1097/00005650-200411000-00005.CrossRefPubMed
4.
go back to reference Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Medical Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Medical Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed
5.
go back to reference Smalley W: Administrative data and measurement of colonoscopy quality: not ready for prime time?. Gastrointest Endosc. 2011, 73: 454-5. 10.1016/j.gie.2010.11.042.CrossRefPubMed Smalley W: Administrative data and measurement of colonoscopy quality: not ready for prime time?. Gastrointest Endosc. 2011, 73: 454-5. 10.1016/j.gie.2010.11.042.CrossRefPubMed
6.
go back to reference Tollefson MK, Gettman MT, Karnes RJ, Frank I: Administrative data sets are inaccurate for assessing functional outcomes after radical prostatectomy. J Urol. 2011, 185: 1686-90. 10.1016/j.juro.2010.12.039.CrossRefPubMed Tollefson MK, Gettman MT, Karnes RJ, Frank I: Administrative data sets are inaccurate for assessing functional outcomes after radical prostatectomy. J Urol. 2011, 185: 1686-90. 10.1016/j.juro.2010.12.039.CrossRefPubMed
7.
go back to reference Turner D, Hildebrand KJ, Fradette KSL: Same question, different data source, different answers? Data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007, 3: 46-54.PubMedPubMedCentral Turner D, Hildebrand KJ, Fradette KSL: Same question, different data source, different answers? Data source agreement for surgical procedures on women with breast cancer. Healthc Policy. 2007, 3: 46-54.PubMedPubMedCentral
8.
go back to reference Woodworth GF, Baird CJ, Garces-Ambrossi G, Tonascia J, Tamargo RJ: Inaccuracy of the administrative database: comparative analysis of two databases for the diagnosis and treatment of intracranial aneurysms. Neurosurgery. 2009, 65: 251-6. 10.1227/01.NEU.0000347003.35690.7A.CrossRefPubMed Woodworth GF, Baird CJ, Garces-Ambrossi G, Tonascia J, Tamargo RJ: Inaccuracy of the administrative database: comparative analysis of two databases for the diagnosis and treatment of intracranial aneurysms. Neurosurgery. 2009, 65: 251-6. 10.1227/01.NEU.0000347003.35690.7A.CrossRefPubMed
9.
10.
go back to reference Abraham NS, Gossey JT, Davila JA, Al-Oudat S, Kramer JK: Receipt of recommended therapy by patients with advanced colorectal cancer. Am J Gastroenterol. 2006, 101: 1320-8. 10.1111/j.1572-0241.2006.00545.x.CrossRefPubMed Abraham NS, Gossey JT, Davila JA, Al-Oudat S, Kramer JK: Receipt of recommended therapy by patients with advanced colorectal cancer. Am J Gastroenterol. 2006, 101: 1320-8. 10.1111/j.1572-0241.2006.00545.x.CrossRefPubMed
11.
go back to reference Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA: Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011, 28: 424-7.CrossRefPubMed Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA: Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011, 28: 424-7.CrossRefPubMed
12.
go back to reference Andrade SE, Gurwitz JH, Chan KA, Donahue JG, Beck A, Boles M, Buist DS, Goodman M, LaCroix AZ, Levin TR, Platt R: Validation of diagnoses of peptic ulcers and bleeding from administrative databases: a multi-health maintenance organization study. J Clin Epidemiol. 2002, 55: 310-3. 10.1016/S0895-4356(01)00480-2.CrossRefPubMed Andrade SE, Gurwitz JH, Chan KA, Donahue JG, Beck A, Boles M, Buist DS, Goodman M, LaCroix AZ, Levin TR, Platt R: Validation of diagnoses of peptic ulcers and bleeding from administrative databases: a multi-health maintenance organization study. J Clin Epidemiol. 2002, 55: 310-3. 10.1016/S0895-4356(01)00480-2.CrossRefPubMed
13.
go back to reference Dodds L, Spencer A, Shea S, Fell D, Armson BA, Allen AC, Bryson S: Validity of autism diagnoses using administrative health data. Chronic Dis Can. 2009, 29: 102-7.PubMedPubMedCentral Dodds L, Spencer A, Shea S, Fell D, Armson BA, Allen AC, Bryson S: Validity of autism diagnoses using administrative health data. Chronic Dis Can. 2009, 29: 102-7.PubMedPubMedCentral
14.
go back to reference Lix L, Yogendran M, Burchill C, Metge C, McKeen N, Moore D, Bond R: Defining and validating chronic diseases: an administrative data approach. 2006, Winnipeg: Manitoba Centre for Health Policy, Ref Type: Generic Lix L, Yogendran M, Burchill C, Metge C, McKeen N, Moore D, Bond R: Defining and validating chronic diseases: an administrative data approach. 2006, Winnipeg: Manitoba Centre for Health Policy, Ref Type: Generic
15.
go back to reference Lo-Ciganic W, Zgibor JC, Ruppert K, Arena VC, Stone RA: Identifying type 1 and type 2 diabetic cases using administrative data: a tree-structured model. J Diabetes Sci Technol. 2011, 5: 486-93.CrossRefPubMedPubMedCentral Lo-Ciganic W, Zgibor JC, Ruppert K, Arena VC, Stone RA: Identifying type 1 and type 2 diabetic cases using administrative data: a tree-structured model. J Diabetes Sci Technol. 2011, 5: 486-93.CrossRefPubMedPubMedCentral
16.
go back to reference Lopushinsky SR, Covarrubia KA, Rabeneck L, Austin PC, Urbach DR: Accuracy of administrative health data for the diagnosis of upper gastrointestinal diseases. Surg Endosc. 2007, 21: 1733-7. 10.1007/s00464-006-9136-1.CrossRefPubMed Lopushinsky SR, Covarrubia KA, Rabeneck L, Austin PC, Urbach DR: Accuracy of administrative health data for the diagnosis of upper gastrointestinal diseases. Surg Endosc. 2007, 21: 1733-7. 10.1007/s00464-006-9136-1.CrossRefPubMed
17.
go back to reference Nattinger AB, Laud PW, Bajorunaite R, Sparapani RA, Freeman JL: An algorithm for the use of Medicare claims data to identify women with incident breast cancer. Health Serv Res. 2004, 39: 1733-49. 10.1111/j.1475-6773.2004.00315.x.CrossRefPubMedPubMedCentral Nattinger AB, Laud PW, Bajorunaite R, Sparapani RA, Freeman JL: An algorithm for the use of Medicare claims data to identify women with incident breast cancer. Health Serv Res. 2004, 39: 1733-49. 10.1111/j.1475-6773.2004.00315.x.CrossRefPubMedPubMedCentral
18.
go back to reference Ramsey S, Mandelson M, Etzioni R, Harrison R, Smith R, Taplin S: Can administrative data identify incident cases of colorectal cancer? a comparison of two health plans. Health Serv Outcomes Res Methodol. 2004, 5: 27-37. 10.1007/s10742-005-5562-0.CrossRef Ramsey S, Mandelson M, Etzioni R, Harrison R, Smith R, Taplin S: Can administrative data identify incident cases of colorectal cancer? a comparison of two health plans. Health Serv Outcomes Res Methodol. 2004, 5: 27-37. 10.1007/s10742-005-5562-0.CrossRef
19.
go back to reference Tu K, Campbell NR, Chen ZL, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Med. 2007, 1: e18-e26.PubMedPubMedCentral Tu K, Campbell NR, Chen ZL, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Med. 2007, 1: e18-e26.PubMedPubMedCentral
20.
go back to reference Zgibor JC, Orchard TJ, Saul M, Piatt G, Ruppert K, Stewart A, Siminerio LM: Developing and validating a diabetes database in a large health system. Diabetes Res Clin Pract. 2007, 75: 313-9. 10.1016/j.diabres.2006.07.007.CrossRefPubMed Zgibor JC, Orchard TJ, Saul M, Piatt G, Ruppert K, Stewart A, Siminerio LM: Developing and validating a diabetes database in a large health system. Diabetes Res Clin Pract. 2007, 75: 313-9. 10.1016/j.diabres.2006.07.007.CrossRefPubMed
21.
go back to reference Cooper GS, Schultz L, Simpkins J, Lafata JE: The utility of administrative data for measuring adherence to cancer surveillance care guidelines. Med Care. 2007, 45: 66-72. 10.1097/01.mlr.0000241107.15133.54.CrossRefPubMed Cooper GS, Schultz L, Simpkins J, Lafata JE: The utility of administrative data for measuring adherence to cancer surveillance care guidelines. Med Care. 2007, 45: 66-72. 10.1097/01.mlr.0000241107.15133.54.CrossRefPubMed
22.
go back to reference Quan H, Parsons GA, Ghali WA: Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J Clin Epidemiol. 2004, 57: 366-72. 10.1016/j.jclinepi.2003.01.002.CrossRefPubMed Quan H, Parsons GA, Ghali WA: Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J Clin Epidemiol. 2004, 57: 366-72. 10.1016/j.jclinepi.2003.01.002.CrossRefPubMed
23.
go back to reference Hilsden RJ, Bryant HE, Sutherland LR, Brasher PM, Fields AL: A retrospective study on the use of post-operative colonoscopy following potentially curative surgery for colorectal cancer in a Canadian province. BMC Cancer. 2004, 4: 14-10.1186/1471-2407-4-14.CrossRefPubMedPubMedCentral Hilsden RJ, Bryant HE, Sutherland LR, Brasher PM, Fields AL: A retrospective study on the use of post-operative colonoscopy following potentially curative surgery for colorectal cancer in a Canadian province. BMC Cancer. 2004, 4: 14-10.1186/1471-2407-4-14.CrossRefPubMedPubMedCentral
24.
go back to reference Peters D, Chen C, Markson LE, Len-Ramey FC, Vollmer WM: Using an asthma control questionnaire and administrative data to predict health-care utilization. Chest. 2006, 129: 918-924. 10.1378/chest.129.4.918.CrossRefPubMed Peters D, Chen C, Markson LE, Len-Ramey FC, Vollmer WM: Using an asthma control questionnaire and administrative data to predict health-care utilization. Chest. 2006, 129: 918-924. 10.1378/chest.129.4.918.CrossRefPubMed
25.
go back to reference Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin DM, et al: (eds): International Classification of Diseases for Oncology. 2000, Geneva, Switzerland: World Health Organization, 3 Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin DM, et al: (eds): International Classification of Diseases for Oncology. 2000, Geneva, Switzerland: World Health Organization, 3
26.
go back to reference Collaborative Staging Task Force of the American Joint Committee on Cancer: Collaborative Staging Manual and Coding Instructions, version 01.04.00. 2004, Jointly published by American Joint Committee on Cancer (Chicago, IL) and U.S. Department of Health and Human Services (Bethesda, MD), NIH Publication Number 04–5496. Incorporates updates through September 8, 2006 Collaborative Staging Task Force of the American Joint Committee on Cancer: Collaborative Staging Manual and Coding Instructions, version 01.04.00. 2004, Jointly published by American Joint Committee on Cancer (Chicago, IL) and U.S. Department of Health and Human Services (Bethesda, MD), NIH Publication Number 04–5496. Incorporates updates through September 8, 2006
27.
go back to reference Fisher DA, Grubber JM, Castor JM, Coffman CJ: Ascertainment of colonoscopy indication using administrative data. Dig Dis Sci. 2010, 55: 1721-5. 10.1007/s10620-010-1200-y.CrossRefPubMed Fisher DA, Grubber JM, Castor JM, Coffman CJ: Ascertainment of colonoscopy indication using administrative data. Dig Dis Sci. 2010, 55: 1721-5. 10.1007/s10620-010-1200-y.CrossRefPubMed
28.
go back to reference Haque R, Chiu V, Mehta KR, Geiger AM: An automated data algorithm to distinguish screening and diagnostic colorectal cancer endoscopy exams. J Natl Cancer Inst Monogr. 2005, 35: 116-118.CrossRefPubMed Haque R, Chiu V, Mehta KR, Geiger AM: An automated data algorithm to distinguish screening and diagnostic colorectal cancer endoscopy exams. J Natl Cancer Inst Monogr. 2005, 35: 116-118.CrossRefPubMed
29.
go back to reference Schenck AP, Klabunde CN, Warren JL, Peacock S, Davis WW, Hawley ST, Pignone M, Ransohoff DF: Data sources for measuring colorectal endoscopy use among Medicare enrollees. Cancer Epidemiol Biomarkers Prev. 2007, 16: 2118-27. 10.1158/1055-9965.EPI-07-0123.CrossRefPubMed Schenck AP, Klabunde CN, Warren JL, Peacock S, Davis WW, Hawley ST, Pignone M, Ransohoff DF: Data sources for measuring colorectal endoscopy use among Medicare enrollees. Cancer Epidemiol Biomarkers Prev. 2007, 16: 2118-27. 10.1158/1055-9965.EPI-07-0123.CrossRefPubMed
30.
go back to reference Goff SL, Feld A, Andrade SE, Mahoney L, Beaton SJ, Boudreau DM, Davis RL, Goodman M, Hartsfield CL, Platt R, Roblin D, Smith D, Yood MU, Dodd K, Gurwitz JH: Administrative data used to identify patients with irritable bowel syndrome. J Clin Epidemiol. 2008, 61: 617-21. 10.1016/j.jclinepi.2007.07.013.CrossRefPubMed Goff SL, Feld A, Andrade SE, Mahoney L, Beaton SJ, Boudreau DM, Davis RL, Goodman M, Hartsfield CL, Platt R, Roblin D, Smith D, Yood MU, Dodd K, Gurwitz JH: Administrative data used to identify patients with irritable bowel syndrome. J Clin Epidemiol. 2008, 61: 617-21. 10.1016/j.jclinepi.2007.07.013.CrossRefPubMed
31.
go back to reference Miller DC, Saigal CS, Warren JL, Leventhal M, Deapen D, Banerjee M, Lai J, Hanley J, Litwin MS: External validation of a claims-based algorithm for classifying kidney-cancer surgeries. BMC Health Serv Res. 2009, 9: 92-10.1186/1472-6963-9-92.CrossRefPubMedPubMedCentral Miller DC, Saigal CS, Warren JL, Leventhal M, Deapen D, Banerjee M, Lai J, Hanley J, Litwin MS: External validation of a claims-based algorithm for classifying kidney-cancer surgeries. BMC Health Serv Res. 2009, 9: 92-10.1186/1472-6963-9-92.CrossRefPubMedPubMedCentral
Metadata
Title
Validation of administrative data sources for endoscopy utilization in colorectal cancer diagnosis
Authors
Xue Li
Robert Hilsden
Shakhawat Hossain
John Fleming
Marcy Winget
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-358

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue