Skip to main content
Top
Published in: Journal of Gastrointestinal Surgery 2/2019

01-02-2019 | Original Article

Do Diagnostic and Procedure Codes Within Population-Based, Administrative Datasets Accurately Identify Patients with Rectal Cancer?

Authors: Reilly P. Musselman, Tara Gomes, Deanna M. Rothwell, Rebecca C. Auer, Husein Moloo, Robin P. Boushey, Carl van Walraven

Published in: Journal of Gastrointestinal Surgery | Issue 2/2019

Login to get access

Abstract

Background

Procedural and diagnostic codes may inaccurately identify specific patient populations within administrative datasets.

Purpose

Measure the accuracy of previously used coding algorithms using administrative data to identify patients with rectal cancer resections (RCR).

Methods

Using a previously published coding algorithm, we re-created a RCR cohort within administrative databases, limiting the search to a single institution. The accuracy of this cohort was determined against a gold standard reference population. A systematic review of the literature was then performed to identify studies that use similar coding methods to identify RCR cohorts and whether or not they comment on accuracy.

Results

Over the course of the study period, there were 664,075 hospitalizations at our institution. Previously used coding algorithms identified 1131 RCRs (administrative data incidence 1.70 per 1000 hospitalizations). The gold standard reference population was 821 RCR over the same period (1.24 per 1000 hospitalizations). Administrative data methods yielded a RCR cohort of moderate accuracy (sensitivity 89.5%, specificity 99.9%) and poor positive predictive value (64.9%). Literature search identified 18 studies that utilized similar coding methods to derive a RCR cohort. Only 1/18 (5.6%) reported on the accuracy of their study cohort.

Conclusions

The use of diagnostic and procedure codes to identify RCR within administrative datasets may be subject to misclassification bias because of low PPV. This underscores the importance of reporting on the accuracy of RCR cohorts derived within population-based datasets.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rodriguez B, Balla A, Fernandez-Ananin S, Balague C, Targarona EM. The era of large databases: outcomes after gastroesophageal surgery according to NSQIP, NIS and NCDB databases. Systematic literature review. Surg Innov. 2018; 25(4):400–412.CrossRef Rodriguez B, Balla A, Fernandez-Ananin S, Balague C, Targarona EM. The era of large databases: outcomes after gastroesophageal surgery according to NSQIP, NIS and NCDB databases. Systematic literature review. Surg Innov. 2018; 25(4):400–412.CrossRef
2.
go back to reference Rodriguez B, Balla A, Corradetti S et al. What have we learned in minimally invasive surgery from NSQIP and NIS large databases? A systematic review. Int J Colorectal Dis. 2018; 33(6): 663–681CrossRef Rodriguez B, Balla A, Corradetti S et al. What have we learned in minimally invasive surgery from NSQIP and NIS large databases? A systematic review. Int J Colorectal Dis. 2018; 33(6): 663–681CrossRef
3.
4.
go back to reference van Walraven C, Bennett C, Forster AJ. Administrative database research infrequently uses validated diagnostic or procedural codes. J Clin Epidemiol. 2011; 64:1054–1059.CrossRefPubMed van Walraven C, Bennett C, Forster AJ. Administrative database research infrequently uses validated diagnostic or procedural codes. J Clin Epidemiol. 2011; 64:1054–1059.CrossRefPubMed
5.
go back to reference Campbell SE, Campbell MK, Grimshaw JM, Walker AE. A systematic review of discharge coding accuracy. J Public Health Med 2001;23:205–211.CrossRefPubMed Campbell SE, Campbell MK, Grimshaw JM, Walker AE. A systematic review of discharge coding accuracy. J Public Health Med 2001;23:205–211.CrossRefPubMed
6.
go back to reference Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P. Assessing the accuracy of administrative data in health information systems. Med Care 2004;42:1066–1072.CrossRefPubMed Peabody JW, Luck J, Jain S, Bertenthal D, Glassman P. Assessing the accuracy of administrative data in health information systems. Med Care 2004;42:1066–1072.CrossRefPubMed
7.
go back to reference Hohl CM, Karpov AK, Reddekopp L, Stausberg J. ICD-10 codes used to identify adverse drug events in administrative data: a systematic review. J Am Med Inform Assoc 2014; 21:547–557.CrossRefPubMed Hohl CM, Karpov AK, Reddekopp L, Stausberg J. ICD-10 codes used to identify adverse drug events in administrative data: a systematic review. J Am Med Inform Assoc 2014; 21:547–557.CrossRefPubMed
8.
go back to reference Prentice RL. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 1989, v8 n4, 431–440. Prentice RL. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 1989, v8 n4, 431–440.
9.
go back to reference Musselman RP, Gomes T, Chan BP, Auer RC, Moloo H, Poulin EC, Mamazza J, Al-Khayal K, Mamdani M, Al-Omran M, Al-Obaid O, Boushey RP. Changing Trends in Rectal Cancer Surgery in Ontario: 2002-2009. Colorectal Disease. 2012; 14(12):1467–1472.CrossRefPubMed Musselman RP, Gomes T, Chan BP, Auer RC, Moloo H, Poulin EC, Mamazza J, Al-Khayal K, Mamdani M, Al-Omran M, Al-Obaid O, Boushey RP. Changing Trends in Rectal Cancer Surgery in Ontario: 2002-2009. Colorectal Disease. 2012; 14(12):1467–1472.CrossRefPubMed
10.
go back to reference O’Connell JB, Maggard MA, Ko CY. Colon cancer survival rates with the new American Joint Committee on cancer sixth edition staging. Journal of the National Cancer Institute. 2004; 96(19): 1420–1425.CrossRefPubMed O’Connell JB, Maggard MA, Ko CY. Colon cancer survival rates with the new American Joint Committee on cancer sixth edition staging. Journal of the National Cancer Institute. 2004; 96(19): 1420–1425.CrossRefPubMed
11.
go back to reference AJCC (American Joint Committee on Cancer) Cancer Staging Manual, 7th edition, Edge, SB, Byrd, DR, Compton, CC, et al (Eds), Springer, New York 2010. p.143 AJCC (American Joint Committee on Cancer) Cancer Staging Manual, 7th edition, Edge, SB, Byrd, DR, Compton, CC, et al (Eds), Springer, New York 2010. p.143
13.
go back to reference Tjandra JJ, Kilkenny JW, Buie WD et al. Practice parameters for the management of rectal cancer (revised). Dis Colon rectum. 2005; 48:411–423.CrossRefPubMed Tjandra JJ, Kilkenny JW, Buie WD et al. Practice parameters for the management of rectal cancer (revised). Dis Colon rectum. 2005; 48:411–423.CrossRefPubMed
14.
go back to reference Musselman RP, Rothwell D, Auer RC, Moloo H, Boushey R, van Walraven C. Identifying rectal cancer patients within administrative datasets using pathology reports. J Pathol Inform 2018; 9:18 (ePub ahead of print).CrossRefPubMedPubMedCentral Musselman RP, Rothwell D, Auer RC, Moloo H, Boushey R, van Walraven C. Identifying rectal cancer patients within administrative datasets using pathology reports. J Pathol Inform 2018; 9:18 (ePub ahead of print).CrossRefPubMedPubMedCentral
15.
go back to reference Juurlink D, Preyra C, Croxford R et al. Canadian Institute for Health Information Discharge Abstract Database: a validation study. Toronto: Institute for Clinical Evaluative Sciences; 2006. Juurlink D, Preyra C, Croxford R et al. Canadian Institute for Health Information Discharge Abstract Database: a validation study. Toronto: Institute for Clinical Evaluative Sciences; 2006.
16.
go back to reference Ackerman SJ, Shoshana D, Baik R et al. Comparison of complication and conversion rates between robotic-assisted and laparoscopic rectal resection for rectal cancer: which patients and providers could benefit most from robotic-assisted surgery?. J Med Econ. 2018; 21(3): 254–261CrossRefPubMed Ackerman SJ, Shoshana D, Baik R et al. Comparison of complication and conversion rates between robotic-assisted and laparoscopic rectal resection for rectal cancer: which patients and providers could benefit most from robotic-assisted surgery?. J Med Econ. 2018; 21(3): 254–261CrossRefPubMed
17.
go back to reference Saia M, Buja A, Mantoan D et al. Isolated rectal cancer surgery: a 2007-2014 population study based on a large administrative database. Updates Surg. 2017; 69: 367–373CrossRefPubMed Saia M, Buja A, Mantoan D et al. Isolated rectal cancer surgery: a 2007-2014 population study based on a large administrative database. Updates Surg. 2017; 69: 367–373CrossRefPubMed
18.
go back to reference Yeo HL, Abelson JS, Mao J et al. Surgeon annual and cumulative volumes predict early postoperative outcomes after rectal cancer resection. Ann Surg. 2017;265: 151–157CrossRefPubMed Yeo HL, Abelson JS, Mao J et al. Surgeon annual and cumulative volumes predict early postoperative outcomes after rectal cancer resection. Ann Surg. 2017;265: 151–157CrossRefPubMed
19.
go back to reference Keller D, Qiu J, Senagore AJ. Predicting opportunities to increase utiliziation of laparoscopy for rectal cancer. Surg Endosc. 2018; 32: 1556–1563.CrossRefPubMed Keller D, Qiu J, Senagore AJ. Predicting opportunities to increase utiliziation of laparoscopy for rectal cancer. Surg Endosc. 2018; 32: 1556–1563.CrossRefPubMed
20.
go back to reference Aquina CT, Probst CP, Becerra BA et al. High volume improves outcomes: the argument for centralization of rectal cancer surgery. Surgery 2016;159: 736–748.CrossRefPubMed Aquina CT, Probst CP, Becerra BA et al. High volume improves outcomes: the argument for centralization of rectal cancer surgery. Surgery 2016;159: 736–748.CrossRefPubMed
21.
go back to reference Wiegard NE, Hart KD, Herzig DO. Psychiatric illness is a disparity in the surgical management of rectal cancer. Ann Surg Oncol 2015;22: S573-S579.CrossRef Wiegard NE, Hart KD, Herzig DO. Psychiatric illness is a disparity in the surgical management of rectal cancer. Ann Surg Oncol 2015;22: S573-S579.CrossRef
22.
go back to reference Dobbins TA, Young JM, Solomon MJ. Uptake and outcomes of laparoscopically assisted resection for colon and rectal cancer in Australia: a population-based study. Dis Colon Rectum 2014;57:415–422CrossRefPubMed Dobbins TA, Young JM, Solomon MJ. Uptake and outcomes of laparoscopically assisted resection for colon and rectal cancer in Australia: a population-based study. Dis Colon Rectum 2014;57:415–422CrossRefPubMed
23.
go back to reference Simunovic M, Baxter NN, Sutradhar R, Liu N, Cadeddu M, Urbach D. Uptake and patient outcomes of laparoscopic colon and rectal cancer surgery in a publicly funded system and following financial incentives. Ann Surg Oncol. 2013; 20: 3740–3746.CrossRefPubMed Simunovic M, Baxter NN, Sutradhar R, Liu N, Cadeddu M, Urbach D. Uptake and patient outcomes of laparoscopic colon and rectal cancer surgery in a publicly funded system and following financial incentives. Ann Surg Oncol. 2013; 20: 3740–3746.CrossRefPubMed
24.
go back to reference Devon KM, Urbach DR, McLeod RS. Postoperative disposition and health services use in elderly patients undergoing colorectal cancer surgery: a population-based study. Surgery 2011; 149: 705–712.CrossRefPubMed Devon KM, Urbach DR, McLeod RS. Postoperative disposition and health services use in elderly patients undergoing colorectal cancer surgery: a population-based study. Surgery 2011; 149: 705–712.CrossRefPubMed
25.
go back to reference Ricciardi R, Roberts PL, Read TE, Baxter NN, Marcello PW, Schoetz DJ. Who performs proctectomy for rectal cancer in the United States. Dis Colon Rectum 2011; 54;1210–1215.CrossRefPubMed Ricciardi R, Roberts PL, Read TE, Baxter NN, Marcello PW, Schoetz DJ. Who performs proctectomy for rectal cancer in the United States. Dis Colon Rectum 2011; 54;1210–1215.CrossRefPubMed
26.
go back to reference Ricciardi R, Roberts PL, Read TE, Baxter NN, Marcello PW, Schoetz DJ. Presence of specialty surgeons reduces the likelihood of colostomy after proctectomy for rectal cancer. Dis Colon Rectum. 2011; 54;207–213.CrossRefPubMed Ricciardi R, Roberts PL, Read TE, Baxter NN, Marcello PW, Schoetz DJ. Presence of specialty surgeons reduces the likelihood of colostomy after proctectomy for rectal cancer. Dis Colon Rectum. 2011; 54;207–213.CrossRefPubMed
27.
go back to reference Ricciardi R, Roberts PL, Read TE, Marcello PW, Schoetz DJ, Baxter NN. Variability in reconstructive procedures following rectal cancer surgery in the United States. Dis Colon Rectum 2010; 53;874–880.CrossRefPubMed Ricciardi R, Roberts PL, Read TE, Marcello PW, Schoetz DJ, Baxter NN. Variability in reconstructive procedures following rectal cancer surgery in the United States. Dis Colon Rectum 2010; 53;874–880.CrossRefPubMed
28.
go back to reference Thompson BS, Coory MD, Lumley JW. National trends in the uptake of laparoscopic resection for colorectal cancer, 2000-2008. MJA 2011; 194: 443–447PubMed Thompson BS, Coory MD, Lumley JW. National trends in the uptake of laparoscopic resection for colorectal cancer, 2000-2008. MJA 2011; 194: 443–447PubMed
29.
go back to reference Tilney HS, Heriot AG, Purkayastha et al. A national perspective on the decline of abdominoperineal resection for rectal cancer. Ann Surg. 2008;247(1): 77–84.CrossRefPubMed Tilney HS, Heriot AG, Purkayastha et al. A national perspective on the decline of abdominoperineal resection for rectal cancer. Ann Surg. 2008;247(1): 77–84.CrossRefPubMed
30.
go back to reference Singh RK, Dharmasena D, Virgo K, et al. Proctectomy for rectal cancer in patients with prior spinal cord injury. Surg Oncol. 2008;17:313–316.CrossRefPubMed Singh RK, Dharmasena D, Virgo K, et al. Proctectomy for rectal cancer in patients with prior spinal cord injury. Surg Oncol. 2008;17:313–316.CrossRefPubMed
31.
go back to reference Ricciardi R, Vernig BA, Madoff RD, Rothenberger DA, Baxter NN. The status of radical proctectomy and sphincter sparing surgery in the United States. Dis Colon Rectum. 2007; 50: 1119–1127.CrossRefPubMed Ricciardi R, Vernig BA, Madoff RD, Rothenberger DA, Baxter NN. The status of radical proctectomy and sphincter sparing surgery in the United States. Dis Colon Rectum. 2007; 50: 1119–1127.CrossRefPubMed
32.
go back to reference Morris E, Quirke P, Thomas JD et al. Unacceptable variation in abdominoperineal excision rates for rectal cancer: time to intervene?. Gut 2008; 57:1690–1697.CrossRefPubMed Morris E, Quirke P, Thomas JD et al. Unacceptable variation in abdominoperineal excision rates for rectal cancer: time to intervene?. Gut 2008; 57:1690–1697.CrossRefPubMed
33.
go back to reference Widdifield J, Bombardier C, Bernatsky S et al. An administrative data validation study of the accuracy of algorithms for identifying rheumatoid arthritis: the influence of the reference standard on algorithm performance. BMC Musculoskelet Disord. 2014; 15:216–225.CrossRefPubMedPubMedCentral Widdifield J, Bombardier C, Bernatsky S et al. An administrative data validation study of the accuracy of algorithms for identifying rheumatoid arthritis: the influence of the reference standard on algorithm performance. BMC Musculoskelet Disord. 2014; 15:216–225.CrossRefPubMedPubMedCentral
34.
go back to reference Lee DS, Stitt A, Wang X et al. Administrative hospitalization database validation of cardiac procedure codes. Med Care. 2013; 51(4):e22–26.CrossRefPubMed Lee DS, Stitt A, Wang X et al. Administrative hospitalization database validation of cardiac procedure codes. Med Care. 2013; 51(4):e22–26.CrossRefPubMed
35.
go back to reference Tu K, Nieuwlaat R, Cheng S et al. Identifying patients with atrial fibrillation in administrative data. Canadian Journal of Cardiology. 2016; 32:1561–1565.CrossRefPubMed Tu K, Nieuwlaat R, Cheng S et al. Identifying patients with atrial fibrillation in administrative data. Canadian Journal of Cardiology. 2016; 32:1561–1565.CrossRefPubMed
36.
go back to reference Goldsbury DE, Armstrong K, Simonella L, Armstrong BK, O’Connell DL. Using administrative health data to describe colorectal and lung cancer in New South Wales, Australia: a validation study. BMC Health Services Research. 2012; 12:387–396.CrossRefPubMedPubMedCentral Goldsbury DE, Armstrong K, Simonella L, Armstrong BK, O’Connell DL. Using administrative health data to describe colorectal and lung cancer in New South Wales, Australia: a validation study. BMC Health Services Research. 2012; 12:387–396.CrossRefPubMedPubMedCentral
38.
go back to reference Li X, King C, deGara C, White J, Winget M. Validation of colorectal cancer surgery data from administrative data sources. BMC Medical Research Methodology. 2012; 12:97–104.CrossRefPubMedPubMedCentral Li X, King C, deGara C, White J, Winget M. Validation of colorectal cancer surgery data from administrative data sources. BMC Medical Research Methodology. 2012; 12:97–104.CrossRefPubMedPubMedCentral
39.
go back to reference Savova GK, Masanz JJ, Ogren PV et al. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J AM Med Inform Assoc 2010; 17(5): 507–513CrossRefPubMedPubMedCentral Savova GK, Masanz JJ, Ogren PV et al. Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications. J AM Med Inform Assoc 2010; 17(5): 507–513CrossRefPubMedPubMedCentral
Metadata
Title
Do Diagnostic and Procedure Codes Within Population-Based, Administrative Datasets Accurately Identify Patients with Rectal Cancer?
Authors
Reilly P. Musselman
Tara Gomes
Deanna M. Rothwell
Rebecca C. Auer
Husein Moloo
Robin P. Boushey
Carl van Walraven
Publication date
01-02-2019
Publisher
Springer US
Published in
Journal of Gastrointestinal Surgery / Issue 2/2019
Print ISSN: 1091-255X
Electronic ISSN: 1873-4626
DOI
https://doi.org/10.1007/s11605-018-4043-z

Other articles of this Issue 2/2019

Journal of Gastrointestinal Surgery 2/2019 Go to the issue