Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Hospital discharge diagnostic and procedure codes for upper gastro-intestinal cancer: how accurate are they?

Authors: Efty Stavrou, Nicole Pesa, Sallie-Anne Pearson

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

Population-level health administrative datasets such as hospital discharge data are used increasingly to evaluate health services and outcomes of care. However information about the accuracy of Australian discharge data in identifying cancer, associated procedures and comorbidity is limited. The Admitted Patients Data Collection (APDC) is a census of inpatient hospital discharges in the state of New South Wales (NSW). Our aim was to assess the accuracy of the APDC in identifying upper gastro-intestinal (upper GI) cancer cases, procedures for associated curative resection and comorbidities at the time of admission compared to data abstracted from medical records (the ‘gold standard’).

Methods

We reviewed the medical records of 240 patients with an incident upper GI cancer diagnosis derived from a clinical database in one NSW area health service from July 2006 to June 2007. Extracted case record data was matched to APDC discharge data to determine sensitivity, positive predictive value (PPV) and agreement between the two data sources (κ-coefficient).

Results

The accuracy of the APDC diagnostic codes in identifying site-specific incident cancer ranged from 80-95% sensitivity. This was comparable to the accuracy of APDC procedure codes in identifying curative resection for upper GI cancer. PPV ranged from 42-80% for cancer diagnosis and 56-93% for curative surgery. Agreement between the data sources was >0.72 for most cancer diagnoses and curative resections. However, APDC discharge data was less accurate in reporting common comorbidities - for each condition, sensitivity ranged from 9-70%, whilst agreement ranged from κ = 0.64 for diabetes down to κ < 0.01 for gastro-oesophageal reflux disorder.

Conclusions

Identifying incident cases of upper GI cancer and curative resection from hospital administrative data is satisfactory but under-ascertained. Linkage of multiple population-health datasets is advisable to maximise case ascertainment and minimise false-positives. Consideration must be given when utilising hospital discharge data alone for generating comorbidity indices, as disease burden at the time of admission is under-reported.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ben-Tovim DI, Pointer SC, Woodman R, Hakendorf PH, Harrison JE: Routine use of administrative data for safety and quality purposes - hospital mortality. Med J Aust. 2010, 193: S100-S103.PubMed Ben-Tovim DI, Pointer SC, Woodman R, Hakendorf PH, Harrison JE: Routine use of administrative data for safety and quality purposes - hospital mortality. Med J Aust. 2010, 193: S100-S103.PubMed
2.
go back to reference Board N, Watson DE: Using what we gather - harnessing information for improved care. Med J Aust. 2010, 193: S93-S94.PubMed Board N, Watson DE: Using what we gather - harnessing information for improved care. Med J Aust. 2010, 193: S93-S94.PubMed
3.
go back to reference Semmens JB, Platell C, Threlfall TJ, Holman CDJ: A population-based study of the incidence, mortality and outcomes in patients following surgery for colorectal cancer in Western Australia. ANZ J Surg. 2000, 70 (1): 11-18. 10.1046/j.1440-1622.2000.01734.x.CrossRef Semmens JB, Platell C, Threlfall TJ, Holman CDJ: A population-based study of the incidence, mortality and outcomes in patients following surgery for colorectal cancer in Western Australia. ANZ J Surg. 2000, 70 (1): 11-18. 10.1046/j.1440-1622.2000.01734.x.CrossRef
4.
go back to reference Spilsbury K, Semmens JB, Saunders CM, Holman CDJ: Long-term survival outcomes following breast cancer surgery in Western Australia. ANZ J Surg. 2005, 75 (8): 625-630. 10.1111/j.1445-2197.2005.03478.x.CrossRefPubMed Spilsbury K, Semmens JB, Saunders CM, Holman CDJ: Long-term survival outcomes following breast cancer surgery in Western Australia. ANZ J Surg. 2005, 75 (8): 625-630. 10.1111/j.1445-2197.2005.03478.x.CrossRefPubMed
5.
go back to reference Stavrou EP, Smith GS, Baker DF: Surgical outcomes associated with oesophagectomy in New South Wales; an investigation of hospital volume. J Gastrointest Surg. 2010, 14: 951-957. 10.1007/s11605-010-1198-7.CrossRef Stavrou EP, Smith GS, Baker DF: Surgical outcomes associated with oesophagectomy in New South Wales; an investigation of hospital volume. J Gastrointest Surg. 2010, 14: 951-957. 10.1007/s11605-010-1198-7.CrossRef
6.
go back to reference Salz T, Sandler RS: The effect of Hospital and surgeon volume on outcomes for rectal cancer surgery. Clin Gastroenterol Hepatol. 2008, 6 (11): 1185-1193. 10.1016/j.cgh.2008.05.023.CrossRefPubMedPubMedCentral Salz T, Sandler RS: The effect of Hospital and surgeon volume on outcomes for rectal cancer surgery. Clin Gastroenterol Hepatol. 2008, 6 (11): 1185-1193. 10.1016/j.cgh.2008.05.023.CrossRefPubMedPubMedCentral
7.
go back to reference Goldsbury DE, Smith DP, Armstrong BK, O'Connell DL: Using linked routinely collected health data to describe prostate cancer treatment in New South Wales, Australia: a validation study. BMC Health Services Res. 2011, 11: 253-259. 10.1186/1472-6963-11-253.CrossRef Goldsbury DE, Smith DP, Armstrong BK, O'Connell DL: Using linked routinely collected health data to describe prostate cancer treatment in New South Wales, Australia: a validation study. BMC Health Services Res. 2011, 11: 253-259. 10.1186/1472-6963-11-253.CrossRef
8.
go back to reference Taylor LK, Simpson JM, Roberts CL, Olive EC, Henderson-Smart DJ: Risk of complications in a second pregnancy following caesarean section in the first preganancy: a population-based study. Med J Aust. 2005, 183: 515-519.PubMed Taylor LK, Simpson JM, Roberts CL, Olive EC, Henderson-Smart DJ: Risk of complications in a second pregnancy following caesarean section in the first preganancy: a population-based study. Med J Aust. 2005, 183: 515-519.PubMed
9.
go back to reference Roberts CL, Algert CS, Morris JM, Ford JB, Henderson-Smart DJ: Hypertensive disorders in pregnancy: a population-based study. Med J Aust. 2005, 182: 332-335.PubMed Roberts CL, Algert CS, Morris JM, Ford JB, Henderson-Smart DJ: Hypertensive disorders in pregnancy: a population-based study. Med J Aust. 2005, 182: 332-335.PubMed
10.
go back to reference Bright RA, Avorn J, Everitt DE: Medicaid data as a resource for epidemiologic studies: strengths and limitations. J Clin Epidemiol. 1989, 42: 937-945. 10.1016/0895-4356(89)90158-3.CrossRefPubMed Bright RA, Avorn J, Everitt DE: Medicaid data as a resource for epidemiologic studies: strengths and limitations. J Clin Epidemiol. 1989, 42: 937-945. 10.1016/0895-4356(89)90158-3.CrossRefPubMed
11.
go back to reference van Walraven C, Bennett C, Forster AJ: Administrative databse research infrequently used validated diagnostic or procedural codes. J Clin Epidemiol. 2011, 64: 1054-1059. 10.1016/j.jclinepi.2011.01.001.CrossRefPubMed van Walraven C, Bennett C, Forster AJ: Administrative databse research infrequently used validated diagnostic or procedural codes. J Clin Epidemiol. 2011, 64: 1054-1059. 10.1016/j.jclinepi.2011.01.001.CrossRefPubMed
12.
go back to reference Terris DD, Litaker DG, Koroukian SM: Health state information derived from secondary databases is affected by multiple sources of bias. J Clin Epidemiol. 2007, 2007: 734-741.CrossRef Terris DD, Litaker DG, Koroukian SM: Health state information derived from secondary databases is affected by multiple sources of bias. J Clin Epidemiol. 2007, 2007: 734-741.CrossRef
13.
go back to reference Lain SJ, Roberts CL, Hadfield RM, Bell JC, Morris JM: How accurate is the reporting of obstetric haemmorhage in hospital discharge data? A validation study. ANZ J Obstetr Gynaecol. 2008, 48: 481-484. Lain SJ, Roberts CL, Hadfield RM, Bell JC, Morris JM: How accurate is the reporting of obstetric haemmorhage in hospital discharge data? A validation study. ANZ J Obstetr Gynaecol. 2008, 48: 481-484.
14.
go back to reference Roberts CL, Bell JC, Ford JB, Hadfield RM, Algert CS, Morris JM: The accuracy of reporting of the hypertensive disorders of pregnancy in population health data. Hypertens Pregnancy. 2008, 27: 285-297. 10.1080/10641950701826695.CrossRefPubMedPubMedCentral Roberts CL, Bell JC, Ford JB, Hadfield RM, Algert CS, Morris JM: The accuracy of reporting of the hypertensive disorders of pregnancy in population health data. Hypertens Pregnancy. 2008, 27: 285-297. 10.1080/10641950701826695.CrossRefPubMedPubMedCentral
15.
go back to reference Roberts CL, Ford JB, Lain SJ, Algert CS, Sparks CJ: The accuracy of reporting of general anaesthesia for childbirth: a validation study. Anaesth Intensive Care. 2008, 36: 418-424.PubMed Roberts CL, Ford JB, Lain SJ, Algert CS, Sparks CJ: The accuracy of reporting of general anaesthesia for childbirth: a validation study. Anaesth Intensive Care. 2008, 36: 418-424.PubMed
16.
go back to reference Korst LM, Gregory KD, Gornbein JA: Elective primary caesarean delivery: Accuracy of administrative data. Paediatr Perinat Epidemiol. 2004, 18: 112-119. 10.1111/j.1365-3016.2003.00540.x.CrossRefPubMed Korst LM, Gregory KD, Gornbein JA: Elective primary caesarean delivery: Accuracy of administrative data. Paediatr Perinat Epidemiol. 2004, 18: 112-119. 10.1111/j.1365-3016.2003.00540.x.CrossRefPubMed
17.
go back to reference Cooper GS, Yuan Z, Stange KC, Dennis LK, Amini SB, Rimm AA: The sensitivity of Medicare claims data for case ascertainment of six common cancers. Med Care. 1999, 37: 436-444. 10.1097/00005650-199905000-00003.CrossRefPubMed Cooper GS, Yuan Z, Stange KC, Dennis LK, Amini SB, Rimm AA: The sensitivity of Medicare claims data for case ascertainment of six common cancers. Med Care. 1999, 37: 436-444. 10.1097/00005650-199905000-00003.CrossRefPubMed
18.
go back to reference Couris CM, Schott AM, Ecochard R, Morgon E, Colin C: A literature review to assess the use of claims databases in identifying incident cancer cases. Health Serv Outcomes Research Method. 2003, 4: 49-63. 10.1023/A:1025828911298.CrossRef Couris CM, Schott AM, Ecochard R, Morgon E, Colin C: A literature review to assess the use of claims databases in identifying incident cancer cases. Health Serv Outcomes Research Method. 2003, 4: 49-63. 10.1023/A:1025828911298.CrossRef
19.
go back to reference Wang PS, Walker AM, Tsuang MT, Orav EJ, Levin R, Avorn J: Finding incident breast cancer cases through US claims data and a state cancer registry. Cancer Causes Control. 2001, 12: 257-265. 10.1023/A:1011204704153.CrossRefPubMed Wang PS, Walker AM, Tsuang MT, Orav EJ, Levin R, Avorn J: Finding incident breast cancer cases through US claims data and a state cancer registry. Cancer Causes Control. 2001, 12: 257-265. 10.1023/A:1011204704153.CrossRefPubMed
20.
go back to reference McGeechan K, Kricker A, Armstrong B, Stubbs J: Evaluation of linked cancer registry and hospital records of breast cancer. Aust NZ J Public Health. 1998, 22: 765-770. 10.1111/j.1467-842X.1998.tb01490.x.CrossRef McGeechan K, Kricker A, Armstrong B, Stubbs J: Evaluation of linked cancer registry and hospital records of breast cancer. Aust NZ J Public Health. 1998, 22: 765-770. 10.1111/j.1467-842X.1998.tb01490.x.CrossRef
21.
go back to reference Australian Institute of Health and Welfare: Cancer in Australia: an overview. 2010, Canberra Australian Institute of Health and Welfare: Cancer in Australia: an overview. 2010, Canberra
24.
go back to reference Fleiss JL: Statistical methods for rates and proportions. 1981, John Wiley, New York, 2 Fleiss JL: Statistical methods for rates and proportions. 1981, John Wiley, New York, 2
25.
go back to reference National Centre for Classification in Health: ICD-10-AM/ACHI/ACS. 2008, Sydney Uo, Sydney, 6 National Centre for Classification in Health: ICD-10-AM/ACHI/ACS. 2008, Sydney Uo, Sydney, 6
26.
go back to reference De Coster C, Quan H, Finlayson A, Gao M, Halfon P, Humphries KH, et al: Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium. BMC Health Serv Res. 2006, 6: 77-10.1186/1472-6963-1186-1177.CrossRefPubMedPubMedCentral De Coster C, Quan H, Finlayson A, Gao M, Halfon P, Humphries KH, et al: Identifying priorities in methodological research using ICD-9-CM and ICD-10 administrative data: report from an international consortium. BMC Health Serv Res. 2006, 6: 77-10.1186/1472-6963-1186-1177.CrossRefPubMedPubMedCentral
27.
go back to reference Smith GS, Minehan E: The SUGSS database:a web based upper GI cancer database. Aust NZ J Surg. 2009, 79 (Suppl 1): A41.CrossRef Smith GS, Minehan E: The SUGSS database:a web based upper GI cancer database. Aust NZ J Surg. 2009, 79 (Suppl 1): A41.CrossRef
28.
go back to reference van Heek NT, Kuhlmann KFD, Scholten RJ, de Castro SMM, Busch ORC, van Gulik TM, Obertop H, Gouma DJ: Hospital volume and mortality after pancreatic resection - a systematic review and an evaluation of intervention in The Netherlands. Ann Surg. 2005, 242 (6): 781-790. 10.1097/01.sla.0000188462.00249.36.CrossRefPubMedPubMedCentral van Heek NT, Kuhlmann KFD, Scholten RJ, de Castro SMM, Busch ORC, van Gulik TM, Obertop H, Gouma DJ: Hospital volume and mortality after pancreatic resection - a systematic review and an evaluation of intervention in The Netherlands. Ann Surg. 2005, 242 (6): 781-790. 10.1097/01.sla.0000188462.00249.36.CrossRefPubMedPubMedCentral
29.
go back to reference Malin JL, Kahn KL, Adams J, Kwan L, Laouri M, Ganz PA: Validity of cancer registry data for measuring the quality of breast cancer care. J Natl Cancer Inst. 2002, 94: 835-844. 10.1093/jnci/94.11.835.CrossRefPubMed Malin JL, Kahn KL, Adams J, Kwan L, Laouri M, Ganz PA: Validity of cancer registry data for measuring the quality of breast cancer care. J Natl Cancer Inst. 2002, 94: 835-844. 10.1093/jnci/94.11.835.CrossRefPubMed
30.
go back to reference Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Med Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed Pinfold SP, Goel V, Sawka C: Quality of hospital discharge and physician data for type of breast cancer surgery. Med Care. 2000, 38: 99-107. 10.1097/00005650-200001000-00011.CrossRefPubMed
31.
go back to reference Bernal-Delgado EE, Martos C, Martinez N, Chirlaque MD, Marquez M, Navarro C, et al: Is hospital discharge administrative data an appropriate source of information for cancer registries purposes? Some insight from four Spanish registries. BMC Health Serv Res. 2010, 10: 9-14. 10.1186/1472-6963-10-9.CrossRefPubMed Bernal-Delgado EE, Martos C, Martinez N, Chirlaque MD, Marquez M, Navarro C, et al: Is hospital discharge administrative data an appropriate source of information for cancer registries purposes? Some insight from four Spanish registries. BMC Health Serv Res. 2010, 10: 9-14. 10.1186/1472-6963-10-9.CrossRefPubMed
32.
go back to reference Couris CM, Seigneurin A, Bouzbid S, Rabilloud M, Perrin P, Martin X, Colin C, Schott AM: French claims data as a source of information to describe cancer incidence: predictive values of two identification methods of incident prostate cancers. J Med Syst. 2006, 30: 459-463. 10.1007/s10916-006-9028-x.CrossRefPubMed Couris CM, Seigneurin A, Bouzbid S, Rabilloud M, Perrin P, Martin X, Colin C, Schott AM: French claims data as a source of information to describe cancer incidence: predictive values of two identification methods of incident prostate cancers. J Med Syst. 2006, 30: 459-463. 10.1007/s10916-006-9028-x.CrossRefPubMed
33.
go back to reference Januel J-M, Luthi J-C, Quan H, Borst F, Taffe P, Ghali WA, Burnand B: Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data. BMC Health Serv Res. 2011, 11: 194-207. 10.1186/1472-6963-11-194.CrossRefPubMedPubMedCentral Januel J-M, Luthi J-C, Quan H, Borst F, Taffe P, Ghali WA, Burnand B: Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data. BMC Health Serv Res. 2011, 11: 194-207. 10.1186/1472-6963-11-194.CrossRefPubMedPubMedCentral
34.
go back to reference Preen DB, Holman CDJ, Lawrence DM, Baynham NJ, Semmens JB: Hospital chart review provided more accurate comorbidity information than data from a general practitioner survey or an administrative database. J Clin Epidemiol. 2004, 57: 1295-1304. 10.1016/j.jclinepi.2004.03.016.CrossRefPubMed Preen DB, Holman CDJ, Lawrence DM, Baynham NJ, Semmens JB: Hospital chart review provided more accurate comorbidity information than data from a general practitioner survey or an administrative database. J Clin Epidemiol. 2004, 57: 1295-1304. 10.1016/j.jclinepi.2004.03.016.CrossRefPubMed
35.
go back to reference Powell H, Lim LL-Y, Heller RF: Accuracy of administrative data to assess comorbidity in patients with heart disease: an Australian perspective. J Clin Epidemiol. 2001, 54: 687-693. 10.1016/S0895-4356(00)00364-4.CrossRefPubMed Powell H, Lim LL-Y, Heller RF: Accuracy of administrative data to assess comorbidity in patients with heart disease: an Australian perspective. J Clin Epidemiol. 2001, 54: 687-693. 10.1016/S0895-4356(00)00364-4.CrossRefPubMed
36.
go back to reference Hawker GA, Coyte PC, Wright JG, Paul JE, Bombardier C: Accuracy of administrative data for assessing outcomes after knee replacement surgery. J Clin Epidemiol. 1997, 50: 265-273. 10.1016/S0895-4356(96)00368-X.CrossRefPubMed Hawker GA, Coyte PC, Wright JG, Paul JE, Bombardier C: Accuracy of administrative data for assessing outcomes after knee replacement surgery. J Clin Epidemiol. 1997, 50: 265-273. 10.1016/S0895-4356(96)00368-X.CrossRefPubMed
Metadata
Title
Hospital discharge diagnostic and procedure codes for upper gastro-intestinal cancer: how accurate are they?
Authors
Efty Stavrou
Nicole Pesa
Sallie-Anne Pearson
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-331

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue