Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Validation of a case definition to define chronic dialysis using outpatient administrative data

Authors: Fiona M Clement, Matthew T James, Rick Chin, Scott W Klarenbach, Braden J Manns, Robert R Quinn, Pietro Ravani, Marcello Tonelli, Brenda R Hemmelgarn, the Alberta Kidney Disease Network

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Administrative health care databases offer an efficient and accessible, though as-yet unvalidated, approach to studying outcomes of patients with chronic kidney disease and end-stage renal disease (ESRD). The objective of this study is to determine the validity of outpatient physician billing derived algorithms for defining chronic dialysis compared to a reference standard ESRD registry.

Methods

A cohort of incident dialysis patients (Jan. 1 - Dec. 31, 2008) and prevalent chronic dialysis patients (Jan 1, 2008) was selected from a geographically inclusive ESRD registry and administrative database. Four administrative data definitions were considered: at least 1 outpatient claim, at least 2 outpatient claims, at least 2 outpatient claims at least 90 days apart, and continuous outpatient claims at least 90 days apart with no gap in claims greater than 21 days. Measures of agreement of the four administrative data definitions were compared to a reference standard (ESRD registry). Basic patient characteristics are compared between all 5 patient groups.

Results

1,118,097 individuals formed the overall population and 2,227 chronic dialysis patients were included in the ESRD registry. The three definitions requiring at least 2 outpatient claims resulted in kappa statistics between 0.60-0.80 indicating "substantial" agreement. "At least 1 outpatient claim" resulted in "excellent" agreement with a kappa statistic of 0.81.

Conclusions

Of the four definitions, the simplest (at least 1 outpatient claim) performed comparatively to other definitions. The limitations of this work are the billing codes used are developed in Canada, however, other countries use similar billing practices and thus the codes could easily be mapped to other systems. Our reference standard ESRD registry may not capture all dialysis patients resulting in some misclassification. The registry is linked to on-going care so this is likely to be minimal. The definition utilized will vary with the research objective.
Literature
1.
go back to reference Levey A, Atkins R, Coresh J, et al: Chronic kidney disease as a global public health probelm: approaches and initiatives - a position statement from Kidney Disease Improving Global Outcomes. Kidney Int. 2007, 72: 247-59. 10.1038/sj.ki.5002343.CrossRefPubMed Levey A, Atkins R, Coresh J, et al: Chronic kidney disease as a global public health probelm: approaches and initiatives - a position statement from Kidney Disease Improving Global Outcomes. Kidney Int. 2007, 72: 247-59. 10.1038/sj.ki.5002343.CrossRefPubMed
2.
go back to reference National, Kidney, Foundation: K/DOQI clinical practive guidelines for chronic kidney disase: evaluation, classification and stratification. Am J Kidney Dis. 2002, 39: S1-266. 10.1016/S0272-6386(02)70081-4. National, Kidney, Foundation: K/DOQI clinical practive guidelines for chronic kidney disase: evaluation, classification and stratification. Am J Kidney Dis. 2002, 39: S1-266. 10.1016/S0272-6386(02)70081-4.
3.
go back to reference Needham D, Scales D, Laupacis A, Pronovost P: A systematic review of the Charlson comorbidty index using Canadian administrative databases: a perspective on risk adjustment in critical care research. Journal of Critical Care. 2005, 20: 12-9. 10.1016/j.jcrc.2004.09.007.CrossRefPubMed Needham D, Scales D, Laupacis A, Pronovost P: A systematic review of the Charlson comorbidty index using Canadian administrative databases: a perspective on risk adjustment in critical care research. Journal of Critical Care. 2005, 20: 12-9. 10.1016/j.jcrc.2004.09.007.CrossRefPubMed
4.
go back to reference Quan H, Khan N, Hemmelgarn B, Tu K, Chen G, Campbell N, et al: Validation of a case definition to define hypertension using administrative data. Hypertension. 2009, 54: 1423-8. 10.1161/HYPERTENSIONAHA.109.139279.CrossRefPubMed Quan H, Khan N, Hemmelgarn B, Tu K, Chen G, Campbell N, et al: Validation of a case definition to define hypertension using administrative data. Hypertension. 2009, 54: 1423-8. 10.1161/HYPERTENSIONAHA.109.139279.CrossRefPubMed
5.
go back to reference Juurlink D, Preyra C, Croxford R, Chong A, Austin P, Tu J, et al: Canadian Institute for Health Information Discharge Abstract Database: A avlidation Study. Institute for Clinical Evaluative Sciences. 2006 Juurlink D, Preyra C, Croxford R, Chong A, Austin P, Tu J, et al: Canadian Institute for Health Information Discharge Abstract Database: A avlidation Study. Institute for Clinical Evaluative Sciences. 2006
6.
go back to reference Liangos O, Wald R, O'Bell J, Price L, Pereira B, Jaber B: Epidemiology and outcomes of acute renal failure in hospitalized patients: a national survey. Clin J Soc Nephrology. 2006, 1: 43-51. 10.2215/CJN.00220605.CrossRef Liangos O, Wald R, O'Bell J, Price L, Pereira B, Jaber B: Epidemiology and outcomes of acute renal failure in hospitalized patients: a national survey. Clin J Soc Nephrology. 2006, 1: 43-51. 10.2215/CJN.00220605.CrossRef
7.
go back to reference Waikar S, Wald R, Chertow G, Curhan G, Winkelmayer W, Liangos O, et al: Validity of Internatioal Classification of Diseases, Ninth Revision, Clinical Modification Codes for acute renal failure. Journal of the American Society of Nehprology. 2006, 17 (6): 1688-94. 10.1681/ASN.2006010073.CrossRef Waikar S, Wald R, Chertow G, Curhan G, Winkelmayer W, Liangos O, et al: Validity of Internatioal Classification of Diseases, Ninth Revision, Clinical Modification Codes for acute renal failure. Journal of the American Society of Nehprology. 2006, 17 (6): 1688-94. 10.1681/ASN.2006010073.CrossRef
8.
go back to reference Humphries K, Rankin J, Carere R, Buller C, Kiely F, Spinelli J: Comorbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? Journal of Clinical Epidemiology. 2000, 53 (4): 343-9.CrossRefPubMed Humphries K, Rankin J, Carere R, Buller C, Kiely F, Spinelli J: Comorbidity data in outcomes research: are clinical data derived from administrative databases a reliable alternative to chart review? Journal of Clinical Epidemiology. 2000, 53 (4): 343-9.CrossRefPubMed
9.
go back to reference Lee D, Donovan L, Austin P, Gong Y, Liu P, Rouleau J, et al: Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005, 43 (2): 182-8. 10.1097/00005650-200502000-00012.CrossRefPubMed Lee D, Donovan L, Austin P, Gong Y, Liu P, Rouleau J, et al: Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005, 43 (2): 182-8. 10.1097/00005650-200502000-00012.CrossRefPubMed
10.
go back to reference Parker J, Li Z, Damberg C, Danielson B, Carlisle D: Administrative versus clinical data for coronary artery bypass graft surgery reprto cards: the view from California. Med Care. 2006, 44: 687-95. 10.1097/01.mlr.0000215815.70506.b6.CrossRefPubMed Parker J, Li Z, Damberg C, Danielson B, Carlisle D: Administrative versus clinical data for coronary artery bypass graft surgery reprto cards: the view from California. Med Care. 2006, 44: 687-95. 10.1097/01.mlr.0000215815.70506.b6.CrossRefPubMed
11.
go back to reference Quan H, Parsons G, Ghali W: Validity of procedure codes in International Classification of Diseases, 9th Revision, Clinical Modification administrative data. Med Care. 2004, 42 (8): 801-9. 10.1097/01.mlr.0000132391.59713.0d.CrossRefPubMed Quan H, Parsons G, Ghali W: Validity of procedure codes in International Classification of Diseases, 9th Revision, Clinical Modification administrative data. Med Care. 2004, 42 (8): 801-9. 10.1097/01.mlr.0000132391.59713.0d.CrossRefPubMed
12.
go back to reference Romano P, Remy L, Luft H: Second Report of the California Hospital Outcomes Project: Acute Myocaridal Infarction Volume 2: Technical Appendix. 1996, Centre for healthcare Policy and Research California Office of Statewide Health Planning and Development, Chapter 13-15: Romano P, Remy L, Luft H: Second Report of the California Hospital Outcomes Project: Acute Myocaridal Infarction Volume 2: Technical Appendix. 1996, Centre for healthcare Policy and Research California Office of Statewide Health Planning and Development, Chapter 13-15:
13.
go back to reference Winkelmayer W, Schneeweiss S, Mogun H, Patrick A, Avorn J, Solomon D: Identification of individuals with CKD from Medicare claims data: a validation study American Journal of Kidney Diseases. 2005, 46 (2): 225-32. Winkelmayer W, Schneeweiss S, Mogun H, Patrick A, Avorn J, Solomon D: Identification of individuals with CKD from Medicare claims data: a validation study American Journal of Kidney Diseases. 2005, 46 (2): 225-32.
14.
go back to reference Weintraub W, Deaton C, Shaw L, Mahoney E, Morris D, Saunders C, et al: Can Cardiovascular clinical characteristics be identified and outcome models be developed from an in-patient claims database?. Am J Cardiol. 1999, 84: 166-9. 10.1016/S0002-9149(99)00228-3.CrossRefPubMed Weintraub W, Deaton C, Shaw L, Mahoney E, Morris D, Saunders C, et al: Can Cardiovascular clinical characteristics be identified and outcome models be developed from an in-patient claims database?. Am J Cardiol. 1999, 84: 166-9. 10.1016/S0002-9149(99)00228-3.CrossRefPubMed
15.
go back to reference Wilchesky M, Tamblyn R, A H: Validation of diagnostic codes within medical services claims. Journal of Clinical Epidemiology. 2004, 57 (2): 131-41. 10.1016/S0895-4356(03)00246-4.CrossRefPubMed Wilchesky M, Tamblyn R, A H: Validation of diagnostic codes within medical services claims. Journal of Clinical Epidemiology. 2004, 57 (2): 131-41. 10.1016/S0895-4356(03)00246-4.CrossRefPubMed
16.
go back to reference Hemmelgarn B, Clement F, Manns B, Klarenbach S, James M, Ravani P, et al: Overview of the Alberta Kidney Disease Network. BMC Nephrology. 2009, 10 (30): Hemmelgarn B, Clement F, Manns B, Klarenbach S, James M, Ravani P, et al: Overview of the Alberta Kidney Disease Network. BMC Nephrology. 2009, 10 (30):
17.
go back to reference Manns B, Mortis G, Taub K, McLaughlin K, Donaldson C, Ghali W: The Southern Alberta Renal Program database: a protoype for patient management and research initiatives. Clin Invest Med. 2001, 24 (4): 164-70.PubMed Manns B, Mortis G, Taub K, McLaughlin K, Donaldson C, Ghali W: The Southern Alberta Renal Program database: a protoype for patient management and research initiatives. Clin Invest Med. 2001, 24 (4): 164-70.PubMed
18.
go back to reference Statistics, Canada: Canadian Classification of Diagnostic, Therapeutic and Surgical Procedures. 1986, Statistics Canada Ottawa Canada Statistics, Canada: Canadian Classification of Diagnostic, Therapeutic and Surgical Procedures. 1986, Statistics Canada Ottawa Canada
19.
go back to reference Lok C, Oliver M, Rothwell D, Hux J: The growing volume of diabetes-related dialysis: a population-based study. Nephrol Dial Transplant. 2004, 19: 3098-103. 10.1093/ndt/gfh540.CrossRefPubMed Lok C, Oliver M, Rothwell D, Hux J: The growing volume of diabetes-related dialysis: a population-based study. Nephrol Dial Transplant. 2004, 19: 3098-103. 10.1093/ndt/gfh540.CrossRefPubMed
20.
go back to reference National, Institutes, of, Health, National, Institutes, of Diabetes and Digestive and Kidney Disease, Division, of Kidney, Urologic and Hematologic Diseases: United States Renal Data System: Researcher's Guide to using the USRDS Database. 2009, Bethesda, MD National, Institutes, of, Health, National, Institutes, of Diabetes and Digestive and Kidney Disease, Division, of Kidney, Urologic and Hematologic Diseases: United States Renal Data System: Researcher's Guide to using the USRDS Database. 2009, Bethesda, MD
21.
go back to reference Hux J, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: Determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25: 512-6. 10.2337/diacare.25.3.512.CrossRefPubMed Hux J, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: Determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25: 512-6. 10.2337/diacare.25.3.512.CrossRefPubMed
22.
go back to reference Quan H, Li B, Saunders D, Parsons G, Nilsson C, Alibhai A, et al: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Services Research. 2008, 43 (4): 1424-41. 10.1111/j.1475-6773.2007.00822.x.CrossRefPubMedPubMedCentral Quan H, Li B, Saunders D, Parsons G, Nilsson C, Alibhai A, et al: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Services Research. 2008, 43 (4): 1424-41. 10.1111/j.1475-6773.2007.00822.x.CrossRefPubMedPubMedCentral
23.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J, et al: Coding algorithms for defining comorbidities in ICD-9CM and ICD-10 administrative data. Med Care. 2005, 43 (11): 1130-9. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J, et al: Coding algorithms for defining comorbidities in ICD-9CM and ICD-10 administrative data. Med Care. 2005, 43 (11): 1130-9. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed
24.
go back to reference Chen G, Faris P, Hemmelgarn B, Walker R, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Medical Research Methodology. 2009, 9 (5): Chen G, Faris P, Hemmelgarn B, Walker R, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Medical Research Methodology. 2009, 9 (5):
25.
go back to reference Kundel H, Polansky M: Measurement of observer agreement. Radiology. 2003, 228: 303-8. 10.1148/radiol.2282011860.CrossRefPubMed Kundel H, Polansky M: Measurement of observer agreement. Radiology. 2003, 228: 303-8. 10.1148/radiol.2282011860.CrossRefPubMed
26.
go back to reference Landis R, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-74. 10.2307/2529310.CrossRefPubMed Landis R, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-74. 10.2307/2529310.CrossRefPubMed
27.
go back to reference Alberta, Health and Wellness: Report on the health of Albertans. 2006, Edmonton: Alberta Health and Wellness Alberta, Health and Wellness: Report on the health of Albertans. 2006, Edmonton: Alberta Health and Wellness
28.
go back to reference Kern E, Maney M, Miller D, Tseng C, Tiwari A, Rajan M, et al: Failure of ICD-9-CM codes to identify patients with comorbid kidney disease in diabetes. Health Services Research. 2006, 41 (2): 564-80. 10.1111/j.1475-6773.2005.00482.x.CrossRefPubMedPubMedCentral Kern E, Maney M, Miller D, Tseng C, Tiwari A, Rajan M, et al: Failure of ICD-9-CM codes to identify patients with comorbid kidney disease in diabetes. Health Services Research. 2006, 41 (2): 564-80. 10.1111/j.1475-6773.2005.00482.x.CrossRefPubMedPubMedCentral
29.
go back to reference Quinn RRLA, Austin PC, Hux JE, Garg AX, Hemmelgarn BR, Oliver MJ: Using administrative datasets to study outcomes in dialysis patients: a validation study. Med Care. 2010, 48 (8): 745-50. 10.1097/MLR.0b013e3181e419fd.CrossRefPubMed Quinn RRLA, Austin PC, Hux JE, Garg AX, Hemmelgarn BR, Oliver MJ: Using administrative datasets to study outcomes in dialysis patients: a validation study. Med Care. 2010, 48 (8): 745-50. 10.1097/MLR.0b013e3181e419fd.CrossRefPubMed
Metadata
Title
Validation of a case definition to define chronic dialysis using outpatient administrative data
Authors
Fiona M Clement
Matthew T James
Rick Chin
Scott W Klarenbach
Braden J Manns
Robert R Quinn
Pietro Ravani
Marcello Tonelli
Brenda R Hemmelgarn
the Alberta Kidney Disease Network
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-25

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue