Skip to main content
Top
Published in: Journal of Foot and Ankle Research 1/2010

Open Access 01-12-2010 | Research

Diagnostic accuracy of existing methods for identifying diabetic foot ulcers from inpatient and outpatient datasets

Authors: Min-Woong Sohn, Elly Budiman-Mak, Rodney M Stuck, Farah Siddiqui, Todd A Lee

Published in: Journal of Foot and Ankle Research | Issue 1/2010

Login to get access

Abstract

Background

As the number of persons with diabetes is projected to double in the next 25 years in the US, an accurate method of identifying diabetic foot ulcers in population-based data sources are ever more important for disease surveillance and public health purposes. The objectives of this study are to evaluate the accuracy of existing methods and to propose a new method.

Methods

Four existing methods were used to identify all patients diagnosed with a foot ulcer in a Department of Veterans Affairs (VA) hospital from the inpatient and outpatient datasets for 2003. Their electronic medical records were reviewed to verify whether the medical records positively indicate presence of a diabetic foot ulcer in diagnoses, medical assessments, or consults. For each method, five measures of accuracy and agreement were evaluated using data from medical records as the gold standard.

Results

Our medical record reviews show that all methods had sensitivity > 92% but their specificity varied substantially between 74% and 91%. A method used in Harrington et al. (2004) was the most accurate with 94% sensitivity and 91% specificity and produced an annual prevalence of 3.3% among VA users with diabetes nationwide. A new and simpler method consisting of two codes (707.1× and 707.9) shows an equally good accuracy with 93% sensitivity and 91% specificity and 3.1% prevalence.

Conclusions

Our results indicate that the Harrington and New methods are highly comparable and accurate. We recommend the Harrington method for its accuracy and the New method for its simplicity and comparable accuracy.
Literature
1.
go back to reference Harrington C, Zagari MJ, Corea J, Klitenic J: A cost analysis of diabetic lower-extremity ulcers. Diabetes Care. 2000, 23: 1333-1338. 10.2337/diacare.23.9.1333.PubMed Harrington C, Zagari MJ, Corea J, Klitenic J: A cost analysis of diabetic lower-extremity ulcers. Diabetes Care. 2000, 23: 1333-1338. 10.2337/diacare.23.9.1333.PubMed
2.
go back to reference Holzer SE, Camerota A, Martens L, Cuerdon T, Crystal-Peters J, Zagari M: Costs and duration of care for lower extremity ulcers in patients with diabetes. Clin Ther. 1998, 20: 169-181. 10.1016/S0149-2918(98)80044-1.PubMed Holzer SE, Camerota A, Martens L, Cuerdon T, Crystal-Peters J, Zagari M: Costs and duration of care for lower extremity ulcers in patients with diabetes. Clin Ther. 1998, 20: 169-181. 10.1016/S0149-2918(98)80044-1.PubMed
3.
go back to reference Ramsey SD, Newton K, Blough D, McCulloch DK, Sandhu N, Reiber GE, Wagner EH: Incidence, outcomes, and cost of foot ulcers in patients with diabetes. Diabetes Care. 1999, 22: 382-387. 10.2337/diacare.22.3.382.PubMed Ramsey SD, Newton K, Blough D, McCulloch DK, Sandhu N, Reiber GE, Wagner EH: Incidence, outcomes, and cost of foot ulcers in patients with diabetes. Diabetes Care. 1999, 22: 382-387. 10.2337/diacare.22.3.382.PubMed
4.
go back to reference Ramsey SD, Newton K, Blough D, McCulloch DK, Sandhu N, Wagner EH: Patient-level estimates of the cost of complications in diabetes in a managed-care population. Pharmacoeconomics. 1999, 16: 285-295. 10.2165/00019053-199916030-00005.PubMed Ramsey SD, Newton K, Blough D, McCulloch DK, Sandhu N, Wagner EH: Patient-level estimates of the cost of complications in diabetes in a managed-care population. Pharmacoeconomics. 1999, 16: 285-295. 10.2165/00019053-199916030-00005.PubMed
5.
go back to reference Nabuurs-Franssen MH, Huijberts MS, Nieuwenhuijzen Kruseman AC, Willems J, Schaper NC: Health-related quality of life of diabetic foot ulcer patients and their caregivers. Diabetologia. 2005, 48: 1906-1910. 10.1007/s00125-005-1856-6.PubMed Nabuurs-Franssen MH, Huijberts MS, Nieuwenhuijzen Kruseman AC, Willems J, Schaper NC: Health-related quality of life of diabetic foot ulcer patients and their caregivers. Diabetologia. 2005, 48: 1906-1910. 10.1007/s00125-005-1856-6.PubMed
6.
go back to reference Armstrong DG, Lavery LA, Wrobel JS, Vileikyte L: Quality of life in healing diabetic wounds: does the end justify the means?. J Foot Ankle Surg. 2008, 47: 278-282. 10.1053/j.jfas.2008.02.015.PubMed Armstrong DG, Lavery LA, Wrobel JS, Vileikyte L: Quality of life in healing diabetic wounds: does the end justify the means?. J Foot Ankle Surg. 2008, 47: 278-282. 10.1053/j.jfas.2008.02.015.PubMed
7.
go back to reference Adler AI, Boyko EJ, Ahroni JH, Smith DG: Lower-extremity amputation in diabetes. The independent effects of peripheral vascular disease, sensory neuropathy, and foot ulcers. Diabetes Care. 1999, 22: 1029-1035. 10.2337/diacare.22.7.1029.PubMed Adler AI, Boyko EJ, Ahroni JH, Smith DG: Lower-extremity amputation in diabetes. The independent effects of peripheral vascular disease, sensory neuropathy, and foot ulcers. Diabetes Care. 1999, 22: 1029-1035. 10.2337/diacare.22.7.1029.PubMed
8.
go back to reference Mayfield JA, Reiber GE, Maynard C, Czerniecki JM, Caps MT, Sangeorzan BJ: Trends in lower limb amputation in the Veterans Health Administration, 1989-1998. J Rehabil Res Dev. 2000, 37: 23-30.PubMed Mayfield JA, Reiber GE, Maynard C, Czerniecki JM, Caps MT, Sangeorzan BJ: Trends in lower limb amputation in the Veterans Health Administration, 1989-1998. J Rehabil Res Dev. 2000, 37: 23-30.PubMed
9.
go back to reference Boyko EJ, Ahroni JH, Smith DG, Davignon D: Increased mortality associated with diabetic foot ulcer. Diabet Med. 1996, 13: 967-972. 10.1002/(SICI)1096-9136(199611)13:11<967::AID-DIA266>3.0.CO;2-K.PubMed Boyko EJ, Ahroni JH, Smith DG, Davignon D: Increased mortality associated with diabetic foot ulcer. Diabet Med. 1996, 13: 967-972. 10.1002/(SICI)1096-9136(199611)13:11<967::AID-DIA266>3.0.CO;2-K.PubMed
10.
go back to reference Moulik PK, Mtonga R, Gill GV: Amputation and mortality in new-onset diabetic foot ulcers stratified by etiology. Diabetes Care. 2003, 26: 491-494. 10.2337/diacare.26.2.491.PubMed Moulik PK, Mtonga R, Gill GV: Amputation and mortality in new-onset diabetic foot ulcers stratified by etiology. Diabetes Care. 2003, 26: 491-494. 10.2337/diacare.26.2.491.PubMed
11.
go back to reference Singh N, Armstrong DG, Lipsky BA: Preventing foot ulcers in patients with diabetes. JAMA. 2005, 293: 217-228. 10.1001/jama.293.2.217.PubMed Singh N, Armstrong DG, Lipsky BA: Preventing foot ulcers in patients with diabetes. JAMA. 2005, 293: 217-228. 10.1001/jama.293.2.217.PubMed
12.
go back to reference Lavery LA, Armstrong DG, Wunderlich RP, Tredwell J, Boulton AJ: Diabetic foot syndrome: evaluating the prevalence and incidence of foot pathology in Mexican Americans and non-Hispanic whites from a diabetes disease management cohort. Diabetes Care. 2003, 26: 1435-1438. 10.2337/diacare.26.5.1435.PubMed Lavery LA, Armstrong DG, Wunderlich RP, Tredwell J, Boulton AJ: Diabetic foot syndrome: evaluating the prevalence and incidence of foot pathology in Mexican Americans and non-Hispanic whites from a diabetes disease management cohort. Diabetes Care. 2003, 26: 1435-1438. 10.2337/diacare.26.5.1435.PubMed
13.
go back to reference Singh N, Armstrong DG, Lipsky BA: Preventing foot ulcers in patients with diabetes. JAMA. 2005, 293: 217-228. 10.1001/jama.293.2.217.PubMed Singh N, Armstrong DG, Lipsky BA: Preventing foot ulcers in patients with diabetes. JAMA. 2005, 293: 217-228. 10.1001/jama.293.2.217.PubMed
14.
go back to reference Mayfield JA, Reiber GE, Maynard C, Czerniecki J, Sangeorzan B: The epidemiology of lower-extremity disease in veterans with diabetes. Diabetes Care. 2004, 27 (Suppl 2): B39-B44. 10.2337/diacare.27.suppl_2.B39.PubMed Mayfield JA, Reiber GE, Maynard C, Czerniecki J, Sangeorzan B: The epidemiology of lower-extremity disease in veterans with diabetes. Diabetes Care. 2004, 27 (Suppl 2): B39-B44. 10.2337/diacare.27.suppl_2.B39.PubMed
15.
go back to reference Newton KM, Wagner EH, Ramsey SD, McCulloch D, Evans R, Sandhu N, Davis C: The use of automated data to identify complications and comorbidities of diabetes: a validation study. J Clin Epidemiol. 1999, 52: 199-207. 10.1016/S0895-4356(98)00161-9.PubMed Newton KM, Wagner EH, Ramsey SD, McCulloch D, Evans R, Sandhu N, Davis C: The use of automated data to identify complications and comorbidities of diabetes: a validation study. J Clin Epidemiol. 1999, 52: 199-207. 10.1016/S0895-4356(98)00161-9.PubMed
16.
go back to reference Miller DR, Safford MM, Pogach LM: Who has diabetes? Best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004, 27 (Suppl 2): B10-B21. 10.2337/diacare.27.suppl_2.B10.PubMed Miller DR, Safford MM, Pogach LM: Who has diabetes? Best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004, 27 (Suppl 2): B10-B21. 10.2337/diacare.27.suppl_2.B10.PubMed
18.
go back to reference Craig BM, Adams AK: Accuracy of body mass index categories based on self-reported height and weight among women in the United States. Matern Child Health J. 2009, 13: 489-496. 10.1007/s10995-008-0384-7.PubMed Craig BM, Adams AK: Accuracy of body mass index categories based on self-reported height and weight among women in the United States. Matern Child Health J. 2009, 13: 489-496. 10.1007/s10995-008-0384-7.PubMed
19.
go back to reference Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009, 9: 5-10.1186/1471-2288-9-5.PubMedPubMedCentral Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009, 9: 5-10.1186/1471-2288-9-5.PubMedPubMedCentral
20.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.PubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.PubMed
21.
go back to reference Harwell TS, Gilman J, Dehart L, Loran E, Eyler N, Schrumpf P, Corsi CM, McDowall JM, Johnson EA, Ford JA, et al: Validation of a case definition for foot complications among hospitalized patients with diabetes. Diabetes Care. 2002, 25: 630-631. 10.2337/diacare.25.3.630.PubMed Harwell TS, Gilman J, Dehart L, Loran E, Eyler N, Schrumpf P, Corsi CM, McDowall JM, Johnson EA, Ford JA, et al: Validation of a case definition for foot complications among hospitalized patients with diabetes. Diabetes Care. 2002, 25: 630-631. 10.2337/diacare.25.3.630.PubMed
Metadata
Title
Diagnostic accuracy of existing methods for identifying diabetic foot ulcers from inpatient and outpatient datasets
Authors
Min-Woong Sohn
Elly Budiman-Mak
Rodney M Stuck
Farah Siddiqui
Todd A Lee
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Journal of Foot and Ankle Research / Issue 1/2010
Electronic ISSN: 1757-1146
DOI
https://doi.org/10.1186/1757-1146-3-27

Other articles of this Issue 1/2010

Journal of Foot and Ankle Research 1/2010 Go to the issue