Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

Validity of type 2 diabetes diagnosis in a population-based electronic health record database

Authors: Conchi Moreno-Iribas, Carmen Sayon-Orea, Josu Delfrade, Eva Ardanaz, Javier Gorricho, Rosana Burgui, Marian Nuin, Marcela Guevara

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

The increasing burden of type 2 diabetes mellitus makes the continuous surveillance of its prevalence and incidence advisable. Electronic health records (EHRs) have great potential for research and surveillance purposes; however the quality of their data must first be evaluated for fitness for use. The aim of this study was to assess the validity of type 2 diabetes diagnosis in a primary care EHR database covering more than half a million inhabitants, 97% of the population in Navarra, Spain.

Methods

In the Navarra EPIC-InterAct study, the validity of the T90 code from the International Classification of Primary Care, Second Edition was studied in a primary care EHR database to identify incident cases of type 2 diabetes, using a multi-source approach as the gold standard. The sensitivity, specificity, positive predictive value, negative predictive value and the kappa index were calculated. Additionally, type 2 diabetes prevalence from the EHR database was compared with estimations from a health survey.

Results

The sensitivity, specificity, positive predictive value and negative predictive value of incident type 2 diabetes recorded in the EHRs were 98.2, 99.3, 92.2 and 99.8%, respectively, and the kappa index was 0.946. Overall prevalence of type 2 diabetes diagnosed in the EHRs among adults (35–84 years of age) was 7.2% (95% confidence interval [CI] 7.2–7.3) in men and 5.9% (95% CI 5.8–5.9) in women, which was similar to the prevalence estimated from the health survey: 8.5% (95% CI 7.1–9.8) and 5.5% (95% CI 4.4–6.6) in men and women, respectively.

Conclusions

The high sensitivity and specificity of type 2 diabetes diagnosis found in the primary care EHRs make this database a good source for population-based surveillance of incident and prevalent type 2 diabetes, as well as for monitoring quality of care and health outcomes in diabetic patients.
Literature
2.
go back to reference Emerging Risk Factors Collaboration, Seshasai SR, Kaptoge S, Thompson A, Di Angelantonio E, Gao P, Sarwar N, Whincup PH, Mukamal KJ, Gillum RF, Holme I, Njølstad I, Fletcher A, Nilsson P, Lewington S, Collins R, Gudnason V, Thompson SG, Sattar N, Selvin E, Hu FB, Danesh J. Diabetes mellitus, fasting glucose, and risk of cause-specific death. N Engl J Med. 2011;364:829–41.CrossRef Emerging Risk Factors Collaboration, Seshasai SR, Kaptoge S, Thompson A, Di Angelantonio E, Gao P, Sarwar N, Whincup PH, Mukamal KJ, Gillum RF, Holme I, Njølstad I, Fletcher A, Nilsson P, Lewington S, Collins R, Gudnason V, Thompson SG, Sattar N, Selvin E, Hu FB, Danesh J. Diabetes mellitus, fasting glucose, and risk of cause-specific death. N Engl J Med. 2011;364:829–41.CrossRef
3.
go back to reference Baena-Díez JM, Peñafiel J, Subirana I, Ramos R, Elosua R, Marín-Ibañez A, Guembe MJ, Rigo F, Tormo-Díaz MJ, Moreno-Iribas C, Cabré JJ, Segura A, García-Lareo M, Gómez De La Cámara A, Lapetra J, Quesada M, Marrugat J, Medrano MJ, Berjón J, Frontera G, Gavrila D, Barricarte A, Basora J, García JM, Pavone NC, Lora-Pablos D, Mayoral E, Franch J, Mata M, Castell C, Frances A, Grau M, FRESCO Investigators. Diabetes Care. 2016;39:1987–95.CrossRefPubMed Baena-Díez JM, Peñafiel J, Subirana I, Ramos R, Elosua R, Marín-Ibañez A, Guembe MJ, Rigo F, Tormo-Díaz MJ, Moreno-Iribas C, Cabré JJ, Segura A, García-Lareo M, Gómez De La Cámara A, Lapetra J, Quesada M, Marrugat J, Medrano MJ, Berjón J, Frontera G, Gavrila D, Barricarte A, Basora J, García JM, Pavone NC, Lora-Pablos D, Mayoral E, Franch J, Mata M, Castell C, Frances A, Grau M, FRESCO Investigators. Diabetes Care. 2016;39:1987–95.CrossRefPubMed
4.
go back to reference Emerging Risk Factors Collaboration, Sarwar N, Gao P, Seshasai SR, Gobin R, Kaptoge S, Di Angelantonio E, Ingelsson E, Lawlor DA, Selvin E, Stampfer M, Stehouwer CD, Lewington S, Pennells L, Thompson A, Sattar N, White IR, Ray KK, Danesh J. Diabetes mellitus, fasting blood glucose concentration, and risk of vascular disease: a collaborative meta-analysis of 102 prospective studies. Lancet. 2010;375:2215–22.CrossRef Emerging Risk Factors Collaboration, Sarwar N, Gao P, Seshasai SR, Gobin R, Kaptoge S, Di Angelantonio E, Ingelsson E, Lawlor DA, Selvin E, Stampfer M, Stehouwer CD, Lewington S, Pennells L, Thompson A, Sattar N, White IR, Ray KK, Danesh J. Diabetes mellitus, fasting blood glucose concentration, and risk of vascular disease: a collaborative meta-analysis of 102 prospective studies. Lancet. 2010;375:2215–22.CrossRef
6.
go back to reference Guttmann A, Nakhla M, Henderson M, To T, Daneman D, Cauch-Dudek K, Wang X, Lam K, Hux J. Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes. 2010;11:122–8.CrossRefPubMed Guttmann A, Nakhla M, Henderson M, To T, Daneman D, Cauch-Dudek K, Wang X, Lam K, Hux J. Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes. 2010;11:122–8.CrossRefPubMed
7.
go back to reference Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA. Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011;28:424–7.CrossRefPubMed Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA. Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011;28:424–7.CrossRefPubMed
8.
go back to reference Chen G, Khan N, Walker R, Quan H. Validating ICD coding algorithms for diabetes mellitus from administrative data. Diabetes Res Clin Pract. 2010;89:189–95.CrossRefPubMed Chen G, Khan N, Walker R, Quan H. Validating ICD coding algorithms for diabetes mellitus from administrative data. Diabetes Res Clin Pract. 2010;89:189–95.CrossRefPubMed
9.
go back to reference Hux JE, Ivis F, Flintoft V, Bica A. Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;3:512–6.CrossRef Hux JE, Ivis F, Flintoft V, Bica A. Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;3:512–6.CrossRef
10.
go back to reference Dart AB, Martens PJ, Sellers E, Brownell MD, Rigatto C, Dean HJ. Validation of a Pediatric Diabetes Case Definition Using Administrative Health Data in Manitoba, Canada. Diabetes Care. 2011;34:898–903.CrossRefPubMedPubMedCentral Dart AB, Martens PJ, Sellers E, Brownell MD, Rigatto C, Dean HJ. Validation of a Pediatric Diabetes Case Definition Using Administrative Health Data in Manitoba, Canada. Diabetes Care. 2011;34:898–903.CrossRefPubMedPubMedCentral
11.
go back to reference Khan NF, Harrison SE, Rose PW. Validity of diagnostic coding within the General Practice Research Database: a systematic review. Br J Gen Pract. 2010;60:128–36. Khan NF, Harrison SE, Rose PW. Validity of diagnostic coding within the General Practice Research Database: a systematic review. Br J Gen Pract. 2010;60:128–36.
12.
go back to reference Gil Montalbán E, Ortiz Marrín H, López-Gay Lucio-Villegas D, Zorrilla Torres B, Arrieta Blanco F, Nogales Aguado P. Validity and concordance of electronic health records in primary care (AP-Madrid) for surveillance of diabetes mellitus. PREDIMERC study. Gac Sanit. 2014;28:393–6.CrossRefPubMed Gil Montalbán E, Ortiz Marrín H, López-Gay Lucio-Villegas D, Zorrilla Torres B, Arrieta Blanco F, Nogales Aguado P. Validity and concordance of electronic health records in primary care (AP-Madrid) for surveillance of diabetes mellitus. PREDIMERC study. Gac Sanit. 2014;28:393–6.CrossRefPubMed
13.
go back to reference Ramos R, Balló E, Marrugat J, Elosua R, Sala J, Grau M, Vila J, Bolíbar B, García-Gil M, Martí R, Fina F, Hermosilla E, Rosell M, Muñoz MA, Prieto-Alhambra D, Quesada M. Validity for use in research on vascular diseases of the SIDIAP (Information System for the Development of Research in Primary Care): the EMMA study. Rev Esp Cardiol. 2012;65:29–37.CrossRefPubMed Ramos R, Balló E, Marrugat J, Elosua R, Sala J, Grau M, Vila J, Bolíbar B, García-Gil M, Martí R, Fina F, Hermosilla E, Rosell M, Muñoz MA, Prieto-Alhambra D, Quesada M. Validity for use in research on vascular diseases of the SIDIAP (Information System for the Development of Research in Primary Care): the EMMA study. Rev Esp Cardiol. 2012;65:29–37.CrossRefPubMed
14.
go back to reference De Burgos-Lunar C, Salinero-Fort MA, Cárdenas-Valladolid J, Soto-Díaz S, Fuentes-Rodríguez CY, Abánades-Herranz JC, del Cura-González I. Validation of diabetes mellitus and hypertension diagnosis in computerized medical records in primary health care. BMC Med Res Methodol. 2011;11:146.CrossRefPubMedPubMedCentral De Burgos-Lunar C, Salinero-Fort MA, Cárdenas-Valladolid J, Soto-Díaz S, Fuentes-Rodríguez CY, Abánades-Herranz JC, del Cura-González I. Validation of diabetes mellitus and hypertension diagnosis in computerized medical records in primary health care. BMC Med Res Methodol. 2011;11:146.CrossRefPubMedPubMedCentral
15.
go back to reference Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013;20:144–51.CrossRefPubMedPubMedCentral Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013;20:144–51.CrossRefPubMedPubMedCentral
16.
go back to reference Woodward M. Use of national data sources in diabetes epidemiology. Lancet Diabetes Endocrinol. 2015;3:92–3.CrossRefPubMed Woodward M. Use of national data sources in diabetes epidemiology. Lancet Diabetes Endocrinol. 2015;3:92–3.CrossRefPubMed
17.
go back to reference Stacks consulting e ingeniería en software. OMI-AP Módulo Historia Clínica. 2006. Stacks consulting e ingeniería en software. OMI-AP Módulo Historia Clínica. 2006.
18.
go back to reference WONCA International Classification Committee. [ICPC-2. International Classification of Primary Care]. Second Edition. Barcelona: Masson; 1999. WONCA International Classification Committee. [ICPC-2. International Classification of Primary Care]. Second Edition. Barcelona: Masson; 1999.
19.
go back to reference InterAct Consortium, Langenberg C, Sharp S, Forouhi NG, Franks PW, Schulze MB, Kerrison N, Ekelund U, Barroso I, Panico S, Tormo MJ, Spranger J, Griffin S, van der Schouw YT, Amiano P, Ardanaz E, Arriola L, Balkau B, Barricarte A, Beulens JW, Boeing H, Bueno-De-Mesquita HB, Buijsse B, Chirlaque Lopez MD, Clavel-Chapelon F, Crowe FL, de Lauzon-Guillan B, Deloukas P, Dorronsoro M, Drogan D, Froguel P, Gonzalez C, Grioni S, Groop L, Groves C, Hainaut P, Halkjaer J, Hallmans G, Hansen T, Huerta Castaño JM, Kaaks R, Key TJ, Khaw KT, Koulman A, Mattiello A, Navarro C, Nilsson P, Norat T, Overvad K, Palla L, Palli D, Pedersen O, Peeters PH, Quirós JR, Ramachandran A, Rodriguez-Suarez L, Rolandsson O, Romaguera D, Romieu I, Sacerdote C, Sánchez MJ, Sandbaek A, Slimani N, Sluijs I, Spijkerman AM, Teucher B, Tjonneland A, Tumino R, van der A DL, Verschuren WM, Tuomilehto J, Feskens E, McCarthy M, Riboli E, Wareham NJ. Design and cohort description of the InterAct Project: an examination of the interaction of genetic and lifestyle factors on the incidence of type 2 diabetes in the EPIC Study. Diabetologia. 2011;54:2272–82.CrossRef InterAct Consortium, Langenberg C, Sharp S, Forouhi NG, Franks PW, Schulze MB, Kerrison N, Ekelund U, Barroso I, Panico S, Tormo MJ, Spranger J, Griffin S, van der Schouw YT, Amiano P, Ardanaz E, Arriola L, Balkau B, Barricarte A, Beulens JW, Boeing H, Bueno-De-Mesquita HB, Buijsse B, Chirlaque Lopez MD, Clavel-Chapelon F, Crowe FL, de Lauzon-Guillan B, Deloukas P, Dorronsoro M, Drogan D, Froguel P, Gonzalez C, Grioni S, Groop L, Groves C, Hainaut P, Halkjaer J, Hallmans G, Hansen T, Huerta Castaño JM, Kaaks R, Key TJ, Khaw KT, Koulman A, Mattiello A, Navarro C, Nilsson P, Norat T, Overvad K, Palla L, Palli D, Pedersen O, Peeters PH, Quirós JR, Ramachandran A, Rodriguez-Suarez L, Rolandsson O, Romaguera D, Romieu I, Sacerdote C, Sánchez MJ, Sandbaek A, Slimani N, Sluijs I, Spijkerman AM, Teucher B, Tjonneland A, Tumino R, van der A DL, Verschuren WM, Tuomilehto J, Feskens E, McCarthy M, Riboli E, Wareham NJ. Design and cohort description of the InterAct Project: an examination of the interaction of genetic and lifestyle factors on the incidence of type 2 diabetes in the EPIC Study. Diabetologia. 2011;54:2272–82.CrossRef
20.
go back to reference Riboli E, Hunt KJ, Slimani N, Ferrari P, Norat T, Fahey M, Charrondière UR, Hémon B, Casagrande C, Vignat J, Overvad K, Tjønneland A, Clavel-Chapelon F, Thiébaut A, Wahrendorf J, Boeing H, Trichopoulos D, Trichopoulou A, Vineis P, Palli D, Bueno-De-Mesquita HB, Peeters PH, Lund E, Engeset D, González CA, Barricarte A, Berglund G, Hallmans G, Day NE, Key TJ, Kaaks R, Saracci R. European Prospective Investigation into Cancer and Nutrition (EPIC): study populations and data collection. Public Health Nutr. 2002;5:1113–24.CrossRefPubMed Riboli E, Hunt KJ, Slimani N, Ferrari P, Norat T, Fahey M, Charrondière UR, Hémon B, Casagrande C, Vignat J, Overvad K, Tjønneland A, Clavel-Chapelon F, Thiébaut A, Wahrendorf J, Boeing H, Trichopoulos D, Trichopoulou A, Vineis P, Palli D, Bueno-De-Mesquita HB, Peeters PH, Lund E, Engeset D, González CA, Barricarte A, Berglund G, Hallmans G, Day NE, Key TJ, Kaaks R, Saracci R. European Prospective Investigation into Cancer and Nutrition (EPIC): study populations and data collection. Public Health Nutr. 2002;5:1113–24.CrossRefPubMed
21.
go back to reference Riboli E, Kaaks R. The EPIC Project: rationale and study design. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol. 1997;26 Suppl 1:S6–S14.CrossRefPubMed Riboli E, Kaaks R. The EPIC Project: rationale and study design. European Prospective Investigation into Cancer and Nutrition. Int J Epidemiol. 1997;26 Suppl 1:S6–S14.CrossRefPubMed
22.
go back to reference Expert Committee on the Diagnosis and Classification of Diabetes Mellitus. Report of the expert committee on the diagnosis and classification of diabetes mellitus. Diabetes Care. 2003;26 Suppl 1:5–20. Expert Committee on the Diagnosis and Classification of Diabetes Mellitus. Report of the expert committee on the diagnosis and classification of diabetes mellitus. Diabetes Care. 2003;26 Suppl 1:5–20.
23.
go back to reference Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ. Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010;69:4–14.CrossRefPubMedPubMedCentral Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ. Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010;69:4–14.CrossRefPubMedPubMedCentral
24.
go back to reference Viñes JJ, Díez J, Guembe MJ, González P, Amézqueta C, Barba J, Sobejano I, Martínez-Vila E, Grijalba AM, Serrano M, Moreno C, Los-Arcos E, Guerrero D. Study of vascular risk in Navarre: objectives and design. Prevalence of metabolic syndrome and of vascular risk. An Sist Sanit Navar. 2007;30:113–24.PubMed Viñes JJ, Díez J, Guembe MJ, González P, Amézqueta C, Barba J, Sobejano I, Martínez-Vila E, Grijalba AM, Serrano M, Moreno C, Los-Arcos E, Guerrero D. Study of vascular risk in Navarre: objectives and design. Prevalence of metabolic syndrome and of vascular risk. An Sist Sanit Navar. 2007;30:113–24.PubMed
25.
go back to reference Zgibor JC, Orchard TJ, Saul M, Piatt G, Ruppert K, Stewart A, Siminerio LM. Developing and validating a diabetes database in a large health system. Diabetes Res Clin Pract. 2007;75:313–9.CrossRefPubMed Zgibor JC, Orchard TJ, Saul M, Piatt G, Ruppert K, Stewart A, Siminerio LM. Developing and validating a diabetes database in a large health system. Diabetes Res Clin Pract. 2007;75:313–9.CrossRefPubMed
26.
go back to reference Saydah SH, Geiss LS, Tierney E, Benjamin SM, Engelgau M, Brancati F. Review of the performance of methods to identify diabetes cases among vital statistics, administrative, and survey data. Ann Epidemiol. 2004;14:507–16.CrossRefPubMed Saydah SH, Geiss LS, Tierney E, Benjamin SM, Engelgau M, Brancati F. Review of the performance of methods to identify diabetes cases among vital statistics, administrative, and survey data. Ann Epidemiol. 2004;14:507–16.CrossRefPubMed
27.
go back to reference Basterra-Gortari FJ, Bes-Rastrollo M, Ruiz-Canela M, Gea A, Martinez-Gonzalez MA. Prevalence of obesity and diabetes in Spanish adults 1987–2012. Med Clin. 2017;148:250–6.CrossRef Basterra-Gortari FJ, Bes-Rastrollo M, Ruiz-Canela M, Gea A, Martinez-Gonzalez MA. Prevalence of obesity and diabetes in Spanish adults 1987–2012. Med Clin. 2017;148:250–6.CrossRef
28.
go back to reference Mata-Cases M, Mauricio D, Real J, Bolíbar B, Franch-Nadal J. Is diabetes mellitus correctly registered and classified in primary care? A population-based study in Catalonia, Spain. Endocrinol y Nutr. 2016;63:440–8.CrossRef Mata-Cases M, Mauricio D, Real J, Bolíbar B, Franch-Nadal J. Is diabetes mellitus correctly registered and classified in primary care? A population-based study in Catalonia, Spain. Endocrinol y Nutr. 2016;63:440–8.CrossRef
Metadata
Title
Validity of type 2 diabetes diagnosis in a population-based electronic health record database
Authors
Conchi Moreno-Iribas
Carmen Sayon-Orea
Josu Delfrade
Eva Ardanaz
Javier Gorricho
Rosana Burgui
Marian Nuin
Marcela Guevara
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0439-z

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue