Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Validation of diabetes mellitus and hypertension diagnosis in computerized medical records in primary health care

Authors: Carmen de Burgos-Lunar, Miguel A Salinero-Fort, Juan Cárdenas-Valladolid, Sonia Soto-Díaz, Carmen Y Fuentes-Rodríguez, Juan C Abánades-Herranz, Isabel del Cura-González

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Computerized Clinical Records, which are incorporated in primary health care practice, have great potential for research. In order to use this information, data quality and reliability must be assessed to prevent compromising the validity of the results.
The aim of this study is to validate the diagnosis of hypertension and diabetes mellitus in the computerized clinical records of primary health care, taking the diagnosis criteria established in the most prominently used clinical guidelines as the gold standard against which what measure the sensitivity, specificity, and determine the predictive values.
The gold standard for diabetes mellitus was the diagnostic criteria established in 2003 American Diabetes Association Consensus Statement for diabetic subjects. The gold standard for hypertension was the diagnostic criteria established in the Joint National Committee published in 2003.

Methods

A cross-sectional multicentre validation study of diabetes mellitus and hypertension diagnoses in computerized clinical records of primary health care was carried out. Diagnostic criteria from the most prominently clinical practice guidelines were considered for standard reference.
Sensitivity, specificity, positive and negative predictive values, and global agreement (with kappa index), were calculated. Results were shown overall and stratified by sex and age groups.

Results

The agreement for diabetes mellitus with the reference standard as determined by the guideline was almost perfect (κ = 0.990), with a sensitivity of 99.53%, a specificity of 99.49%, a positive predictive value of 91.23% and a negative predictive value of 99.98%.
Hypertension diagnosis showed substantial agreement with the reference standard as determined by the guideline (κ = 0.778), the sensitivity was 85.22%, the specificity 96.95%, the positive predictive value 85.24%, and the negative predictive value was 96.95%. Sensitivity results were worse in patients who also had diabetes and in those aged 70 years or over.

Conclusions

Our results substantiate the validity of using diagnoses of diabetes and hypertension found within the computerized clinical records for epidemiologic studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ministry of Health and Social Policy: ICT in the Health System. The Healthcare Online program. Progress update January 2010. [http://red.es] Ministry of Health and Social Policy: ICT in the Health System. The Healthcare Online program. Progress update January 2010. [http://​red.​es]
2.
go back to reference Jick H, Madsen S, Nudelman PM, Perera DR, Stergachis A: Postmarketing follow-up at Group Health Cooperative of Puget Sound. Pharmacotherapy. 1984, 4 (2): 99-100.CrossRefPubMed Jick H, Madsen S, Nudelman PM, Perera DR, Stergachis A: Postmarketing follow-up at Group Health Cooperative of Puget Sound. Pharmacotherapy. 1984, 4 (2): 99-100.CrossRefPubMed
3.
go back to reference Malcolm E, Downey W, Strand L, McNutt M, West R: Saskatchewan Health's linkable data bases and pharmacoepidemiology. PMS. 1993, 6: 175-264. Malcolm E, Downey W, Strand L, McNutt M, West R: Saskatchewan Health's linkable data bases and pharmacoepidemiology. PMS. 1993, 6: 175-264.
4.
go back to reference Ray WA, Griffin MR: Use of Medicaid data pharmacoepidemiology. Am J Epidemiol. 1989, 129 (4): 837-49.PubMed Ray WA, Griffin MR: Use of Medicaid data pharmacoepidemiology. Am J Epidemiol. 1989, 129 (4): 837-49.PubMed
6.
go back to reference Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ: Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010, 69 (1): 4-14. 10.1111/j.1365-2125.2009.03537.x.CrossRefPubMedPubMedCentral Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ: Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010, 69 (1): 4-14. 10.1111/j.1365-2125.2009.03537.x.CrossRefPubMedPubMedCentral
7.
go back to reference Khan NF, Harrison SE, Rose PW: Validity of diagnostic coding within the General Practice Research Database: a systematic review. Br J Gen Pract. 2010, 60 (572): 128-136. 10.3399/bjgp10X483562.CrossRef Khan NF, Harrison SE, Rose PW: Validity of diagnostic coding within the General Practice Research Database: a systematic review. Br J Gen Pract. 2010, 60 (572): 128-136. 10.3399/bjgp10X483562.CrossRef
9.
go back to reference American Diabetes Association: Treatment of hypertension in adults with diabetes (Position Statement). Diabetes Care. 2003, 26 (Suppl 1): S80-S82. American Diabetes Association: Treatment of hypertension in adults with diabetes (Position Statement). Diabetes Care. 2003, 26 (Suppl 1): S80-S82.
10.
go back to reference Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al: The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. JAMA. 2003, 289: 2560-71. 10.1001/jama.289.19.2560.CrossRefPubMed Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al: The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. JAMA. 2003, 289: 2560-71. 10.1001/jama.289.19.2560.CrossRefPubMed
11.
go back to reference World Health Organization: Definition, Diagnosis and classification of diabetes mellitus and its complications: Report of a WHO Consultation. Part 1: Diagnosis and clasification of diabetes mellitus. 1999, Geneve: World Heath Organization, 539-53. World Health Organization: Definition, Diagnosis and classification of diabetes mellitus and its complications: Report of a WHO Consultation. Part 1: Diagnosis and clasification of diabetes mellitus. 1999, Geneve: World Heath Organization, 539-53.
12.
go back to reference European Diabetes Policy Group 1999: A desktop guide to type 2 diabetes Mellitus. Diabet Med. 1999, 16 (9): 716-30. 10.1046/j.1464-5491.1999.00166.x.CrossRef European Diabetes Policy Group 1999: A desktop guide to type 2 diabetes Mellitus. Diabet Med. 1999, 16 (9): 716-30. 10.1046/j.1464-5491.1999.00166.x.CrossRef
13.
go back to reference The Task Force for the Management of Arterial Hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC): 2007 Guidelines for the Management of Arterial Hypertension. J Hypert. 2007, 25: 1005-87. The Task Force for the Management of Arterial Hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC): 2007 Guidelines for the Management of Arterial Hypertension. J Hypert. 2007, 25: 1005-87.
14.
go back to reference Mancia G, Laurent S, Agabiti-Rosei E, Ambrosioni E, Burnier M, Caulfield MJ, et al: Reappraisal of European guidelines on hypertension management: a European Society of Hypertension Task Force document. J Hypertens. 2009, 27: 2121-58. 10.1097/HJH.0b013e328333146d.CrossRefPubMed Mancia G, Laurent S, Agabiti-Rosei E, Ambrosioni E, Burnier M, Caulfield MJ, et al: Reappraisal of European guidelines on hypertension management: a European Society of Hypertension Task Force document. J Hypertens. 2009, 27: 2121-58. 10.1097/HJH.0b013e328333146d.CrossRefPubMed
15.
go back to reference Canadian Diabetes Association: Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008, 32: S1-201. Canadian Diabetes Association: Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008, 32: S1-201.
16.
go back to reference Grupo de trabajo de la Guía de Práctica Clínica sobre Diabetes tipo 2: Guía de Práctica Clínica sobre Diabetes tipo 2. Madrid: Plan Nacional para el SNS del MSC. 2008, Agencia de Evaluación de Tecnologías Sanitarias de El País Vasco, Guías de Práctica Clínica en el SNS: OSTEBA N° 2006/08 Grupo de trabajo de la Guía de Práctica Clínica sobre Diabetes tipo 2: Guía de Práctica Clínica sobre Diabetes tipo 2. Madrid: Plan Nacional para el SNS del MSC. 2008, Agencia de Evaluación de Tecnologías Sanitarias de El País Vasco, Guías de Práctica Clínica en el SNS: OSTEBA N° 2006/08
17.
go back to reference Marín R, de la Sierra A, Armario P, Campo C, Banegas JR, Gorostidi M: Guía sobre el diagnóstico y tratamiento de la hipertensión arterial en España 2005. Med Clin(Barc). 2005, 125: 24-34. 10.1157/13076402.CrossRef Marín R, de la Sierra A, Armario P, Campo C, Banegas JR, Gorostidi M: Guía sobre el diagnóstico y tratamiento de la hipertensión arterial en España 2005. Med Clin(Barc). 2005, 125: 24-34. 10.1157/13076402.CrossRef
18.
go back to reference Coca A, Aranda P, Bertomeu V, Bonet A, Esmatjes E, Guillén F, et al: Strategies for effective control of arterial hypertension in Spain. Consensus document. Rev ClinEsp. 2006, 206: 510-4. Coca A, Aranda P, Bertomeu V, Bonet A, Esmatjes E, Guillén F, et al: Strategies for effective control of arterial hypertension in Spain. Consensus document. Rev ClinEsp. 2006, 206: 510-4.
19.
go back to reference De la Sierra A, Gorostidi M, Marín R, Redón J, Banegas JR, Armario P, et al: Evaluación y tratamiento de la hipertensión arterial en España. Documento de consenso. Med Clin (Barc). 2008, 131 (3): 104-16. 10.1157/13124015.CrossRef De la Sierra A, Gorostidi M, Marín R, Redón J, Banegas JR, Armario P, et al: Evaluación y tratamiento de la hipertensión arterial en España. Documento de consenso. Med Clin (Barc). 2008, 131 (3): 104-16. 10.1157/13124015.CrossRef
20.
go back to reference Rogan WJ, Gladen B: Estimating prevalence from the results of a screening test. Am J Epidemiol. 1978, 107: 71-6.PubMed Rogan WJ, Gladen B: Estimating prevalence from the results of a screening test. Am J Epidemiol. 1978, 107: 71-6.PubMed
21.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
24.
go back to reference Huerta JM, Tormo MJ, Egea-Caparrós JM, Ortolá-Devesa JB, Navarro C: Validez del diagnóstico referido de diabetes, hipertensión e hiperlipemia en población adulta española. Resultados del estudio DINO. Rev Esp Cardiol. 2009, 62: 143-52.CrossRef Huerta JM, Tormo MJ, Egea-Caparrós JM, Ortolá-Devesa JB, Navarro C: Validez del diagnóstico referido de diabetes, hipertensión e hiperlipemia en población adulta española. Resultados del estudio DINO. Rev Esp Cardiol. 2009, 62: 143-52.CrossRef
25.
go back to reference Molenaar EA, Van Ameijden EJ, Grobbee DE, Numans ME: Comparison of routine care self-reported and biometrical data on hypertension and diabetes: results of the Utrecht Health Project. Eur J Public Health. 2007, 17: 199-205. 10.1093/eurpub/ckl113.CrossRefPubMed Molenaar EA, Van Ameijden EJ, Grobbee DE, Numans ME: Comparison of routine care self-reported and biometrical data on hypertension and diabetes: results of the Utrecht Health Project. Eur J Public Health. 2007, 17: 199-205. 10.1093/eurpub/ckl113.CrossRefPubMed
26.
go back to reference Goldman N, Lin IF, Weinstein M, Lin YH: Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003, 56 (2): 148-54. 10.1016/S0895-4356(02)00580-2.CrossRefPubMed Goldman N, Lin IF, Weinstein M, Lin YH: Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003, 56 (2): 148-54. 10.1016/S0895-4356(02)00580-2.CrossRefPubMed
27.
go back to reference Alonso A, Beunza JJ, Delgado-Rodríguez M, Martínez-González MA: Validation of self reported diagnosis of hypertension in a cohort of university graduates in Spain. BMC Public Health. 2005, 5: 94-10.1186/1471-2458-5-94.CrossRefPubMedPubMedCentral Alonso A, Beunza JJ, Delgado-Rodríguez M, Martínez-González MA: Validation of self reported diagnosis of hypertension in a cohort of university graduates in Spain. BMC Public Health. 2005, 5: 94-10.1186/1471-2458-5-94.CrossRefPubMedPubMedCentral
28.
go back to reference Tormo MJ, Navarro C, Chirlaque MD, Barber X: Validation of self diagnosis of high blood pressure in a sample of the Spanish EPIC cohort: overall agreement and predictive values. EPIC Group of Spain. J Epidemiol Community Health. 2000, 54: 221-6. 10.1136/jech.54.3.221.CrossRefPubMedPubMedCentral Tormo MJ, Navarro C, Chirlaque MD, Barber X: Validation of self diagnosis of high blood pressure in a sample of the Spanish EPIC cohort: overall agreement and predictive values. EPIC Group of Spain. J Epidemiol Community Health. 2000, 54: 221-6. 10.1136/jech.54.3.221.CrossRefPubMedPubMedCentral
29.
go back to reference Giles WH, Croft JB, Keenan NL, Lane MJ, Wheeler FC: The validity of self-reported hypertension and correlates of hypertension awareness among blacks and whites within the stroke belt. J Prev Med. 1995, 11 (3): 163-9. Giles WH, Croft JB, Keenan NL, Lane MJ, Wheeler FC: The validity of self-reported hypertension and correlates of hypertension awareness among blacks and whites within the stroke belt. J Prev Med. 1995, 11 (3): 163-9.
30.
go back to reference Wu SC, Li CY, Ke DS: The agreement between self-reporting and clinical diagnosis for selected medical conditions among the elderly in Taiwan. Public Health. 2000, 114 (2): 137-42. 10.1016/S0033-3506(00)00323-1.CrossRefPubMed Wu SC, Li CY, Ke DS: The agreement between self-reporting and clinical diagnosis for selected medical conditions among the elderly in Taiwan. Public Health. 2000, 114 (2): 137-42. 10.1016/S0033-3506(00)00323-1.CrossRefPubMed
31.
go back to reference Johansson J, Hellenius ML, Elofsson S, Krakau I: Self-report as a selection instrument in screening for cardiovascular disease risk. Am J Prev Med. 1999, 16 (4): 322-4. 10.1016/S0749-3797(99)00019-7.CrossRefPubMed Johansson J, Hellenius ML, Elofsson S, Krakau I: Self-report as a selection instrument in screening for cardiovascular disease risk. Am J Prev Med. 1999, 16 (4): 322-4. 10.1016/S0749-3797(99)00019-7.CrossRefPubMed
32.
go back to reference Bowlin SJ, Morrill BD, Nafziger AN, Lewis C, Pearson TA: Reliability and changes in validity of self-reported cardiovascular disease risk factors using dual response: the behavioral risk factor survey. J Clin Epidemiol. 1996, 49: 511-17. 10.1016/0895-4356(96)00010-8.CrossRefPubMed Bowlin SJ, Morrill BD, Nafziger AN, Lewis C, Pearson TA: Reliability and changes in validity of self-reported cardiovascular disease risk factors using dual response: the behavioral risk factor survey. J Clin Epidemiol. 1996, 49: 511-17. 10.1016/0895-4356(96)00010-8.CrossRefPubMed
33.
go back to reference Bays HE, Bazata DD, Clark NG, Gavin JR, Green AJ, Lewis SJ, Reed ML, Stewart W, Chapman RH, Fox KM, Grandy S: Prevalence of self-reported diagnosis of diabetes mellitus and associated risk factors in a national survey in the US population: SHIELD (Study to Help Improve Early evaluation and management of risk factors Leading to Diabetes). BMC Public Health. 2007, 3;7: 277-CrossRef Bays HE, Bazata DD, Clark NG, Gavin JR, Green AJ, Lewis SJ, Reed ML, Stewart W, Chapman RH, Fox KM, Grandy S: Prevalence of self-reported diagnosis of diabetes mellitus and associated risk factors in a national survey in the US population: SHIELD (Study to Help Improve Early evaluation and management of risk factors Leading to Diabetes). BMC Public Health. 2007, 3;7: 277-CrossRef
34.
go back to reference Pereira M, Lunet N, Azevedo A, Barros H: Differences in prevalence, awareness, treatment and control of hypertension between developing and developed countries. J Hypertens. 2009, 27 (5): 963-75. 10.1097/HJH.0b013e3283282f65.CrossRefPubMed Pereira M, Lunet N, Azevedo A, Barros H: Differences in prevalence, awareness, treatment and control of hypertension between developing and developed countries. J Hypertens. 2009, 27 (5): 963-75. 10.1097/HJH.0b013e3283282f65.CrossRefPubMed
35.
go back to reference Perez-Fernandez R, Mariño AF, Cadarso-Suarez C, Botana MA, Tome MA, Solache I, et al: Prevalence, awareness, treatment and control of hypertension in Galicia (Spain) and association with related diseases. J Hum Hypertens. 2007, 21 (5): 366-73.PubMed Perez-Fernandez R, Mariño AF, Cadarso-Suarez C, Botana MA, Tome MA, Solache I, et al: Prevalence, awareness, treatment and control of hypertension in Galicia (Spain) and association with related diseases. J Hum Hypertens. 2007, 21 (5): 366-73.PubMed
36.
go back to reference Zorrilla B, De la Calle H, Martínez M, Gil E, Sánchez JL, Nogales P, et al: Prevalencia de diabetes mellitus en la Comunidad de Madrid: estudio PREDIMERC. Av Diabetol. 2008, 24 (Suppl 1): 45-112. Zorrilla B, De la Calle H, Martínez M, Gil E, Sánchez JL, Nogales P, et al: Prevalencia de diabetes mellitus en la Comunidad de Madrid: estudio PREDIMERC. Av Diabetol. 2008, 24 (Suppl 1): 45-112.
37.
go back to reference García Vallejo O, Vicente Lozano J, Vegazo O, Jiménez Jiménez FJ, Llisterri Caro JL, Redón J: Control de la presión arterial de los pacientes diabéticos en el ámbito de atención primaria. Estudio DIAPA. Med Clin (Barc). 2003, 120 (14): 529-34. 10.1157/13045871.CrossRef García Vallejo O, Vicente Lozano J, Vegazo O, Jiménez Jiménez FJ, Llisterri Caro JL, Redón J: Control de la presión arterial de los pacientes diabéticos en el ámbito de atención primaria. Estudio DIAPA. Med Clin (Barc). 2003, 120 (14): 529-34. 10.1157/13045871.CrossRef
39.
go back to reference Banegas JR: Epidemiología de la hipertensión arterial en España. Situación actual y perspectivas. Hipertensión. 2005, 22: 353-62.CrossRef Banegas JR: Epidemiología de la hipertensión arterial en España. Situación actual y perspectivas. Hipertensión. 2005, 22: 353-62.CrossRef
40.
go back to reference Kannel WB, Wilson PW, Zhang TJ: The epidemiology of impaired glucose tolerance and hypertension. Am Heart J. 1991, 121: 1268-73. 10.1016/0002-8703(91)90432-H.CrossRefPubMed Kannel WB, Wilson PW, Zhang TJ: The epidemiology of impaired glucose tolerance and hypertension. Am Heart J. 1991, 121: 1268-73. 10.1016/0002-8703(91)90432-H.CrossRefPubMed
41.
go back to reference Fernández Cuenca R: Análisis de los servicios sanitarios. Sociedad Española de Salud Pública y Administración Sanitaria. Informe SESPAS 1998: La salud pública y el futuro del estado de bienestar. 1998, Granada: Escuela Andaluza de Salud Pública, 249-98. Fernández Cuenca R: Análisis de los servicios sanitarios. Sociedad Española de Salud Pública y Administración Sanitaria. Informe SESPAS 1998: La salud pública y el futuro del estado de bienestar. 1998, Granada: Escuela Andaluza de Salud Pública, 249-98.
42.
go back to reference Nicholson A, Tate AR, Koeling R, Cassell JA: What does validation of cases in electronic record databases mean? The potential contribution of free text. Pharmacoepidemiol Drug Saf. 2011, 20 (3): 321-4. 10.1002/pds.2086.CrossRefPubMedPubMedCentral Nicholson A, Tate AR, Koeling R, Cassell JA: What does validation of cases in electronic record databases mean? The potential contribution of free text. Pharmacoepidemiol Drug Saf. 2011, 20 (3): 321-4. 10.1002/pds.2086.CrossRefPubMedPubMedCentral
Metadata
Title
Validation of diabetes mellitus and hypertension diagnosis in computerized medical records in primary health care
Authors
Carmen de Burgos-Lunar
Miguel A Salinero-Fort
Juan Cárdenas-Valladolid
Sonia Soto-Díaz
Carmen Y Fuentes-Rodríguez
Juan C Abánades-Herranz
Isabel del Cura-González
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-146

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue