Skip to main content
Top
Published in: BMC Health Services Research 1/2009

Open Access 01-12-2009 | Research article

A structured registration program can be validly used for quality assessment in general practice

Authors: Andrea S Fokkens, P Auke Wiegersma, Sijmen A Reijneveld

Published in: BMC Health Services Research | Issue 1/2009

Login to get access

Abstract

Background

Patient information, medical history, clinical outcomes and demographic information, can be registered in different ways in registration programs. For evaluation of diabetes care, data can easily be extracted from a structured registration program (SRP). The usability of data from this source depends on the agreement of this data with that of the usual data registration in the electronic medical record (EMR).
Aim of the study was to determine the comparability of data from an EMR and from an SRP, to determine whether the use of SRP data for quality assessment is justified in general practice.

Methods

We obtained 196 records of diabetes mellitus patients in a sample of general practices in the Netherlands. We compared the agreement between the two programs in terms of laboratory and non-laboratory parameters. Agreement was determined by defining accordance between the programs in absent and present registrations, accordance between values of registrations, and whether the differences found in values were also a clinically relevant difference.

Results

No differences were found in the occurrence of registration (absent/present) in the SRP and EMR for all the laboratory parameters. Smoking behaviour, weight and eye examination were registered significantly more often in the SRP than in the EMR. In the EMR, blood pressure was registered significantly more often than in the SRP. Data registered in the EMR and in the SRP had a similar clinical meaning for all parameters (laboratory and non-laboratory).

Conclusions

Laboratory parameters showed good agreement and non-laboratory acceptable agreement of the SRP with the EMR. Data from a structured registration program can be used validly for research purposes and quality assessment in general practice.
Literature
1.
go back to reference Berner ES, Detmer DE, Simborg D: Will the wave finally break? A brief view of the adoption of electronic medical records in the United States. J Am Med Inform Assoc. 2005, 12 (1): 3-7. 10.1197/jamia.M1664.CrossRefPubMedPubMedCentral Berner ES, Detmer DE, Simborg D: Will the wave finally break? A brief view of the adoption of electronic medical records in the United States. J Am Med Inform Assoc. 2005, 12 (1): 3-7. 10.1197/jamia.M1664.CrossRefPubMedPubMedCentral
2.
go back to reference de Lusignan S, Teasdale S, Little D, Zapp J, Zuckerman A, Bates DW, et al: Comprehensive computerised primary care records are an essential component of any national health information strategy: report from an international consensus conference. Inform Prim Care. 2004, 12 (4): 255-64.PubMed de Lusignan S, Teasdale S, Little D, Zapp J, Zuckerman A, Bates DW, et al: Comprehensive computerised primary care records are an essential component of any national health information strategy: report from an international consensus conference. Inform Prim Care. 2004, 12 (4): 255-64.PubMed
3.
go back to reference Knottnerus JA: Role of the electronic patient record in the development of general practice in The Netherlands. Methods of information in medicine. 1999, 38 (4-5): 350-4.PubMed Knottnerus JA: Role of the electronic patient record in the development of general practice in The Netherlands. Methods of information in medicine. 1999, 38 (4-5): 350-4.PubMed
4.
go back to reference Nilsson G, Ahlfeldt H, Strender LE: Computerisation, coding, data retrieval and related attitudes among Swedish general practitioners-a survey of necessary conditions for a database of diseases and health problems. Int J Med Inform. 2002, 65 (2): 135-43. 10.1016/S1386-5056(02)00012-6.CrossRefPubMed Nilsson G, Ahlfeldt H, Strender LE: Computerisation, coding, data retrieval and related attitudes among Swedish general practitioners-a survey of necessary conditions for a database of diseases and health problems. Int J Med Inform. 2002, 65 (2): 135-43. 10.1016/S1386-5056(02)00012-6.CrossRefPubMed
5.
go back to reference Young RJ, Khong CK, Vaughan NJ, New J, Roxburgh M: The evolution of diabetes information systems. Diabet Med. 2002, 19 (Suppl 4): 6-12. 10.1046/j.1464-5491.19.s4.3.x.CrossRefPubMed Young RJ, Khong CK, Vaughan NJ, New J, Roxburgh M: The evolution of diabetes information systems. Diabet Med. 2002, 19 (Suppl 4): 6-12. 10.1046/j.1464-5491.19.s4.3.x.CrossRefPubMed
6.
go back to reference Dorr D, Bonner LM, Cohen AN, Shoai RS, Perrin R, Chaney E, et al: Informatics systems to promote improved care for chronic illness: a literature review. J Am Med Inform Assoc. 2007, 14 (2): 156-63. 10.1197/jamia.M2255.CrossRefPubMedPubMedCentral Dorr D, Bonner LM, Cohen AN, Shoai RS, Perrin R, Chaney E, et al: Informatics systems to promote improved care for chronic illness: a literature review. J Am Med Inform Assoc. 2007, 14 (2): 156-63. 10.1197/jamia.M2255.CrossRefPubMedPubMedCentral
7.
go back to reference Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006, 144 (10): 742-52.CrossRefPubMed Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006, 144 (10): 742-52.CrossRefPubMed
8.
go back to reference Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280 (15): 1339-46. 10.1001/jama.280.15.1339.CrossRefPubMed Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280 (15): 1339-46. 10.1001/jama.280.15.1339.CrossRefPubMed
9.
go back to reference de Lusignan S, van Weel C: The use of routinely collected computer data for research in primary care: opportunities and challenges. Fam Pract. 2006, 23 (2): 253-63. 10.1093/fampra/cmi106.CrossRefPubMed de Lusignan S, van Weel C: The use of routinely collected computer data for research in primary care: opportunities and challenges. Fam Pract. 2006, 23 (2): 253-63. 10.1093/fampra/cmi106.CrossRefPubMed
10.
go back to reference Mansson J, Nilsson G, Bjorkelund C, Strender LE: Collection and retrieval of structured clinical data from electronic patient records in general practice. A first-phase study to create a health care database for research and quality assessment. Scand J Prim Health Care. 2004, 22 (1): 6-10. 10.1080/02813430310003660.CrossRefPubMed Mansson J, Nilsson G, Bjorkelund C, Strender LE: Collection and retrieval of structured clinical data from electronic patient records in general practice. A first-phase study to create a health care database for research and quality assessment. Scand J Prim Health Care. 2004, 22 (1): 6-10. 10.1080/02813430310003660.CrossRefPubMed
11.
go back to reference Metsemakers JF, Knottnerus JA, van Schendel GJ, Kocken RJ, Limonard CB: Unlocking patients' records in general practice for research, medical education and quality assurance: the Registration Network Family Practices. Int J Biomed Comput. 1996, 42 (1-2): 43-50. 10.1016/0020-7101(96)01180-4.CrossRefPubMed Metsemakers JF, Knottnerus JA, van Schendel GJ, Kocken RJ, Limonard CB: Unlocking patients' records in general practice for research, medical education and quality assurance: the Registration Network Family Practices. Int J Biomed Comput. 1996, 42 (1-2): 43-50. 10.1016/0020-7101(96)01180-4.CrossRefPubMed
12.
go back to reference Roukema J, Los RK, Bleeker SE, van Ginneken AM, van der LJ, Moll HA: Paper versus computer: feasibility of an electronic medical record in general pediatrics. Pediatrics. 2006, 117 (1): 15-21. 10.1542/peds.2004-2741.CrossRefPubMed Roukema J, Los RK, Bleeker SE, van Ginneken AM, van der LJ, Moll HA: Paper versus computer: feasibility of an electronic medical record in general pediatrics. Pediatrics. 2006, 117 (1): 15-21. 10.1542/peds.2004-2741.CrossRefPubMed
13.
go back to reference Voorham J, Denig P: Computerized extraction of information on the quality of diabetes care from free text in electronic patient records of general practitioners. J Am Med Inform Assoc. 2007, 14 (3): 349-54. 10.1197/jamia.M2128.CrossRefPubMedPubMedCentral Voorham J, Denig P: Computerized extraction of information on the quality of diabetes care from free text in electronic patient records of general practitioners. J Am Med Inform Assoc. 2007, 14 (3): 349-54. 10.1197/jamia.M2128.CrossRefPubMedPubMedCentral
14.
go back to reference Klein Woolthuis EP, de Grauw WJ, van Gerwen WH, Hoogen van den HJ, Lisdonk van de EH, Metsemakers JF, et al: Identifying people at risk for undiagnosed type 2 diabetes using the GP's electronic medical record. Fam Pract. 2007, 24 (3): 230-6. 10.1093/fampra/cmm018.CrossRefPubMed Klein Woolthuis EP, de Grauw WJ, van Gerwen WH, Hoogen van den HJ, Lisdonk van de EH, Metsemakers JF, et al: Identifying people at risk for undiagnosed type 2 diabetes using the GP's electronic medical record. Fam Pract. 2007, 24 (3): 230-6. 10.1093/fampra/cmm018.CrossRefPubMed
15.
go back to reference de Lusignan S, Hague N, van Vlymen J, Kumarapeli P: Routinely-collected general practice data are complex, but with systematic processing can be used for quality improvement and research. Inform Prim Care. 2006, 14 (1): 59-66.PubMed de Lusignan S, Hague N, van Vlymen J, Kumarapeli P: Routinely-collected general practice data are complex, but with systematic processing can be used for quality improvement and research. Inform Prim Care. 2006, 14 (1): 59-66.PubMed
16.
go back to reference Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.CrossRefPubMedPubMedCentral Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.CrossRefPubMedPubMedCentral
17.
go back to reference Cruz-Correia RJ, Vieira-Marques PM, Ferreira AM, Almeida FC, Wyatt JC, Costa-Pereira AM: Reviewing the integration of patient data: how systems are evolving in practice to meet patient needs. BMC Med Inform Decis Mak. 2007, 7: 14-10.1186/1472-6947-7-14.CrossRefPubMedPubMedCentral Cruz-Correia RJ, Vieira-Marques PM, Ferreira AM, Almeida FC, Wyatt JC, Costa-Pereira AM: Reviewing the integration of patient data: how systems are evolving in practice to meet patient needs. BMC Med Inform Decis Mak. 2007, 7: 14-10.1186/1472-6947-7-14.CrossRefPubMedPubMedCentral
18.
go back to reference Liu H, Friedman C: CliniViewer: a tool for viewing electronic medical records based on natural language processing and XML. Medinfo. 2004, 11 (Pt 1): 639-43. Liu H, Friedman C: CliniViewer: a tool for viewing electronic medical records based on natural language processing and XML. Medinfo. 2004, 11 (Pt 1): 639-43.
19.
go back to reference Los RK, van Ginneken AM, Roukema J, Moll HA, Lei van der J: Why are structured data different? Relating differences in data representation to the rationale of OpenSDE. Med Inform Internet Med. 2005, 30 (4): 267-76. 10.1080/14639230500367563.CrossRefPubMed Los RK, van Ginneken AM, Roukema J, Moll HA, Lei van der J: Why are structured data different? Relating differences in data representation to the rationale of OpenSDE. Med Inform Internet Med. 2005, 30 (4): 267-76. 10.1080/14639230500367563.CrossRefPubMed
20.
go back to reference Piwernetz K: DIABCARE Quality Network in Europe--a model for quality management in chronic diseases. Int Clin Psychopharmacol. 2001, 16 (Suppl 3): S5-13. 10.1097/00004850-200104003-00002.CrossRefPubMed Piwernetz K: DIABCARE Quality Network in Europe--a model for quality management in chronic diseases. Int Clin Psychopharmacol. 2001, 16 (Suppl 3): S5-13. 10.1097/00004850-200104003-00002.CrossRefPubMed
21.
go back to reference Cicchetti DV, Feinstein AR: High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990, 43 (6): 551-8. 10.1016/0895-4356(90)90159-M.CrossRefPubMed Cicchetti DV, Feinstein AR: High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990, 43 (6): 551-8. 10.1016/0895-4356(90)90159-M.CrossRefPubMed
22.
go back to reference Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43 (6): 543-9. 10.1016/0895-4356(90)90158-L.CrossRefPubMed Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990, 43 (6): 543-9. 10.1016/0895-4356(90)90158-L.CrossRefPubMed
23.
go back to reference Powsner SM, Wyatt JC, Wright P: Opportunities for and challenges of computerisation. Lancet. 1998, 352 (9140): 1617-22. 10.1016/S0140-6736(98)08309-3.CrossRefPubMed Powsner SM, Wyatt JC, Wright P: Opportunities for and challenges of computerisation. Lancet. 1998, 352 (9140): 1617-22. 10.1016/S0140-6736(98)08309-3.CrossRefPubMed
24.
go back to reference Horwitz RI, Yu EC: Assessing the reliability of epidemiologic data obtained from medical records. J Chronic Dis. 1984, 37 (11): 825-31. 10.1016/0021-9681(84)90015-8.CrossRefPubMed Horwitz RI, Yu EC: Assessing the reliability of epidemiologic data obtained from medical records. J Chronic Dis. 1984, 37 (11): 825-31. 10.1016/0021-9681(84)90015-8.CrossRefPubMed
25.
go back to reference Goudswaard AN, Lam K, Stolk RP, Rutten GE: Quality of recording of data from patients with type 2 diabetes is not a valid indicator of quality of care. A cross-sectional study. Fam Pract. 2003, 20 (2): 173-7. 10.1093/fampra/20.2.173.CrossRefPubMed Goudswaard AN, Lam K, Stolk RP, Rutten GE: Quality of recording of data from patients with type 2 diabetes is not a valid indicator of quality of care. A cross-sectional study. Fam Pract. 2003, 20 (2): 173-7. 10.1093/fampra/20.2.173.CrossRefPubMed
26.
go back to reference Khunti K, Baker R, Rumsey M, Lakhani M: Quality of care of patients with diabetes: collation of data from multi-practice audits of diabetes in primary care. Fam Pract. 1999, 16 (1): 54-9. 10.1093/fampra/16.1.54.CrossRefPubMed Khunti K, Baker R, Rumsey M, Lakhani M: Quality of care of patients with diabetes: collation of data from multi-practice audits of diabetes in primary care. Fam Pract. 1999, 16 (1): 54-9. 10.1093/fampra/16.1.54.CrossRefPubMed
Metadata
Title
A structured registration program can be validly used for quality assessment in general practice
Authors
Andrea S Fokkens
P Auke Wiegersma
Sijmen A Reijneveld
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2009
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-9-241

Other articles of this Issue 1/2009

BMC Health Services Research 1/2009 Go to the issue