Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2012

Open Access 01-12-2012 | Research article

Impact of a computerized system for evidence-based diabetes care on completeness of records: a before–after study

Authors: Pavel S Roshanov, Hertzel C Gerstein, Dereck L Hunt, Rolf J Sebaldt, R Brian Haynes

Published in: BMC Medical Informatics and Decision Making | Issue 1/2012

Login to get access

Abstract

Background

Physicians practicing in ambulatory care are adopting electronic health record (EHR) systems. Governments promote this adoption with financial incentives, some hinged on improvements in care. These systems can improve care but most demonstrations of successful systems come from a few highly computerized academic environments. Those findings may not be generalizable to typical ambulatory settings, where evidence of success is largely anecdotal, with little or no use of rigorous methods. The purpose of our pilot study was to evaluate the impact of a diabetes specific chronic disease management system (CDMS) on recording of information pertinent to guideline-concordant diabetes care and to plan for larger, more conclusive studies.

Methods

Using a before–after study design we analyzed the medical record of approximately 10 patients from each of 3 diabetes specialists (total = 31) who were seen both before and after the implementation of a CDMS. We used a checklist of key clinical data to compare the completeness of information recorded in the CDMS record to both the clinical note sent to the primary care physician based on that same encounter and the clinical note sent to the primary care physician based on the visit that occurred prior to the implementation of the CDMS, accounting for provider effects with Generalized Estimating Equations.

Results

The CDMS record outperformed by a substantial margin dictated notes created for the same encounter. Only 10.1% (95% CI, 7.7% to 12.3%) of the clinically important data were missing from the CDMS chart compared to 25.8% (95% CI, 20.5% to 31.1%) from the clinical note prepared at the time (p < 0.001) and 26.3% (95% CI, 19.5% to 33.0%) from the clinical note prepared before the CDMS was implemented (p < 0.001). There was no significant difference between dictated notes created for the CDMS-assisted encounter and those created for usual care encounters (absolute mean difference, 0.8%; 95% CI, −8.5% to 6.8%).

Conclusions

The CDMS chart captured information important for the management of diabetes more often than dictated notes created with or without its use but we were unable to detect a difference in completeness between notes dictated in CDMS-associated and usual-care encounters. Our sample of patients and providers was small, and completeness of records may not reflect quality of care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Souza NM, Sebaldt RJ, Mackay JA, Prorok J, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for primary preventive care: a decision-maker–researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011, 6: 87-10.1186/1748-5908-6-87.CrossRefPubMedPubMedCentral Souza NM, Sebaldt RJ, Mackay JA, Prorok J, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for primary preventive care: a decision-maker–researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011, 6: 87-10.1186/1748-5908-6-87.CrossRefPubMedPubMedCentral
2.
go back to reference Roshanov PS, You JJ, Dhaliwal J, Koff D, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Can computerized clinical decision support systems improve practitioners’ diagnostic test ordering behavior? A decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 88-10.1186/1748-5908-6-88.CrossRefPubMedPubMedCentral Roshanov PS, You JJ, Dhaliwal J, Koff D, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Can computerized clinical decision support systems improve practitioners’ diagnostic test ordering behavior? A decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 88-10.1186/1748-5908-6-88.CrossRefPubMedPubMedCentral
3.
go back to reference Sahota N, Lloyd R, Ramakrishna A, Mackay J, Prorok J, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for acute care management: a decision-maker–researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011, 6: 91-10.1186/1748-5908-6-91.CrossRefPubMedPubMedCentral Sahota N, Lloyd R, Ramakrishna A, Mackay J, Prorok J, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for acute care management: a decision-maker–researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011, 6: 91-10.1186/1748-5908-6-91.CrossRefPubMedPubMedCentral
4.
go back to reference Hemens BJ, Holbrook AM, Tonkin M, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for drug prescribing and management: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 89-10.1186/1748-5908-6-89.CrossRefPubMedPubMedCentral Hemens BJ, Holbrook AM, Tonkin M, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski N, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for drug prescribing and management: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 89-10.1186/1748-5908-6-89.CrossRefPubMedPubMedCentral
5.
go back to reference Nieuwlaat R, Connolly S, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 90-10.1186/1748-5908-6-90.CrossRefPubMedPubMedCentral Nieuwlaat R, Connolly S, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for therapeutic drug monitoring and dosing: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 90-10.1186/1748-5908-6-90.CrossRefPubMedPubMedCentral
6.
go back to reference Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for chronic disease management: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 92-10.1186/1748-5908-6-92.CrossRefPubMedPubMedCentral Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB, the CCDSS Systematic Review Team: Computerized clinical decision support systems for chronic disease management: a decision-maker–researcher partnership systematic review. Implement Sci. 2011, 6: 92-10.1186/1748-5908-6-92.CrossRefPubMedPubMedCentral
7.
go back to reference Holbrook A, Pullenayegum E, Thabane L, Troyan S, Foster G, Keshavjee K, Chan D, Dolovich L, Gerstein H, Demers C, Curnew G: Shared electronic vascular risk decision support in primary care: Computerization of Medical Practices for the Enhancement of Therapeutic Effectiveness (COMPETE III) randomized trial. Arch Intern Med. 2011, 171: 1736-1744. 10.1001/archinternmed.2011.471.CrossRefPubMed Holbrook A, Pullenayegum E, Thabane L, Troyan S, Foster G, Keshavjee K, Chan D, Dolovich L, Gerstein H, Demers C, Curnew G: Shared electronic vascular risk decision support in primary care: Computerization of Medical Practices for the Enhancement of Therapeutic Effectiveness (COMPETE III) randomized trial. Arch Intern Med. 2011, 171: 1736-1744. 10.1001/archinternmed.2011.471.CrossRefPubMed
8.
go back to reference Holbrook A, Thabane L, Keshavjee K, Dolovich L, Bernstein B, Chan D, Troyan S, Foster G, Gerstein H: Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. Can Med Assoc J. 2009, 181: 37-44. 10.1503/cmaj.081272.CrossRef Holbrook A, Thabane L, Keshavjee K, Dolovich L, Bernstein B, Chan D, Troyan S, Foster G, Gerstein H: Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. Can Med Assoc J. 2009, 181: 37-44. 10.1503/cmaj.081272.CrossRef
9.
go back to reference MacLean CD, Gagnon M, Callas P: The Vermont Diabetes Information System: a cluster randomized trial of a population based decision support system. J Gen Intern Med. 2009, 24: 1303-1310. 10.1007/s11606-009-1147-x.CrossRefPubMedPubMedCentral MacLean CD, Gagnon M, Callas P: The Vermont Diabetes Information System: a cluster randomized trial of a population based decision support system. J Gen Intern Med. 2009, 24: 1303-1310. 10.1007/s11606-009-1147-x.CrossRefPubMedPubMedCentral
10.
go back to reference Christian JG, Bessesen DH, Byers TE, Christian KK, Goldstein MG, Bock BC: Clinic-based support to help overweight patients with type 2 diabetes increase physical activity and lose weight. Arch Intern Med. 2008, 168: 141-146. 10.1001/archinternmed.2007.13.CrossRefPubMed Christian JG, Bessesen DH, Byers TE, Christian KK, Goldstein MG, Bock BC: Clinic-based support to help overweight patients with type 2 diabetes increase physical activity and lose weight. Arch Intern Med. 2008, 168: 141-146. 10.1001/archinternmed.2007.13.CrossRefPubMed
11.
go back to reference Cleveringa FG, Gorter KJ, van den Donk M, Rutten GE: Combined task delegation, computerized decision support, and feedback improve cardiovascular risk for type 2 diabetic patients: a cluster randomized trial in primary care. Diabetes Care. 2008, 31: 2273-2275. 10.2337/dc08-0312.CrossRefPubMedPubMedCentral Cleveringa FG, Gorter KJ, van den Donk M, Rutten GE: Combined task delegation, computerized decision support, and feedback improve cardiovascular risk for type 2 diabetic patients: a cluster randomized trial in primary care. Diabetes Care. 2008, 31: 2273-2275. 10.2337/dc08-0312.CrossRefPubMedPubMedCentral
12.
go back to reference Peterson KA, Radosevich DM, O’Connor PJ, Nyman JA, Prineas RJ, Smith SA, Arneson TJ, Corbett VA, Weinhandl JC, Lange CJ, Hannan PJ: Improving diabetes care in practice: findings from the TRANSLATE trial. Diabetes Care. 2008, 31: 2238-2243. 10.2337/dc08-2034.CrossRefPubMedPubMedCentral Peterson KA, Radosevich DM, O’Connor PJ, Nyman JA, Prineas RJ, Smith SA, Arneson TJ, Corbett VA, Weinhandl JC, Lange CJ, Hannan PJ: Improving diabetes care in practice: findings from the TRANSLATE trial. Diabetes Care. 2008, 31: 2238-2243. 10.2337/dc08-2034.CrossRefPubMedPubMedCentral
13.
go back to reference Augstein P, Vogt L, Kohnert KD, Freyse EJ, Heinke P, Salzsieder E: Outpatient assessment of Karlsburg Diabetes Management System-based decision support. Diabetes Care. 2007, 30: 1704-1708. 10.2337/dc06-2167.CrossRefPubMed Augstein P, Vogt L, Kohnert KD, Freyse EJ, Heinke P, Salzsieder E: Outpatient assessment of Karlsburg Diabetes Management System-based decision support. Diabetes Care. 2007, 30: 1704-1708. 10.2337/dc06-2167.CrossRefPubMed
14.
go back to reference Filippi A, Sabatini A, Badioli L, Samani F, Mazzaglia G, Catapano A, Cricelli C: Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. Diabetes Care. 2003, 26: 1497-1500. 10.2337/diacare.26.5.1497.CrossRefPubMed Filippi A, Sabatini A, Badioli L, Samani F, Mazzaglia G, Catapano A, Cricelli C: Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. Diabetes Care. 2003, 26: 1497-1500. 10.2337/diacare.26.5.1497.CrossRefPubMed
15.
go back to reference Meigs JB, Cagliero E, Dubey A, Murphy-Sheehy P, Gildesgame C, Chueh H, Barry MJ, Singer DE, Nathan DM: A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care. 2003, 26: 750-757. 10.2337/diacare.26.3.750.CrossRefPubMed Meigs JB, Cagliero E, Dubey A, Murphy-Sheehy P, Gildesgame C, Chueh H, Barry MJ, Singer DE, Nathan DM: A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care. 2003, 26: 750-757. 10.2337/diacare.26.3.750.CrossRefPubMed
16.
go back to reference Lobach DF, Hammond W: Computerized decision support based on a clinical practice guideline improves compliance with care standards. Am J Med. 1997, 102: 89-98. 10.1016/S0002-9343(96)00382-8.CrossRefPubMed Lobach DF, Hammond W: Computerized decision support based on a clinical practice guideline improves compliance with care standards. Am J Med. 1997, 102: 89-98. 10.1016/S0002-9343(96)00382-8.CrossRefPubMed
17.
go back to reference Nilasena DS, Lincoln MJ: A computer-generated reminder system improves physician compliance with diabetes preventive care guidelines. Proc Annu Symp Comput Appl Med Care. 1995, 640-645. Nilasena DS, Lincoln MJ: A computer-generated reminder system improves physician compliance with diabetes preventive care guidelines. Proc Annu Symp Comput Appl Med Care. 1995, 640-645.
18.
go back to reference Mazzuca SA, Vinicor F, Einterz RM, Tierney WM, Norton JA, Kalasinski LA: Effects of the clinical environment on physicians’ response to postgraduate medical education. Am Educ Res J. 1990, 27: 473-488.CrossRef Mazzuca SA, Vinicor F, Einterz RM, Tierney WM, Norton JA, Kalasinski LA: Effects of the clinical environment on physicians’ response to postgraduate medical education. Am Educ Res J. 1990, 27: 473-488.CrossRef
19.
go back to reference Thomas RE, Croal BL, Ramsay C, Eccles M, Grimshaw J: Effect of enhanced feedback and brief educational reminder messages on laboratory test requesting in primary care: a cluster randomised trial. Lancet. 2006, 367: 1990-1996. 10.1016/S0140-6736(06)68888-0.CrossRefPubMed Thomas RE, Croal BL, Ramsay C, Eccles M, Grimshaw J: Effect of enhanced feedback and brief educational reminder messages on laboratory test requesting in primary care: a cluster randomised trial. Lancet. 2006, 367: 1990-1996. 10.1016/S0140-6736(06)68888-0.CrossRefPubMed
20.
go back to reference Derose SF, Dudl JR, Benson VM, Contreras R, Nakahiro RK, Ziel FH: Point of service reminders for prescribing cardiovascular medications. Am J Manag Care. 2005, 11: 298-304.PubMed Derose SF, Dudl JR, Benson VM, Contreras R, Nakahiro RK, Ziel FH: Point of service reminders for prescribing cardiovascular medications. Am J Manag Care. 2005, 11: 298-304.PubMed
21.
go back to reference Sequist TD, Gandhi TK, Karson AS, Fiskio JM, Bugbee D, Sperling M, Cook EF, Orav EJ, Fairchild DG, Bates DW: A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc. 2005, 12: 431-437. 10.1197/jamia.M1788.CrossRefPubMedPubMedCentral Sequist TD, Gandhi TK, Karson AS, Fiskio JM, Bugbee D, Sperling M, Cook EF, Orav EJ, Fairchild DG, Bates DW: A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc. 2005, 12: 431-437. 10.1197/jamia.M1788.CrossRefPubMedPubMedCentral
22.
go back to reference Thomas JC, Moore A, Qualls PE: The effect on cost of medical care for patients treated with an automated clinical audit system. J Med Syst. 1983, 7: 307-313. 10.1007/BF00993294.CrossRefPubMed Thomas JC, Moore A, Qualls PE: The effect on cost of medical care for patients treated with an automated clinical audit system. J Med Syst. 1983, 7: 307-313. 10.1007/BF00993294.CrossRefPubMed
23.
go back to reference Martin DC, Berger ML, Anstatt DT, Wofford J, Warfel D, Turpin RS, Cannuscio CC, Teutsch SM, Mansheim BJ, Turpin RS: A randomized controlled open trial of population-based disease and case management in a Medicare Plus Choice health maintenance organization. Prev Chronic Dis. 2004, 1: A05-PubMedPubMedCentral Martin DC, Berger ML, Anstatt DT, Wofford J, Warfel D, Turpin RS, Cannuscio CC, Teutsch SM, Mansheim BJ, Turpin RS: A randomized controlled open trial of population-based disease and case management in a Medicare Plus Choice health maintenance organization. Prev Chronic Dis. 2004, 1: A05-PubMedPubMedCentral
24.
go back to reference Demakis JG, Beauchamp C, Cull WL, Denwood R, Eisen SA, Lofgren R, Nichol K, Woolliscroft J, Henderson WG: Improving residents’ compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. JAMA. 2000, 284: 1411-1416. 10.1001/jama.284.11.1411.CrossRefPubMed Demakis JG, Beauchamp C, Cull WL, Denwood R, Eisen SA, Lofgren R, Nichol K, Woolliscroft J, Henderson WG: Improving residents’ compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. JAMA. 2000, 284: 1411-1416. 10.1001/jama.284.11.1411.CrossRefPubMed
25.
go back to reference Hetlevik I, Holmen J, Kruger O: Implementing clinical guidelines in the treatment of hypertension in general practice. Evaluation of patient outcome related to implementation of a computer-based clinical decision support system. Scand J Primary Health Care. 1999, 17: 35-40. 10.1080/028134399750002872.CrossRef Hetlevik I, Holmen J, Kruger O: Implementing clinical guidelines in the treatment of hypertension in general practice. Evaluation of patient outcome related to implementation of a computer-based clinical decision support system. Scand J Primary Health Care. 1999, 17: 35-40. 10.1080/028134399750002872.CrossRef
26.
go back to reference Zeger SL, Liang K-Y, Albert PS: Models for longitudinal data: a generalized estimating equation approach. Biometrics. 1988, 44: 1049-1060. 10.2307/2531734.CrossRefPubMed Zeger SL, Liang K-Y, Albert PS: Models for longitudinal data: a generalized estimating equation approach. Biometrics. 1988, 44: 1049-1060. 10.2307/2531734.CrossRefPubMed
27.
go back to reference StataCorp: Stata Statistical Software: Release 11. 2009, StataCorp LP, College Station, TX StataCorp: Stata Statistical Software: Release 11. 2009, StataCorp LP, College Station, TX
28.
go back to reference Lobach DF: Electronically distributed, computer-generated, individualized feedback enhances the use of a computerized practice guideline. Proc AMIA Annu Fall Symp. 1996, 493-497. Lobach DF: Electronically distributed, computer-generated, individualized feedback enhances the use of a computerized practice guideline. Proc AMIA Annu Fall Symp. 1996, 493-497.
29.
go back to reference Fortin M, Bravo G, Hudon C: Prevalence of multimorbidity among adults seen in family practice. Ann Family Med. 2005, 3: 223-228. 10.1370/afm.272.CrossRef Fortin M, Bravo G, Hudon C: Prevalence of multimorbidity among adults seen in family practice. Ann Family Med. 2005, 3: 223-228. 10.1370/afm.272.CrossRef
Metadata
Title
Impact of a computerized system for evidence-based diabetes care on completeness of records: a before–after study
Authors
Pavel S Roshanov
Hertzel C Gerstein
Dereck L Hunt
Rolf J Sebaldt
R Brian Haynes
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2012
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-12-63

Other articles of this Issue 1/2012

BMC Medical Informatics and Decision Making 1/2012 Go to the issue