Skip to main content
Top
Published in: Journal of General Internal Medicine 4/2008

01-04-2008 | original Article

Electronic Medical Record-Assisted Design of a Cluster-Randomized Trial to Improve Diabetes Care and Outcomes

Authors: Thomas E. Love, PhD, Randall D. Cebul, MD, Douglas Einstadter, MD, MPH, Anil K. Jain, MD, Holly Miller, MD, MBA, C. Martin Harris, MD, MBA, Peter J. Greco, MD, Scott S. Husak, BS, Neal V. Dawson, MD, for the DIG-IT Investigators

Published in: Journal of General Internal Medicine | Issue 4/2008

Login to get access

Abstract

Background

Electronic medical records (EMRs) have the potential to facilitate the design of large cluster-randomized trials (CRTs).

Objective

To describe the design of a CRT of clinical decision support to improve diabetes care and outcomes.

Methods

In the Diabetes Improvement Group-Intervention Trial (DIG-IT), we identified and balanced preassignment characteristics of 12,675 diabetic patients cared for by 147 physicians in 24 practices of 2 systems using the same vendor’s EMR. EMR-facilitated disease management was system A’s experimental intervention; system B interventions involved patient empowerment, with or without disease management. For our sample, we: (1) identified characteristics associated with response to interventions or outcomes; (2) summarized feasible partitions of 10 system A practices (2 groups) and 14 system B practices (3 groups) using intra-cluster correlation coefficients (ICCs) and standardized differences; (3) selected (blinded) partitions to effectively balance the characteristics; and (4) randomly assigned groups of practices to interventions.

Results

In System A, 4,306 patients, were assigned to 2 groups of practices; 8,369 patients in system B were assigned to 3 groups of practices. Nearly all baseline outcome variables and covariates were well-balanced, including several not included in the initial design. DIG-IT’s balance was superior to alternative partitions based on volume, geography or demographics alone.

Conclusions

EMRs facilitated rigorous CRT design by identifying large numbers of patients with diabetes and enabling fair comparisons through preassignment balancing of practice sites. Our methods can be replicated in other settings and for other conditions, enhancing the power of other translational investigations.
Literature
1.
go back to reference Centers for Disease Control and Prevention. National Diabetes fact sheet: general information and national estimates on diabetes in the United States, 2003 Rev. ed. Atlanta: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention; 2004. Centers for Disease Control and Prevention. National Diabetes fact sheet: general information and national estimates on diabetes in the United States, 2003 Rev. ed. Atlanta: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention; 2004.
2.
go back to reference Saaddine JB, Cadwell B, Gregg EW, Engelgau MM, Vinicor F, Imperatore G, et al. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988–2002. Ann Intern Med.. 2006;144(7):465–74, Apr 4.PubMed Saaddine JB, Cadwell B, Gregg EW, Engelgau MM, Vinicor F, Imperatore G, et al. Improvements in diabetes processes of care and intermediate outcomes: United States, 1988–2002. Ann Intern Med.. 2006;144(7):465–74, Apr 4.PubMed
3.
go back to reference Shojania KG, Ranji S, McDonald KM, et al. Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006;296(4):427–40, Jul 26.PubMedCrossRef Shojania KG, Ranji S, McDonald KM, et al. Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006;296(4):427–40, Jul 26.PubMedCrossRef
4.
go back to reference Meigs JB, Cagliero E, Dubey A, et al. A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care. 2003;26(3):750–7, Mar.PubMedCrossRef Meigs JB, Cagliero E, Dubey A, et al. A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care. 2003;26(3):750–7, Mar.PubMedCrossRef
5.
go back to reference O’Connor PJ, Crain AL, Rush WA, Sperl-Hillen JM, Gutenkauf JJ, Duncan JE. Impact of an electronic medical record on diabetes quality of care. Ann Fam Med. 2005;3(4):300–6, Jul–Aug.PubMedCrossRef O’Connor PJ, Crain AL, Rush WA, Sperl-Hillen JM, Gutenkauf JJ, Duncan JE. Impact of an electronic medical record on diabetes quality of care. Ann Fam Med. 2005;3(4):300–6, Jul–Aug.PubMedCrossRef
6.
go back to reference Selby JV, Karter AJ, Ackerson LM, Ferrara A, Liu J. Developing a prediction rule from automated clinical databases to identify high-risk patients in a large population with diabetes. Diabetes Care. 2001;24(9):1547–55, Sep.PubMedCrossRef Selby JV, Karter AJ, Ackerson LM, Ferrara A, Liu J. Developing a prediction rule from automated clinical databases to identify high-risk patients in a large population with diabetes. Diabetes Care. 2001;24(9):1547–55, Sep.PubMedCrossRef
7.
go back to reference Murray D. Design and Analysis of Group-Randomized Trials. New York: Oxford University Press; 1998. Murray D. Design and Analysis of Group-Randomized Trials. New York: Oxford University Press; 1998.
8.
go back to reference Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold; 2000. Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. London: Arnold; 2000.
9.
go back to reference Eldridge SM, Ashby D, Feder GS, Rudnicka A, Ukoumunne OC. Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials. 2004;1(1):80–90, Feb.PubMedCrossRef Eldridge SM, Ashby D, Feder GS, Rudnicka A, Ukoumunne OC. Lessons for cluster randomized trials in the twenty-first century: a systematic review of trials in primary care. Clin Trials. 2004;1(1):80–90, Feb.PubMedCrossRef
10.
go back to reference Simpson JM, Klar N, Donnor A. Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. Am J Public Health. 1995;85(10):1378–83, Oct.PubMedCrossRef Simpson JM, Klar N, Donnor A. Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. Am J Public Health. 1995;85(10):1378–83, Oct.PubMedCrossRef
11.
go back to reference Osheroff JA, Teich JM, Middleton BF, Steen EB, Wright A, Detmer DE. A Roadmap for National Action on Clinical Decision Support. J Am Med Inform Assoc. 2007;14:141–5.PubMedCrossRef Osheroff JA, Teich JM, Middleton BF, Steen EB, Wright A, Detmer DE. A Roadmap for National Action on Clinical Decision Support. J Am Med Inform Assoc. 2007;14:141–5.PubMedCrossRef
12.
go back to reference Eccles M, McColl E, Steen N, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002;325(7370):941, Oct 26.PubMedCrossRef Eccles M, McColl E, Steen N, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ. 2002;325(7370):941, Oct 26.PubMedCrossRef
13.
go back to reference Campbell MK, Grimshaw JM, Elbourne DR. Intracluster correlation coefficients in cluster randomized trials: empirical insights into how should they be reported. BMC Med Res Methodol. 2004;4:9, Apr 28.PubMedCrossRef Campbell MK, Grimshaw JM, Elbourne DR. Intracluster correlation coefficients in cluster randomized trials: empirical insights into how should they be reported. BMC Med Res Methodol. 2004;4:9, Apr 28.PubMedCrossRef
14.
go back to reference Campbell MK, Fayers PM, Grimshaw JM. Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005;2(2):99–107.PubMedCrossRef Campbell MK, Fayers PM, Grimshaw JM. Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005;2(2):99–107.PubMedCrossRef
15.
go back to reference Lancaster GA, Chellaswamy H, Taylor S, Lyon D, Dowrick C. Design of a clustered observational study to predict emergency admissions in the elderly: statistical reasoning in clinical practice. J Eval Clin Pract. 2007;13(2):169–78, Apr.PubMedCrossRef Lancaster GA, Chellaswamy H, Taylor S, Lyon D, Dowrick C. Design of a clustered observational study to predict emergency admissions in the elderly: statistical reasoning in clinical practice. J Eval Clin Pract. 2007;13(2):169–78, Apr.PubMedCrossRef
16.
go back to reference Johnson DW, Craig W, Brant , Mitton C, Svenson L, Klassen TP. A cluster randomized controlled trial comparing three methods of disseminating practice guidelines for children with croup. Implement Sci. 2006;1:10.PubMedCrossRef Johnson DW, Craig W, Brant , Mitton C, Svenson L, Klassen TP. A cluster randomized controlled trial comparing three methods of disseminating practice guidelines for children with croup. Implement Sci. 2006;1:10.PubMedCrossRef
17.
go back to reference Freedman LS, Gail MH, Green SB, Corle DK. The efficiency of the matched-pairs design of the Community Intervention Trial for Smoking Cessation (COMMIT). Control Clin Trials. 1997;18(2):131–9, Apr.PubMedCrossRef Freedman LS, Gail MH, Green SB, Corle DK. The efficiency of the matched-pairs design of the Community Intervention Trial for Smoking Cessation (COMMIT). Control Clin Trials. 1997;18(2):131–9, Apr.PubMedCrossRef
18.
go back to reference Glasgow RE, Nutting PA, King DK, Nelson CC, Cutter G, Gaglio B, et al. Randomized effectiveness trial of a computer-assisted intervention to improve diabetes care. Diabetes Care. 2005;28(1):33–9, Jan.PubMedCrossRef Glasgow RE, Nutting PA, King DK, Nelson CC, Cutter G, Gaglio B, et al. Randomized effectiveness trial of a computer-assisted intervention to improve diabetes care. Diabetes Care. 2005;28(1):33–9, Jan.PubMedCrossRef
19.
go back to reference Grosskurth H, Mosha F, Todd J, Mwijarubi E, Klokke A, Senkoro K, et al. Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial. Lancet.. 1995;346(8974):530–6, Aug 26.PubMedCrossRef Grosskurth H, Mosha F, Todd J, Mwijarubi E, Klokke A, Senkoro K, et al. Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial. Lancet.. 1995;346(8974):530–6, Aug 26.PubMedCrossRef
20.
go back to reference Gulmezoglu AM, Villar J, Grimshaw J, Piaggio G, Lumbiganon P, Langer A. Cluster randomized trial of an active, multifaceted information dissemination intervention based on The WHO Reproductive health library to change obstetric practices: methods and design issues. BMC Med Res Methodol. 2004;4(1):2, Jan 15.PubMedCrossRef Gulmezoglu AM, Villar J, Grimshaw J, Piaggio G, Lumbiganon P, Langer A. Cluster randomized trial of an active, multifaceted information dissemination intervention based on The WHO Reproductive health library to change obstetric practices: methods and design issues. BMC Med Res Methodol. 2004;4(1):2, Jan 15.PubMedCrossRef
21.
go back to reference Thompson SG, Pyke SD, Hardy RJ. The design and analysis of paired cluster randomized trials: an application of meta-analysis techniques. Stat Med. 1997;16(18):2063–79, Sep 30.PubMedCrossRef Thompson SG, Pyke SD, Hardy RJ. The design and analysis of paired cluster randomized trials: an application of meta-analysis techniques. Stat Med. 1997;16(18):2063–79, Sep 30.PubMedCrossRef
22.
go back to reference American Diabetes Association. Standards of medical care for patients with diabetes mellitus. Diabetes Care. 2003;26(1):S33–50, Jan.CrossRef American Diabetes Association. Standards of medical care for patients with diabetes mellitus. Diabetes Care. 2003;26(1):S33–50, Jan.CrossRef
23.
24.
go back to reference Raab GM, Butcher I. Randomization inference for balanced cluster-randomized trials. Clin Trials. 2005;2(2):130–40.PubMedCrossRef Raab GM, Butcher I. Randomization inference for balanced cluster-randomized trials. Clin Trials. 2005;2(2):130–40.PubMedCrossRef
25.
go back to reference Cohen J. Statistical Power Analysis for the Behavioral Sciences. Toronto: Academic Press, Inc.; 1977. Cohen J. Statistical Power Analysis for the Behavioral Sciences. Toronto: Academic Press, Inc.; 1977.
26.
go back to reference Ahmed A, Husain A, Love TE, et al. Heart failure, chronic diuretic use, and increase in mortality and hospitalization: an observational study using propensity score methods. Eur Heart J. 2006;27(12):1431–9, Jun.PubMedCrossRef Ahmed A, Husain A, Love TE, et al. Heart failure, chronic diuretic use, and increase in mortality and hospitalization: an observational study using propensity score methods. Eur Heart J. 2006;27(12):1431–9, Jun.PubMedCrossRef
27.
go back to reference Normand ST, Landrum MB, Guadagnoli E, et al. Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores. J Clin Epidemiol. 2001;54(4):387–98, Apr.PubMedCrossRef Normand ST, Landrum MB, Guadagnoli E, et al. Validating recommendations for coronary angiography following acute myocardial infarction in the elderly: a matched analysis using propensity scores. J Clin Epidemiol. 2001;54(4):387–98, Apr.PubMedCrossRef
28.
go back to reference Kerry SM, Bland JM. The intracluster correlation coefficient in cluster randomisation. BMJ. 1998;316(7142):1455, May 9.PubMed Kerry SM, Bland JM. The intracluster correlation coefficient in cluster randomisation. BMJ. 1998;316(7142):1455, May 9.PubMed
29.
go back to reference Feng Z, Diehr P, Peterson A, McLerran D. Selected statistical issues in group randomized trials. Annu Rev Public Health. 2001;22:167–87.PubMedCrossRef Feng Z, Diehr P, Peterson A, McLerran D. Selected statistical issues in group randomized trials. Annu Rev Public Health. 2001;22:167–87.PubMedCrossRef
30.
go back to reference Kerry SM, Bland JM. Sample size in cluster randomisation. BMJ. 1998;316(7130):549, Feb 14.PubMed Kerry SM, Bland JM. Sample size in cluster randomisation. BMJ. 1998;316(7130):549, Feb 14.PubMed
31.
go back to reference Kerry SM, Bland JM. Trials which randomize practices II: sample size. Fam Pract. 1998;15(1):84–7, Feb.PubMedCrossRef Kerry SM, Bland JM. Trials which randomize practices II: sample size. Fam Pract. 1998;15(1):84–7, Feb.PubMedCrossRef
32.
go back to reference Campbell MK, Elbourne D, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328(7441):702–8, Mar 20.PubMedCrossRef Campbell MK, Elbourne D, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328(7441):702–8, Mar 20.PubMedCrossRef
33.
go back to reference Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M. Analysis of cluster randomized trials in primary care: a practical approach. Fam Pract. 2000;17(2):192–6, Apr.PubMedCrossRef Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M. Analysis of cluster randomized trials in primary care: a practical approach. Fam Pract. 2000;17(2):192–6, Apr.PubMedCrossRef
34.
go back to reference Campbell MK, Mollison J, Grimshaw JM. Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001;20(3):391–9, Feb 15.PubMedCrossRef Campbell MK, Mollison J, Grimshaw JM. Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001;20(3):391–9, Feb 15.PubMedCrossRef
35.
go back to reference Cebul RD, Dawson NV, Love TE. Cluster Randomized Trials in Health Care ResearchIn: Machin D, Day S, Green S (eds). The Textbook of Clinical Trials 2nd ed. New York: Wiley; 2006. Cebul RD, Dawson NV, Love TE. Cluster Randomized Trials in Health Care ResearchIn: Machin D, Day S, Green S (eds). The Textbook of Clinical Trials 2nd ed. New York: Wiley; 2006.
36.
go back to reference StataCorp. Intercooled Stata/SE 9.2 for WindowsCollege Station, TX: StataCorp; 2007. StataCorp. Intercooled Stata/SE 9.2 for WindowsCollege Station, TX: StataCorp; 2007.
37.
go back to reference Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ. 2003;327(7418):785–9, Oct 4.PubMedCrossRef Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomised trials: review of recent trials published in three general medical journals. BMJ. 2003;327(7418):785–9, Oct 4.PubMedCrossRef
38.
go back to reference Eccles M, Hawthorne G, Whitty P, et al. A randomised controlled trial of a patient based Diabetes Recall and Management System: the DREAM trial: a study protocol. BMC Health Serv Res. 2002;2(1):5, Mar 21.PubMedCrossRef Eccles M, Hawthorne G, Whitty P, et al. A randomised controlled trial of a patient based Diabetes Recall and Management System: the DREAM trial: a study protocol. BMC Health Serv Res. 2002;2(1):5, Mar 21.PubMedCrossRef
39.
go back to reference Brown AF, Gregg EW, Stevens M, Karter AJ, Weinberger M, Safford MM, et al. Race, ethnicity, socioeconomic position, and quality of care for adults with diabetes enrolled in managed care: the Translating Research Into Action for Diabetes (TRIAD) study. Diabetes Care. 2005;28(12):2864–70, Dec.PubMedCrossRef Brown AF, Gregg EW, Stevens M, Karter AJ, Weinberger M, Safford MM, et al. Race, ethnicity, socioeconomic position, and quality of care for adults with diabetes enrolled in managed care: the Translating Research Into Action for Diabetes (TRIAD) study. Diabetes Care. 2005;28(12):2864–70, Dec.PubMedCrossRef
40.
go back to reference Hsu J, Price M, Huang J, Brand , Fung V, Hui , et al. Unintended consequences of caps on Medicare drug benefits. N Engl J Med. 2006;354(22):2349–59, Jun 1.PubMedCrossRef Hsu J, Price M, Huang J, Brand , Fung V, Hui , et al. Unintended consequences of caps on Medicare drug benefits. N Engl J Med. 2006;354(22):2349–59, Jun 1.PubMedCrossRef
41.
go back to reference Murray DM, Blitstein JL, Hannan PJ, Baker WL, Lytle LA. Sizing a trial to alter the trajectory of health behaviours: methods, parameter estimates, and their application. Stat Med. 2007;26(11):2297–2316, May 20.PubMedCrossRef Murray DM, Blitstein JL, Hannan PJ, Baker WL, Lytle LA. Sizing a trial to alter the trajectory of health behaviours: methods, parameter estimates, and their application. Stat Med. 2007;26(11):2297–2316, May 20.PubMedCrossRef
Metadata
Title
Electronic Medical Record-Assisted Design of a Cluster-Randomized Trial to Improve Diabetes Care and Outcomes
Authors
Thomas E. Love, PhD
Randall D. Cebul, MD
Douglas Einstadter, MD, MPH
Anil K. Jain, MD
Holly Miller, MD, MBA
C. Martin Harris, MD, MBA
Peter J. Greco, MD
Scott S. Husak, BS
Neal V. Dawson, MD
for the DIG-IT Investigators
Publication date
01-04-2008
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue 4/2008
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-007-0454-3

Other articles of this Issue 4/2008

Journal of General Internal Medicine 4/2008 Go to the issue