Skip to main content
Top
Published in: Trials 1/2014

Open Access 01-12-2014 | Methodology

Cluster randomized trials utilizing primary care electronic health records: methodological issues in design, conduct, and analysis (eCRT Study)

Authors: Martin C Gulliford, Tjeerd P van Staa, Lisa McDermott, Gerard McCann, Judith Charlton, Alex Dregan, for the eCRT Research Team

Published in: Trials | Issue 1/2014

Login to get access

Abstract

Background

There is growing interest in conducting clinical and cluster randomized trials through electronic health records. This paper reports on the methodological issues identified during the implementation of two cluster randomized trials using the electronic health records of the Clinical Practice Research Datalink (CPRD).

Methods

Two trials were completed in primary care: one aimed to reduce inappropriate antibiotic prescribing for acute respiratory infection; the other aimed to increase physician adherence with secondary prevention interventions after first stroke. The paper draws on documentary records and trial datasets to report on the methodological experience with respect to research ethics and research governance approval, general practice recruitment and allocation, sample size calculation and power, intervention implementation, and trial analysis.

Results

We obtained research governance approvals from more than 150 primary care organizations in England, Wales, and Scotland. There were 104 CPRD general practices recruited to the antibiotic trial and 106 to the stroke trial, with the target number of practices being recruited within six months. Interventions were installed into practice information systems remotely over the internet. The mean number of participants per practice was 5,588 in the antibiotic trial and 110 in the stroke trial, with the coefficient of variation of practice sizes being 0.53 and 0.56 respectively. Outcome measures showed substantial correlations between the 12 months before, and after intervention, with coefficients ranging from 0.42 for diastolic blood pressure to 0.91 for proportion of consultations with antibiotics prescribed, defining practice and participant eligibility for analysis requires careful consideration.

Conclusions

Cluster randomized trials may be performed efficiently in large samples from UK general practices using the electronic health records of a primary care database. The geographical dispersal of trial sites presents a difficulty for research governance approval and intervention implementation. Pretrial data analyses should inform trial design and analysis plans.

Trial registration

Current Controlled Trials ISRCTN47558792 and ISRCTN35701810 (both registered on 17 March 2010).
Literature
1.
go back to reference Staa TP, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, Delaney B, Smeeth L: Pragmatic randomized trials using routine electronic health records: putting them to the test. BMJ. 2012, 344: e55-10.1136/bmj.e55.CrossRefPubMedPubMedCentral Staa TP, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, Delaney B, Smeeth L: Pragmatic randomized trials using routine electronic health records: putting them to the test. BMJ. 2012, 344: e55-10.1136/bmj.e55.CrossRefPubMedPubMedCentral
2.
go back to reference Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K: A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009, 62: 464-75. 10.1016/j.jclinepi.2008.12.011.CrossRefPubMed Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K: A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009, 62: 464-75. 10.1016/j.jclinepi.2008.12.011.CrossRefPubMed
3.
go back to reference Fiore LD, Brophy M, Ferguson RE, D'Avolio L, Hermos JA, Lew RA, Doros G, Conrad CH, O'Neil JA, Sabin TP, Kaufman J, Swartz SL, Lawler E, Liang MH, Gaziano JM, Lavori PW: A point-of-care clinical trial comparing insulin administered using a sliding scale versus a weight-based regimen. Clinical trials. 2011, 8: 183-95. 10.1177/1740774511398368.CrossRefPubMedPubMedCentral Fiore LD, Brophy M, Ferguson RE, D'Avolio L, Hermos JA, Lew RA, Doros G, Conrad CH, O'Neil JA, Sabin TP, Kaufman J, Swartz SL, Lawler E, Liang MH, Gaziano JM, Lavori PW: A point-of-care clinical trial comparing insulin administered using a sliding scale versus a weight-based regimen. Clinical trials. 2011, 8: 183-95. 10.1177/1740774511398368.CrossRefPubMedPubMedCentral
5.
go back to reference Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ: Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010, 69: 4-14. 10.1111/j.1365-2125.2009.03537.x.CrossRefPubMedPubMedCentral Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ: Validation and validity of diagnoses in the General Practice Research Database: a systematic review. Br J Clin Pharmacol. 2010, 69: 4-14. 10.1111/j.1365-2125.2009.03537.x.CrossRefPubMedPubMedCentral
6.
go back to reference Herrett E, Shah AD, Boggon R, Denaxas S, Smeeth L, van Staa T, Timmis A, Hemingway H: Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study. BMJ. 2013, 346: f2350-10.1136/bmj.f2350.CrossRefPubMedPubMedCentral Herrett E, Shah AD, Boggon R, Denaxas S, Smeeth L, van Staa T, Timmis A, Hemingway H: Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study. BMJ. 2013, 346: f2350-10.1136/bmj.f2350.CrossRefPubMedPubMedCentral
7.
go back to reference Dregan A, Moller H, Murray-Thomas T, Gulliford MC: Validity of cancer diagnosis in a primary care database compared with linked cancer registrations in England. Population-based cohort study. Cancer epidemiol. 2012, 36: 425-9. 10.1016/j.canep.2012.05.013.CrossRefPubMed Dregan A, Moller H, Murray-Thomas T, Gulliford MC: Validity of cancer diagnosis in a primary care database compared with linked cancer registrations in England. Population-based cohort study. Cancer epidemiol. 2012, 36: 425-9. 10.1016/j.canep.2012.05.013.CrossRefPubMed
8.
go back to reference Gulliford MC, van Staa T, McDermott L, Dregan A, McCann G, Ashworth M, Charlton J, Grieve AP, Little P, Moore MV, Yardley L, eCRT Research Team: Cluster randomized trial in the general practice research database: 1. electronic decision support to reduce antibiotic prescribing in primary care (eCRT study). Trials. 2011, 12: 115-10.1186/1745-6215-12-115.CrossRefPubMedPubMedCentral Gulliford MC, van Staa T, McDermott L, Dregan A, McCann G, Ashworth M, Charlton J, Grieve AP, Little P, Moore MV, Yardley L, eCRT Research Team: Cluster randomized trial in the general practice research database: 1. electronic decision support to reduce antibiotic prescribing in primary care (eCRT study). Trials. 2011, 12: 115-10.1186/1745-6215-12-115.CrossRefPubMedPubMedCentral
9.
go back to reference Dregan A, van Staa T, McDermott L, McCann G, Ashworth M, Charlton J, Wolfe C, Rudd A, Yardley L, Gulliford M, eCRT Research Team: Cluster randomized trial in the general practice research database: 2. secondary prevention after first stroke (eCRT study): study protocol for a randomized controlled trial. Trials. 2012, 13: 181-10.1186/1745-6215-13-181.CrossRefPubMedPubMedCentral Dregan A, van Staa T, McDermott L, McCann G, Ashworth M, Charlton J, Wolfe C, Rudd A, Yardley L, Gulliford M, eCRT Research Team: Cluster randomized trial in the general practice research database: 2. secondary prevention after first stroke (eCRT study): study protocol for a randomized controlled trial. Trials. 2012, 13: 181-10.1186/1745-6215-13-181.CrossRefPubMedPubMedCentral
10.
go back to reference Gulliford M, van Staa T, Dregan A, McDermott L, McCann G, Asworth M, Charlton J, Little P, Moore MV, Yardley L: Utilising electronic health records for intervention research. cluster randomized trial to reduce antibiotic prescribing in primary care (eCRT study). Ann Fam Med. 2014, in press Gulliford M, van Staa T, Dregan A, McDermott L, McCann G, Asworth M, Charlton J, Little P, Moore MV, Yardley L: Utilising electronic health records for intervention research. cluster randomized trial to reduce antibiotic prescribing in primary care (eCRT study). Ann Fam Med. 2014, in press
12.
go back to reference McDermott L, Yardley L, Little P, Ashworth M, Gulliford M, and the eCRT Research Team: Developing a computer delivered, theory based intervention for guideline implementation in general practice. BMC Family Practice. 2010, 11: 90-10.1186/1471-2296-11-90.CrossRefPubMedPubMedCentral McDermott L, Yardley L, Little P, Ashworth M, Gulliford M, and the eCRT Research Team: Developing a computer delivered, theory based intervention for guideline implementation in general practice. BMC Family Practice. 2010, 11: 90-10.1186/1471-2296-11-90.CrossRefPubMedPubMedCentral
13.
go back to reference Gulliford M, Latinovic R, Charlton J, Little P, van Staa T, Ashworth M: Selective decrease in consultations and antibiotic prescribing for acute respiratory tract infections in UK primary care up to 2006. J Public Health (Oxford). 2009, 31: 512-20. 10.1093/pubmed/fdp081.CrossRef Gulliford M, Latinovic R, Charlton J, Little P, van Staa T, Ashworth M: Selective decrease in consultations and antibiotic prescribing for acute respiratory tract infections in UK primary care up to 2006. J Public Health (Oxford). 2009, 31: 512-20. 10.1093/pubmed/fdp081.CrossRef
14.
go back to reference National Institute for Health and Clinical Excellence: Prescribing of antibiotics for self-limiting respiratory tract infections in adults and children in primary care. 2008, London: National Institute for Health and Clinical Excellence National Institute for Health and Clinical Excellence: Prescribing of antibiotics for self-limiting respiratory tract infections in adults and children in primary care. 2008, London: National Institute for Health and Clinical Excellence
16.
go back to reference Hutton JL: Are distinctive ethical principles required for cluster randomized controlled trials?. Stat Med. 2001, 20: 473-88. 10.1002/1097-0258(20010215)20:3<473::AID-SIM805>3.0.CO;2-D.CrossRefPubMed Hutton JL: Are distinctive ethical principles required for cluster randomized controlled trials?. Stat Med. 2001, 20: 473-88. 10.1002/1097-0258(20010215)20:3<473::AID-SIM805>3.0.CO;2-D.CrossRefPubMed
17.
go back to reference Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, Taljaard M, Ottawa Ethics of Cluster Randomized Trials Consensus G: The Ottawa statement on the ethical design and conduct of cluster randomized trials. PLoS Med. 2012, 9: e1001346-10.1371/journal.pmed.1001346.CrossRefPubMedPubMedCentral Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, Taljaard M, Ottawa Ethics of Cluster Randomized Trials Consensus G: The Ottawa statement on the ethical design and conduct of cluster randomized trials. PLoS Med. 2012, 9: e1001346-10.1371/journal.pmed.1001346.CrossRefPubMedPubMedCentral
19.
go back to reference Kerry SM, Bland JM: Unequal cluster sizes for trials in English and Welsh general practice: implications for sample size calculations. Stat Med. 2001, 20: 377-90. 10.1002/1097-0258(20010215)20:3<377::AID-SIM799>3.0.CO;2-N.CrossRefPubMed Kerry SM, Bland JM: Unequal cluster sizes for trials in English and Welsh general practice: implications for sample size calculations. Stat Med. 2001, 20: 377-90. 10.1002/1097-0258(20010215)20:3<377::AID-SIM799>3.0.CO;2-N.CrossRefPubMed
20.
go back to reference Eldridge SM, Ashby D, Kerry S: Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. Int J Epidemiol. 2006, 35: 1292-300. 10.1093/ije/dyl129.CrossRefPubMed Eldridge SM, Ashby D, Kerry S: Sample size for cluster randomized trials: effect of coefficient of variation of cluster size and analysis method. Int J Epidemiol. 2006, 35: 1292-300. 10.1093/ije/dyl129.CrossRefPubMed
21.
go back to reference Dregan A, Toschke MA, Wolfe CD, Rudd A, Ashworth M, Gulliford MC, and the eCRT Research Team: Utility of electronic patient records in primary care for stroke secondary prevention trials. BMC Public Health. 2011, 11: 86-10.1186/1471-2458-11-86.CrossRefPubMedPubMedCentral Dregan A, Toschke MA, Wolfe CD, Rudd A, Ashworth M, Gulliford MC, and the eCRT Research Team: Utility of electronic patient records in primary care for stroke secondary prevention trials. BMC Public Health. 2011, 11: 86-10.1186/1471-2458-11-86.CrossRefPubMedPubMedCentral
22.
go back to reference Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ: Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004, 57: 785-94. 10.1016/j.jclinepi.2003.12.013.CrossRefPubMed Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ: Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004, 57: 785-94. 10.1016/j.jclinepi.2003.12.013.CrossRefPubMed
23.
go back to reference Hayes RJ, Bennett S: Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999, 28: 319-26. 10.1093/ije/28.2.319.CrossRefPubMed Hayes RJ, Bennett S: Simple sample size calculation for cluster-randomized trials. Int J Epidemiol. 1999, 28: 319-26. 10.1093/ije/28.2.319.CrossRefPubMed
24.
go back to reference Ashworth M, Charlton J, Ballard K, Latinovic R, Gulliford M: Variations in antibiotic prescribing and consultation rates for acute respiratory infection in UK general practices 1995–2000. BrJ Gen Pract. 2005, 55: 603-8. Ashworth M, Charlton J, Ballard K, Latinovic R, Gulliford M: Variations in antibiotic prescribing and consultation rates for acute respiratory infection in UK general practices 1995–2000. BrJ Gen Pract. 2005, 55: 603-8.
25.
go back to reference Boggon R, Hubbard R, Smeeth L, Gulliford M, Cassell J, Eaton S, Pirmohamed M, van Staa TP: Variability of antibiotic prescribing in patients with chronic obstructive pulmonary disease exacerbations: a cohort study. BMC Pulmonary Medicine. 2013, 13: 32-10.1186/1471-2466-13-32.CrossRefPubMedPubMedCentral Boggon R, Hubbard R, Smeeth L, Gulliford M, Cassell J, Eaton S, Pirmohamed M, van Staa TP: Variability of antibiotic prescribing in patients with chronic obstructive pulmonary disease exacerbations: a cohort study. BMC Pulmonary Medicine. 2013, 13: 32-10.1186/1471-2466-13-32.CrossRefPubMedPubMedCentral
26.
go back to reference Teerenstra S, Eldridge S, Graff M, de Hoop E, Borm GF: A simple sample size formula for analysis of covariance in cluster randomized trials. Stat Med. 2012, 31: 2169-78. 10.1002/sim.5352.CrossRefPubMed Teerenstra S, Eldridge S, Graff M, de Hoop E, Borm GF: A simple sample size formula for analysis of covariance in cluster randomized trials. Stat Med. 2012, 31: 2169-78. 10.1002/sim.5352.CrossRefPubMed
27.
go back to reference Borm GF, Fransen J, Lemmens WAJG: A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007, 60: 1234-8. 10.1016/j.jclinepi.2007.02.006.CrossRefPubMed Borm GF, Fransen J, Lemmens WAJG: A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007, 60: 1234-8. 10.1016/j.jclinepi.2007.02.006.CrossRefPubMed
30.
go back to reference Employers NHS: Quality and outcomes framework guidance. 2014, London: NHS Confederation Employers NHS: Quality and outcomes framework guidance. 2014, London: NHS Confederation
31.
go back to reference Ukoumunne OC, Carlin JB, Gulliford MC: A simulation study of odds ratio estimation for binary outcomes from cluster randomized trials. Stat Med. 2007, 26: 3415-28.CrossRefPubMed Ukoumunne OC, Carlin JB, Gulliford MC: A simulation study of odds ratio estimation for binary outcomes from cluster randomized trials. Stat Med. 2007, 26: 3415-28.CrossRefPubMed
32.
go back to reference Gulliford MC, Charlton J, Ashworth M, Rudd AG, Toschke AM: Selection of medical diagnostic codes for analysis of electronic patient records. Application to stroke in a primary care database. PloS ONE. 2009, 4: e7168-10.1371/journal.pone.0007168.CrossRefPubMedPubMedCentral Gulliford MC, Charlton J, Ashworth M, Rudd AG, Toschke AM: Selection of medical diagnostic codes for analysis of electronic patient records. Application to stroke in a primary care database. PloS ONE. 2009, 4: e7168-10.1371/journal.pone.0007168.CrossRefPubMedPubMedCentral
Metadata
Title
Cluster randomized trials utilizing primary care electronic health records: methodological issues in design, conduct, and analysis (eCRT Study)
Authors
Martin C Gulliford
Tjeerd P van Staa
Lisa McDermott
Gerard McCann
Judith Charlton
Alex Dregan
for the eCRT Research Team
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Trials / Issue 1/2014
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-15-220

Other articles of this Issue 1/2014

Trials 1/2014 Go to the issue