Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

What’s the uptake? Pragmatic RCTs may be used to estimate uptake, and thereby population impact of interventions, but better reporting of trial recruitment processes is needed

Authors: Katy J. L. Bell, Amanda McCullough, Chris Del Mar, Paul Glasziou

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Effectiveness of interventions in pragmatic trials may not translate directly into population impact, because of limited uptake by clinicians and/or the public. Uptake of an intervention is influenced by a number of factors.

Methods

We propose a method for calculating population impact of clinical interventions that accounts for the intervention uptake. We suggest that population impact may be estimated by multiplying the two key components: (1) the effectiveness of the intervention in pragmatic trials (trial effect); and, (2) its uptake in clinical practice. We argue that participation rates in trials may be a valid proxy for uptake in clinical practice and, in combination with trial effectiveness estimates, be used to rank interventions by their likely population impact. We illustrate the method using the example of four interventions to decrease antibiotic prescription for acute respiratory infections in primary care: delayed prescribing, procalcitonin test, C-Reactive Protein, shared decision making.

Results

In order to estimate uptake of interventions from trial data we need detailed reporting on the recruitment processes used for clinician participation in the trials. In the antibiotic prescribing example, between 75 and 91% of the population would still be prescribed or consume antibiotics because effective interventions were not taken up. Of the four interventions considered, we found that delayed prescribing would have the highest population impact and shared decision making the lowest.

Conclusion

Estimates of uptake and population impact of an intervention may be possible from pragmatic RCTs, provided the recruitment processes for these trials are adequately reported (which currently few of them are). Further validation of this method using empirical data on intervention uptake in the real world would support use of this method to decide on public funding of interventions.
Literature
1.
go back to reference Sackett DL. The Principles behind the tactics of performing therapeutic trials. In: Haynes RB, Sackett DL, Guyatt GH, Tugwell P, editors. Clinical epidemiology: how to do clinical practice research. Philadelphia: Lippincott, Williams and Wilkins; 2006. p. 183–8. Sackett DL. The Principles behind the tactics of performing therapeutic trials. In: Haynes RB, Sackett DL, Guyatt GH, Tugwell P, editors. Clinical epidemiology: how to do clinical practice research. Philadelphia: Lippincott, Williams and Wilkins; 2006. p. 183–8.
2.
go back to reference Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.CrossRefPubMedPubMedCentral Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.CrossRefPubMedPubMedCentral
4.
go back to reference Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967;20:637–48.CrossRefPubMed Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967;20:637–48.CrossRefPubMed
5.
go back to reference Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009;62:464–75.CrossRefPubMed Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009;62:464–75.CrossRefPubMed
6.
go back to reference Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.CrossRefPubMed Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.CrossRefPubMed
7.
go back to reference Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008;337:a2390.
9.
go back to reference Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–7.CrossRefPubMedPubMedCentral Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93:1261–7.CrossRefPubMedPubMedCentral
10.
go back to reference Glasziou P, Haynes B. The paths from research to improved health outcomes. Evid Based Med. 2005;10:4–7.CrossRef Glasziou P, Haynes B. The paths from research to improved health outcomes. Evid Based Med. 2005;10:4–7.CrossRef
11.
go back to reference Grobbee EJ, van der Vlugt M, van Vuuren A, Stroobants AK, Mallant-Hent R, Lansdorp-Vogelaar I, Bossuyt P, Kuipers EJ, Dekker E, Spaander M. 176 comparison of colonoscopy. Sigmoidoscopy and Multiple Rounds of FIT-Based Colorectal Cancer Screening: Long-Term Follow-Up Gastroenterol. 2016;150:S45. Grobbee EJ, van der Vlugt M, van Vuuren A, Stroobants AK, Mallant-Hent R, Lansdorp-Vogelaar I, Bossuyt P, Kuipers EJ, Dekker E, Spaander M. 176 comparison of colonoscopy. Sigmoidoscopy and Multiple Rounds of FIT-Based Colorectal Cancer Screening: Long-Term Follow-Up Gastroenterol. 2016;150:S45.
12.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. On behalf of the “psychological theory” group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33.CrossRefPubMedPubMedCentral Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. On behalf of the “psychological theory” group. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14:26–33.CrossRefPubMedPubMedCentral
13.
go back to reference Little P, Stuart B, Hobbs FDR, Butler CC, Hay AD, Delaney B, Campbell J, Broomfield S, Barratt P, Hood K, et al. Antibiotic prescription strategies for acute sore throat: a prospective observational cohort study. Lancet Infect Dis. 2014;14:213–9.CrossRefPubMed Little P, Stuart B, Hobbs FDR, Butler CC, Hay AD, Delaney B, Campbell J, Broomfield S, Barratt P, Hood K, et al. Antibiotic prescription strategies for acute sore throat: a prospective observational cohort study. Lancet Infect Dis. 2014;14:213–9.CrossRefPubMed
14.
go back to reference Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014. Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
15.
go back to reference SAS software, Version 9.4 of the SAS System for Unix. Copyright © 2002–2012 by SAS Institute Inc. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc., Cary, NC, USA. SAS software, Version 9.4 of the SAS System for Unix. Copyright © 2002–2012 by SAS Institute Inc. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks of SAS Institute Inc., Cary, NC, USA.
16.
go back to reference Dowell J, Pitkethly M, Bain J, Martin S. A randomised controlled trial of delayed antibiotic prescribing as a strategy for managing uncomplicated respiratory tract infection in primary care. BJGP. 2001;51:200–5.PubMedPubMedCentral Dowell J, Pitkethly M, Bain J, Martin S. A randomised controlled trial of delayed antibiotic prescribing as a strategy for managing uncomplicated respiratory tract infection in primary care. BJGP. 2001;51:200–5.PubMedPubMedCentral
17.
go back to reference Briel M, Schuetz P, Mueller B, Young J, Schild U, Nusbaumer C, Periat P, Bucher HC, Christ-Crain M. Procalcitonin-guided antibiotic use vs a standard approach for acute respiratory tract infections in primary care. Arch Intern Med. 2008;168:2000–7.CrossRefPubMed Briel M, Schuetz P, Mueller B, Young J, Schild U, Nusbaumer C, Periat P, Bucher HC, Christ-Crain M. Procalcitonin-guided antibiotic use vs a standard approach for acute respiratory tract infections in primary care. Arch Intern Med. 2008;168:2000–7.CrossRefPubMed
18.
go back to reference Diederichsen HZ, Skamling M, Diederichsen A, Grinsted P, Antonsen S, Petersen PH, Munck AP, Kragstrup J. Randomised controlled trial of CRP rapid test as a guide to treatment of respiratory infections in general practice. Scand J Prim Health Care. 2000;18:39–43.CrossRefPubMed Diederichsen HZ, Skamling M, Diederichsen A, Grinsted P, Antonsen S, Petersen PH, Munck AP, Kragstrup J. Randomised controlled trial of CRP rapid test as a guide to treatment of respiratory infections in general practice. Scand J Prim Health Care. 2000;18:39–43.CrossRefPubMed
19.
go back to reference Briel M, Langewitz W, Tschudi P, Young J, Hugenschmidt C, Bucher HC. Communication training and antibiotic use in acute respiratory tract infections. A cluster randomised controlled trial in general practice. Swiss Med Wkly. 2006;136:241–7.PubMed Briel M, Langewitz W, Tschudi P, Young J, Hugenschmidt C, Bucher HC. Communication training and antibiotic use in acute respiratory tract infections. A cluster randomised controlled trial in general practice. Swiss Med Wkly. 2006;136:241–7.PubMed
20.
go back to reference Altiner A, Brockmann S, Sielk M, Wilm S, Wegscheider K, Abholz HH. Reducing antibiotic prescriptions for acute cough by motivating GPs to change their attitudes to communication and empowering patients: a cluster-randomized intervention study. J Antimicrob Chemother. 2007;60:638–44.CrossRefPubMed Altiner A, Brockmann S, Sielk M, Wilm S, Wegscheider K, Abholz HH. Reducing antibiotic prescriptions for acute cough by motivating GPs to change their attitudes to communication and empowering patients: a cluster-randomized intervention study. J Antimicrob Chemother. 2007;60:638–44.CrossRefPubMed
21.
go back to reference Legare F, Labrecque M, Cauchon M, Castel J, Turcotte S, Grimshaw J. Training family physicians in shared decision-making to reduce the overuse of antibiotics in acute respiratory infections: a cluster randomized trial. CMAJ. 2012;184:E726–34.CrossRefPubMedPubMedCentral Legare F, Labrecque M, Cauchon M, Castel J, Turcotte S, Grimshaw J. Training family physicians in shared decision-making to reduce the overuse of antibiotics in acute respiratory infections: a cluster randomized trial. CMAJ. 2012;184:E726–34.CrossRefPubMedPubMedCentral
22.
23.
go back to reference Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E: Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 383:267–276. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E: Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 383:267–276.
24.
go back to reference Rebnord IK, Hunskaar S, Gjesdal S, Hetlevik Ø. Point-of-care testing with CRP in primary care: a registry-based observational study from Norway. BMC Fam Pract. 2015;16(1):170.CrossRefPubMedPubMedCentral Rebnord IK, Hunskaar S, Gjesdal S, Hetlevik Ø. Point-of-care testing with CRP in primary care: a registry-based observational study from Norway. BMC Fam Pract. 2015;16(1):170.CrossRefPubMedPubMedCentral
25.
go back to reference Spurling GK, Del Mar CB, Dooley L, Foxlee R, Farley R: Delayed antibiotics for respiratory infections. Cochrane Database Syst Rev. 2013,4:Cd004417. Spurling GK, Del Mar CB, Dooley L, Foxlee R, Farley R: Delayed antibiotics for respiratory infections. Cochrane Database Syst Rev. 2013,4:Cd004417.
26.
go back to reference Schuetz P, Muller B, Christ-Crain M, Stolz D, Tamm M, Bouadma L, Luyt CE, Wolff M, Chastre J, Tubach F et al: Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections. Cochrane Database Syst Rev. 2012,9:Cd007498. Schuetz P, Muller B, Christ-Crain M, Stolz D, Tamm M, Bouadma L, Luyt CE, Wolff M, Chastre J, Tubach F et al: Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections. Cochrane Database Syst Rev. 2012,9:Cd007498.
27.
go back to reference Aabenhus R, Jensen JU, Jorgensen KJ, Hrobjartsson A, Bjerrum L. Biomarkers as point-of-care tests to guide prescription of antibiotics in patients with acute respiratory infections in primary care. Cochrane Database Syst Rev.. 2014,11:Cd010130. Aabenhus R, Jensen JU, Jorgensen KJ, Hrobjartsson A, Bjerrum L. Biomarkers as point-of-care tests to guide prescription of antibiotics in patients with acute respiratory infections in primary care. Cochrane Database Syst Rev.. 2014,11:Cd010130.
28.
go back to reference Coxeter P, Del Mar CB, McGregor L, Beller EM, Hoffmann TC. Interventions to facilitate shared decision making to address antibiotic use for acute respiratory infections in primary care. Cochrane Database Syst Rev. 2015:CD010907. Coxeter P, Del Mar CB, McGregor L, Beller EM, Hoffmann TC. Interventions to facilitate shared decision making to address antibiotic use for acute respiratory infections in primary care. Cochrane Database Syst Rev. 2015:CD010907.
Metadata
Title
What’s the uptake? Pragmatic RCTs may be used to estimate uptake, and thereby population impact of interventions, but better reporting of trial recruitment processes is needed
Authors
Katy J. L. Bell
Amanda McCullough
Chris Del Mar
Paul Glasziou
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0443-0

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue