Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Research article

How pragmatic or explanatory is the randomized, controlled trial? The application and enhancement of the PRECIS tool to the evaluation of a smoking cessation trial

Authors: Peter Selby, Gerald Brosky, Paul I Oh, Vincent Raymond, Suzanne Ranger

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

Numerous explanatory randomized trials support the efficacy of chronic disease interventions, including smoking cessation treatments. However, there is often inadequate adoption of these interventions for various reasons, one being the limitation of generalizability of the explanatory studies in real-world settings. Randomized controlled trials can be rated as more explanatory versus pragmatic along 10 dimensions. Pragmatic randomized clinical trials generate more realistic estimates of effectiveness with greater relevance to clinical practice and for health resource allocation decisions. However, there is no clear method to scale each dimension during the trial design phase to ensure that the design matches the intended purpose of the study.

Methods

We designed a pragmatic, randomized, controlled study to maximize external validity by addressing several barriers to smoking cessation therapy in ambulatory care. We analyzed our design and methods using the recently published ‘Pragmatic–Explanatory Continuum Indicatory Summary (PRECIS)’ tool, a qualitative method to assess trial design across 10 domains. We added a 20-point numerical rating scale and a modified Delphi process to improve consensus in rating these domains.

Results

After two rounds of review, there was consensus on all 10 domains of study design. No single domain was scored as either fully pragmatic or fully explanatory; but overall, the study scored high on pragmatism.

Conclusions

This addition to the PRECIS tool may assist other trial designers working with interdisciplinary co-investigators to rate their study design while building consensus.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRefPubMed Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRefPubMed
2.
go back to reference Guyatt GH, Sackett DL, Cook DJ: Users’ guides to the medical literature. II. How to use an article about therapy or prevention. B. What were the results and will they help me in caring for my patients? Evidence-Based Medicine Working Group. JAMA. 1994, 271: 59-63. 10.1001/jama.1994.03510250075039.CrossRefPubMed Guyatt GH, Sackett DL, Cook DJ: Users’ guides to the medical literature. II. How to use an article about therapy or prevention. B. What were the results and will they help me in caring for my patients? Evidence-Based Medicine Working Group. JAMA. 1994, 271: 59-63. 10.1001/jama.1994.03510250075039.CrossRefPubMed
3.
go back to reference Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.CrossRefPubMed Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.CrossRefPubMed
4.
go back to reference March JS, Silva SG, Compton S, Shapiro M, Califf R, Krishnan R: The case for practical clinical trials in psychiatry. Am J Psychiatry. 2005, 162: 836-846. 10.1176/appi.ajp.162.5.836.CrossRefPubMed March JS, Silva SG, Compton S, Shapiro M, Califf R, Krishnan R: The case for practical clinical trials in psychiatry. Am J Psychiatry. 2005, 162: 836-846. 10.1176/appi.ajp.162.5.836.CrossRefPubMed
5.
go back to reference Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed Glasgow RE, Emmons KM: How can we increase translation of research into practice? Types of evidence needed. Annu Rev Public Health. 2007, 28: 413-433. 10.1146/annurev.publhealth.28.021406.144145.CrossRefPubMed
6.
go back to reference Liberati A: The relationship between clinical trials and clinical practice: the risks of underestimating its complexity. Stat Med. 1994, 13: 1485-1491. 10.1002/sim.4780131326.CrossRefPubMed Liberati A: The relationship between clinical trials and clinical practice: the risks of underestimating its complexity. Stat Med. 1994, 13: 1485-1491. 10.1002/sim.4780131326.CrossRefPubMed
7.
go back to reference Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA: Practical clinical trials for translating research to practice: design and measurement recommendations. Med Care. 2005, 43: 551-557. 10.1097/01.mlr.0000163645.41407.09.CrossRefPubMed Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA: Practical clinical trials for translating research to practice: design and measurement recommendations. Med Care. 2005, 43: 551-557. 10.1097/01.mlr.0000163645.41407.09.CrossRefPubMed
8.
go back to reference Gartlehner G, Hansen RA, Nissman D, Lohr KN, Carey TS: A simple and valid tool distinguished efficacy from effectiveness studies. J Clin Epidemiol. 2006, 59: 1040-1048. 10.1016/j.jclinepi.2006.01.011.CrossRefPubMed Gartlehner G, Hansen RA, Nissman D, Lohr KN, Carey TS: A simple and valid tool distinguished efficacy from effectiveness studies. J Clin Epidemiol. 2006, 59: 1040-1048. 10.1016/j.jclinepi.2006.01.011.CrossRefPubMed
10.
go back to reference Hannan EL: Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. JACC Cardiovasc Interv. 2008, 1: 211-217. 10.1016/j.jcin.2008.01.008.CrossRefPubMed Hannan EL: Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. JACC Cardiovasc Interv. 2008, 1: 211-217. 10.1016/j.jcin.2008.01.008.CrossRefPubMed
11.
go back to reference Mullins CD, Whicher D, Reese ES, Tunis S: Generating evidence for comparative effectiveness research using more pragmatic randomized controlled trials. Pharmacoeconomics. 2010, 28: 969-976. 10.2165/11536160-000000000-00000.CrossRefPubMed Mullins CD, Whicher D, Reese ES, Tunis S: Generating evidence for comparative effectiveness research using more pragmatic randomized controlled trials. Pharmacoeconomics. 2010, 28: 969-976. 10.2165/11536160-000000000-00000.CrossRefPubMed
12.
go back to reference 2008 PHS Guideline Update Panel, Liaisons, and Staff: Treating tobacco use and dependence: 2008 update U.S. Public Health Service Clinical Practice Guideline executive summary. Respir Care. 2008, 53: 1217-1222. 2008 PHS Guideline Update Panel, Liaisons, and Staff: Treating tobacco use and dependence: 2008 update U.S. Public Health Service Clinical Practice Guideline executive summary. Respir Care. 2008, 53: 1217-1222.
13.
go back to reference Cahill K, Stead LF, Lancaster T: Nicotine receptor partial agonists for smoking cessation. Cochrane Database Syst Rev. 2010, 12: CD006103-PubMed Cahill K, Stead LF, Lancaster T: Nicotine receptor partial agonists for smoking cessation. Cochrane Database Syst Rev. 2010, 12: CD006103-PubMed
14.
go back to reference Hughes JR, Stead LF, Lancaster T: Antidepressants for smoking cessation. Cochrane Database Syst Rev. 2007, 1: CD000031-PubMed Hughes JR, Stead LF, Lancaster T: Antidepressants for smoking cessation. Cochrane Database Syst Rev. 2007, 1: CD000031-PubMed
15.
go back to reference Stead LF, Perera R, Bullen C, Mant D, Lancaster T: Nicotine replacement therapy for smoking cessation. Cochrane Database Syst Rev. 2008, 1: CD000146-PubMed Stead LF, Perera R, Bullen C, Mant D, Lancaster T: Nicotine replacement therapy for smoking cessation. Cochrane Database Syst Rev. 2008, 1: CD000146-PubMed
16.
go back to reference Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K: A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009, 62: 464-475. 10.1016/j.jclinepi.2008.12.011.CrossRefPubMed Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K: A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. 2009, 62: 464-475. 10.1016/j.jclinepi.2008.12.011.CrossRefPubMed
17.
go back to reference Riddle DL, Johnson RE, Jensen MP, Keefe FJ, Kroenke K, Bair MJ, Ang DC: The Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) instrument was useful for refining a randomized trial design: experiences from an investigative team. J Clin Epidemiol. 2010, 63: 1271-1275. 10.1016/j.jclinepi.2010.03.006.CrossRefPubMedPubMedCentral Riddle DL, Johnson RE, Jensen MP, Keefe FJ, Kroenke K, Bair MJ, Ang DC: The Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) instrument was useful for refining a randomized trial design: experiences from an investigative team. J Clin Epidemiol. 2010, 63: 1271-1275. 10.1016/j.jclinepi.2010.03.006.CrossRefPubMedPubMedCentral
18.
go back to reference Bratton DJ, Nunn AJ: Alternative approaches to tuberculosis treatment evaluation: the role of pragmatic trials. Int J Tuberc Lung Dis. 2011, 15: 440-446. 10.5588/ijtld.10.0732.CrossRefPubMed Bratton DJ, Nunn AJ: Alternative approaches to tuberculosis treatment evaluation: the role of pragmatic trials. Int J Tuberc Lung Dis. 2011, 15: 440-446. 10.5588/ijtld.10.0732.CrossRefPubMed
19.
go back to reference Tosh G, Soares-Weiser K, Adams CE: Pragmatic vs explanatory trials: the pragmascope tool to help measure differences in protocols of mental health randomized controlled trials. Dialogues Clin Neurosci. 2011, 13: 209-215.PubMedPubMedCentral Tosh G, Soares-Weiser K, Adams CE: Pragmatic vs explanatory trials: the pragmascope tool to help measure differences in protocols of mental health randomized controlled trials. Dialogues Clin Neurosci. 2011, 13: 209-215.PubMedPubMedCentral
20.
go back to reference Glasgow RE, Gaglio B, Bennett G, Jerome GJ, Yeh HC, Sarwer DB, Appel L, Colditz G, Wadden TA, Wells B: Applying the PRECIS criteria to describe three effectiveness trials of weight loss in obese patients with comorbid conditions. Health Serv Res. 2011, 10.1111/j.1475-6773.2011.01347.x.. [Epub ahead of print] Nov 2 Glasgow RE, Gaglio B, Bennett G, Jerome GJ, Yeh HC, Sarwer DB, Appel L, Colditz G, Wadden TA, Wells B: Applying the PRECIS criteria to describe three effectiveness trials of weight loss in obese patients with comorbid conditions. Health Serv Res. 2011, 10.1111/j.1475-6773.2011.01347.x.. [Epub ahead of print] Nov 2
21.
go back to reference Koppenaal T, Linmans J, Knottnerus JA, Spigt M: Pragmatic vs. explanatory: an adaptation of the PRECIS tool helps to judge the applicability of systematic reviews for daily practice. J Clin Epidemiol. 2011, 64: 1095-1101. 10.1016/j.jclinepi.2010.11.020.CrossRefPubMed Koppenaal T, Linmans J, Knottnerus JA, Spigt M: Pragmatic vs. explanatory: an adaptation of the PRECIS tool helps to judge the applicability of systematic reviews for daily practice. J Clin Epidemiol. 2011, 64: 1095-1101. 10.1016/j.jclinepi.2010.11.020.CrossRefPubMed
22.
go back to reference Spigt MG, Kotz D: Comment on: ‘a simple and valid tool distinguished efficacy from effectiveness studies’. J Clin Epidemiol. 2007, 60: 753-755.CrossRefPubMed Spigt MG, Kotz D: Comment on: ‘a simple and valid tool distinguished efficacy from effectiveness studies’. J Clin Epidemiol. 2007, 60: 753-755.CrossRefPubMed
23.
go back to reference Mullen PM: Delphi: myths and reality. J Health Organ Manag. 2003, 17: 37-52. 10.1108/14777260310469319.CrossRefPubMed Mullen PM: Delphi: myths and reality. J Health Organ Manag. 2003, 17: 37-52. 10.1108/14777260310469319.CrossRefPubMed
Metadata
Title
How pragmatic or explanatory is the randomized, controlled trial? The application and enhancement of the PRECIS tool to the evaluation of a smoking cessation trial
Authors
Peter Selby
Gerald Brosky
Paul I Oh
Vincent Raymond
Suzanne Ranger
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-101

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue