Skip to main content
Top
Published in: Trials 1/2013

Open Access 01-12-2013 | Review

Active ingredients are reported more often for pharmacologic than non-pharmacologic interventions: an illustrative review of reporting practices in titles and abstracts

Authors: Nicola McCleary, Eilidh M Duncan, Fiona Stewart, Jill J Francis

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Key components of healthcare interventions include ‘active ingredients’ (intervention components that can be specifically linked to effects on outcomes such that, were they omitted, the intervention would be ineffective). These should be reported in titles and abstracts of published reports of randomized controlled trials (RCTs). However, reporting of non-pharmacologic interventions (NPIs), particularly behaviour change interventions (BCIs), is difficult, owing to their complexity. This illustrative review compares how pharmacologic interventions (PIs), NPIs and BCIs are specified in titles and abstracts to clarify how reporting of NPIs and BCIs can be improved. MEDLINE and Embase were searched for RCTs published in the British Medical Journal, The Journal of the American Medical Association, The New England Journal of Medicine, The Lancet and Annals of Behavioral Medicine from 2009 to March 2011. All types of intervention, participant and outcome were included. A random sample of 198 studies (sampled proportionally from included journals) stratified by intervention type (PI/NPI) was taken: 98 evaluated PIs, 96 evaluated NPIs and four evaluated both. Studies were coded for the presence or absence of key components. The frequency data were analyzed using the chi-square test. Active ingredients were named in 88% titles and 95% abstracts of PI reports, and in 51% titles and 71% abstracts of NPI reports, with a significant association between intervention type and reporting of active ingredients in titles (χ 2(1) = 28.90; P < 0.001) and abstracts (χ 2(1) = 16.94; P < 0.001). Active ingredients were named in BCI reports in 37% titles and 56% abstracts, and in other NPI reports in 66% titles and 86% abstracts. There was also a significant association between intervention type and reporting of active ingredients in titles (χ 2(1) = 6.68; P = 0.010) and abstracts (χ 2(1) = 8.66; P = 0.003). Reporting practices also differed for such components as the trial setting and intervention provider. This review highlights the need for improved reporting of NPIs (particularly BCIs) and indicates that a set of agreed labels and definitions for complex NPIs could facilitate standardized reporting. This would ensure that interventions can be faithfully replicated and that evidence for interventions can be appropriately synthesized.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral
2.
go back to reference Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P: Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008, 148: 295-309. 10.7326/0003-4819-148-4-200802190-00008.CrossRefPubMed Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P: Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008, 148: 295-309. 10.7326/0003-4819-148-4-200802190-00008.CrossRefPubMed
3.
go back to reference Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, Spring B, Trudeau KJ, Whitlock EP: Evidence-based behavioral medicine: what is it and how do we achieve it?. Ann Behav Med. 2003, 26: 161-171. 10.1207/S15324796ABM2603_01.CrossRefPubMed Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, Spring B, Trudeau KJ, Whitlock EP: Evidence-based behavioral medicine: what is it and how do we achieve it?. Ann Behav Med. 2003, 26: 161-171. 10.1207/S15324796ABM2603_01.CrossRefPubMed
4.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and Evaluating Complex Interventions: New Guidance. 2008, London: Medical Research Council Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and Evaluating Complex Interventions: New Guidance. 2008, London: Medical Research Council
5.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral
6.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
7.
go back to reference Clark AM: What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention. Soc Sci Med. 2012, 10.1016/j.socscimed.2012.03.035. Clark AM: What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention. Soc Sci Med. 2012, 10.1016/j.socscimed.2012.03.035.
8.
go back to reference Abraham C, Michie S: A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008, 27: 379-387.CrossRefPubMed Abraham C, Michie S: A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008, 27: 379-387.CrossRefPubMed
9.
go back to reference Can OS, Yilmaz AA, Hasdogan M, Alkaya F, Turhan SC, Can MF, Alanoglu Z: Has the quality of abstracts for randomised controlled trials improved since the release of Consolidated Standards of Reporting Trial guideline for abstract reporting? A survey of four high-profile anaesthesia journals. Eur J Anaesthesiol. 2011, 28: 485-492. 10.1097/EJA.0b013e32833fb96f.CrossRefPubMed Can OS, Yilmaz AA, Hasdogan M, Alkaya F, Turhan SC, Can MF, Alanoglu Z: Has the quality of abstracts for randomised controlled trials improved since the release of Consolidated Standards of Reporting Trial guideline for abstract reporting? A survey of four high-profile anaesthesia journals. Eur J Anaesthesiol. 2011, 28: 485-492. 10.1097/EJA.0b013e32833fb96f.CrossRefPubMed
10.
go back to reference Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed
11.
go back to reference von Erik E: Writing the abstract: completeness and accuracy matter. Eur J Anaesthesiol. 2011, 28: 483-484. 10.1097/EJA.0b013e328343b160.CrossRef von Erik E: Writing the abstract: completeness and accuracy matter. Eur J Anaesthesiol. 2011, 28: 483-484. 10.1097/EJA.0b013e328343b160.CrossRef
12.
go back to reference Centre for Reviews and Dissemination: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2008, York Centre for Reviews and Dissemination: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2008, York
13.
go back to reference Burns KEA, Adhikari NKJ, Kho M, Meade MO, Patel RV, Sinuff T, Cook DJ: Abstract reporting in randomized clinical trials of acute lung injury: an audit and assessment of a quality of reporting score. Crit Care Med. 2005, 33: 1937-1945. 10.1097/01.CCM.0000178361.73895.24.CrossRefPubMed Burns KEA, Adhikari NKJ, Kho M, Meade MO, Patel RV, Sinuff T, Cook DJ: Abstract reporting in randomized clinical trials of acute lung injury: an audit and assessment of a quality of reporting score. Crit Care Med. 2005, 33: 1937-1945. 10.1097/01.CCM.0000178361.73895.24.CrossRefPubMed
14.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: 869-10.1136/bmj.c869.CrossRef Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: 869-10.1136/bmj.c869.CrossRef
15.
go back to reference Boutron I, Ravaud P: Reporting guidelines for nonpharmacological trials. Randomized Clinical Trials of Nonpharmacological Treatments. Edited by: Boutron I, Ravaud P, Moher D. 2012, Florida: Chapman & Hall/CRC Press, 199-210. Boutron I, Ravaud P: Reporting guidelines for nonpharmacological trials. Randomized Clinical Trials of Nonpharmacological Treatments. Edited by: Boutron I, Ravaud P, Moher D. 2012, Florida: Chapman & Hall/CRC Press, 199-210.
16.
go back to reference Orwoll ES, Miller PD, Adachi JD, Brown J, Adler RA, Kendler D, Bucci-Rechtweg C, Readie A, Mesenbrink P, Weinstein RS: Efficacy and safety of a once-yearly i.v. infusion of zoledronic acid 5mg versus a once-weekly 70-mg oral alendronate in the treatment of male osteoporosis: a randomized, multicenter, double-blind, active-controlled study. J Bone Miner Res. 2010, 25: 2239-2250. 10.1002/jbmr.119.CrossRefPubMed Orwoll ES, Miller PD, Adachi JD, Brown J, Adler RA, Kendler D, Bucci-Rechtweg C, Readie A, Mesenbrink P, Weinstein RS: Efficacy and safety of a once-yearly i.v. infusion of zoledronic acid 5mg versus a once-weekly 70-mg oral alendronate in the treatment of male osteoporosis: a randomized, multicenter, double-blind, active-controlled study. J Bone Miner Res. 2010, 25: 2239-2250. 10.1002/jbmr.119.CrossRefPubMed
17.
go back to reference Smeulders ES, van Haastregt JC, Ambergen T, Uszko-Lencer NH, Janssen-Boyne JJ, Gorgels AP, Stoffers HE, Lodewijks-van der Bolt CL, v E JT, Kempen GI: Nurse-led self-management group programme for patients with congestive heart failure: randomized controlled trial. J Adv Nurs. 2010, 66: 1487-1499. 10.1111/j.1365-2648.2010.05318.x.CrossRefPubMed Smeulders ES, van Haastregt JC, Ambergen T, Uszko-Lencer NH, Janssen-Boyne JJ, Gorgels AP, Stoffers HE, Lodewijks-van der Bolt CL, v E JT, Kempen GI: Nurse-led self-management group programme for patients with congestive heart failure: randomized controlled trial. J Adv Nurs. 2010, 66: 1487-1499. 10.1111/j.1365-2648.2010.05318.x.CrossRefPubMed
18.
go back to reference Boutron I, Tubach F, Giraudeau B, Ravaud P: Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA. 2003, 290: 1062-1070. 10.1001/jama.290.8.1062.CrossRefPubMed Boutron I, Tubach F, Giraudeau B, Ravaud P: Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA. 2003, 290: 1062-1070. 10.1001/jama.290.8.1062.CrossRefPubMed
19.
go back to reference Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.CrossRefPubMedPubMedCentral Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.CrossRefPubMedPubMedCentral
20.
go back to reference National Institute for Health and Clinical Excellence: Behaviour Change at Population, Community and Individual Levels. 2007, London National Institute for Health and Clinical Excellence: Behaviour Change at Population, Community and Individual Levels. 2007, London
21.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The Behavior Change Technique Taxonomy (v1) of 93 hierarchically-clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 10.1007/s12160-013-9486-6. In press, 2013 Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The Behavior Change Technique Taxonomy (v1) of 93 hierarchically-clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 10.1007/s12160-013-9486-6. In press, 2013
22.
go back to reference Dombrowski SU, Sniehotta FF, Avenell AA, Coyne JC: Towards a cumulative science of behaviour change: do current conduct and reporting of behavioural interventions fall short of best practice?. Psychol Health. 2007, 22: 869-874.CrossRef Dombrowski SU, Sniehotta FF, Avenell AA, Coyne JC: Towards a cumulative science of behaviour change: do current conduct and reporting of behavioural interventions fall short of best practice?. Psychol Health. 2007, 22: 869-874.CrossRef
24.
go back to reference Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed
26.
go back to reference Higgins JPT, Deeks JJ: Chapter 7: Selecting studies and collecting data. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Edited by: Higgins JPT, Green S. 2011, London: The Cochrane Collaboration, [http://www.cochrane-handbook.org/] Higgins JPT, Deeks JJ: Chapter 7: Selecting studies and collecting data. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. Edited by: Higgins JPT, Green S. 2011, London: The Cochrane Collaboration, [http://​www.​cochrane-handbook.​org/​]
27.
go back to reference Petrie A, Sabin C: Medical Statistics at a Glance. 2005, Oxford: Blackwell Publishing Ltd, 2 Petrie A, Sabin C: Medical Statistics at a Glance. 2005, Oxford: Blackwell Publishing Ltd, 2
28.
go back to reference McCance DR, Holmes VA, Maresh MJ, Patterson CC, Walker JD, Pearson DW, Young IS: Vitamins C and E for prevention of pre-eclampsia in women with type 1 diabetes (DAPIT): a randomised placebo-controlled trial. Lancet. 2010, 376: 259-266. 10.1016/S0140-6736(10)60630-7.CrossRefPubMedPubMedCentral McCance DR, Holmes VA, Maresh MJ, Patterson CC, Walker JD, Pearson DW, Young IS: Vitamins C and E for prevention of pre-eclampsia in women with type 1 diabetes (DAPIT): a randomised placebo-controlled trial. Lancet. 2010, 376: 259-266. 10.1016/S0140-6736(10)60630-7.CrossRefPubMedPubMedCentral
29.
go back to reference Ford AL, Bergh C, Sodersten P, Sabin MA, Hollinghurst S, Hunt LP, Shield JPH: Treatment of childhood obesity by retraining eating behaviour: randomised controlled trial. BMJ. 2010, 340: 250- Ford AL, Bergh C, Sodersten P, Sabin MA, Hollinghurst S, Hunt LP, Shield JPH: Treatment of childhood obesity by retraining eating behaviour: randomised controlled trial. BMJ. 2010, 340: 250-
35.
go back to reference Michie S, Abraham C: Interventions to change health behaviours: evidence-based or evidence-inspired?. Psychol Health. 2004, 19: 29-49. 10.1080/0887044031000141199.CrossRef Michie S, Abraham C: Interventions to change health behaviours: evidence-based or evidence-inspired?. Psychol Health. 2004, 19: 29-49. 10.1080/0887044031000141199.CrossRef
36.
go back to reference Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6: e1000086-10.1371/journal.pmed.1000086.CrossRefPubMedPubMedCentral Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6: e1000086-10.1371/journal.pmed.1000086.CrossRefPubMedPubMedCentral
37.
go back to reference Francis JJ, Johnston M, Abraham C, Hardeman W, Eccles MP, Richardson M, Michie S: Development of a taxonomy to facilitate reporting of behaviour change techniques, the ‘active ingredients’ of behaviour change interventions. 2012, Miami, Florida, USA: Presented at the 33rd Annual Meeting of the Society for Clinical Trials Francis JJ, Johnston M, Abraham C, Hardeman W, Eccles MP, Richardson M, Michie S: Development of a taxonomy to facilitate reporting of behaviour change techniques, the ‘active ingredients’ of behaviour change interventions. 2012, Miami, Florida, USA: Presented at the 33rd Annual Meeting of the Society for Clinical Trials
38.
go back to reference Tate DF, Jackvony EH, Wing RR: Effects of internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. JAMA. 2003, 289: 1833-1836. 10.1001/jama.289.14.1833.CrossRefPubMed Tate DF, Jackvony EH, Wing RR: Effects of internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. JAMA. 2003, 289: 1833-1836. 10.1001/jama.289.14.1833.CrossRefPubMed
39.
go back to reference Steptoe A, Kerry S, Rink E, Hilton S: The impact of behavioral counseling on stage of change in fat intake, physical activity, and cigarette smoking in adults at increased risk of coronary heart disease. Am J Public Health. 2001, 91: 265-269.CrossRefPubMedPubMedCentral Steptoe A, Kerry S, Rink E, Hilton S: The impact of behavioral counseling on stage of change in fat intake, physical activity, and cigarette smoking in adults at increased risk of coronary heart disease. Am J Public Health. 2001, 91: 265-269.CrossRefPubMedPubMedCentral
41.
go back to reference Doig GS, Dvm: Quality of abstract reporting: caveat medicus. Crit Care Med. 2005, 33: 2122-2123. 10.1097/01.CCM.0000178290.42739.EC.CrossRefPubMed Doig GS, Dvm: Quality of abstract reporting: caveat medicus. Crit Care Med. 2005, 33: 2122-2123. 10.1097/01.CCM.0000178290.42739.EC.CrossRefPubMed
Metadata
Title
Active ingredients are reported more often for pharmacologic than non-pharmacologic interventions: an illustrative review of reporting practices in titles and abstracts
Authors
Nicola McCleary
Eilidh M Duncan
Fiona Stewart
Jill J Francis
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-146

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue