Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2013

Open Access 01-12-2013 | Commentary

Developing a reporting guideline for social and psychological intervention trials

Authors: Evan Mayo-Wilson, Sean Grant, Sally Hopewell, Geraldine Macdonald, David Moher, Paul Montgomery

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Social and psychological interventions are often complex. Understanding randomised controlled trials (RCTs) of these complex interventions requires a detailed description of the interventions tested and the methods used to evaluate them; however, RCT reports often omit, or inadequately report, this information. Incomplete and inaccurate reporting hinders the optimal use of research, wastes resources, and fails to meet ethical obligations to research participants and consumers. In this paper, we explain how reporting guidelines have improved the quality of reports in medicine, and describe the ongoing development of a new reporting guideline for RCTs: CONSORT-SPI (an Extension for social and psychological interventions). We invite readers to participate in the project by visiting our website, in order to help us reach the best-informed consensus on these guidelines (http://​tinyurl.​com/​CONSORT-study).
Literature
1.
Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2008, London: MRC
2.
Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist synthesis: an introduction. 2004, ESRC Research Methods Programme: University of Manchester
3.
Bonell C: The utility of randomized controlled trials of social interventions: an examination of two trials of HIV prevention. Crit Public Health. 2002, 12: 321-334. 10.1080/0958159021000029504a.CrossRef
4.
Hawe P, Shiell A, Riley T: Complex interventions: how “out of control” can a randomised controlled trial be?. BMJ. 2004, 328: 1561-1563. 10.1136/bmj.328.7455.1561.CrossRefPubMedPubMedCentral
5.
Bonell C, Fletcher A, Morton M, Lorenc T, Moore L: Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012, 75: 2299-2306. 10.1016/j.socscimed.2012.08.032.CrossRefPubMed
6.
Henggeler SW, Schoenwald SK, Rowland MD, Cunningham PB: Serious emotional disturbances in children and adolescents: multisystemic therapy. 2002, New York: Guilford Press
7.
Littell JH, Campbell M, Green S, Toews B: Multisystemic Therapy for social, emotional, and behavioral problems in youth aged 10–17. Cochrane Database Syst Rev. 2009, 4: CD004797
8.
9.
10.
Perry AE, Weisburd D, Hewitt C: Are criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials. J Exp Criminol. 2010, 6: 245-262. 10.1007/s11292-010-9099-z.CrossRef
11.
Naleppa MJ, Cagle JG: Treatment fidelity in social work intervention research: a review of published studies. Res Soc Work Pract. 2010, 20: 674-681. 10.1177/1049731509352088.CrossRef
12.
Torgerson CJ, Torgerson DJ, Birks YF, Porthouse J: A comparison of RCTs in health and education. Br Educ Res J. 2005, 31: 761-785. 10.1080/01411920500314919.CrossRef
13.
Stinson JN, McGrath PJ, Yamada JT: Clinical trials in the Journal of Pediatric Psychology: applying the CONSORT Statement. J Pediatr Psychol. 2003, 28: 159-167. 10.1093/jpepsy/jsg001.CrossRefPubMed
14.
Michie S, Abraham C, Eccles MP, Francis JJ, Hardeman W, Johnston M: Strengthening evaluation and implementation by specifying components of behaviour change interventions: a study protocol. Implement Sci. 2011, 6: 10-10.1186/1748-5908-6-10.CrossRefPubMedPubMedCentral
15.
Semaan S, Kay L, Strouse D, Sogolow E, Dolan Mullen P, Spink Neumann M, Flores SA, Peersman G, Johnson WD, Darby Lipman P, Eke A, Des Jarlais DC: A profile of U.S.-based trials of behavioral and social interventions for HIV risk reduction. J Acquir Immune Defic Syndr. 2002, 30: S30-S50.CrossRefPubMed
16.
Schulz KF, Altman DG, Moher D: For the CONSORT Group: CONSORT, Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 2010 (340): 698-702.
17.
Davidson KW, Goldstein M, Kaplan RM, Kaufman PG, Knatterud GL, Tracy Orleans C, Spring B, Trudeau KJ, Whitlock EP: Evidence-based behavioural medicine: what is it and how do we achieve it?. Ann Behav Med. 2003, 26: 161-171. 10.1207/S15324796ABM2603_01.CrossRefPubMed
18.
Bonell C, Oakley A, Hargreaves J, Strange V, Rees R: Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006, 333: 346-349. 10.1136/bmj.333.7563.346.CrossRefPubMedPubMedCentral
19.
Moher D, Schulz KF, Simera I, Altman DG: Guidance for developers of health research reporting guidelines. PLoS Med. 2010, 7: e1000217-10.1371/journal.pmed.1000217.CrossRefPubMedPubMedCentral
20.
Bonell CP, Hargreaves J, Cousens S, Ross D, Hayes R, Petticrew M, Kirkwood BR: Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions. J Epidemiol Community Health. 2011, 65: 582-587. 10.1136/jech.2008.082602.CrossRefPubMed
21.
Chalmers I: Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date evaluations. Ann Am Acad Pol Soc Sci. 2003, 589: 22-40. 10.1177/0002716203254762.CrossRef
22.
Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D: Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012, 11: MR000030
23.
Moher D, Altman DG, Schulz KF, Elbourne DR: Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. CMAJ. 2004, 171: 349-350. 10.1503/cmaj.1040031.CrossRefPubMedPubMedCentral
24.
Mayo-Wilson E: Reporting implementation in randomized trials: proposed additions to the Consolidated Standards of Reporting Trials statement. Am J Public Health. 2007, 97: 630-10.2105/AJPH.2006.094169.CrossRefPubMedPubMedCentral
25.
Gill CE: Missing links: how descriptive validity impacts the policy relevance of randomized controlled trials in criminology. J Exp Criminol. 2011, 7: 201-224. 10.1007/s11292-011-9122-z.CrossRef
26.
27.
Boutron I, Moher D, Altman DG, Schulz K, Ravaud P: for the CONSORT group: Methods and processes of the CONSORT group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 148: 60-67.
28.
Zwarenstein M, Treweek S, Gagnier JJ, for the CONSORT and Pragmatic Trials in Healthcare (Practihc) group: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337: 2390-10.1136/bmj.a2390.CrossRef
29.
Calvert M, Blazeby J, Revicki D, Moher D, Brundage M: Reporting quality of life in clinical trials: a CONSORT extension. Lancet. 2011, 378: 1684-1685. 10.1016/S0140-6736(11)61256-7.CrossRefPubMed
30.
31.
American Educational Research Association: Standards for reporting on empirical social science research in AERA publications. Educ Res. 2006, 35: 33-40.
32.
Newman M, Elbourne D: Improving the usability of educational research: guidelines for the REPOrting of primary empirical research Studies in Education (The REPOSE Guidelines). Evaluation & Research in Education. 2004, 18: 201-212. 10.1080/09500790408668319.CrossRef
33.
American Psychological Association Journal Article Reporting Standards Group: Reporting standards for research in psychology: why do we need them? What might they be?. Am Psychol. 2008, 63: 839-851.CrossRef
34.
Grant S, Montgomery P, Mayo-Wilson E: Development of a CONSORT extension for interventions in public health and related disciplines. Lancet. 2012, 380: 14-10.1016/S0140-6736(12)61111-8.CrossRef
35.
Perry AE, Johnson M: Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note. J Exp Criminol. 2008, 4: 165-185. 10.1007/s11292-008-9051-7.CrossRef
36.
Armstrong R, Waters E, Moore L, Riggs E, Gabriel Cuervo L, Lumbiganon P, Hawe P: Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health. 2008, 30: 103-109. 10.1093/pubmed/fdm082.CrossRef
37.
Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gøtzsche PC: Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol. 2007, 36: 847-857. 10.1093/ije/dym087.CrossRefPubMed
38.
Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess. 1999, 3: 1-143.PubMed
39.
Schulz KF, Chalmers I, Hayes RJ, Altman DG: Allocation concealment in randomised trials: defending against deciphering. Lancet. 1995, 359: 614-617.CrossRef
40.
Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses. Lancet. 1999, 352: 609-613.CrossRef
41.
Ladd BO, McCrady BS, Manuel JK, Campbell W: Improving the quality of reporting alcohol outcome studies: effects of the CONSORT statement. Addict Behav. 2010, 35: 660-666. 10.1016/j.addbeh.2010.02.009.CrossRefPubMed
42.
Medical Research Council: Using natural experiments to evaluate population health interventions: guidance for producers and users of evidence. 2011, London: MRC
43.
Marshall M, Lockwood A, Bradley C, Adams C, Joy C, Fenton M: Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia. Br J Psychiatry. 2000, 176: 249-252. 10.1192/bjp.176.3.249.CrossRefPubMed
44.
Fraser MW, Galinsky MJ, Richman JM, Day SH: Intervention research: developing social programs. 2009, Oxford: Oxford University Press
45.
Cartwright N, Munro E: The limitations of randomized controlled trials in predicting effectiveness. J Eval Clin Pract. 2010, 16: 260-266. 10.1111/j.1365-2753.2010.01382.x.CrossRefPubMed
46.
Moore L, Moore GF: Public health evaluation: which designs work, for whom and under what circumstances?. J Epidemiol Community Health. 2011, 65: 596-597. 10.1136/jech.2009.093211.CrossRefPubMed
47.
Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6: 31000086-CrossRef
48.
Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.CrossRefPubMedPubMedCentral
49.
Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: 979-983. 10.1136/bmj.a979.CrossRef
50.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 6: CD000259
51.
Hardeman W, Michie S, Fanshawe T, Prevost AT, McLoughlin K, Kinmonth AL: Fidelity of delivery of a physical activity intervention: predictors and consequences. Psychol Health. 2008, 23: 11-24. 10.1080/08870440701615948.CrossRefPubMed
52.
McGrath PJ, Stinson J, Davidson K: Commentary: The Journal of Pediatric Psychology should adopt the CONSORT statement as a way of improving the evidence base in pediatric psychology. J Pediatr Psychol. 2003, 28: 169-171. 10.1093/jpepsy/jsg002.CrossRefPubMed
53.
Evans T, Brown H: Road traffic crashes: operationalizing equity in the context of health sector reform. Inj Control Saf Promot. 2003, 10: 11-12. 10.1076/icsp.10.1.11.14117.CrossRefPubMed
54.
Moore L: Research design for the rigorous evaluation of complex educational interventions: lessons from health services research. Building Research Capacity. 2002, 1: 4-5.
55.
Tugwell P, Petticrew M, Kristjansson E, Welch V, Ueffing E, Waters E, Bonnefoy J, Morgan A, Doohan E, Kelly MP: Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health. BMJ. 2010, 341: c4739-10.1136/bmj.c4739.CrossRefPubMed
56.
Welch V, Petticrew M, Tugwell P, Moher D, O’Neill J, Waters E, White H, PRISMA-Equity Bellagio group: PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012, 9: e1001333-10.1371/journal.pmed.1001333.CrossRefPubMedPubMedCentral
57.
Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation research: a synthesis of the literature. 2005, Tampa, Florida: University of South Florida
58.
Wang S, Moss JR, Hiller JE: Applicability and transferability of interventions in evidence-based public health. Health Promot Int. 2006, 21: 76-83.CrossRefPubMed
59.
Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group: Extending the CONSORT Statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008, 148: 295-309. 10.7326/0003-4819-148-4-200802190-00008.CrossRefPubMed
60.
Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008, 371: 281-283. 10.1016/S0140-6736(07)61835-2.CrossRefPubMed
61.
Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, Marteau T: Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998, 2: 1-88.
62.
Moher D, Hopewell S, Schultz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
63.
Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 40-10.1186/1748-5908-4-40.CrossRefPubMedPubMedCentral
64.
Goldbeck L, Vitiello B: Reporting clinical trials of psychosocial interventions in child and adolescent psychiatry and mental health. Child Adolesc Psychiatry Ment Health. 2011, 5: 4-10.1186/1753-2000-5-4.CrossRefPubMedPubMedCentral
65.
von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Ann Intern Med. 2007, 147: 573-577. 10.7326/0003-4819-147-8-200710160-00010.CrossRefPubMed
66.
Des Jarlais DC, Lyles C, Crepaz N, And the TREND Group: Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions the TREND statement. Am J Public Health. 2004, 94: 361-366. 10.2105/AJPH.94.3.361.CrossRefPubMedPubMedCentral
67.
Tong A, Sainsbury P, Craig J: Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007, 19: 349-357. 10.1093/intqhc/mzm042.CrossRefPubMed
Metadata
Title
Developing a reporting guideline for social and psychological intervention trials
Authors
Evan Mayo-Wilson
Sean Grant
Sally Hopewell
Geraldine Macdonald
David Moher
Paul Montgomery
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-242

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue

Study protocol

Zinc supplementation in pre-diabetes: study protocol for a randomized controlled trial

Study protocol

Evaluation of ergonomic and education interventions to reduce occupational sitting in office-based university workers: study protocol for a randomized controlled trial

Study protocol

Interreality for the management and training of psychological stress: study protocol for a randomized controlled trial

Study protocol

Comparison of error-based and errorless learning for people with severe traumatic brain injury: study protocol for a randomized control trial

Study protocol

Muslim communities learning about second-hand smoke (MCLASS): study protocol for a pilot cluster randomised controlled trial

Study protocol

Effects of tai chi program on neuromuscular function for patients with knee osteoarthritis: study protocol for a randomized controlled trial