Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed

Authors: Ralph Möhler, Gabriele Bartoszek, Gabriele Meyer

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

The development and evaluation of complex interventions in healthcare has obtained increased awareness. The Medical Research Council’s (MRC) framework for the development and evaluation of complex interventions and its update offers guidance for researchers covering the phases development, feasibility/piloting, and evaluation. Comprehensive reporting of complex interventions enhances transparency and is essential for researchers and policy-makers. Recently, a set of 16 criteria for reporting complex interventions in healthcare (CReDECI) was published. The aim of this study is to evaluate the reporting quality in publications of complex interventions adhering to either the first or the updated MRC framework, and to evaluate the applicability of CReDECI.

Methods

A systematic PubMed search was conducted. Two reviewers independently checked titles and abstracts for inclusion. Trials on complex interventions adhering to the MRC framework and including an evaluation study in English and German were included. For all included trials and for all publications which reported on phases prior to the evaluation study, related publications were identified via forward citation tracking. The quality of reporting was assessed independently by two reviewers using CReDECI. Inter-rater agreement and time needed to complete the assessment were determined.

Results

Twenty-six publications on eight trials were included. The number of publications per trial ranged from 1 to 6 (mean 3.25). The trials demonstrate a good reporting quality for the criteria referring to the development and feasibility/piloting. For the criteria addressing the introduction of the intervention and the evaluation, quality of reporting varied widely. Two trials fulfilled 7 and 8 items respectively, five trials fulfilled one to five items and one trial offered no information on any item. The mean number of items with differing ratings per trial was two. The time needed to rate a trial ranged from 30 to 90 minutes, depending on the number of publications.

Conclusions

Adherence to the MRC framework seems to have a positive impact on the reporting quality on the development and piloting of complex interventions. Reporting on the evaluation could be improved. CReDECI is a practical instrument to check the reporting quality of complex interventions and could be used alongside design-specific reporting guidelines.
Appendix
Available only for authorised users
Literature
1.
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
2.
3.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance: Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008, 337: a1655-10.1136/bmj.a1655.CrossRefPubMedPubMedCentral
4.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new medical research council guidance. Int J Nurs Stud. 2013, 50: 587-592. 10.1016/j.ijnurstu.2012.09.010.CrossRefPubMed
5.
Hawe P, Shiell A, Riley T, Gold L: Methods for exploring implementation variation and local context within a cluster randomised community intervention trial. J Epidemiol Community Health. 2004, 58: 788-793. 10.1136/jech.2003.014415.CrossRefPubMedPubMedCentral
6.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J, RIPPLE Study Team: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.CrossRefPubMedPubMedCentral
7.
Spillane V, Byrne MC, Byrne M, Leathem CS, O’Malley M, Cupples ME: Monitoring treatment fidelity in a randomized controlled trial of a complex intervention. J Adv Nurs. 2007, 60: 343-352. 10.1111/j.1365-2648.2007.04386.x.CrossRefPubMed
8.
Armstrong R, Waters E, Moore L, Riggs E, Cuervo LG, Lumbiganon P, Hawe P: Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health. 2008, 30: 103-109. 10.1093/pubmed/fdm082.CrossRef
9.
Egan M, Bambra C, Petticrew M, Whitehead M: Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions. J Epidemiol Community Health. 2009, 63: 4-11.CrossRefPubMed
10.
Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, Sheikh A: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6: e1000086-10.1371/journal.pmed.1000086.CrossRefPubMedPubMedCentral
11.
Mayo-Wilson E: Reporting implementation in randomized trials: proposed additions to the consolidated standards of reporting trials statement. Am J Public Health. 2007, 97: 630-633. 10.2105/AJPH.2006.094169.CrossRefPubMedPubMedCentral
12.
Möhler R, Richter T, Köpke S, Meyer G: Interventions for preventing and reducing the use of physical restraints in long-term geriatric care - a Cochrane review. J Clin Nurs. 2012, 21: 3070-3081. 10.1111/j.1365-2702.2012.04153.x.CrossRefPubMed
13.
Redfern J, McKevitt C, Wolfe CD: Development of complex interventions in stroke care: a systematic review. Stroke. 2006, 37: 2410-2419. 10.1161/01.STR.0000237097.00342.a9.CrossRefPubMed
14.
Möhler R, Bartoszek G, Köpke S, Meyer G: Proposed criteria for reporting the development and evaluation of complex interventions in healthcare (CReDECI): guideline development. Int J Nurs Stud. 2012, 49: 40-46. 10.1016/j.ijnurstu.2011.08.003.CrossRefPubMed
15.
Greenhalgh T, Peacock R: Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005, 331: 1064-1065. 10.1136/bmj.38636.593461.68.CrossRefPubMedPubMedCentral
16.
Tilling K, Coshall C, McKevitt C, Daneski K, Wolfe C: A family support organiser for stroke patients and their carers: a randomised controlled trial. Cerebrovasc Dis. 2005, 20: 85-91. 10.1159/000086511.CrossRefPubMed
17.
Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Cresswell K, Eden M, Elliott RA, Howard R, Kendrick D, Morris CJ, Prescott RJ, Swanwick G, Franklin M, Putman K, Boyd M, Sheikh A: A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012, 379: 1310-1319. 10.1016/S0140-6736(11)61817-5.CrossRefPubMed
18.
Strong V, Waters R, Hibberd C, Murray G, Wall L, Walker J, McHugh G, Walker A, Sharpe M: Management of depression for people with cancer (SMaRT oncology 1): a randomised trial. Lancet. 2008, 372: 40-48. 10.1016/S0140-6736(08)60991-5.CrossRefPubMed
19.
Wolfe CD, Redfern J, Rudd AG, Grieve AP, Heuschmann PU, McKevitt C: Cluster randomized controlled trial of a patient and general practitioner intervention to improve the management of multiple risk factors after stroke: stop stroke. Stroke. 2010, 41: 2470-2476. 10.1161/STROKEAHA.110.588046.CrossRefPubMed
20.
Murphy AW, Cupples ME, Smith SM, Byrne M, Byrne MC, Newell J, SPHERE study team: Effect of tailored practice and patient care plans on secondary prevention of heart disease in general practice: cluster randomised controlled trial. BMJ. 2009, 339: b4220-10.1136/bmj.b4220.CrossRefPubMedPubMedCentral
21.
Smith SM, Paul G, Kelly A, Whitford DL, O’Shea E, O’Dowd T: Peer support for patients with type 2 diabetes: cluster randomised controlled trial. BMJ. 2011, 342: d715-10.1136/bmj.d715.CrossRefPubMedPubMedCentral
22.
Klinkhammer-Schalke M, Koller M, Steinger B, Ehret C, Ernst B, Wyatt JC, Hofstädter F, Lorenz W, Regensburg QoL Study Group: Direct improvement of quality of life using a tailored quality of life diagnosis and therapy pathway: randomised trial in 200 women with breast cancer. Br J Cancer. 2012, 106: 826-838. 10.1038/bjc.2012.4.CrossRefPubMedPubMedCentral
23.
Faes MC, Reelick MF, Melis RJ, Borm GF, Esselink RA, Rikkert MG: Multifactorial fall prevention for pairs of frail community-dwelling older fallers and their informal caregivers: a dead end for complex interventions in the frailest fallers. J Am Med Dir Assoc. 2011, 12: 451-458. 10.1016/j.jamda.2010.11.006.CrossRefPubMed
24.
Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Elliott R, Howard R, Kendrick D, Morris CJ, Murray SA, Prescott RJ, Cresswell K, Sheikh A: Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices. Trials. 2009, 10: 28-10.1186/1745-6215-10-28.CrossRefPubMedPubMedCentral
25.
26.
Sharpe M, Strong V, Allen K, Rush R, Maguire P, House A, Ramirez A, Cull A: Management of major depression in outpatients attending a cancer centre: a preliminary evaluation of a multicomponent cancer nurse-delivered intervention. Br J Cancer. 2004, 90: 310-313. 10.1038/sj.bjc.6601546.CrossRefPubMedPubMedCentral
27.
Bower P, Gilbody S, Richards D, Fletcher J, Sutton A: Collaborative care for depression in primary care. Making sense of a complex intervention: systematic review and meta-regression. Br J Psychiatry. 2006, 189: 484-493. 10.1192/bjp.bp.106.023655.CrossRefPubMed
28.
Redfern J, Rudd AD, Wolfe CD, McKevitt C: Stop Stroke: development of an innovative intervention to improve risk factor management after stroke. Patient Educ Couns. 2008, 72: 201-209. 10.1016/j.pec.2008.03.006.CrossRefPubMed
29.
Byrne M, Cupples ME, Smith SM, Leathem C, Corrigan M, Byrne MC, Murphy AW: Development of a complex intervention for secondary prevention of coronary heart disease in primary care using the UK medical research council framework. Am J Manag Care. 2006, 12: 261-266.PubMed
30.
Corrrigan M, Cupples ME, Smith SM, Byrne M, Leathem CS, Clerkin P, Murphy AW: The contribution of qualitative research in designing a complex intervention for secondary prevention of coronary heart disease in two different healthcare systems. BMC Health Serv Res. 2006, 6: 90-10.1186/1472-6963-6-90.CrossRefPubMedPubMedCentral
31.
Murphy AW, Cupples ME, Smith SM, Byrne M, Leathem C, Byrne MC, The SPHERE Study: Secondary prevention of heart disease in general practice: protocol of a randomised controlled trial of tailored practice and patient care plans with parallel qualitative, economic and policy analyses [ISRCTN24081411]. Curr Control Trials Cardiovasc Med. 2005, 6: 11-10.1186/1468-6708-6-11.CrossRefPubMedPubMedCentral
32.
Gillespie P, O’Shea E, Murphy AW, Byrne MC, Byrne M, Smith SM, Cupples ME: The cost-effectiveness of the SPHERE intervention for the secondary prevention of coronary heart disease. Int J Technol Assess Health Care. 2010, 26: 263-271. 10.1017/S0266462310000358.CrossRefPubMed
33.
Paul G, Smith SM, Whitford D, O’Kelly F, O’Dowd T: Development of a complex intervention to test the effectiveness of peer support in type 2 diabetes. BMC Health Serv Res. 2007, 7: 136-10.1186/1472-6963-7-136.CrossRefPubMedPubMedCentral
34.
Paul GM, Smith SM, Whitford DL, O’Shea E, O’Kelly F, O’Dowd T: Peer support in type 2 diabetes: a randomised controlled trial in primary care with parallel economic and qualitative analyses: pilot study and protocol. BMC Fam Pract. 2007, 8: 45-10.1186/1471-2296-8-45.CrossRefPubMedPubMedCentral
35.
Gillespie P, O’Shea E, Paul G, O’Dowd T, Smith SM: Cost effectiveness of peer support for type 2 diabetes. Int J Technol Assess Health Care. 2012, 28: 3-11. 10.1017/S0266462311000663.CrossRefPubMed
36.
Koller M, Klinkhammer-Schalke M, Ehret C, Steinger B, Ernst B, Hofstädter F, Lorenz W, Mitglieder des Qualitätszitkels; Advisory Board: [Diagnosis and therapy of illness-related quality of life in breast cancer patients. Protocol of a randomized clinical trial at the Regensburg tumour centre]. Z Arztl Fortbild Qualitatssich. 2006, 100: 175-182.PubMed
37.
Klinkhammer-Schalke M, Koller M, Wyatt JC, Steinger B, Ehret C, Ernst B, Hofstädter F, Lorenz W: Quality of life diagnosis and therapy as complex intervention for improvement of health in breast cancer patients: delineating the conceptual, methodological, and logistic requirements (modeling). Langenbecks Arch Surg. 2008, 393: 1-12.CrossRefPubMed
38.
Klinkhammer-Schalke M, Koller M, Ehret C, Steinger B, Ernst B, Wyatt JC, Hofstädter F, Lorenz W, Regensburg QoL Study Group: Implementing a system of quality-of-life diagnosis and therapy for breast cancer patients: results of an exploratory trial as a prerequisite for a subsequent RCT. Br J Cancer. 2008, 99: 415-422. 10.1038/sj.bjc.6604505.CrossRefPubMedPubMedCentral
39.
Faes MC, Reelick MF, Esselink RA, Rikkert MG: Developing and evaluating complex healthcare interventions in geriatrics: the use of the medical research council framework exemplified on a complex fall prevention intervention. J Am Geriatr Soc. 2010, 58: 2212-2221. 10.1111/j.1532-5415.2010.03108.x.CrossRefPubMed
40.
Reelick MF, Faes MC, Esselink RA, Kessels RP, Olde Rikkert MG: How to perform a preplanned process evaluation for complex interventions in geriatric medicine: exemplified with the process evaluation of a complex falls-prevention program for community-dwelling frail older fallers. J Am Med Dir Assoc. 2011, 12: 331-336. 10.1016/j.jamda.2011.01.006.CrossRefPubMed
41.
Thompson C, Stapley S: Do educational interventions improve nurses’ clinical decision making and judgement? a systematic review. Int J Nurs Stud. 2011, 48: 881-893. 10.1016/j.ijnurstu.2010.12.005.CrossRefPubMed
42.
Schroter S, Glasziou P, Heneghan C: Quality of descriptions of treatments: a review of published randomised controlled trials. BMJ Open. 2012, 2: e001978-10.1136/bmjopen-2012-001978.CrossRefPubMedPubMedCentral
43.
Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B: Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013, 14: 15-10.1186/1745-6215-14-15.CrossRefPubMedPubMedCentral
44.
Wells M, Williams B, Treweek S, Coyle J, Taylor J: Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials. 2012, 13: 95-10.1186/1745-6215-13-95.CrossRefPubMedPubMedCentral
45.
Moher D, Weeks L, Ocampo M, Seely D, Sampson M, Altman DG, Schulz KF, Miller D, Simera I, Grimshaw J, Hoey J: Describing reporting guidelines for health research: a systematic review. J Clin Epidemiol. 2011, 64: 718-742. 10.1016/j.jclinepi.2010.09.013.CrossRefPubMed
46.
Metadata
Title
Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed
Authors
Ralph Möhler
Gabriele Bartoszek
Gabriele Meyer
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-125

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue

Research article

Google Scholar as replacement for systematic literature searches: good relative recall and precision are not enough

Research article

Reducing and meta-analysing estimates from distributed lag non-linear models

Research article

A threshold method for immunological correlates of protection

Research article

A nonparametric random coefficient approach for life expectancy growth using a hierarchical mixture likelihood model with application to regional data from North Rhine-Westphalia (Germany)

Correspondence

Novel study design to assess the utility of the copd assessment test in a primary care setting

Debate

Enhancing the scoping study methodology: a large, inter-professional team’s experience with Arksey and O’Malley’s framework