Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Systematic Reviews
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Protocol

Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol

Authors: Noah Ivers, Andrea C Tricco, Thomas A Trikalinos, Issa J Dahabreh, Kristin J Danko, David Moher, Sharon E Straus, John N Lavis, Catherine H Yu, Kaveh Shojania, Braden Manns, Marcello Tonelli, Timothy Ramsay, Alun Edwards, Peter Sargious, Alison Paprica, Michael Hillmer, Jeremy M Grimshaw

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

To improve quality of care and patient outcomes, health system decision-makers need to identify and implement effective interventions. An increasing number of systematic reviews document the effects of quality improvement programs to assist decision-makers in developing new initiatives. However, limitations in the reporting of primary studies and current meta-analysis methods (including approaches for exploring heterogeneity) reduce the utility of existing syntheses for health system decision-makers. This study will explore the role of innovative meta-analysis approaches and the added value of enriched and updated data for increasing the utility of systematic reviews of complex interventions.

Methods/Design

We will use the dataset from our recent systematic review of 142 randomized trials of diabetes quality improvement programs to evaluate novel approaches for exploring heterogeneity. These will include exploratory methods, such as multivariate meta-regression analyses and all-subsets combinatorial meta-analysis. We will then update our systematic review to include new trials and enrich the dataset by surveying authors of all included trials. In doing so, we will explore the impact of variables not, reported in previous publications, such as details of study context, on the effectiveness of the intervention. We will use innovative analytical methods on the enriched and updated dataset to identify key success factors in the implementation of quality improvement interventions for diabetes. Decision-makers will be involved throughout to help identify and prioritize variables to be explored and to aid in the interpretation and dissemination of results.

Discussion

This study will inform future systematic reviews of complex interventions and describe the value of enriching and updating data for exploring heterogeneity in meta-analysis. It will also result in an updated comprehensive systematic review of diabetes quality improvement interventions that will be useful to health system decision-makers in developing interventions to improve outcomes for people with diabetes.

Systematic review registration

PROSPERO registration no. CRD42013005165
Appendix
Available only for authorised users
Literature
1.
Grol R: Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001, 39: II46-II54.CrossRefPubMed
2.
Mangione-Smith R, DeCristofaro AH, Setodji CM, Keesey J, Klein DJ, Adams JL, Schuster MA, McGlynn EA: The quality of ambulatory care delivered to children in the United States. N Engl J Med. 2007, 357: 1515-1523. 10.1056/NEJMsa064637.CrossRefPubMed
3.
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed
4.
Lomas J, Brown AD: Research and advice giving: a functional view of evidence-informed policy advice in a Canadian Ministry of Health. Milbank Q. 2009, 87: 903-926. 10.1111/j.1468-0009.2009.00583.x.CrossRefPubMedPubMedCentral
5.
Anderson LM, Petticrew M, Chandler J, Grimshaw J, Tugwell P, O’Neill J, Welch V, Squires J, Churchill R, Shemilt I: Introducing a series of methodological articles on considering complexity in systematic reviews of interventions. J Clin Epidemiol. 2013, 66: 1205-1208. 10.1016/j.jclinepi.2013.07.005.CrossRefPubMed
6.
Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ: Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011, 89: 167-205. 10.1111/j.1468-0009.2011.00625.x.CrossRefPubMedPubMedCentral
7.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE: The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013, 46: 81-95. 10.1007/s12160-013-9486-6.CrossRefPubMed
8.
Stevens DP, Shojania KG: Tell me about the context, and more. BMJ Qual Saf. 2011, 20: 557-559. 10.1136/bmjqs-2011-000206.CrossRefPubMed
9.
Noyes J, Gough D, Lewin S, Mayhew A, Michie S, Pantoja T, Petticrew M, Pottie K, Rehfuess E, Shemilt I, Shepperd S, Sowden A, Tugwell P, Welch V: A research and development agenda for systematic reviews that ask complex questions about complex interventions. J Clin Epidemiol. 2013, 66: 1262-1270. 10.1016/j.jclinepi.2013.07.003.CrossRefPubMed
10.
Michie S, Fixsen D, Grimshaw JM, Eccles MP: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 40-10.1186/1748-5908-4-40.CrossRefPubMedPubMedCentral
11.
Shekelle PG, Pronovost PJ, Wachter RM, Taylor SL, Dy SM, Foy R, Hempel S, McDonald KM, Ovretveit J, Rubenstein LV, Adams AS, Angood PB, Bates DW, Bickman L, Carayon P, Donaldson L, Duan N, Farley DO, Greenhalgh T, Haughom J, Lake ET, Lilford R, Lohr KN, Meyer GS, Miller MR, Neuhauser DV, Ryan G, Saint S, Shojania KG, Shortell SM: Advancing the science of patient safety. Ann Intern Med. 2011, 154: 693-696. 10.7326/0003-4819-154-10-201105170-00011.CrossRefPubMed
12.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, Lamb SE, Dixon-Woods M, McCulloch P, Wyatt JC, Chan AW, Michie S: Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014, 348: g1687-10.1136/bmj.g1687. doi: 10.1136/bmj.g1687.:g1687CrossRefPubMed
13.
Lau J, Ioannidis JP, Schmid CH: Summing up evidence: one answer is not always enough. Lancet. 1998, 351: 123-127. 10.1016/S0140-6736(97)08468-7.CrossRefPubMed
14.
15.
Deeks JJ, Higgins JPT, Altman DG, on behalf of the Cochrane Statistical Methods Group: Analysing data and undertaking meta-analyses. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. Edited by: Higgins JPT, Green S. 2011, The Cochrane Collaboration
16.
Saydah SH, Eberhardt MS, Loria CM, Brancati FL: Age and the burden of death attributable to diabetes in the United States. Am J Epidemiol. 2002, 156: 714-719. 10.1093/aje/kwf111.CrossRefPubMed
17.
IDF Diabetes Atlas. 2009, Brussels: International Diabetes Federation
18.
Haffner S: Coronary heart disease in patients with diabetes. New Engl J Med. 2000, 342: 1040-1042. 10.1056/NEJM200004063421408.CrossRefPubMed
19.
Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, Tonelli M, Shojania K: Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012, 379: 2252-2261. 10.1016/S0140-6736(12)60480-2.CrossRefPubMed
20.
Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. 2011, The Cochrane Collaboration
21.
Ivers NM, Tricco AC, Taljaard M, Halperin I, Turner L, Moher D, Grimshaw JM: Quality improvement needed in quality improvement randomised trials: systematic review of interventions to improve care in diabetes. BMJ Open. 2013, 3: e002727-CrossRefPubMedPubMedCentral
22.
Higgins JP, Whitehead A, Turner RM, Omar RZ, Thompson SG: Meta-analysis of continuous outcome data from individual patients. Stat Med. 2001, 20: 2219-2241. 10.1002/sim.918.CrossRefPubMed
23.
Turner RM, Omar RZ, Yang M, Goldstein H, Thompson SG: A multilevel model framework for meta-analysis of clinical trials with binary outcomes. Stat Med. 2000, 19: 3417-3432. 10.1002/1097-0258(20001230)19:24<3417::AID-SIM614>3.0.CO;2-L.CrossRefPubMed
24.
Welton NJ, Caldwell DM, Adamopoulos E, Vedhara K: Mixed treatment comparison meta-analysis of complex interventions: psychological interventions in coronary heart disease. Am J Epidemiol. 2009, 169: 1158-1165. 10.1093/aje/kwp014.CrossRefPubMed
25.
Senn S: Hans van Houwelingen and the art of summing up. Biom J. 2010, 52: 85-94. 10.1002/bimj.200900074.CrossRefPubMed
26.
Van HH, Senn S: Investigating underlying risk as a source of heterogeneity in meta-analysis. Stat Med. 1999, 18: 110-115. 10.1002/(SICI)1097-0258(19990115)18:1<110::AID-SIM14>3.0.CO;2-C.CrossRef
27.
van Houwelingen HC, Arends LR, Stijnen T: Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002, 21: 589-624. 10.1002/sim.1040.CrossRefPubMed
28.
Olkin I, Dahabreh IJ, Trikalinos TA: GOSH - a graphical display of study heterogeneity. Res Syn Meth. 2012, 3: 214-223. 10.1002/jrsm.1053.CrossRef
29.
Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336: 1472-1474. 10.1136/bmj.39590.732037.47.CrossRefPubMedPubMedCentral
30.
Gagnon ML: Moving knowledge to action through dissemination and exchange. J Clin Epidemiol. 2011, 64: 25-31. 10.1016/j.jclinepi.2009.08.013.CrossRefPubMed
31.
Ross S, Lavis J, Rodriguez C, Woodside J, Denis JL: Partnership experiences: involving decision-makers in the research process. J Health Serv Res Policy. 2003, 8 (Suppl 2): 26-34. 10.1258/135581903322405144.CrossRefPubMed
32.
Kothari A, Wathen CN: A critical second look at integrated knowledge translation. Health Policy. 2013, 109: 187-191. 10.1016/j.healthpol.2012.11.004.CrossRefPubMed
33.
34.
Tricco AC, Galipeau J, Turner L, Moher D, Ivers N, Halperin I, Vachon B, Ramsay T, Shojania KG, Grimshaw JM: Improving diabetes care: updated and expanded systematic review of diabetes quality improvement strategies. 2010, Report prepared for the Ministry of Health and Long Term Care: Ottawa
35.
Wallace BC, Schmid CH, Lau J, Trikalinos TA: Meta-Analyst: software for meta-analysis of binary, continuous and diagnostic data. BMC Med Res Methodol. 2009, 9: 80-10.1186/1471-2288-9-80. doi: 10.1186/1471-2288-9-80.:80-89CrossRefPubMedPubMedCentral
36.
37.
Plummer MJAGS: A Program for Analysis of Bayesian Graphical Models Using Gibbs Sampling. Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003). 2003, Vienna, Austria
38.
Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296: 427-440. 10.1001/jama.296.4.427.CrossRefPubMed
39.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 6: CD000259-doi: 10.1002/14651858.CD000259.pub3.:CD000259PubMed
40.
Chaudry SH: Challenges in the ethical conduct and ethics review of cluster randomized trials: a survey of cluster randomization trialists. (MSc thesis), PhD Thesis. 2011, University of Ottawa
41.
Dillman DA: The design and administration of mail surveys. Annu Rev Sociol. 1991, 17: 225-248. 10.1146/annurev.so.17.080191.001301.CrossRef
42.
Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A: SUPPORT tools for evidence-informed health policymaking (STP) 14: organising and using policy dialogues to support evidence-informed policymaking. Health Res Policy Syst. 2009, 7 (Suppl 1): S14-S17. 10.1186/1478-4505-7-S1-S14. doi: 10.1186/1478-4505-7-S1-S14.:S14-S17CrossRefPubMedPubMedCentral
43.
Moat KA, Lavis JN, Clancy SJ, El-Jardali F, Pantoja T: Evidence briefs and deliberative dialogues: perceptions and intentions to act on what was learnt. Bull World Health Organ. 2014, 92: 20-28. 10.2471/BLT.12.116806.CrossRefPubMed
Metadata
Title
Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol
Authors
Noah Ivers
Andrea C Tricco
Thomas A Trikalinos
Issa J Dahabreh
Kristin J Danko
David Moher
Sharon E Straus
John N Lavis
Catherine H Yu
Kaveh Shojania
Braden Manns
Marcello Tonelli
Timothy Ramsay
Alun Edwards
Peter Sargious
Alison Paprica
Michael Hillmer
Jeremy M Grimshaw
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-88

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue

Protocol

Prescription opioid misuse and its relation to injection drug use and hepatitis C virus infection: protocol for a systematic review and meta-analysis

Erratum

Erratum to: Assessment of a method to detect signals for updating systematic reviews

Protocol

Clinical manifestations of tension pneumothorax: protocol for a systematic review and meta-analysis

Reviewer acknowledgement

Reviewer Acknowledgement 2013

Protocol

Rationale and protocol for a systematic review and meta-analysis on reduced data gathering in people with delusions

Methodology

Recovering the raw data behind a non-parametric survival curve