Skip to main content
Top
Published in: BMC Medicine 1/2013

Open Access 01-12-2013 | Guideline

RAMESES publication standards: meta-narrative reviews

Authors: Geoff Wong, Trish Greenhalgh, Gill Westhorp, Jeanette Buckingham, Ray Pawson

Published in: BMC Medicine | Issue 1/2013

Login to get access

Abstract

Background

Meta-narrative review is one of an emerging menu of new approaches to qualitative and mixed-method systematic review. A meta-narrative review seeks to illuminate a heterogeneous topic area by highlighting the contrasting and complementary ways in which researchers have studied the same or a similar topic. No previous publication standards exist for the reporting of meta-narrative reviews. This publication standard was developed as part of the RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) project. The project's aim is to produce preliminary publication standards for meta-narrative reviews.

Methods

We (a) collated and summarized existing literature on the principles of good practice in meta-narrative reviews; (b) considered the extent to which these principles had been followed by published reviews, thereby identifying how rigor may be lost and how existing methods could be improved; (c) used a three-round online Delphi method with an interdisciplinary panel of national and international experts in evidence synthesis, meta-narrative reviews, policy and/or publishing to produce and iteratively refine a draft set of methodological steps and publication standards; (d) provided real-time support to ongoing meta-narrative reviews and the open-access RAMESES online discussion list so as to capture problems and questions as they arose; and (e) synthesized expert input, evidence review and real-time problem analysis into a definitive set of standards.

Results

We identified nine published meta-narrative reviews, provided real-time support to four ongoing reviews and captured questions raised in the RAMESES discussion list. Through analysis and discussion within the project team, we summarized the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 33 members. Within three rounds this panel had reached consensus on 20 key publication standards, with an overall response rate of 90%.

Conclusion

This project used multiple sources to draw together evidence and expertise in meta-narrative reviews. For each item we have included an explanation for why it is important and guidance on how it might be reported. Meta-narrative review is a relatively new method for evidence synthesis and as experience and methodological developments occur, we anticipate that these standards will evolve to reflect further theoretical and methodological developments. We hope that these standards will act as a resource that will contribute to improving the reporting of meta-narrative reviews.
To encourage dissemination of the RAMESES publication standards, this article is co-published in the Journal of Advanced Nursing and is freely accessible on Wiley Online Library (http://​www.​wileyonlinelibra​ry.​com/​journal/​jan). Please see related article http://​www.​biomedcentral.​com/​1741-7015/​11/​21 and http://​www.​biomedcentral.​com/​1741-7015/​11/​22
Appendix
Available only for authorised users
Literature
1.
go back to reference Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRefPubMedPubMedCentral Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRefPubMedPubMedCentral
3.
go back to reference Sandelowski M, Voils C, Leeman J, Crandell J: Mapping the mixed methods-mixed research synthesis terrain. J Mixed Method Res. 2012, 6: 317-331. 10.1177/1558689811427913.CrossRef Sandelowski M, Voils C, Leeman J, Crandell J: Mapping the mixed methods-mixed research synthesis terrain. J Mixed Method Res. 2012, 6: 317-331. 10.1177/1558689811427913.CrossRef
4.
go back to reference Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (Suppl 1): 6-20.CrossRefPubMed Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (Suppl 1): 6-20.CrossRefPubMed
5.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic literature review and recommendations for future research. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organisations: systematic literature review and recommendations for future research. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
6.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005, 61: 417-430. 10.1016/j.socscimed.2004.12.001.CrossRefPubMed Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005, 61: 417-430. 10.1016/j.socscimed.2004.12.001.CrossRefPubMed
7.
go back to reference Kuhn TS: The Structure of Scientific Revolutions. 1962, Chicago: University of Chicago Press Kuhn TS: The Structure of Scientific Revolutions. 1962, Chicago: University of Chicago Press
8.
go back to reference Paterson B, Thorne S, Canam C, Jillings C: Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Synthesis. 2001, Thousand Oaks, California, USA: Sage PublicationsCrossRef Paterson B, Thorne S, Canam C, Jillings C: Meta-Study of Qualitative Health Research: A Practical Guide to Meta-Analysis and Meta-Synthesis. 2001, Thousand Oaks, California, USA: Sage PublicationsCrossRef
9.
go back to reference Lewis MW, Grimes AJ: Meta-triangulation: building theory from multiple paradigms. Acad Manage Rev. 1999, 24: 672-690. Lewis MW, Grimes AJ: Meta-triangulation: building theory from multiple paradigms. Acad Manage Rev. 1999, 24: 672-690.
10.
go back to reference Moher D, Hopewell S, Schulz K, Montori V, Gotzsche P, Devereaux P, Elbourne D, Egger M, Altman D: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trial. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz K, Montori V, Gotzsche P, Devereaux P, Elbourne D, Egger M, Altman D: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trial. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
11.
go back to reference Brouwers M, Kho M, Browman G, Burgers J, Cluzeau F, Feder G, Fervers B, Graham I, Grimshaw J, Hanna S, Littlejohns P, Makarski J, Zitzelsberger L, AGREE Next Steps Consortium: AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010, 182: E839-842. 10.1503/cmaj.090449.CrossRefPubMedPubMedCentral Brouwers M, Kho M, Browman G, Burgers J, Cluzeau F, Feder G, Fervers B, Graham I, Grimshaw J, Hanna S, Littlejohns P, Makarski J, Zitzelsberger L, AGREE Next Steps Consortium: AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010, 182: E839-842. 10.1503/cmaj.090449.CrossRefPubMedPubMedCentral
12.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009, 339: b2700-10.1136/bmj.b2700.CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009, 339: b2700-10.1136/bmj.b2700.CrossRefPubMedPubMedCentral
13.
go back to reference Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S, SQUIRE Development Group: Publication guidelines for improvement studies in health care: evolution of the SQUIRE project. Ann Intern Med. 2008, 149: 670-676.CrossRefPubMed Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney S, SQUIRE Development Group: Publication guidelines for improvement studies in health care: evolution of the SQUIRE project. Ann Intern Med. 2008, 149: 670-676.CrossRefPubMed
14.
go back to reference Greenhalgh T, Wong G, Westhorp G, Pawson R: Protocol - realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC Med Res Methodol. 2011, 11: 115-10.1186/1471-2288-11-115.CrossRefPubMedPubMedCentral Greenhalgh T, Wong G, Westhorp G, Pawson R: Protocol - realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC Med Res Methodol. 2011, 11: 115-10.1186/1471-2288-11-115.CrossRefPubMedPubMedCentral
17.
go back to reference Greenhalgh T, Potts HW, Wong G, Bark P, Swinglehurst D: Tensions and paradoxes in electronic patient record research: a systematic literature review using the meta-narrative method. Milbank Q. 2009, 87: 729-788. 10.1111/j.1468-0009.2009.00578.x.CrossRefPubMedPubMedCentral Greenhalgh T, Potts HW, Wong G, Bark P, Swinglehurst D: Tensions and paradoxes in electronic patient record research: a systematic literature review using the meta-narrative method. Milbank Q. 2009, 87: 729-788. 10.1111/j.1468-0009.2009.00578.x.CrossRefPubMedPubMedCentral
18.
go back to reference Greenhalgh T, Heath I: Measuring quality in the therapeutic relationship-Part 1: Objective approaches. QualSaf Health Care. 2010, 19: 475-478. 10.1136/qshc.2010.043364. Greenhalgh T, Heath I: Measuring quality in the therapeutic relationship-Part 1: Objective approaches. QualSaf Health Care. 2010, 19: 475-478. 10.1136/qshc.2010.043364.
19.
go back to reference Collins P, Hayes M: The role of urban municipal governments in reducing health inequities: a meta-narrative mapping analysis. Int J Equity Health. 2010, 9: 13-10.1186/1475-9276-9-13.CrossRefPubMedPubMedCentral Collins P, Hayes M: The role of urban municipal governments in reducing health inequities: a meta-narrative mapping analysis. Int J Equity Health. 2010, 9: 13-10.1186/1475-9276-9-13.CrossRefPubMedPubMedCentral
20.
go back to reference Contandriopoulos D, Lemire M, Denis J-L, Tremblay E: Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q. 2010, 88: 444-483. 10.1111/j.1468-0009.2010.00608.x.CrossRefPubMedPubMedCentral Contandriopoulos D, Lemire M, Denis J-L, Tremblay E: Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q. 2010, 88: 444-483. 10.1111/j.1468-0009.2010.00608.x.CrossRefPubMedPubMedCentral
Metadata
Title
RAMESES publication standards: meta-narrative reviews
Authors
Geoff Wong
Trish Greenhalgh
Gill Westhorp
Jeanette Buckingham
Ray Pawson
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2013
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-11-20

Other articles of this Issue 1/2013

BMC Medicine 1/2013 Go to the issue