Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Study protocol

What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review

Authors: Monika Kastner, Andrea C Tricco, Charlene Soobiah, Erin Lillie, Laure Perrier, Tanya Horsley, Vivian Welch, Elise Cogo, Jesmin Antony, Sharon E Straus

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

A knowledge synthesis attempts to summarize all pertinent studies on a specific question, can improve the understanding of inconsistencies in diverse evidence, and can identify gaps in research evidence to define future research agendas. Knowledge synthesis activities in healthcare have largely focused on systematic reviews of interventions. However, a wider range of synthesis methods has emerged in the last decade addressing different types of questions (e.g., realist synthesis to explore mediating mechanisms and moderators of interventions). Many different knowledge synthesis methods exist in the literature across multiple disciplines, but locating these, particularly for qualitative research, present challenges. There is a need for a comprehensive manual for synthesis methods (quantitative/qualitative or mixed), outlining how these methods are related, and how to match the most appropriate knowledge synthesis method to answer a research question. The objectives of this scoping review are to: 1) conduct a systematic search of the literature for knowledge synthesis methods across multi-disciplinary fields; 2) compare and contrast the different knowledge synthesis methods; and, 3) map out the specific steps to conducting the knowledge syntheses to inform the development of a knowledge synthesis methods manual/tool.

Methods

We will search relevant electronic databases (e.g., MEDLINE, CINAHL), grey literature, and discipline-based listservs. The scoping review will consider all study designs including qualitative and quantitative methodologies (excluding economic analysis or clinical practice guideline development), and identify knowledge synthesis methods across the disciplines of health, education, sociology, and philosophy. Two reviewers will pilot-test the screening criteria and data abstraction forms, and will independently screen the literature and abstract the data. A three-step synthesis process will be used to map the literature to our objectives.

Discussion

This project represents the first attempt to broadly and systematically identify, define and classify knowledge synthesis methods (i.e., less traditional knowledge synthesis methods). We anticipate that our results will lead to an accepted taxonomy for less traditional knowledge synthesis methods, and to the development and implementation of a methods manual for these reviews which will be relevant to a wide range of knowledge users, including researchers, funders, and journal editors.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cook DJ, Mulrow CD, Haynes RB: Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med. 1997, 126 (5): 376-380.CrossRefPubMed Cook DJ, Mulrow CD, Haynes RB: Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med. 1997, 126 (5): 376-380.CrossRefPubMed
3.
go back to reference Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH: Reviewing the reviewers: the quality of reporting in three secondary journals. CMAJ. 2001, 164 (11): 1573-1576.PubMedPubMedCentral Devereaux PJ, Manns BJ, Ghali WA, Quan H, Guyatt GH: Reviewing the reviewers: the quality of reporting in three secondary journals. CMAJ. 2001, 164 (11): 1573-1576.PubMedPubMedCentral
4.
go back to reference Straus SE, Tetroe J, Graham ID: Knowledge Translation in Health Care: Moving from Evidence to Practice. 2009, UK: Wiley-Blackwell Publishing LtdCrossRef Straus SE, Tetroe J, Graham ID: Knowledge Translation in Health Care: Moving from Evidence to Practice. 2009, UK: Wiley-Blackwell Publishing LtdCrossRef
5.
go back to reference Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC: A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992, 268 (2): 240-248. 10.1001/jama.1992.03490020088036.CrossRefPubMed Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC: A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992, 268 (2): 240-248. 10.1001/jama.1992.03490020088036.CrossRefPubMed
7.
go back to reference Greenhalgh T, Kristjansson E, Robinson V: Realist review to understand the efficacy of school feeding programmes. BMJ. 2007, 335 (7625): 858-861. 10.1136/bmj.39359.525174.AD.CrossRefPubMedPubMedCentral Greenhalgh T, Kristjansson E, Robinson V: Realist review to understand the efficacy of school feeding programmes. BMJ. 2007, 335 (7625): 858-861. 10.1136/bmj.39359.525174.AD.CrossRefPubMedPubMedCentral
9.
go back to reference Kastner M, Estey E, Perrier L, Graham ID, Grimshaw J, Straus SE: Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: a realist review. Impl Sci. 2011, 6: 69-10.1186/1748-5908-6-69.CrossRef Kastner M, Estey E, Perrier L, Graham ID, Grimshaw J, Straus SE: Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: a realist review. Impl Sci. 2011, 6: 69-10.1186/1748-5908-6-69.CrossRef
10.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005, 10 (Suppl 1): 21-34.CrossRefPubMed Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005, 10 (Suppl 1): 21-34.CrossRefPubMed
11.
go back to reference Kristjansson EA, Robinson V, Petticrew M, MacDonald B, Krasevec J, Janzen L, et al: School feeding for improving the physical and psychosocial health of disadvantaged elementary school children. Cochrane Database Syst Rev. 2007, 1: CD004676-PubMed Kristjansson EA, Robinson V, Petticrew M, MacDonald B, Krasevec J, Janzen L, et al: School feeding for improving the physical and psychosocial health of disadvantaged elementary school children. Cochrane Database Syst Rev. 2007, 1: CD004676-PubMed
13.
go back to reference Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6 (8): e1000086-10.1371/journal.pmed.1000086.CrossRefPubMedPubMedCentral Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al: Can we systematically review studies that evaluate complex interventions?. PLoS Med. 2009, 6 (8): e1000086-10.1371/journal.pmed.1000086.CrossRefPubMedPubMedCentral
14.
go back to reference Mazzocato P, Savage C, Brommels M, Aronsson H, Thor J: Lean thinking in healthcare: a realist review of the literature. Qual Saf Health Care. 2010, 19 (5): 376-382. 10.1136/qshc.2009.037986.PubMed Mazzocato P, Savage C, Brommels M, Aronsson H, Thor J: Lean thinking in healthcare: a realist review of the literature. Qual Saf Health Care. 2010, 19 (5): 376-382. 10.1136/qshc.2009.037986.PubMed
15.
go back to reference Thorne S, Paterson B: Shifting images of chronic illness. Image J Nurs Sch. 1998, 30 (2): 173-178. 10.1111/j.1547-5069.1998.tb01275.x.CrossRefPubMed Thorne S, Paterson B: Shifting images of chronic illness. Image J Nurs Sch. 1998, 30 (2): 173-178. 10.1111/j.1547-5069.1998.tb01275.x.CrossRefPubMed
16.
go back to reference Wong G, Greenhalgh T, Pawson R: Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ. 2010, 10: 12-10.1186/1472-6920-10-12.CrossRefPubMedPubMedCentral Wong G, Greenhalgh T, Pawson R: Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ. 2010, 10: 12-10.1186/1472-6920-10-12.CrossRefPubMedPubMedCentral
17.
go back to reference Rycroft-Malone J, McCormack B, Hutchinson AM, et al: Realist synthesis: illustrating the method for implementation research. Impl Sci. 2012, 7: 33-10.1186/1748-5908-7-33.CrossRef Rycroft-Malone J, McCormack B, Hutchinson AM, et al: Realist synthesis: illustrating the method for implementation research. Impl Sci. 2012, 7: 33-10.1186/1748-5908-7-33.CrossRef
18.
go back to reference Sutton AJ, Abrams KR: Bayesian methods in meta-analysis and evidence synthesis. Stat Methods Med Res. 2001, 10: 277-303. 10.1191/096228001678227794.CrossRefPubMed Sutton AJ, Abrams KR: Bayesian methods in meta-analysis and evidence synthesis. Stat Methods Med Res. 2001, 10: 277-303. 10.1191/096228001678227794.CrossRefPubMed
19.
go back to reference Roberts KA, Dixon-Woods M, Fitzpatrick R, Abrams KR, Jones DR: Factors affecting uptake of childhood immunization: a Bayesian synthesis of qualitative and quantitative evidence. Lancet. 2002, 360: 1596-1599. 10.1016/S0140-6736(02)11560-1.CrossRefPubMed Roberts KA, Dixon-Woods M, Fitzpatrick R, Abrams KR, Jones DR: Factors affecting uptake of childhood immunization: a Bayesian synthesis of qualitative and quantitative evidence. Lancet. 2002, 360: 1596-1599. 10.1016/S0140-6736(02)11560-1.CrossRefPubMed
20.
go back to reference Stemler S: An overview of content analysis. Practical Assessment, Research and Evaluation. 2001, 7: 17- Stemler S: An overview of content analysis. Practical Assessment, Research and Evaluation. 2001, 7: 17-
21.
go back to reference Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al: Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006, 6: 35-10.1186/1471-2288-6-35.CrossRefPubMedPubMedCentral Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al: Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006, 6: 35-10.1186/1471-2288-6-35.CrossRefPubMedPubMedCentral
22.
go back to reference Droitcour J, Silberman G, Chelimsky E: Cross-design synthesis: a new form of metaanalysis for combining results from randomised clinical trials and medical-practice databases. Int Journal of Tech Assessment in Health Care. 1993, 9: 440-927. 10.1017/S0266462300004694.CrossRef Droitcour J, Silberman G, Chelimsky E: Cross-design synthesis: a new form of metaanalysis for combining results from randomised clinical trials and medical-practice databases. Int Journal of Tech Assessment in Health Care. 1993, 9: 440-927. 10.1017/S0266462300004694.CrossRef
24.
go back to reference Pope C, Ziebland S, Mays N: Qualitative research in health care: analysing qualitative data. Br Med J. 2000, 320: 114-116. 10.1136/bmj.320.7227.114.CrossRef Pope C, Ziebland S, Mays N: Qualitative research in health care: analysing qualitative data. Br Med J. 2000, 320: 114-116. 10.1136/bmj.320.7227.114.CrossRef
25.
go back to reference Brunton G, Oliver S, Oliver K, Lorenc T: A Synthesis of Research Addressing Children’s, Young People’s and Parents’ Views of Walking and Cycling for Transport. 2006, London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London Brunton G, Oliver S, Oliver K, Lorenc T: A Synthesis of Research Addressing Children’s, Young People’s and Parents’ Views of Walking and Cycling for Transport. 2006, London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London
26.
go back to reference Strauss AL, Corbin J: Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 1998, Thousand Oaks: Sage Strauss AL, Corbin J: Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 1998, Thousand Oaks: Sage
27.
go back to reference Noblit GW, Hare RD: Meta-ethnography: synthesizing qualitative studies. 1988, Newbury Park: SageCrossRef Noblit GW, Hare RD: Meta-ethnography: synthesizing qualitative studies. 1988, Newbury Park: SageCrossRef
28.
go back to reference Weed M: “Meta interpretation”: a method for the interpretive synthesis of qualitative research. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research. 2005, 6 (1; Art. 37): 1-18. Weed M: “Meta interpretation”: a method for the interpretive synthesis of qualitative research. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research. 2005, 6 (1; Art. 37): 1-18.
29.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005, 61 (2): 417-430. 10.1016/j.socscimed.2004.12.001.CrossRefPubMed Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005, 61 (2): 417-430. 10.1016/j.socscimed.2004.12.001.CrossRefPubMed
30.
go back to reference Paterson BL, Thorne SE, Canam C, Jillings C: Meta-Study of Qualitative Health Research. A Practical Guide to Meta-Analysis and Meta-Synthesis. 2001, Thousand Oaks: Sage PublicationsCrossRef Paterson BL, Thorne SE, Canam C, Jillings C: Meta-Study of Qualitative Health Research. A Practical Guide to Meta-Analysis and Meta-Synthesis. 2001, Thousand Oaks: Sage PublicationsCrossRef
31.
go back to reference Sandelowski M, Barroso J: Creating metasummaries of qualitative findings. Nurs Res. 2003, 52 (4): 226-233. 10.1097/00006199-200307000-00004.CrossRefPubMed Sandelowski M, Barroso J: Creating metasummaries of qualitative findings. Nurs Res. 2003, 52 (4): 226-233. 10.1097/00006199-200307000-00004.CrossRefPubMed
32.
go back to reference Sandelowski M, Docherty S, Emden C: Qualitative metasynthesis: Issues and techniques. Res Nurs Health. 1997, 20 (4): 365-371. 10.1002/(SICI)1098-240X(199708)20:4<365::AID-NUR9>3.0.CO;2-E.CrossRefPubMed Sandelowski M, Docherty S, Emden C: Qualitative metasynthesis: Issues and techniques. Res Nurs Health. 1997, 20 (4): 365-371. 10.1002/(SICI)1098-240X(199708)20:4<365::AID-NUR9>3.0.CO;2-E.CrossRefPubMed
33.
go back to reference Pluye P, Grad R, Dunikowski LG, Stephenson R: Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies. Int J Med Inform. 2005, 74: 745-768. 10.1016/j.ijmedinf.2005.05.004.CrossRefPubMed Pluye P, Grad R, Dunikowski LG, Stephenson R: Impact of clinical information-retrieval technology on physicians: A literature review of quantitative, qualitative and mixed methods studies. Int J Med Inform. 2005, 74: 745-768. 10.1016/j.ijmedinf.2005.05.004.CrossRefPubMed
34.
go back to reference Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J: A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. Int J Nurs Stud. 2009, 46 (4): 529-546. 10.1016/j.ijnurstu.2009.01.009.CrossRefPubMed Pluye P, Gagnon MP, Griffiths F, Johnson-Lafleur J: A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. Int J Nurs Stud. 2009, 46 (4): 529-546. 10.1016/j.ijnurstu.2009.01.009.CrossRefPubMed
35.
go back to reference Sandelowski M: Tables or tableaux? The challenges of writing and reading mixed methods studies. Handbook of Mixed Methods: Social and Behavioral Research. Edited by: Tashakkori A, Teddue C. 2003, London: Sage, 321-350. Sandelowski M: Tables or tableaux? The challenges of writing and reading mixed methods studies. Handbook of Mixed Methods: Social and Behavioral Research. Edited by: Tashakkori A, Teddue C. 2003, London: Sage, 321-350.
36.
go back to reference Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesizing qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10 (1): 45-53. 10.1258/1355819052801804.CrossRefPubMed Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesizing qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10 (1): 45-53. 10.1258/1355819052801804.CrossRefPubMed
37.
go back to reference Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S: Guidance on the conduct of narrative synthesis in systematic reviews. Results of an ESRC funded research project. 2006, UK: University of Lancaster, Unpublished report. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S: Guidance on the conduct of narrative synthesis in systematic reviews. Results of an ESRC funded research project. 2006, UK: University of Lancaster, Unpublished report.
38.
go back to reference Yin R: Case study research, design and methods. Applied Social Research Methods Series Vol 5. 2003, Thousand Oaks CA: Sage, 3, Yin R: Case study research, design and methods. Applied Social Research Methods Series Vol 5. 2003, Thousand Oaks CA: Sage, 3,
39.
go back to reference Miles MB, Huberman AM: Qualitative data analysis: an expanded sourcebook. 1994, London: Sage Miles MB, Huberman AM: Qualitative data analysis: an expanded sourcebook. 1994, London: Sage
40.
go back to reference Jensen L, Allen M: Meta-synthesis of qualitative findings. Qual Health Res. 1996, 6 (4): 553-560. 10.1177/104973239600600407.CrossRef Jensen L, Allen M: Meta-synthesis of qualitative findings. Qual Health Res. 1996, 6 (4): 553-560. 10.1177/104973239600600407.CrossRef
41.
go back to reference Grant MJ, Booth A: A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009, 26: 91-108. 10.1111/j.1471-1842.2009.00848.x.CrossRefPubMed Grant MJ, Booth A: A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009, 26: 91-108. 10.1111/j.1471-1842.2009.00848.x.CrossRefPubMed
42.
go back to reference Yin R, Heald K: Using the case survey method to analyse policy studies. Admin Sci Q. 1975, 20: 371-381. 10.2307/2391997.CrossRef Yin R, Heald K: Using the case survey method to analyse policy studies. Admin Sci Q. 1975, 20: 371-381. 10.2307/2391997.CrossRef
43.
go back to reference Pelz D: Use of innovation in innovating processes by local governments. 1981, Ann Arbor: University of Michigan, CRUSK Institute for Social Research Pelz D: Use of innovation in innovating processes by local governments. 1981, Ann Arbor: University of Michigan, CRUSK Institute for Social Research
44.
go back to reference Lucas PJ, Arai L, Baird B, Law C, Roberts HM: Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Med Res Methodol. 2007, 7: 4-10.1186/1471-2288-7-4.CrossRefPubMedPubMedCentral Lucas PJ, Arai L, Baird B, Law C, Roberts HM: Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Med Res Methodol. 2007, 7: 4-10.1186/1471-2288-7-4.CrossRefPubMedPubMedCentral
45.
go back to reference Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (1): 6-20. 10.1258/1355819054308576.CrossRefPubMed Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (1): 6-20. 10.1258/1355819054308576.CrossRefPubMed
46.
go back to reference Thomas J: Harden A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008, 8: 45-10.1186/1471-2288-8-45.CrossRefPubMedPubMedCentral Thomas J: Harden A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008, 8: 45-10.1186/1471-2288-8-45.CrossRefPubMedPubMedCentral
47.
go back to reference Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Method. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRef Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Method. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRef
48.
go back to reference Arksey H, O’Malley L: Scoping studies: towards a methodological framework. Int J Social Res Method. 2005, 8: 19-31. 10.1080/1364557032000119616.CrossRef Arksey H, O’Malley L: Scoping studies: towards a methodological framework. Int J Social Res Method. 2005, 8: 19-31. 10.1080/1364557032000119616.CrossRef
49.
go back to reference Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952. 10.1016/j.jclinepi.2008.10.012.CrossRefPubMed Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62 (9): 944-952. 10.1016/j.jclinepi.2008.10.012.CrossRefPubMed
51.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26 (1): 13-24. 10.1002/chp.47.CrossRefPubMed Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al: Lost in knowledge translation: time for a map?. J Contin Educ Health Prof. 2006, 26 (1): 13-24. 10.1002/chp.47.CrossRefPubMed
Metadata
Title
What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review
Authors
Monika Kastner
Andrea C Tricco
Charlene Soobiah
Erin Lillie
Laure Perrier
Tanya Horsley
Vivian Welch
Elise Cogo
Jesmin Antony
Sharon E Straus
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-114

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue