Skip to main content
Top
Published in: Systematic Reviews 1/2013

Open Access 01-12-2013 | Commentary

Celebrating methodological challenges and changes: reflecting on the emergence and importance of the role of qualitative evidence in Cochrane reviews

Authors: Karin Hannes, Andrew Booth, Janet Harris, Jane Noyes

Published in: Systematic Reviews | Issue 1/2013

Login to get access

Abstract

Cochrane systematic reviews have proven to be beneficial for decision making processes, both on a practitioner and a policy level, and there are current initiatives to extend the types of evidence used by them, including qualitative research. In this article we outline the major achievements of the Cochrane Qualitative and Implementation Methods Group. Although the Group has encountered numerous challenges in dealing with the evolution of qualitative evidence synthesis, both outside and within the Cochrane Collaboration, it has successfully responded to the challenges posed in terms of incorporating qualitative evidence in systematic reviews. The Methods Group will continue to advocate for more flexible and inclusive approaches to evidence synthesis in order to meet the exciting challenges and opportunities presented by mixed methods systematic reviews and reviews of complex interventions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hill GB: Archie Cochrane and his legacy: an internal challenge to physicians’ autonomy?. J Clin Epidemiol. 2004, 53: 1189-1192.CrossRef Hill GB: Archie Cochrane and his legacy: an internal challenge to physicians’ autonomy?. J Clin Epidemiol. 2004, 53: 1189-1192.CrossRef
2.
go back to reference Gabbay J, Le-May AE: Practice-based evidence for healthcare: clinical mindlines. 2011, Abingdon: Routledge Gabbay J, Le-May AE: Practice-based evidence for healthcare: clinical mindlines. 2011, Abingdon: Routledge
3.
go back to reference Haynes RB, Devereaux PJ, Guyatt GH: Physicians’ and patients’ choices in evidence based practice: evidence does not make decisions, people do. BMJ. 2002, 324: 1350-10.1136/bmj.324.7350.1350.CrossRefPubMedPubMedCentral Haynes RB, Devereaux PJ, Guyatt GH: Physicians’ and patients’ choices in evidence based practice: evidence does not make decisions, people do. BMJ. 2002, 324: 1350-10.1136/bmj.324.7350.1350.CrossRefPubMedPubMedCentral
4.
go back to reference Arai L, Roen K, Roberts H, Popay J: It might work in Oklahoma but will it work in Oakhampton? Context and implementation in the effectiveness literature on domestic smoke detectors. Inj Prev. 2005, 11: 148-151. 10.1136/ip.2004.007336.CrossRefPubMedPubMedCentral Arai L, Roen K, Roberts H, Popay J: It might work in Oklahoma but will it work in Oakhampton? Context and implementation in the effectiveness literature on domestic smoke detectors. Inj Prev. 2005, 11: 148-151. 10.1136/ip.2004.007336.CrossRefPubMedPubMedCentral
5.
go back to reference Greenhalgh T: Narrative based medicine in an evidence based world. BMJ. 1999, 318: 323.1- Greenhalgh T: Narrative based medicine in an evidence based world. BMJ. 1999, 318: 323.1-
7.
go back to reference Noblit G, Hare R: Meta-ethnography: synthesizing qualitative studies. 1988, London: Sage Publications IncCrossRef Noblit G, Hare R: Meta-ethnography: synthesizing qualitative studies. 1988, London: Sage Publications IncCrossRef
8.
go back to reference Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesizing qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10: 45-53. 10.1258/1355819052801804.CrossRefPubMed Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesizing qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10: 45-53. 10.1258/1355819052801804.CrossRefPubMed
9.
go back to reference Pearson A, Wiechula R, Court A, Lockwood C: A re-consideration of what constitutes ‘evidence’ in the healthcare professions. Nurs Sci Q. 2007, 20: 85-88. 10.1177/0894318406296306.CrossRefPubMed Pearson A, Wiechula R, Court A, Lockwood C: A re-consideration of what constitutes ‘evidence’ in the healthcare professions. Nurs Sci Q. 2007, 20: 85-88. 10.1177/0894318406296306.CrossRefPubMed
10.
go back to reference Dixon-Woods M, Agarwal S, Jones DR, Young B, Sutton AJ, Noyes J: Synthesizing qualitative and quantitative evidence within a systematic review. Nursing research: designs and methods. Edited by: Watson R, McKenna H, Cowman S, Keady J. 2008, Livingstone: Churchill Dixon-Woods M, Agarwal S, Jones DR, Young B, Sutton AJ, Noyes J: Synthesizing qualitative and quantitative evidence within a systematic review. Nursing research: designs and methods. Edited by: Watson R, McKenna H, Cowman S, Keady J. 2008, Livingstone: Churchill
11.
go back to reference Noyes J, Popay J, Pearson A, Hannes K, Booth A: Chapter 20: qualitative research and Cochrane reviews. Cochrane handbook for systematic reviews of interventions version 5.1.0 (Updated march 2011). Edited by: Higgins JPT, Green S. 1993, The Cochrane Collaboration,http://www.cochrane-handbook.org, Noyes J, Popay J, Pearson A, Hannes K, Booth A: Chapter 20: qualitative research and Cochrane reviews. Cochrane handbook for systematic reviews of interventions version 5.1.0 (Updated march 2011). Edited by: Higgins JPT, Green S. 1993, The Cochrane Collaboration,http://​www.​cochrane-handbook.​org,
12.
go back to reference Noyes J, Popay J: Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 2007, 57: 227-243. 10.1111/j.1365-2648.2006.04092.x.CrossRefPubMed Noyes J, Popay J: Directly observed therapy and tuberculosis: how can a systematic review of qualitative research contribute to improving services? A qualitative meta-synthesis. J Adv Nurs. 2007, 57: 227-243. 10.1111/j.1365-2648.2006.04092.x.CrossRefPubMed
13.
go back to reference Volmink J, Garner P: Directly observed therapy for treating tuberculosis. Cochrane Database Syst Rev. 1997, 4: 10.1002/14651858.CD003343.pub3 Volmink J, Garner P: Directly observed therapy for treating tuberculosis. Cochrane Database Syst Rev. 1997, 4: 10.1002/14651858.CD003343.pub3
14.
go back to reference Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRefPubMedPubMedCentral Barnett-Page E, Thomas J: Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009, 9: 59-10.1186/1471-2288-9-59.CrossRefPubMedPubMedCentral
15.
go back to reference Hannes K, Lockwood C: Qualitative evidence synthesis: choosing the right approach. 2012, West Sussex: Wiley-Blackwell Publishers Hannes K, Lockwood C: Qualitative evidence synthesis: choosing the right approach. 2012, West Sussex: Wiley-Blackwell Publishers
17.
go back to reference Noyes J, Lewin S: Chapter 6: supplemental guidance on selecting a method of qualitative evidence synthesis, and integrating qualitative evidence with Cochrane intervention reviews. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://cqrmg.cochrane.org/supplemental-handbook-guidance] Noyes J, Lewin S: Chapter 6: supplemental guidance on selecting a method of qualitative evidence synthesis, and integrating qualitative evidence with Cochrane intervention reviews. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://​cqrmg.​cochrane.​org/​supplemental-handbook-guidance]
18.
go back to reference Harris J: Chapter 2: using qualitative research to develop robust effectiveness questions and protocols for Cochrane systematic reviews. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative Methods Group,http://cqrmg.cochrane.org/supplemental-handbook-guidance, Harris J: Chapter 2: using qualitative research to develop robust effectiveness questions and protocols for Cochrane systematic reviews. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative Methods Group,http://​cqrmg.​cochrane.​org/​supplemental-handbook-guidance,
19.
go back to reference Tharyan P: Introducing conceptual and analytical clarity on dimensions of complexity in systematic reviews of complex interventions. J Clin Epidemiol. 2013, In press Tharyan P: Introducing conceptual and analytical clarity on dimensions of complexity in systematic reviews of complex interventions. J Clin Epidemiol. 2013, In press
20.
go back to reference Hannes K, Macaitis K: A move to more transparent and systematic approaches of qualitative evidence synthesis: update of a review on published papers. Qual Res. 2012, 12: 402-442. 10.1177/1468794111432992.CrossRef Hannes K, Macaitis K: A move to more transparent and systematic approaches of qualitative evidence synthesis: update of a review on published papers. Qual Res. 2012, 12: 402-442. 10.1177/1468794111432992.CrossRef
21.
go back to reference Dixon-Woods M, Booth A, Sutton AJ: Synthesizing qualitative research: a review of published reports. Qual Res. 2007, 7: 375-10.1177/1468794107078517.CrossRef Dixon-Woods M, Booth A, Sutton AJ: Synthesizing qualitative research: a review of published reports. Qual Res. 2007, 7: 375-10.1177/1468794107078517.CrossRef
22.
go back to reference Tong A, Flemming K, McInnes E, Oliver S, Craig J: Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012, 12: 181-10.1186/1471-2288-12-181.CrossRefPubMedPubMedCentral Tong A, Flemming K, McInnes E, Oliver S, Craig J: Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012, 12: 181-10.1186/1471-2288-12-181.CrossRefPubMedPubMedCentral
23.
go back to reference Ryan R, Hill S, Lowe D, Allen K, Taylor M, Mead C: Notification and support for people exposed to the risk of Creutzfeldt-Jakob disease (CJD) (or other prion diseases) through medical treatment (iatrogenically). Cochrane Database of Syst Rev. 2011, 3: doi:10.1002/14651858.CD007578.pub2. Article Number: 7578 Ryan R, Hill S, Lowe D, Allen K, Taylor M, Mead C: Notification and support for people exposed to the risk of Creutzfeldt-Jakob disease (CJD) (or other prion diseases) through medical treatment (iatrogenically). Cochrane Database of Syst Rev. 2011, 3: doi:10.1002/14651858.CD007578.pub2. Article Number: 7578
24.
go back to reference Lins S, Rücker G, Motschall E, Langer G, Antes G, Meyer G: Efficacy and experiences of telephone counseling for informal carers of people with dementia. Cochrane Database of Syst Rev. 2011, 5: doi:10.1002/14651858.CD009126. Article Number: CD009126 Lins S, Rücker G, Motschall E, Langer G, Antes G, Meyer G: Efficacy and experiences of telephone counseling for informal carers of people with dementia. Cochrane Database of Syst Rev. 2011, 5: doi:10.1002/14651858.CD009126. Article Number: CD009126
25.
go back to reference Leiknes KA, Berg RC, Smedslund G, Jarosch-von Schweder L, Overland S, Hammerstrom KT, Hoie B: Electroconvulsive therapy for depression. Cochrane Database of Syst Rev. 2011, 5: doi:10.1002/14651858.CD009105. Article Number: CD009105 Leiknes KA, Berg RC, Smedslund G, Jarosch-von Schweder L, Overland S, Hammerstrom KT, Hoie B: Electroconvulsive therapy for depression. Cochrane Database of Syst Rev. 2011, 5: doi:10.1002/14651858.CD009105. Article Number: CD009105
26.
go back to reference Cassidy TM, Giglia RC: Psychosocial and cultural interventions for reducing alcohol consumption during lactation. Cochrane Database of Syst Rev. 2012, 3: doi:10.1002/14651858.CD009707. Article Number: CD009707 Cassidy TM, Giglia RC: Psychosocial and cultural interventions for reducing alcohol consumption during lactation. Cochrane Database of Syst Rev. 2012, 3: doi:10.1002/14651858.CD009707. Article Number: CD009707
27.
go back to reference Jordan J, Rose L, Dainty KN, Noyes J, Clarke S, Blackwood B: Factors that impact on the use of mechanical ventilation weaning protocols in critically ill adults and children: a qualitative evidence-synthesis. Cochrane Database of Syst Rev. 2012, 5: doi:10.1002/14651858.CD009851. Article Number: CD009851 Jordan J, Rose L, Dainty KN, Noyes J, Clarke S, Blackwood B: Factors that impact on the use of mechanical ventilation weaning protocols in critically ill adults and children: a qualitative evidence-synthesis. Cochrane Database of Syst Rev. 2012, 5: doi:10.1002/14651858.CD009851. Article Number: CD009851
28.
go back to reference Rashidian A, Shakibazadeh E, Karimi- Shahanjarini A, Glenton C, Noyes J, Lewin S, Colvin C, Laurant M: Barriers and facilitators to the implementation of doctor-nurse substitution strategies in primary care: qualitative evidence synthesis. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010412. Article Number: CD010412 Rashidian A, Shakibazadeh E, Karimi- Shahanjarini A, Glenton C, Noyes J, Lewin S, Colvin C, Laurant M: Barriers and facilitators to the implementation of doctor-nurse substitution strategies in primary care: qualitative evidence synthesis. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010412. Article Number: CD010412
29.
go back to reference Glenton C, Colvin C, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programs to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010414. Article Number: CD010414 Glenton C, Colvin C, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programs to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010414. Article Number: CD010414
30.
go back to reference Husk K, Lovell R, Cooper C, Garside R: Participation in environmental enhancement and conservation activities for health and well-being in adults. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010351. Article Number: CD010351 Husk K, Lovell R, Cooper C, Garside R: Participation in environmental enhancement and conservation activities for health and well-being in adults. Cochrane Database of Syst Rev. 2013, 2: doi:10.1002/14651858.CD010351. Article Number: CD010351
31.
go back to reference Hurley M, Walsh N, Oliver S, Dickson K, Hauari H, Grant R: Exercise interventions and patient beliefs or people with chronic hip and knee pain: a mixed methods review. In press Hurley M, Walsh N, Oliver S, Dickson K, Hauari H, Grant R: Exercise interventions and patient beliefs or people with chronic hip and knee pain: a mixed methods review. In press
33.
34.
go back to reference Booth A: Chapter 3: searching for studies. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://cqrmg.cochrane.org/supplemental-handbook-guidance] Booth A: Chapter 3: searching for studies. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://​cqrmg.​cochrane.​org/​supplemental-handbook-guidance]
35.
go back to reference Dixon-Woods M, Shaw RL, Agarwal S, Smith JA: The problem of appraising qualitative research. Qual Saf Health Care. 2004, 13: 223-225. 10.1136/qshc.2003.008714.CrossRefPubMedPubMedCentral Dixon-Woods M, Shaw RL, Agarwal S, Smith JA: The problem of appraising qualitative research. Qual Saf Health Care. 2004, 13: 223-225. 10.1136/qshc.2003.008714.CrossRefPubMedPubMedCentral
36.
go back to reference Hannes K: Chapter 4: critical appraisal of qualitative research. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://cqrmg.cochrane.org/supplemental-handbook-guidance] Hannes K: Chapter 4: critical appraisal of qualitative research. Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harris J, Lewin S, Lockwood C. 2011, The Cochrane Collaboration Qualitative and Implementation Methods Group, http://​cqrmg.​cochrane.​org/​supplemental-handbook-guidance]
37.
go back to reference Carroll C, Booth A, Lloyd-Jones M: Should we exclude inadequately reported studies from qualitative systematic reviews? An evaluation of sensitivity analyses in two case study reviews. Qual Health Res. 2012, 22: 1425-1434. 10.1177/1049732312452937.CrossRefPubMed Carroll C, Booth A, Lloyd-Jones M: Should we exclude inadequately reported studies from qualitative systematic reviews? An evaluation of sensitivity analyses in two case study reviews. Qual Health Res. 2012, 22: 1425-1434. 10.1177/1049732312452937.CrossRefPubMed
38.
go back to reference Lewin S, Glenton C, Noyes J, Hendry M, Rashidian A: CerQual approach: assessing How much certainty to place in findings from qualitative evidence syntheses. 2013, Quebec, Canada: 21st Cochrane Colloquium Lewin S, Glenton C, Noyes J, Hendry M, Rashidian A: CerQual approach: assessing How much certainty to place in findings from qualitative evidence syntheses. 2013, Quebec, Canada: 21st Cochrane Colloquium
39.
go back to reference Sandelowski M, Barroso J: Handbook for synthesizing qualitative research. 2007, New York: Springer Sandelowski M, Barroso J: Handbook for synthesizing qualitative research. 2007, New York: Springer
40.
go back to reference Timmermans S, Berg M: The gold standard: the challenge of evidence based medicine and standardization in health care. 2003, Philadelphia: Temple University Press Timmermans S, Berg M: The gold standard: the challenge of evidence based medicine and standardization in health care. 2003, Philadelphia: Temple University Press
41.
go back to reference Noyes J: Never mind the qualitative feel the depth!. The evolving role of qualitative research in Cochrane intervention reviews. J Res Nurs. 2010, 15: 525- Noyes J: Never mind the qualitative feel the depth!. The evolving role of qualitative research in Cochrane intervention reviews. J Res Nurs. 2010, 15: 525-
Metadata
Title
Celebrating methodological challenges and changes: reflecting on the emergence and importance of the role of qualitative evidence in Cochrane reviews
Authors
Karin Hannes
Andrew Booth
Janet Harris
Jane Noyes
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2013
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-84

Other articles of this Issue 1/2013

Systematic Reviews 1/2013 Go to the issue