Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Technical advance

Establishing confidence in the output of qualitative research synthesis: the ConQual approach

Authors: Zachary Munn, Kylie Porritt, Craig Lockwood, Edoardo Aromataris, Alan Pearson

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

The importance of findings derived from syntheses of qualitative research has been increasingly acknowledged. Findings that arise from qualitative syntheses inform questions of practice and policy in their own right and are commonly used to complement findings from quantitative research syntheses. The GRADE approach has been widely adopted by international organisations to rate the quality and confidence of the findings of quantitative systematic reviews. To date, there has been no widely accepted corresponding approach to assist health care professionals and policy makers in establishing confidence in the synthesised findings of qualitative systematic reviews.

Methods

A methodological group was formed develop a process to assess the confidence in synthesised qualitative research findings and develop a Summary of Findings tables for meta-aggregative qualitative systematic reviews.

Results

Dependability and credibility are two elements considered by the methodological group to influence the confidence of qualitative synthesised findings. A set of critical appraisal questions are proposed to establish dependability, whilst credibility can be ranked according to the goodness of fit between the author’s interpretation and the original data. By following the processes outlined in this article, an overall ranking can be assigned to rate the confidence of synthesised qualitative findings, a system we have labelled ConQual.

Conclusions

The development and use of the ConQual approach will assist users of qualitative systematic reviews to establish confidence in the evidence produced in these types of reviews and can serve as a practical tool to assist in decision making.
Appendix
Available only for authorised users
Literature
1.
go back to reference Guyatt G, Cairns J, Churchill D, Cook D, Haynes B, Hirsh J, Irvine J, Levine M, Levine M, Nishikawa J, Sackett D, Brill-Edwards P, Gerstein H, Gibson J, Jaeschke R, Kerigan A, Neville A, Panju A, Detsky A, Enkin M, Frid P, Gerrity M, Laupacis A, Lawrence V, Menard J, Moyer V, Mulrow C, Links P, Oxman A, Sinclair J, Tugwell P: Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-2425. 10.1001/jama.1992.03490170092032.CrossRef Guyatt G, Cairns J, Churchill D, Cook D, Haynes B, Hirsh J, Irvine J, Levine M, Levine M, Nishikawa J, Sackett D, Brill-Edwards P, Gerstein H, Gibson J, Jaeschke R, Kerigan A, Neville A, Panju A, Detsky A, Enkin M, Frid P, Gerrity M, Laupacis A, Lawrence V, Menard J, Moyer V, Mulrow C, Links P, Oxman A, Sinclair J, Tugwell P: Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-2425. 10.1001/jama.1992.03490170092032.CrossRef
2.
go back to reference Sackett D, Rosenberg W, Gray J, Haynes R, Richardson W: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 13: 71-72.CrossRef Sackett D, Rosenberg W, Gray J, Haynes R, Richardson W: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 13: 71-72.CrossRef
3.
go back to reference Pearson A, Wiechula R, Court A, Lockwood C: The JBI model of evidence-based healthcare. Int J Evid Base Healthc. 2005, 3: 207-215. Pearson A, Wiechula R, Court A, Lockwood C: The JBI model of evidence-based healthcare. Int J Evid Base Healthc. 2005, 3: 207-215.
4.
go back to reference Marshall G, Sykes AE: Systematic reviews: a guide for radiographers and other health care professionals. Radiography. 2010, doi:10.1016/j.radi.2010.08.007 Marshall G, Sykes AE: Systematic reviews: a guide for radiographers and other health care professionals. Radiography. 2010, doi:10.1016/j.radi.2010.08.007
5.
go back to reference Noyes J, Popay J, Pearson A, Hannes K, Booth A: Qualitative research and Cochrane reviews. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins J, Green S. 2011, The Cochrane Collaboration, http://www.cochrane-handbook.org, Version 510 [updated March 2011], Noyes J, Popay J, Pearson A, Hannes K, Booth A: Qualitative research and Cochrane reviews. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins J, Green S. 2011, The Cochrane Collaboration, http://​www.​cochrane-handbook.​org, Version 510 [updated March 2011],
6.
go back to reference Pearson A: Balancing the evidence: incorporating the synthesis of qualitative data into systematic reviews. JBI Reports. 2004, 2: 45-64. 10.1111/j.1479-6988.2004.00008.x.CrossRef Pearson A: Balancing the evidence: incorporating the synthesis of qualitative data into systematic reviews. JBI Reports. 2004, 2: 45-64. 10.1111/j.1479-6988.2004.00008.x.CrossRef
7.
go back to reference Pearson A, Jordan Z, Munn Z: Translational science and evidence-based healthcare: a clarification and reconceptualization of how knowledge is generated and used in healthcare. Nurs Res Pract. 2012, 2012: 792519-PubMedPubMedCentral Pearson A, Jordan Z, Munn Z: Translational science and evidence-based healthcare: a clarification and reconceptualization of how knowledge is generated and used in healthcare. Nurs Res Pract. 2012, 2012: 792519-PubMedPubMedCentral
8.
go back to reference The Joanna Briggs Institute: Joanna Briggs Institute Reviewers’ Manual: 2011 edition. 2011, Adelaide: The Joanna Briggs Institute The Joanna Briggs Institute: Joanna Briggs Institute Reviewers’ Manual: 2011 edition. 2011, Adelaide: The Joanna Briggs Institute
9.
go back to reference Sandelowski M, Leeman J: Writing usable qualitative health research findings. Qual Health Res. 2012, 22: 1404-1413. 10.1177/1049732312450368.CrossRefPubMed Sandelowski M, Leeman J: Writing usable qualitative health research findings. Qual Health Res. 2012, 22: 1404-1413. 10.1177/1049732312450368.CrossRefPubMed
10.
go back to reference Hannes K, Lockwood C: Pragmatism as the philosophical foundation for the Joanna Briggs meta-aggregative approach to qualitative evidence synthesis. J Adv Nurs. 2011, 67: 1632-1642. 10.1111/j.1365-2648.2011.05636.x.CrossRefPubMed Hannes K, Lockwood C: Pragmatism as the philosophical foundation for the Joanna Briggs meta-aggregative approach to qualitative evidence synthesis. J Adv Nurs. 2011, 67: 1632-1642. 10.1111/j.1365-2648.2011.05636.x.CrossRefPubMed
11.
go back to reference Thorne S, Jensen L, Kearney MH, Noblit G, Sandelowski M: Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res. 2004, 14: 1342-1365. 10.1177/1049732304269888.CrossRefPubMed Thorne S, Jensen L, Kearney MH, Noblit G, Sandelowski M: Qualitative metasynthesis: reflections on methodological orientation and ideological agenda. Qual Health Res. 2004, 14: 1342-1365. 10.1177/1049732304269888.CrossRefPubMed
12.
go back to reference Noyes J, Lewin S: Supplemental Guidance on Selecting a Method of Qualitative Evidence Synthesis, and Integrating Qualitative Evidence with Cochrane Intervention Reviews. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harries J, Lewin S, Lockwood C. 2011, Cochrane Collaboration Qualitative Methods Group, http://cqrmg.cochrane.org/supplemental-handbook-guidance, Noyes J, Lewin S: Supplemental Guidance on Selecting a Method of Qualitative Evidence Synthesis, and Integrating Qualitative Evidence with Cochrane Intervention Reviews. Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions. Edited by: Noyes J, Booth A, Hannes K, Harden A, Harries J, Lewin S, Lockwood C. 2011, Cochrane Collaboration Qualitative Methods Group, http://​cqrmg.​cochrane.​org/​supplemental-handbook-guidance,
13.
go back to reference Munn Z, Kavanagh S, Lockwood C, Pearson A, Wood F: The development of an evidence based resource for burns care. Burns. 2013, 39: 577-582. 10.1016/j.burns.2012.11.005.CrossRefPubMed Munn Z, Kavanagh S, Lockwood C, Pearson A, Wood F: The development of an evidence based resource for burns care. Burns. 2013, 39: 577-582. 10.1016/j.burns.2012.11.005.CrossRefPubMed
14.
go back to reference Korhonen A, Hakulinen‒Viitanen T, Jylhä V, Holopainen A: Meta‒synthesis and evidence‒based health care–a method for systematic review. Scand J Caring Sci. 2012, 27 (4): 1027-1034.CrossRefPubMed Korhonen A, Hakulinen‒Viitanen T, Jylhä V, Holopainen A: Meta‒synthesis and evidence‒based health care–a method for systematic review. Scand J Caring Sci. 2012, 27 (4): 1027-1034.CrossRefPubMed
15.
go back to reference Munn Z, Jordan Z: The patient experience of high technology medical imaging: a systematic review of the qualitative evidence. Radiography. 2011, 17: 323-331. 10.1016/j.radi.2011.06.004.CrossRef Munn Z, Jordan Z: The patient experience of high technology medical imaging: a systematic review of the qualitative evidence. Radiography. 2011, 17: 323-331. 10.1016/j.radi.2011.06.004.CrossRef
16.
go back to reference Goldet G, Howick J: Understanding GRADE: an introduction. J Evid Based Med. 2013, 6: 50-54. 10.1111/jebm.12018.CrossRefPubMed Goldet G, Howick J: Understanding GRADE: an introduction. J Evid Based Med. 2013, 6: 50-54. 10.1111/jebm.12018.CrossRefPubMed
17.
go back to reference Langendam MW, Akl EA, Dahm P, Glasziou P, Guyatt G, Schunemann HJ: Assessing and presenting summaries of evidence in Cochrane Reviews. Syst Rev. 2013, 2: 81-10.1186/2046-4053-2-81.CrossRefPubMedPubMedCentral Langendam MW, Akl EA, Dahm P, Glasziou P, Guyatt G, Schunemann HJ: Assessing and presenting summaries of evidence in Cochrane Reviews. Syst Rev. 2013, 2: 81-10.1186/2046-4053-2-81.CrossRefPubMedPubMedCentral
18.
go back to reference Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626. 10.1016/j.jclinepi.2009.12.014.CrossRefPubMed Rosenbaum SE, Glenton C, Oxman AD: Summary-of-findings tables in Cochrane reviews improved understanding and rapid retrieval of key information. J Clin Epidemiol. 2010, 63: 620-626. 10.1016/j.jclinepi.2009.12.014.CrossRefPubMed
19.
go back to reference Treweek S, Oxman AD, Alderson P, Bossuyt PM, Brandt L, Brozek J, Davoli M, Flottorp S, Harbour R, Hill S, Liberati A, Liira H, Schünemann HJ, Rosenbaum S, Thornton J, Vandvik PO, Alonso-Coello P, DECIDE Consortium: Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence (DECIDE): protocol and preliminary results. Implement Sci. 2013, 8: 6-10.1186/1748-5908-8-6.CrossRefPubMedPubMedCentral Treweek S, Oxman AD, Alderson P, Bossuyt PM, Brandt L, Brozek J, Davoli M, Flottorp S, Harbour R, Hill S, Liberati A, Liira H, Schünemann HJ, Rosenbaum S, Thornton J, Vandvik PO, Alonso-Coello P, DECIDE Consortium: Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence (DECIDE): protocol and preliminary results. Implement Sci. 2013, 8: 6-10.1186/1748-5908-8-6.CrossRefPubMedPubMedCentral
20.
go back to reference Guba EG, Lincoln YS: Epistemological and methodological bases of naturalistic inquiry. Educ Commun Technol. 1982, 30: 233-252. Guba EG, Lincoln YS: Epistemological and methodological bases of naturalistic inquiry. Educ Commun Technol. 1982, 30: 233-252.
21.
go back to reference Tobin GABC: Methodological rigour within a qualitative framework. J Adv Nurs. 2004, 48: 388-396. 10.1111/j.1365-2648.2004.03207.x.CrossRefPubMed Tobin GABC: Methodological rigour within a qualitative framework. J Adv Nurs. 2004, 48: 388-396. 10.1111/j.1365-2648.2004.03207.x.CrossRefPubMed
22.
go back to reference Krefting L: Rigor in qualitative research: the assessment of trustworthiness. Am J Occup Ther. 1991, 45: 214-222. 10.5014/ajot.45.3.214.CrossRefPubMed Krefting L: Rigor in qualitative research: the assessment of trustworthiness. Am J Occup Ther. 1991, 45: 214-222. 10.5014/ajot.45.3.214.CrossRefPubMed
23.
go back to reference Creswell JW: Qualitative Inquiry and Research Design: Choosing Among Five Approaches. 2007, Thousand Oaks: Sage Publications, Inc, 2 Creswell JW: Qualitative Inquiry and Research Design: Choosing Among Five Approaches. 2007, Thousand Oaks: Sage Publications, Inc, 2
24.
go back to reference Murphy F, Yielder J: Establishing rigour in qualitative radiography research. Radiography. 2010, 16: 62-67. 10.1016/j.radi.2009.07.003.CrossRef Murphy F, Yielder J: Establishing rigour in qualitative radiography research. Radiography. 2010, 16: 62-67. 10.1016/j.radi.2009.07.003.CrossRef
25.
go back to reference Tong A, Flemming K, McInnes E, Oliver S, Craig J: Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012, 12: 181-10.1186/1471-2288-12-181.CrossRefPubMedPubMedCentral Tong A, Flemming K, McInnes E, Oliver S, Craig J: Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012, 12: 181-10.1186/1471-2288-12-181.CrossRefPubMedPubMedCentral
26.
go back to reference Finfgeld DL: Metasynthesis: The State of the Art—So Far. Qual Health Res. 2003, 13: 893-904. 10.1177/1049732303253462.CrossRefPubMed Finfgeld DL: Metasynthesis: The State of the Art—So Far. Qual Health Res. 2003, 13: 893-904. 10.1177/1049732303253462.CrossRefPubMed
27.
go back to reference Hannes K, Lockwood C, Pearson A: A comparative analysis of three online appraisal instruments' ability to assess validity in qualitative research. Qual Health Res. 2010, 20: 1736-1743. 10.1177/1049732310378656.CrossRefPubMed Hannes K, Lockwood C, Pearson A: A comparative analysis of three online appraisal instruments' ability to assess validity in qualitative research. Qual Health Res. 2010, 20: 1736-1743. 10.1177/1049732310378656.CrossRefPubMed
28.
go back to reference Sandelowski M, Barroso J: Finding the findings in qualitative studies. J Nurs Scholarsh. 2002, 34: 213-219. 10.1111/j.1547-5069.2002.00213.x.CrossRefPubMed Sandelowski M, Barroso J: Finding the findings in qualitative studies. J Nurs Scholarsh. 2002, 34: 213-219. 10.1111/j.1547-5069.2002.00213.x.CrossRefPubMed
29.
go back to reference Lewin S, Glenton C, Noyes J, Hendry M, Rashidian A: CerQual Approach: Assessing How Much Certainty to Place in Findings from Qualitative Evidence Syntheses. 2013, Quebec, Canada: 21st Cochrane Colloquium Lewin S, Glenton C, Noyes J, Hendry M, Rashidian A: CerQual Approach: Assessing How Much Certainty to Place in Findings from Qualitative Evidence Syntheses. 2013, Quebec, Canada: 21st Cochrane Colloquium
30.
go back to reference Glenton C, Colvin C, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013, 2: CD010414- Glenton C, Colvin C, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013, 2: CD010414-
31.
go back to reference Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013, 10: CD010414-PubMed Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, Rashidian A: Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013, 10: CD010414-PubMed
32.
go back to reference Glenton C, Lewin S, Carlsen B, Colvin C, Munthe-Kaas H, Noyes J, Rashidian A: Assessing the Certainty of Findings from Qualitative Evidence Syntheses: The CerQual Approach. 2013, Rome, Italy: Draft for discussion In GRADE Working Group Meeting Glenton C, Lewin S, Carlsen B, Colvin C, Munthe-Kaas H, Noyes J, Rashidian A: Assessing the Certainty of Findings from Qualitative Evidence Syntheses: The CerQual Approach. 2013, Rome, Italy: Draft for discussion In GRADE Working Group Meeting
Metadata
Title
Establishing confidence in the output of qualitative research synthesis: the ConQual approach
Authors
Zachary Munn
Kylie Porritt
Craig Lockwood
Edoardo Aromataris
Alan Pearson
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-108

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue