Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

‘Trying to pin down jelly’ - exploring intuitive processes in quality assessment for meta-ethnography

Authors: Francine Toye, Kate Seers, Nick Allcock, Michelle Briggs, Eloise Carr, JoyAnn Andrews, Karen Barker

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Studies that systematically search for and synthesise qualitative research are becoming more evident in health care, and they can make an important contribution to patient care. However, there is still no agreement as to whether, or how we should appraise studies for inclusion. We aimed to explore the intuitive processes that determined the ‘quality’ of qualitative research for inclusion in qualitative research syntheses. We were particularly interested to explore the way that knowledge was constructed.

Methods

We used qualitative methods to explore the process of quality appraisal within a team of seven qualitative researchers funded to undertake a meta-ethnography of chronic non-malignant musculoskeletal pain. Team discussions took place monthly between October 2010 and June 2012 and were recorded and transcribed. Data was coded and organised using constant comparative method. The development of our conceptual analysis was both iterative and collaborative. The strength of this team approach to quality came from open and honest discussion, where team members felt free to agree, disagree, or change their position within the safety of the group.

Results

We suggest two core facets of quality for inclusion in meta-ethnography - (1) Conceptual clarity; how clearly has the author articulated a concept that facilitates theoretical insight. (2) Interpretive rigour; fundamentally, can the interpretation ‘be trusted?’ Our findings showed that three important categories help the reader to judge interpretive rigour: (ii) What is the context of the interpretation? (ii) How inductive is the interpretation? (iii) Has the researcher challenged their interpretation?

Conclusions

We highlight that methods alone do not determine the quality of research for inclusion into a meta-ethnography. The strength of a concept and its capacity to facilitate theoretical insight is integral to meta-ethnography, and arguably to the quality of research. However, we suggest that to be judged ‘good enough’ there also needs to be some assurance that qualitative findings are more than simply anecdotal. Although our conceptual model was developed specifically for meta-ethnography, it may be transferable to other research methodologies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Seers K, Toye F: What is quality in qualitative health research?. Evid Based Nurs. 2011, 15 (1): 1-10.1136/ebn.2011.100268.CrossRefPubMed Seers K, Toye F: What is quality in qualitative health research?. Evid Based Nurs. 2011, 15 (1): 1-10.1136/ebn.2011.100268.CrossRefPubMed
2.
go back to reference Campbell R, Pound P, Morgan M, Daker-White G, Britten N, Pill R, Yardley L, Pope C, Donovan J: Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research. Health Technol Assess. 2011, 15 (43): 1-164.CrossRefPubMed Campbell R, Pound P, Morgan M, Daker-White G, Britten N, Pill R, Yardley L, Pope C, Donovan J: Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research. Health Technol Assess. 2011, 15 (43): 1-164.CrossRefPubMed
3.
go back to reference Dixon-Woods M, Sutton A, Shaw R, Miller T, Smith J, Young B, Bonas S, Booth A, Jones D: Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods. J Health Serv Res Policy. 2007, 12 (1): 42-47. 10.1258/135581907779497486.CrossRefPubMed Dixon-Woods M, Sutton A, Shaw R, Miller T, Smith J, Young B, Bonas S, Booth A, Jones D: Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods. J Health Serv Res Policy. 2007, 12 (1): 42-47. 10.1258/135581907779497486.CrossRefPubMed
5.
go back to reference Dixon-Woods M, Booth A, Sutton A: Synthesizing qualitative research: a review of published reports. Qualitative Research. 2007, 7: 375-422. 10.1177/1468794107078517.CrossRef Dixon-Woods M, Booth A, Sutton A: Synthesizing qualitative research: a review of published reports. Qualitative Research. 2007, 7: 375-422. 10.1177/1468794107078517.CrossRef
6.
go back to reference Hannes K, Macaitis K: A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers. Qualitative Research. 2012, 12 (4): 402-442. 10.1177/1468794111432992.CrossRef Hannes K, Macaitis K: A move to more systematic and transparent approaches in qualitative evidence synthesis: update on a review of published papers. Qualitative Research. 2012, 12 (4): 402-442. 10.1177/1468794111432992.CrossRef
7.
go back to reference Sandelowski M, Barrosso J: Handbook for synthesising qualitative research. 2007, New York: Springer Publishing Company Sandelowski M, Barrosso J: Handbook for synthesising qualitative research. 2007, New York: Springer Publishing Company
8.
go back to reference Blyth FM: The demography of chronic pain: an overview. Chronic Pain Epidemiology From Aetiology to Public Health. Edited by: Croft P, Blyth FM, Windt D. 2010, Oxford: Oxford University Press, 19-29.CrossRef Blyth FM: The demography of chronic pain: an overview. Chronic Pain Epidemiology From Aetiology to Public Health. Edited by: Croft P, Blyth FM, Windt D. 2010, Oxford: Oxford University Press, 19-29.CrossRef
9.
go back to reference Carroll C, Booth A, Lloyd-Jones M: Should we exclude inadequately reported studies from qualitative systematic reviews? An Evaluation of Sensitivity Analyses in Two Case Study Reviews. Qualitative Health Research. 2012, 22 (10): 1425-1434. 10.1177/1049732312452937.CrossRefPubMed Carroll C, Booth A, Lloyd-Jones M: Should we exclude inadequately reported studies from qualitative systematic reviews? An Evaluation of Sensitivity Analyses in Two Case Study Reviews. Qualitative Health Research. 2012, 22 (10): 1425-1434. 10.1177/1049732312452937.CrossRefPubMed
10.
go back to reference Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. 2008, Chichester, England: Wiley-BlackwellCrossRef Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. 2008, Chichester, England: Wiley-BlackwellCrossRef
11.
go back to reference Dixon-Woods M, Shaw R, Agarwal S, Smith J: The problem of appraising qualitative research. Qual Saf Health Care. 2004, 13: 223-225. 10.1136/qshc.2003.008714.CrossRefPubMedPubMedCentral Dixon-Woods M, Shaw R, Agarwal S, Smith J: The problem of appraising qualitative research. Qual Saf Health Care. 2004, 13: 223-225. 10.1136/qshc.2003.008714.CrossRefPubMedPubMedCentral
12.
go back to reference Smith J, Deemer D: The Problem of Criteria in the Age of Relativism. Handbook of Qualitative Research. Edited by: Lincoln NDY. 2000, London: Sage Smith J, Deemer D: The Problem of Criteria in the Age of Relativism. Handbook of Qualitative Research. Edited by: Lincoln NDY. 2000, London: Sage
13.
go back to reference Polanyi M: The Tacit Dimension. 1966, London: Routledge Polanyi M: The Tacit Dimension. 1966, London: Routledge
14.
go back to reference Noblit G, Hare R: Meta-ethnography: Synthesising Qualitative Studies. 1988, California: Sage PublicationsCrossRef Noblit G, Hare R: Meta-ethnography: Synthesising Qualitative Studies. 1988, California: Sage PublicationsCrossRef
15.
go back to reference Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesising qualitative and quantitative research evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10 (1): 45-53. 10.1258/1355819052801804.CrossRefPubMed Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A: Synthesising qualitative and quantitative research evidence: a review of possible methods. J Health Serv Res Policy. 2005, 10 (1): 45-53. 10.1258/1355819052801804.CrossRefPubMed
16.
go back to reference Campbell R, Pound P, Pope C, Britten N, Pill R, Morgan M, Donovan J: Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care. Soc Sci Med. 2003, 56: 671-684. 10.1016/S0277-9536(02)00064-3.CrossRefPubMed Campbell R, Pound P, Pope C, Britten N, Pill R, Morgan M, Donovan J: Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care. Soc Sci Med. 2003, 56: 671-684. 10.1016/S0277-9536(02)00064-3.CrossRefPubMed
17.
go back to reference Malpass A, Shaw A, Sharp D, Walter F, Feder G, Ridd M, Kessler D: "Medication career" or "Moral career"? The two sides of managing anti-dperessants: A meta-ethnography of patients experience of antidepressants. Soc Sci Med. 2009, 68: 154-168. 10.1016/j.socscimed.2008.09.068.CrossRefPubMed Malpass A, Shaw A, Sharp D, Walter F, Feder G, Ridd M, Kessler D: "Medication career" or "Moral career"? The two sides of managing anti-dperessants: A meta-ethnography of patients experience of antidepressants. Soc Sci Med. 2009, 68: 154-168. 10.1016/j.socscimed.2008.09.068.CrossRefPubMed
18.
go back to reference Pound P, Britten N, Morgan M, Yardley L, Pope C, Daker-White G, Campbell R: Resisting medicines: a synthesis of qualitative studies of medicine taking. Soc Sci Med. 2005, 61: 133-155. 10.1016/j.socscimed.2004.11.063.CrossRefPubMed Pound P, Britten N, Morgan M, Yardley L, Pope C, Daker-White G, Campbell R: Resisting medicines: a synthesis of qualitative studies of medicine taking. Soc Sci Med. 2005, 61: 133-155. 10.1016/j.socscimed.2004.11.063.CrossRefPubMed
20.
go back to reference Atkins S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J: Conducting a meta-ethnography of qualitative literature:Lessons learnt. BMC Med Res Methodol. 2008, 8: 21-10.1186/1471-2288-8-21.CrossRefPubMedPubMedCentral Atkins S, Lewin S, Smith H, Engel M, Fretheim A, Volmink J: Conducting a meta-ethnography of qualitative literature:Lessons learnt. BMC Med Res Methodol. 2008, 8: 21-10.1186/1471-2288-8-21.CrossRefPubMedPubMedCentral
22.
go back to reference Seale C: The quality of qualitative research. 1999, London: Sage publicationsCrossRef Seale C: The quality of qualitative research. 1999, London: Sage publicationsCrossRef
23.
go back to reference Holton J: The coding process and its challenges. The Sage Handbook of Grounded Theory. Edited by: Bryant A, Charmaz C. 2007, Los Angeles: Sage, 265-289.CrossRef Holton J: The coding process and its challenges. The Sage Handbook of Grounded Theory. Edited by: Bryant A, Charmaz C. 2007, Los Angeles: Sage, 265-289.CrossRef
24.
go back to reference Altheide DL, Johnson JM: Criteria for Assessing Interpretive Validity in Qualitative Research. Handbook of Qualitative Research. Edited by: Lincoln ND Y. 1994, London: Sage Altheide DL, Johnson JM: Criteria for Assessing Interpretive Validity in Qualitative Research. Handbook of Qualitative Research. Edited by: Lincoln ND Y. 1994, London: Sage
25.
go back to reference Guba E, Lincoln Y: Paradigmatic Controversies, Contradictions and Emerging Confluences. Handbook of qualitative research (third edition). Edited by: Denzin N, Lincoln Y. 2005, London: Sage Guba E, Lincoln Y: Paradigmatic Controversies, Contradictions and Emerging Confluences. Handbook of qualitative research (third edition). Edited by: Denzin N, Lincoln Y. 2005, London: Sage
26.
go back to reference Spencer L, Ritchie J, Lewis J, Dillon L, National-Centre-for-Social-Research: Cabinet Office: Quality in Qualitive Evaluation: A framework for assessing research evidence. 2003 Spencer L, Ritchie J, Lewis J, Dillon L, National-Centre-for-Social-Research: Cabinet Office: Quality in Qualitive Evaluation: A framework for assessing research evidence. 2003
27.
go back to reference Boychuk-Duchscher JE, Morgan D: Grounded theory: reflections on the emergence vs. forcing debate. J Adv Nurs. 2004, 48 (6): 605-612. 10.1111/j.1365-2648.2004.03249.x.CrossRefPubMed Boychuk-Duchscher JE, Morgan D: Grounded theory: reflections on the emergence vs. forcing debate. J Adv Nurs. 2004, 48 (6): 605-612. 10.1111/j.1365-2648.2004.03249.x.CrossRefPubMed
28.
go back to reference Denzin NK: The research act: A theoretical introduction to sociological methods. 1970, Chicago: Aldine Denzin NK: The research act: A theoretical introduction to sociological methods. 1970, Chicago: Aldine
29.
go back to reference Charmaz K: Constructing grounded theory. 2006, California: Sage Publications Charmaz K: Constructing grounded theory. 2006, California: Sage Publications
30.
go back to reference Lincoln Y, Guba E: Naturalistic Enquiry. 1995, California: Sage Lincoln Y, Guba E: Naturalistic Enquiry. 1995, California: Sage
31.
go back to reference Smith J, Hodkinson P: Relativism, Criteria and Politics. The Sage Handbook of Qualitative Research. Edited by: Denzin N, Lincoln Y. 2005, London: Sage Smith J, Hodkinson P: Relativism, Criteria and Politics. The Sage Handbook of Qualitative Research. Edited by: Denzin N, Lincoln Y. 2005, London: Sage
Metadata
Title
‘Trying to pin down jelly’ - exploring intuitive processes in quality assessment for meta-ethnography
Authors
Francine Toye
Kate Seers
Nick Allcock
Michelle Briggs
Eloise Carr
JoyAnn Andrews
Karen Barker
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-46

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue