Skip to main content
Top
Published in: BMC Health Services Research 1/2007

Open Access 01-12-2007 | Research article

Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study

Authors: Alicia O'Cathain, Elizabeth Murphy, Jon Nicholl

Published in: BMC Health Services Research | Issue 1/2007

Login to get access

Abstract

Background

Recently, there has been a surge of international interest in combining qualitative and quantitative methods in a single study – often called mixed methods research. It is timely to consider why and how mixed methods research is used in health services research (HSR).

Methods

Documentary analysis of proposals and reports of 75 mixed methods studies funded by a research commissioner of HSR in England between 1994 and 2004. Face-to-face semi-structured interviews with 20 researchers sampled from these studies.

Results

18% (119/647) of HSR studies were classified as mixed methods research. In the documentation, comprehensiveness was the main driver for using mixed methods research, with researchers wanting to address a wider range of questions than quantitative methods alone would allow. Interviewees elaborated on this, identifying the need for qualitative research to engage with the complexity of health, health care interventions, and the environment in which studies took place. Motivations for adopting a mixed methods approach were not always based on the intrinsic value of mixed methods research for addressing the research question; they could be strategic, for example, to obtain funding. Mixed methods research was used in the context of evaluation, including randomised and non-randomised designs; survey and fieldwork exploratory studies; and instrument development. Studies drew on a limited number of methods – particularly surveys and individual interviews – but used methods in a wide range of roles.

Conclusion

Mixed methods research is common in HSR in the UK. Its use is driven by pragmatism rather than principle, motivated by the perceived deficit of quantitative methods alone to address the complexity of research in health care, as well as other more strategic gains. Methods are combined in a range of contexts, yet the emerging methodological contributions from HSR to the field of mixed methods research are currently limited to the single context of combining qualitative methods and randomised controlled trials. Health services researchers could further contribute to the development of mixed methods research in the contexts of instrument development, survey and fieldwork, and non-randomised evaluations.
Literature
1.
go back to reference Stecher B, Borko H: Integrating findings from surveys and case studies: examples from a study of standards-based educational reform. Journal of Educational Policy. 2002, 17 (5): 547-569. 10.1080/02680930210158311.CrossRef Stecher B, Borko H: Integrating findings from surveys and case studies: examples from a study of standards-based educational reform. Journal of Educational Policy. 2002, 17 (5): 547-569. 10.1080/02680930210158311.CrossRef
2.
go back to reference Teddlie C, Tashakkori A: Major issues and controversies in the use of mixed methods in the social and behavioural sciences. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 3-50. Teddlie C, Tashakkori A: Major issues and controversies in the use of mixed methods in the social and behavioural sciences. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 3-50.
3.
go back to reference Brannen J, (Ed): Mixing methods: qualitative and quantitative research. 1992, Aldershot: Ashgate Brannen J, (Ed): Mixing methods: qualitative and quantitative research. 1992, Aldershot: Ashgate
4.
go back to reference Bryman A: Quantity and quality in social research. 1988, London: Routledge Bryman A: Quantity and quality in social research. 1988, London: Routledge
5.
go back to reference Bryman A: Integrating quantitative and qualitative research: how is it done?. Qualitative Research. 2006, 6: 97-113. 10.1177/1468794106058877.CrossRef Bryman A: Integrating quantitative and qualitative research: how is it done?. Qualitative Research. 2006, 6: 97-113. 10.1177/1468794106058877.CrossRef
6.
go back to reference Gorard S, Taylor C: Combining methods in educational and social research. 2004, Maidenhead: Open University Press Gorard S, Taylor C: Combining methods in educational and social research. 2004, Maidenhead: Open University Press
7.
go back to reference Moran-Ellis J, Alexander VD, Cronin A, Dickinson M, Fielding J, Sleney J, Thomas H: Triangulation and integration: processes, claims and implications. Qualitative Research. 2006, 6 (1): 45-59. 10.1177/1468794106058870.CrossRef Moran-Ellis J, Alexander VD, Cronin A, Dickinson M, Fielding J, Sleney J, Thomas H: Triangulation and integration: processes, claims and implications. Qualitative Research. 2006, 6 (1): 45-59. 10.1177/1468794106058870.CrossRef
8.
go back to reference Bryman A: Paradigm peace and the implications for quality. International Journal of Social Research Methodology. 2006, 9: 111-126. 10.1080/13645570600595280.CrossRef Bryman A: Paradigm peace and the implications for quality. International Journal of Social Research Methodology. 2006, 9: 111-126. 10.1080/13645570600595280.CrossRef
9.
go back to reference Bryman A: Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research. 2007, 1 (1): 8-22. 10.1177/2345678906290531.CrossRef Bryman A: Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods Research. 2007, 1 (1): 8-22. 10.1177/2345678906290531.CrossRef
10.
go back to reference Tashakkori A, Teddlie C, (Eds): Handbook of mixed methods in social and behavioural research. 2003, London: Sage Tashakkori A, Teddlie C, (Eds): Handbook of mixed methods in social and behavioural research. 2003, London: Sage
11.
go back to reference Creswell JW: Research design. Qualitative, quantitative, and mixed methods approaches. 2003, London: Sage Publications;, Second Creswell JW: Research design. Qualitative, quantitative, and mixed methods approaches. 2003, London: Sage Publications;, Second
12.
go back to reference Pope C, Mays N: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. British Medical Journal. 1995, 311: 42-45.PubMedPubMedCentralCrossRef Pope C, Mays N: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. British Medical Journal. 1995, 311: 42-45.PubMedPubMedCentralCrossRef
13.
go back to reference Barbour RS: The case for combining qualitative and quantitative approaches in health services research. Journal of Health Services Research and Policy. 1999, 4 (1): 39-43.PubMedCrossRef Barbour RS: The case for combining qualitative and quantitative approaches in health services research. Journal of Health Services Research and Policy. 1999, 4 (1): 39-43.PubMedCrossRef
14.
go back to reference O'Cathain A, Thomas K: Combining qualitative and quantitative methods. Qualitative Research in Health Care. Edited by: Pope C, Mays N. 2006, Oxford: Blackwell Publishing, 102-111. ThirdCrossRef O'Cathain A, Thomas K: Combining qualitative and quantitative methods. Qualitative Research in Health Care. Edited by: Pope C, Mays N. 2006, Oxford: Blackwell Publishing, 102-111. ThirdCrossRef
15.
go back to reference Adamson J: Combined qualitative and quantitative designs. Handbook of health research methods Investigation, measurement and analysis. Edited by: Bowling A, Ebrahim S. 2005, Berkshire: Open University Press, 230-245. Adamson J: Combined qualitative and quantitative designs. Handbook of health research methods Investigation, measurement and analysis. Edited by: Bowling A, Ebrahim S. 2005, Berkshire: Open University Press, 230-245.
16.
go back to reference McDowell I, MacLean L: Blending qualitative and quantitative study methods in health services research. Health Informatics Journal. 1998, 4: 15-22.CrossRef McDowell I, MacLean L: Blending qualitative and quantitative study methods in health services research. Health Informatics Journal. 1998, 4: 15-22.CrossRef
17.
go back to reference Johnstone PL: Mixed methods, mixed methodology health services research in practice. Qualitative Health Research. 2004, 14 (2): 259-271. 10.1177/1049732303260610.PubMedCrossRef Johnstone PL: Mixed methods, mixed methodology health services research in practice. Qualitative Health Research. 2004, 14 (2): 259-271. 10.1177/1049732303260610.PubMedCrossRef
18.
go back to reference Bradley F, Wiles R, Kinmonth A-L, Mant D, Gantley M: Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). British Medical Journal. 1999, 318: 711-715.PubMedPubMedCentralCrossRef Bradley F, Wiles R, Kinmonth A-L, Mant D, Gantley M: Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). British Medical Journal. 1999, 318: 711-715.PubMedPubMedCentralCrossRef
19.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. British Medical Journal. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.PubMedPubMedCentralCrossRef Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. British Medical Journal. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.PubMedPubMedCentralCrossRef
20.
go back to reference Wolff N: Randomised trials of socially complex interventions: promise or peril?. Journal of Health Services Research and Policy. 2001, 6 (2): 123-126. 10.1258/1355819011927224.PubMedCrossRef Wolff N: Randomised trials of socially complex interventions: promise or peril?. Journal of Health Services Research and Policy. 2001, 6 (2): 123-126. 10.1258/1355819011927224.PubMedCrossRef
21.
go back to reference Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. BMJ. 2002, 325: 766-770. 10.1136/bmj.325.7367.766.PubMedPubMedCentralCrossRef Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. BMJ. 2002, 325: 766-770. 10.1136/bmj.325.7367.766.PubMedPubMedCentralCrossRef
22.
go back to reference Riley T, Hawe P, Shiell A: Contested ground: how should qualitative evidence inform the conduct of a community intervention trial?. Journal of Health Services Research and Policy. 2005, 10 (2): 103-110. 10.1258/1355819053559029.PubMedCrossRef Riley T, Hawe P, Shiell A: Contested ground: how should qualitative evidence inform the conduct of a community intervention trial?. Journal of Health Services Research and Policy. 2005, 10 (2): 103-110. 10.1258/1355819053559029.PubMedCrossRef
23.
go back to reference Moffatt S, White M, Mackintosh J, Howel D: Using quantitative and qualitative data in health services research – what happens when mixed method findings conflict?. BMC Health Services Research. 2006, 6 (28). Moffatt S, White M, Mackintosh J, Howel D: Using quantitative and qualitative data in health services research – what happens when mixed method findings conflict?. BMC Health Services Research. 2006, 6 (28).
24.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.PubMedPubMedCentralCrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413-416. 10.1136/bmj.332.7538.413.PubMedPubMedCentralCrossRef
25.
go back to reference Ong BN: The practice of health services research. 1993, London: Chapman and HallCrossRef Ong BN: The practice of health services research. 1993, London: Chapman and HallCrossRef
26.
go back to reference Fulop N, Allen P, Clarke A, Black N: Issues in studying the organisation and delivery of health services. Studying the organisation and delivery of health services Research methods. Edited by: N Fulop PA, Clarke A, Black N. 2001, London: Routledge Fulop N, Allen P, Clarke A, Black N: Issues in studying the organisation and delivery of health services. Studying the organisation and delivery of health services Research methods. Edited by: N Fulop PA, Clarke A, Black N. 2001, London: Routledge
27.
go back to reference O'Cathain A, Murphy E, Nicholl J: Integration and publications as indicators of 'yield' from mixed methods studies. Journal of Mixed Methods Research. 2007, 1 (2): 147-163. 10.1177/1558689806299094.CrossRef O'Cathain A, Murphy E, Nicholl J: Integration and publications as indicators of 'yield' from mixed methods studies. Journal of Mixed Methods Research. 2007, 1 (2): 147-163. 10.1177/1558689806299094.CrossRef
28.
go back to reference Bowling A: Research Methods in Health. Investigating health and health services. 1997, Buckingham: Open University Press; Bowling A: Research Methods in Health. Investigating health and health services. 1997, Buckingham: Open University Press;
29.
go back to reference Creswell JW, Clark VLP, Gutmann ML, Hanson WE: Advanced mixed methods research designs. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 209-240. Creswell JW, Clark VLP, Gutmann ML, Hanson WE: Advanced mixed methods research designs. Handbook of mixed methods in social and behavioural research. Edited by: Tashakkori A, Teddlie C. 2003, London: Sage Publications, 209-240.
30.
go back to reference Greene JC, Caracelli VJ, Graham WF: Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1989, 11 (3): 255-274. 10.2307/1163620.CrossRef Greene JC, Caracelli VJ, Graham WF: Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1989, 11 (3): 255-274. 10.2307/1163620.CrossRef
32.
go back to reference Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998, 2 (16): 1-274.CrossRef Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P: Qualitative research methods in health technology assessment: a review of the literature. Health Technology Assessment. 1998, 2 (16): 1-274.CrossRef
33.
go back to reference Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: Routledge Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: Routledge
34.
go back to reference Kuckartz U: WinMAX Software for qualitative data analysis. 1998, London: Scolari Sage Publications Kuckartz U: WinMAX Software for qualitative data analysis. 1998, London: Scolari Sage Publications
35.
go back to reference McKibbon KA, Gadd C: A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year. BMC Medical Informatics and Decision Making. 2004, 4 (11). McKibbon KA, Gadd C: A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year. BMC Medical Informatics and Decision Making. 2004, 4 (11).
36.
go back to reference Turner-Stokes L, Harding R, Sergeant J, Lupton C, McPherson K: Generating the evidence base for the National Service Framework (NSF) for long term conditions: a new research typology. Clinical Medicine. 2006, 6: 91-97.PubMedPubMedCentralCrossRef Turner-Stokes L, Harding R, Sergeant J, Lupton C, McPherson K: Generating the evidence base for the National Service Framework (NSF) for long term conditions: a new research typology. Clinical Medicine. 2006, 6: 91-97.PubMedPubMedCentralCrossRef
37.
go back to reference Murphy E, Dingwall R: Qualitative methods in health services research. Health services research methods. Edited by: Black N, Brazier J, Fitzpatrick R, Reeves B. 1998, London: BMJ Books, 129-138. Murphy E, Dingwall R: Qualitative methods in health services research. Health services research methods. Edited by: Black N, Brazier J, Fitzpatrick R, Reeves B. 1998, London: BMJ Books, 129-138.
38.
go back to reference Bryman A: Quantitative and qualitative research: further reflections on their integration. Mixing methods: qualitative and quantitative research. Edited by: Brannen J. 1992, Aldershot: Ashgate, 57-78. Bryman A: Quantitative and qualitative research: further reflections on their integration. Mixing methods: qualitative and quantitative research. Edited by: Brannen J. 1992, Aldershot: Ashgate, 57-78.
39.
go back to reference Sieber SD: The integration of fieldwork and survey methods. The American Journal of Sociology. 1973, 78 (6): 1335-1359. 10.1086/225467.CrossRef Sieber SD: The integration of fieldwork and survey methods. The American Journal of Sociology. 1973, 78 (6): 1335-1359. 10.1086/225467.CrossRef
40.
go back to reference Parry-Langdon N, Bloor M, Audrey S, Holliday J: Process evaluation of health promotion interventions. Policy & Politics. 2003, 31 (2): 207-216. 10.1332/030557303765371690.CrossRef Parry-Langdon N, Bloor M, Audrey S, Holliday J: Process evaluation of health promotion interventions. Policy & Politics. 2003, 31 (2): 207-216. 10.1332/030557303765371690.CrossRef
41.
go back to reference Krause N: A comprehensive strategy for developing close-ended survey items for use in studies of older adults. Journal of Gerontology. 2002, 57 (5): S263-S274.CrossRef Krause N: A comprehensive strategy for developing close-ended survey items for use in studies of older adults. Journal of Gerontology. 2002, 57 (5): S263-S274.CrossRef
42.
go back to reference Rousseau N, McColl E, Eccles M, Hall L: Qualitative methods in implementation research. Changing professional practice: theory and practice of clinical guidelines implementation. Edited by: Thorsen T, Makela M. 1999, Copenhagen: DSI, 99-116. Rousseau N, McColl E, Eccles M, Hall L: Qualitative methods in implementation research. Changing professional practice: theory and practice of clinical guidelines implementation. Edited by: Thorsen T, Makela M. 1999, Copenhagen: DSI, 99-116.
43.
go back to reference MRC: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research Council MRC: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research Council
44.
go back to reference Caracelli VJ, Greene JC: Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1993, 15 (2): 195-207. 10.2307/1164421.CrossRef Caracelli VJ, Greene JC: Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis. 1993, 15 (2): 195-207. 10.2307/1164421.CrossRef
45.
go back to reference Weinholtz D, Kacer B, Rocklin T: Salvaging quantitative research with qualitative data. Qualitative Health Research. 1995, 5 (3): 388-397. 10.1177/104973239500500308.CrossRef Weinholtz D, Kacer B, Rocklin T: Salvaging quantitative research with qualitative data. Qualitative Health Research. 1995, 5 (3): 388-397. 10.1177/104973239500500308.CrossRef
Metadata
Title
Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study
Authors
Alicia O'Cathain
Elizabeth Murphy
Jon Nicholl
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2007
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-7-85

Other articles of this Issue 1/2007

BMC Health Services Research 1/2007 Go to the issue