Skip to main content
Top
Published in: Trials 1/2016

Open Access 01-12-2016 | Methodology

The role of qualitative research in adding value to a randomised controlled trial: lessons from a pilot study of a guided e-learning intervention for managers to improve employee wellbeing and reduce sickness absence

Authors: Jill Russell, Lee Berney, Stephen Stansfeld, Doris Lanz, Sally Kerry, Tarani Chandola, Kamaldeep Bhui

Published in: Trials | Issue 1/2016

Login to get access

Abstract

Background

Despite the growing popularity of mixed-methods studies and considerable emphasis on the potential value of qualitative research to the trial endeavour, there remains a dearth of published studies reporting on actual contribution. This paper presents a critically reflective account of our experience of the actual value of undertaking qualitative research alongside a pilot cluster randomised controlled trial of a guided e-learning intervention for managers in an NHS Mental Health Trust to improve employee wellbeing and reduce sickness absence.
For the qualitative study we undertook 36 in-depth interviews with key informants, managers and employees. We observed and took in-depth field notes of 10 meetings involving managers and employees at the Trust, and the two qualitative researchers acted as participant observers at steering committee and monthly research team meetings. We adopted a narrative methodological orientation alongside a thematic approach to data analysis, eliciting a rich account of the complexities of managing stress at work.

Results

We identified two key overarching roles played by the qualitative research: ‘problematising’ and ‘contextualising’. Specifically, the qualitative data revealed and challenged assumptions embedded in the trial about the nature of the learning process, and exposed the slippery and contested nature of abstracted variables, on which a trial depends. The qualitative data challenged the trial’s logic model, and provided a rich understanding of the context within which the trial and intervention took place.

Conclusions

While acknowledging the ever-present tension in mixed-methods research between the requirements of quantitative research to represent the social world as abstracted variables, and the goal of qualitative research to explore and document the complexity of social phenomena, we adopted a pragmatic position that enabled us to engage with this tension in a productive and partially integrative way. Our critically reflective account of the praxis of integration illuminated opportunities and challenges for maximising the value of qualitative research to a trial. This paper sets out tangible illustrative lessons for other mixed-methods researchers endeavouring to get the most from qualitative research.

Trial registration

This study is registered as ISRCTN58661009. Registration was submitted on 22 April 2013 and completed on 17 June 2013.
Literature
1.
go back to reference O’Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Goode J, Hewison J. Maximising the value of combining qualitative research and randomised controlled trials in health research: the QUAlitative Research in Trials (QUART) study – a mixed methods study. Health Technol Assess. 2014;18:1–198.PubMedPubMedCentral O’Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Goode J, Hewison J. Maximising the value of combining qualitative research and randomised controlled trials in health research: the QUAlitative Research in Trials (QUART) study – a mixed methods study. Health Technol Assess. 2014;18:1–198.PubMedPubMedCentral
2.
go back to reference Flemming K, Adamson J, Atkin K. Improving the effectiveness of interventions in palliative care: the potential role of qualitative research in enhancing evidence from randomized controlled trials. Palliat Med. 2008;22:123–31.CrossRefPubMed Flemming K, Adamson J, Atkin K. Improving the effectiveness of interventions in palliative care: the potential role of qualitative research in enhancing evidence from randomized controlled trials. Palliat Med. 2008;22:123–31.CrossRefPubMed
3.
go back to reference Drabble SJ, O’Cathain A, Thomas KJ, Rudolph A, Hewison J. Describing qualitative research undertaken with randomised controlled trials in grant proposals: a documentary analysis. BMC Med Res Methodol. 2014;14:24.CrossRefPubMedPubMedCentral Drabble SJ, O’Cathain A, Thomas KJ, Rudolph A, Hewison J. Describing qualitative research undertaken with randomised controlled trials in grant proposals: a documentary analysis. BMC Med Res Methodol. 2014;14:24.CrossRefPubMedPubMedCentral
4.
go back to reference Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.CrossRefPubMedPubMedCentral Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.CrossRefPubMedPubMedCentral
5.
go back to reference O’Cathain A, Murphy E, Nicholl J. Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study. BMC Health Serv Res. 2007;7:85.CrossRefPubMedPubMedCentral O’Cathain A, Murphy E, Nicholl J. Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study. BMC Health Serv Res. 2007;7:85.CrossRefPubMedPubMedCentral
6.
go back to reference Jansen YJ, Foets MM, de Bont AA. The contribution of qualitative research to the development of tailor-made community-based interventions in primary care: a review. Eur J Public Health. 2010;20:220–6.CrossRefPubMed Jansen YJ, Foets MM, de Bont AA. The contribution of qualitative research to the development of tailor-made community-based interventions in primary care: a review. Eur J Public Health. 2010;20:220–6.CrossRefPubMed
7.
go back to reference O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215.CrossRefPubMedPubMedCentral O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215.CrossRefPubMedPubMedCentral
9.
go back to reference Barbour RS. The case for combining qualitative and quantitative approaches in health services research. J Health Serv Res Policy. 1999;4:39–43.PubMed Barbour RS. The case for combining qualitative and quantitative approaches in health services research. J Health Serv Res Policy. 1999;4:39–43.PubMed
10.
go back to reference Denzin NK, Lincoln YS. The Sage handbook of qualitative research. Thousand Oaks: Sage; 2011. Denzin NK, Lincoln YS. The Sage handbook of qualitative research. Thousand Oaks: Sage; 2011.
11.
go back to reference Greene JC. Mixed methods in social inquiry. San Francisco: Jossey-Bass; 2007. Greene JC. Mixed methods in social inquiry. San Francisco: Jossey-Bass; 2007.
12.
go back to reference Teddlie C, Tashakkori A. Foundations of mixed methods research: integrating quantitative and qualitative approaches in the social and behavioral sciences. Los Angeles: Sage; 2009. Teddlie C, Tashakkori A. Foundations of mixed methods research: integrating quantitative and qualitative approaches in the social and behavioral sciences. Los Angeles: Sage; 2009.
13.
go back to reference Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P. Qualitative research methods in health technology assessment: a review of the literature. Health Technol Assess. 1998;2:iii.PubMed Murphy E, Dingwall R, Greatbatch D, Parker S, Watson P. Qualitative research methods in health technology assessment: a review of the literature. Health Technol Assess. 1998;2:iii.PubMed
14.
go back to reference Bryman A. The end of the paradigm wars? In: The Sage handbook of social research methods. London: Sage; 2008. p. 13–25. Bryman A. The end of the paradigm wars? In: The Sage handbook of social research methods. London: Sage; 2008. p. 13–25.
15.
go back to reference Greenhalgh T, Russell J. Evidence-based policymaking: a critique. Perspect Biol Med. 2009;52:304–18.CrossRefPubMed Greenhalgh T, Russell J. Evidence-based policymaking: a critique. Perspect Biol Med. 2009;52:304–18.CrossRefPubMed
16.
go back to reference Guba E. The alternative paradigm dialog. In: The paradigm dialog. Newbury Park: Sage; 1990. p. 17–27. Guba E. The alternative paradigm dialog. In: The paradigm dialog. Newbury Park: Sage; 1990. p. 17–27.
17.
go back to reference Johnson RB, Onwuegbuzie AJ. Mixed methods research: a research paradigm whose time has come. Educ Res. 2004;33:14–26.CrossRef Johnson RB, Onwuegbuzie AJ. Mixed methods research: a research paradigm whose time has come. Educ Res. 2004;33:14–26.CrossRef
18.
go back to reference Stansfeld S, Berney B, Bhui K, Chandola T, Costelloe C, Hounsome N, Kerry S, Lanz D, Russell J. Pilot study of a randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee wellbeing and reduction of sickness absence: The Guided E-learning for Managers (GEM) Study. Southampton: NIHR HTA; 2015. Stansfeld S, Berney B, Bhui K, Chandola T, Costelloe C, Hounsome N, Kerry S, Lanz D, Russell J. Pilot study of a randomised trial of a guided e-learning health promotion intervention for managers based on management standards for the improvement of employee wellbeing and reduction of sickness absence: The Guided E-learning for Managers (GEM) Study. Southampton: NIHR HTA; 2015.
19.
go back to reference Mackay C, Palferman D, Saul H, Webster S, Packham C, Biron. Implementation of the management standards for work-related stress in Great Britain. In: Improving organizational interventions for stress and well-being. Biron C, Karanika-Murray M, Cooper C, editors. London, Routledge; 2012:285–310. Mackay C, Palferman D, Saul H, Webster S, Packham C, Biron. Implementation of the management standards for work-related stress in Great Britain. In: Improving organizational interventions for stress and well-being. Biron C, Karanika-Murray M, Cooper C, editors. London, Routledge; 2012:285–310.
20.
go back to reference Mackay C, Palferman D. Policy level interventions for organizational health: development and evolution of the UK management standards. In: Salutogenic organizations and change. G Bauer & G Jenny, editors, Dordrecht: Springer; 2013:191–215. Mackay C, Palferman D. Policy level interventions for organizational health: development and evolution of the UK management standards. In: Salutogenic organizations and change. G Bauer & G Jenny, editors, Dordrecht: Springer; 2013:191–215.
21.
go back to reference Reissman C. Narrative interviewing. In: Lewis-Beck MS, Bryman A, Futing Liao T, editors. Encyclopedia of social science research methods. London and Newbury: Sage; 2004. Reissman C. Narrative interviewing. In: Lewis-Beck MS, Bryman A, Futing Liao T, editors. Encyclopedia of social science research methods. London and Newbury: Sage; 2004.
22.
go back to reference Ritchie J, Lewis J. Qualitative research practice. London: Sage; 2003. Ritchie J, Lewis J. Qualitative research practice. London: Sage; 2003.
23.
go back to reference Riessman CK. Narrative methods for the human sciences. Thousand Oaks: Sage; 2008. Riessman CK. Narrative methods for the human sciences. Thousand Oaks: Sage; 2008.
24.
go back to reference Erickson F. Qualitative methods. In: Linn R, editor. Research in teaching and learning, volume II. New York: Macmillan; 1990. p. 77–194. Erickson F. Qualitative methods. In: Linn R, editor. Research in teaching and learning, volume II. New York: Macmillan; 1990. p. 77–194.
26.
go back to reference Bacchi C. The turn to problematization: political implications of contrasting interpretive and poststructural adaptations. OJPS. 2015;05:1–12.CrossRef Bacchi C. The turn to problematization: political implications of contrasting interpretive and poststructural adaptations. OJPS. 2015;05:1–12.CrossRef
27.
go back to reference Kolb DA. The process of experiential learning. In: Thorpe M, Edwards R, Hanson A, editors. Culture and processes of adult learning. London: Routledge; 1993. p. 138–56. Kolb DA. The process of experiential learning. In: Thorpe M, Edwards R, Hanson A, editors. Culture and processes of adult learning. London: Routledge; 1993. p. 138–56.
29.
go back to reference Pentland BT. Organizational routines as a unit of analysis. Ind Corp Change. 2005;14:793–815.CrossRef Pentland BT. Organizational routines as a unit of analysis. Ind Corp Change. 2005;14:793–815.CrossRef
30.
go back to reference Yarker J, Lewis R, Donaldson-Feilder E, Flaxman P. Management competencies for preventing and reducing stress at work. RR633 Research Report. London: Health and Safety Executive. 2007. Yarker J, Lewis R, Donaldson-Feilder E, Flaxman P. Management competencies for preventing and reducing stress at work. RR633 Research Report. London: Health and Safety Executive. 2007.
31.
go back to reference Kinsella EA, Pitman A. Phronesis as professional knowledge : practical wisdom in the professions. Rotterdam: Sense Publishers; 2012.CrossRef Kinsella EA, Pitman A. Phronesis as professional knowledge : practical wisdom in the professions. Rotterdam: Sense Publishers; 2012.CrossRef
32.
go back to reference Lingard L. What we see and don’t see when we look at ‘competence’: notes on a god term. Adv Health Sci Educ Theory Pract. 2009;14:625–8.CrossRefPubMed Lingard L. What we see and don’t see when we look at ‘competence’: notes on a god term. Adv Health Sci Educ Theory Pract. 2009;14:625–8.CrossRefPubMed
33.
go back to reference Kushner S. Case study as antidote to the literal. In: Case study evaluation: past, present and future challenges (advances in program evaluation, Volume 15). Russell J, Greenhalgh T, Kushner S, editors. Bingley: Emerald Group Publishing Limited; 2015;15:63–83. Kushner S. Case study as antidote to the literal. In: Case study evaluation: past, present and future challenges (advances in program evaluation, Volume 15). Russell J, Greenhalgh T, Kushner S, editors. Bingley: Emerald Group Publishing Limited; 2015;15:63–83.
34.
go back to reference The Mid Staffordshire NHS Foundation Trust Public Inquiry. Chaired by Robert Francis QC. London: Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry; 2013 The Mid Staffordshire NHS Foundation Trust Public Inquiry. Chaired by Robert Francis QC. London: Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry; 2013
35.
go back to reference Dopson S, Fitzgerald L, Ferlie E. Understanding change and innovation in healthcare settings: reconceptualizing the active role of context. J Change Manag. 2008;8:213–31.CrossRef Dopson S, Fitzgerald L, Ferlie E. Understanding change and innovation in healthcare settings: reconceptualizing the active role of context. J Change Manag. 2008;8:213–31.CrossRef
36.
go back to reference Bate P. Context is everything. London: The Health Foundation; 2014. Bate P. Context is everything. London: The Health Foundation; 2014.
37.
go back to reference Ramiller NC, Pentland BT. Management implications in information systems research: the untold story. J Assoc Info Syst. 2009;10:2. Ramiller NC, Pentland BT. Management implications in information systems research: the untold story. J Assoc Info Syst. 2009;10:2.
38.
go back to reference Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18:40–3.CrossRefPubMed Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18:40–3.CrossRefPubMed
39.
go back to reference Hesse-Biber S, Johnson RB. Coming at things differently: future directions of possible engagement with mixed methods research. J Mix Methods Res. 2013;7:103–9.CrossRef Hesse-Biber S, Johnson RB. Coming at things differently: future directions of possible engagement with mixed methods research. J Mix Methods Res. 2013;7:103–9.CrossRef
40.
go back to reference Hoddinott P, Britten J, Pill R. Why do interventions work in some places and not others: a breastfeeding support group trial. Soc Sci Med. 2010;70:769–78.CrossRefPubMed Hoddinott P, Britten J, Pill R. Why do interventions work in some places and not others: a breastfeeding support group trial. Soc Sci Med. 2010;70:769–78.CrossRefPubMed
41.
go back to reference Giddings LS. Mixed-methods research: positivism dressed in drag? J Res Nurs. 2006;11:195–203.CrossRef Giddings LS. Mixed-methods research: positivism dressed in drag? J Res Nurs. 2006;11:195–203.CrossRef
42.
go back to reference Morgan DL. Practical strategies for combining qualitative and quantitative methods: Applications to health research. Qual Health Res. 1998;8:362–76.CrossRefPubMed Morgan DL. Practical strategies for combining qualitative and quantitative methods: Applications to health research. Qual Health Res. 1998;8:362–76.CrossRefPubMed
43.
go back to reference O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.CrossRefPubMed O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.CrossRefPubMed
44.
go back to reference Bryman A. Barriers to integrating quantitative and qualitative research. J Mix Methods Res. 2007;1:8–22.CrossRef Bryman A. Barriers to integrating quantitative and qualitative research. J Mix Methods Res. 2007;1:8–22.CrossRef
Metadata
Title
The role of qualitative research in adding value to a randomised controlled trial: lessons from a pilot study of a guided e-learning intervention for managers to improve employee wellbeing and reduce sickness absence
Authors
Jill Russell
Lee Berney
Stephen Stansfeld
Doris Lanz
Sally Kerry
Tarani Chandola
Kamaldeep Bhui
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1497-8

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue