Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Research article

Application of the critical incident technique in refining a realist initial programme theory

Authors: U. Cunningham, A. De Brún, E. McAuliffe

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

As realist methodology is still evolving, there is a paucity of guidance on how to conduct theory driven interviews. Realist researchers can therefore struggle to collect interview data that can make a meaningful contribution to refining their initial programme theory. Collecting data to inform realist Inital Programme Theories (IPTs) in healthcare contexts is further compounded due to the healthcare workers’ busy work schedules.
In this case study of team interventions in acute hospital contexts, we explore the benefits of using the Critical Incident Technique (CIT) in order to build and refine an initial programme theory. We contend that use of the CIT helps to draw on more specific experiences of “Key Informants” and therefore elicits richer and more relevant data for realist enquiry.

Methods

The five steps of the CIT were mapped against realist methods guidance and adapted into an interview framework. Specifications to identify an incident as “critical” were agreed. Probes were embedded in the interview framework to confirm, refine and/or refute previous theories.
Seventeen participants were interviewed and recordings were transcribed and imported for analysis into NVivo software. Using RAMESES guidelines, Context-Mechanism-Outcomes configurations were extrapolated from a total of 31 incidents.

Results

We found that the CIT facilitated construction of an interview format that allowed participants to reflect on specific experiences of interest. We demonstrate how the CIT strengthened initial programme theory development as it facilitated the reporting of the specifics of team interventions and the contexts and mechanisms characteristic of those experiences. As new data emerged, it was possible to evolve previous theories synthesised from the literature as well as to explore new theories.

Conclusions

Utilising a CIT framework paid dividends in terms of the relevance and usefulness of the data for refining the initial programme theory. Adapting the CIT questioning technique helped to focus the participants on the specifics relating to an incident allowing the interviewers to concentrate on probes to explore theories during the interview process. The CIT interview format therefore achieved its purpose and can be adapted for use within realist methodology.
Appendix
Available only for authorised users
Literature
2.
go back to reference Hewitt G, Sims S, Harris R. Using realist synthesis to understand the mechanisms of interprofessional teamwork in health and social care. J Interprof Care. 2014;28(6):501–6.CrossRef Hewitt G, Sims S, Harris R. Using realist synthesis to understand the mechanisms of interprofessional teamwork in health and social care. J Interprof Care. 2014;28(6):501–6.CrossRef
4.
go back to reference Allan HT, Brearley S, Byng R, Christian S, Clayton J, Mackintosh M, et al. People and teams matter in organizational change: professionals’ and managers’ experiences of changing governance and incentives in primary care. Health Serv Res. 2014;49(1):93–112.CrossRef Allan HT, Brearley S, Byng R, Christian S, Clayton J, Mackintosh M, et al. People and teams matter in organizational change: professionals’ and managers’ experiences of changing governance and incentives in primary care. Health Serv Res. 2014;49(1):93–112.CrossRef
5.
go back to reference Kirst M, Im J, Burns T, Baker GR, Goldhar J, O’Campo P, et al. What works in implementation of integrated care programs for older adults with complex needs? A realist review. Int J Qual Health Care. 2017;29(5):612–24.CrossRef Kirst M, Im J, Burns T, Baker GR, Goldhar J, O’Campo P, et al. What works in implementation of integrated care programs for older adults with complex needs? A realist review. Int J Qual Health Care. 2017;29(5):612–24.CrossRef
6.
go back to reference Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):49.CrossRef Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):49.CrossRef
7.
8.
go back to reference Manzano A. The craft of interviewing in realist evaluation. Evaluation. 2016;22(3):342–60.CrossRef Manzano A. The craft of interviewing in realist evaluation. Evaluation. 2016;22(3):342–60.CrossRef
9.
go back to reference Flanagan JC, Flanagan JC. The critical incident technique. Psychol Bull. 1954;51(4):327 33.CrossRef Flanagan JC, Flanagan JC. The critical incident technique. Psychol Bull. 1954;51(4):327 33.CrossRef
10.
go back to reference Whittaker. The political in qualitative methods. Curr Anthropol. 2000;41(5):883.CrossRef Whittaker. The political in qualitative methods. Curr Anthropol. 2000;41(5):883.CrossRef
11.
go back to reference FitzGerald K, Dent B, Kerins CA. The critical incident technique: a useful tool for conducting qualitative research. J Dent Educ. 2008;72(3):6. FitzGerald K, Dent B, Kerins CA. The critical incident technique: a useful tool for conducting qualitative research. J Dent Educ. 2008;72(3):6.
12.
go back to reference Butterfoss FD, Kegler MC, Francisco VT. Mobilizing organizations for health promotion: theories of organizational change. In: Health behavior and health education: theory, research, and practice. 4th ed. San Francisco: Jossey-Bass; 2008. p. 335–61. Butterfoss FD, Kegler MC, Francisco VT. Mobilizing organizations for health promotion: theories of organizational change. In: Health behavior and health education: theory, research, and practice. 4th ed. San Francisco: Jossey-Bass; 2008. p. 335–61.
13.
go back to reference Wodlinger MG. April: a case study in the use of guided reflection. Alta J Educ Res. 1990;36(2):115–31. Wodlinger MG. April: a case study in the use of guided reflection. Alta J Educ Res. 1990;36(2):115–31.
14.
go back to reference Dworkin R. The Theory and Practice of Equality. Sovereign Virtue. 2000. p. 407. Dworkin R. The Theory and Practice of Equality. Sovereign Virtue. 2000. p. 407.
15.
go back to reference Whittaker E. The political in qualitative methods (Creswell’s qualitative inquiry and research design). Curr Anthropol. 2000;41(5):883–4.CrossRef Whittaker E. The political in qualitative methods (Creswell’s qualitative inquiry and research design). Curr Anthropol. 2000;41(5):883–4.CrossRef
16.
go back to reference Woolsey LK. The critical incident technique: an innovative qualitative method of research. Can J Couns. 1986;20(4):242–54. Woolsey LK. The critical incident technique: an innovative qualitative method of research. Can J Couns. 1986;20(4):242–54.
17.
go back to reference Bhaskar R. A realist theory of science. Brighton: Harvester Press; 1978. Bhaskar R. A realist theory of science. Brighton: Harvester Press; 1978.
18.
go back to reference Chell E, Pittaway L. A study of entrepreneurship in the restaurant and café industry: exploratory work using the critical incident technique as a methodology. Int J Hosp Manag. 1998;17(1):23–32.CrossRef Chell E, Pittaway L. A study of entrepreneurship in the restaurant and café industry: exploratory work using the critical incident technique as a methodology. Int J Hosp Manag. 1998;17(1):23–32.CrossRef
19.
go back to reference Cunningham U, Ward ME, De Brún A, McAuliffe E. Team interventions in acute hospital contexts: a systematic search of the literature using realist synthesis. BMC Health Serv Res. 2018;18(1):536.CrossRef Cunningham U, Ward ME, De Brún A, McAuliffe E. Team interventions in acute hospital contexts: a systematic search of the literature using realist synthesis. BMC Health Serv Res. 2018;18(1):536.CrossRef
21.
go back to reference Butterfoss FD. Coalitions and partnerships in community health. San Francisco: Jossey-Bass; 2007. Butterfoss FD. Coalitions and partnerships in community health. San Francisco: Jossey-Bass; 2007.
22.
23.
go back to reference Castleberry A. NVivo 10 [software program]. Version 10. QSR international; 2012. Am J Pharm Educ. 2014;78(1):25.CrossRef Castleberry A. NVivo 10 [software program]. Version 10. QSR international; 2012. Am J Pharm Educ. 2014;78(1):25.CrossRef
24.
go back to reference Gilmore B, McAuliffe E, Power J, Vallières F. Data analysis and synthesis within a realist evaluation: toward more transparent methodological approaches. Int J Qual Methods. 2019;18:160940691985975.CrossRef Gilmore B, McAuliffe E, Power J, Vallières F. Data analysis and synthesis within a realist evaluation: toward more transparent methodological approaches. Int J Qual Methods. 2019;18:160940691985975.CrossRef
27.
go back to reference Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. 2016;14(1):96.CrossRef Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. 2016;14(1):96.CrossRef
28.
go back to reference Greenhalgh T, Wong G, Westhorp G, Pawson R. Protocol - realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC Med Res Methodol. 2011;11(1):115.CrossRef Greenhalgh T, Wong G, Westhorp G, Pawson R. Protocol - realist and meta-narrative evidence synthesis: evolving standards (RAMESES). BMC Med Res Methodol. 2011;11(1):115.CrossRef
29.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRef Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRef
30.
go back to reference Remenyi D, Williams B, Money A, Swartz E. Doing research in business and management: an introduction to process and method: Sage; 1998. Remenyi D, Williams B, Money A, Swartz E. Doing research in business and management: an introduction to process and method: Sage; 1998.
31.
go back to reference Butterfield LD, Borgen WA, Amundson NE, Maglio A-ST. Fifty years of the critical incident technique: 1954-2004 and beyond. Qual Res. 2005;5(4):475–97.CrossRef Butterfield LD, Borgen WA, Amundson NE, Maglio A-ST. Fifty years of the critical incident technique: 1954-2004 and beyond. Qual Res. 2005;5(4):475–97.CrossRef
Metadata
Title
Application of the critical incident technique in refining a realist initial programme theory
Authors
U. Cunningham
A. De Brún
E. McAuliffe
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01016-9

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue