Skip to main content
Top
Published in: Trials 1/2016

Open Access 01-12-2016 | Commentary

Can “realist” randomised controlled trials be genuinely realist?

Authors: Sara Van Belle, Geoff Wong, Gill Westhorp, Mark Pearson, Nick Emmel, Ana Manzano, Bruno Marchal

Published in: Trials | Issue 1/2016

Login to get access

Abstract

In this paper, we respond to a paper by Jamal and colleagues published in Trials in October 2015 and take an opportunity to continue the much-needed debate about what applied scientific realism is. The paper by Jamal et al. is useful because it exposes the challenges of combining a realist evaluation approach (as developed by Pawson and Tilley) with the randomised controlled trial (RCT) design.
We identified three fundamental differences that are related to paradigmatic differences in the treatment of causation between post-positivist and realist logic: (1) the construct of mechanism, (2) the relation between mediators and moderators on one hand and mechanisms and contexts on the other hand, and (3) the variable-oriented approach to analysis of causation versus the configurational approach.
We show how Jamal et al. consider mechanisms as observable, external treatments and how their approach reduces complex causal processes to variables. We argue that their proposed RCT design cannot provide a truly realist understanding. Not only does the proposed realist RCT design not deal with the RCT’s inherent inability to “unpack” complex interventions, it also does not enable the identification of the dynamic interplay among the intervention, actors, context, mechanisms and outcomes, which is at the core of realist research. As a result, the proposed realist RCT design is not, as we understand it, genuinely realist in nature.
Literature
1.
go back to reference Jamal F, Fletcher A, Shackleton N, Elbourne D, Viner R, Bonell C. The three stages of building and testing mid-level theories in a realist RCT: a theoretical and methodological case-example. Trials. 2015;16:466.CrossRefPubMedPubMedCentral Jamal F, Fletcher A, Shackleton N, Elbourne D, Viner R, Bonell C. The three stages of building and testing mid-level theories in a realist RCT: a theoretical and methodological case-example. Trials. 2015;16:466.CrossRefPubMedPubMedCentral
2.
go back to reference Blackwood B, O'Halloran P, Porter S. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. J Res Nurs. 2010;15(6):511–21.CrossRef Blackwood B, O'Halloran P, Porter S. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. J Res Nurs. 2010;15(6):511–21.CrossRef
3.
go back to reference Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997. Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.
4.
go back to reference Marchal B, Van Belle S, Van Olmen J, Hoerée T, Kegels G. Is realist evaluation keeping its promise? A literature review of methodological practice in health systems research. Evaluation. 2012;18(2):192–212.CrossRef Marchal B, Van Belle S, Van Olmen J, Hoerée T, Kegels G. Is realist evaluation keeping its promise? A literature review of methodological practice in health systems research. Evaluation. 2012;18(2):192–212.CrossRef
5.
go back to reference Dalkin S, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Sci. 2015;10:49.CrossRef Dalkin S, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Sci. 2015;10:49.CrossRef
6.
go back to reference Astbury B, Leeuw F. Unpacking black boxes: mechanisms and theory building in evaluation. Am J Eval. 2010;31(3):363–81.CrossRef Astbury B, Leeuw F. Unpacking black boxes: mechanisms and theory building in evaluation. Am J Eval. 2010;31(3):363–81.CrossRef
7.
go back to reference Lacouture A, Breton E, Guichard A, Ridde V. The concept of mechanism from a realist approach: a scoping review to facilitate its operationalization in public health program evaluation. Implement Sci. 2015;10:153.CrossRefPubMedPubMedCentral Lacouture A, Breton E, Guichard A, Ridde V. The concept of mechanism from a realist approach: a scoping review to facilitate its operationalization in public health program evaluation. Implement Sci. 2015;10:153.CrossRefPubMedPubMedCentral
8.
go back to reference Bhaskar R. The possibility of naturalism: a philosophical critique of the contemporary human sciences. London: Routledge; 1979. Bhaskar R. The possibility of naturalism: a philosophical critique of the contemporary human sciences. London: Routledge; 1979.
9.
go back to reference Harré R. Varieties of realism: a rationale for the natural sciences. Oxford: Basil Blackwell; 1986. Harré R. Varieties of realism: a rationale for the natural sciences. Oxford: Basil Blackwell; 1986.
10.
go back to reference Pawson R. A measure for measures: a manifesto for empirical sociology. London: Routledge; 1989.CrossRef Pawson R. A measure for measures: a manifesto for empirical sociology. London: Routledge; 1989.CrossRef
11.
go back to reference Greenhalgh T, Wong G, Jagosh J, Greenhalgh J, Manzano A, Westhorp G, Pawson R. Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation. BMJ Open. 2015;5:e008567. Greenhalgh T, Wong G, Jagosh J, Greenhalgh J, Manzano A, Westhorp G, Pawson R. Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation. BMJ Open. 2015;5:e008567.
12.
go back to reference Pawson R. Invisible mechanisms. Eval J Australas. 2008;8(2):3–13. Pawson R. Invisible mechanisms. Eval J Australas. 2008;8(2):3–13.
13.
go back to reference Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef
14.
go back to reference Mahoney J. Beyond correlational analysis: recent innovations in theory and method. Sociol Forum. 2001;16(3):575–93.CrossRef Mahoney J. Beyond correlational analysis: recent innovations in theory and method. Sociol Forum. 2001;16(3):575–93.CrossRef
15.
go back to reference Elster J. Nuts and bolts for the social sciences. Cambridge: Cambridge University Press; 1989.CrossRef Elster J. Nuts and bolts for the social sciences. Cambridge: Cambridge University Press; 1989.CrossRef
16.
go back to reference Bonell C, Allen E, Christie D, Elbourne D, Fletcher A, Greve R, et al. Initiating change locally in bullying and aggression through the school environment (INCLUSIVE): study protocol for a cluster randomised controlled trial. Trials. 2014;15:381.CrossRefPubMedPubMedCentral Bonell C, Allen E, Christie D, Elbourne D, Fletcher A, Greve R, et al. Initiating change locally in bullying and aggression through the school environment (INCLUSIVE): study protocol for a cluster randomised controlled trial. Trials. 2014;15:381.CrossRefPubMedPubMedCentral
17.
go back to reference Byrne D, Uprichard E. Useful complex causality. In: Kincaid H, editor. The Oxford Handbook of Philosophy of Social Science. Oxford: Oxford University Press; 2012. Byrne D, Uprichard E. Useful complex causality. In: Kincaid H, editor. The Oxford Handbook of Philosophy of Social Science. Oxford: Oxford University Press; 2012.
18.
go back to reference Pawson R. The science of evaluation: a realist manifesto. London: Sage; 2013.CrossRef Pawson R. The science of evaluation: a realist manifesto. London: Sage; 2013.CrossRef
19.
go back to reference Westhorp G. Realist impact evaluation - an introduction. In: London: Overseas Development Institute. 2014. p. 1–12 Westhorp G. Realist impact evaluation - an introduction. In: London: Overseas Development Institute. 2014. p. 1–12
20.
go back to reference Sayer A. Method in social science: a realist approach. London: Routledge; 1992. Sayer A. Method in social science: a realist approach. London: Routledge; 1992.
21.
go back to reference Merton RK. On sociological theories of the middle range. In: Calhoun C, Gerteis J, Moody J, Pfaff S, Virk I, editors. Classical sociological theory. 2nd ed. Oxford: Blackwell; 1949. p. 448–58. Merton RK. On sociological theories of the middle range. In: Calhoun C, Gerteis J, Moody J, Pfaff S, Virk I, editors. Classical sociological theory. 2nd ed. Oxford: Blackwell; 1949. p. 448–58.
22.
go back to reference Boudon R. What middle-range theories are. Contemp Sociol. 1991;20:519–22.CrossRef Boudon R. What middle-range theories are. Contemp Sociol. 1991;20:519–22.CrossRef
Metadata
Title
Can “realist” randomised controlled trials be genuinely realist?
Authors
Sara Van Belle
Geoff Wong
Gill Westhorp
Mark Pearson
Nick Emmel
Ana Manzano
Bruno Marchal
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1407-0

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue