Skip to main content
Top
Published in: Trials 1/2015

Open Access 01-12-2015 | Research

Explaining high and low performers in complex intervention trials: a new model based on diffusion of innovations theory

Authors: Heather McMullen, Chris Griffiths, Werner Leber, Trisha Greenhalgh

Published in: Trials | Issue 1/2015

Login to get access

Abstract

Background

Complex intervention trials may require health care organisations to implement new service models. In a recent cluster randomised controlled trial, some participating organisations achieved high recruitment, whereas others found it difficult to assimilate the intervention and were low recruiters. We sought to explain this variation and develop a model to inform organisational participation in future complex intervention trials.

Methods

The trial included 40 general practices in a London borough with high HIV prevalence. The intervention was offering a rapid HIV test as part of the New Patient Health Check. The primary outcome was mean CD4 cell count at diagnosis. The process evaluation consisted of several hundred hours of ethnographic observation, 21 semi-structured interviews and analysis of routine documents (e.g., patient leaflets, clinical protocols) and trial documents (e.g., inclusion criteria, recruitment statistics). Qualitative data were analysed thematically using—and, where necessary, extending—Greenhalgh et al.’s model of diffusion of innovations. Narrative synthesis was used to prepare case studies of four practices representing maximum variety in clinicians’ interest in HIV (assessed by level of serological testing prior to the trial) and performance in the trial (high vs. low recruiters).

Results

High-recruiting practices were, in general though not invariably, also innovative practices. They were characterised by strong leadership, good managerial relations, readiness for change, a culture of staff training and available staff time (‘slack resources’). Their front-line staff believed that patients might benefit from the rapid HIV test (‘relative advantage’), were emotionally comfortable administering it (‘compatibility’), skilled in performing it (‘task issues’) and made creative adaptations to embed the test in local working practices (‘reinvention’). Early experience of a positive HIV test (‘observability’) appeared to reinforce staff commitment to recruiting more participants. Low-performing practices typically had less good managerial relations, significant resource constraints, staff discomfort with the test and no positive results early in the trial.

Conclusions

An adaptation of the diffusion of innovations model was an effective analytical tool for retrospectively explaining high and low-performing practices in a complex intervention research trial. Whether the model will work prospectively to predict performance (and hence shape the design of future trials) is unknown.

Trial registration

ISRCTN Registry number: ISRCTN63473710. Date assigned: 22 April 2010.
Literature
1.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.CrossRefPubMedPubMedCentral Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.CrossRefPubMedPubMedCentral
2.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral
3.
4.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9.CrossRefPubMedPubMedCentral
5.
go back to reference Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester, UK: John Wiley & Sons; 2012.CrossRef Eldridge S, Kerry S. A practical guide to cluster randomised trials in health services research. Chichester, UK: John Wiley & Sons; 2012.CrossRef
6.
go back to reference Tosh G, Soares-Weiser K, Adams CE. Pragmatic vs explanatory trials: the Pragmascope tool to help measure differences in protocols of mental health randomized controlled trials. Dialogues Clin Neurosci. 2011;13:209–15.PubMedPubMedCentral Tosh G, Soares-Weiser K, Adams CE. Pragmatic vs explanatory trials: the Pragmascope tool to help measure differences in protocols of mental health randomized controlled trials. Dialogues Clin Neurosci. 2011;13:209–15.PubMedPubMedCentral
7.
go back to reference Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19:237–70.CrossRefPubMed Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19:237–70.CrossRefPubMed
8.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57:660–80.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57:660–80.CrossRef
9.
go back to reference Blackwood B, O’Halloran P, Porter S. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. J Res Nurs. 2010;15:511–21.CrossRef Blackwood B, O’Halloran P, Porter S. On the problems of mixing RCTs with qualitative research: the case of the MRC framework for the evaluation of complex healthcare interventions. J Res Nurs. 2010;15:511–21.CrossRef
10.
go back to reference Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18:40–3.CrossRefPubMed Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18:40–3.CrossRefPubMed
11.
go back to reference Petticrew M. When are complex interventions ‘complex’? When are simple interventions ‘simple’? Eur J Public Health. 2011;21:397–8.CrossRefPubMed Petticrew M. When are complex interventions ‘complex’? When are simple interventions ‘simple’? Eur J Public Health. 2011;21:397–8.CrossRefPubMed
13.
go back to reference Craig P, Petticrew M. Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. Int J Nurs Stud. 2013;50:585–7.CrossRefPubMed Craig P, Petticrew M. Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. Int J Nurs Stud. 2013;50:585–7.CrossRefPubMed
14.
go back to reference Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6:e1000086.CrossRefPubMedPubMedCentral Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6:e1000086.CrossRefPubMedPubMedCentral
16.
go back to reference Denis JL, Hébert Y, Langley A, Lozeau D, Trottier LH. Explaining diffusion patterns for complex health care innovations. Health Care Manage Rev. 2002;27:60–73.CrossRefPubMed Denis JL, Hébert Y, Langley A, Lozeau D, Trottier LH. Explaining diffusion patterns for complex health care innovations. Health Care Manage Rev. 2002;27:60–73.CrossRefPubMed
17.
go back to reference Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.CrossRefPubMedPubMedCentral Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496.CrossRefPubMedPubMedCentral
19.
go back to reference Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63.CrossRefPubMedPubMedCentral Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63.CrossRefPubMedPubMedCentral
20.
go back to reference Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRefPubMed Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75:2299–306.CrossRefPubMed
21.
go back to reference Marchal B, Westhorp G, Wong G, Van Belle S, Greenhalgh T, Kegels G, et al. Realist RCTs of complex interventions – an oxymoron. Soc Sci Med. 2013;94:124–8.CrossRefPubMed Marchal B, Westhorp G, Wong G, Van Belle S, Greenhalgh T, Kegels G, et al. Realist RCTs of complex interventions – an oxymoron. Soc Sci Med. 2013;94:124–8.CrossRefPubMed
22.
go back to reference Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press/Simon and Schuster; 2003. Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press/Simon and Schuster; 2003.
23.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.CrossRefPubMedPubMedCentral
24.
go back to reference Leber, W, McMullen, H, Anderson, J et al. Promotion of rapid testing for HIV in primary care (RHIVA2): a clusterrandomised controlled trial. Lancet HIV. 2015; (published online April 29) doi:S2352-3018/S2352-3018(15)00059-4. Leber, W, McMullen, H, Anderson, J et al. Promotion of rapid testing for HIV in primary care (RHIVA2): a clusterrandomised controlled trial. Lancet HIV. 2015; (published online April 29) doi:S2352-3018/​S2352-3018(15)00059-4.
25.
go back to reference Leber W, McMullen H, Marlin N, Bremner S, Santos AC, Terris-Prestholt F, et al. Point-of-care HIV testing in primary care and early detection of HIV (RHIVA2): a cluster randomised controlled trial [abstract]. Lancet. 2013;382 Special Issue:S7.CrossRef Leber W, McMullen H, Marlin N, Bremner S, Santos AC, Terris-Prestholt F, et al. Point-of-care HIV testing in primary care and early detection of HIV (RHIVA2): a cluster randomised controlled trial [abstract]. Lancet. 2013;382 Special Issue:S7.CrossRef
29.
go back to reference Cook D, Gilbert M, DiFrancesco L, Krajden M. Detection of early sero-conversion HIV infection using the INSTI HIV-1 Antibody Point-of-Care Test. Open AIDS J. 2010;4:176–9.PubMedPubMedCentral Cook D, Gilbert M, DiFrancesco L, Krajden M. Detection of early sero-conversion HIV infection using the INSTI HIV-1 Antibody Point-of-Care Test. Open AIDS J. 2010;4:176–9.PubMedPubMedCentral
31.
go back to reference Robson J, Hippisley-Cox J, Coupland C, Eldridge S, Donstal I, Madurasinghe V, et al. NHS health check programme: national evaluation. London: Queen Mary University of London; 2014. Robson J, Hippisley-Cox J, Coupland C, Eldridge S, Donstal I, Madurasinghe V, et al. NHS health check programme: national evaluation. London: Queen Mary University of London; 2014.
32.
go back to reference Watson TJ. Ethnography, reality, and truth: the vital need for studies of ‘how things work’ in organizations and management. J Manag Stud. 2011;48:202–17.CrossRef Watson TJ. Ethnography, reality, and truth: the vital need for studies of ‘how things work’ in organizations and management. J Manag Stud. 2011;48:202–17.CrossRef
34.
go back to reference Prost A, Griffiths CJ, Anderson J, Wight D, Hart GJ. Feasibility and acceptability of offering rapid HIV tests to patients registering with primary care in London (UK): a pilot study. Sex Transm Infect. 2009;85:326–9.CrossRefPubMed Prost A, Griffiths CJ, Anderson J, Wight D, Hart GJ. Feasibility and acceptability of offering rapid HIV tests to patients registering with primary care in London (UK): a pilot study. Sex Transm Infect. 2009;85:326–9.CrossRefPubMed
38.
go back to reference Strauss A, Corbin JM. Basics of qualitative research: grounded theory procedures and techniques. 2nd ed. Thousand Oaks, CA: Sage Publications; 1990. Strauss A, Corbin JM. Basics of qualitative research: grounded theory procedures and techniques. 2nd ed. Thousand Oaks, CA: Sage Publications; 1990.
39.
go back to reference Van Maanen J. Tales of the field: on writing ethnography. 2nd ed. Chicago: University of Chicago Press; 2011.CrossRef Van Maanen J. Tales of the field: on writing ethnography. 2nd ed. Chicago: University of Chicago Press; 2011.CrossRef
40.
go back to reference Greenhalgh T. Role of routines in collaborative work in healthcare organisations. BMJ. 2008;337:a2448.CrossRefPubMed Greenhalgh T. Role of routines in collaborative work in healthcare organisations. BMJ. 2008;337:a2448.CrossRefPubMed
Metadata
Title
Explaining high and low performers in complex intervention trials: a new model based on diffusion of innovations theory
Authors
Heather McMullen
Chris Griffiths
Werner Leber
Trisha Greenhalgh
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Trials / Issue 1/2015
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-015-0755-5

Other articles of this Issue 1/2015

Trials 1/2015 Go to the issue