Skip to main content
Top
Published in: Implementation Science 1/2010

Open Access 01-12-2010 | Study protocol

Systematic evaluation of implementation fidelity of complex interventions in health and social care

Author: Henna Hasson

Published in: Implementation Science | Issue 1/2010

Login to get access

Abstract

Background

Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes.
The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care.

Methods

A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods.

Discussion

This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified.

Trial Registration

Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bradley F, Wiles R, Kinmonth AL, Mant D, Gantley M: Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). The SHIP Collaborative Group. Bmj. 1999, 318: 711-715.CrossRefPubMedPubMedCentral Bradley F, Wiles R, Kinmonth AL, Mant D, Gantley M: Development and evaluation of complex interventions in health services research: case study of the Southampton heart integrated care project (SHIP). The SHIP Collaborative Group. Bmj. 1999, 318: 711-715.CrossRefPubMedPubMedCentral
2.
go back to reference Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: MRC Medical Research Council: A framework for development and evaluation of RCTs for complex interventions to improve health. 2000, London: MRC
3.
go back to reference Lipsey MW, Cordray DS: Evaluation methods for social intervention. Annual review of psychology. 2000, 51: 345-375. 10.1146/annurev.psych.51.1.345.CrossRefPubMed Lipsey MW, Cordray DS: Evaluation methods for social intervention. Annual review of psychology. 2000, 51: 345-375. 10.1146/annurev.psych.51.1.345.CrossRefPubMed
4.
go back to reference Dobson D, Cook TJ: Avoiding type III error in program evaluation: Results from a field experiment. Evaluation and Program Planning. 1980, 3: 269-276. 10.1016/0149-7189(80)90042-7.CrossRef Dobson D, Cook TJ: Avoiding type III error in program evaluation: Results from a field experiment. Evaluation and Program Planning. 1980, 3: 269-276. 10.1016/0149-7189(80)90042-7.CrossRef
5.
go back to reference McGrew JH, Griss ME: Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatric rehabilitation journal. 2005, 29: 41-47. 10.2975/29.2005.41.47.CrossRefPubMed McGrew JH, Griss ME: Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatric rehabilitation journal. 2005, 29: 41-47. 10.2975/29.2005.41.47.CrossRefPubMed
6.
go back to reference Hulscher M, Laurant MGH, Grol R: Process evaluation on quality improvement interventions. Quality and Safety in Health Care. 2003, 12: 40-46. 10.1136/qhc.12.1.40.CrossRefPubMedPubMedCentral Hulscher M, Laurant MGH, Grol R: Process evaluation on quality improvement interventions. Quality and Safety in Health Care. 2003, 12: 40-46. 10.1136/qhc.12.1.40.CrossRefPubMedPubMedCentral
7.
go back to reference Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation research: A synthesis of the literature. 2005, Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication 231) Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation research: A synthesis of the literature. 2005, Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication 231)
8.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. Bmj. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. Bmj. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
9.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implementation Science. 2007, 2: 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S: A conceptual framework for implementation fidelity. Implementation Science. 2007, 2: 40-10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral
10.
go back to reference Dane AV, Schneider BH: Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical Psychology Review. 1998, 18: 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed Dane AV, Schneider BH: Program integrity in primary and early secondary prevention: are implementation effects out of control?. Clinical Psychology Review. 1998, 18: 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed
11.
go back to reference Rossi PH, Lipsey MW, Freeman HE: Evaluation: A systematic approach. 2004, Sage Publications Inc Rossi PH, Lipsey MW, Freeman HE: Evaluation: A systematic approach. 2004, Sage Publications Inc
12.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Education Research. 2003, 18: 237-256. 10.1093/her/18.2.237.CrossRefPubMed Dusenbury L, Brannigan R, Falco M, Hansen WB: A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Education Research. 2003, 18: 237-256. 10.1093/her/18.2.237.CrossRefPubMed
13.
go back to reference Steckler AB, Linnan L, Israel BA: Process evaluation for public health interventions and research. 2002, Jossey-Bass Steckler AB, Linnan L, Israel BA: Process evaluation for public health interventions and research. 2002, Jossey-Bass
14.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
15.
go back to reference Pettigrew AM: Longitudinal field research on change: theory and practice. Organizational Science. 1990, 1: 267-292. 10.1287/orsc.1.3.267.CrossRef Pettigrew AM: Longitudinal field research on change: theory and practice. Organizational Science. 1990, 1: 267-292. 10.1287/orsc.1.3.267.CrossRef
16.
go back to reference Pettigrew AM: The character and significance of strategy process research. Strategic Management Journal. 1992, 13: 5-16. 10.1002/smj.4250130903.CrossRef Pettigrew AM: The character and significance of strategy process research. Strategic Management Journal. 1992, 13: 5-16. 10.1002/smj.4250130903.CrossRef
17.
go back to reference Pettigrew AM: What is a processual analysis?. Scandinavian Journal of Management. 1997, 13: 337-348. 10.1016/S0956-5221(97)00020-1.CrossRef Pettigrew AM: What is a processual analysis?. Scandinavian Journal of Management. 1997, 13: 337-348. 10.1016/S0956-5221(97)00020-1.CrossRef
18.
go back to reference Baranowski T, Stables G: Process evaluations of the 5-a-day projects. Health Education & Behavior. 2000, 27: 157-166.CrossRef Baranowski T, Stables G: Process evaluations of the 5-a-day projects. Health Education & Behavior. 2000, 27: 157-166.CrossRef
19.
go back to reference Yin RK: Case Study Research: Design and Methods. 2003, Sage Publications Inc Yin RK: Case Study Research: Design and Methods. 2003, Sage Publications Inc
20.
go back to reference Bond GR, Drake RE, Becker DR: An update on randomized controlled trials of evidence-based supported employment. Psychiatric rehabilitation journal. 2008, 31: 280-290. 10.2975/31.4.2008.280.290.CrossRefPubMed Bond GR, Drake RE, Becker DR: An update on randomized controlled trials of evidence-based supported employment. Psychiatric rehabilitation journal. 2008, 31: 280-290. 10.2975/31.4.2008.280.290.CrossRefPubMed
21.
go back to reference Burns T, Catty J, Becker T, Drake RE, Fioritti A, Knapp M, Lauber C, Rössler W, Tomov T, Van Busschbach J: The effectiveness of supported employment for people with severe mental illness: a randomised controlled trial. The Lancet. 2007, 370: 1146-1152. 10.1016/S0140-6736(07)61516-5.CrossRef Burns T, Catty J, Becker T, Drake RE, Fioritti A, Knapp M, Lauber C, Rössler W, Tomov T, Van Busschbach J: The effectiveness of supported employment for people with severe mental illness: a randomised controlled trial. The Lancet. 2007, 370: 1146-1152. 10.1016/S0140-6736(07)61516-5.CrossRef
22.
go back to reference Campbell K, Bond GR, Drake RE: Who Benefits From Supported Employment: A Meta-analytic Study. Schizophrenia Bulletin. 2009 Campbell K, Bond GR, Drake RE: Who Benefits From Supported Employment: A Meta-analytic Study. Schizophrenia Bulletin. 2009
23.
go back to reference Swanson S, Bond GR, Merrens MR: Evidence-based Supported Employment fidelity review manual. 2008, Dartmouth Psychiatric Research Center Swanson S, Bond GR, Merrens MR: Evidence-based Supported Employment fidelity review manual. 2008, Dartmouth Psychiatric Research Center
24.
go back to reference Yang B: Identifying valid and reliable measures for dimensions of a learning cultur -. Advances in Developing Human Resources. 2003, 5: 152-162. 10.1177/1523422303005002003.CrossRef Yang B: Identifying valid and reliable measures for dimensions of a learning cultur -. Advances in Developing Human Resources. 2003, 5: 152-162. 10.1177/1523422303005002003.CrossRef
25.
go back to reference Yang B, Watkins KE, Marsick VJ: The Construct of the Learning Organization: Dimensions, Measurement, and Validation. Human Resource Development Quarterly. 2004, 15: 31-55. 10.1002/hrdq.1086.CrossRef Yang B, Watkins KE, Marsick VJ: The Construct of the Learning Organization: Dimensions, Measurement, and Validation. Human Resource Development Quarterly. 2004, 15: 31-55. 10.1002/hrdq.1086.CrossRef
Metadata
Title
Systematic evaluation of implementation fidelity of complex interventions in health and social care
Author
Henna Hasson
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2010
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-5-67

Other articles of this Issue 1/2010

Implementation Science 1/2010 Go to the issue