Skip to main content
Top
Published in: Implementation Science 1/2007

Open Access 01-12-2007 | Debate

A conceptual framework for implementation fidelity

Authors: Christopher Carroll, Malcolm Patterson, Stephen Wood, Andrew Booth, Jo Rick, Shashi Balain

Published in: Implementation Science | Issue 1/2007

Login to get access

Abstract

Background

Implementation fidelity refers to the degree to which an intervention or programme is delivered as intended. Only by understanding and measuring whether an intervention has been implemented with fidelity can researchers and practitioners gain a better understanding of how and why an intervention works, and the extent to which outcomes can be improved.

Discussion

The authors undertook a critical review of existing conceptualisations of implementation fidelity and developed a new conceptual framework for understanding and measuring the process. The resulting theoretical framework requires testing by empirical research.

Summary

Implementation fidelity is an important source of variation affecting the credibility and utility of research. The conceptual framework presented here offers a means for measuring this variable and understanding its place in the process of intervention implementation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen W: A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Educ Res. 2003, 18: 237-256. 10.1093/her/18.2.237.CrossRefPubMed Dusenbury L, Brannigan R, Falco M, Hansen W: A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Educ Res. 2003, 18: 237-256. 10.1093/her/18.2.237.CrossRefPubMed
2.
go back to reference Dane A, Schneider B: Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clin Psychol Rev. 1998, 18: 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed Dane A, Schneider B: Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clin Psychol Rev. 1998, 18: 23-45. 10.1016/S0272-7358(97)00043-3.CrossRefPubMed
3.
go back to reference Elliot D, Mihalic S: Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004, 5: 47-53. 10.1023/B:PREV.0000013981.28071.52.CrossRef Elliot D, Mihalic S: Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004, 5: 47-53. 10.1023/B:PREV.0000013981.28071.52.CrossRef
4.
go back to reference Mihalic S: The importance of implementation fidelity. Emotional & Behavioral Disorders in Youth. 2004, 4: 83-86. and 99–105. Mihalic S: The importance of implementation fidelity. Emotional & Behavioral Disorders in Youth. 2004, 4: 83-86. and 99–105.
5.
go back to reference Mihalic S: The importance of implementation fidelity. Blueprints Violence Prevention Initiative. 2002, Boulder, Colorado Mihalic S: The importance of implementation fidelity. Blueprints Violence Prevention Initiative. 2002, Boulder, Colorado
6.
go back to reference McGrew J, Griss M: Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatr Rehab J. 2005, 29: 41-47. 10.2975/29.2005.41.47.CrossRef McGrew J, Griss M: Concurrent and predictive validity of two scales to assess the fidelity of implementation of supported employment. Psychiatr Rehab J. 2005, 29: 41-47. 10.2975/29.2005.41.47.CrossRef
7.
go back to reference Resnick B, Neale M, Rosenheck R: Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. J Nerv Ment Dis. 2003, 191: 139-144. 10.1097/00005053-200303000-00001.PubMed Resnick B, Neale M, Rosenheck R: Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness. J Nerv Ment Dis. 2003, 191: 139-144. 10.1097/00005053-200303000-00001.PubMed
8.
go back to reference Forgatch M, Patterson G, DeGarmo D: Evaluating Fidelity: Predictive Validity for a Measure of Competent Adherence to the Oregon Model of Parent Management Training. Behav Ther. 2005, 36: 3-13. 10.1016/S0005-7894(05)80049-8.CrossRefPubMedPubMedCentral Forgatch M, Patterson G, DeGarmo D: Evaluating Fidelity: Predictive Validity for a Measure of Competent Adherence to the Oregon Model of Parent Management Training. Behav Ther. 2005, 36: 3-13. 10.1016/S0005-7894(05)80049-8.CrossRefPubMedPubMedCentral
9.
go back to reference Thomas RE, Baker P, Lorenzetti D: Family-based programmes for preventing smoking by children and adolescents. Cochrane Database Syst Rev. 2007, CD004493-1 Thomas RE, Baker P, Lorenzetti D: Family-based programmes for preventing smoking by children and adolescents. Cochrane Database Syst Rev. 2007, CD004493-1
10.
go back to reference Noel P: The impact of therapeutic case management on participation in adolescent substance abuse treatment. Am J Drug Alcohol Abuse. 2006, 32: 311-327. 10.1080/00952990500328646.CrossRefPubMed Noel P: The impact of therapeutic case management on participation in adolescent substance abuse treatment. Am J Drug Alcohol Abuse. 2006, 32: 311-327. 10.1080/00952990500328646.CrossRefPubMed
11.
go back to reference Dobson L, Cook T: Avoiding Type III error in program evaluation: results from a field experiment. Evaluation and Program Planning. 1980, 3: 269-276. 10.1016/0149-7189(80)90042-7.CrossRef Dobson L, Cook T: Avoiding Type III error in program evaluation: results from a field experiment. Evaluation and Program Planning. 1980, 3: 269-276. 10.1016/0149-7189(80)90042-7.CrossRef
12.
go back to reference Godard J: Beyond the High-Performance Paradigm? An analysis of variation in Canadian Managerial Perceptions of Reform Programme effectiveness. Brit J Ind Rel. 2001, 39: 25-52. 10.1111/1467-8543.00188.CrossRef Godard J: Beyond the High-Performance Paradigm? An analysis of variation in Canadian Managerial Perceptions of Reform Programme effectiveness. Brit J Ind Rel. 2001, 39: 25-52. 10.1111/1467-8543.00188.CrossRef
13.
go back to reference Roen K, Arai L, Roberts H, Popay J: Extending systematic reviews to include evidence on implementation: Methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006, 63: 1060-1071. 10.1016/j.socscimed.2006.02.013.CrossRefPubMed Roen K, Arai L, Roberts H, Popay J: Extending systematic reviews to include evidence on implementation: Methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006, 63: 1060-1071. 10.1016/j.socscimed.2006.02.013.CrossRefPubMed
14.
go back to reference Arai L, Roen K, Roberts H, Popay J: It might work in Oklahoma but will it work in Southampton? Context and implementation in the effectiveness literature on domestic smoke detectors. Inj Prev. 2005, 11: 148-151. 10.1136/ip.2004.007336.CrossRefPubMedPubMedCentral Arai L, Roen K, Roberts H, Popay J: It might work in Oklahoma but will it work in Southampton? Context and implementation in the effectiveness literature on domestic smoke detectors. Inj Prev. 2005, 11: 148-151. 10.1136/ip.2004.007336.CrossRefPubMedPubMedCentral
15.
16.
go back to reference Kirkpatrick D: Evaluation of training. Training Evaluation Handbook. Edited by: Craig R, Bittel L. 1967, New York: McGraw-Hill Kirkpatrick D: Evaluation of training. Training Evaluation Handbook. Edited by: Craig R, Bittel L. 1967, New York: McGraw-Hill
17.
go back to reference Hermens R, Hak E, Hulscher M, Braspenning J, Grol R: Adherence to guidelines on cervical cancer screening in general practice: programme elements of successful implementation. Brit J Gen Prac. 2001, 51 (472): 897-903. Hermens R, Hak E, Hulscher M, Braspenning J, Grol R: Adherence to guidelines on cervical cancer screening in general practice: programme elements of successful implementation. Brit J Gen Prac. 2001, 51 (472): 897-903.
18.
go back to reference Greenhalgh T, Robert G, Bate P, Kyriakidou O, Macfarlane F, Peacock R: How to spread good ideas. A systematic review of the literature on diffusion, dissemination and sustainability of innovations in health service delivery and organisation. 2004, London: NHS Service Delivery Organisation Greenhalgh T, Robert G, Bate P, Kyriakidou O, Macfarlane F, Peacock R: How to spread good ideas. A systematic review of the literature on diffusion, dissemination and sustainability of innovations in health service delivery and organisation. 2004, London: NHS Service Delivery Organisation
19.
go back to reference Hahn E, Noland M, Rayens M, Christie D: Efficacy of training and fidelity of implementation of the life skills training program. J School Health. 2002, 72: 282-287.CrossRefPubMed Hahn E, Noland M, Rayens M, Christie D: Efficacy of training and fidelity of implementation of the life skills training program. J School Health. 2002, 72: 282-287.CrossRefPubMed
20.
go back to reference Naylor P-J, MacDonald H, Zebedee J, Reed K, McKay H: Lessons learned from Action Schools! BC – an 'active school' model to promote physical activity in elementary schools. J Sci Med in Sport. 2006, 9: 413-423. 10.1016/j.jsams.2006.06.013.CrossRef Naylor P-J, MacDonald H, Zebedee J, Reed K, McKay H: Lessons learned from Action Schools! BC – an 'active school' model to promote physical activity in elementary schools. J Sci Med in Sport. 2006, 9: 413-423. 10.1016/j.jsams.2006.06.013.CrossRef
21.
go back to reference Faw L, Hogue A, Liddle H: Multidimensional implementation evaluation of a residential treatment program for adolescent substance use. Am J Eval. 2005, 26: 77-93. 10.1177/1098214004273183.CrossRef Faw L, Hogue A, Liddle H: Multidimensional implementation evaluation of a residential treatment program for adolescent substance use. Am J Eval. 2005, 26: 77-93. 10.1177/1098214004273183.CrossRef
22.
go back to reference Blakely C, Mayer J, Gottschalk R, Schmitt N, Davidson W, Riotman D, Emshoff J: The fidelity-adaptation debate: implications for the implementation of public sector social programs. Am J Com Psychol. 1987, 15: 253-268. 10.1007/BF00922697.CrossRef Blakely C, Mayer J, Gottschalk R, Schmitt N, Davidson W, Riotman D, Emshoff J: The fidelity-adaptation debate: implications for the implementation of public sector social programs. Am J Com Psychol. 1987, 15: 253-268. 10.1007/BF00922697.CrossRef
23.
go back to reference Grol R, Dalhuijsen J, Thomas S, Veld C, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. Brit Med J. 1998, 317: 858-861.CrossRefPubMedPubMedCentral Grol R, Dalhuijsen J, Thomas S, Veld C, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. Brit Med J. 1998, 317: 858-861.CrossRefPubMedPubMedCentral
24.
go back to reference Medical Research Council: A framework for the development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research Council Medical Research Council: A framework for the development and evaluation of RCTs for complex interventions to improve health. 2000, London: Medical Research Council
25.
go back to reference Bellg A, Borrelli B, Resnick B, Hecht J, Minicucci D, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behaviour change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004, 23: 443-451. 10.1037/0278-6133.23.5.443.CrossRefPubMed Bellg A, Borrelli B, Resnick B, Hecht J, Minicucci D, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behaviour change studies: Best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004, 23: 443-451. 10.1037/0278-6133.23.5.443.CrossRefPubMed
26.
go back to reference Hitt J, Robbins A, Galbraith J, Todd J, Patel-Larson A, McFarlane J, Spikes P, Carey J: Adaptation and implementation of a evidence-based prevention counselling intervention in Texas. AIDS Educ Prev. 2006, 18 (SA): 108-118. 10.1521/aeap.2006.18.supp.108.CrossRefPubMed Hitt J, Robbins A, Galbraith J, Todd J, Patel-Larson A, McFarlane J, Spikes P, Carey J: Adaptation and implementation of a evidence-based prevention counselling intervention in Texas. AIDS Educ Prev. 2006, 18 (SA): 108-118. 10.1521/aeap.2006.18.supp.108.CrossRefPubMed
27.
go back to reference Penuel W, Means B: Implementation variation and fidelity in an Inquiry Science Program: analysis of GLOBE data reporting patterns. J Res Sci Teaching. 2004, 41: 294-315. 10.1002/tea.20002.CrossRef Penuel W, Means B: Implementation variation and fidelity in an Inquiry Science Program: analysis of GLOBE data reporting patterns. J Res Sci Teaching. 2004, 41: 294-315. 10.1002/tea.20002.CrossRef
28.
go back to reference O'Brien R: Translating a research intervention into community practice: The nurse-family partnership. J Primary Prev. 2005, 26: 241-257. 10.1007/s10935-005-3599-z.CrossRef O'Brien R: Translating a research intervention into community practice: The nurse-family partnership. J Primary Prev. 2005, 26: 241-257. 10.1007/s10935-005-3599-z.CrossRef
29.
go back to reference Resnick B, Inguito P, Orwig D, Yahiro J, Hawkes W, Werner M, Zimmerman S, Magaziner J: Treatment fidelity in behavior change research: A case example. Nurs Res. 2005, 54: 139-143. 10.1097/00006199-200503000-00010.CrossRefPubMed Resnick B, Inguito P, Orwig D, Yahiro J, Hawkes W, Werner M, Zimmerman S, Magaziner J: Treatment fidelity in behavior change research: A case example. Nurs Res. 2005, 54: 139-143. 10.1097/00006199-200503000-00010.CrossRefPubMed
30.
go back to reference Rogers EM: Diffusion of Innovation. 2003, New York, NY: Free Press, Fifth Rogers EM: Diffusion of Innovation. 2003, New York, NY: Free Press, Fifth
31.
go back to reference Maidment R, Livingston G, Katona C: "Just keep taking the tablets": Adherence to antidepressant treatment in older people in primary care. Int J Geriatr Psychiatry. 2003, 17: 752-757. 10.1002/gps.688.CrossRef Maidment R, Livingston G, Katona C: "Just keep taking the tablets": Adherence to antidepressant treatment in older people in primary care. Int J Geriatr Psychiatry. 2003, 17: 752-757. 10.1002/gps.688.CrossRef
32.
go back to reference Barat I, Andreasen F, Damsgaard EMS: Drug therapy in the elderly: what doctors believe and patients actually do. Brit J Clin Pharm. 2001, 51: 615-622. 10.1046/j.0306-5251.2001.01401.x.CrossRefPubMedPubMedCentral Barat I, Andreasen F, Damsgaard EMS: Drug therapy in the elderly: what doctors believe and patients actually do. Brit J Clin Pharm. 2001, 51: 615-622. 10.1046/j.0306-5251.2001.01401.x.CrossRefPubMedPubMedCentral
33.
go back to reference Allen H: Adult/elderly care nursing. Promoting compliance with antihypertensive medication. Brit J Nurs. 1998, 7: 1252-1258.CrossRef Allen H: Adult/elderly care nursing. Promoting compliance with antihypertensive medication. Brit J Nurs. 1998, 7: 1252-1258.CrossRef
34.
go back to reference Martens M, van Assema P, Paulussen T, Schaalma H, Brug J: Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. Health Educ Res. 2006, 21: 695-704. 10.1093/her/cyl082.CrossRefPubMed Martens M, van Assema P, Paulussen T, Schaalma H, Brug J: Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. Health Educ Res. 2006, 21: 695-704. 10.1093/her/cyl082.CrossRefPubMed
35.
go back to reference Ringwalt C, Ennett S, Johnson R, Rohrbach L, Simons-Rudolph A, Vincus A, Thorne J: Factors associated with fidelity to substance use prevention curriculum guides in the nation's middle schools. Health Educ Behav. 2003, 30: 375-391. 10.1177/1090198103030003010.CrossRefPubMed Ringwalt C, Ennett S, Johnson R, Rohrbach L, Simons-Rudolph A, Vincus A, Thorne J: Factors associated with fidelity to substance use prevention curriculum guides in the nation's middle schools. Health Educ Behav. 2003, 30: 375-391. 10.1177/1090198103030003010.CrossRefPubMed
36.
go back to reference Bullock R, Batten D: Its just a phase we are going through: A review and synthesis of OD phase analysis. Group and Organization Studies. 1985, 10: 383-412. 10.1177/105960118501000403.CrossRef Bullock R, Batten D: Its just a phase we are going through: A review and synthesis of OD phase analysis. Group and Organization Studies. 1985, 10: 383-412. 10.1177/105960118501000403.CrossRef
37.
go back to reference McBride N, Farringdon F, Midford R: Implementing a school drug education programme: reflections on fidelity. Int J Health Promotion Educ. 2002, 40: 40-50.CrossRef McBride N, Farringdon F, Midford R: Implementing a school drug education programme: reflections on fidelity. Int J Health Promotion Educ. 2002, 40: 40-50.CrossRef
38.
go back to reference Herzog S, Wright P: Addressing the fidelity of personal and social responsibility model implementation. Res Q Exerc Sport. 2005, A-76. 76 Supplement Herzog S, Wright P: Addressing the fidelity of personal and social responsibility model implementation. Res Q Exerc Sport. 2005, A-76. 76 Supplement
39.
go back to reference Cash S, Berry M: Measuring service delivery in a placement prevention program: An application to an ecological model. Admin Soc Work. 2003, 27: 65-85. 10.1300/J147v27n03_05.CrossRef Cash S, Berry M: Measuring service delivery in a placement prevention program: An application to an ecological model. Admin Soc Work. 2003, 27: 65-85. 10.1300/J147v27n03_05.CrossRef
40.
go back to reference Rinaldi M, McNeil K, Firn M, Koletsi M, Perkins R, Singh S: What are the benefits of evidence-based supported employment for patients with first-episode psychosis?. Psychiatr Bull. 2004, 28: 281-284. 10.1192/pb.28.8.281.CrossRef Rinaldi M, McNeil K, Firn M, Koletsi M, Perkins R, Singh S: What are the benefits of evidence-based supported employment for patients with first-episode psychosis?. Psychiatr Bull. 2004, 28: 281-284. 10.1192/pb.28.8.281.CrossRef
41.
go back to reference Nutley S, Homel P: Delivering evidence-based policy and practice: Lessons from the implementation of the UK Crime Reduction Programme. Evidence & Policy. 2006, 2: 5-26.CrossRef Nutley S, Homel P: Delivering evidence-based policy and practice: Lessons from the implementation of the UK Crime Reduction Programme. Evidence & Policy. 2006, 2: 5-26.CrossRef
Metadata
Title
A conceptual framework for implementation fidelity
Authors
Christopher Carroll
Malcolm Patterson
Stephen Wood
Andrew Booth
Jo Rick
Shashi Balain
Publication date
01-12-2007
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2007
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-2-40

Other articles of this Issue 1/2007

Implementation Science 1/2007 Go to the issue