Skip to main content
Top
Published in: Implementation Science 1/2011

Open Access 01-12-2011 | Research

Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)

Authors: Patricia Chamberlain, C Hendricks Brown, Lisa Saldana

Published in: Implementation Science | Issue 1/2011

Login to get access

Abstract

Background

An increasingly large body of research is focused on designing and testing strategies to improve knowledge about how to embed evidence-based programs (EBP) into community settings. Development of strategies for overcoming barriers and increasing the effectiveness and pace of implementation is a high priority. Yet, there are few research tools that measure the implementation process itself. The Stages of Implementation Completion (SIC) is an observation-based measure that is used to track the time to achievement of key implementation milestones in an EBP being implemented in 51 counties in 53 sites (two counties have two sites) in two states in the United States.

Methods

The SIC was developed in the context of a randomized trial comparing the effectiveness of two implementation strategies: community development teams (experimental condition) and individualized implementation (control condition). Fifty-one counties were randomized to experimental or control conditions for implementation of multidimensional treatment foster care (MTFC), an alternative to group/residential care placement for children and adolescents. Progress through eight implementation stages was tracked by noting dates of completion of specific activities in each stage. Activities were tailored to the strategies for implementing the specific EBP.

Results

Preliminary data showed that several counties ceased progress during pre-implementation and that there was a high degree of variability among sites in the duration scores per stage and on the proportion of activities that were completed in each stage. Progress through activities and stages for three example counties is shown.

Conclusions

By assessing the attainment time of each stage and the proportion of activities completed, the SIC measure can be used to track and compare the effectiveness of various implementation strategies. Data from the SIC will provide sites with relevant information on the time and resources needed to implement MTFC during various phases of implementation. With some modifications, the SIC could be appropriate for use in evaluating implementation strategies in head-to-head randomized implementation trials and as a monitoring tool for rolling out other EBPs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pringle B, Chambers D, Wang PS: Toward enough of the best for all: Research to transform the efficacy, quality, and reach of mental health care for youth. Adm Policy Ment Health. 2010, 37: 191-196.CrossRefPubMed Pringle B, Chambers D, Wang PS: Toward enough of the best for all: Research to transform the efficacy, quality, and reach of mental health care for youth. Adm Policy Ment Health. 2010, 37: 191-196.CrossRefPubMed
3.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Admin Policy Ment Health. 2011, 38: 65-76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Admin Policy Ment Health. 2011, 38: 65-76.CrossRef
4.
go back to reference Feldstein AC, Glasgow RE, Smith DH: A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008, 34: 228-243.PubMed Feldstein AC, Glasgow RE, Smith DH: A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008, 34: 228-243.PubMed
5.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Imp Sci. 2009, 4: 50-CrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Imp Sci. 2009, 4: 50-CrossRef
6.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82: 581-629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82: 581-629.CrossRefPubMedPubMedCentral
7.
go back to reference Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J of Public Health. 1999, 89: 1322-1327.CrossRef Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J of Public Health. 1999, 89: 1322-1327.CrossRef
8.
go back to reference Palinkas LA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J: Mixed Method Designs in Implementation Research. Adm Policy Ment Health. 2011, 62: 255-263. Palinkas LA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J: Mixed Method Designs in Implementation Research. Adm Policy Ment Health. 2011, 62: 255-263.
9.
go back to reference Mansenich L: Evidence-based practices in mental health services for foster youth. 2002, Sacramento, CA: California Institute for Mental Health Mansenich L: Evidence-based practices in mental health services for foster youth. 2002, Sacramento, CA: California Institute for Mental Health
10.
go back to reference Fixsen DL, Blase KA, Horner RH, Sugai G: Developing the capacity for scaling up the effective use of evidence-based programs in state departments of education. 2009, Chapel Hill, NC: State Implementation of Scaling-up Evidence-based Practices (SISEP) Center Fixsen DL, Blase KA, Horner RH, Sugai G: Developing the capacity for scaling up the effective use of evidence-based programs in state departments of education. 2009, Chapel Hill, NC: State Implementation of Scaling-up Evidence-based Practices (SISEP) Center
11.
go back to reference Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB: Interventions in organizational and community context: A framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008, 35: 21-37.CrossRefPubMed Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB: Interventions in organizational and community context: A framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008, 35: 21-37.CrossRefPubMed
12.
go back to reference Hales B, Terblanche M, Fowler R, Sibbald W: Development of medical checklists for improved quality of patient care. Int J for Quality in Health Care. 2008, 20: 22-30.CrossRef Hales B, Terblanche M, Fowler R, Sibbald W: Development of medical checklists for improved quality of patient care. Int J for Quality in Health Care. 2008, 20: 22-30.CrossRef
13.
go back to reference Chamberlain P: The Oregon multidimensional treatment foster care model: Features, outcomes, and progress in dissemination. Cognitive and Behavioral Practice. Edited by: S. Schoenwald and S. Henggeler. 2003, Moving evidence-based treatments from the laboratory into clinical practice, 10: 303-312. (2003) Chamberlain P: The Oregon multidimensional treatment foster care model: Features, outcomes, and progress in dissemination. Cognitive and Behavioral Practice. Edited by: S. Schoenwald and S. Henggeler. 2003, Moving evidence-based treatments from the laboratory into clinical practice, 10: 303-312. (2003)
14.
go back to reference Chamberlain P, Leve LD, DeGarmo DS: Multidimensional treatment foster care for girls in the juvenile justice system: 2-year follow-up of a randomized clinical trial. J Consult Clin Psych. 2007, 75: 187-193.CrossRef Chamberlain P, Leve LD, DeGarmo DS: Multidimensional treatment foster care for girls in the juvenile justice system: 2-year follow-up of a randomized clinical trial. J Consult Clin Psych. 2007, 75: 187-193.CrossRef
15.
go back to reference Leve LD, Chamberlain P: A randomized evaluation of Multidimensional Treatment Foster Care: Effects on school attendance and homework completion in juvenile justice girls. Res Social Work Prac. 2007, 17: 657-663.CrossRef Leve LD, Chamberlain P: A randomized evaluation of Multidimensional Treatment Foster Care: Effects on school attendance and homework completion in juvenile justice girls. Res Social Work Prac. 2007, 17: 657-663.CrossRef
16.
go back to reference Chamberlain P, Reid J: Differences in risk factors and adjustment for male and female delinquents in treatment foster care. J Child and Fam Stud. 1998, 3: 23-39.CrossRef Chamberlain P, Reid J: Differences in risk factors and adjustment for male and female delinquents in treatment foster care. J Child and Fam Stud. 1998, 3: 23-39.CrossRef
17.
go back to reference Bergh AM, Arsalo I, Malan AF, Patrick M, Pattinson RC, Phillips N: Measuring implementation progress in kangaroo mother care. Acta Pediatrica. 2005, 94: 1102-1108.CrossRef Bergh AM, Arsalo I, Malan AF, Patrick M, Pattinson RC, Phillips N: Measuring implementation progress in kangaroo mother care. Acta Pediatrica. 2005, 94: 1102-1108.CrossRef
18.
go back to reference Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2010, 38: 4-23.CrossRefPubMedCentral Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2010, 38: 4-23.CrossRefPubMedCentral
19.
go back to reference Sonsa T, Marsenich L: Community Development Team Model. Supporting the Model Adherent Implementation of Programs and Practices [report]. 2006, Sacramento, CA: The California Institute for Mental Health, October, 2-40. Sonsa T, Marsenich L: Community Development Team Model. Supporting the Model Adherent Implementation of Programs and Practices [report]. 2006, Sacramento, CA: The California Institute for Mental Health, October, 2-40.
20.
go back to reference Rogers EM: Diffusion of innovations. New York: Free Press, 4 Rogers EM: Diffusion of innovations. New York: Free Press, 4
21.
go back to reference Kalbfleisch JD, Prentice RL: The Statistical Analysis of Failure Time Data. 2002, New York: Wiley, 2CrossRef Kalbfleisch JD, Prentice RL: The Statistical Analysis of Failure Time Data. 2002, New York: Wiley, 2CrossRef
22.
go back to reference Wang W, Saldana L, Brown CH, Chamberlain P: Factors that influenced county system leaders to implement an evidence-based program: A baseline survey within a randomized controlled trial. Imp Sci. 2010, 5: 72-CrossRef Wang W, Saldana L, Brown CH, Chamberlain P: Factors that influenced county system leaders to implement an evidence-based program: A baseline survey within a randomized controlled trial. Imp Sci. 2010, 5: 72-CrossRef
23.
go back to reference DeAngelis T: Getting research into the real world. Monitor on Psych. 2010, 41: 60- DeAngelis T: Getting research into the real world. Monitor on Psych. 2010, 41: 60-
24.
go back to reference Saldana L, Chamberlain P, Wang W, Brown CH: Predicting program start-up using the stages of implementation measure. Adm Policy Ment Health. 2011, online first:. Saldana L, Chamberlain P, Wang W, Brown CH: Predicting program start-up using the stages of implementation measure. Adm Policy Ment Health. 2011, online first:.
Metadata
Title
Observational measure of implementation progress in community based settings: The Stages of implementation completion (SIC)
Authors
Patricia Chamberlain
C Hendricks Brown
Lisa Saldana
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2011
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-6-116

Other articles of this Issue 1/2011

Implementation Science 1/2011 Go to the issue