Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Study protocol

Development and testing of an implementation strategy for a complex housing intervention: protocol for a mixed methods study

Authors: Dennis P Watson, Jeani Young, Emily Ahonen, Huiping Xu, Macey Henderson, Valery Shuman, Randi Tolliver

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

There is currently a lack of scientifically designed and tested implementation strategies. Such strategies are particularly important for highly complex interventions that require coordination between multiple parts to be successful. This paper presents a protocol for the development and testing of an implementation strategy for a complex intervention known as the Housing First model (HFM). Housing First is an evidence-based practice for chronically homeless individuals demonstrated to significantly improve a number of outcomes.

Methods/design

Drawing on practices demonstrated to be useful in implementation and e-learning theory, our team is currently adapting a face-to-face implementation strategy so that it can be delivered over a distance. Research activities will be divided between Chicago and Central Indiana, two areas with significantly different barriers to HFM implementation. Ten housing providers (five from Chicago and five from Indiana) will be recruited to conduct an alpha test of each of four e-learning modules as they are developed. Providers will be requested to keep a detailed log of their experience completing the modules and participate in one of two focus groups. After refining the modules based on alpha test results, we will test the strategy among a sample of four housing organizations (two from Chicago and two from Indiana). We will collect and analyze both qualitative and quantitative data from administration and staff. Measures of interest include causal factors affecting implementation, training outcomes, and implementation outcomes.

Discussion

This project is an important first step in the development of an evidence-based implementation strategy to increase scalability and impact of the HFM. The project also has strong potential to increase limited scientific knowledge regarding implementation strategies in general.
Appendix
Available only for authorised users
Literature
1.
go back to reference Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012, 69: 123-157. 10.1177/1077558711430690.CrossRefPubMed Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL: A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012, 69: 123-157. 10.1177/1077558711430690.CrossRefPubMed
2.
go back to reference Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B: Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009, 36: 24-34. 10.1007/s10488-008-0197-4.CrossRefPubMed Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B: Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009, 36: 24-34. 10.1007/s10488-008-0197-4.CrossRefPubMed
3.
go back to reference May C: A rational model for assessing and evaluating complex interventions in health care.BMC Health Serv Res 2006, 6:86., May C: A rational model for assessing and evaluating complex interventions in health care.BMC Health Serv Res 2006, 6:86.,
4.
go back to reference Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M: Effects of pay for performance on the quality of primary care in England. New Engl J Med. 2009, 361: 368-378. 10.1056/NEJMsa0807651.CrossRefPubMed Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M: Effects of pay for performance on the quality of primary care in England. New Engl J Med. 2009, 361: 368-378. 10.1056/NEJMsa0807651.CrossRefPubMed
5.
go back to reference Clark HW, Power AK, Le Fauve CE, Lopez EI: Policy and practice implications of epidemiological surveys on co-occurring mental and substance use disorders. J Subst Abuse Treat. 2008, 34: 3-13. 10.1016/j.jsat.2006.12.032.CrossRefPubMed Clark HW, Power AK, Le Fauve CE, Lopez EI: Policy and practice implications of epidemiological surveys on co-occurring mental and substance use disorders. J Subst Abuse Treat. 2008, 34: 3-13. 10.1016/j.jsat.2006.12.032.CrossRefPubMed
6.
go back to reference Bostic RW, Thornton RLJ, Rudd EC, Sternthal MJ: Health in all policies: the role of the US Department of Housing and Urban Development and present and future challenges. Health Affair. 2012, 31 (9): 2130-2137. 10.1377/hlthaff.2011.1014.CrossRef Bostic RW, Thornton RLJ, Rudd EC, Sternthal MJ: Health in all policies: the role of the US Department of Housing and Urban Development and present and future challenges. Health Affair. 2012, 31 (9): 2130-2137. 10.1377/hlthaff.2011.1014.CrossRef
7.
go back to reference Watson DP: From structural chaos to a model of consumer support: understanding the roles of structure and agency in mental health recovery for the formerly homeless. J Forensic Psychol Pract. 2012, 12: 325-348. 10.1080/15228932.2012.695656.CrossRefPubMedPubMedCentral Watson DP: From structural chaos to a model of consumer support: understanding the roles of structure and agency in mental health recovery for the formerly homeless. J Forensic Psychol Pract. 2012, 12: 325-348. 10.1080/15228932.2012.695656.CrossRefPubMedPubMedCentral
8.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
9.
go back to reference Dickson-Gomez J, Convey M, Hilario H, Corbett AM, Weeks M: Unofficial policy: access to housing, housing information and social services among homeless drug users in Hartford.Connecticut Subst Abuse Treat Prev Policy 2007, 2:8., Dickson-Gomez J, Convey M, Hilario H, Corbett AM, Weeks M: Unofficial policy: access to housing, housing information and social services among homeless drug users in Hartford.Connecticut Subst Abuse Treat Prev Policy 2007, 2:8.,
10.
go back to reference Tsemberis S: From streets to homes: an innovative approach to supported housing for homeless adults with psychiatric disabilities. J Community Psychol. 1999, 27: 225-241. 10.1002/(SICI)1520-6629(199903)27:2<225::AID-JCOP9>3.0.CO;2-Y.CrossRef Tsemberis S: From streets to homes: an innovative approach to supported housing for homeless adults with psychiatric disabilities. J Community Psychol. 1999, 27: 225-241. 10.1002/(SICI)1520-6629(199903)27:2<225::AID-JCOP9>3.0.CO;2-Y.CrossRef
11.
go back to reference Collins SE, Malone DK, Clifasefi SL: Housing retention in single-site Housing First for chronically homeless individuals with severe alcohol problems. Am J Public Health. 2013, 103: S269-S274. 10.2105/AJPH.2013.301312.CrossRefPubMedPubMedCentral Collins SE, Malone DK, Clifasefi SL: Housing retention in single-site Housing First for chronically homeless individuals with severe alcohol problems. Am J Public Health. 2013, 103: S269-S274. 10.2105/AJPH.2013.301312.CrossRefPubMedPubMedCentral
12.
go back to reference Sadowski LS, Kee RA, VanderWeele TJ, Buchanan D: Effect of a housing and case management program on emergency department visits and hospitalizations among chronically ill homeless adults: a randomized trial. JAMA. 2009, 301: 1771-1778. 10.1001/jama.2009.561.CrossRefPubMed Sadowski LS, Kee RA, VanderWeele TJ, Buchanan D: Effect of a housing and case management program on emergency department visits and hospitalizations among chronically ill homeless adults: a randomized trial. JAMA. 2009, 301: 1771-1778. 10.1001/jama.2009.561.CrossRefPubMed
13.
go back to reference Tsemberis S, Eisenberg RF: Pathways to Housing: supported housing for street-dwelling homeless individuals with psychiatric disabilities. Psychiatr Serv. 2000, 51: 487-493. 10.1176/appi.ps.51.4.487.CrossRefPubMed Tsemberis S, Eisenberg RF: Pathways to Housing: supported housing for street-dwelling homeless individuals with psychiatric disabilities. Psychiatr Serv. 2000, 51: 487-493. 10.1176/appi.ps.51.4.487.CrossRefPubMed
14.
go back to reference Padgett DK, Gulcur L, Tsemberis S: Housing First services for people who are homeless with co-occurring serious mental illness and substance abuse. Res Soc Wor Prac. 2006, 16: 74-83. 10.1177/1049731505282593.CrossRef Padgett DK, Gulcur L, Tsemberis S: Housing First services for people who are homeless with co-occurring serious mental illness and substance abuse. Res Soc Wor Prac. 2006, 16: 74-83. 10.1177/1049731505282593.CrossRef
15.
go back to reference Tsemberis S, Asmussen S: From streets to homes - the Pathways to Housing consumer preference supported housing model. Alcohol Treat Q. 1999, 17: 113-131. 10.1300/J020v17n01_07.CrossRef Tsemberis S, Asmussen S: From streets to homes - the Pathways to Housing consumer preference supported housing model. Alcohol Treat Q. 1999, 17: 113-131. 10.1300/J020v17n01_07.CrossRef
17.
go back to reference A Plan, not a dream: how to end homelessness in ten years. 2000, National Alliance to End Homelessness, Washington DC A Plan, not a dream: how to end homelessness in ten years. 2000, National Alliance to End Homelessness, Washington DC
18.
go back to reference Pearson CL, Montgomery AE, Locke G: Housing stability among homeless individuals with serious mental illness participating in housing first programs. J Community Psychol. 2009, 37: 404-417. 10.1002/jcop.20303.CrossRef Pearson CL, Montgomery AE, Locke G: Housing stability among homeless individuals with serious mental illness participating in housing first programs. J Community Psychol. 2009, 37: 404-417. 10.1002/jcop.20303.CrossRef
19.
go back to reference George C, Chernega JN, Stawiski S, Figert A, Bendixen AV: Connecting fractured lives to a fragmented system: Chicago Housing for Health Partnership. Equal Oppor Int. 2008, 27: 161-180. 10.1108/02610150810853488.CrossRef George C, Chernega JN, Stawiski S, Figert A, Bendixen AV: Connecting fractured lives to a fragmented system: Chicago Housing for Health Partnership. Equal Oppor Int. 2008, 27: 161-180. 10.1108/02610150810853488.CrossRef
20.
go back to reference Watson DP, Wagner DE, Rivers MM: Understanding the critical ingredients for facilitating consumer change in housing first programming: a case study approach. J Behav Health Serv Res. 2013, 40: 169-179. 10.1007/s11414-012-9312-0.CrossRefPubMedPubMedCentral Watson DP, Wagner DE, Rivers MM: Understanding the critical ingredients for facilitating consumer change in housing first programming: a case study approach. J Behav Health Serv Res. 2013, 40: 169-179. 10.1007/s11414-012-9312-0.CrossRefPubMedPubMedCentral
21.
go back to reference Watson DP, Orwat J, Wagner DE, Shuman V, Tolliver R: The Housing First model (HFM) Fidelity Index: designing and testing a tool for measuring integrity of housing programs that serve active substance users.Subst Abuse Treat Prev Policy 2013, 8:16., Watson DP, Orwat J, Wagner DE, Shuman V, Tolliver R: The Housing First model (HFM) Fidelity Index: designing and testing a tool for measuring integrity of housing programs that serve active substance users.Subst Abuse Treat Prev Policy 2013, 8:16.,
22.
go back to reference Watson DP, George CC: Evaluation of the Midwest Harm Reduction Institute's harm reduction housing training and technical assistance program. 2009, Center for Urban Research and Learning, Loyola University Chicago, Chicago, IL Watson DP, George CC: Evaluation of the Midwest Harm Reduction Institute's harm reduction housing training and technical assistance program. 2009, Center for Urban Research and Learning, Loyola University Chicago, Chicago, IL
23.
go back to reference Klein KJ, Knight AP: Innovation implementation. Curr Dir Psychol Sci. 2005, 14: 243-246. 10.1111/j.0963-7214.2005.00373.x.CrossRef Klein KJ, Knight AP: Innovation implementation. Curr Dir Psychol Sci. 2005, 14: 243-246. 10.1111/j.0963-7214.2005.00373.x.CrossRef
24.
go back to reference Derouin RE, Fritzsche BA, Salas E: E-learning in organizations. J Air Waste Manage Assoc. 2005, 31: 920-940. Derouin RE, Fritzsche BA, Salas E: E-learning in organizations. J Air Waste Manage Assoc. 2005, 31: 920-940.
25.
go back to reference Means B, Yukie T, Murphy R, Bakia M, Jones K: Evaluation of evidence-based practices in online learning: a meta-analysis and review of online learning studies evaluation. 2010, U.S. Department of Education, Office of Planning, Evaluation, and Policy Development, Washington, D.C Means B, Yukie T, Murphy R, Bakia M, Jones K: Evaluation of evidence-based practices in online learning: a meta-analysis and review of online learning studies evaluation. 2010, U.S. Department of Education, Office of Planning, Evaluation, and Policy Development, Washington, D.C
26.
go back to reference Miller L: ASTD 2012 State of the industry report: organizations continue to invest in workplace learning. 2012, ASTD Press, Alexandria, VA Miller L: ASTD 2012 State of the industry report: organizations continue to invest in workplace learning. 2012, ASTD Press, Alexandria, VA
27.
go back to reference Burnes B, Jackson P: Success and failure in organizational change: an exploration of the role of values. J Chang Manage. 2011, 11: 133-162. 10.1080/14697017.2010.524655.CrossRef Burnes B, Jackson P: Success and failure in organizational change: an exploration of the role of values. J Chang Manage. 2011, 11: 133-162. 10.1080/14697017.2010.524655.CrossRef
28.
go back to reference Anderson T: Towards a theory of online learning. Theory and Practice of Online Learning. 2008, 45-74. Anderson T: Towards a theory of online learning. Theory and Practice of Online Learning. 2008, 45-74.
29.
go back to reference Swan K: A constructivist model for thinking about learning online. Elements of Quality Online Education: Engaging Communities, Wisdom from the Sloan Consortium. Edited by: Bourne J, Moore J. 2005, Sloan Consortium, Needham, MA, 13-30. Swan K: A constructivist model for thinking about learning online. Elements of Quality Online Education: Engaging Communities, Wisdom from the Sloan Consortium. Edited by: Bourne J, Moore J. 2005, Sloan Consortium, Needham, MA, 13-30.
30.
go back to reference Bransford JD, Brown A, Cocking R: How people learn: mind, brain, experience, and school. 1999, National Academies Press, Washington DC Bransford JD, Brown A, Cocking R: How people learn: mind, brain, experience, and school. 1999, National Academies Press, Washington DC
31.
go back to reference Chaudoir SR, Dugan AG, Barr CH: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.Implement Sci 2013, 8:22., Chaudoir SR, Dugan AG, Barr CH: Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures.Implement Sci 2013, 8:22.,
32.
go back to reference Bond GR, Drake RE, McHugo GJ, Rapp CA, Whitley R: Strategies for improving fidelity in the national evidence-based practices project. Res Soc Wor Prac. 2009, 19: 569-581. 10.1177/1049731509335531.CrossRef Bond GR, Drake RE, McHugo GJ, Rapp CA, Whitley R: Strategies for improving fidelity in the national evidence-based practices project. Res Soc Wor Prac. 2009, 19: 569-581. 10.1177/1049731509335531.CrossRef
33.
go back to reference Novak JD: Meaningful learning: the essential factor for conceptual change in limited or inappropriate propositional hierarchies leading to empowerment of learners. Sci Ed. 2002, 86: 548-571. 10.1002/sce.10032.CrossRef Novak JD: Meaningful learning: the essential factor for conceptual change in limited or inappropriate propositional hierarchies leading to empowerment of learners. Sci Ed. 2002, 86: 548-571. 10.1002/sce.10032.CrossRef
34.
go back to reference Allen MW: Designing Successful E-Learning: Forget what you Know about Instructional Design and do Something Interesting. 2011, Pfeiffer, San Francisco, CA Allen MW: Designing Successful E-Learning: Forget what you Know about Instructional Design and do Something Interesting. 2011, Pfeiffer, San Francisco, CA
35.
go back to reference Jonassen DH, Hernandez-Serrano J: Case-based reasoning and instructional design: using stories to support problem solving. ETR&D-Educ Tech Res. 2002, 50: 65-77. 10.1007/BF02504994.CrossRef Jonassen DH, Hernandez-Serrano J: Case-based reasoning and instructional design: using stories to support problem solving. ETR&D-Educ Tech Res. 2002, 50: 65-77. 10.1007/BF02504994.CrossRef
36.
go back to reference Becker DR, Drake RE, Bond GR, Nawaz S, Haslett WR, Martinez RA: Best practices: a national mental health learning collaborative on supported employment. Psychiatr Serv. 2011, 62: 704-706. 10.1176/appi.ps.62.7.704.CrossRefPubMed Becker DR, Drake RE, Bond GR, Nawaz S, Haslett WR, Martinez RA: Best practices: a national mental health learning collaborative on supported employment. Psychiatr Serv. 2011, 62: 704-706. 10.1176/appi.ps.62.7.704.CrossRefPubMed
37.
go back to reference Schouten LMT, Hulscher MEJL, Van Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. Brit Med J. 2008, 336: 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRefPubMedPubMedCentral Schouten LMT, Hulscher MEJL, Van Everdingen JJE, Huijsman R, Grol RPTM: Evidence for the impact of quality improvement collaboratives: systematic review. Brit Med J. 2008, 336: 1491-1494. 10.1136/bmj.39570.749884.BE.CrossRefPubMedPubMedCentral
38.
go back to reference Mayer RE: Applying the science of learning to medical education. Med Educ. 2010, 44: 543-549. 10.1111/j.1365-2923.2010.03624.x.CrossRefPubMed Mayer RE: Applying the science of learning to medical education. Med Educ. 2010, 44: 543-549. 10.1111/j.1365-2923.2010.03624.x.CrossRefPubMed
39.
go back to reference Kangas E, Kinnunen T: Applying user-centered design to mobile application development. Commun ACM. 2005, 48: 55-59. 10.1145/1070838.1070866.CrossRef Kangas E, Kinnunen T: Applying user-centered design to mobile application development. Commun ACM. 2005, 48: 55-59. 10.1145/1070838.1070866.CrossRef
40.
go back to reference Patton MQ: Qualitative Research and Evaluation Methods. 2002, Sage Publications, Thousand Oaks, CA Patton MQ: Qualitative Research and Evaluation Methods. 2002, Sage Publications, Thousand Oaks, CA
42.
go back to reference Hsieh H-F, Shannon SE: Three approaches to qualitative content analysis. Qual Health Res. 2005, 15: 1277-1288. 10.1177/1049732305276687.CrossRefPubMed Hsieh H-F, Shannon SE: Three approaches to qualitative content analysis. Qual Health Res. 2005, 15: 1277-1288. 10.1177/1049732305276687.CrossRefPubMed
43.
go back to reference Creswell JH, Plano Clark VL: Designing and Conducting Mixed Methods Research. 2011, Sage, Thousand Oaks, CA Creswell JH, Plano Clark VL: Designing and Conducting Mixed Methods Research. 2011, Sage, Thousand Oaks, CA
44.
go back to reference Helfrich CD, Li Y-F, Sharp ND, Sales AE: Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework.Implement Sci 2009, 4:38., Helfrich CD, Li Y-F, Sharp ND, Sales AE: Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework.Implement Sci 2009, 4:38.,
45.
go back to reference Holgado Tello FP, Chacón Moscoso S, Barbero García I, Sanduvete Chaves S: Training satisfaction rating scale: development of a measurement model using polychoric correlations. Eur J Psychol Assess. 2006, 22: 268-279. 10.1027/1015-5759.22.4.268.CrossRef Holgado Tello FP, Chacón Moscoso S, Barbero García I, Sanduvete Chaves S: Training satisfaction rating scale: development of a measurement model using polychoric correlations. Eur J Psychol Assess. 2006, 22: 268-279. 10.1027/1015-5759.22.4.268.CrossRef
46.
go back to reference Chamberlain P, Brown CH, Saldana L: Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC).Implement Sci 2011, 6:116., Chamberlain P, Brown CH, Saldana L: Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC).Implement Sci 2011, 6:116.,
47.
go back to reference Saldana L, Chamberlain P, Wang W, Hendricks Brown C: Predicting program start-up using the stages of implementation measure. Adm Policy Ment Health. 2012, 39: 419-425. 10.1007/s10488-011-0363-y.CrossRefPubMedPubMedCentral Saldana L, Chamberlain P, Wang W, Hendricks Brown C: Predicting program start-up using the stages of implementation measure. Adm Policy Ment Health. 2012, 39: 419-425. 10.1007/s10488-011-0363-y.CrossRefPubMedPubMedCentral
48.
go back to reference Aarons GA: Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004, 6: 61-74. 10.1023/B:MHSR.0000024351.12294.65.CrossRefPubMedPubMedCentral Aarons GA: Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004, 6: 61-74. 10.1023/B:MHSR.0000024351.12294.65.CrossRefPubMedPubMedCentral
49.
go back to reference Yin RK: Case Study Research: Design and Methods. 2008, Sage, Thousand Oaks, CA Yin RK: Case Study Research: Design and Methods. 2008, Sage, Thousand Oaks, CA
50.
go back to reference Eisenhardt KM, Graebner ME: Theory building from cases: opportunities and challenges. Acad Manage J. 2007, 50: 25-32. 10.5465/AMJ.2007.24160888.CrossRef Eisenhardt KM, Graebner ME: Theory building from cases: opportunities and challenges. Acad Manage J. 2007, 50: 25-32. 10.5465/AMJ.2007.24160888.CrossRef
51.
go back to reference Corbin JM, Strauss AL: Grounded theory research: procedures, canons, and evaluative criteria. Qual Sociol. 1990, 13: 3-21. 10.1007/BF00988593.CrossRef Corbin JM, Strauss AL: Grounded theory research: procedures, canons, and evaluative criteria. Qual Sociol. 1990, 13: 3-21. 10.1007/BF00988593.CrossRef
52.
go back to reference Saldana L, Chamberlain P: Supporting implementation: the role of community development teams to build infrastructure. Am J Community Psychol. 2012, 50: 334-346. 10.1007/s10464-012-9503-0.CrossRefPubMedPubMedCentral Saldana L, Chamberlain P: Supporting implementation: the role of community development teams to build infrastructure. Am J Community Psychol. 2012, 50: 334-346. 10.1007/s10464-012-9503-0.CrossRefPubMedPubMedCentral
Metadata
Title
Development and testing of an implementation strategy for a complex housing intervention: protocol for a mixed methods study
Authors
Dennis P Watson
Jeani Young
Emily Ahonen
Huiping Xu
Macey Henderson
Valery Shuman
Randi Tolliver
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-014-0138-4

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue