Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Care | Research article

Pace and determinants of implementation of the self-management of well-being group intervention: a multilevel observational study

Authors: Daphne Kuiper, Nardi Steverink, Roy E. Stewart, Sijmen A. Reijneveld, Robbert Sanderman, Martine M. Goedendorp

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

When implementing an empirically supported intervention (ESI) arrays of influencing factors operate on the professional and organizational level, but so far dependency between these levels has often been ignored. The aim of this study is to describe the pace and identify determinants of implementation of the Self-Management of Well-being (SMW) group intervention while taking the dependency between professionals and organizations into account.

Methods

Pace of implementation was measured as the time between training of professionals and first use of the SMW intervention in months. Determinants of first use were derived from the Fleuren framework and assessed using web-based questionnaires and telephone interviews. First, univariate analyses, Fisher’s exact tests and t-tests, were performed to identify determinants of first use of the SMW intervention on the individual professional and the organizational level independently. Second, multilevel analyses were performed to correct for the dependency between professionals and organizations. Simple multilevel logistic regression analyses were performed with determinants found significant in the univariate analyses as independent variables, first use as dependent variable, professionals entered in the first level, and organizations in the second level.

Results

Forty-eight professionals from 18 organizations were trained to execute the SMW intervention. Thirty-two professionals achieved first use, at a mean pace of 7.5 months ± 4.2. Determinants on the professional level were ‘ownership’, ‘relative advantage’, ‘support from colleagues’ and ‘compatibility’. Determinants on the organizational level were ‘organizational size’ and ‘innovation-task orientation fit’. Multilevel analysis showed that ‘compatibility’, a factor on the professional level, was the only significant determinant contributing to first use in the multilevel model.

Conclusions

This implementation study revealed a strong dependency between professionals and organizations. Results showed that a majority of professionals used the SMW intervention in about 8 months. When the dependency between professionals and organization was taken into account, the professionals’ perception of compatibility was the only remaining determinant of implementation on the professional level. Organizational size and managers’ perception of ‘innovation-task orientation fit’ were determinants of implementation on the organizational level. It is advisable to discuss the compatibility between new and current tasks among managers and professionals before adopting a new intervention.
Appendix
Available only for authorised users
Footnotes
1
In former publications the SMW interventions were also referred to as “GRIP and GLEAM (G&G) interventions”.
 
Literature
1.
go back to reference Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6 Suppl):S57–60.PubMed Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6 Suppl):S57–60.PubMed
2.
go back to reference Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3–4):171–81.CrossRef Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell K, Stillman L, Blachman M, Dunville R, Saul J. Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008;41(3–4):171–81.CrossRef
3.
go back to reference Backer TE. The failure of success: challenges of disseminating effective substance abuse prevention programs. J Community Psychol. 2000;28(3):363–73.CrossRef Backer TE. The failure of success: challenges of disseminating effective substance abuse prevention programs. J Community Psychol. 2000;28(3):363–73.CrossRef
4.
go back to reference Goodman RM. Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000;28(3):309–21.CrossRef Goodman RM. Bridging the gap in effective program implementation: from concept to application. J Community Psychol. 2000;28(3):309–21.CrossRef
5.
go back to reference Boren SA, Balas EA. Evidence-based quality measurement. J Ambul Care Manage. 1999;22(3):17–23.CrossRef Boren SA, Balas EA. Evidence-based quality measurement. J Ambul Care Manage. 1999;22(3):17–23.CrossRef
6.
go back to reference Palinkas LA, Soydan H. New horizons of translational research and research translation in social work. Res Soc Work Pract. 2012;22(1):85–92.CrossRef Palinkas LA, Soydan H. New horizons of translational research and research translation in social work. Res Soc Work Pract. 2012;22(1):85–92.CrossRef
8.
go back to reference Kremers IP, Steverink N, Albersnagel FA, Slaets JP. Improved self-management ability and well-being in older women after a short group intervention. Aging Ment Health. 2006;10(5):476–84.CrossRef Kremers IP, Steverink N, Albersnagel FA, Slaets JP. Improved self-management ability and well-being in older women after a short group intervention. Aging Ment Health. 2006;10(5):476–84.CrossRef
9.
go back to reference Frieswijk N, Steverink N, Buunk BP, Slaets JP. The effectiveness of a bibliotherapy in increasing the self-management ability of slightly to moderately frail older people. Patient Educ Couns. 2006;61(2):219–27.CrossRef Frieswijk N, Steverink N, Buunk BP, Slaets JP. The effectiveness of a bibliotherapy in increasing the self-management ability of slightly to moderately frail older people. Patient Educ Couns. 2006;61(2):219–27.CrossRef
10.
go back to reference Masi CM, Chen H, Hawkley LC, Cacioppo JT. A meta-analysis of interventions to reduce loneliness. Personal Soc Psychol Rev. 2011;15(3):219–66.CrossRef Masi CM, Chen H, Hawkley LC, Cacioppo JT. A meta-analysis of interventions to reduce loneliness. Personal Soc Psychol Rev. 2011;15(3):219–66.CrossRef
11.
go back to reference Goedendorp MM, Kuiper D, Reijneveld SA, Sanderman R, Steverink N. Sustaining program effectiveness after implementation: the case of the self-management of well-being group intervention for older adults. Patient Educ Couns. 2017;100(6):1177–84.CrossRef Goedendorp MM, Kuiper D, Reijneveld SA, Sanderman R, Steverink N. Sustaining program effectiveness after implementation: the case of the self-management of well-being group intervention for older adults. Patient Educ Couns. 2017;100(6):1177–84.CrossRef
12.
go back to reference Valtorta N, Hanratty B. Loneliness, isolation and the health of older adults: do we need a new research agenda? JRSM. 2012;105(12):518–22.CrossRef Valtorta N, Hanratty B. Loneliness, isolation and the health of older adults: do we need a new research agenda? JRSM. 2012;105(12):518–22.CrossRef
13.
go back to reference Beekman A, Copeland J, Prince MJ. Review of community prevalence of depression in later life. Brit J Psychiat. 1999;174(4):307–11.CrossRef Beekman A, Copeland J, Prince MJ. Review of community prevalence of depression in later life. Brit J Psychiat. 1999;174(4):307–11.CrossRef
15.
go back to reference Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Admin Pol Ment Health. 2009;36(1):24–34.CrossRef Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Admin Pol Ment Health. 2009;36(1):24–34.CrossRef
16.
go back to reference Custers EJ. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ. 2010;15(1):109–28.CrossRef Custers EJ. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ. 2010;15(1):109–28.CrossRef
17.
go back to reference Sanders MR, Prinz RJ, Shapiro CJ. Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Adm Policy Ment Hlth. 2009;36(2):133–43.CrossRef Sanders MR, Prinz RJ, Shapiro CJ. Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Adm Policy Ment Hlth. 2009;36(2):133–43.CrossRef
18.
go back to reference Fixsen DL, Naoom SF, Blase KA, Wallace F. Implementation: the missing link between research and practice. Winter/Spring: APSAC Advisor Excerpt; 2007. Fixsen DL, Naoom SF, Blase KA, Wallace F. Implementation: the missing link between research and practice. Winter/Spring: APSAC Advisor Excerpt; 2007.
19.
go back to reference Stith S, Pruitt I, Dees J, Fronce M, Green N, Som A, Linkh D. Implementing community-based prevention programming: a review of the literature. J Prim Prev. 2006;27(6):599–617.CrossRef Stith S, Pruitt I, Dees J, Fronce M, Green N, Som A, Linkh D. Implementing community-based prevention programming: a review of the literature. J Prim Prev. 2006;27(6):599–617.CrossRef
20.
go back to reference Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la parte Florida mental health institute, The National Implementation Research Network; 2005. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa: University of South Florida, Louis de la parte Florida mental health institute, The National Implementation Research Network; 2005.
21.
go back to reference Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004;16(2):107–23.CrossRef Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004;16(2):107–23.CrossRef
22.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRef Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRef
23.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRef Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRef
24.
go back to reference Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.CrossRef Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practice: models for dissemination and implementation research. Am J Prev Med. 2012;43(3):337–50.CrossRef
25.
go back to reference McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, Benedict AJ, Hamilton AB, Rose AJ. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15(1):62.CrossRef McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, Benedict AJ, Hamilton AB, Rose AJ. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15(1):62.CrossRef
26.
go back to reference Kuiper D, Goedendorp MM, Sanderman R, Reijneveld SA, Steverink N. Identifying the determinants of use of the G&G interventions for older adults in health and social care: protocol of a multilevel approach. BMC Res Notes. 2015;8:296.CrossRef Kuiper D, Goedendorp MM, Sanderman R, Reijneveld SA, Steverink N. Identifying the determinants of use of the G&G interventions for older adults in health and social care: protocol of a multilevel approach. BMC Res Notes. 2015;8:296.CrossRef
27.
go back to reference Steverink N, Lindenberg S, Slaets JP. How to understand and improve older people's self-management of well-being. Eur J Ageing. 2005;2:235–44.CrossRef Steverink N, Lindenberg S, Slaets JP. How to understand and improve older people's self-management of well-being. Eur J Ageing. 2005;2:235–44.CrossRef
29.
go back to reference Fleuren M, Wiefferink K, Paulussen T. Checklist determinanten van innovaties in gezondheidszorgorganisaties. TSG. 2010;88(2):51–4.CrossRef Fleuren M, Wiefferink K, Paulussen T. Checklist determinanten van innovaties in gezondheidszorgorganisaties. TSG. 2010;88(2):51–4.CrossRef
30.
go back to reference Nunnally JC, Bernstein IH, ten Berge JMF. Psychometric theory. New York: McGraw-Hill; 1967. Nunnally JC, Bernstein IH, ten Berge JMF. Psychometric theory. New York: McGraw-Hill; 1967.
31.
go back to reference Muthén LK, Muthén BO. Mplus: The comprehensive modelling program for applied researchers: User’s guide, 5. Los Angeles: Muthén & Muthén; 2012. Muthén LK, Muthén BO. Mplus: The comprehensive modelling program for applied researchers: User’s guide, 5. Los Angeles: Muthén & Muthén; 2012.
32.
go back to reference Paccagnella O. Sample size and accuracy of estimates in multilevel models, new simulations results. Methodology. 2011;7(3):111–20.CrossRef Paccagnella O. Sample size and accuracy of estimates in multilevel models, new simulations results. Methodology. 2011;7(3):111–20.CrossRef
33.
go back to reference Asgary-Eden V, Lee CM. So now we’ve picked an evidence-based program, what’s next? Perspectives of service providers and administrators. Prof Psychol Res Pr. 2011;42(2):169–75.CrossRef Asgary-Eden V, Lee CM. So now we’ve picked an evidence-based program, what’s next? Perspectives of service providers and administrators. Prof Psychol Res Pr. 2011;42(2):169–75.CrossRef
34.
go back to reference Asgary-Eden V, Lee CM. Implementing an evidence-based parenting program in community agencies: what helps and what gets in the way? Adm Policy Ment Hlth. 2012;39(6):478–88.CrossRef Asgary-Eden V, Lee CM. Implementing an evidence-based parenting program in community agencies: what helps and what gets in the way? Adm Policy Ment Hlth. 2012;39(6):478–88.CrossRef
35.
go back to reference DeGroff A, Holden D, Goode Green S, Boehm J, Seeff LC, Tangka F. Start-up of the colorectal cancer screening demonstration program. Prev Chronic Dis. 2008;5(2):A38.PubMedPubMedCentral DeGroff A, Holden D, Goode Green S, Boehm J, Seeff LC, Tangka F. Start-up of the colorectal cancer screening demonstration program. Prev Chronic Dis. 2008;5(2):A38.PubMedPubMedCentral
36.
go back to reference Bigham BL, Koprowicz K, Aufderheide TP, Davis DP, Donn S, Powell J, Suffoletto B, Nafziger S, Stouffer J, Idris A. Delayed prehospital implementation of the 2005 American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiac care. Prehosp Emerg Care. 2010;14(3):355–60.CrossRef Bigham BL, Koprowicz K, Aufderheide TP, Davis DP, Donn S, Powell J, Suffoletto B, Nafziger S, Stouffer J, Idris A. Delayed prehospital implementation of the 2005 American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiac care. Prehosp Emerg Care. 2010;14(3):355–60.CrossRef
37.
go back to reference Hall RK, Wang V, Jackson GL, Hammill BG, Maciejewski ML, Yano EM, Svetkey LP, Patel UD. Implementation of automated reporting of estimated glomerular filtration rate among veterans affairs laboratories: a retrospective study. BMC Med Inform Decis. 2012;12(1):69.CrossRef Hall RK, Wang V, Jackson GL, Hammill BG, Maciejewski ML, Yano EM, Svetkey LP, Patel UD. Implementation of automated reporting of estimated glomerular filtration rate among veterans affairs laboratories: a retrospective study. BMC Med Inform Decis. 2012;12(1):69.CrossRef
38.
go back to reference van der Meer EWC, van der Gulden JWJ, van Dongen D, Boot CR, Anema JR. Barriers and facilitators in the implementation of recommendations for hand eczema prevention among healthcare workers. Contact Derm. 2015;72(5):325–36.CrossRef van der Meer EWC, van der Gulden JWJ, van Dongen D, Boot CR, Anema JR. Barriers and facilitators in the implementation of recommendations for hand eczema prevention among healthcare workers. Contact Derm. 2015;72(5):325–36.CrossRef
39.
go back to reference van der Stege HA, van Staa A, Hilberink SR, Visser AP. Using the new board game SeCZ TaLK to stimulate the communication on sexual health for adolescents with chronic conditions. Patient Educ Couns. 2010;81(3):324–31.CrossRef van der Stege HA, van Staa A, Hilberink SR, Visser AP. Using the new board game SeCZ TaLK to stimulate the communication on sexual health for adolescents with chronic conditions. Patient Educ Couns. 2010;81(3):324–31.CrossRef
40.
go back to reference Nilsen P. Making sense of implementation theories. models and frameworks Implement Sci. 2015;10(1):53.CrossRef Nilsen P. Making sense of implementation theories. models and frameworks Implement Sci. 2015;10(1):53.CrossRef
41.
go back to reference Doran D, Haynes BR, Estabrooks CA, Kushniruk A, Dubrowski A, Bajnok I, Hall LM, Li M, Carryer J, Jedras D. The role of organizational context and individual nurse characteristics in explaining variation in use of information technologies in evidence based practice. Implement Sci. 2012;7(1):122.CrossRef Doran D, Haynes BR, Estabrooks CA, Kushniruk A, Dubrowski A, Bajnok I, Hall LM, Li M, Carryer J, Jedras D. The role of organizational context and individual nurse characteristics in explaining variation in use of information technologies in evidence based practice. Implement Sci. 2012;7(1):122.CrossRef
42.
go back to reference Gagnon M, Simonyan D, Ghandour EK, Godin G, Labrecque M, Ouimet M, Rousseau M. Factors influencing electronic health record adoption by physicians: a multilevel analysis. Int J Inf Manag. 2016;36(3):258–70.CrossRef Gagnon M, Simonyan D, Ghandour EK, Godin G, Labrecque M, Ouimet M, Rousseau M. Factors influencing electronic health record adoption by physicians: a multilevel analysis. Int J Inf Manag. 2016;36(3):258–70.CrossRef
43.
go back to reference Estabrooks CA, Midodzi WK, Cummings GG, Wallin L. Predicting research use in nursing organizations: a multilevel analysis. Nurs Res. 2007;56(4 Suppl):S7–23.CrossRef Estabrooks CA, Midodzi WK, Cummings GG, Wallin L. Predicting research use in nursing organizations: a multilevel analysis. Nurs Res. 2007;56(4 Suppl):S7–23.CrossRef
44.
go back to reference Estabrooks CA, Squires JE, Hayduk L, Morgan D, Cummings GG, Ginsburg L, Stewart N, McGilton K, Kang SH, Norton PG. The influence of organizational context on best practice use by care aides in residential long-term care settings. J Am Med Dir Assoc 2015;16(6):537; doi:org/10.1016/j.jamda.2015.03.009. Estabrooks CA, Squires JE, Hayduk L, Morgan D, Cummings GG, Ginsburg L, Stewart N, McGilton K, Kang SH, Norton PG. The influence of organizational context on best practice use by care aides in residential long-term care settings. J Am Med Dir Assoc 2015;16(6):537; doi:org/10.1016/j.jamda.2015.03.009.
45.
go back to reference Ahn H, Keyser D, Hayward-Everson RA. A multi-level analysis of individual and agency effects on implementation of family-centered practice in child welfare. Child Youth Serv Rev. 2016;69:11–8.CrossRef Ahn H, Keyser D, Hayward-Everson RA. A multi-level analysis of individual and agency effects on implementation of family-centered practice in child welfare. Child Youth Serv Rev. 2016;69:11–8.CrossRef
46.
go back to reference Kallestad JH, Olweus D. Predicting Teachers’ and Schools’ Implementation of the Olweus Bullying Prevention Program: A Multilevel Study. Prev Treat. 2003;6(1):21a. Kallestad JH, Olweus D. Predicting Teachers’ and Schools’ Implementation of the Olweus Bullying Prevention Program: A Multilevel Study. Prev Treat. 2003;6(1):21a.
47.
go back to reference Fleuren MA, Paulussen TG, Van Dommelen P, Van Buuren S. Towards a measurement instrument for determinants of innovations. Int J Qual Health Care. 2014;26(5):501–10.CrossRef Fleuren MA, Paulussen TG, Van Dommelen P, Van Buuren S. Towards a measurement instrument for determinants of innovations. Int J Qual Health Care. 2014;26(5):501–10.CrossRef
48.
go back to reference Jacobs SR, Weiner BJ, Reeve BB, Hofmann DA, Christian M, Weinberger M. Determining the predictors of innovation implementation in healthcare: a quantitative analysis of implementation effectiveness. BMC Health Serv Res. 2015;15(1):6.CrossRef Jacobs SR, Weiner BJ, Reeve BB, Hofmann DA, Christian M, Weinberger M. Determining the predictors of innovation implementation in healthcare: a quantitative analysis of implementation effectiveness. BMC Health Serv Res. 2015;15(1):6.CrossRef
49.
go back to reference van der Kleij RM, Crone MR, Paulussen TG, van de Gaar VM, Reis R. A stitch in time saves nine? A repeated cross-sectional case study on the implementation of the intersectoral community approach youth at a healthy weight. BMC Public Health. 2015;15(1):1032.CrossRef van der Kleij RM, Crone MR, Paulussen TG, van de Gaar VM, Reis R. A stitch in time saves nine? A repeated cross-sectional case study on the implementation of the intersectoral community approach youth at a healthy weight. BMC Public Health. 2015;15(1):1032.CrossRef
Metadata
Title
Pace and determinants of implementation of the self-management of well-being group intervention: a multilevel observational study
Authors
Daphne Kuiper
Nardi Steverink
Roy E. Stewart
Sijmen A. Reijneveld
Robbert Sanderman
Martine M. Goedendorp
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-3891-x

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue