Skip to main content
Top
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

Process evaluation of five tailored programs to improve the implementation of evidence-based recommendations for chronic conditions in primary care

Authors: C. Jäger, J. Steinhäuser, T. Freund, R. Baker, S. Agarwal, M. Godycki-Cwirko, A. Kowalczyk, E. Aakhus, I. Granlund, J. van Lieshout, J. Szecsenyi, M. Wensing

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Although there is evidence that tailored implementation strategies can be effective, there is little evidence on which methods of tailoring improve the effect. We designed and evaluated five tailored programs (TPs) each consisting of various strategies. The aim of this study was to examine (a) how determinants of practice prioritized in the design phase of the TPs were perceived by health care professionals who had been exposed to the TPs and whether they suggested other important determinants of practice and (b) how professionals used the offered strategies and whether they suggested other strategies that might have been more effective.

Methods

We conducted a mixed-method process evaluation linked to five cluster-randomized trials carried out in five European countries to implement recommendations for five chronic conditions in primary care settings. The five TPs used a total of 28 strategies which aimed to address 38 determinants of practice. Interviews of professionals in the intervention groups and a survey of professionals in the intervention and control groups were performed. Data collection was conducted by each research team in the respective national language. The interview data were first analyzed inductively by each research team, and subsequently, a meta-synthesis was conducted. The survey was analyzed descriptively.

Results

We conducted 71 interviews; 125 professionals completed the survey. The survey showed that 76 % (n = 29) of targeted determinants of practice were perceived as relevant and 95 % (n = 36) as being modified by the implementation interventions by 66 to 100 % of professionals. On average, 47 % of professionals reported using the strategies and 51 % considered them helpful, albeit with substantial variance between countries and strategies. In the interviews, 89 determinants of practice were identified, of which 70 % (n = 62) had been identified and 45 % (n = 40) had been prioritized in the design phase. The interviewees suggested 65 additional strategies, of which 54 % (n = 35) had been identified and 20 % (n = 13) had been prioritized, but not selected in the final programs.

Conclusions

This study largely confirmed the perceived relevance of the targeted determinants of practice. This contrasts with the fact that no impact of the trials on the implementation of the recommendations could be observed. The findings suggest that better methods for prioritization of determinants and strategies are needed.

Trial registration

Each of the five trials was registered separately in recognized trial registries. Details are given in the respective trial outcome papers.
Appendix
Available only for authorised users
Literature
1.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;4:CD005470. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;4:CD005470.
3.
go back to reference Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.CrossRefPubMedPubMedCentral Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35.CrossRefPubMedPubMedCentral
5.
go back to reference Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51.PubMedPubMedCentral Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51.PubMedPubMedCentral
6.
go back to reference Leeman J, Baernholdt M, Sandelowski M. Developing a theory-based taxonomy of methods for implementing change in practice. J Adv Nurs. 2007;58(2):191–200.CrossRefPubMed Leeman J, Baernholdt M, Sandelowski M. Developing a theory-based taxonomy of methods for implementing change in practice. J Adv Nurs. 2007;58(2):191–200.CrossRefPubMed
7.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed
8.
go back to reference Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.CrossRefPubMedPubMedCentral Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.CrossRefPubMedPubMedCentral
9.
go back to reference Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.CrossRefPubMed Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.CrossRefPubMed
10.
go back to reference Bosch M, van der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRefPubMed Bosch M, van der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract. 2007;13(2):161–8.CrossRefPubMed
11.
go back to reference Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, et al. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implement Sci. 2011;6:103.CrossRefPubMedPubMedCentral Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, et al. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implement Sci. 2011;6:103.CrossRefPubMedPubMedCentral
12.
go back to reference Huntink E, van Lieshout J, Aakhus E, Baker R, Flottorp S, Godycki-Cwirko M, et al. Stakeholders inverted question mark contributions to tailored implementation programs: an observational study of group interview methods. Implement Sci. 2014;9(1):185.CrossRefPubMedPubMedCentral Huntink E, van Lieshout J, Aakhus E, Baker R, Flottorp S, Godycki-Cwirko M, et al. Stakeholders inverted question mark contributions to tailored implementation programs: an observational study of group interview methods. Implement Sci. 2014;9(1):185.CrossRefPubMedPubMedCentral
13.
go back to reference Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants of care for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102.CrossRefPubMedPubMedCentral Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants of care for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102.CrossRefPubMedPubMedCentral
14.
go back to reference Wensing M, Huntink E, van Lieshout J, Godycki-Cwirko M, Kowalczyk A, Jager C, et al. Tailored implementation of evidence-based practice for patients with chronic diseases. PLoS One. 2014;9(7):e101981.CrossRefPubMedPubMedCentral Wensing M, Huntink E, van Lieshout J, Godycki-Cwirko M, Kowalczyk A, Jager C, et al. Tailored implementation of evidence-based practice for patients with chronic diseases. PLoS One. 2014;9(7):e101981.CrossRefPubMedPubMedCentral
15.
go back to reference Aakhus E, Granlund I, Odgaard-Jensen J, Oxman AD, Flottorp SA. A tailored intervention to implement guideline recommendations for elderly patients with depression in primary care: a pragmatic cluster randomised trial. Implement Sci. 2016 Mar 9;11:32. doi:10.1186/s13012-016-0397-3. Aakhus E, Granlund I, Odgaard-Jensen J, Oxman AD, Flottorp SA. A tailored intervention to implement guideline recommendations for elderly patients with depression in primary care: a pragmatic cluster randomised trial. Implement Sci. 2016 Mar 9;11:32. doi:10.​1186/​s13012-016-0397-3.
16.
go back to reference Goodfellow J, Agarwal S, Harrad F, Shepherd D, Morris T, Ring A, Walker N, Rogers S, Baker R. Cluster randomised trial of a tailored intervention to improve the management of overweight and obesity in primary care in England. Implement Sci. 2016 May 27;11(1):77. doi:10.1186/s13012-016-0441-3. Goodfellow J, Agarwal S, Harrad F, Shepherd D, Morris T, Ring A, Walker N, Rogers S, Baker R. Cluster randomised trial of a tailored intervention to improve the management of overweight and obesity in primary care in England. Implement Sci. 2016 May 27;11(1):77. doi:10.​1186/​s13012-016-0441-3.
17.
go back to reference Jan van Lieshout, Elke Huntink, Jan Koetsenruijter, Michel Wensing. Tailored implementation of cardiovascular risk management in general practice: a cluster randomized trial. Implementation Science 2016 11:115. doi:10.1186/s13012-016-0460-0. Jan van Lieshout, Elke Huntink, Jan Koetsenruijter, Michel Wensing. Tailored implementation of cardiovascular risk management in general practice: a cluster randomized trial. Implementation Science 2016 11:115. doi:10.​1186/​s13012-016-0460-0.
18.
go back to reference Aakhus E, Granlund I, Odgaard-Jensen J, Wensing M, Oxman AD, Flottorp SA. Tailored interventions to implement recommendations for elderly patients with depression in primary care: a study protocol for a pragmatic cluster randomised controlled trial. Trials. 2014;15:16.CrossRefPubMedPubMedCentral Aakhus E, Granlund I, Odgaard-Jensen J, Wensing M, Oxman AD, Flottorp SA. Tailored interventions to implement recommendations for elderly patients with depression in primary care: a study protocol for a pragmatic cluster randomised controlled trial. Trials. 2014;15:16.CrossRefPubMedPubMedCentral
19.
go back to reference Godycki-Cwirko M, Zakowska I, Kosiek K, Wensing M, Krawczyk J, Kowalczyk A. Evaluation of a tailored implementation strategy to improve the management of patients with chronic obstructive pulmonary disease in primary care: a study protocol of a cluster randomized trial. Trials. 2014;15:109.CrossRefPubMedPubMedCentral Godycki-Cwirko M, Zakowska I, Kosiek K, Wensing M, Krawczyk J, Kowalczyk A. Evaluation of a tailored implementation strategy to improve the management of patients with chronic obstructive pulmonary disease in primary care: a study protocol of a cluster randomized trial. Trials. 2014;15:109.CrossRefPubMedPubMedCentral
20.
go back to reference Huntink E, Heijmans N, Wensing M, van Lieshout J. Effectiveness of a tailored intervention to improve cardiovascular risk management in primary care: study protocol for a randomised controlled trial. Trials. 2013;14:433.CrossRefPubMedPubMedCentral Huntink E, Heijmans N, Wensing M, van Lieshout J. Effectiveness of a tailored intervention to improve cardiovascular risk management in primary care: study protocol for a randomised controlled trial. Trials. 2013;14:433.CrossRefPubMedPubMedCentral
21.
go back to reference Jager C, Freund T, Steinhauser J, Joos S, Wensing M, Szecsenyi J. A tailored implementation intervention to implement recommendations addressing polypharmacy in multimorbid patients: study protocol of a cluster randomized controlled trial. Trials. 2013;14:420.CrossRefPubMedPubMedCentral Jager C, Freund T, Steinhauser J, Joos S, Wensing M, Szecsenyi J. A tailored implementation intervention to implement recommendations addressing polypharmacy in multimorbid patients: study protocol of a cluster randomized controlled trial. Trials. 2013;14:420.CrossRefPubMedPubMedCentral
22.
go back to reference Krause J, Agarwal S, Bodicoat DH, Ring A, Shepherd D, Rogers S, et al. Evaluation of a tailored intervention to improve management of overweight and obesity in primary care: study protocol of a cluster randomised controlled trial. Trials. 2014;15:82.CrossRefPubMedPubMedCentral Krause J, Agarwal S, Bodicoat DH, Ring A, Shepherd D, Rogers S, et al. Evaluation of a tailored intervention to improve management of overweight and obesity in primary care: study protocol of a cluster randomised controlled trial. Trials. 2014;15:82.CrossRefPubMedPubMedCentral
23.
go back to reference Jager C, Freund T, Steinhauser J, Aakhus E, Flottorp S, Godycki-Cwirko M, et al. Tailored Implementation for Chronic Diseases (TICD): a protocol for process evaluation in cluster randomized controlled trials in five European countries. Trials. 2014;15:87.CrossRefPubMedPubMedCentral Jager C, Freund T, Steinhauser J, Aakhus E, Flottorp S, Godycki-Cwirko M, et al. Tailored Implementation for Chronic Diseases (TICD): a protocol for process evaluation in cluster randomized controlled trials in five European countries. Trials. 2014;15:87.CrossRefPubMedPubMedCentral
27.
go back to reference Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7:35.CrossRefPubMedPubMedCentral Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7:35.CrossRefPubMedPubMedCentral
28.
go back to reference Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.CrossRefPubMedPubMedCentral Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.CrossRefPubMedPubMedCentral
29.
go back to reference French SD, Green SE, O'Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38.CrossRefPubMedPubMedCentral French SD, Green SE, O'Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci. 2012;7:38.CrossRefPubMedPubMedCentral
30.
go back to reference Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673–93.CrossRefPubMed Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673–93.CrossRefPubMed
31.
go back to reference Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42.CrossRefPubMedPubMedCentral Porcheret M, Main C, Croft P, McKinley R, Hassell A, Dziedzic K. Development of a behaviour change intervention: a case study on the practical application of theory. Implement Sci. 2014;9(1):42.CrossRefPubMedPubMedCentral
32.
go back to reference Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.CrossRefPubMedPubMedCentral Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40.CrossRefPubMedPubMedCentral
33.
go back to reference Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci. 2013;8:32.CrossRefPubMedPubMedCentral Mazza D, Bairstow P, Buchan H, Chakraborty SP, Van Hecke O, Grech C, et al. Refining a taxonomy for guideline implementation: results of an exercise in abstract classification. Implement Sci. 2013;8:32.CrossRefPubMedPubMedCentral
34.
go back to reference Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, McKibbon KA, Peters GJ, Stevens KR, Wilson MG, Grimshaw J. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51. doi:10.1186/1748-5908-9-51.PubMedPubMedCentral Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, McKibbon KA, Peters GJ, Stevens KR, Wilson MG, Grimshaw J. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51. doi:10.​1186/​1748-5908-9-51.PubMedPubMedCentral
Metadata
Title
Process evaluation of five tailored programs to improve the implementation of evidence-based recommendations for chronic conditions in primary care
Authors
C. Jäger
J. Steinhäuser
T. Freund
R. Baker
S. Agarwal
M. Godycki-Cwirko
A. Kowalczyk
E. Aakhus
I. Granlund
J. van Lieshout
J. Szecsenyi
M. Wensing
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-016-0473-8

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue