Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Systematic review

Criteria for evaluating transferability of health interventions: a systematic review and thematic synthesis

Authors: Tamara Schloemer, Peter Schröder-Bäck

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Improving the public’s health in different countries requires the consideration of diverse health care systems and settings. For evidence-based public health, decision-makers need to consider the transferability of effective health interventions from a primary context to their specific target context. The aim of this systematic review was to develop a model for the assessment of transferability of health interventions through identification and systematization of influencing criteria, including facilitators and barriers.

Methods

A systematic literature search was performed in the databases PubMed, Embase, CINAHL, and PsycINFO. Articles were eligible if they were published in English or German and provided a description of transferability criteria. Included articles were ranked based on their thematic relevance and methodological support of transferability criteria. Using a qualitative approach, a thematic synthesis was conducted.

Results

Thirty-seven articles were included in the review. The thematic synthesis revealed 44 criteria, covered by 4 overarching themes, which influence transferability of health interventions: The population (P), the intervention (I), and the environment (E) represent 30 conditional transferability criteria, and the transfer of the intervention (T) represents 14 process criteria for transferring the intervention to the target context. Transferability (-T) depends on the dynamic interaction of conditional criteria in the primary and target context as well as on the process of transfer. The description of facilitators and barriers deepens the understanding of the criteria. The synthesis resulted in two related models: the conceptual PIET-T model explains the underlying mechanism of transferability of health interventions and the PIET-T process model provides practical guidance for a transferability assessment.

Conclusions

Transferability of health interventions is a complex concept, which needs systematic consideration of the primary and target context. It should be anticipated before and evaluated after an intervention is implemented in the target context. Therefore, decision-makers need systematic and practically relevant knowledge on transferability. The synthesized PIET-T conceptual and process models with systematized criteria, facilitators, and barriers are intended as a theoretical basis to determine transferability of health interventions. Further research is needed to develop a practical tool for the PIET-T models and to evaluate the tool’s usefulness for decision-making processes and intervention transfer.
Appendix
Available only for authorised users
Literature
1.
Brownson R, Baker E, Leet T, Gillespie K. Evidence-based public health. Oxford: Oxford University Press; 2003.
2.
Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30(1):175–201.CrossRefPubMed
3.
Brownson R, Gurney J, Land G. Evidence-based decision-making in public health. J Public Health Manag Pract. 1999;5:86–97.CrossRefPubMed
4.
Glasziou P, Longbottom H. Evidence-based public health practice. Aust N Z J Public Health. 1999;23:436–40.CrossRefPubMed
5.
Kohatsu N, Robinson J, Torner J. Evidence-based public health: an evolving concept. Am J Prev Med. 2004;27:417–21.PubMed
6.
7.
Burchett H, Umoquit M, Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Policy. 2011;16(4):238–44.CrossRefPubMed
8.
9.
10.
Wang S, Moss JR, Hiller JE. Applicability and transferability of interventions in evidence-based public health. Health Promot Int. 2006;21(1):76–83.CrossRefPubMed
11.
12.
13.
Goodman R, Bunnell R, Posner S. What is “community health”? Examining the meaning of an evolving field in public health. Prev Med. 2014;67(Suppl 1):58–61.CrossRef
14.
15.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50:585–92.CrossRefPubMed
16.
Muhlhausen DB. Evaluating Federal Social Programs: finding out what works and what does not. Res Soc Work Pract. 2012;22(1):100–7.CrossRef
17.
Weinmann S, Gühne U, Kösters M, Gaebel W, Becker T. Team-based community psychiatry: importance of context factors and transferability of evidence from studies [German]. Nervenarzt. 2012;83(7):825–31.CrossRefPubMed
18.
19.
Hallfors D, Cho H, Sanchez V, Khatapoush S, Kim HM, Bauer D. Efficacy vs effectiveness trial results of an indicated “model” substance abuse program: implications for public health. Am J Public Health. 2006;96(12):2254–9.CrossRefPubMedPubMedCentral
20.
Robertson E, David S, Rao S. Preventing drug use among children and adolescents: a research-based guide for parents, educators, and community leaders. Washington, DC: National Institute of Health, National Institute on Drug Abuse; 2003.
21.
Schinke S, Brounstein P, Gardner S. Science-based prevention programs and principles. Washington, DC: US Department of Health and Human Services; 2002.
22.
Killaspy H, Bebbington P, Blizard R, Johnson S, Nolan F, Pilling S, et al. The REACT study: randomised evaluation of assertive community treatment in North London. BMJ Clinical research ed. 2006;332(7545):815–20.CrossRefPubMedPubMedCentral
23.
Killaspy H, Kingett S, Bebbington P, Blizard R, Johnson S, Nolan F, et al. Randomised evaluation of assertive community treatment: 3-year outcomes. Br J Psychiatry. 2009;195(1):81–2.CrossRefPubMed
24.
Marshall M, Lockwood A. Assertive community treatment for people with severe mental disorders. The Cochrane Database of Systematic Reviews. 2000;2:CD001089.
25.
Perleth M. Assessment of the generalisability of clinical trial results in the Federal Joint Committee. [German]. Z Evid Fortbild Qual Gesundhwes. 2009;103(6):412–4.CrossRefPubMed
26.
Rychetnik L, Bauman A, Laws R, King L, Rissel C, Nutbeam D, et al. Translating research for evidence-based public health: key concepts and future directions. J Epidemiol Community Health. 2012;66(12):1187–92.CrossRefPubMed
27.
Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10(1):45–53.CrossRefPubMed
28.
Noblit GW, Meta-Ethnography HRD. Synthesizing qualitative studies. Newbury Park: Sage; 1988.
29.
30.
31.
Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12:181.CrossRefPubMedPubMedCentral
32.
Jackson N, Waters E. Criteria for the systematic review of health promotion and public health interventions. Health Promot Int. 2005;20(4):367–74.CrossRefPubMed
33.
Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ (Clinical research ed). 2005;331(7524):1064–5.CrossRef
34.
Rathbone J, Carter M, Hoffmann T, Glasziou P. Better duplicate detection for systematic reviewers: evaluation of systematic review assistant-deduplication module. Syst Rev. 2015;4:6.CrossRefPubMedPubMedCentral
35.
Dyrvig A-K, Kidholm K, Gerke O, Vondeling H. Checklists for external validity: a systematic review. J Eval Clin Pract. 2014;20(6):857–64.CrossRefPubMed
36.
Cruzes DS, Dyba T. Recommended steps for thematic synthesis in software engineering. International symposium on empirical software engineering and measurement (ESEM), 2011. Piscataway: IEEE; 2011. p. 275–84.
37.
Rychetnik L, Frommer M, Hawe P, Shiell A. Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002;56(2):119–27.CrossRefPubMedPubMedCentral
38.
Schoenwald SK, Hoagwood K. Effectiveness, transportability, and dissemination of interventions: what matters when? Psychiatr Serv. 2001;52(9):1190–7.CrossRefPubMed
39.
Watts P, Phillips G, Petticrew M, Harden A, Renton A. The influence of environmental factors on the generalisability of public health research evidence: physical activity as a worked example. Int J Behav Nutr Phys Act. 2011;8:128.CrossRefPubMedPubMedCentral
40.
Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011;89(2):167–205.CrossRefPubMedPubMedCentral
41.
Whitley R, Rousseau C, Carpenter-Song E, Kirmayer LJ. Evidence-based medicine: opportunities and challenges in a diverse society. Can J Psychiatr. 2011;56(9):514–22.CrossRef
42.
Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Community Psychol. 2009;43:267–76.CrossRefPubMed
43.
Pfadenhauer L, Mozygemba K, Gerhardus A, Hofman B, Booth A, Bakke Lysdahl K, et al. Context and implementation: a concept analysis towards conceptual maturity. Z Evid Fortbild Qual Gesundh wesen. 2015;109:103–14.CrossRef
44.
Pfadenhauer L, Gerhardus A, Mozygemba K, Bakke Lysdahl K, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the context and implementation of complex interventions (CICI) framework. Implement Sci. 2017;12:21.CrossRefPubMedPubMedCentral
45.
Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice?: rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93(8):1261–7.CrossRefPubMedPubMedCentral
46.
Kelly JA, Heckman TG, Stevenson LY, Williams PN, Ertl T, Hays RB, et al. Transfer of research-based HIV prevention interventions to community service providers: fidelity and adaptation. AIDS Educ Prev. 2000;12(Suppl 5):87–98.PubMed
47.
Carter M, Karwalajtys T, Chambers L, Kaczorowski J, Dolovich L, Gierman T, et al. Implementing a standardized community-based cardiovascular risk assessment program in 20 Ontario communities. Health Promot Int. 2009;24(4):325–33.CrossRefPubMed
48.
Pearson M, Parkin S, Coomber R. Generalizing applied qualitative research on harm reduction: the example of a public injecting typology. Contemp Drug Probl. 2011;38(1):61–91.CrossRef
49.
Tham R, Humphreys JS, Kinsman L, Buykx P, Asaid A, Tuohey K. Study protocol: evaluating the impact of a rural Australian primary health care service on rural health. BMC Health Serv Res. 2011;11:52.CrossRefPubMedPubMedCentral
50.
Van Royen P, Rees CE, Groenewegen P. Patient-centred interprofessional collaboration in primary care: challenges for clinical, educational and health services research. An EGPRN keynote paper. Eur J Gen Pract. 2014;20(4):327–32.CrossRefPubMed
51.
52.
Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43.CrossRefPubMed
53.
Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci. 2007;2:42.CrossRefPubMedPubMedCentral
54.
Pawson R. Nothing as practical as a good theory. Evaluation (Lond). 2003;9(4):471–90.CrossRef
55.
Saurman E, Johnston J, Hindman J, Kirby S, Lyle D. A transferable telepsychiatry model for improving access to emergency mental health care. J Telemed Telecare. 2014;20(7):391–9.CrossRefPubMed
56.
Villeval M, Bidault E, Shoveller J, Alias F, Basson J-C, Frasse C, et al. Enabling the transferability of complex interventions: exploring the combination of an intervention’s key functions and implementation. Int J Public Health. 2016;61(9):1031–8.CrossRefPubMed
57.
Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to address determinants of practice. The Cochrane Database of Systematic Reviews. 2015;(4):CD005470.
58.
Birken SA, Powell BJ, Presseau J, Kirk MA, Lorencatto F, Gould NJ, et al. Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): a systematic review. Implement Sci. 2017;12:2.CrossRefPubMedPubMedCentral
59.
Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2017;44(2):177–94.CrossRefPubMedPubMedCentral
60.
Trompette J, Kivits J, Minary L, Cambon L, Alla F. Stakeholders' perceptions of transferability criteria for health promotion interventions: a case study. BMC Public Health. 2014;14:1134.CrossRefPubMedPubMedCentral
61.
Flay BR. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Prev Med. 1986;15(5):451–74.CrossRefPubMed
62.
Flay BR, Biglan A, Boruch RF, Castro FG, Gottfredson D, Kellam S, et al. Standards of evidence: criteria for efficacy, effectiveness and dissemination. Prev Sci. 2005;6(3):151–75.CrossRefPubMed
63.
Glasgow R, Vogt T, Boles S. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRefPubMedPubMedCentral
64.
Spencer LM, Schooley MW, Anderson LA, Kochtitzky CS, DeGroff AS, Devlin HM, et al. Seeking best practices: a conceptual framework for planning and improving evidence-based practices. Prev Chronic Dis. 2013;10:E207.CrossRefPubMedPubMedCentral
65.
66.
Greenwald P, Cullen JW. The new emphasis in cancer control. J Natl Cancer Inst. 1985;74(3):543–51.PubMed
67.
Buffet C, Ciliska D, Thomas H. Can I use this evidence in my program decision? Assessing applicability and transferability of evidence. Hamilton: National Collaborating Centre for Methods and Tools; 2007.
68.
Chase D, Rosten C, Turner S, Hicks N, Milne R. Development of a toolkit and glossary to aid in the adaptation of health technology assessment (HTA) reports for use in different contexts. Health Technol Assess. 2009;13(37):1–142.PubMed
69.
Cuijpers P, Graaf I, Bohlmeijer E. Adapting and disseminating effective public health interventions in another country: towards a systematic approach. Eur J Pub Health. 2005;15(2):166–9.CrossRef
70.
71.
Schreyogg J. Justice in health care systems from an economic perspective. Gesundheitswesen. 2004;66(1):7–14.CrossRefPubMed
72.
Wegscheider K. Transferability of study results to health care practice: contribution of different qualitative and quantitative research approaches [German]. Z Evid Fortbild Qual Gesundhwes. 2009;103(6):381–7.CrossRefPubMed
73.
Heller RF, Verma A, Gemmell I, Harrison R, Hart J, Edwards R. Critical appraisal for public health: a new checklist. Public Health. 2008;122(1):92–8.CrossRefPubMed
74.
Granstrøm Ekeland AG, Grottland A. Assessment of MAST in European patient-centered telemedicine pilots. Int J Technol Assess Health Care. 2015;31(5):304–11.CrossRefPubMed
75.
Kidholm K, Ekeland AG, Jensen LK, Rasmussen J, Pedersen CD, Bowes A, et al. A model for assessment of telemedicine applications: mast. Int J Technol Assess Health Care. 2012;28(1):44–51.CrossRefPubMed
Metadata
Title
Criteria for evaluating transferability of health interventions: a systematic review and thematic synthesis
Authors
Tamara Schloemer
Peter Schröder-Bäck
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0751-8

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue

Study protocol

The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health

Research

A new scale for the evaluation of clinical practice guidelines applicability: development and appraisal

Systematic review

Managerial leadership for research use in nursing and allied health care professions: a systematic review

Correction

Correction to: Exploring multi-level system factors facilitating educator training and implementation of evidence-based practices (EBP): a study protocol

Research

Changing behaviour ‘more or less’—do theories of behaviour inform strategies for implementation and de-implementation? A critical interpretive synthesis

Research

Applying modern measurement approaches to constructs relevant to evidence-based practice among Canadian physical and occupational therapists