Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Debate

A typology of useful evidence: approaches to increase the practical value of intervention research

Authors: Henna Hasson, Laura Leviton, Ulrica von Thiele Schwarz

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Too often, studies of evidence-based interventions (EBIs) in preventive, community, and health care are not sufficiently useful to end users (typically practitioners, patients, policymakers, or other researchers). The ways in which intervention studies are conventionally conducted and reported mean that there is often a shortage of information when an EBI is used in practice.
The paper aims to invite the research community to consider ways to optimize not only the trustworthiness but also the research’s usefulness in intervention studies. This is done by proposing a typology that provides some approaches to useful EBIs for intervention researchers. The approaches originate from different research fields and are summarized to highlight their potential benefits from a usefulness perspective.

Main message

The typology consists of research approaches to increase the usefulness of EBIs by improving the reporting of four features in intervention studies: (1) the interventions themselves, including core components and appropriate adaptations; (2) strategies to support–high-quality implementation of the interventions; (3) generalizations about the evidence in a variety of contexts; and (4) outcomes based on end users’ preferences and knowledge. The research approaches fall into three levels: Description, Analysis, and Design. The first level, Description, outlines what types of information about the intervention and its implementation, context, and outcomes can be helpful for end users. Research approaches under analysis offers alternative ways of analyzing data, increasing the precision of information provided to end users. Approaches summarized under design involve more radical changes and far-reaching implications for how research can provide more useful information. These approaches partly flip the order of efficacy and effectiveness, focusing not on whether an intervention works in highly controlled and optimal circumstances, but first and foremost whether an intervention can be implemented and lead to anticipated outcomes in everyday practice.

Conclusions

The research community, as well as the end users of research, are invited to consider ways to optimize research’s usefulness as well as its trustworthiness. Many of the research approaches in the typology are not new, and their contributions to quality have been described for generations – but their contributions to useful knowledge need more attention.
Footnotes
1
Social science describes several kinds of knowledge use. The decisions to adopt and implement an EBI are direct, instrumental uses of evidence. Three other kinds of knowledge use are also important to this process: conceptual use (serious consideration but no direct action), persuasion of others to a course of action, and process use, in which participants’ frame of reference is changed by participating in research or evaluation.
 
Literature
1.
2.
go back to reference Cook TD. Generalizing causal knowledge in the policy sciences: external validity as a task of both multiattribute representation and multiattribute extrapolation. J Pol Anal Manag. 2014;33(2):527–36.CrossRef Cook TD. Generalizing causal knowledge in the policy sciences: external validity as a task of both multiattribute representation and multiattribute extrapolation. J Pol Anal Manag. 2014;33(2):527–36.CrossRef
3.
go back to reference Cronbach LJ, Shapiro K. Designing evaluations of educational and social programs: Jossey-bass; 1982. Cronbach LJ, Shapiro K. Designing evaluations of educational and social programs: Jossey-bass; 1982.
4.
go back to reference Pawson R, Tilley N. Realistic evaluation: sage; 1997. Pawson R, Tilley N. Realistic evaluation: sage; 1997.
6.
go back to reference Balas EA, Boren SA. Managing clinical knowledge for health care improvement. Yearbook of medical informatics 2000: Patient-centered systems; 2000. Balas EA, Boren SA. Managing clinical knowledge for health care improvement. Yearbook of medical informatics 2000: Patient-centered systems; 2000.
8.
go back to reference Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175–201.PubMedCrossRef Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175–201.PubMedCrossRef
9.
go back to reference Kazdin AE. Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. Am Psychol. 2008;63(3):146.PubMedCrossRef Kazdin AE. Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. Am Psychol. 2008;63(3):146.PubMedCrossRef
10.
go back to reference Bornheimer LA, Acri M, Parchment T, McKay MM. Provider attitudes, organizational readiness for change, and uptake of research supported treatment. Res Soc Work Pract. 2018;1049731518770278. Bornheimer LA, Acri M, Parchment T, McKay MM. Provider attitudes, organizational readiness for change, and uptake of research supported treatment. Res Soc Work Pract. 2018;1049731518770278.
11.
go back to reference Leviton LC. Generalizing about public health interventions: a mixed-methods approach to external validity. Annu Rev Public Health. 2017;38:371–91.PubMedCrossRef Leviton LC. Generalizing about public health interventions: a mixed-methods approach to external validity. Annu Rev Public Health. 2017;38:371–91.PubMedCrossRef
12.
go back to reference Fairweather GW, Sanders DH, Cressler DL, Maynard H. Community life for the mentally ill: an alternative to institutional care: Routledge; 2017.CrossRef Fairweather GW, Sanders DH, Cressler DL, Maynard H. Community life for the mentally ill: an alternative to institutional care: Routledge; 2017.CrossRef
14.
go back to reference Avellar SA, Thomas J, Kleinman R, Sama-Miller E, Woodruff SE, Coughlin R, et al. External validity: the next step for systematic reviews? Eval Rev. 2017;41(4):283–325.PubMedCrossRef Avellar SA, Thomas J, Kleinman R, Sama-Miller E, Woodruff SE, Coughlin R, et al. External validity: the next step for systematic reviews? Eval Rev. 2017;41(4):283–325.PubMedCrossRef
15.
go back to reference Leviton LC, Trujillo MD. Interaction of theory and practice to assess external validity. Eval Rev. 2017;41(5):436–71.PubMedCrossRef Leviton LC, Trujillo MD. Interaction of theory and practice to assess external validity. Eval Rev. 2017;41(5):436–71.PubMedCrossRef
16.
go back to reference Kessler R, Glasgow R. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med. 2011;40(6):637–44.PubMedCrossRef Kessler R, Glasgow R. A proposal to speed translation of healthcare research into practice: dramatic change is needed. Am J Prev Med. 2011;40(6):637–44.PubMedCrossRef
17.
go back to reference Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, Brice A, et al. Taking healthcare interventions from trial to practice. BMJ. 2010;341:c3852.PubMedCrossRef Glasziou P, Chalmers I, Altman DG, Bastian H, Boutron I, Brice A, et al. Taking healthcare interventions from trial to practice. BMJ. 2010;341:c3852.PubMedCrossRef
18.
go back to reference Burchett H, Umoquit M, Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Pol. 2011;16(4):238–44.CrossRef Burchett H, Umoquit M, Dobrow M. How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks. J Health Serv Res Pol. 2011;16(4):238–44.CrossRef
19.
go back to reference Flaspohler P, Lesesne CA, Puddy RW, Smith E, Wandersman A. Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. Am J Community Psychol. 2012;50(3-4):271–281.PubMedPubMedCentralCrossRef Flaspohler P, Lesesne CA, Puddy RW, Smith E, Wandersman A. Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. Am J Community Psychol. 2012;50(3-4):271–281.PubMedPubMedCentralCrossRef
20.
go back to reference Chambers D. Commentary: Increasing the connectivity between implementation science and public health: advancing methodology, evidence integration, and sustainability. Annu Rev Public Health. 2018;39:1–4. Chambers D. Commentary: Increasing the connectivity between implementation science and public health: advancing methodology, evidence integration, and sustainability. Annu Rev Public Health. 2018;39:1–4.
21.
go back to reference Chorpita BF, Weisz JR, Daleiden EL, Schoenwald SK, Palinkas LA, Miranda J, et al. Long-term outcomes for the child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care. J Consult Clin Psychol. 2013;81(6):999.PubMedCrossRef Chorpita BF, Weisz JR, Daleiden EL, Schoenwald SK, Palinkas LA, Miranda J, et al. Long-term outcomes for the child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care. J Consult Clin Psychol. 2013;81(6):999.PubMedCrossRef
22.
go back to reference Sundell K, Beelmann A, Hasson H, von Thiele Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol. 2015;45:1–13. Sundell K, Beelmann A, Hasson H, von Thiele Schwarz U. Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. J Clin Child Adolesc Psychol. 2015;45:1–13.
23.
go back to reference Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5(1):47–53.PubMedCrossRef Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5(1):47–53.PubMedCrossRef
24.
25.
go back to reference Robling M, Bekkers M-J, Bell K, Butler CC, Cannings-John R, Channon S, et al. Effectiveness of a nurse-led intensive home-visitation programme for first-time teenage mothers (building blocks): a pragmatic randomised controlled trial. Lancet. 2016;387(10014):146–55.PubMedPubMedCentralCrossRef Robling M, Bekkers M-J, Bell K, Butler CC, Cannings-John R, Channon S, et al. Effectiveness of a nurse-led intensive home-visitation programme for first-time teenage mothers (building blocks): a pragmatic randomised controlled trial. Lancet. 2016;387(10014):146–55.PubMedPubMedCentralCrossRef
26.
go back to reference Arnold V. Evidence Summary for the Nurse Family Partnership; Social Programs That Work Review Laura and John Arnold Foundation; 2017. Arnold V. Evidence Summary for the Nurse Family Partnership; Social Programs That Work Review Laura and John Arnold Foundation; 2017.
27.
go back to reference Dixon-Woods M, Leslie M, Tarrant C, Bion J. Explaining matching Michigan: an ethnographic study of a patient safety program. Implement Sci. 2013;8(1):70.PubMedPubMedCentralCrossRef Dixon-Woods M, Leslie M, Tarrant C, Bion J. Explaining matching Michigan: an ethnographic study of a patient safety program. Implement Sci. 2013;8(1):70.PubMedPubMedCentralCrossRef
28.
29.
go back to reference Pettigrew AM. Context and action in the transformation of the firm. J Manag Stud. 1987;11:31–48. Pettigrew AM. Context and action in the transformation of the firm. J Manag Stud. 1987;11:31–48.
30.
go back to reference Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10(1):1.CrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. 2015;10(1):1.CrossRef
31.
go back to reference Lipsey MW, Cordray DS. Evaluation methods for social intervention. Annu Rev Psychol. 2000;51(1):345–75.PubMedCrossRef Lipsey MW, Cordray DS. Evaluation methods for social intervention. Annu Rev Psychol. 2000;51(1):345–75.PubMedCrossRef
32.
go back to reference Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef
33.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Health services research: process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413.PubMedPubMedCentralCrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Health services research: process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413.PubMedPubMedCentralCrossRef
34.
go back to reference Naylor MD, Feldman PH, Keating S, Koren MJ, Kurtzman ET, Maccoy MC, et al. Translating research into practice: transitional care for older adults. J Eval Clin Pract. 2009;15(6):1164–70.PubMedCrossRef Naylor MD, Feldman PH, Keating S, Koren MJ, Kurtzman ET, Maccoy MC, et al. Translating research into practice: transitional care for older adults. J Eval Clin Pract. 2009;15(6):1164–70.PubMedCrossRef
35.
go back to reference Leviton LC, Baker S, Hassol A, Goldenberg RL. An exploration of opinion and practice patterns affecting low use of antenatal corticosteroids. Am J Obstetrics Gynecology. 1995;173(1):312–6.CrossRef Leviton LC, Baker S, Hassol A, Goldenberg RL. An exploration of opinion and practice patterns affecting low use of antenatal corticosteroids. Am J Obstetrics Gynecology. 1995;173(1):312–6.CrossRef
36.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.PubMedPubMedCentralCrossRef Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.PubMedPubMedCentralCrossRef
37.
go back to reference Ogrinc G, Mooney S, Estrada C, Foster T, Goldmann D, Hall LW, et al. The SQUIRE (standards for QUality improvement reporting excellence) guidelines for quality improvement reporting: explanation and elaboration. BMJ Quality Safety. 2008;17(Suppl 1):i13–32.CrossRef Ogrinc G, Mooney S, Estrada C, Foster T, Goldmann D, Hall LW, et al. The SQUIRE (standards for QUality improvement reporting excellence) guidelines for quality improvement reporting: explanation and elaboration. BMJ Quality Safety. 2008;17(Suppl 1):i13–32.CrossRef
38.
39.
go back to reference Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755.PubMedPubMedCentralCrossRef Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755.PubMedPubMedCentralCrossRef
40.
go back to reference Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Internal Med. 2008;148(4):W-60.CrossRef Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Internal Med. 2008;148(4):W-60.CrossRef
41.
go back to reference Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.PubMedPubMedCentralCrossRef Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.PubMedPubMedCentralCrossRef
42.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. Das Strengthening the Reporting of Observational Studies in Epidemiology (STROBE-) StatementThe Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting of observational studies. Notfall+ Rettungsmedizin. 2008;11(4):260.CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. Das Strengthening the Reporting of Observational Studies in Epidemiology (STROBE-) StatementThe Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting of observational studies. Notfall+ Rettungsmedizin. 2008;11(4):260.CrossRef
43.
go back to reference Des Jarlais D, Lyles C, Crepaz N, Group T. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94:361–6.PubMedPubMedCentralCrossRef Des Jarlais D, Lyles C, Crepaz N, Group T. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94:361–6.PubMedPubMedCentralCrossRef
44.
go back to reference Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726–32.PubMedCrossRef Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726–32.PubMedCrossRef
45.
go back to reference Steckler AB, Linnan L, Israel B. Process evaluation for public health interventions and research: Jossey-bass San Francisco; 2002. Steckler AB, Linnan L, Israel B. Process evaluation for public health interventions and research: Jossey-bass San Francisco; 2002.
46.
go back to reference Rossi PH, Lipsey MW, Freeman HE. Evaluation: a systematic approach: sage publications Inc; 2004. Rossi PH, Lipsey MW, Freeman HE. Evaluation: a systematic approach: sage publications Inc; 2004.
47.
go back to reference Carman JG, Fredericks KA. Nonprofits and evaluation: empirical evidence from the field. N Dir Eval. 2008;2008(119):51–71.CrossRef Carman JG, Fredericks KA. Nonprofits and evaluation: empirical evidence from the field. N Dir Eval. 2008;2008(119):51–71.CrossRef
48.
go back to reference Mark M, Henry G, Julnes G. Evaluation: an integrated framework for understanding, guiding, and improving public and non profit policies and programs. San Francisco: Jossey Bass Publishers; 2000. Mark M, Henry G, Julnes G. Evaluation: an integrated framework for understanding, guiding, and improving public and non profit policies and programs. San Francisco: Jossey Bass Publishers; 2000.
49.
go back to reference Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.PubMedCrossRef Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.PubMedCrossRef
50.
go back to reference Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5:67.PubMedPubMedCentralCrossRef Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5:67.PubMedPubMedCentralCrossRef
51.
go back to reference Hasson H, Blomberg S, Duner A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7:23.PubMedPubMedCentralCrossRef Hasson H, Blomberg S, Duner A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7:23.PubMedPubMedCentralCrossRef
53.
go back to reference Ferrer-Wreder L, Sundell K, Mansoory S. Tinkering with perfection: Theory development in the intervention cultural adaptation field. Child & Youth Care Forum: Springer; 2012. Ferrer-Wreder L, Sundell K, Mansoory S. Tinkering with perfection: Theory development in the intervention cultural adaptation field. Child & Youth Care Forum: Springer; 2012.
54.
go back to reference Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:i6795. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:i6795.
55.
go back to reference Ferrer-Wreder L, Sundell K. Mansoory S. Tinkering with Perfection: Theory Development in the Intervention Cultural Adaptation Field. Child Youth Care Forum. 2012;41;149–171.CrossRef Ferrer-Wreder L, Sundell K. Mansoory S. Tinkering with Perfection: Theory Development in the Intervention Cultural Adaptation Field. Child Youth Care Forum. 2012;41;149–171.CrossRef
57.
go back to reference Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9(1):39.PubMedPubMedCentralCrossRef Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): protocol for a mixed methods study. Implement Sci. 2014;9(1):39.PubMedPubMedCentralCrossRef
58.
go back to reference Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.PubMedCrossRef Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.PubMedCrossRef
59.
go back to reference Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690.PubMedCrossRef Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol. 2009;28(6):690.PubMedCrossRef
60.
go back to reference Weiner BJ, Lewis MA, Clauser SB, Stitzenberg KB. In search of synergy: strategies for combining interventions at multiple levels. J Natl Cancer Inst Monogr. 2012;2012(44):34–41.PubMedPubMedCentralCrossRef Weiner BJ, Lewis MA, Clauser SB, Stitzenberg KB. In search of synergy: strategies for combining interventions at multiple levels. J Natl Cancer Inst Monogr. 2012;2012(44):34–41.PubMedPubMedCentralCrossRef
61.
go back to reference Øvretveit J. Perspectives: answering questions about quality improvement: suggestions for investigators. Int J Qual Health Care. 2016;29(1):137–42. Øvretveit J. Perspectives: answering questions about quality improvement: suggestions for investigators. Int J Qual Health Care. 2016;29(1):137–42.
62.
63.
go back to reference Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1.PubMedPubMedCentralCrossRef Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3(1):1.PubMedPubMedCentralCrossRef
64.
go back to reference Greenhalgh T, Macfarlane RF, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.PubMedPubMedCentralCrossRef Greenhalgh T, Macfarlane RF, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.PubMedPubMedCentralCrossRef
65.
go back to reference Pettigrew AM, Ferlie E, McKee L. Shaping strategic change: making change in large organizations: the case of the National Health Service. London: Sage Publications; 1992. Pettigrew AM, Ferlie E, McKee L. Shaping strategic change: making change in large organizations: the case of the National Health Service. London: Sage Publications; 1992.
66.
go back to reference Hirschman KB, Shaid E, Bixby MB, Badolato DJ, Barg R, Byrnes MB, et al. Transitional care in the patient-centered medical home: lessons in adaptation. J Healthc Qual. 2017;39(2):67–77.PubMedCrossRef Hirschman KB, Shaid E, Bixby MB, Badolato DJ, Barg R, Byrnes MB, et al. Transitional care in the patient-centered medical home: lessons in adaptation. J Healthc Qual. 2017;39(2):67–77.PubMedCrossRef
67.
go back to reference Batalden M, Batalden P, Margolis P, Seid M, Armstrong G, Opipari-Arrigan L, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25(7):509–17.PubMedCrossRef Batalden M, Batalden P, Margolis P, Seid M, Armstrong G, Opipari-Arrigan L, et al. Coproduction of healthcare service. BMJ Qual Saf. 2016;25(7):509–17.PubMedCrossRef
68.
go back to reference Wallerstein N, Duran B, Minkler M, Oetzel JG. Community-based participatory research for health: advancing social and health equity: John Wiley & Sons; 2017. Wallerstein N, Duran B, Minkler M, Oetzel JG. Community-based participatory research for health: advancing social and health equity: John Wiley & Sons; 2017.
69.
go back to reference Bottomley A, Jones D, Claassens L. Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European medicines agency. Eur J Cancer. 2009;45(3):347–53.PubMedCrossRef Bottomley A, Jones D, Claassens L. Patient-reported outcomes: assessment and current perspectives of the guidelines of the Food and Drug Administration and the reflection paper of the European medicines agency. Eur J Cancer. 2009;45(3):347–53.PubMedCrossRef
70.
go back to reference von Thiele SU, Richter A, Hasson H. Getting on the same page - Co-created program logic (COP). In: Nielsen K, Noblet A, editors. Implementing and evaluating organizational interventions: Taylor and Francis; 2018. von Thiele SU, Richter A, Hasson H. Getting on the same page - Co-created program logic (COP). In: Nielsen K, Noblet A, editors. Implementing and evaluating organizational interventions: Taylor and Francis; 2018.
71.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38(2):65–76.CrossRef
72.
go back to reference Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34.CrossRef Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34.CrossRef
73.
go back to reference Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51(6):1173–82.PubMedCrossRef Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol. 1986;51(6):1173–82.PubMedCrossRef
74.
go back to reference Kraemer HC, Wilson GT, Fairburn CG, Agras WS. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry. 2002;59(10):877–83.PubMedCrossRef Kraemer HC, Wilson GT, Fairburn CG, Agras WS. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry. 2002;59(10):877–83.PubMedCrossRef
75.
go back to reference Kazdin AE. Evidence-based psychosocial treatment: advances, surprises, and needed shifts in foci. Cogn Behav Pract. 2016;23(4):426–30.CrossRef Kazdin AE. Evidence-based psychosocial treatment: advances, surprises, and needed shifts in foci. Cogn Behav Pract. 2016;23(4):426–30.CrossRef
76.
go back to reference Fairchild AJ, McQuillin SD. Evaluating mediation and moderation effects in school psychology: a presentation of methods and review of current practice. J Sch Psychol. 2010;48(1):53–84.PubMedPubMedCentralCrossRef Fairchild AJ, McQuillin SD. Evaluating mediation and moderation effects in school psychology: a presentation of methods and review of current practice. J Sch Psychol. 2010;48(1):53–84.PubMedPubMedCentralCrossRef
77.
go back to reference Querstret D, Cropley M, Fife-Schaw C. Internet-based instructor-led mindfulness for work-related rumination, fatigue, and sleep: Assessing facets of mindfulness as mechanisms of change. A randomized waitlist control trial. J Occup Health Psych. 2017;22(2):153.CrossRef Querstret D, Cropley M, Fife-Schaw C. Internet-based instructor-led mindfulness for work-related rumination, fatigue, and sleep: Assessing facets of mindfulness as mechanisms of change. A randomized waitlist control trial. J Occup Health Psych. 2017;22(2):153.CrossRef
78.
go back to reference Collins LM, Kugler KC. Optimization of behavioral, biobehavioral, and biomedical interventions. Cham: Springer International Publishing. 2018;10(1007):978–3. Collins LM, Kugler KC. Optimization of behavioral, biobehavioral, and biomedical interventions. Cham: Springer International Publishing. 2018;10(1007):978–3.
79.
go back to reference Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.PubMedCrossRef Kazdin AE. Mediators and mechanisms of change in psychotherapy research. Annu Rev Clin Psychol. 2007;3:1–27.PubMedCrossRef
80.
go back to reference Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217.PubMedPubMedCentralCrossRef Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217.PubMedPubMedCentralCrossRef
81.
go back to reference Boyd MR, Powell BJ, Endicott D, Lewis CC. A method for tracking implementation strategies: an exemplar implementing measurement-based care in community behavioral health clinics. Behav Ther. 2018;49(4):525–37.PubMedCrossRef Boyd MR, Powell BJ, Endicott D, Lewis CC. A method for tracking implementation strategies: an exemplar implementing measurement-based care in community behavioral health clinics. Behav Ther. 2018;49(4):525–37.PubMedCrossRef
82.
go back to reference Kraemer HC. Discovering, comparing, and combining moderators of treatment on outcome after randomized clinical trials: a parametric approach. Stat Med. 2013;32(11):1964–73.PubMedCrossRef Kraemer HC. Discovering, comparing, and combining moderators of treatment on outcome after randomized clinical trials: a parametric approach. Stat Med. 2013;32(11):1964–73.PubMedCrossRef
83.
go back to reference Bloom HS, Michalopoulos C. When is the story in the subgroups? Prev Sci. 2012:1–10. Bloom HS, Michalopoulos C. When is the story in the subgroups? Prev Sci. 2012:1–10.
84.
go back to reference Dymnicki A, Wandersman A, Osher D, Grigorescu V, Huang L, Meyer A. Willing, able→ ready: basics and policy implications of readiness as a key component for implementation of evidence-based practices. In: ASPE issue brief Washington, DC: Office of the Assistant Secretary for planning and evaluation, (Office of Human Services Policy). Washington, DC: US Department of Health and Human Services; 2014. Dymnicki A, Wandersman A, Osher D, Grigorescu V, Huang L, Meyer A. Willing, able→ ready: basics and policy implications of readiness as a key component for implementation of evidence-based practices. In: ASPE issue brief Washington, DC: Office of the Assistant Secretary for planning and evaluation, (Office of Human Services Policy). Washington, DC: US Department of Health and Human Services; 2014.
85.
go back to reference Shadish WR, Navarro AM, Matt GE, Phillips G. The effects of psychological therapies under clinically representative conditions: a meta-analysis. Psychol Bull. 2000;126(4):512.PubMedCrossRef Shadish WR, Navarro AM, Matt GE, Phillips G. The effects of psychological therapies under clinically representative conditions: a meta-analysis. Psychol Bull. 2000;126(4):512.PubMedCrossRef
86.
go back to reference Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):49.PubMedPubMedCentralCrossRef Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):49.PubMedPubMedCentralCrossRef
87.
go back to reference Salter KL, Kothari A. Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review. Implement Sci. 2014;9(1):115.PubMedPubMedCentralCrossRef Salter KL, Kothari A. Using realist evaluation to open the black box of knowledge translation: a state-of-the-art review. Implement Sci. 2014;9(1):115.PubMedPubMedCentralCrossRef
88.
go back to reference Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef Pawson R, Manzano-Santaella A. A realist diagnostic workshop. Evaluation. 2012;18(2):176–91.CrossRef
89.
go back to reference Nielsen K, Miraglia M. What works for whom in which circumstances? On the need to move beyond the ‘what works?‘question in organizational intervention research. Human Relations. 2017;70(1):40–62.CrossRef Nielsen K, Miraglia M. What works for whom in which circumstances? On the need to move beyond the ‘what works?‘question in organizational intervention research. Human Relations. 2017;70(1):40–62.CrossRef
90.
go back to reference Bond FW, Flaxman PE, Bunce D. The influence of psychological flexibility on work redesign: mediated moderation of a work reorganization intervention. J Appl Psychol. 2008;93(3):645.PubMedCrossRef Bond FW, Flaxman PE, Bunce D. The influence of psychological flexibility on work redesign: mediated moderation of a work reorganization intervention. J Appl Psychol. 2008;93(3):645.PubMedCrossRef
91.
go back to reference Emmelkamp PM, David D, Beckers T, Muris P, Cuijpers P, Lutz W, et al. Advancing psychotherapy and evidence-based psychological interventions. Int J Methods Psychiatr Res. 2014;23(S1):58–91.PubMedCrossRef Emmelkamp PM, David D, Beckers T, Muris P, Cuijpers P, Lutz W, et al. Advancing psychotherapy and evidence-based psychological interventions. Int J Methods Psychiatr Res. 2014;23(S1):58–91.PubMedCrossRef
92.
go back to reference Glasgow RE. What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013;40(3):257–65.PubMedCrossRef Glasgow RE. What does it mean to be pragmatic? Pragmatic methods, measures, and models to facilitate research translation. Health Educ Behav. 2013;40(3):257–65.PubMedCrossRef
94.
go back to reference Gravenstein S, Davidson HE, Taljaard M, Ogarek J, Gozalo P, Han L, et al. Comparative effectiveness of high-dose versus standard-dose influenza vaccination on numbers of US nursing home residents admitted to hospital: a cluster-randomised trial. Lancet Respir Med. 2017;5(9):738–46.PubMedCrossRef Gravenstein S, Davidson HE, Taljaard M, Ogarek J, Gozalo P, Han L, et al. Comparative effectiveness of high-dose versus standard-dose influenza vaccination on numbers of US nursing home residents admitted to hospital: a cluster-randomised trial. Lancet Respir Med. 2017;5(9):738–46.PubMedCrossRef
95.
go back to reference Wilcox S, Dowda M, Leviton LC, Bartlett-Prescott J, Bazzarre T, Campbell-Voytal K, et al. Active for life: final results from the translation of two physical activity programs. Am J of Prev Med. 2008;35(4):340–51.CrossRef Wilcox S, Dowda M, Leviton LC, Bartlett-Prescott J, Bazzarre T, Campbell-Voytal K, et al. Active for life: final results from the translation of two physical activity programs. Am J of Prev Med. 2008;35(4):340–51.CrossRef
96.
go back to reference Villatte JL, Vilardaga R, Villatte M, Vilardaga JCP, Atkins DC, Hayes SC. Acceptance and commitment therapy modules: differential impact on treatment processes and outcomes. Behav Res Ther. 2016;77:52–61.PubMedCrossRef Villatte JL, Vilardaga R, Villatte M, Vilardaga JCP, Atkins DC, Hayes SC. Acceptance and commitment therapy modules: differential impact on treatment processes and outcomes. Behav Res Ther. 2016;77:52–61.PubMedCrossRef
97.
go back to reference Griner D, Smith TB. Culturally adapted mental health intervention: A meta-analytic review. Psychotherapy. 2006;43(4):531.PubMedCrossRef Griner D, Smith TB. Culturally adapted mental health intervention: A meta-analytic review. Psychotherapy. 2006;43(4):531.PubMedCrossRef
98.
go back to reference Hodge DR, Jackson KF, Vaughn MG. Culturally sensitive interventions for health related behaviors among Latino youth: a meta-analytic review. Child Youth Serv Rev. 2010;32(10):1331–7.CrossRef Hodge DR, Jackson KF, Vaughn MG. Culturally sensitive interventions for health related behaviors among Latino youth: a meta-analytic review. Child Youth Serv Rev. 2010;32(10):1331–7.CrossRef
100.
go back to reference Jackson KF, Hodge DR. Native American youth and culturally sensitive interventions: a systematic review. Res Soc Work Pract. 2010. Jackson KF, Hodge DR. Native American youth and culturally sensitive interventions: a systematic review. Res Soc Work Pract. 2010.
101.
go back to reference Kumpfer KL, Alvarado R, Smith P, Bellamy N. Cultural sensitivity and adaptation in family-based prevention interventions. Prev Sci. 2002;3(3):241–6.PubMedCrossRef Kumpfer KL, Alvarado R, Smith P, Bellamy N. Cultural sensitivity and adaptation in family-based prevention interventions. Prev Sci. 2002;3(3):241–6.PubMedCrossRef
102.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40):1–9. Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40):1–9.
103.
go back to reference Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6(1):54. Brown CA, Lilford RJ. The stepped wedge trial design: a systematic review. BMC Med Res Methodol. 2006;6(1):54.
104.
go back to reference Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.PubMedCrossRef Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015;350:h391.PubMedCrossRef
105.
go back to reference Mdege ND, Man M-S, Taylor CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48.PubMedCrossRef Mdege ND, Man M-S, Taylor CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48.PubMedCrossRef
106.
go back to reference Bailet LL, Repper K, Murphy S, Piasta S, Zettler-Greeley C. Emergent literacy intervention for prekindergarteners at risk for reading failure: years 2 and 3 of a multiyear study. J Learn Disabil. 2013;46(2):133–53.PubMedCrossRef Bailet LL, Repper K, Murphy S, Piasta S, Zettler-Greeley C. Emergent literacy intervention for prekindergarteners at risk for reading failure: years 2 and 3 of a multiyear study. J Learn Disabil. 2013;46(2):133–53.PubMedCrossRef
107.
go back to reference Bailet LL, Repper KK, Piasta SB, Murphy SP. Emergent literacy intervention for prekindergarteners at risk for reading failure. J Learn Disabil. 2009;42(4):336–55.PubMedCrossRef Bailet LL, Repper KK, Piasta SB, Murphy SP. Emergent literacy intervention for prekindergarteners at risk for reading failure. J Learn Disabil. 2009;42(4):336–55.PubMedCrossRef
108.
go back to reference Galovski TE, Blain LM, Mott JM, Elwood L, Houle T. Manualized therapy for PTSD: flexing the structure of cognitive processing therapy. J Consult Clin Psychol. 2012;80(6):968.PubMedPubMedCentralCrossRef Galovski TE, Blain LM, Mott JM, Elwood L, Houle T. Manualized therapy for PTSD: flexing the structure of cognitive processing therapy. J Consult Clin Psychol. 2012;80(6):968.PubMedPubMedCentralCrossRef
109.
go back to reference Sox HC, Greenfield S. Comparative effectiveness research: a report from the Institute of Medicine. Ann Intern Med. 2009;151(3):203–5.PubMedCrossRef Sox HC, Greenfield S. Comparative effectiveness research: a report from the Institute of Medicine. Ann Intern Med. 2009;151(3):203–5.PubMedCrossRef
111.
go back to reference Seers K, Cox K, Crichton NJ, Edwards RT, Eldh AC, Estabrooks CA, et al. FIRE (facilitating implementation of research evidence): a study protocol. Implement Sci. 2012;7(1):25.PubMedPubMedCentralCrossRef Seers K, Cox K, Crichton NJ, Edwards RT, Eldh AC, Estabrooks CA, et al. FIRE (facilitating implementation of research evidence): a study protocol. Implement Sci. 2012;7(1):25.PubMedPubMedCentralCrossRef
112.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3.
113.
go back to reference Flottorp S, Oxman AD, Håvelsrud K, Treweek S, Herrin J. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ. 2002;325(7360):367.PubMedPubMedCentralCrossRef Flottorp S, Oxman AD, Håvelsrud K, Treweek S, Herrin J. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ. 2002;325(7360):367.PubMedPubMedCentralCrossRef
114.
go back to reference Sinnema H, Majo MC, Volker D, Hoogendoorn A, Terluin B, Wensing M, et al. Effectiveness of a tailored implementation programme to improve recognition, diagnosis and treatment of anxiety and depression in general practice: a cluster randomised controlled trial. Implement Sci. 2015;10(1):33.PubMedPubMedCentralCrossRef Sinnema H, Majo MC, Volker D, Hoogendoorn A, Terluin B, Wensing M, et al. Effectiveness of a tailored implementation programme to improve recognition, diagnosis and treatment of anxiety and depression in general practice: a cluster randomised controlled trial. Implement Sci. 2015;10(1):33.PubMedPubMedCentralCrossRef
115.
go back to reference Laurenceau J-P, Hayes AM, Feldman GC. Some methodological and statistical issues in the study of change processes in psychotherapy. Clin Psychol Rev. 2007;27(6):682–95.PubMedPubMedCentralCrossRef Laurenceau J-P, Hayes AM, Feldman GC. Some methodological and statistical issues in the study of change processes in psychotherapy. Clin Psychol Rev. 2007;27(6):682–95.PubMedPubMedCentralCrossRef
116.
go back to reference Öst L-G, Johansson J, Jerremalm A. Individual response patterns and the effects of different behavioral methods in the treatment of claustrophobia. Behav Res Ther. 1982;20(5):445–60.PubMedCrossRef Öst L-G, Johansson J, Jerremalm A. Individual response patterns and the effects of different behavioral methods in the treatment of claustrophobia. Behav Res Ther. 1982;20(5):445–60.PubMedCrossRef
117.
go back to reference Samani NJ, Tomaszewski M, Schunkert H. The personal genome—the future of personalised medicine? Lancet. 2010;375(9725):1497–8.PubMedCrossRef Samani NJ, Tomaszewski M, Schunkert H. The personal genome—the future of personalised medicine? Lancet. 2010;375(9725):1497–8.PubMedCrossRef
118.
go back to reference Horbar JD, Carpenter JH, Buzas J, Soll RF, Suresh G, Bracken MB, et al. Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial. BMJ. 2004;329(7473):1004.PubMedPubMedCentralCrossRef Horbar JD, Carpenter JH, Buzas J, Soll RF, Suresh G, Bracken MB, et al. Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial. BMJ. 2004;329(7473):1004.PubMedPubMedCentralCrossRef
119.
go back to reference Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.PubMedCrossRef Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.PubMedCrossRef
120.
go back to reference Price D, Musgrave SD, Shepstone L, Hillyer EV, Sims EJ, Gilbert RF, et al. Leukotriene antagonists as first-line or add-on asthma-controller therapy. N Engl J Med. 2011;364(18):1695–707.PubMedCrossRef Price D, Musgrave SD, Shepstone L, Hillyer EV, Sims EJ, Gilbert RF, et al. Leukotriene antagonists as first-line or add-on asthma-controller therapy. N Engl J Med. 2011;364(18):1695–707.PubMedCrossRef
121.
go back to reference Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clin Psychol Sci Pract. 2016;23(2):180–200.CrossRef Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clin Psychol Sci Pract. 2016;23(2):180–200.CrossRef
122.
go back to reference Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Aff. 2005;24(1):138–50.CrossRef Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Aff. 2005;24(1):138–50.CrossRef
123.
go back to reference Hofmann DA, Griffin MA, Gavin MB. The application of hierarchical linear modeling to organizational research; 2000. Hofmann DA, Griffin MA, Gavin MB. The application of hierarchical linear modeling to organizational research; 2000.
124.
go back to reference van Walraven C, Goel V, Chan B. Effect of population-based interventions on laboratory utilization: a time-series analysis. JAMA. 1998;280(23):2028–33.PubMedCrossRef van Walraven C, Goel V, Chan B. Effect of population-based interventions on laboratory utilization: a time-series analysis. JAMA. 1998;280(23):2028–33.PubMedCrossRef
125.
go back to reference Leon SC, Miller SA, Stoner AM, Fuller A, Rolnik A. Change trajectories: Children’s patterns of improvement in acute-stay inpatient care. J Behav Health Serv Res. 2016;43(2):233–45.PubMedCrossRef Leon SC, Miller SA, Stoner AM, Fuller A, Rolnik A. Change trajectories: Children’s patterns of improvement in acute-stay inpatient care. J Behav Health Serv Res. 2016;43(2):233–45.PubMedCrossRef
126.
go back to reference Ovretveit J, Keller C, Hvitfeldt Forsberg H, Essén A, Lindblad S, Brommels M. Continuous innovation: developing and using a clinical database with new technology for patient-centred care—the case of the Swedish quality register for arthritis. Int J Qual Health Care. 2013;25(2):118–24.PubMedCrossRef Ovretveit J, Keller C, Hvitfeldt Forsberg H, Essén A, Lindblad S, Brommels M. Continuous innovation: developing and using a clinical database with new technology for patient-centred care—the case of the Swedish quality register for arthritis. Int J Qual Health Care. 2013;25(2):118–24.PubMedCrossRef
128.
go back to reference Shadish W, Cook T, Campbell D. Experimental and quasi-experimental designs for generalized causal inference; 2002. Shadish W, Cook T, Campbell D. Experimental and quasi-experimental designs for generalized causal inference; 2002.
129.
go back to reference Minary L, Trompette J, Kivits J, Cambon L, Tarquinio C, Alla F. Which design to evaluate complex interventions? Toward a methodological framework through a systematic review. BMC Med Res Methodol. 2019;19(1):92.PubMedPubMedCentralCrossRef Minary L, Trompette J, Kivits J, Cambon L, Tarquinio C, Alla F. Which design to evaluate complex interventions? Toward a methodological framework through a systematic review. BMC Med Res Methodol. 2019;19(1):92.PubMedPubMedCentralCrossRef
Metadata
Title
A typology of useful evidence: approaches to increase the practical value of intervention research
Authors
Henna Hasson
Laura Leviton
Ulrica von Thiele Schwarz
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-00992-2

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue