Top

Implementation Science

Published in:

Open Access 01-12-2017 | Research

Broadening measures of success: results of a behavioral health translational research training program

Authors: Julie A. Baldwin, Heather J. Williamson, Emery R. Eaves, Bruce L. Levin, Donna L. Burton, Oliver T. Massey

Published in: Implementation Science | Issue 1/2017

Abstract

Background

While some research training programs have considered the importance of mentoring in inspiring professionals to engage in translational research, most evaluations emphasize outcomes specific to academic productivity as primary measures of training program success. The impact of such training or mentoring programs on stakeholders and local community organizations engaged in translational research efforts has received little attention. The purpose of this evaluation is to explore outcomes other than traditional academic productivity in a translational research graduate certificate program designed to pair graduate students and behavioral health professionals in collaborative service-learning projects.

Methods

Semi-structured qualitative interviews with scholars, community mentors, and academic mentors were conducted regarding a translational research program to identify programmatic impacts. Interviews were transcribed and coded by the research team to identify salient themes related to programmatic outcomes.

Results

Results are framed using the Translational Research Impact Scale which is organized into three overarching domains of potential impact: (1) research-related impacts, (2) translational impacts, and (3) societal impacts. This evaluation demonstrates the program’s impact in all three domains of the TRIS evaluation framework. Graduate certificate participants (scholars) reported that gaining experience in applied behavioral health settings added useful skills and expertise to their present careers and increased their interest in pursuing translational research. Scholars also described benefits resulting from networks gained through participation in the program, including valuable ties between the university and community behavioral health organizations.

Conclusions

This evaluation of the outcomes of a graduate certificate program providing training in translational research highlights the need for more community-oriented and practice-based measures of success. Encouraging practitioner involvement in translational research is vital to translate knowledge into practice and to enable practice-based needs to inform research and policy. A more flexible approach to measuring programmatic success in research training programs can help bridge the knowledge translation gap.

Morrato EH, Rabin B, Proctor J, Cicutto LC, Battaglia CT, Lambert-Kerzner A, et al. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015;10(1):1–12. doi:10.1186/s13012-015-0281-6.CrossRef

Rubio DM, Schoenbaum EE, Lee LS, Schteingart DE, Marantz PR, Anderson KE, et al. Defining translational research: implications for training. Acad Med. 2010;85(3):470–5. doi:10.1097/ACM.0b013e3181ccd618.PubMedPubMedCentralCrossRef

Lal S, Urquhart R, Cornelissen E, Newman K, Van Eerd D, Powell BJ, et al. Trainees’ self-reported challenges in knowledge translation, research and practice. Worldviews Evid-Based Nurs. 2015;12(6):348–54. doi:10.1111/wvn.12118.PubMedCrossRef

Wooten KC, Dann SM, Finnerty CC, Kotarba JA. Translational science project team managers: qualitative insights and implications from current and previous postdoctoral experiences. Postdoc J. 2014;2(7):37–49.PubMedPubMedCentral

Waitzkin H, Yager J, Parker T, Duran B. Mentoring partnerships for minority faculty and graduate students in mental health services research. Acad Psychiatry. 2006;30(3):205–17. doi:10.1176/appi.ap.30.3.205.PubMedPubMedCentralCrossRef

Viets VL, Baca C, Verney SP, Venner K, Parker T, Wallerstein N. Reducing health disparities through a culturally centered mentorship program for minority faculty: the Southwest Addictions Research Group (SARG) experience. Acad Med. 2009;84(8):1118–26. doi:10.1097/ACM.0b013e3181ad1cb1.PubMedPubMedCentralCrossRef

Wooten KC, Calhoun WJ, Bhavnani S, Rose RM, Ameredes B, Brasier AR. Evolution of multidisciplinary translational teams (MTTs): insights for accelerating translational innovations. Clin Transl Sci. 2015;8(5):542–52. doi:10.1111/cts.12266.PubMedPubMedCentralCrossRef

Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013;8(1):1–12. doi:10.1186/1748-5908-8-105.CrossRef

Begg MD, Crumley G, Fair AM, Martina CA, McCormack WT, Merchant C, et al. Approaches to preparing young scholars for careers in interdisciplinary team science. J Investig Med. 2014;62(1):14–25. doi:10.2310/JIM.0000000000000021.PubMedPubMedCentralCrossRef

10.

Straus SE, Brouwers M, Johnson D, Lavis JN, Légaré F, Majumdar SR, et al. Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011;6(1):127.PubMedPubMedCentralCrossRef

11.

Pozen R, Kline H. Defining success for translational research organizations. Sci Transl Med. 2011;3(94):94cm20. doi:10.1126/scitranslmed.3002085.PubMedCrossRef

12.

Rajan A, Sullivan R, Bakker S, Van Harten WH. Critical appraisal of translational research models for suitability in performance assessment of cancer centers. Oncologist. 2012;17(12):e48–57.PubMedPubMedCentralCrossRef

13.

Grether M, Eickelberg O, Mall MA, Rabe KF, Welte T, Seeger W. New metrics for translational research. Lancet Respir Med. 2014;2(8):e13–4.PubMedCrossRef

14.

Dembe AE, Lynch MS, Gugiu PC, Jackson RD. The translational research impact scale development, construct validity, and reliability testing. Eval Health Prof. 2014;37(1):50–70.PubMedCrossRef

15.

Ginexi EM, Hilton TF. What’s next for translation research? Eval Health Prof. 2006;29(3):334–47. doi:10.1177/0163278706290409.PubMedCrossRef

16.

Truncali A, Kalet AL, Gillespie C, More F, Naegle M, Lee JD, et al. Engaging health professional students in substance abuse (SA) research: development and early evaluation of the SARET program. J Addict Med. 2012;6(3):196–204. doi:10.1097/ADM.0b013e31825f77db.PubMedPubMedCentralCrossRef

17.

Glasgow RE, Vogt TM, Boles SM, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. National Institutes of Health approaches to dissemination and implementation science: Current and future directions. The American Journal of Public Health. 2012;102(7):1274–81.

18.

Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1):50. doi:10.1186/1748-5908-7-50.PubMedPubMedCentralCrossRef

19.

Young B-R, Williamson HJ, Burton DL, Massey OT, Levin BL, Baldwin JA. Challenges and benefits in designing and implementing a team-based research mentorship experience in translational research. Pedagogy Health Promot. 2015;1(4):233–46. doi:10.1177/2373379915600174.PubMedPubMedCentralCrossRef

20.

Burton DL, Levin BL, Massey T, Baldwin J, Williamson H. Innovative Graduate Research Education for Advancement of Implementation Science in Adolescent Behavioral Health. J Behav Health Serv Res. 2016;43(2):172–86.

21.

Malterud K. Qualitative research: standards, challenges, and guidelines. Lancet. 2001;358. doi:10.1016/s0140-6736(01)05627-6.

22.

Glaser BG, Strauss AL. The discovery of grounded theory: Strategies for qualitative research. New York, NY: Routledge; 2017 [1999].

23.

Strauss A, Corbin J. Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks, CA: Sage Publications; 1998.

24.

Strauss AL. Qualitative analysis for social scientists. New York, NY: Cambridge University Press; 1987.

25.

Strauss A, Corbin J. Basics of Qualitative Research. Grounded Theory Procedures and Techniques. Newbury Park, California: SAGE Publications; 1990.

26.

Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72. doi:10.1111/j.1475-6773.2006.00684.x.PubMedPubMedCentralCrossRef

27.

Armstrong D, Gosling A, Weinman J, Marteau T. The place of inter-rater reliability in qualitative research: an empirical study. Sociology. 1997;31(3):597–606.CrossRef

28.

Pope C, Ziebland S, Mays N. Analysing qualitative data. BMJ. 2000;320(7227):114–6.PubMedPubMedCentralCrossRef

29.

Eaves ER, Nichter M, Ritenbaugh C, Sutherland E, Dworkin SF. Works of illness and the challenges of social risk and the specter of pain in the lived experience of TMD. Med Anthropol Q. 2015;29(2):157–77.PubMedCrossRef

30.

Eaves ER, Sherman KJ, Ritenbaugh C, Hsu C, Nichter M, Turner JA, et al. A qualitative study of changes in expectations over time among patients with chronic low back pain seeking four CAM therapies. BMC Complement Altern Med. 2015;15(1):1–10. doi:10.1186/s12906-015-0531-9.CrossRef

31.

Hsu C, Sherman K, Eaves ER, Turner J, Cherkin DC, Cromp D. New perspectives on patient expectations of treatment outcomes: results from qualitative interviews with patients seeking complementary and alternative medicine treatments for chronic low back pain. BMC Complement Altern Med. 2014;14. doi:10.1186/1472-6882-14-276.

32.

Williamson HJ, Young B-R, Murray N, Burton DL, Lubotsky Levin B, Massey OT, et al. Community-University Partnerships for Research and Practice: Application of an Interactive and Contextual Model of Collaboration. J High Educ Outreach Engagement. 2016;20(2):55–84.

33.

Castillo HL, Rivers T, Randall C, Gaughan K, Ojanen T, Burton D. Placing Evidence-Based Interventions at the Fingertips of School Social Workers. J Behav Health Serv Res. 2016;43(3):474–83.

34.

Sopher CJ, Adamson BJS, Andrasik MP, Flood DM, Wakefield SF, Stoff DM, et al. Enhancing diversity in the public health research workforce: the research and mentorship program for future HIV vaccine scientists. Am J Public Health. 2014;105(4):823–30. doi:10.2105/AJPH.2014.302076.PubMedCrossRef

35.

Adamson BJS, Fuchs JD, Sopher CJ, Flood DM, Johnson RP, Haynes BF, et al. A new model for catalyzing translational science: the early stage investigator mentored research scholar program in HIV vaccines. Clin Transl Sci. 2015;8(2):166–8. doi:10.1111/cts.12249.PubMedCrossRef

36.

Kerner JF. Knowledge translation versus knowledge integration: a “funder’s” perspective. J Contin Educ Health Prof. 2006;26(1):72–80.PubMedCrossRef

37.

National Collaborating Centre for Methods and Tools. Is Research Working for You? Tool. Hamilton: McMaster University; 2009. (Updated 16 February, 2017) Retrieved from http://www.nccmt.ca/resources/search/35.

38.

Lavis J, Oxman A, Lewin S, Fretheim A. SUPPORT tools for evidence-informed health policymaking (STP). Introduction. Health Res Policy Syst. 2009;7 Suppl 1:I1–10.PubMedPubMedCentralCrossRef

39.

Johnson MO, Subak LL, Brown JS, Lee KA, Feldman MD. An innovative program to train health sciences researchers to be effective clinical and translational-research mentors. Acad Med. 2010;85(3):484.PubMedPubMedCentralCrossRef

40.

Feldman MD, Steinauer JE, Khalili M, Huang L, Kahn JS, Lee KA, et al. A mentor development program for clinical translational science faculty leads to sustained, improved confidence in mentoring skills. Clin Transl Sci. 2012;5(4):362–7. doi:10.1111/j.1752-8062.2012.00419.x.PubMedPubMedCentralCrossRef

41.

Urquhart R, Cornelissen E, Lal S, Colquhoun H, Klein G, Richmond S, et al. A community of practice for knowledge translation trainees: an innovative approach for learning and collaboration. J Contin Educ Health Prof. 2013;33(4):274–81.PubMedCrossRef

Title: Broadening measures of success: results of a behavioral health translational research training program
Authors: Julie A. Baldwin
Heather J. Williamson
Emery R. Eaves
Bruce L. Levin
Donna L. Burton
Oliver T. Massey
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-017-0621-9

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Broadening measures of success: results of a behavioral health translational research training program

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2017

Improving the adaptability of WHO evidence-informed guidelines for nutrition actions: results of a mixed methods evaluation

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Specification of implementation interventions to address the cascade of HIV care and treatment in resource-limited settings: a systematic review

Health professionals’ views on the barriers and enablers to evidence-based practice for acute stroke care: a systematic review

The effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare: a systematic review

The physician’s experience of changing clinical practice: a struggle to unlearn