Skip to main content
Top
Published in: Implementation Science 1/2012

Open Access 01-12-2012 | Methodology

Online self-administered training for post-traumatic stress disorder treatment providers: design and methods for a randomized, prospective intervention study

Authors: Josef I Ruzek, Raymond C Rosen, Lisa Marceau, Mary Jo Larson, Donn W Garvert, Lauren Smith, Anne Stoddard

Published in: Implementation Science | Issue 1/2012

Login to get access

Abstract

This paper presents the rationale and methods for a randomized controlled evaluation of web-based training in motivational interviewing, goal setting, and behavioral task assignment. Web-based training may be a practical and cost-effective way to address the need for large-scale mental health training in evidence-based practice; however, there is a dearth of well-controlled outcome studies of these approaches. For the current trial, 168 mental health providers treating post-traumatic stress disorder (PTSD) were assigned to web-based training plus supervision, web-based training, or training-as-usual (control). A novel standardized patient (SP) assessment was developed and implemented for objective measurement of changes in clinical skills, while on-line self-report measures were used for assessing changes in knowledge, perceived self-efficacy, and practice related to cognitive behavioral therapy (CBT) techniques. Eligible participants were all actively involved in mental health treatment of veterans with PTSD. Study methodology illustrates ways of developing training content, recruiting participants, and assessing knowledge, perceived self-efficacy, and competency-based outcomes, and demonstrates the feasibility of conducting prospective studies of training efficacy or effectiveness in large healthcare systems.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL: Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004, 351: 13-22. 10.1056/NEJMoa040603.CrossRefPubMed Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL: Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004, 351: 13-22. 10.1056/NEJMoa040603.CrossRefPubMed
2.
go back to reference Ruzek JI, Vasterling JJ, Schnurr PP, Friedman MJ: Caring for Veterans with Deployment-Related Stress Disorders: Iraq, Afghanistan, and Beyond. 2011, American Psychological Association Press, Washington, D.C.CrossRef Ruzek JI, Vasterling JJ, Schnurr PP, Friedman MJ: Caring for Veterans with Deployment-Related Stress Disorders: Iraq, Afghanistan, and Beyond. 2011, American Psychological Association Press, Washington, D.C.CrossRef
3.
go back to reference Ruzek JI, Rosen RC: Disseminating evidence-based treatments for PTSD in organizational settings: a high priority focus area. Behav Res Ther. 2009, 47: 980-989. 10.1016/j.brat.2009.07.008.CrossRefPubMed Ruzek JI, Rosen RC: Disseminating evidence-based treatments for PTSD in organizational settings: a high priority focus area. Behav Res Ther. 2009, 47: 980-989. 10.1016/j.brat.2009.07.008.CrossRefPubMed
4.
go back to reference Ruzek JI, Friedman MJ, Murray S: Towards a PTSD knowledge management system in Veterans Health Care. Psychiatr Ann. 2005, 35: 911-920. Ruzek JI, Friedman MJ, Murray S: Towards a PTSD knowledge management system in Veterans Health Care. Psychiatr Ann. 2005, 35: 911-920.
5.
go back to reference McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010, 65: 73-84.CrossRefPubMed McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010, 65: 73-84.CrossRefPubMed
6.
go back to reference Drake RE, Essock SM, Shaner A, Carey KB, Minkoff K, Kola L, Lynde D, Osher FC, Clark RE, Rickards L: Implementing dual diagnosis services for clients with severe mental illness. Psychiatr Serv. 2001, 52: 469-476. 10.1176/appi.ps.52.4.469.CrossRefPubMed Drake RE, Essock SM, Shaner A, Carey KB, Minkoff K, Kola L, Lynde D, Osher FC, Clark RE, Rickards L: Implementing dual diagnosis services for clients with severe mental illness. Psychiatr Serv. 2001, 52: 469-476. 10.1176/appi.ps.52.4.469.CrossRefPubMed
7.
go back to reference Sholomskas DE, Syracuse-Siewert G, Rounsaville BJ, Ball SA, Nuro KF, Carroll KM: We don’t train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. J Consult Clin Psychol. 2005, 73: 106-115.CrossRefPubMedPubMedCentral Sholomskas DE, Syracuse-Siewert G, Rounsaville BJ, Ball SA, Nuro KF, Carroll KM: We don’t train in vain: a dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. J Consult Clin Psychol. 2005, 73: 106-115.CrossRefPubMedPubMedCentral
8.
go back to reference Institute of Medicine (U.S.). Committee on Quality of Health Care in America: Crossing the Quality Chasm : A New Health System for the 21st Century. 2001, National Academy Press, Washington Institute of Medicine (U.S.). Committee on Quality of Health Care in America: Crossing the Quality Chasm : A New Health System for the 21st Century. 2001, National Academy Press, Washington
9.
go back to reference Institute of Medicine (U.S.). Committee on Crossing the Quality Chasm. Adaptation to Mental Health and Addictive Disorders: Improving the Quality of Health Care for Mental and Substance-Use Conditions. 2006, National Academies Press, Washington Institute of Medicine (U.S.). Committee on Crossing the Quality Chasm. Adaptation to Mental Health and Addictive Disorders: Improving the Quality of Health Care for Mental and Substance-Use Conditions. 2006, National Academies Press, Washington
10.
go back to reference Hoge MA, Huey LY, O’Connell MJ: best practices in behavioral health workforce education and training. Admin Pol Ment Health. 2004, 32: 91-106.CrossRef Hoge MA, Huey LY, O’Connell MJ: best practices in behavioral health workforce education and training. Admin Pol Ment Health. 2004, 32: 91-106.CrossRef
11.
go back to reference Allen B, Brymer MJ, Steinberg AM, Vernberg EM, Jacobs A, Speier AH, Pynoos RS: Perceptions of psychological first aid among providers responding to Hurricanes Gustav and Ike. J Trauma Stress. 2010, 23: 509-513. 10.1002/jts.20539.CrossRefPubMed Allen B, Brymer MJ, Steinberg AM, Vernberg EM, Jacobs A, Speier AH, Pynoos RS: Perceptions of psychological first aid among providers responding to Hurricanes Gustav and Ike. J Trauma Stress. 2010, 23: 509-513. 10.1002/jts.20539.CrossRefPubMed
12.
go back to reference Crits-Christoph P, Frank E, Chambless DL, Brody C, Karp JF: Training in empirically validated treatments: what are clinical psychology students learning?. Prof Psychol: Res Pract. 1995, 26: 514-522.CrossRef Crits-Christoph P, Frank E, Chambless DL, Brody C, Karp JF: Training in empirically validated treatments: what are clinical psychology students learning?. Prof Psychol: Res Pract. 1995, 26: 514-522.CrossRef
13.
go back to reference Miller WR, Moyers TB, Arciniega L, Ernst D, Forcehimes A: Training, supervision and quality monitoring of the COMBINE Study behavioral interventions. J Stud Alcohol. 2005, Supplement No. 15: 188-195. discussion 168–189CrossRef Miller WR, Moyers TB, Arciniega L, Ernst D, Forcehimes A: Training, supervision and quality monitoring of the COMBINE Study behavioral interventions. J Stud Alcohol. 2005, Supplement No. 15: 188-195. discussion 168–189CrossRef
14.
go back to reference Elkins RM, McHugh RK, Santucci LC, Barlow DH: Improving the transportability of CBT for internalizing disorders in children. Clin Child Fam Psychol Rev. 2011, 14 (2): 161-173. 10.1007/s10567-011-0085-4.CrossRefPubMed Elkins RM, McHugh RK, Santucci LC, Barlow DH: Improving the transportability of CBT for internalizing disorders in children. Clin Child Fam Psychol Rev. 2011, 14 (2): 161-173. 10.1007/s10567-011-0085-4.CrossRefPubMed
15.
go back to reference Cook JM, Walser RD, Kane V, Ruzek JI, Woody G: Dissemination and feasibility of a cognitive-behavioral treatment for substance use disorders and posttraumatic stress disorder in the Veterans Administration. J Psychoactive Drugs. 2006, 38: 89-92. 10.1080/02791072.2006.10399831.CrossRefPubMed Cook JM, Walser RD, Kane V, Ruzek JI, Woody G: Dissemination and feasibility of a cognitive-behavioral treatment for substance use disorders and posttraumatic stress disorder in the Veterans Administration. J Psychoactive Drugs. 2006, 38: 89-92. 10.1080/02791072.2006.10399831.CrossRefPubMed
16.
go back to reference Levitt JT, Malta LS, Martin A, Davis L, Cloitre M: The flexible application of a manualized treatment for PTSD symptoms and functional impairment related to the 9/11 World Trade Center attack. Behav Res Ther. 2007, 45: 1419-1433. 10.1016/j.brat.2007.01.004.CrossRefPubMed Levitt JT, Malta LS, Martin A, Davis L, Cloitre M: The flexible application of a manualized treatment for PTSD symptoms and functional impairment related to the 9/11 World Trade Center attack. Behav Res Ther. 2007, 45: 1419-1433. 10.1016/j.brat.2007.01.004.CrossRefPubMed
17.
go back to reference Amodeo M, Robb N: Modifying methods and content to teach about alcohol and drug abuse cross- culturally. Subst Abus. 1997, 18: 1-12. 10.1080/08897079709511341.CrossRef Amodeo M, Robb N: Modifying methods and content to teach about alcohol and drug abuse cross- culturally. Subst Abus. 1997, 18: 1-12. 10.1080/08897079709511341.CrossRef
18.
go back to reference Squires DD, Hester RK: Development of a computer-based, brief intervention for drinkers: the increasing role for computers in the assessment and treatment of addictive behaviors. Behav Ther. 2002, 25: 59-65. Squires DD, Hester RK: Development of a computer-based, brief intervention for drinkers: the increasing role for computers in the assessment and treatment of addictive behaviors. Behav Ther. 2002, 25: 59-65.
19.
go back to reference Weingardt KR: The role of instructional design and technology in the dissemination of empirically supported, manual-based therapies. Clin Psychol Sci Pract. 2004, 11: 313-331. 10.1093/clipsy.bph087.CrossRef Weingardt KR: The role of instructional design and technology in the dissemination of empirically supported, manual-based therapies. Clin Psychol Sci Pract. 2004, 11: 313-331. 10.1093/clipsy.bph087.CrossRef
20.
go back to reference Weingardt KR, Cucciare MA, Bellotti C, Lai WP: A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. J Subst Abuse Treat. 2009, 37: 219-227. 10.1016/j.jsat.2009.01.002.CrossRefPubMedPubMedCentral Weingardt KR, Cucciare MA, Bellotti C, Lai WP: A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. J Subst Abuse Treat. 2009, 37: 219-227. 10.1016/j.jsat.2009.01.002.CrossRefPubMedPubMedCentral
21.
go back to reference Weingardt KR, Villafranca SW, Levin C: Technology-based training in cognitive behavioral therapy for substance abuse counselors. Subst Abus. 2006, 27: 19-25. 10.1300/J465v27n03_04.CrossRefPubMed Weingardt KR, Villafranca SW, Levin C: Technology-based training in cognitive behavioral therapy for substance abuse counselors. Subst Abus. 2006, 27: 19-25. 10.1300/J465v27n03_04.CrossRefPubMed
22.
go back to reference Smith JL, Amrhein PC, Brooks AC, Carpenter KM, Levin D, Schreiber EA, Travaglini LA, Nunes EV: Providing live supervision via teleconferencing improves acquisition of motivational interviewing skills after workshop attendance. Am J Drug Alcohol Abuse. 2007, 33: 163-168. 10.1080/00952990601091150.CrossRefPubMed Smith JL, Amrhein PC, Brooks AC, Carpenter KM, Levin D, Schreiber EA, Travaglini LA, Nunes EV: Providing live supervision via teleconferencing improves acquisition of motivational interviewing skills after workshop attendance. Am J Drug Alcohol Abuse. 2007, 33: 163-168. 10.1080/00952990601091150.CrossRefPubMed
23.
go back to reference Baker TB, McFall RM, Shoham V: Current status and future prospects of clinical psychology. Psychol Sci Public Interest. 2008, 9: 67-103.PubMed Baker TB, McFall RM, Shoham V: Current status and future prospects of clinical psychology. Psychol Sci Public Interest. 2008, 9: 67-103.PubMed
24.
go back to reference Miller WR, Rollnick S: Motivational Interviewing: Preparing People for Change. 2002, Guilford, New York, 2 Miller WR, Rollnick S: Motivational Interviewing: Preparing People for Change. 2002, Guilford, New York, 2
25.
go back to reference Ruzek JI: Concurrent Posttraumatic Stress Disorder and Substance Use Disorder Among Substance Abuse, Posttraumatic Stress Disorder and Treatment 4 veterans: Evidence and Treatment Issues. 2002, American Psychological Association, Washington, DC Ruzek JI: Concurrent Posttraumatic Stress Disorder and Substance Use Disorder Among Substance Abuse, Posttraumatic Stress Disorder and Treatment 4 veterans: Evidence and Treatment Issues. 2002, American Psychological Association, Washington, DC
26.
go back to reference Milne D, James I: A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol. 2000, 39 (Pt 2): 111-127.CrossRefPubMed Milne D, James I: A systematic review of effective cognitive-behavioural supervision. Br J Clin Psychol. 2000, 39 (Pt 2): 111-127.CrossRefPubMed
27.
go back to reference Brownell M, Stillman P, Wang Y: Growing use of standardized patients in teaching and evaluation in medical education. Teach Learn Med. 1994, 6: 15-22. 10.1080/10401339409539637.CrossRef Brownell M, Stillman P, Wang Y: Growing use of standardized patients in teaching and evaluation in medical education. Teach Learn Med. 1994, 6: 15-22. 10.1080/10401339409539637.CrossRef
28.
go back to reference Barzansky B, Etzel SI: Educational programs in US medical schools, 2003–2004. Jama. 2004, 292: 1025-1031. 10.1001/jama.292.9.1025.CrossRefPubMed Barzansky B, Etzel SI: Educational programs in US medical schools, 2003–2004. Jama. 2004, 292: 1025-1031. 10.1001/jama.292.9.1025.CrossRefPubMed
29.
go back to reference Baer JS, Rosengren DB, Dunn CW, Wells EA, Ogle RL, Hartzler B: An evaluation of workshop training in motivational interviewing for addiction and mental health clinicians. Drug Alcohol Depend. 2004, 73: 99-106. 10.1016/j.drugalcdep.2003.10.001.CrossRefPubMed Baer JS, Rosengren DB, Dunn CW, Wells EA, Ogle RL, Hartzler B: An evaluation of workshop training in motivational interviewing for addiction and mental health clinicians. Drug Alcohol Depend. 2004, 73: 99-106. 10.1016/j.drugalcdep.2003.10.001.CrossRefPubMed
30.
go back to reference Rosengren DB, Baer JS, Hartzler B, Dunn CW, Wells EA: The video assessment of simulated encounters (VASE): Development and validation of a group-administered method for evaluating clinician skills in motivational interviewing. Drug Alcohol Depend. 2005, 79: 321-330. 10.1016/j.drugalcdep.2005.02.004.CrossRefPubMed Rosengren DB, Baer JS, Hartzler B, Dunn CW, Wells EA: The video assessment of simulated encounters (VASE): Development and validation of a group-administered method for evaluating clinician skills in motivational interviewing. Drug Alcohol Depend. 2005, 79: 321-330. 10.1016/j.drugalcdep.2005.02.004.CrossRefPubMed
31.
go back to reference Agresti A: Categorical Data Analysis. 1990, Wiley, Hoboken, New Jersey Agresti A: Categorical Data Analysis. 1990, Wiley, Hoboken, New Jersey
32.
go back to reference Portnoy DB, Scott-Sheldon LA, Johnson BT, Carey MP: Computer-delivered interventions for health promotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988–2007. Prev Med. 2008, 47: 3-16. 10.1016/j.ypmed.2008.02.014.CrossRefPubMedPubMedCentral Portnoy DB, Scott-Sheldon LA, Johnson BT, Carey MP: Computer-delivered interventions for health promotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988–2007. Prev Med. 2008, 47: 3-16. 10.1016/j.ypmed.2008.02.014.CrossRefPubMedPubMedCentral
33.
go back to reference USDHHS: Federal coordinating council for comparative effectiveness research report to the president and the congress. Federal Coordinating Council for Comparative Effectiveness Research Report to the President and the Congress. 2009, City USDHHS: Federal coordinating council for comparative effectiveness research report to the president and the congress. Federal Coordinating Council for Comparative Effectiveness Research Report to the President and the Congress. 2009, City
34.
go back to reference Bradley EH, Webster TR, Schlesinger M, Baker D, Inouye SK: Patterns of diffusion of evidence-based clinical programmes: a case study of the Hospital Elder Life Program. Qual Saf Health Care. 2006, 15: 334-338. 10.1136/qshc.2006.018820.CrossRefPubMedPubMedCentral Bradley EH, Webster TR, Schlesinger M, Baker D, Inouye SK: Patterns of diffusion of evidence-based clinical programmes: a case study of the Hospital Elder Life Program. Qual Saf Health Care. 2006, 15: 334-338. 10.1136/qshc.2006.018820.CrossRefPubMedPubMedCentral
35.
go back to reference Barrows HS: An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC. Acad Med. 1993, 68: 443-451. 10.1097/00001888-199306000-00002. discussion 451–443CrossRefPubMed Barrows HS: An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC. Acad Med. 1993, 68: 443-451. 10.1097/00001888-199306000-00002. discussion 451–443CrossRefPubMed
36.
go back to reference Harden RM, Gleeson FA: Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ. 1979, 13: 41-54.PubMed Harden RM, Gleeson FA: Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ. 1979, 13: 41-54.PubMed
37.
go back to reference Tunis SR, Stryer DB, Clancy CM: Practical clinical trials - Increasing the value of clinical research for decision making in clinical and health policy. Jama-J Am Med Assoc. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.CrossRef Tunis SR, Stryer DB, Clancy CM: Practical clinical trials - Increasing the value of clinical research for decision making in clinical and health policy. Jama-J Am Med Assoc. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.CrossRef
38.
go back to reference Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA: Practical clinical trials for translating research to practice - Design and measurement recommendations. Med Care. 2005, 43: 551-557. 10.1097/01.mlr.0000163645.41407.09.CrossRefPubMed Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA: Practical clinical trials for translating research to practice - Design and measurement recommendations. Med Care. 2005, 43: 551-557. 10.1097/01.mlr.0000163645.41407.09.CrossRefPubMed
39.
go back to reference Baer JS, Ball SA, Campbell BK, Miele GM, Schoener EP, Tracy K: Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug Alcohol Depend. 2007, 87: 107-118. 10.1016/j.drugalcdep.2006.08.028.CrossRefPubMed Baer JS, Ball SA, Campbell BK, Miele GM, Schoener EP, Tracy K: Training and fidelity monitoring of behavioral interventions in multi-site addictions research. Drug Alcohol Depend. 2007, 87: 107-118. 10.1016/j.drugalcdep.2006.08.028.CrossRefPubMed
40.
go back to reference Bennett GA, Moore J, Vaughan T, Rouse L, Gibbins JA, Thomas P, James K, Gower P: Strengthening Motivational Interviewing skills following initial training: a randomised trial of workplace-based reflective practice. Addict Behav. 2007, 32: 2963-2975. 10.1016/j.addbeh.2007.06.013.CrossRefPubMed Bennett GA, Moore J, Vaughan T, Rouse L, Gibbins JA, Thomas P, James K, Gower P: Strengthening Motivational Interviewing skills following initial training: a randomised trial of workplace-based reflective practice. Addict Behav. 2007, 32: 2963-2975. 10.1016/j.addbeh.2007.06.013.CrossRefPubMed
41.
go back to reference Murrihy R, Byrne MK: Training models for psychiatry in primary care: a new frontier. Australas Psychiatry. 2005, 13: 296-301.PubMed Murrihy R, Byrne MK: Training models for psychiatry in primary care: a new frontier. Australas Psychiatry. 2005, 13: 296-301.PubMed
Metadata
Title
Online self-administered training for post-traumatic stress disorder treatment providers: design and methods for a randomized, prospective intervention study
Authors
Josef I Ruzek
Raymond C Rosen
Lisa Marceau
Mary Jo Larson
Donn W Garvert
Lauren Smith
Anne Stoddard
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2012
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-7-43

Other articles of this Issue 1/2012

Implementation Science 1/2012 Go to the issue