Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-01-2020 | Original Article

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

Authors: Iris Sijercic, Jeanine E. M. Lane, Cassidy A. Gutner, Candice M. Monson, Shannon Wiltsey Stirman

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1/2020

Abstract

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians’ willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Aarons, G. A. (2005). Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America,14, 255–271. https://doi.org/10.1016/j.chc.2004.04.008.CrossRefPubMedPubMedCentral

Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research,39, 331–340. https://doi.org/10.1007/s10488-010-0302-3.CrossRefPubMed

Aarons, G. A., & Sawitzky, A. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services,3, 61–72. https://doi.org/10.1037/1541-1559.3.1.61.CrossRefPubMedPubMedCentral

Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology,77, 270–280. https://doi.org/10.1037/a0013223.CrossRefPubMedPubMedCentral

Asgary-Eden, V., & Lee, C. M. (2012). Implementing an evidence-based parenting program in community agencies: What helps and what gets in the way? Administration and Policy in Mental Health and Mental Health Services Research,39, 478–488. https://doi.org/10.1007/s10488-011-0371-y.CrossRefPubMed

Becker-Haimes, E. M., Williams, N. J., Okamura, K. H., & Beidas, R. S. (2019). Interactions between clinician and organizational characteristics to predict cognitive-behavioral and psychodynamic therapy use. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-019-00959-6.CrossRefPubMed

Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research,41, 788–799. https://doi.org/10.1007/s10488-013-0529-x.CrossRefPubMed

Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., … Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. Journal of the American Medical Association Pediatrics, 169, 374–382. https://doi.org/10.1001/jamapediatrics.2014.3736

Campbell, B. K., Buti, A., Fussell, H. E., Srikanth, P., McCarty, D., & Guydish, J. R. (2013). Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. The American Journal of Drug and Alcohol Abuse,39, 304–311. https://doi.org/10.3109/00952990.2013.799175.CrossRefPubMedPubMedCentral

Carpenter, K. M., Cheng, W. Y., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R. M., et al. (2012). “Old dogs” and new skills: How clinician characteristics relate to motivational interviewing skills before, during, and after training. Journal of Consulting and Clinical Psychology,80, 560–573. https://doi.org/10.1037/a0028362.CrossRefPubMedPubMedCentral

Cook, J. M., Dinnen, S., Thompson, R., Simiola, V., & Schnurr, P. P. (2014). Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: A national investigation. Journal of Traumatic Stress,27, 137–143. https://doi.org/10.1002/jts.21902.CrossRefPubMedPubMedCentral

Creed, T. A., Frankel, S. A., German, R. E., Green, K. L., Jager-Hyman, S., Taylor, K. P., et al. (2016). Implementation of transdiagnostic cognitive therapy in community behavioral health: The beck community initiative. Journal of Consulting and Clinical Psychology. https://doi.org/10.1037/ccp0000105.CrossRefPubMedPubMedCentral

Decker, S. E., Jameson, M. T., & Naugle, A. E. (2011). Therapist training in empirically supported treatments: A review of evaluation methods for short- and long-term outcomes. Administration and Policy in Mental Health and Mental Health Services Research,38, 254–286. https://doi.org/10.1007/s10488-011-0360-1.CrossRefPubMed

Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the implementation climate scale (ICS). Implementation Science,9, 11. https://doi.org/10.1186/s13012-014-0157-1.CrossRef

Enders, C. K. (2001). A primer on maximum likelihood algorithms available for use with missing data. Structural Equation Modeling,8, 128–141. https://doi.org/10.1207/S15328007SEM0801_7.CrossRef

Farmer, C. C., Mitchell, K. S., Parker-Guilbert, K., & Galovski, T. E. (2017). Fidelity to the cognitive processing therapy protocol: Evaluation of critical elements. Behavior Therapy,48, 195–206. https://doi.org/10.1016/j.beth.2016.02.009.CrossRefPubMed

Forsberg, S., Fitzpatrick, K. K., Darcy, A., Aspen, V., Accurso, E. C., Bryson, S. W., … Lock, J. (2015). Development and evaluation of a treatment fidelity instrument for family-based treatment of adolescent anorexia nervosa. International Journal of Eating Disorders, 48, 91–99. https://doi.org/10.1002/eat.22337

Garner, B. R., Hunter, B. D., Godley, S. H., & Godley, M. D. (2012). Training and retaining staff to competently deliver an evidence-based practice: The role of staff attributes and perceptions of organizational functioning. Journal of Substance Abuse Treatment,42, 191–200. https://doi.org/10.1016/j.jsat.2011.10.016.CrossRefPubMed

Glick, W. H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review,10, 601–616. https://doi.org/10.2307/258140.CrossRef

Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect,35, 582–591. https://doi.org/10.1016/j.chiabu.2011.04.009.CrossRefPubMed

Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology,78, 537–550. https://doi.org/10.1037/a0019160.CrossRefPubMedPubMedCentral

Godley, S. H., White, W. L., Diamond, G., Passetti, L., & Titus, J. C. (2001). Therapist reactions to manual-guided therapies for the treatment of adolescent marijuana users. Clinical Psychology: Science and Practice,8, 405–417. https://doi.org/10.1093/clipsy.8.4.405.CrossRef

Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., et al. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology,76, 556–567. https://doi.org/10.1037/0022-006X.76.4.556.CrossRefPubMedPubMedCentral

Hoagwood, K., Schoenwald, S. K., & Chapman, J. E. (2003). Dimensions of Organizational Readiness-Revised (DOOR-R). Unpublished instrument.

Holder, N., Holliday, R., Williams, R., Mullen, K., & Suris, A. (2017). A preliminary examination of the role of psychotherapist fidelity on outcomes of cognitive processing therapy during an RCT for military sexual trauma-related PTSD. Cognitive Behaviour Therapy,47, 76–89. https://doi.org/10.1080/16506073.2017.1357750.CrossRefPubMed

James, I. A., Blackburn, I. M., Milne, D. L., & Reichfelt, F. K. (2001). Moderators of trainee therapists’ competence in cognitive therapy. British Journal of Clinical Psychology,40, 131–140. https://doi.org/10.1348/014466501163580.CrossRefPubMed

James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., et al. (2008). Organizational and psychological climate: A review of theory and research. European Journal of work and organizational psychology,17, 5–32. https://doi.org/10.1080/13594320701662550.CrossRef

Jerrell, J. M., & Ridgely, M. S. (1999). Impact of robustness of program implementation on outcomes of clients in dual diagnosis programs. Psychiatric Services,50, 109–112. https://doi.org/10.1176/ps.50.1.109.CrossRefPubMed

Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions. Organizational Behavior and Human Performance,23, 201–250. https://doi.org/10.1016/0030-5073(79)90056-4.CrossRef

Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement,56, 746–759. https://doi.org/10.1177/0013164496056005002.CrossRef

Kolko, D. J., Baumann, B. L., Herschell, A. D., Hart, J. A., Holden, E. A., & Wisniewski, S. R. (2012). Implementation of AF-CBT by community practitioners serving child welfare and mental health: A randomized trial. Child Maltreatment,17, 32–46. https://doi.org/10.1177/1077559511427346.CrossRefPubMed

Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment,22, 197–209. https://doi.org/10.1016/S0740-5472(02)00233-7.CrossRefPubMed

Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research,38, 324–334. https://doi.org/10.1007/s10488-011-0348-x.CrossRefPubMed

Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association,83, 1198–1202. https://doi.org/10.1080/01621459.1988.10478722.CrossRef

Lu, W., Yanos, P. T., Gottlieb, J. D., Duva, S. M., Silverstein, S. M., Xie, H., … Mueser, K. T. (2014). Use of fidelity assessments to train clinicians in the CBT for PTSD program for clients with serious mental illness. Psychiatric Services, 63, 785–792. https://doi.org/10.1176/appi.ps.201000458

McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist,65, 73–84. https://doi.org/10.1037/a0018121.CrossRefPubMed

McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services,50, 818–824. https://doi.org/10.1176/ps.50.6.818.CrossRefPubMed

Meier, A., McGovern, M. P., Lambert-Harris, C., McLeman, B., Franklin, A., Saunders, E. C., et al. (2015). Adherence and competence in two manual-guided therapies for co-occurring substance use and posttraumatic stress disorders: Clinician factors and patient outcomes. The American Journal of Drug and Alcohol Abuse,41, 527–534. https://doi.org/10.3109/00952990.2015.1062894.CrossRefPubMedPubMedCentral

Monson, C. M., Shields, N., Suvak, M. K., Lane, J. E. M., Shnaider, P., Landy, M. S. H., et al. (2018). A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes. Behaviour Research and Therapy, 110, 31–40.CrossRef

Moore, G. A. (2002). Crossing the chasm: Marketing and selling high-tech products to mainstream customers. New York: Harper Collins.

Nishith, P., & Resick, P. A. (1994). Cognitive Processing Therapy (CPT): Therapist adherence and competence protocol. St. Louis: University of Missouri.

Patterson, M. G., West, M. A., Shackelton, V. J., Dawson, J. F., Lawthom, R., Maitlis, S., et al. (2005). Validating the organizational climate measure: Links to managerial practices, productivity and innovation. Journal of Organizational Behavior,26, 379–408. https://doi.org/10.1002/job.312.CrossRef

Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. https://doi.org/10.1007/s10488-010-0319-7

Resick, P. A., Galovski, T. E., Uhlmansiek, M. O., Scher, C., Clum, G. A., & Young-Xu, Y. (2008). A randomized clinical trial to dismantle components of cognitive processing therapy for posttraumatic stress disorder in female victims of interpersonal violence. Journal of Consulting and Clinical Psychology,76, 243–258. https://doi.org/10.1037/0022-006X.76.2.243.CrossRefPubMedPubMedCentral

Resick, P. A., Monson, C. M., & Chard, K. (2016). Cognitive processing therapy for PTSD: A comprehensive manual. New York, NY: Guilford.

Resick, P. A., Nishith, P., Weaver, T. L., Astin, M. C., & Feuer, C. A. (2002). A comparison of cognitive-processing therapy with prolonged exposure and a waiting condition for the treatment of chronic posttraumatic stress disorder in female rape victims. Journal of Consulting and Clinical Psychology,70, 867–879. https://doi.org/10.1037/0022-006X.70.4.867.CrossRefPubMedPubMedCentral

Rodriguez, A. (2016). The influence of client-, family-, and therapist-level pretreatment characteristics on therapist delivery of youth psychotherapy treatments (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 10145732).

Sainani, K. L. (2012). Dealing with non-normal data. American Academy of Physical Medicine and Rehabilitation,4, 1001–1005. https://doi.org/10.1016/j.pmrj.2012.10.013.CrossRef

Saldana, L., Chapman, J. E., Henggeler, S. W., & Rowland, M. D. (2007). The Organizational readiness for change scale in adolescent programs: Criterion validity. Journal of Substance Abuse Treatment,33, 159–169. https://doi.org/10.1016/j.jsat.2006.12.029.CrossRefPubMedPubMedCentral

Sanders, M. R., & Turner, K. M. T. (2005). Reflections on the challenges of effective dissemination of behavioural family intervention: Our experience with the triple p-positive parenting program. Child and Adolescent Mental Health,10, 158–169. https://doi.org/10.1111/j.1475-3588.2005.00367.x.CrossRef

Sayer, N. A., Rosen, C. S., Bernardy, N. C., Cook, J. M., Orazem, R. J., Chard, K. M., … Schnurr, P. P. (2017). Context matters: Team and organizational factors associated with reach of evidence-based psychotherapies for PTSD in the veterans health administration. Administration and Policy in Mental Health and Mental Health Services Research, 44, 904–918. https://doi.org/10.1007/s10488-017-0809-y

Scheffer, J. (2002). Dealing with missing data. Research Letters in the Information and Mathematical Sciences,3, 153–160.

Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology,38, 91–105. https://doi.org/10.1080/15374410802575388.CrossRefPubMedPubMedCentral

Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. (2005). Predicting therapist adherence to a transported family-based treatment for youth. Journal of Clinical Child and Adolescent Psychology,34, 658–670. https://doi.org/10.1207/s15374424jccp3404_8.CrossRefPubMed

Shmueli, G. (2010). To explain or to predict? Statistical Science,25, 289–310. https://doi.org/10.1214/10-STS330.CrossRef

Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment,22, 171–182. https://doi.org/10.1016/S0740-5472(02)00231-3.CrossRefPubMed

Stirman, S. W., Finley, E. P., Shields, N., Cook, J., Haine-Schlagel, R., Burgess, J. F., … Monson, C. M. (2017). Improving and sustaining delivery of CPT for PTSD in mental health systems: A cluster randomized trial. Implementation Science, 12, 32. https://doi.org/10.1186/s13012-017-0544-5

Stirman, S. W., Gutner, C. A., Crits-Christoph, P., Edmunds, J., Evans, A. C., & Beidas, R. S. (2015). Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Science,10, 115–125. https://doi.org/10.1186/s13012-015-0308-z.CrossRef

Stirman, S. W., Shields, N., Deloriea, J., Landy, M. S. H., Belus, J. M., Maslej, M. M., et al. (2013). A randomized controlled dismantling trial of post-workshop consultation strategies to increase effectiveness and fidelity to an evidence-based psychotherapy for posttraumatic stress disorder. Implementation Science,8, 82–90. https://doi.org/10.1186/1748-5908-8-82.CrossRef

Strunk, D. R., Brotman, M. A., & DeRubeis, R. J. (2010a). The process of change in cognitive therapy for depression: Predictors of early inter-session symptom gains. Behaviour Research and Therapy,48, 599–606. https://doi.org/10.1016/j.brat.2010.03.011.CrossRefPubMedPubMedCentral

Strunk, D. R., Brotman, M. A., DeRubeis, R. J., & Hollon, S. D. (2010b). Therapist competence in cognitive therapy for depression: Predicting subsequent symptom change. Journal of Consulting and Clinical Psychology,78, 429–437. https://doi.org/10.1037/a0019631.CrossRefPubMedPubMedCentral

Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal,46, 119–129. https://doi.org/10.1007/s10597-009-9202-y.CrossRefPubMed

Thijssen, J., Albrecht, G., Muris, P., & de Ruiter, C. (2017). Treatment fidelity during therapist initial training is related to subsequent effectiveness of parent management training: Oregon Model. Journal of Child and Family Studies,26, 1991–1999. https://doi.org/10.1007/s10826-017-0706-8.CrossRefPubMedPubMedCentral

Tooley, E. (2012). Organizational factors and therapist attitudes in the prediction of MI adoption (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3553901).

Whitaker, D. J., Ryan, K. A., Wild, R. C., Self-Brown, S., Lutzker, J. R., Shanley, J. R., et al. (2012). Initial implementation indicators from a statewide rollout of SafeCare within a child welfare system. Child Maltreatment,17, 96–101. https://doi.org/10.1177/1077559511430722.CrossRefPubMed

Zazzali, J. L., Sherbourne, C., Hoagwood, K. E., Greene, D., Bigley, M. F., & Sexton, T. L. (2008). The adoption and implementation of an evidence based practice in child and family mental health services organizations: A pilot study of functional family therapy in New York state. Administration and Policy in Mental Health and Mental Health Services Research,35, 38–49. https://doi.org/10.1007/s10488-007-0145-8.CrossRefPubMed

Title: The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial
Authors: Iris Sijercic
Jeanine E. M. Lane
Cassidy A. Gutner
Candice M. Monson
Shannon Wiltsey Stirman
Publication date: 01-01-2020
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 1/2020
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-019-00966-7

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2020

Awareness of Suicide Prevention Programs Among U.S. Military Veterans

Correction to: The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

Organizational Climate and Support Among Peer Specialists Working in Peer-Run, Hybrid and Conventional Mental Health Settings

The Homeless and Their Animal Companions: An Integrative Review

Opportunities for and Tensions Surrounding the Use of Technology-Enabled Mental Health Services in Community Mental Health Care

Development of Quality Management Capacity in Child-Serving Nonprofit Agencies