Top

Published in:

Open Access 01-12-2017 | Research

Feasibility and acceptability of two incentive-based implementation strategies for mental health therapists implementing cognitive-behavioral therapy: a pilot study to inform a randomized controlled trial

Authors: Rinad S. Beidas, Emily M. Becker-Haimes, Danielle R. Adams, Laura Skriner, Rebecca E. Stewart, Courtney Benjamin Wolk, Alison M. Buttenheim, Nathaniel J. Williams, Patricia Inacker, Elizabeth Richey, Steven C. Marcus

Published in: Implementation Science | Issue 1/2017

Abstract

Background

Informed by our prior work indicating that therapists do not feel recognized or rewarded for implementation of evidence-based practices, we tested the feasibility and acceptability of two incentive-based implementation strategies that seek to improve therapist adherence to cognitive-behavioral therapy for youth, an evidence-based practice.

Methods

This study was conducted over 6 weeks in two community mental health agencies with therapists (n = 11) and leaders (n = 4). Therapists were randomized to receive either a financial or social incentive if they achieved a predetermined criterion on adherence to cognitive-behavioral therapy. In the first intervention period (block 1; 2 weeks), therapists received the reward they were initially randomized to if they achieved criterion. In the second intervention period (block 2; 2 weeks), therapists received both rewards if they achieved criterion. Therapists recorded 41 sessions across 15 unique clients over the project period. Primary outcomes included feasibility and acceptability. Feasibility was assessed quantitatively. Fifteen semi-structured interviews were conducted with therapists and leaders to assess acceptability. Difference in therapist adherence by condition was examined as an exploratory outcome. Adherence ratings were ascertained using an established and validated observational coding system of cognitive-behavioral therapy.

Results

Both implementation strategies were feasible and acceptable—however, modifications to study design for the larger trial will be necessary based on participant feedback. With respect to our exploratory analysis, we found a trend suggesting the financial reward may have had a more robust effect on therapist adherence than the social reward.

Conclusions

Incentive-based implementation strategies can be feasibly administered in community mental health agencies with good acceptability, although iterative pilot work is essential. Larger, fully powered trials are needed to compare the effectiveness of implementation strategies to incentivize and enhance therapists’ adherence to evidence-based practices such as cognitive-behavioral therapy.

Available only for authorised users

McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments: a review of current efforts. Am Psychol. 2010;65(2):73. https://doi.org/10.1037/a0018121.CrossRefPubMed

Gotham HJ, White MK, Bergethon HS, Feeney T, Cho DW, Keehn B. An implementation story: moving the GAIN from pilot project to statewide use. J Psychoactive Drugs. 2008;40(1):97–107. https://doi.org/10.1080/02791072.2008.10399765.CrossRefPubMed

Chambless DL, Ollendick TH. Empirically supported psychological interventions: controversies and evidence. Annu Rev Psychol. 2001;52(1):685–716. https://doi.org/10.1146/annurev.psych.52.1.685.CrossRefPubMed

Hemmelgarn AL, Glisson C, James LR. Organizational culture and climate: implications for services and interventions research. Clin Psychol-Sci Pr. 2006;13(1):73–89. https://doi.org/10.1111/j.1468-2850.2006.00008.x.CrossRef

Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, et al. Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatr. 2015;169(4):374–82. https://doi.org/10.1001/jamapediatrics.2014.3736.CrossRefPubMedPubMedCentral

Kazdin AE. Treatment as usual and routine care in research and clinical practice. Clin Psychol Rev. 2015;42:168–78. https://doi.org/10.1016/j.cpr.2015.08.006.CrossRefPubMed

Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57. https://doi.org/10.1177/1077558711430690.CrossRefPubMed

Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. https://doi.org/10.1186/s13012-015-0209-1.CrossRefPubMedPubMedCentral

Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45(5):626–9. https://doi.org/10.1016/j.jpsychires.2010.10.008.CrossRefPubMed

10.

Beidas RS, Stewart RE, Adams DR, Fernandez T, Lustbader S, Powell BJ, et al. A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Adm Policy Ment Hlth. 2016;43(6):893–908. https://doi.org/10.1007/s10488-015-0705-2.CrossRef

11.

Beidas RS, Aarons G, Barg F, Evans A, Hadley T, Hoagwood K, et al. Policy to implementation: evidence-based practice in community mental health—study protocol. Implement Sci. 2013;8:38. https://doi.org/10.1186/1748-5908-8-38.CrossRefPubMedPubMedCentral

12.

Stewart RE, Adams DR, Mandell DS, Hadley TR, Evans AC, Rubin R, et al. The perfect storm: collision of the business of mental health and the implementation of evidence-based practices. Psychiatr Serv. 2016;67(2):159–61. https://doi.org/10.1176/appi.ps.201500392.CrossRefPubMed

13.

Volpp KG, Asch DA, Galvin R, Loewenstein G. Redesigning employee health incentives—lessons from behavioral economics. N Engl J Med. 2011;365(5):388–90. https://doi.org/10.1056/NEJMp1105966.CrossRefPubMedPubMedCentral

14.

Asch DA, Troxel AB, Stewart WF, Sequist TD, Jones JB, Hirsch AG, et al. Effect of financial incentives to physicians, patients, or both on lipid levels: a randomized clinical trial. JAMA. 2015;314(18):1926–35. https://doi.org/10.1001/jama.2015.14850.CrossRefPubMedPubMedCentral

15.

Troxel AB, Asch DA, Volpp KG: Statistical issues in pragmatic trials of behavioral economic interventions. Clin Trials 2016:1740774516654862. doi: https://doi.org/10.1177/1740774516654862.

16.

Halpern SD, French B, Small DS, Saulsgiver K, Harhay MO, Audrain-McGovern J, et al. Randomized trial of four financial-incentive programs for smoking cessation. N Engl J Med. 2015;372(22):2108–17. https://doi.org/10.1056/NEJMoa1414293.CrossRefPubMedPubMedCentral

17.

Loewenstein G, Asch DA, Volpp KG. Behavioral economics holds potential to deliver better results for patients, insurers, and employers. Health Affair. 2013;32(7):1244–50. https://doi.org/10.1377/hlthaff.2012.1163.CrossRef

18.

Volpp KG, Troxel AB, Pauly MV, Glick HA, Puig A, Asch DA, et al. A randomized, controlled trial of financial incentives for smoking cessation. N Engl J Med. 2009;360(7):699–709. https://doi.org/10.1056/NEJMsa0806819.CrossRefPubMed

19.

Emanuel EJ, Ubel PA, Kessler JB, Meyer G, Muller RW, Navathe AS, et al. Using behavioral economics to design physician incentives that deliver high-value care behavioral economics, physician incentives, and high-value care. Ann Intern Med. 2016;164(2):114–9. https://doi.org/10.7326/M15-1330.CrossRefPubMed

20.

Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95. https://doi.org/10.1007/s12160-013-9486-6.CrossRefPubMed

21.

Arnold DR. Countervailing incentives in value-based payment, In Healthcare. 2017;5(3):125–8. ISSN 2213-0764. https://doi.org/10.1016/j.hjdsi.2016.04.009. http://www.sciencedirect.com/science/article/pii/S2213076416300392.

22.

Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Libr. 2011; https://doi.org/10.1002/14651858.CD009255.

23.

Garner BR, Godley SH, Dennis ML, Hunter BD, Bair CM, Godley MD. Using pay for performance to improve treatment implementation for adolescent substance use disorders: results from a cluster randomized trial. Arch Pediatr Adolesc Med. 2012;166(10):938–44. https://doi.org/10.1001/archpediatrics.2012.802.CrossRefPubMed

24.

Vandrey R, Stitzer ML, Acquavita SP, Quinn-Stabile P. Pay-for-performance in a community substance abuse clinic. J Subst Abus Treat. 2011;41(2):193–200. https://doi.org/10.1016/j.jsat.2011.03.001.CrossRef

25.

The National Child Traumatic Stress Network: NCTSN Financing and Sustainability Survey Report. 2016: 1–17. http://www.nctsn.org/sites/all/modules/pubdlcnt/pubdlcnt.php?file=/sites/default/files/assets/pdfs/nctsn_financing_and_sustainability_survey_report.pdf&nid=1784. Accessed: April 28, 2017.

26.

Navathe AS, Sen AP, Rosenthal MB, Pearl RM, Ubel PA, Emanuel EJ, et al. New strategies for aligning physicians with health system incentives. Am J Manag C. 2016;22(9):610.

27.

Liao JM, Fleisher LA, Navathe AS. Increasing the value of social comparisons of physician performance using norms. J Am Med Assoc. 2016;316(11):1151–2. https://doi.org/10.1001/jama.2016.10094.CrossRef

28.

Kolstad JR, Lindkvist I. Pro-social preferences and self-selection into the public health sector: evidence from an economic experiment. Health Policy Plan. 2013;28(3):320–7. https://doi.org/10.1093/heapol/czs063.CrossRefPubMed

29.

Powell BJ, Beidas RS, Rubin RM, Stewart RE, Wolk CB, Matlin SL, et al. Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Admin Pol Ment Health. 2016;43(6):909–26. https://doi.org/10.1007/s10488-016-0733-6.CrossRef

30.

Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cognitive Ther Res. 2012;36(5):427–40. https://doi.org/10.1007/s10608-012-9476-1.CrossRef

31.

Weisz JR, Kuppens S, Ng MY, Eckshtain D, Ugueto AM, Vaughn-Coaxum R, et al: What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. Am Psychol 2017;2(72). doi: https://doi.org/10.1037/a0040360.

32.

Dorsey S, McLaughlin KA, Kerns SE, Harrison JP, Lambert HK, Briggs EC, et al. Evidence base update for psychosocial treatments for children and adolescents exposed to traumatic events. J Clin Child Adolesc Psychol. 2017;46(3):303–30. https://doi.org/10.1080/15374416.2016.1220309.CrossRefPubMed

33.

Sburlati ES, Schniering CA, Lyneham HJ, Rapee RM. A model of therapist competencies for the empirically supported cognitive behavioral treatment of child and adolescent anxiety and depressive disorders. Clin Child Fam Psychol Rev. 2011;14(1):89–109. https://doi.org/10.1007/s10567-011-0083-6.CrossRefPubMed

34.

Read D, Loewenstein G, Rabin M, Keren G, Laibson D. Choice bracketing. In: Fischhoff B, Manski CF, editors. Elicitation of preferences. Norwell, MA: Springer; 1999. p. 171–202.CrossRef

35.

McLeod BD, Smith MM, Southam-Gerow MA, Weisz JR, Kendall PC. Measuring treatment differentiation for implementation research: The Therapy Process Observational Coding System for Child Psychotherapy Revised Strategies scale. Psychol Assessment. 2015;27(1):314. https://doi.org/10.1037/pas0000037.CrossRef

36.

McLeod BD, Weisz JR. The therapy process observational coding system for child psychotherapy strategies scale. J Clin Child Adolesc Psychol. 2010;39(3):436–43. https://doi.org/10.1080/15374411003691750.CrossRefPubMed

37.

Smith MM, McLeod BD, Southam-Gerow MA, Jensen-Doss A, Kendall PC, Weisz JR. Does the delivery of CBT for youth anxiety differ across research and practice settings? Behav Ther. 2016; https://doi.org/10.1016/j.beth.2016.07.004.

38.

Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72. https://doi.org/10.1111/j.1475-6773.2006.00684.x.CrossRefPubMedPubMedCentral

39.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977:159–74. https://doi.org/10.2307/2529310.

40.

Eisenberg D, Druss BG. Time preferences, mental health and treatment utilization. J Ment Health Policy. 2015;18(3):125–36.

41.

Beidas RS, Maclean JC, Fishman J, Dorsey S, Schoenwald SK, Mandell DS, et al. A randomized trial to identify accurate and cost-effective fidelity measurement methods for cognitive-behavioral therapy: project FACTS study protocol. BMC Psychiatry. 2016;16(1):323. https://doi.org/10.1186/s12888-016-1034-z.CrossRefPubMedPubMedCentral

42.

Mills EJ, Chan A-W, Wu P, Vail A, Guyatt GH, Altman DG. Design, analysis, and presentation of crossover trials. Trials. 2009;10(1):27. https://doi.org/10.1186/1745-6215-10-27.CrossRefPubMedPubMedCentral

43.

Blumenthal-Barby JS, Burroughs H. Seeking better health care outcomes: the ethics of using the “nudge”. Am J Bioeth. 2012;12(2):1–10. https://doi.org/10.1080/15265161.2011.634481.CrossRefPubMed

44.

Lunze K, Paasche-Orlow MK. Financial incentives for healthy behavior: ethical safeguards for behavioral economics. Am J Prev Med. 2013;44(6):659–65. https://doi.org/10.1016/j.amepre.2013.01.035.CrossRefPubMed

45.

Heyman J, Ariely D. Effort for payment: a tale of two markets. Psychol Sci. 2004;15(11):787–93. https://doi.org/10.1111/j.0956-7976.2004.00757.x.CrossRefPubMed

46.

Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55(1):68.CrossRefPubMed

47.

Deci EL, Koestner R, Ryan RM. A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychol Bull. 1999;125(6):627–68. http://dx.doi.org/10.1037/0033-2909.125.6.627.

48.

Cerasoli CP, Nicklin JM, Ford MT. Intrinsic motivation and extrinsic incentives jointly predict performance: a 40-year meta-analysis. Psychol Bull. 2014;140(4):980. https://doi.org/10.1080/15374416.2016.1220309.CrossRefPubMed

49.

Jenkins Jr GD, Mitra A, Gupta N, Shaw JD. Are financial incentives related to performance? A meta-analytic review of empirical research. J Appl Psychol. 1998;83(5):777–87. http://dx.doi.org/10.1037/0021-9010.83.5.777.

50.

Gibbons MBC, Rothbard A, Farris KD, Stirman SW, Thompson SM, Scott K, et al. Changes in psychotherapy utilization among consumers of services for major depressive disorder in the community mental health system. Adm Policy Ment Hlth. 2011;38(6):495–503. https://doi.org/10.1007/s10488-011-0336-1.CrossRef

51.

Navathe AS, Emanuel EJ. Physician peer comparisons as a nonfinancial strategy to improve the value of care. JAMA. 2016;316(17):1759–60. https://doi.org/10.1001/jama.2016.13739.CrossRefPubMed

52.

Alexander JA, Maeng D, Casalino LP, Rittenhouse D. Use of care management practices in small-and medium-sized physician groups: do public reporting of physician quality and financial incentives matter? Health Serv Res. 2013;48(2pt1):376–97. https://doi.org/10.1111/j.1475-6773.2012.01454.x. CrossRefPubMed

53.

Wiley JA, Rittenhouse DR, Shortell SM, Casalino LP, Ramsay PP, Bibi S, et al. Managing chronic illness: physician practices increased the use of care management and medical home processes. Health Affair. 2015;34(1):78–86. https://doi.org/10.1377/hlthaff.2014.0404.CrossRef

54.

Luthans F, Rhee S, Luthans BC, Avey JB. Impact of behavioral performance management in a Korean application. Leadership Org Dev J. 2008;29(5):427–43. https://doi.org/10.1108/01437730810887030.CrossRef

55.

Ashraf N, Bandiera O, Lee SS. Awards unbundled: evidence from a natural field experiment. J Econ Behav Organ. 2014;100:44–63. https://doi.org/10.1016/j.jebo.2014.01.001.CrossRef

56.

Powell BJ, Proctor EK, Glass JE. A systematic review of strategies for implementing empirically supported mental health interventions. Res Soc Work Pract. 2014;24(2):192–212. https://doi.org/10.1177/1049731513505778.CrossRefPubMed

57.

Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6 https://doi.org/10.1002/14651858.CD000259.pub3.

58.

Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiat. 2006;63(5):484–9. https://doi.org/10.1001/archpsyc.63.5.484.CrossRefPubMed

59.

Haine-Schlagel R, Fettes DL, Garcia AR, Brookman-Frazee L, Garland AF. Consistency with evidence-based treatments and perceived effectiveness of children’s community-based care. Community Ment Hlt J. 2014;50(2):158–63. https://doi.org/10.1007/s10597-012-9583-1.CrossRef

60.

Garland AF, Brookman-Frazee L, Hurlburt MS, Accurso EC, Zoffness RJ, Haine-Schlagel R, et al. Mental health care for children with disruptive behavior problems: a view inside therapists’ offices. Psychiatr Serv. 2010;61(8):788–95. https://doi.org/10.1176/ps.2010.61.8.788.CrossRefPubMedPubMedCentral

61.

Jacobs SR, Weiner BJ, Reeve BB, Hofmann DA, Christian M. The missing link: a test of Klein and Sorra’s proposed relationship between implementation climate, innovation-values fit and implementation effectiveness. Implement Sci. 2015;10:A18. https://doi.org/10.1186/1748-5908-10-S1-A18.CrossRefPubMedCentral

62.

Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, et al. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Hlth. 2008;35(1–2):98. https://doi.org/10.1007/s10488-007-0148-5.CrossRef

63.

Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC organizational strategy: increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Adm Policy Ment Hlth. 2017;44(2):269–83. https://doi.org/10.1007/s10488-016-0742-5.CrossRef

64.

Williams NJ, Glisson C. The role of organizational culture and climate in the dissemination and implementation of empirically supported treatments for youth. In: Beidas RS, Kendall PC, editors. Dissemination and implementation of evidence-based practices in child and adolescent mental health; 2014. p. 61–81.

65.

Edmondson A. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44(2):350–83.CrossRef

66.

Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8(1):139. doi:CrossRefPubMedPubMedCentral

Title: Feasibility and acceptability of two incentive-based implementation strategies for mental health therapists implementing cognitive-behavioral therapy: a pilot study to inform a randomized controlled trial
Authors: Rinad S. Beidas
Emily M. Becker-Haimes
Danielle R. Adams
Laura Skriner
Rebecca E. Stewart
Courtney Benjamin Wolk
Alison M. Buttenheim
Nathaniel J. Williams
Patricia Inacker
Elizabeth Richey
Steven C. Marcus
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-017-0684-7

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Feasibility and acceptability of two incentive-based implementation strategies for mental health therapists implementing cognitive-behavioral therapy: a pilot study to inform a randomized controlled trial

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2017

Barriers and facilitators to reducing frequent laboratory testing for patients who are stable on warfarin: a mixed methods study of de-implementation in five anticoagulation clinics

Electronic Laboratory Medicine ordering with evidence-based Order sets in primary care (ELMO study): protocol for a cluster randomised trial

The use of evidence in English local public health decision-making: a systematic scoping review

Intervention planning for a digital intervention for self-management of hypertension: a theory-, evidence- and person-based approach

Community-based participatory research and integrated knowledge translation: advancing the co-creation of knowledge

Optimising the value of the evidence generated in implementation science: the use of ontologies to address the challenges