Top

Social Psychiatry and Psychiatric Epidemiology

Published in:

01-05-2019 | Review

Effectiveness of supported employment in non-trial routine implementation: systematic review and meta-analysis

Authors: Dirk Richter, Holger Hoffmann

Published in: Social Psychiatry and Psychiatric Epidemiology | Issue 5/2019

Abstract

Purpose

While supported employment (SE) programs for people with mental illness have demonstrated their superiority in randomized controlled trials (RCTs) and meta-analyses, little is known about the effectiveness of non-trial routine programs. The primary objective of this study was to estimate a pooled competitive employment rate of non-trial SE programs by means of a meta-analysis. A secondary objective was to compare this result to competitive employment rates of SE programs in RCTs, prevocational training programs in RCTs and in routine implementation.

Methods

A systematic review and a random-effects meta-analysis of proportions were conducted. Quality assessment was provided. Moderator analyses by subgroup comparisons were conducted.

Results

Results from 28 samples were included in the meta-analysis. The pooled competitive employment rate for SE routine programs was 0.43 (95% CI 0.37–0.50). The pooled competitive employment rates for comparison conditions were: SE programs in RCTs: 0.50 (95% CI 0.43–0.56); prevocational programs in RCTs: 0.22 (95% CI 0.16–0.28); prevocational programs in routine programs: 0.17 (95% CI 0.11–0.23). SE routine studies conducted prior to 2008 showed a significantly higher competitive employment rate.

Conclusion

SE routine programs lose only little effectiveness compared to SE programs from RCTs but are much more successful in reintegrating participants into the competitive labor market than prevocational programs. Labor market conditions have to be taken into account when evaluating SE programs.

Available only for authorised users

Modini M, Tan L, Brinchmann B, Wang MJ, Killackey E, Glozier N, Mykletun A, Harvey SB (2016) Supported employment for people with severe mental illness: systematic review and meta-analysis of the international evidence. Br J Psychiatry 209(1):14–22. https://doi.org/10.1192/bjp.bp.115.165092 CrossRefPubMed

Suijkerbuijk YB, Schaafsma FG, van Mechelen JC, Ojajarvi A, Corbiere M, Anema JR (2017) Interventions for obtaining and maintaining employment in adults with severe mental illness, a network meta-analysis. Cochrane Database Syst Rev 9:CD011867. https://doi.org/10.1002/14651858.CD011867.pub2 CrossRefPubMed

Johnson-Kwochka A, Bond GR, Becker DR, Drake RE, Greene MA (2017) Prevalence and quality of individual placement and support (IPS) supported employment in the United States. Adm Policy Ment Health 44(3):311–319. https://doi.org/10.1007/s10488-016-0787-5 CrossRefPubMed

Cochrane AL (1972) Effectiveness and efficiency: random reflections on health services. Nuffield Trust, London

Smith PG, Morrow RH, DA R (eds) (2015) Field trials of health interventions: a toolbox, 3rd edn. Oxford University Press, Oxford

Gold PB, Macias C, Barreira PJ, Tepper M, Frey J (2010) Viability of using employment rates from randomized trials as benchmarks for supported employment program performance. Adm Policy Ment Health 37(5):427–432. https://doi.org/10.1007/s10488-009-0258-3 CrossRefPubMedPubMedCentral

Becker DR, Drake RE, Bond GR (2014) The IPS supported employment learning collaborative. Psychiatr Rehabil J 37(2):79–85. https://doi.org/10.1037/prj0000044 CrossRefPubMed

Bond GR, Drake RE, Becker DR, Noel VA (2016) The IPS learning community: a longitudinal study of sustainment, quality, and outcome. Psychiatr Serv 67(8):864–869. https://doi.org/10.1176/appi.ps.201500301 CrossRefPubMed

Becker DR, Drake RE, Bond GR (2011) Benchmark outcomes in supported employment. Am J Psychiatr Rehabil 14:230–236CrossRef

10.

Bond GR, Drake RE, Becker DR (2012) Generalizability of the Individual Placement and Support (IPS) model of supported employment outside the US. World Psychiatry 11(1):32–39CrossRef

11.

Marshall T, Goldberg RW, Braude L, Dougherty RH, Daniels AS, Ghose SS, George P, Delphin-Rittmon ME (2014) Supported employment: assessing the evidence. Psychiatr Serv 65(1):16–23. https://doi.org/10.1176/appi.ps.201300262 CrossRefPubMed

12.

Barendregt JJ, Doi SA, Lee YY, Norman RE, Vos T (2013) Meta-analysis of prevalence. J Epidemiol Community Health 67(11):974–978. https://doi.org/10.1136/jech-2013-203104 CrossRefPubMed

13.

Borenstein M, Hedges LV, Higgins JPT, Rothstein HR (2009) Introduction to meta-analysis. Wiley, ChichesterCrossRef

14.

Polanin JR, Hennessy EA, Tanner-Smith ET (2017) A review of meta-analysis packages in R. J Educ Behav Stat 42:206–242CrossRef

15.

Schwarzer G, Carpenter JR, Rücker G (2015) Meta-analysis with R. Springer, ChamCrossRef

16.

R Core Team (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna

17.

Hartung J, Knapp G (2001) A refined method for the meta-analysis of controlled clinical trials with binary outcome. Stat Med 20(24):3875–3889CrossRef

18.

IntHout J, Ioannidis JP, Borm GF (2014) The Hartung–Knapp–Sidik–Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian–Laird method. BMC Med Res Methodol 14:25. https://doi.org/10.1186/1471-2288-14-25 CrossRefPubMedPubMedCentral

19.

Hunter JP, Saratzis A, Sutton AJ, Boucher RH, Sayers RD, Bown MJ (2014) In meta-analyses of proportion studies, funnel plots were found to be an inaccurate method of assessing publication bias. J Clin Epidemiol 67(8):897–903. https://doi.org/10.1016/j.jclinepi.2014.03.003 CrossRefPubMed

20.

Anthony WA, Brown MA, Rogers ES, Derringer S (1999) A supported living/supported employment program for reducing the number of people in institutions. Psychiatr Rehabil J 23:57–61CrossRef

21.

Bailey EL, Ricketts SK, Becker DR, Xie H, Drake RE (1998) Do long-term day treatment clients benefit from supported employment. Psychiatr Rehabil J 22:24–29CrossRef

22.

Becker DR, Bond GR, McCarthy D, Thompson D, Xie H, McHugo GJ, Drake RE (2001) Converting day treatment centers to supported employment programs in Rhode Island. Psychiatr Serv 52(3):351–357. https://doi.org/10.1176/appi.ps.52.3.351 CrossRefPubMed

23.

Beimers D, Biegek DE, Guo S, Stevenson L (2010) Employment entry through supported employment: Influential factors for consumers with co-occurring mental and substance disorders. Best Pract Ment Health 6(2):85–102

24.

Browne DJ, Stephenson A, Wright J, Waghorn G (2009) Developing high performing employment services for people with mental illness. Int J Ther Rehabil 16:502–511CrossRef

25.

Corbiere M, Lecomte T, Reinharz D, Kirsh B, Goering P, Menear M, Berbiche D, Genest K, Goldner EM (2017) Predictors of acquisition of competitive employment for people enrolled in supported employment programs. J Nerv Ment Dis 205(4):275–282. https://doi.org/10.1097/NMD.0000000000000612 CrossRefPubMed

26.

Drake RE, Becker DR, Biesanz JC, Torrey WC, McHugo GJ, Wyzik PF (1994) Rehabilitative day treatment vs. supported employment: I. Vocational outcomes. Community Ment Health J 30(5):519–532CrossRef

27.

Dudley R, Nicholson M, Stott P, Spoors G (2014) Improving vocational outcomes of service users in an Early Intervention in Psychosis service. Early Interv Psychiatry 8(1):98–102. https://doi.org/10.1111/eip.12043 CrossRefPubMed

28.

Ellison ML, Klodnick VV, Bond GR, Krzos IM, Kaiser SM, Fagan MA, Davis M (2015) Adapting supported employment for emerging adults with serious mental health conditions. J Behav Health Serv Res 42(2):206–222. https://doi.org/10.1007/s11414-014-9445-4 CrossRefPubMed

29.

Fabian ES (1992) Longitudinal outcomes in supported employment: a survival analysis. Rehabil Psychol 37(1):23–35CrossRef

30.

Fabian ES (1992) Supported employment and the quality of life: does a job make a difference? Rehabil Counsel Bull 36(2):84–97

31.

Favre C, Spagnoli D, Pomini V (2014) Dispositf de soutien à l’emploi pour patients psychiatriques: évaluation rétrospective. Swiss Arch Neurol Psychiatry 185:258–264

32.

Furlong M, McCoy ML, Dincin J, Clay R, McClory K, Pavick D (2002) Jobs for people with the most severe psychiatric disorders: thresholds Bridge North pilot. Psychiatr Rehabil J 26(1):13–22CrossRef

33.

Henry AD, Hashemi L, Zhang J (2014) Evaluation of a statewide implementation of supported employment in Massachusetts. Psychiatr Rehabil J 37(4):284–288. https://doi.org/10.1037/prj0000097 CrossRefPubMed

34.

Lucca AM, Henry AD, Banks S, Simon L, Page S (2004) Evaluation of an Individual Placement and Support model (IPS) program. Psychiatr Rehabil J 27(3):251–257CrossRef

35.

Major BS, Hinton MF, Flint A, Chalmers-Brown A, McLoughlin K, Johnson S (2010) Evidence of the effectiveness of a specialist vocational intervention following first episode psychosis: a naturalistic prospective cohort study. Soc Psychiatry Psychiatr Epidemiol 45(1):1–8. https://doi.org/10.1007/s00127-009-0034-4 CrossRefPubMed

36.

Morris A, Waghorn G, Robson E, Moore L, Edwards E (2014) Implementation of evidence-based supported employment in regional Australia. Psychiatr Rehabil J 37(2):144–147. https://doi.org/10.1037/prj0000051 CrossRefPubMed

37.

Nygren U, Markstrom U, Svensson B, Hansson L, Sandlund M (2011) Individual placement and support—a model to get employed for people with mental illness—the first Swedish report of outcomes. Scand J Caring Sci 25(3):591–598. https://doi.org/10.1111/j.1471-6712.2011.00869.x CrossRefPubMed

38.

Oldman J, Thomson L, Calsaferri K, Luke A, Bond GR (2005) A case report of the conversion of sheltered employment to evidence-based supported employment in Canada. Psychiatr Serv 56(11):1436–1440. https://doi.org/10.1176/appi.ps.56.11.1436 CrossRefPubMed

39.

Porteous N, Waghorn G (2007) Implementing evidence-based employment services in New Zealand for young adults with psychosis: progress during the first five years. Br J Occup Ther 70:521–526CrossRef

40.

Rinaldi M, Perkins R (2007) Comparing employment outcomes for two vocational services: individual placement and support and non-integrated pre-vocational services in the UK. J Vocat Rehabil 27:21–27

41.

Rinaldi M, Perkins R, McNeil K, Hickman N, Singh S (2010) The Individual Placement and Support approach to vocational rehabilitation for young people with first episode psychosis in the UK. J Ment Health 19:483–491CrossRef

42.

Rosenheck RA, Mares AS (2007) Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: two-year outcomes. Psychiatr Serv 58(3):325–333. https://doi.org/10.1176/ps.2007.58.3.325 CrossRefPubMed

43.

Shafer MS, Huang H-W (1995) The utilization of survival analyses to evaluate supported employment services. J Vocat Rehabil 5:103–115CrossRef

44.

van Erp NH, Giesen FB, van Weeghel J, Kroon H, Michon HW, Becker D, McHugo GJ, Drake RE (2007) A multisite study of implementing supported employment in the Netherlands. Psychiatr Serv 58(11):1421–1426. https://doi.org/10.1176/ps.2007.58.11.1421 CrossRefPubMed

45.

van Veggel R, Waghorn G, Dias S (2015) Implementing evidence-based suppported employment in Sussex for people with severe mental illness. Br J Occup Ther 78:286–294CrossRef

46.

Waghorn G, Dias S, Gladman B, Harris M (2015) Measuring what matters: effectiveness of implementing evidence-based supported employment for adults with severe mental illness. Int J Ther Rehabil 22:411–420CrossRef

47.

Williams PL, Lloyd C, Waghorn G, Machingura T (2015) Implementing evidence-based practices in supported employment on the Gold Coaist for people with severe mental illness. Aust Occup Ther J 62:315–326CrossRef

48.

Wong K, Chiu LP, Tang SW, Kan HK, Kong CL, Chu HW, Lo WM, Sin YM, Chiu SN (2000) Vocational outcomes of individuals with psychiatric disabilities participating in a supported competitive employment program. Work 14(3):247–255PubMed

49.

Metcalfe JD, Drake RE, Bond GR (2018) Economic, labor, and regulatory moderators of the effect of individual placement and support among people with severe mental illness: a systematic review and meta-analysis. Schizophr Bull 44(1):22–31. https://doi.org/10.1093/schbul/sbx132 CrossRefPubMed

50.

Starace F, Mungai F, Sarti E, Addabbo T (2017) Self-reported unemployment status and recession: an analysis on the Italian population with and without mental health problems. PLoS One 12(4):e0174135. https://doi.org/10.1371/journal.pone.0174135 CrossRefPubMedPubMedCentral

51.

Evans-Lacko S, Knapp M, McCrone P, Thornicroft G, Mojtabai R (2013) The mental health consequences of the recession: economic hardship and employment of people with mental health problems in 27 European countries. PLoS One 8(7):e69792. https://doi.org/10.1371/journal.pone.0069792 CrossRefPubMedPubMedCentral

52.

Chan JY, Wang CC, Ditchman N, K JH, Pete J, Chan F, Dries B (2014) State unemployment rates and vocational rehabilitation outcomes: a multilevel analysis. Rehabil Counsel Bull 57:209–218CrossRef

Title: Effectiveness of supported employment in non-trial routine implementation: systematic review and meta-analysis
Authors: Dirk Richter
Holger Hoffmann
Publication date: 01-05-2019
Publisher: Springer Berlin Heidelberg
Published in: Social Psychiatry and Psychiatric Epidemiology / Issue 5/2019
Print ISSN: 0933-7954
Electronic ISSN: 1433-9285
DOI: https://doi.org/10.1007/s00127-018-1577-z

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Effectiveness of supported employment in non-trial routine implementation: systematic review and meta-analysis

Abstract

Purpose

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 5/2019

An apple a day: Protective associations between nutrition and the mental health of immigrants in Canada

Triple jeopardy: the joint impact of racial segregation and neighborhood poverty on the mental health of black Americans

Effect of the Brazilian cash transfer programme on suicide rates: a longitudinal analysis of the Brazilian municipalities

Changing characteristics of forensic psychiatric patients in Ontario: a population-based study from 1987 to 2012

Race/ethnicity, nativity, and lifetime risk of mental disorders in US adults

Rates and trends of psychiatric inpatient and postdischarge suicides in Taiwan, 2002–2013: a national register-based study