Advertisement

Effectiveness of supported employment in non-trial routine implementation: systematic review and meta-analysis

  • Dirk Richter
  • Holger Hoffmann
Review

Abstract

Purpose

While supported employment (SE) programs for people with mental illness have demonstrated their superiority in randomized controlled trials (RCTs) and meta-analyses, little is known about the effectiveness of non-trial routine programs. The primary objective of this study was to estimate a pooled competitive employment rate of non-trial SE programs by means of a meta-analysis. A secondary objective was to compare this result to competitive employment rates of SE programs in RCTs, prevocational training programs in RCTs and in routine implementation.

Methods

A systematic review and a random-effects meta-analysis of proportions were conducted. Quality assessment was provided. Moderator analyses by subgroup comparisons were conducted.

Results

Results from 28 samples were included in the meta-analysis. The pooled competitive employment rate for SE routine programs was 0.43 (95% CI 0.37–0.50). The pooled competitive employment rates for comparison conditions were: SE programs in RCTs: 0.50 (95% CI 0.43–0.56); prevocational programs in RCTs: 0.22 (95% CI 0.16–0.28); prevocational programs in routine programs: 0.17 (95% CI 0.11–0.23). SE routine studies conducted prior to 2008 showed a significantly higher competitive employment rate.

Conclusion

SE routine programs lose only little effectiveness compared to SE programs from RCTs but are much more successful in reintegrating participants into the competitive labor market than prevocational programs. Labor market conditions have to be taken into account when evaluating SE programs.

Keywords

Social psychiatry Psychiatric rehabilitation Supported employment Routine implementation 

Notes

Compliance with ethical standards

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Supplementary material

127_2018_1577_MOESM1_ESM.docx (48 kb)
Supplementary material 1 (DOCX 48 KB)
127_2018_1577_MOESM2_ESM.pdf (468 kb)
Supplementary material 2 (PDF 468 KB)
127_2018_1577_MOESM3_ESM.pdf (201 kb)
Supplementary material 3 (PDF 200 KB)
127_2018_1577_MOESM4_ESM.pdf (309 kb)
Supplementary material 4 (PDF 308 KB)
127_2018_1577_MOESM5_ESM.pdf (73 kb)
Supplementary material 5 (PDF 73 KB)

References

  1. 1.
    Modini M, Tan L, Brinchmann B, Wang MJ, Killackey E, Glozier N, Mykletun A, Harvey SB (2016) Supported employment for people with severe mental illness: systematic review and meta-analysis of the international evidence. Br J Psychiatry 209(1):14–22.  https://doi.org/10.1192/bjp.bp.115.165092 CrossRefPubMedGoogle Scholar
  2. 2.
    Suijkerbuijk YB, Schaafsma FG, van Mechelen JC, Ojajarvi A, Corbiere M, Anema JR (2017) Interventions for obtaining and maintaining employment in adults with severe mental illness, a network meta-analysis. Cochrane Database Syst Rev 9:CD011867.  https://doi.org/10.1002/14651858.CD011867.pub2 PubMedCrossRefGoogle Scholar
  3. 3.
    Johnson-Kwochka A, Bond GR, Becker DR, Drake RE, Greene MA (2017) Prevalence and quality of individual placement and support (IPS) supported employment in the United States. Adm Policy Ment Health 44(3):311–319.  https://doi.org/10.1007/s10488-016-0787-5 CrossRefPubMedGoogle Scholar
  4. 4.
    Cochrane AL (1972) Effectiveness and efficiency: random reflections on health services. Nuffield Trust, LondonGoogle Scholar
  5. 5.
    Smith PG, Morrow RH, DA R (eds) (2015) Field trials of health interventions: a toolbox, 3rd edn. Oxford University Press, OxfordGoogle Scholar
  6. 6.
    Gold PB, Macias C, Barreira PJ, Tepper M, Frey J (2010) Viability of using employment rates from randomized trials as benchmarks for supported employment program performance. Adm Policy Ment Health 37(5):427–432.  https://doi.org/10.1007/s10488-009-0258-3 CrossRefPubMedPubMedCentralGoogle Scholar
  7. 7.
    Becker DR, Drake RE, Bond GR (2014) The IPS supported employment learning collaborative. Psychiatr Rehabil J 37(2):79–85.  https://doi.org/10.1037/prj0000044 CrossRefPubMedGoogle Scholar
  8. 8.
    Bond GR, Drake RE, Becker DR, Noel VA (2016) The IPS learning community: a longitudinal study of sustainment, quality, and outcome. Psychiatr Serv 67(8):864–869.  https://doi.org/10.1176/appi.ps.201500301 CrossRefPubMedGoogle Scholar
  9. 9.
    Becker DR, Drake RE, Bond GR (2011) Benchmark outcomes in supported employment. Am J Psychiatr Rehabil 14:230–236CrossRefGoogle Scholar
  10. 10.
    Bond GR, Drake RE, Becker DR (2012) Generalizability of the Individual Placement and Support (IPS) model of supported employment outside the US. World Psychiatry 11(1):32–39CrossRefPubMedPubMedCentralGoogle Scholar
  11. 11.
    Marshall T, Goldberg RW, Braude L, Dougherty RH, Daniels AS, Ghose SS, George P, Delphin-Rittmon ME (2014) Supported employment: assessing the evidence. Psychiatr Serv 65(1):16–23.  https://doi.org/10.1176/appi.ps.201300262 CrossRefPubMedGoogle Scholar
  12. 12.
    Barendregt JJ, Doi SA, Lee YY, Norman RE, Vos T (2013) Meta-analysis of prevalence. J Epidemiol Community Health 67(11):974–978.  https://doi.org/10.1136/jech-2013-203104 CrossRefPubMedGoogle Scholar
  13. 13.
    Borenstein M, Hedges LV, Higgins JPT, Rothstein HR (2009) Introduction to meta-analysis. Wiley, ChichesterCrossRefGoogle Scholar
  14. 14.
    Polanin JR, Hennessy EA, Tanner-Smith ET (2017) A review of meta-analysis packages in R. J Educ Behav Stat 42:206–242CrossRefGoogle Scholar
  15. 15.
    Schwarzer G, Carpenter JR, Rücker G (2015) Meta-analysis with R. Springer, ChamCrossRefGoogle Scholar
  16. 16.
    R Core Team (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, ViennaGoogle Scholar
  17. 17.
    Hartung J, Knapp G (2001) A refined method for the meta-analysis of controlled clinical trials with binary outcome. Stat Med 20(24):3875–3889CrossRefPubMedGoogle Scholar
  18. 18.
    IntHout J, Ioannidis JP, Borm GF (2014) The Hartung–Knapp–Sidik–Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian–Laird method. BMC Med Res Methodol 14:25.  https://doi.org/10.1186/1471-2288-14-25 CrossRefPubMedPubMedCentralGoogle Scholar
  19. 19.
    Hunter JP, Saratzis A, Sutton AJ, Boucher RH, Sayers RD, Bown MJ (2014) In meta-analyses of proportion studies, funnel plots were found to be an inaccurate method of assessing publication bias. J Clin Epidemiol 67(8):897–903.  https://doi.org/10.1016/j.jclinepi.2014.03.003 CrossRefPubMedGoogle Scholar
  20. 20.
    Anthony WA, Brown MA, Rogers ES, Derringer S (1999) A supported living/supported employment program for reducing the number of people in institutions. Psychiatr Rehabil J 23:57–61CrossRefGoogle Scholar
  21. 21.
    Bailey EL, Ricketts SK, Becker DR, Xie H, Drake RE (1998) Do long-term day treatment clients benefit from supported employment. Psychiatr Rehabil J 22:24–29CrossRefGoogle Scholar
  22. 22.
    Becker DR, Bond GR, McCarthy D, Thompson D, Xie H, McHugo GJ, Drake RE (2001) Converting day treatment centers to supported employment programs in Rhode Island. Psychiatr Serv 52(3):351–357.  https://doi.org/10.1176/appi.ps.52.3.351 CrossRefPubMedGoogle Scholar
  23. 23.
    Beimers D, Biegek DE, Guo S, Stevenson L (2010) Employment entry through supported employment: Influential factors for consumers with co-occurring mental and substance disorders. Best Pract Ment Health 6(2):85–102Google Scholar
  24. 24.
    Browne DJ, Stephenson A, Wright J, Waghorn G (2009) Developing high performing employment services for people with mental illness. Int J Ther Rehabil 16:502–511CrossRefGoogle Scholar
  25. 25.
    Corbiere M, Lecomte T, Reinharz D, Kirsh B, Goering P, Menear M, Berbiche D, Genest K, Goldner EM (2017) Predictors of acquisition of competitive employment for people enrolled in supported employment programs. J Nerv Ment Dis 205(4):275–282.  https://doi.org/10.1097/NMD.0000000000000612 CrossRefPubMedGoogle Scholar
  26. 26.
    Drake RE, Becker DR, Biesanz JC, Torrey WC, McHugo GJ, Wyzik PF (1994) Rehabilitative day treatment vs. supported employment: I. Vocational outcomes. Community Ment Health J 30(5):519–532CrossRefPubMedGoogle Scholar
  27. 27.
    Dudley R, Nicholson M, Stott P, Spoors G (2014) Improving vocational outcomes of service users in an Early Intervention in Psychosis service. Early Interv Psychiatry 8(1):98–102.  https://doi.org/10.1111/eip.12043 CrossRefPubMedGoogle Scholar
  28. 28.
    Ellison ML, Klodnick VV, Bond GR, Krzos IM, Kaiser SM, Fagan MA, Davis M (2015) Adapting supported employment for emerging adults with serious mental health conditions. J Behav Health Serv Res 42(2):206–222.  https://doi.org/10.1007/s11414-014-9445-4 CrossRefPubMedGoogle Scholar
  29. 29.
    Fabian ES (1992) Longitudinal outcomes in supported employment: a survival analysis. Rehabil Psychol 37(1):23–35CrossRefGoogle Scholar
  30. 30.
    Fabian ES (1992) Supported employment and the quality of life: does a job make a difference? Rehabil Counsel Bull 36(2):84–97Google Scholar
  31. 31.
    Favre C, Spagnoli D, Pomini V (2014) Dispositf de soutien à l’emploi pour patients psychiatriques: évaluation rétrospective. Swiss Arch Neurol Psychiatry 185:258–264Google Scholar
  32. 32.
    Furlong M, McCoy ML, Dincin J, Clay R, McClory K, Pavick D (2002) Jobs for people with the most severe psychiatric disorders: thresholds Bridge North pilot. Psychiatr Rehabil J 26(1):13–22CrossRefPubMedGoogle Scholar
  33. 33.
    Henry AD, Hashemi L, Zhang J (2014) Evaluation of a statewide implementation of supported employment in Massachusetts. Psychiatr Rehabil J 37(4):284–288.  https://doi.org/10.1037/prj0000097 CrossRefPubMedGoogle Scholar
  34. 34.
    Lucca AM, Henry AD, Banks S, Simon L, Page S (2004) Evaluation of an Individual Placement and Support model (IPS) program. Psychiatr Rehabil J 27(3):251–257CrossRefPubMedGoogle Scholar
  35. 35.
    Major BS, Hinton MF, Flint A, Chalmers-Brown A, McLoughlin K, Johnson S (2010) Evidence of the effectiveness of a specialist vocational intervention following first episode psychosis: a naturalistic prospective cohort study. Soc Psychiatry Psychiatr Epidemiol 45(1):1–8.  https://doi.org/10.1007/s00127-009-0034-4 CrossRefPubMedGoogle Scholar
  36. 36.
    Morris A, Waghorn G, Robson E, Moore L, Edwards E (2014) Implementation of evidence-based supported employment in regional Australia. Psychiatr Rehabil J 37(2):144–147.  https://doi.org/10.1037/prj0000051 CrossRefPubMedGoogle Scholar
  37. 37.
    Nygren U, Markstrom U, Svensson B, Hansson L, Sandlund M (2011) Individual placement and support—a model to get employed for people with mental illness—the first Swedish report of outcomes. Scand J Caring Sci 25(3):591–598.  https://doi.org/10.1111/j.1471-6712.2011.00869.x CrossRefPubMedGoogle Scholar
  38. 38.
    Oldman J, Thomson L, Calsaferri K, Luke A, Bond GR (2005) A case report of the conversion of sheltered employment to evidence-based supported employment in Canada. Psychiatr Serv 56(11):1436–1440.  https://doi.org/10.1176/appi.ps.56.11.1436 CrossRefPubMedGoogle Scholar
  39. 39.
    Porteous N, Waghorn G (2007) Implementing evidence-based employment services in New Zealand for young adults with psychosis: progress during the first five years. Br J Occup Ther 70:521–526CrossRefGoogle Scholar
  40. 40.
    Rinaldi M, Perkins R (2007) Comparing employment outcomes for two vocational services: individual placement and support and non-integrated pre-vocational services in the UK. J Vocat Rehabil 27:21–27Google Scholar
  41. 41.
    Rinaldi M, Perkins R, McNeil K, Hickman N, Singh S (2010) The Individual Placement and Support approach to vocational rehabilitation for young people with first episode psychosis in the UK. J Ment Health 19:483–491CrossRefPubMedGoogle Scholar
  42. 42.
    Rosenheck RA, Mares AS (2007) Implementation of supported employment for homeless veterans with psychiatric or addiction disorders: two-year outcomes. Psychiatr Serv 58(3):325–333.  https://doi.org/10.1176/ps.2007.58.3.325 CrossRefPubMedGoogle Scholar
  43. 43.
    Shafer MS, Huang H-W (1995) The utilization of survival analyses to evaluate supported employment services. J Vocat Rehabil 5:103–115CrossRefGoogle Scholar
  44. 44.
    van Erp NH, Giesen FB, van Weeghel J, Kroon H, Michon HW, Becker D, McHugo GJ, Drake RE (2007) A multisite study of implementing supported employment in the Netherlands. Psychiatr Serv 58(11):1421–1426.  https://doi.org/10.1176/ps.2007.58.11.1421 CrossRefPubMedGoogle Scholar
  45. 45.
    van Veggel R, Waghorn G, Dias S (2015) Implementing evidence-based suppported employment in Sussex for people with severe mental illness. Br J Occup Ther 78:286–294CrossRefGoogle Scholar
  46. 46.
    Waghorn G, Dias S, Gladman B, Harris M (2015) Measuring what matters: effectiveness of implementing evidence-based supported employment for adults with severe mental illness. Int J Ther Rehabil 22:411–420CrossRefGoogle Scholar
  47. 47.
    Williams PL, Lloyd C, Waghorn G, Machingura T (2015) Implementing evidence-based practices in supported employment on the Gold Coaist for people with severe mental illness. Aust Occup Ther J 62:315–326CrossRefGoogle Scholar
  48. 48.
    Wong K, Chiu LP, Tang SW, Kan HK, Kong CL, Chu HW, Lo WM, Sin YM, Chiu SN (2000) Vocational outcomes of individuals with psychiatric disabilities participating in a supported competitive employment program. Work 14(3):247–255PubMedGoogle Scholar
  49. 49.
    Metcalfe JD, Drake RE, Bond GR (2018) Economic, labor, and regulatory moderators of the effect of individual placement and support among people with severe mental illness: a systematic review and meta-analysis. Schizophr Bull 44(1):22–31.  https://doi.org/10.1093/schbul/sbx132 CrossRefPubMedGoogle Scholar
  50. 50.
    Starace F, Mungai F, Sarti E, Addabbo T (2017) Self-reported unemployment status and recession: an analysis on the Italian population with and without mental health problems. PLoS One 12(4):e0174135.  https://doi.org/10.1371/journal.pone.0174135 CrossRefPubMedPubMedCentralGoogle Scholar
  51. 51.
    Evans-Lacko S, Knapp M, McCrone P, Thornicroft G, Mojtabai R (2013) The mental health consequences of the recession: economic hardship and employment of people with mental health problems in 27 European countries. PLoS One 8(7):e69792.  https://doi.org/10.1371/journal.pone.0069792 CrossRefPubMedPubMedCentralGoogle Scholar
  52. 52.
    Chan JY, Wang CC, Ditchman N, K JH, Pete J, Chan F, Dries B (2014) State unemployment rates and vocational rehabilitation outcomes: a multilevel analysis. Rehabil Counsel Bull 57:209–218CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Center for Psychiatric RehabilitationUniversity Bern Psychiatric ServicesBernSwitzerland
  2. 2.Health DivisionBern University of Applied SciencesBernSwitzerland
  3. 3.SoteriaBernSwitzerland

Personalised recommendations