Skip to main content
Top
Published in: Journal of Occupational Rehabilitation 2/2017

Open Access 01-06-2017

External Validation and Update of a Prediction Rule for the Duration of Sickness Absence Due to Common Mental Disorders

Authors: Giny Norder, Corné A. M. Roelen, Jac J. L. van der Klink, Ute Bültmann, J. K. Sluiter, K. Nieuwenhuijsen

Published in: Journal of Occupational Rehabilitation | Issue 2/2017

Login to get access

Abstract

Purpose The objective of the present study was to validate an existing prediction rule (including age, education, depressive/anxiety symptoms, and recovery expectations) for predictions of the duration of sickness absence due to common mental disorders (CMDs) and investigate the added value of work-related factors. Methods A prospective cohort study including 596 employees who reported sick with CMDs in the period from September 2013 to April 2014. Work-related factors were measured at baseline with the Questionnaire on the Experience and Evaluation of Work. During 1-year follow-up, sickness absence data were retrieved from an occupational health register. The outcome variables of the study were sickness absence (no = 0, yes = 1) at 3 and 6 months after reporting sick with CMDs. Discrimination between workers with and without sickness absence was investigated at 3 and 6 months with the area under the receiver operating characteristic curve (AUC). Results A total of 220 (37 %) employees agreed to participate and 211 (35 %) had complete data for analysis. Discrimination was poor with AUC = 0.69 and AUC = 0.55 at 3 and 6 months, respectively. When ‘variety in work’ was added as predictor variable, discrimination between employees with and without CMD sickness absence improved to AUC = 0.74 (at 3 months) and AUC = 0.62 (at 6 months). Conclusions The original prediction rule poorly predicted CMD sickness absence duration. After adding ‘variety in work’, the prediction rule discriminated between employees with and without CMD sickness absence 3 months after reporting sick. This new prediction rule remains to be validated in other populations.
Literature
1.
go back to reference Organization for Economic Cooperation and Development. Sick on the job? Myths and realities about mental health and work. Paris: OECD Publishing; 2011. Organization for Economic Cooperation and Development. Sick on the job? Myths and realities about mental health and work. Paris: OECD Publishing; 2011.
2.
go back to reference Vaez M, Rylander G, Nygren Å, Åsberg M, Alexanderson K. Sickness absence and disability pension in a cohort of employees initially on long-term sick leave due to psychiatric disorders in Sweden. Soc Psychiatry Psychiatr Epidemiol. 2007;42:381–8.CrossRefPubMed Vaez M, Rylander G, Nygren Å, Åsberg M, Alexanderson K. Sickness absence and disability pension in a cohort of employees initially on long-term sick leave due to psychiatric disorders in Sweden. Soc Psychiatry Psychiatr Epidemiol. 2007;42:381–8.CrossRefPubMed
3.
go back to reference Gjesdal S, Ringdal RR, Haug K, Maeland JG. Long-term sickness absence and disability pension with psychiatric disorders: a population-based cohort study. Nord J Pyschiatry. 2008;62:294–301.CrossRef Gjesdal S, Ringdal RR, Haug K, Maeland JG. Long-term sickness absence and disability pension with psychiatric disorders: a population-based cohort study. Nord J Pyschiatry. 2008;62:294–301.CrossRef
4.
go back to reference Foss L, Gravseth HM, Kristensen P, Claussen B, Mehlum IS, Skyberg K. Risk factors for long-term sickness absence due to mental sickness: a register-based 5-year follow-up from the Oslo Health Study. J Occup Environ Med. 2010;52:698–705.CrossRefPubMed Foss L, Gravseth HM, Kristensen P, Claussen B, Mehlum IS, Skyberg K. Risk factors for long-term sickness absence due to mental sickness: a register-based 5-year follow-up from the Oslo Health Study. J Occup Environ Med. 2010;52:698–705.CrossRefPubMed
5.
go back to reference Knudsen AK, Øverland S, Aakvaag HF, Harvey SB, Hotopf M, Mykletun A. Common mental disorders and disability pension award: seven year follow-up of the HUSK study. J Psychosom Res. 2010;69:59–67.CrossRefPubMed Knudsen AK, Øverland S, Aakvaag HF, Harvey SB, Hotopf M, Mykletun A. Common mental disorders and disability pension award: seven year follow-up of the HUSK study. J Psychosom Res. 2010;69:59–67.CrossRefPubMed
6.
go back to reference Ahola K, Virtanen M, Honkonen T, Isometsä E, Aromaa A, Lönnqvist J. Common mental disorders and subsequent disability: a population-based Health 2000 Study. J Affect Disord. 2011;134:365–72.CrossRefPubMed Ahola K, Virtanen M, Honkonen T, Isometsä E, Aromaa A, Lönnqvist J. Common mental disorders and subsequent disability: a population-based Health 2000 Study. J Affect Disord. 2011;134:365–72.CrossRefPubMed
7.
go back to reference Knudsen AK, Harvey SB, Mykletun A, Øverland S. Common mental disorders and long-term sickness absence in a general working population. The Hordaland Study. Acta Psychiatr Scand. 2013;127:287–97.CrossRefPubMed Knudsen AK, Harvey SB, Mykletun A, Øverland S. Common mental disorders and long-term sickness absence in a general working population. The Hordaland Study. Acta Psychiatr Scand. 2013;127:287–97.CrossRefPubMed
8.
go back to reference Blank L, Peters J, Pickvance S, Wilford J, MacDonald E. A systematic review of the factors that predict return to work for people suffering episodes of poor mental health. J Occup Rehabil. 2008;18:27–34.CrossRefPubMed Blank L, Peters J, Pickvance S, Wilford J, MacDonald E. A systematic review of the factors that predict return to work for people suffering episodes of poor mental health. J Occup Rehabil. 2008;18:27–34.CrossRefPubMed
9.
go back to reference Nieuwenhuijsen K, Verbeek JH, de Boer AG, Blonk RW, van Dijk FJ. Predicting the duration of sickness absence for patients with common mental disorders in occupational health care. Scand J Work Environ Health. 2006;32:67–74.CrossRefPubMed Nieuwenhuijsen K, Verbeek JH, de Boer AG, Blonk RW, van Dijk FJ. Predicting the duration of sickness absence for patients with common mental disorders in occupational health care. Scand J Work Environ Health. 2006;32:67–74.CrossRefPubMed
10.
go back to reference Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515–24.CrossRefPubMed Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515–24.CrossRefPubMed
11.
go back to reference Harrel FE, Lee KL, Mark DB. Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361–87.CrossRef Harrel FE, Lee KL, Mark DB. Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361–87.CrossRef
12.
go back to reference Roelen CA, Norder G, Koopmans PC, van Rhenen W, van der Klink JJ, Bültmann U. Employees sick-listed with mental disorders: who returns to work and when? J Occup Rehabil. 2012;22:409–17.CrossRefPubMed Roelen CA, Norder G, Koopmans PC, van Rhenen W, van der Klink JJ, Bültmann U. Employees sick-listed with mental disorders: who returns to work and when? J Occup Rehabil. 2012;22:409–17.CrossRefPubMed
13.
go back to reference Terluin B, van Rhenen W, Schaufeli WB, de Haan M. The Four-Dimensional Symptom Questionnaire (4DSQ): measuring distress and other mental health problems in a working population. Work Stress. 2004;18:187–207.CrossRef Terluin B, van Rhenen W, Schaufeli WB, de Haan M. The Four-Dimensional Symptom Questionnaire (4DSQ): measuring distress and other mental health problems in a working population. Work Stress. 2004;18:187–207.CrossRef
14.
go back to reference Terluin B, van Marwijk HW, Adèr HJ, de Vet HC, Penninx BW, Hermens WL, et al. The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry. 2006;6:34.CrossRefPubMedPubMedCentral Terluin B, van Marwijk HW, Adèr HJ, de Vet HC, Penninx BW, Hermens WL, et al. The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry. 2006;6:34.CrossRefPubMedPubMedCentral
15.
go back to reference van Veldhoven M, de Jonge J, Boersen S, Kompier M, Meijman TF. Specific relations between psychosocial job conditions and job-related stress. Work Stress. 2002;16:207–28.CrossRef van Veldhoven M, de Jonge J, Boersen S, Kompier M, Meijman TF. Specific relations between psychosocial job conditions and job-related stress. Work Stress. 2002;16:207–28.CrossRef
17.
go back to reference Kinnunen U, Feldt T, Geurts S, Pulkkinen L. Types of work-family interface: well-being correlates of negative and positive spillover between work and family. Scand J Psychol. 2006;47:149–62.CrossRefPubMed Kinnunen U, Feldt T, Geurts S, Pulkkinen L. Types of work-family interface: well-being correlates of negative and positive spillover between work and family. Scand J Psychol. 2006;47:149–62.CrossRefPubMed
18.
go back to reference Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski M, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128–38.CrossRefPubMedPubMedCentral Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski M, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21:128–38.CrossRefPubMedPubMedCentral
19.
go back to reference Pencina MJ, d’Agostinho RB Sr, d’Agostinho RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.CrossRefPubMed Pencina MJ, d’Agostinho RB Sr, d’Agostinho RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.CrossRefPubMed
20.
go back to reference Sundström J, Byberg L, Gedeborg R, Michaëlsson K, Berglund L. Useful tests of usefulness of new risk factors: tools for assessing reclassification and discrimination. Scand J Public Health. 2011;39:439–41.CrossRefPubMed Sundström J, Byberg L, Gedeborg R, Michaëlsson K, Berglund L. Useful tests of usefulness of new risk factors: tools for assessing reclassification and discrimination. Scand J Public Health. 2011;39:439–41.CrossRefPubMed
21.
go back to reference Kundu S, Aulchenko YS, van Duijn CM, Janssens AC. PredictABEL: an R package for the assessment of risk prediction models. Eur J Epidemiol. 2011;26:261–4.CrossRefPubMedPubMedCentral Kundu S, Aulchenko YS, van Duijn CM, Janssens AC. PredictABEL: an R package for the assessment of risk prediction models. Eur J Epidemiol. 2011;26:261–4.CrossRefPubMedPubMedCentral
22.
go back to reference Debray TPA, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KGM. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68:279–89.CrossRefPubMed Debray TPA, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KGM. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68:279–89.CrossRefPubMed
23.
go back to reference Lagerveld SE, Blonk RWB, Brenninkmeijer V, Wijngaards-de Meij L, Schaufeli WB. Work-focused treatment of common mental disorders and return to work: a comparative outcome study. J Occup Health Psychol. 2012;17:220–34.CrossRefPubMed Lagerveld SE, Blonk RWB, Brenninkmeijer V, Wijngaards-de Meij L, Schaufeli WB. Work-focused treatment of common mental disorders and return to work: a comparative outcome study. J Occup Health Psychol. 2012;17:220–34.CrossRefPubMed
24.
go back to reference Karlson B, Jönsson P, Pålsson B, Åbjörnsson G, Malmberg B, Larsson B, et al. Return to work after a workplace-oriented intervention for patients on sick-leave for burnout—a prospective controlled study. BMC Public Health. 2010;10:301.CrossRefPubMedPubMedCentral Karlson B, Jönsson P, Pålsson B, Åbjörnsson G, Malmberg B, Larsson B, et al. Return to work after a workplace-oriented intervention for patients on sick-leave for burnout—a prospective controlled study. BMC Public Health. 2010;10:301.CrossRefPubMedPubMedCentral
25.
go back to reference Nieuwenhuijsen K, Faber B, Verbeek JH, Neumeyer-Gromen A, Hees HL, Verhoeven AC, et al. Interventions to improve return to work in depressed people. Cochrane Database Syst Rev. 2014;12:CD006237. Nieuwenhuijsen K, Faber B, Verbeek JH, Neumeyer-Gromen A, Hees HL, Verhoeven AC, et al. Interventions to improve return to work in depressed people. Cochrane Database Syst Rev. 2014;12:CD006237.
26.
go back to reference Persson R, Kristiansen J. The challenge of assessing the psychosocial work environment: why some self-reports should not be interpreted as environmental exposures. Occup Environ Med. 2012;69:932–3.CrossRefPubMed Persson R, Kristiansen J. The challenge of assessing the psychosocial work environment: why some self-reports should not be interpreted as environmental exposures. Occup Environ Med. 2012;69:932–3.CrossRefPubMed
27.
go back to reference Rugulies R. Studying the effect of the psychosocial work environment on risk of ill-health: towards a more comprehensive assessment of working conditions. Scand J Work Environ Health. 2013;38:187–92.CrossRef Rugulies R. Studying the effect of the psychosocial work environment on risk of ill-health: towards a more comprehensive assessment of working conditions. Scand J Work Environ Health. 2013;38:187–92.CrossRef
28.
go back to reference Roelen CA, Heymans MW, Twisk JWR, van Rhenen W, Pallesen S, Bjorvatn B, Moen BE, Magerøy N. Updating and prospective validation of a prognostic model for high sickness absence. Int Arch Occup Environ Health. 2015;188:113–22.CrossRef Roelen CA, Heymans MW, Twisk JWR, van Rhenen W, Pallesen S, Bjorvatn B, Moen BE, Magerøy N. Updating and prospective validation of a prognostic model for high sickness absence. Int Arch Occup Environ Health. 2015;188:113–22.CrossRef
29.
go back to reference Roelen CA, Stapelfeldt CM, Heymans MW, van Rhenen W, Labriola M, Nielsen CV, Bültmann U, Jensen C. Cross-national validation of prognostic models predicting sickness absence and the added value of work environment variables. J Occup Rehabil. 2015;25:279–87.CrossRefPubMed Roelen CA, Stapelfeldt CM, Heymans MW, van Rhenen W, Labriola M, Nielsen CV, Bültmann U, Jensen C. Cross-national validation of prognostic models predicting sickness absence and the added value of work environment variables. J Occup Rehabil. 2015;25:279–87.CrossRefPubMed
Metadata
Title
External Validation and Update of a Prediction Rule for the Duration of Sickness Absence Due to Common Mental Disorders
Authors
Giny Norder
Corné A. M. Roelen
Jac J. L. van der Klink
Ute Bültmann
J. K. Sluiter
K. Nieuwenhuijsen
Publication date
01-06-2017
Publisher
Springer US
Published in
Journal of Occupational Rehabilitation / Issue 2/2017
Print ISSN: 1053-0487
Electronic ISSN: 1573-3688
DOI
https://doi.org/10.1007/s10926-016-9646-1

Other articles of this Issue 2/2017

Journal of Occupational Rehabilitation 2/2017 Go to the issue