Skip to main content
Top
Published in: International Archives of Occupational and Environmental Health 8/2015

Open Access 01-11-2015 | Original Article

Risk reclassification analysis investigating the added value of fatigue to sickness absence predictions

Authors: Corné A. M. Roelen, Ute Bültmann, Johan W. Groothoff, Jos W. R. Twisk, Martijn W. Heymans

Published in: International Archives of Occupational and Environmental Health | Issue 8/2015

Login to get access

Abstract

Background

Prognostic models including age, self-rated health and prior sickness absence (SA) have been found to predict high (≥30) SA days and high (≥3) SA episodes during 1-year follow-up. More predictors of high SA are needed to improve these SA prognostic models. The purpose of this study was to investigate fatigue as new predictor in SA prognostic models by using risk reclassification methods and measures.

Methods

This was a prospective cohort study with 1-year follow-up of 1,137 office workers. Fatigue was measured at baseline with the 20-item checklist individual strength and added to the existing SA prognostic models. SA days and episodes during 1-year follow-up were retrieved from an occupational health service register. The added value of fatigue was investigated with Net Reclassification Index (NRI) and integrated discrimination improvement (IDI) measures.

Results

In total, 579 (51 %) office workers had complete data for analysis. Fatigue was prospectively associated with both high SA days and episodes. The NRI revealed that adding fatigue to the SA days model correctly reclassified workers with high SA days, but incorrectly reclassified workers without high SA days. The IDI indicated no improvement in risk discrimination by the SA days model. Both NRI and IDI showed that the prognostic model predicting high SA episodes did not improve when fatigue was added as predictor variable.

Conclusion

In the present study, fatigue increased false-positive rates which may reduce the cost-effectiveness of interventions for preventing SA.
Literature
go back to reference Åkerstedt T, Kecklund G, Alfredsson L, Selén J (2007) Predicting long-term sickness absence from sleep and fatigue. J Sleep Res 16:341–345CrossRef Åkerstedt T, Kecklund G, Alfredsson L, Selén J (2007) Predicting long-term sickness absence from sleep and fatigue. J Sleep Res 16:341–345CrossRef
go back to reference Beurskens AJ, Bültmann U, Kant IJ, Vercoulen JH, Bleijenberg G, Swaen GM (2000) Fatigue among working people: validity of a questionnaire measure. Occup Environ Med 57:353–357CrossRef Beurskens AJ, Bültmann U, Kant IJ, Vercoulen JH, Bleijenberg G, Swaen GM (2000) Fatigue among working people: validity of a questionnaire measure. Occup Environ Med 57:353–357CrossRef
go back to reference Bouwmeester W, Zuithoff NPA, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW et al (2012) Reporting and methods in clinical prediction research: a systematic review. Plos Med 9:e1001221CrossRef Bouwmeester W, Zuithoff NPA, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW et al (2012) Reporting and methods in clinical prediction research: a systematic review. Plos Med 9:e1001221CrossRef
go back to reference Bültmann U, Kant I, Kasl SV, Beurskens AJ, van den Brandt PA (2002) Fatigue and psychological distress in the working population: psychometrics, prevalence and correlates. J Psychosom Res 52:445–452CrossRef Bültmann U, Kant I, Kasl SV, Beurskens AJ, van den Brandt PA (2002) Fatigue and psychological distress in the working population: psychometrics, prevalence and correlates. J Psychosom Res 52:445–452CrossRef
go back to reference Bültmann U, Huibers MJ, van Amelsvoort LP, Janssen PPM, Schröer CAP (2005) Psychological distress, fatigue and long-term sickness absence: prospective results from the Maastricht Cohort Study. J Occup Environ Med 47:941–947CrossRef Bültmann U, Huibers MJ, van Amelsvoort LP, Janssen PPM, Schröer CAP (2005) Psychological distress, fatigue and long-term sickness absence: prospective results from the Maastricht Cohort Study. J Occup Environ Med 47:941–947CrossRef
go back to reference Bültmann U, Nielsen MB, Madsen IEH, Burr H, Rugulies R (2013) Sleep disturbances and fatigue: independent predictors of sickness absence? A prospective study among 6,538 employees. Eur J Public Health 23:123–128CrossRef Bültmann U, Nielsen MB, Madsen IEH, Burr H, Rugulies R (2013) Sleep disturbances and fatigue: independent predictors of sickness absence? A prospective study among 6,538 employees. Eur J Public Health 23:123–128CrossRef
go back to reference Chalder T, Berelowith G, Pawlikowska T, Watts L, Wessely S, Wright D et al (1993) Development of a fatigue scale. J Psychosom Res 37:147–153CrossRef Chalder T, Berelowith G, Pawlikowska T, Watts L, Wessely S, Wright D et al (1993) Development of a fatigue scale. J Psychosom Res 37:147–153CrossRef
go back to reference Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115:928–935CrossRef Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115:928–935CrossRef
go back to reference Cook NR (2008) Statistical evaluation of prognostic versus diagnostic models: beyond the ROC-curve. Clin Chem 54:17–23CrossRef Cook NR (2008) Statistical evaluation of prognostic versus diagnostic models: beyond the ROC-curve. Clin Chem 54:17–23CrossRef
go back to reference Cook NR, Paynter NP (2011) Performance of reclassification statistics in comparing risk prediction models. Biom J 53:237–258CrossRef Cook NR, Paynter NP (2011) Performance of reclassification statistics in comparing risk prediction models. Biom J 53:237–258CrossRef
go back to reference De Vries J, Michielsen HJ, van Heck GL (2003) Assessment of fatigue among working people: a comparison of six questionnaires. Occup Environ Med 60(suppl 1):i10–i15CrossRef De Vries J, Michielsen HJ, van Heck GL (2003) Assessment of fatigue among working people: a comparison of six questionnaires. Occup Environ Med 60(suppl 1):i10–i15CrossRef
go back to reference Dittner AJ, Wessely SC, Brown RG (2004) The assessment of fatigue. A practical guide for clinicians and researchers. J Psychosom Res 56:157–170CrossRef Dittner AJ, Wessely SC, Brown RG (2004) The assessment of fatigue. A practical guide for clinicians and researchers. J Psychosom Res 56:157–170CrossRef
go back to reference Etter JF, Perneger TV (1997) Analysis of non-response bias in a mailed health survey. J Clin Epidemiol 50:1123–1128CrossRef Etter JF, Perneger TV (1997) Analysis of non-response bias in a mailed health survey. J Clin Epidemiol 50:1123–1128CrossRef
go back to reference Froom P, Melamed S, Kristahl-Boneh E, Benbassat J, Ribak J (1999) Healthy volunteer effect in industrial workers. J Clin Epidemiol 52:731–735CrossRef Froom P, Melamed S, Kristahl-Boneh E, Benbassat J, Ribak J (1999) Healthy volunteer effect in industrial workers. J Clin Epidemiol 52:731–735CrossRef
go back to reference Halford C, Wallman T, Welin L, Rosengren A, Bardel A, Johansson S et al (2012) Effects of self-rated health on sick leave, disability pension, hospital admissions and mortality. A population-based longitudinal study of nearly 15,000 observations among Swedish women and men. BMC Public Health 12:1103CrossRef Halford C, Wallman T, Welin L, Rosengren A, Bardel A, Johansson S et al (2012) Effects of self-rated health on sick leave, disability pension, hospital admissions and mortality. A population-based longitudinal study of nearly 15,000 observations among Swedish women and men. BMC Public Health 12:1103CrossRef
go back to reference Hilden J, Gerds TA (2014) A note on the evaluation of novel biomarkers: do not rely on integrated discrimination improvement and Net Reclassification Index. Stat Med. doi:10.1002/sim.5804 Hilden J, Gerds TA (2014) A note on the evaluation of novel biomarkers: do not rely on integrated discrimination improvement and Net Reclassification Index. Stat Med. doi:10.​1002/​sim.​5804
go back to reference Janes H, Pepe MS, Gu W (2008) Assessing the value of risk predictions by using risk stratification tables. Ann Intern Med 149:751–760CrossRef Janes H, Pepe MS, Gu W (2008) Assessing the value of risk predictions by using risk stratification tables. Ann Intern Med 149:751–760CrossRef
go back to reference Janssen N, Kant IJ, Swaen GHM, Janssen PP, Schröer CA (2003) Fatigue as predictor of sickness absence: results from the Maastricht Cohort Study. Occup Environ Med 60(Suppl1):i71–i76CrossRef Janssen N, Kant IJ, Swaen GHM, Janssen PP, Schröer CA (2003) Fatigue as predictor of sickness absence: results from the Maastricht Cohort Study. Occup Environ Med 60(Suppl1):i71–i76CrossRef
go back to reference Kant IJ, Jansen NW, van Amelsvoort LG, van Leusden R, Berkouwer A (2008) Structured early consultation with the occupational physician reduces sickness absence among office workers at high risk for long-term sickness absence: a randomized controlled trial. J Occup Rehabil 18:79–86CrossRef Kant IJ, Jansen NW, van Amelsvoort LG, van Leusden R, Berkouwer A (2008) Structured early consultation with the occupational physician reduces sickness absence among office workers at high risk for long-term sickness absence: a randomized controlled trial. J Occup Rehabil 18:79–86CrossRef
go back to reference Kerr KF, Wang Z, Janes H, McClelland RL, Psaty BM, Pepe MS (2014) Net reclassification Indices for evaluation risk prediction instruments: a critical review. Epidemiology 25:114–121CrossRef Kerr KF, Wang Z, Janes H, McClelland RL, Psaty BM, Pepe MS (2014) Net reclassification Indices for evaluation risk prediction instruments: a critical review. Epidemiology 25:114–121CrossRef
go back to reference Kundu S, Aulchenko YS, van Duijn CM, Janssens AC (2011) PredictABEL: an R package for the assessment of risk prediction models. Eur J Epidemiol 26:261–264CrossRef Kundu S, Aulchenko YS, van Duijn CM, Janssens AC (2011) PredictABEL: an R package for the assessment of risk prediction models. Eur J Epidemiol 26:261–264CrossRef
go back to reference Labriola M (2008) Conceptual framework of sickness absence and return to work, focusing on both the individual and contextual level. Work 30:377–387 Labriola M (2008) Conceptual framework of sickness absence and return to work, focusing on both the individual and contextual level. Work 30:377–387
go back to reference Leening MJ, Vedder MM, Witteman JC, Pencina MJ, Steyerberg EW (2014a) Net reclassification improvement: computation, interpretation, and controversies: a literature review and clinician’s guide. Ann Intern Med 160:122–131CrossRef Leening MJ, Vedder MM, Witteman JC, Pencina MJ, Steyerberg EW (2014a) Net reclassification improvement: computation, interpretation, and controversies: a literature review and clinician’s guide. Ann Intern Med 160:122–131CrossRef
go back to reference Leening MJ, Steyerberg EW, van Calster B, D’Agostinho RB, Pencina MJ (2014b) Net reclassification improvement and integrated discrimination improvement require calibrated models: relevance from a marker and model perspective. Stat Med 33:3415–3418CrossRef Leening MJ, Steyerberg EW, van Calster B, D’Agostinho RB, Pencina MJ (2014b) Net reclassification improvement and integrated discrimination improvement require calibrated models: relevance from a marker and model perspective. Stat Med 33:3415–3418CrossRef
go back to reference Lund T, Kivimäki M, Labriola M, Villadsen E, Christensen KB (2008) Using administrative sickness absence data as a marker of future disability pension: the prospective DREAM study of Danish private sector employees. Occup Environ Med 65:28–31CrossRef Lund T, Kivimäki M, Labriola M, Villadsen E, Christensen KB (2008) Using administrative sickness absence data as a marker of future disability pension: the prospective DREAM study of Danish private sector employees. Occup Environ Med 65:28–31CrossRef
go back to reference Maslach C, Jackson SE (1986) The Maslach Burnout Inventory. Manual, 2nd edn. Sage, Palo Alto Maslach C, Jackson SE (1986) The Maslach Burnout Inventory. Manual, 2nd edn. Sage, Palo Alto
go back to reference Michielsen HJ, De Vries J, van Heck GL (2002) Psychometric qualities of a brief self-rated fatigue measure: the fatigue assessment scale (FAS). J Psychosom Res 54:45–52 Michielsen HJ, De Vries J, van Heck GL (2002) Psychometric qualities of a brief self-rated fatigue measure: the fatigue assessment scale (FAS). J Psychosom Res 54:45–52
go back to reference Pencina MJ, d’Agostinho RB Sr, d’Agostinho RB Jr, Vasan RS (2008) Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 27:157–172CrossRef Pencina MJ, d’Agostinho RB Sr, d’Agostinho RB Jr, Vasan RS (2008) Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 27:157–172CrossRef
go back to reference Pencina MJ, d’Agostinho RB Sr, Steyerberg EW (2011) Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 30:11–21CrossRef Pencina MJ, d’Agostinho RB Sr, Steyerberg EW (2011) Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 30:11–21CrossRef
go back to reference Pepe MS (2011) Problems with risk reclassification methods for evaluating prediction models. Am J Epidemiol 173:1327–1335CrossRef Pepe MS (2011) Problems with risk reclassification methods for evaluating prediction models. Am J Epidemiol 173:1327–1335CrossRef
go back to reference Pepe MS, Janes H (2011) Reporting standards are needed for evaluations of risk reclassification. Int J Epidemiol 40:1106–1108CrossRef Pepe MS, Janes H (2011) Reporting standards are needed for evaluations of risk reclassification. Int J Epidemiol 40:1106–1108CrossRef
go back to reference Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P (2004) Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 159:882–890CrossRef Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P (2004) Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 159:882–890CrossRef
go back to reference Pepe, Janse H, Li CI (2014) Net risk reclassification p values: valid or misleading? J Natl Cancer Inst 106:dju041CrossRef Pepe, Janse H, Li CI (2014) Net risk reclassification p values: valid or misleading? J Natl Cancer Inst 106:dju041CrossRef
go back to reference Roelen CA, van Rhenen W, Bültmann U, Groothoff JW, van der Klink JJ, Heymans MW (2013a) The development and validation of two prediction models to identify employees with high sickness absence. Eur J Public Health 23:128–133CrossRef Roelen CA, van Rhenen W, Bültmann U, Groothoff JW, van der Klink JJ, Heymans MW (2013a) The development and validation of two prediction models to identify employees with high sickness absence. Eur J Public Health 23:128–133CrossRef
go back to reference Roelen CA, Bültmann U, van Rhenen W, van der Klink JJ, Twisk JWR, Heymans MW (2013b) External validation of two prediction models identifying employees at risk of high sickness absence: cohort study with 1-year follow-up. BMC Public Health 13:105CrossRef Roelen CA, Bültmann U, van Rhenen W, van der Klink JJ, Twisk JWR, Heymans MW (2013b) External validation of two prediction models identifying employees at risk of high sickness absence: cohort study with 1-year follow-up. BMC Public Health 13:105CrossRef
go back to reference Roelen CA, Stapelfeldt CM, Heymans MW, van Rhenen W, Labriola M, Nielsen CV, et al (2014a) Cross-national validation of prognostic models predicting sickness absence and the added value of work environment variables. J Occup Rehabil. doi:10.1007/s10926-014-9536-3 Roelen CA, Stapelfeldt CM, Heymans MW, van Rhenen W, Labriola M, Nielsen CV, et al (2014a) Cross-national validation of prognostic models predicting sickness absence and the added value of work environment variables. J Occup Rehabil. doi:10.​1007/​s10926-014-9536-3
go back to reference Roelen CA, van Rhenen W, Groothoff JW, van der Klink JJL, Bültmann U (2014b) Prolonged fatigue is associated with sickness absence in men but not in women: prospective study with 1-year follow-up of white collar employees. Int Arch Occup Environ Health 24:101–105 Roelen CA, van Rhenen W, Groothoff JW, van der Klink JJL, Bültmann U (2014b) Prolonged fatigue is associated with sickness absence in men but not in women: prospective study with 1-year follow-up of white collar employees. Int Arch Occup Environ Health 24:101–105
go back to reference Shahid A, Shen J, Shapiro CM (2010) Measurement of sleepiness and fatigue. J Psychosom Res 69:81–89CrossRef Shahid A, Shen J, Shapiro CM (2010) Measurement of sleepiness and fatigue. J Psychosom Res 69:81–89CrossRef
go back to reference Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski M et al (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21:128–138CrossRef Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski M et al (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21:128–138CrossRef
go back to reference Sundström J, Byberg L, Gedeborg R, Michaëlsson K, Berglund L (2011) Useful tests of usefulness of new risk factors: tools for assessing reclassification and discrimination. Scand J Public Health 39:439–441CrossRef Sundström J, Byberg L, Gedeborg R, Michaëlsson K, Berglund L (2011) Useful tests of usefulness of new risk factors: tools for assessing reclassification and discrimination. Scand J Public Health 39:439–441CrossRef
go back to reference Taimela S, Malmivaara A, Justén S, Läärä E, Sintonen H, Tiekso J et al (2008a) The effectiveness of two occupational health intervention programmes in reducing sickness absence among employees at risk. Two randomised controlled trials. Occup Environ Med 65:236–241CrossRef Taimela S, Malmivaara A, Justén S, Läärä E, Sintonen H, Tiekso J et al (2008a) The effectiveness of two occupational health intervention programmes in reducing sickness absence among employees at risk. Two randomised controlled trials. Occup Environ Med 65:236–241CrossRef
go back to reference Taimela S, Justén S, Aronen P, Sintonen H, Läärä E, Malmivaara A et al (2008b) An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial. Occup Environ Med 65:242–248CrossRef Taimela S, Justén S, Aronen P, Sintonen H, Läärä E, Malmivaara A et al (2008b) An occupational health intervention programme for workers at high risk for sickness absence. Cost effectiveness analysis based on a randomised controlled trial. Occup Environ Med 65:242–248CrossRef
go back to reference Tzoulaki I, Liberopoulos G, Ioannidis JPA (2011) Use of reclassification for assessment of improved prediction: an empirical evaluation. Int J Epidemiol 40:1094–1105CrossRef Tzoulaki I, Liberopoulos G, Ioannidis JPA (2011) Use of reclassification for assessment of improved prediction: an empirical evaluation. Int J Epidemiol 40:1094–1105CrossRef
go back to reference Virtanen P, Siukola A, Luukkaala T, Savinainen M, Arola H, Nygård CH et al (2008) Sick leaves in four factories—do characteristics of employees and work conditions explain differences in sickness absence between workplaces? Scand J Work Environ Health 34:260–266CrossRef Virtanen P, Siukola A, Luukkaala T, Savinainen M, Arola H, Nygård CH et al (2008) Sick leaves in four factories—do characteristics of employees and work conditions explain differences in sickness absence between workplaces? Scand J Work Environ Health 34:260–266CrossRef
go back to reference Ware JE, Kosinski MA, Turner-Bowker DM, Gandek B (2002) User’s manual for the SF-12v2® health survey. Quality Metric Incorporated, Lincoln Ware JE, Kosinski MA, Turner-Bowker DM, Gandek B (2002) User’s manual for the SF-12v2® health survey. Quality Metric Incorporated, Lincoln
go back to reference Wikman A, Marklund S, Alexanderson K (2005) Illness, disease, and sickness absence: an empirical test of differences between concepts of ill health. J Epidemiol Community Health 59:450–455CrossRef Wikman A, Marklund S, Alexanderson K (2005) Illness, disease, and sickness absence: an empirical test of differences between concepts of ill health. J Epidemiol Community Health 59:450–455CrossRef
Metadata
Title
Risk reclassification analysis investigating the added value of fatigue to sickness absence predictions
Authors
Corné A. M. Roelen
Ute Bültmann
Johan W. Groothoff
Jos W. R. Twisk
Martijn W. Heymans
Publication date
01-11-2015
Publisher
Springer Berlin Heidelberg
Published in
International Archives of Occupational and Environmental Health / Issue 8/2015
Print ISSN: 0340-0131
Electronic ISSN: 1432-1246
DOI
https://doi.org/10.1007/s00420-015-1032-3

Other articles of this Issue 8/2015

International Archives of Occupational and Environmental Health 8/2015 Go to the issue