Top

International Archives of Occupational and Environmental Health

Published in:

Open Access 01-04-2012 | Review

Review on the validity of self-report to assess work-related diseases

Authors: Annet F. Lenderink, Ilona Zoer, Henk F. van der Molen, Dick Spreeuwers, Monique H. W. Frings-Dresen, Frank J. H. van Dijk

Published in: International Archives of Occupational and Environmental Health | Issue 3/2012

Abstract

Purpose

Self-report is an efficient and accepted means of assessing population characteristics, risk factors, and diseases. Little is known on the validity of self-reported work-related illness as an indicator of the presence of a work-related disease. This study reviews the evidence on (1) the validity of workers’ self-reported illness and (2) on the validity of workers’ self-assessed work relatedness of an illness.

Methods

A systematic literature search was conducted in four databases (Medline, Embase, PsycINFO and OSH-Update). Two reviewers independently performed the article selection and data extraction. The methodological quality of the studies was evaluated, levels of agreement and predictive values were rated against predefined criteria, and sources of heterogeneity were explored.

Results

In 32 studies, workers’ self-reports of health conditions were compared with the "reference standard" of expert opinion. We found that agreement was mainly low to moderate. Self-assessed work relatedness of a health condition was examined in only four studies, showing low-to-moderate agreement with expert assessment. The health condition, type of questionnaire, and the case definitions for both self-report and reference standards influence the results of validation studies.

Conclusions

Workers’ self-reported illness may provide valuable information on the presence of disease, although the generalizability of the findings is limited primarily to musculoskeletal and skin disorders. For case finding in a population at risk, e.g., an active workers’ health surveillance program, a sensitive symptom questionnaire with a follow-up by a medical examination may be the best choice. Evidence on the validity of self-assessed work relatedness of a health condition is scarce. Adding well-developed questions to a specific medical diagnosis exploring the relationship between symptoms and work may be a good strategy.

Agius R (2000) Taking an occupational history. Health environment & work 2000 (http://www.agius.com/hew/resource/occhist.htm) (updated in April 2010; accessed on 28 December 2010)

Åkesson I, Johnsson B, Rylander L, Moritz U, Skerfving S (1999) Musculoskeletal disorders among female dental personnel–clinical examination and a 5-year follow-up study of symptoms. Int Arch Occup Environ Health 72(6):395–403CrossRef

Altman DG (1991) Practical statistics for medical research. Chapman & Hall, Boca Raton

Beckett M, Weinstein M, Goldman N, Yu-Hsuan L (2000) Do health interview surveys yield reliable data on chronic illness among older respondents? Am J Epidemiol 151(3):315–323

Bjorksten MG, Boquist B, Talback M, Edling C (1999) The validity of reported musculoskeletal problems. A study of questionnaire answers in relation to diagnosed disorders and perception of pain. Appl Ergon 30(4):325–330CrossRef

Bolen AR, Henneberger PK, Liang X, Sama SR, Preusse PA, Rosiello RA et al (2007) The validation of work-related self-reported asthma exacerbation. Occup Environ Med 64(5):343–348CrossRef

Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Int Med 138:W1–W12

Brauer C, Mikkelsen S (2003) The context of a study influences the reporting of symptoms. Int Arch Occup Environ Health 76(8):621–624CrossRef

Cegolon et al (2010) The primary care practitioner and the diagnosis of occupational diseases. BMC Public Health 10:405CrossRef

Chen PY, Popovich PM (2002) Correlation: parametric and nonparametric measures. Thousand Oaks, CA: Sage Publications

Choi SW, Peek-Asa C, Zwerling C, Sprince NL, Rautiainen RH, Whitten PS et al (2005) A comparison of self-reported hearing and pure tone threshold average in the Iowa farm family health and hazard survey. J Agromed 10(3):31–39CrossRef

Cohen J, Cohen P (1983) Applied multiple regression/correlation analysis for the behavioral sciences, 2nd edn. NJ Lawrence Erlbaum Associates, Hillsdale

Cvetkovski RS, Jensen H, Olsen J, Johansen JD, Agner T (2005) Relation between patients’ and physicians’ severity assessment of occupational hand eczema. Br J Dermatol 153(3):596–600CrossRef

Dasgupta S, Meisner C, Wheeler D, Xuyen K, Thi LN (2007) Pesticide poisoning of farm workers-implications of blood test results from Vietnam. Int J Hyg Environ Health 210(2):121–132CrossRef

de Joode BW, Vermeulen R, Heederik D, van GK, Kromhout H (2007) Evaluation of 2 self-administered questionnaires to ascertain dermatitis among metal workers and its relation with exposure to metalworking fluids. Contact Dermat 56(6):311–317CrossRef

Demers RY, Fischetti LR, Neale AV (1990) Incongruence between self-reported symptoms and objective evidence of respiratory disease among construction workers. Soc Sci Med 30(7):805–810CrossRef

Descatha A, Roquelaure Y, Chastang JF, Evanoff B, Melchior M, Mariot C et al (2007) Validity of Nordic-style questionnaires in the surveillance of upper-limb work-related musculoskeletal disorders. Scand J Work Environ Health 33(1):58–65CrossRef

Eskelinen L, Kohvakka A, Merisalo T, Hurri H, Wagar G (1991) Relationship between the self-assessment and clinical assessment of health status and work ability. Scand J Work Environ Health 17(Suppl 1):40–47

Fleisher JM, Kay D (2006) Risk perception bias, self-reporting of illness, and the validity of reported results in an epidemiologic study of recreational water associated illnesses. Mar Pollut Bull 52(3):264–268CrossRef

Gomez MI, Hwang SA, Sobotova L, Stark AD, May JJ (2001) A comparison of self-reported hearing loss and audiometry in a cohort of New York farmers. J Speech Lang Hear Res 44(6):1201–1208CrossRef

Gordon SB, Curran AD, Murphy J, Sillitoe C, Lee G, Wiley K, Morice AH (1997) Screening questionnaires for bakers’ asthma—are they worth the effort? Occup Med (Lond) 47(6):361–366

Gouttebarge V, Wind H, Kuijer PP, Frings-Dresen MH (2004) Reliability and validity of functional capacity evaluation methods: a systematic review with reference to Blankenship system, Ergos work simulator, Ergo-Kit and Isernhagen work system. Int Arch Occup Environ Health 77(8):527–537CrossRef

Haapanen N et al (1997) Agreement between questionnaire data and medical records of chronic diseases in middle-aged and elderly Finnish men and women. Am J Epidemiol 145(8):762–769CrossRef

Hayden JA et al (2006) Evaluation of the quality of prognosis studies in systematic reviews. Ann Int Med 144(6):427–437

Hill AB (1965) The environment and disease: association or causation? Proc R Soc Med 58:295–300

HSEa (2010) Self-reported work-related illness and workplace injuries in 2008/09: results from the Labour Force Survey. HSE. 10-3-2010

ILO (2005) World day for safety and health at work: a background paper. International Labour Office, Geneva

Innes E, Straker L (1999a) Reliability of work-related assessments. Work 13:107–124

Innes E, Straker L (1999b) Validity of work-related assessments. Work 13:125–152

Johnson NE, Browning SR, Westneat SM, Prince TS, Dignan MB (2009) Respiratory symptom reporting error in occupational surveillance of older farmers. J Occup Environ Med 51(4):472–479CrossRef

Juul-Kristensen B, Kadefors R, Hansen K, Bystrom P, Sandsjo L, Sjogaard G. (2006) C96linical signs and physical function in neck and upper extremities among elderly female computer users: the NEW study. Eur J Appl Physiol (96):136–45

Kaergaard A, Andersen JH, Rasmussen K, Mikkelsen S (2000) Identification of neck-shoulder disorders in a 1 year follow-up study. Validation Of a questionnaire-based method. Pain 86(3):305–310CrossRef

Kauffmann F, Annesi I, Chwalow J (1997) Validity of subjective assessment of changes in respiratory health status: a 30 year epidemiological study of workers in Paris. Eur Respir J 10(11):2508–2514CrossRef

Kleinman A, Eisenberg L, Good B (1978) Culture, illness, and care: clinical lessons from anthropologic and cross-cultural research. Ann Int Med 88(2):251–258

Kujala VM, Karvonen J, Laara E, Kanerva L, Estlander T, Reijula KE (1997) Postal questionnaire study of disability associated with latex allergy among health care workers in Finland. Am J Ind Med 32(3):197–204CrossRef

Landis J, Koch G (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef

Lax MB, Grant WD, Manetti FA, Klein R (1998) Recognizing occupational disease—taking an effective occupational history. American Academy of Family Physicians 1998 (http://www.aafp.org/afp/980915ap/lax.html). Accessed on 28 Dec 2010

Leventhal H, Meyer D, Nerenz DR (1980) The common sense representation of illness danger. In: Rachman S (ed) Contributions to medical psychology. Pergamon Press, New York, pp 17–30

Lezak MD (1995) Neuropsychological assessment. Oxford University Press, Oxford

Livesley EJ, Rushton L, English JS, Williams HC (2002) Clinical examinations to validate self-completion questionnaires: dermatitis in the UK printing industry. Contact Dermat 47(1):7–13CrossRef

Lundström R, Nilsson T, Hagberg M, Burstrom L (2008) Grading of sensorineural disturbances according to a modified Stockholm workshop scale using self-reports and QST. Int Arch Occup Environ Health 81(5):553–557CrossRef

Meding B, Barregard L (2001) Validity of self-reports of hand eczema. Contact Dermat 45(2):99–103CrossRef

Mehlum IS et al (2006) Self-reported work-related health problems from the Oslo health study. Occup Med (Lond) 56(6):371–379CrossRef

Mehlum IS, Veiersted KB, Waersted M, Wergeland E, Kjuus H (2009) Self-reported versus expert-assessed work-relatedness of pain in the neck, shoulder, arm. Scand J Work Environ Health 35(3):222–232CrossRef

Merkin SS, Cavanaugh K, Longenecker JC, Fink NE, Levey AS, Powe NR (2007) Agreement of self-reported comorbid conditions with medical and physician reports varied by disease among end-stage renal disease patients. J Clin Epidemiol 60:634–642

Murphy KR, Davidshofer CO (1994) Psychological testing: principles and applications, 3rd edn. Prentice-Hall International, London

Nettis E, Dambra P, Soccio AL, Ferrannini A, Tursi A (2003) Latex hypersensitivity: relationship with positive prick test and patch test responses among hairdressers. Allergy 58(1):57–61CrossRef

Ohlsson K, Attewell RG, Johnsson B, Ahlm A, Skerfving S (1994) An assessment of neck and upper extremity disorders by questionnaire and clinical examination. Ergonomics 37(5):891–897CrossRef

Oksanen T et al (2010) Self-report as an indicator of incident disease. Ann Epidemiol 20(7):547–554CrossRef

Palmer KT, Smedley J (2007) Work-relatedness of chronic neck pain with physical findings—a systematic review. Scand J Work Environ Health 33(3):165–191CrossRef

Perreault N, Brisson C, Dionne CE, Montreuil S, Punnett L (2008) Agreement between a self-administered questionnaire on musculoskeletal disorders of the neck-shoulder region and a physical examination. BMC Musculoskelet Disord 9:34CrossRef

Petrie KJ, Weinman J (2006) Why illness perceptions matter. Clin Med 6(6):536–539

Plomp HN (1993) Employees’ and occupational physicians’ different perceptions of the work-relatedness of health problems: a critical point in an effective consultation process. Occup Med (Lond) 43(Suppl 1):S18–S22

Pransky G, Snyder T, Dembe A, Himmelstein J (1999) Under-reporting of work-related disorders in the workplace: a case study and review of the literature. Ergonomics 42(1):171–182CrossRef

Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM (2009) A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol 62:797–806CrossRef

Rutjes AW, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PM (2007) Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technol Assess 11:50

Sensky T (1997) Causal attributions in physical illness. J Psychosom Res 43(6):565–573CrossRef

Silverstein BA, Stetson DS, Keyserling WM, Fine LJ (1997) Work-related musculoskeletal disorders: comparison of data sources for surveillance. Am J Ind Med 31(5):600–608CrossRef

Smit HA, Coenraads PJ, Lavrijsen AP, Nater JP (1992) Evaluation of a self-administered questionnaire on hand dermatitis. Contact Dermat 26(1):11–16CrossRef

Smith B et al (2008) Challenges of self-reported medical conditions and electronic medical records among members of a large military cohort. BMC Med Res Methodol 8:37CrossRef

Spector PE (2006) Method variance in organizational research. Truth or urban legend? Org Res Methods 9(2):221–232CrossRef

Spector PE, Brannick MT (2010) Common method issues: an introduction to the feature topic in organizational research methods. Org Res Methods 13:403CrossRef

Stål M, Moritz U, Johnsson B, Pinzke S (1997) The Natural course of musculoskeletal symptoms and clinical findings in upper extremities of female milkers. Int J Occup Environ Health 3(3):190–197

Susitaival P, Husman L, Hollmen A, Horsmanheimo M (1995) Dermatoses determined in a population of farmers in a questionnaire-based clinical study including methodology validation. Scand J Work Environ Health 21(1):30–35CrossRef

Svensson A, Lindberg M, Meding B, Sundberg K, Stenberg B (2002) Self-reported hand eczema: symptom-based reports do not increase the validity of diagnosis. Br J Dermatol 147(2):281–284CrossRef

Toomingas A, Nemeth G, Alfredsson L (1995) Self-administered examination versus conventional medical examination of the musculoskeletal system in the neck, shoulders, and upper limbs. The Stockholm MUSIC I Study Group. J Clin Epidemiol 48(12):1473–1483CrossRef

Vermeulen R, Kromhout H, Bruynzeel DP, de Boer EM (2000) Ascertainment of hand dermatitis using a symptom-based questionnaire; applicability in an industrial population. Contact Dermat 42(4):202–206CrossRef

Younger MS (1979) Handbook for linear regression. Duxbury Press, North Scituate

Zetterberg C, Forsberg A, Hansson E, Johansson H, Nielsen P, Danielsson B et al (1997) Neck and upper extremity problems in car assembly workers. A comparison of subjective complaints, work satisfaction, physical examination and gender. Int J Ind Ergon 19(4):277–289CrossRef

Title: Review on the validity of self-report to assess work-related diseases
Authors: Annet F. Lenderink
Ilona Zoer
Henk F. van der Molen
Dick Spreeuwers
Monique H. W. Frings-Dresen
Frank J. H. van Dijk
Publication date: 01-04-2012
Publisher: Springer-Verlag
Published in: International Archives of Occupational and Environmental Health / Issue 3/2012
Print ISSN: 0340-0131
Electronic ISSN: 1432-1246
DOI: https://doi.org/10.1007/s00420-011-0662-3

At a glance: The STEP trials

Springer Medicine

Review on the validity of self-report to assess work-related diseases

Abstract

Purpose

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 3/2012

Assessment of time to pregnancy and spontaneous abortion status following occupational exposure to organic solvents mixture

Regarding “Long-term lead elimination from plasma and whole blood after poisoning”

Occupational exposure to diisononyl phthalate (DiNP) in polyvinyl chloride processing operations

Can the relationship between shoulder tendon lesions and lifting or carrying be explained by pushing or pulling?

Occupational physical activity and mortality among Danish workers

Long-term lead elimination from plasma and whole blood after poisoning