Top

Published in:

01-01-2015 | Review Article

Estimating Productivity Costs in Health Economic Evaluations: A Review of Instruments and Psychometric Evidence

Author: Kenneth Tang

Published in: PharmacoEconomics | Issue 1/2015

Abstract

Health economic evaluations (i.e. cost-effectiveness appraisal of an intervention) are useful aids for decision makers responsible for the allocation of scarce healthcare resources. The relevance of including health-related productivity costs (or benefits) in these evaluations is increasingly recognized and, as such, reliable and valid instruments to quantify productivity costs are needed. Over the years, a number of work productivity instruments have emerged in the literature, along with a growing body of psychometric evidence. The overall aim of this paper is to provide a review of available instruments with potential for estimating health-related productivity costs. This included the Health and Labor Questionnaire, Health and Work Performance Questionnaire, Health-Related Productivity Questionnaire Diary, Productivity and Disease Questionnaire, Quantity and Quality method, Stanford Presenteeism Scale 13, Valuation of Lost Productivity, Work and Health Interview, Work Limitations Questionnaire, Work Productivity and Activity Impairment Questionnaire, and Work Productivity Short Inventory. Critical discussions on the instruments’ overall strengths and limitations, applicability for health economic evaluations, as well as the methodological quality of existing psychometric evidence were provided. Lastly, a set of reflective questions were proposed for users to consider when selecting an instrument for health economic evaluations.

Longitudinal construct validity is sometimes considered as a type of responsiveness.

Brouwer WB, van Exel NJ, Baltussen RM, Rutten FF. A dollar is a dollar is a dollar—or is it? Value Health. 2006;9(5):341–7.PubMedCrossRef

Drummond MF, Sculpher MJ, Torrance GW, O’Brien BJ, Stoddart GL. Methods for the economic evalation of health care programmes. Oxford: Oxford University Press; 2005.

Gold M, Siegel J, Russell L, Weinstein M. Cost-effectiveness in health and medicine. New York: Oxford University Press; 1996.

Prasad M, Wahlqvist P, Shikiar R, Shih YC. A review of self-report instruments measuring health-related work productivity: a patient-reported outcomes perspective. Pharmacoeconomics. 2004;22(4):225–44.PubMedCrossRef

Lofland JH, Pizzi L, Frick KD. A review of health-related workplace productivity loss instruments. Pharmacoeconomics. 2004;22(3):165–84.PubMedCrossRef

Zhang W, Bansback N, Anis AH. Measuring and valuing productivity loss due to poor health: a critical review. Soc Sci Med. 2011;72(2):185–92.PubMedCrossRef

Krol M, Brouwer W, Rutten F. Productivity costs in economic evaluations: past, present, future. Pharmacoeconomics. 2013;31(7):537–49.PubMedCrossRef

Krol M, Brouwer W. How to estimate productivity costs in economic evaluations. Pharmacoeconomics. 2014;32(4):335–44.PubMedCrossRef

Koopmanschap MA, Rutten FF. Indirect costs in economic studies: confronting the confusion. Pharmacoeconomics. 1993;4(6):446–54.PubMedCrossRef

10.

Anis A, Zhang W, Emery P, Sun H, Singh A, Freundlich B, et al. The effect of etanercept on work productivity in patients with early active rheumatoid arthritis: results from the COMET study. Rheumatology. 2009;48(10):1283–9.PubMedCrossRef

11.

Escorpizo R, Bombardier C, Boonen A, Hazes JM, Lacaille D, Strand V, et al. Worker productivity outcome measures in arthritis. J Rheumatol. 2007;34(6):1372–80.PubMed

12.

Stewart WF, Ricci JA, Chee E, Hahn SR, Morganstein D. Cost of lost productive work time among US workers with depression. JAMA. 2003;289(23):3135–44.PubMedCrossRef

13.

Goetzel RZ, Guindon AM, Turshen IJ, Ozminkowski RJ. Health and productivity management: establishing key performance measures, benchmarks, and best practices. J Occup Environ Med. 2001;43(1):10–7.PubMedCrossRef

14.

Stewart WF, Ricci JA, Chee E, Morganstein D. Lost productive work time costs from health conditions in the United States: results from the American Productivity Audit. J Occup Environ Med. 2003;45(12):1234–46.PubMedCrossRef

15.

Lamb CE, Ratner PH, Johnson CE, Ambegaonkar AJ, Joshi AV, Day D, et al. Economic impact of workplace productivity losses due to allergic rhinitis compared with select medical conditions in the United States from an employer perspective. Curr Med Res Opin. 2006;22(6):1203–10.PubMedCrossRef

16.

Li X, Gignac MA, Anis AH. The indirect costs of arthritis resulting from unemployment, reduced performance, and occupational changes while at work. Med Care. 2006;44(4):304–10.PubMedCrossRef

17.

Burton WN, Chen CY, Conti DJ, Schultz AB, Pransky G, Edington DW. The association of health risks with on-the-job productivity. J Occup Environ Med. 2005;47(8):769–77.PubMed

18.

Jacob-Tacken KH, Koopmanschap MA, Meerding WJ, Severens JL. Correcting for compensating mechanisms related to productivity costs in economic evaluations of health care programmes. Health Econ. 2005;14(5):435–43.PubMedCrossRef

19.

Severens JL, Laheij RJ, Jansen JB, Van der Lisdonk EH, Verbeek AL. Estimating the cost of lost productivity in dyspepsia. Aliment Pharmacol Ther. 1998;12(9):919–23.PubMedCrossRef

20.

Pauly MV, Nicholson S, Xu J, Polsky D, Danzon PM, Murray JF, et al. A general model of the impact of absenteeism on employers and employees. Health Econ. 2002;11(3):221–31.PubMedCrossRef

21.

Nicholson S, Pauly MV, Polsky D, Sharda C, Szrek H, Berger ML. Measuring the effects of work loss on productivity with team production. Health Econ. 2006;15(2):111–23.PubMedCrossRef

22.

Pauly MV, Nicholson S, Polsky D, Berger ML, Sharda C. Valuing reductions in on-the-job illness: ‘presenteeism’ from managerial and economic perspectives. Health Econ. 2008;17(4):469–85.PubMedCrossRef

23.

Jonsson B. Ten arguments for a societal perspective in the economic evaluation of medical innovations. Eur J Health Econ. 2009;10(4):357–9.PubMedCrossRef

24.

Johannesson M. The willingness to pay for health changes, the human-capital approach and the external costs. Health Policy. 1996;36(3):231–44.PubMedCrossRef

25.

Reid M. Economics of household production. New York, NY: Wiley; 1934.

26.

Zhang W, Bansback N, Boonen A, Severens JL, Anis AH. Development of a composite questionnaire, the valuation of lost productivity, to value productivity losses: application in rheumatoid arthritis. Value Health. 2012;15(1):46–54.PubMedCrossRef

27.

Koopmanschap MA, Rutten FF, van Ineveld BM, van Roijen L. The friction cost method for measuring indirect costs of disease. J Health Econ. 1995;14(2):171–89.PubMedCrossRef

28.

Johannesson M, Karlsson G. The friction cost method: a comment. J Health Econ. 1997;16(2):249–55; discussion 57–9.

29.

Johannesson M. Avoiding double-counting in pharmacoeconomic studies. Pharmacoeconomics. 1997;11(5):385–8.PubMedCrossRef

30.

Brouwer WB, Koopmanschap MA, Rutten FF. Productivity costs in cost-effectiveness analysis: numerator or denominator: a further discussion. Health Econ. 1997;6(5):511–4.PubMedCrossRef

31.

Weisbrod BA. The valuation of human capital. J Polit Econ. 1961;69(5):425–36.CrossRef

32.

Drummond M. Cost-of-illness studies: a major headache? Pharmacoeconomics. 1992;2(1):1–4.PubMedCrossRef

33.

Koopmanschap MA, van Ineveld BM. Towards a new approach for estimating indirect costs of disease. Soc Sci Med. 1992;34(9):1005–10.PubMedCrossRef

34.

van den Berg B, Brouwer W, van Exel J, Koopmanschap M, van den Bos GA, Rutten F. Economic valuation of informal care: lessons from the application of the opportunity costs and proxy good methods. Soc Sci Med. 2006;62(4):835–45.PubMedCrossRef

35.

Fleiss JL, Cohen J, Everitt BS. Large-sample standard errors of kappa and weighted kappa. Psychol Bull. 1969;72:323–7.CrossRef

36.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.PubMedCrossRef

37.

Streiner DL, Norman GR. Health measurement scales. A practical guide to their development and use. New York, NY: Oxford University Press; 1995.

38.

Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.PubMedCrossRef

39.

Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

40.

Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–333.CrossRef

41.

Kuder GF, Richardson MW. The theory of the estimation of test reliability. Psychometrika. 1937;2(3):151–60.CrossRef

42.

Messick S. Test validity: a matter of consequence. Soc Indic Res. 1998;45(1–3):35–44.CrossRef

43.

Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52(4):281–302.PubMedCrossRef

44.

Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12(4):349–62.PubMedCrossRef

45.

Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.PubMedCentralPubMedCrossRef

46.

van Roijen L, Essink-Bot ML, Koopmanschap MA, Bonsel G, Rutten FF. Labor and health status in economic evaluation of health care. The Health and Labor Questionnaire. Int J Technol Assess Health Care. 1996;12(3):405–15.PubMedCrossRef

47.

Hakkaart-van Roijen L, Essink-Bot ML. Manual: The Health and Labour Questionnaire. Institute for Medical Technology Assessment, Erasmus University Rotterdam; 2000. Report No.: 52. http://repub.eur.nl/pub/1313/.

48.

Brouwer WB, Koopmanschap MA, Rutten FF. Productivity losses without absence: measurement validation and empirical evidence. Health Policy. 1999;48(1):13–27.PubMedCrossRef

49.

Koopmanschap MA. PRODISQ: a modular questionnaire on productivity and disease for economic evaluation studies. Expert Rev Pharmacoecon Outcomes Res. 2005;5(1):23–8.PubMedCrossRef

50.

Hakkaart-van Roijen L. Short Form – Health and Labour Questionnaire. Erasmus University Rotterdam: Institute for Medical Technology Assessment; 2010.

51.

Braakman-Jansen LM, Taal E, Kuper IH, van de Laar MA. Productivity loss due to absenteeism and presenteeism by different instruments in patients with RA and subjects without RA. Rheumatology (Oxford). 2012;51(2):354–61.PubMedCrossRef

52.

Meerding WJ, IJzelenberg W, Koopmanschap MA, Severens JL, Burdorf A. Health problems lead to considerable productivity loss at work among workers with high physical load jobs. J Clin Epidemiol. 2005;58(5):517–23.PubMedCrossRef

53.

Osterhaus JT, Gutterman DL, Plachetka JR. Healthcare resource and lost labour costs of migraine headache in the US. Pharmacoeconomics. 1992;2(1):67–76.PubMedCrossRef

54.

Kessler RC, Barber C, Beck A, Berglund P, Cleary PD, McKenas D, et al. The World Health Organization Health and Work Performance Questionnaire (HPQ). J Occup Environ Med. 2003;45(2):156–74.PubMedCrossRef

55.

Kessler RC, Ames M, Hymel PA, Loeppke R, McKenas DK, Richling DE, et al. Using the World Health Organization Health and Work Performance Questionnaire (HPQ) to evaluate the indirect workplace costs of illness. J Occup Environ Med. 2004;46(6 Suppl):S23–37.PubMedCrossRef

56.

Kessler RC, Petukhova M, Ustun TB. HPQ Short Form (absenteeism and presenteeism questions and scoring rules). 2007.

57.

Zhang W, Gignac MA, Beaton D, Tang K, Anis AH. Productivity loss due to presenteeism among patients with arthritis: estimates from 4 instruments. J Rheumatol. 2010;37(9):1805–14.PubMedCrossRef

58.

Kumar RN, Hass SL, Li JZ, Nickens DJ, Daenzer CL, Wathen LK. Validation of the Health-Related Productivity Questionnaire Diary (HRPQ-D) on a sample of patients with infectious mononucleosis: results from a phase 1 multicenter clinical trial. J Occup Environ Med. 2003;45(8):899–907.PubMedCrossRef

59.

Collins JJ, Baase CM, Sharda CE, Ozminkowski RJ, Nicholson S, Billotti GM, et al. The assessment of chronic health conditions on work performance, absence, and total economic impact for employers. J Occup Environ Med. 2005;47(6):547–57.PubMedCrossRef

60.

Koopman C, Pelletier KR, Murray JF, Sharda CE, Berger ML, Turpin RS, et al. Stanford presenteeism scale: health status and employee productivity. J Occup Environ Med. 2002;44(1):14–20.PubMedCrossRef

61.

Lynch W, Riedel J. Measuring employee productivity: a guide to self-assessment tools. Scottsdale, AZ: Institute for Health & Productivity Management & William Mercer; 2001.

62.

Turpin RS, Ozminkowski RJ, Sharda CE, Collins JJ, Berger ML, Billotti GM, et al. Reliability and validity of the Stanford Presenteeism Scale. J Occup Environ Med. 2004;46(11):1123–33.PubMedCrossRef

63.

Zhang W, Bansback N, Kopec J, Anis AH. Measuring time input loss among patients with rheumatoid arthritis: validity and reliability of the valuation of lost productivity questionnaire. J Occup Environ Med. 2011;52(5):530–6.CrossRef

64.

Stewart WF, Ricci JA, Chee E, Morganstein D, Lipton R. Lost productive time and cost due to common pain conditions in the US workforce. JAMA. 2003;290(18):2443–54.PubMedCrossRef

65.

Stewart WF, Ricci JA, Leotta C. Health-related lost productive time (LPT): recall interval and bias in LPT estimates. J Occup Environ Med. 2004;46(6 Suppl):S12–22.PubMedCrossRef

66.

Stewart WF, Ricci JA, Leotta C, Chee E. Validation of the work and health interview. Pharmacoeconomics. 2004;22(17):1127–40.PubMedCrossRef

67.

Lerner D, Amick III BC, Rogers WH, Malspeis S, Bungay K, Cynn D. The Work Limitations Questionnaire. Med Care. 2001;39(1):72–85.

68.

Lerner D, Rogers WH, Chang H. Technical report: scoring the work limitations questionnaire (WLQ) and the WLQ index for estimating work productivity loss. 2003.

69.

Lerner D, Amick III BC, Lee JC, Rooney T, Rogers WH, Chang H, et al. Relationship of employee-reported work limitations to work productivity. Med Care. 2003;41(5):649–59.

70.

Lerner D, Reed JI, Massarotti E, Wester LM, Burke TA. The Work Limitations Questionnaire’s validity and reliability among patients with osteoarthritis. J Clin Epidemiol. 2002;55(2):197–208.PubMedCrossRef

71.

Walker N, Michaud K, Wolfe F. Work limitations among working persons with rheumatoid arthritis: results, reliability, and validity of the work limitations questionnaire in 836 patients. J Rheumatol. 2005;32(6):1006–12.PubMed

72.

Beaton DE, Tang K, Gignac MA, Lacaille D, Badley EM, Anis AH, et al. Reliability, validity, and responsiveness of five at-work productivity measures in patients with rheumatoid arthritis or osteoarthritis. Arthritis Care Res. 2010;62(1):28–37.CrossRef

73.

Roy JS, MacDermid JC, Amick BC III, Shannon HS, McMurtry R, Roth JH, et al. Validity and responsiveness of presenteeism scales in chronic work-related upper-extremity disorders. Phys Ther. 2011;91(2):254–66.PubMedCrossRef

74.

Ozminkowski RJ, Goetzel RZ, Chang S, Long S. The application of two health and productivity instruments at a large employer. J Occup Environ Med. 2004;46(7):635–48.PubMedCrossRef

75.

Reilly MC, Zbrozek AS, Dukes EM. The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics. 1993;4(5):353–65.PubMedCrossRef

76.

Bushnell DM, Reilly MC, Galani C, Martin ML, Ricci JF, Patrick DL, et al. Validation of electronic data capture of the Irritable Bowel Syndrome-Quality of Life Measure, the Work Productivity and Activity Impairment Questionnaire for Irritable Bowel Syndrome and the EuroQol. Value Health. 2006;9(2):98–105.PubMedCrossRef

77.

Ariza-Ariza R, Hernandez-Cruz B, Navarro-Compan V, Leyva Pardo C, Juanola X, Navarro-Sarabia F. A comparison of telephone and paper self-completed questionnaires of main patient-related outcome measures in patients with ankylosing spondylitis and psoriatic arthritis. Rheumatol Int. 2013;33(11):2731–6.PubMedCrossRef

78.

Zhang W, Bansback N, Boonen A, Young A, Singh A, Anis AH. Validity of the work productivity and activity impairment questionnaire: general health version in patients with rheumatoid arthritis. Arthritis Res Ther. 2010;12(5):R177.PubMedCentralPubMedCrossRef

79.

Chen H, Blanc PD, Hayden ML, Bleecker ER, Chawla A, Lee JH, et al. Assessing productivity loss and activity impairment in severe or difficult-to-treat asthma. Value Health. 2008;11(2):231–9.PubMedCrossRef

80.

Erickson SR, Guthrie S, Vanetten-Lee M, Himle J, Hoffman J, Santos SF, et al. Severity of anxiety and work-related outcomes of patients with anxiety disorders. Depress Anxiety. 2009;26(12):1165–71.PubMedCrossRef

81.

Giovannetti ER, Wolff JL, Frick KD, Boult C. Construct validity of the Work Productivity and Activity Impairment questionnaire across informal caregivers of chronically ill older patients. Value Health. 2009;12(6):1011–7.PubMedCentralPubMedCrossRef

82.

Reilly MC, Gerlier L, Brabant Y, Brown M. Validity, reliability, and responsiveness of the work productivity and activity impairment questionnaire in Crohn’s disease. Clin Ther. 2008;30(2):393–404.PubMedCrossRef

83.

Wahlqvist P, Carlsson J, Stalhammar NO, Wiklund I. Validity of a Work Productivity and Activity Impairment questionnaire for patients with symptoms of gastro-esophageal reflux disease (WPAI-GERD): results from a cross-sectional study. Value Health. 2002;5(2):106–13.PubMedCrossRef

84.

Wahlqvist P, Guyatt GH, Armstrong D, Degl’Innocenti A, Heels-Ansdell D, El-Dika S, et al. The Work Productivity and Activity Impairment Questionnaire for Patients with Gastroesophageal Reflux Disease (WPAI-GERD): responsiveness to change and English language validation. Pharmacoeconomics. 2007;25(5):385–96.PubMedCrossRef

85.

Reilly MC, Lavin PT, Kahler KH, Pariser DM. Validation of the Dermatology Life Quality Index and the Work Productivity and Activity Impairment-Chronic Hand Dermatitis questionnaire in chronic hand dermatitis. J Am Acad Dermatol. 2003;48(1):128–30.PubMedCrossRef

86.

Reilly MC, Bracco A, Ricci JF, Santoro J, Stevens T. The validity and accuracy of the Work Productivity and Activity Impairment questionnaire—irritable bowel syndrome version (WPAI:IBS). Aliment Pharmacol Ther. 2004;20(4):459–67.PubMedCrossRef

87.

Reilly MC, Gooch KL, Wong RL, Kupper H, van der HD. Validity, reliability and responsiveness of the Work Productivity and Activity Impairment Questionnaire in ankylosing spondylitis. Rheumatology. 2010;49(4):812–9.PubMedCrossRef

88.

Goetzel RZ, Hawkins K, Ozminkowski RJ, Wang S. The health and productivity cost burden of the “top 10” physical and mental health conditions affecting six large U.S. employers in 1999. J Occup Environ Med. 2003;45(1):5–14.PubMedCrossRef

89.

Berger ML, Murray JF, Xu J, Pauly M. Alternative valuations of work loss and productivity. J Occup Environ Med. 2001;43(1):18–24.PubMedCrossRef

90.

Schultz AB, Edington DW. Employee health and presenteeism: a systematic review. J Occup Rehabil. 2007;17(3):547–79.PubMedCrossRef

91.

Brooks A, Hagen SE, Sathyanarayanan S, Schultz AB, Edington DW. Presenteeism: critical issues. J Occup Environ Med. 2010;52(11):1055–67.PubMedCrossRef

92.

Scuffham PA, Vecchio N, Whiteford HA. Exploring the validity of HPQ-based presenteeism measures to estimate productivity losses in the health and education sectors. Med Decis Making. 2014;34(1):127–37.

93.

Sanderson K, Tilse E, Nicholson J, Oldenburg B, Graves N. Which presenteeism measures are more sensitive to depression and anxiety? J Affect Disord. 2007;101(1–3):65–74.PubMedCrossRef

94.

Wolfe F, Michaud K, Choi HK, Williams R. Household income and earnings losses among 6,396 persons with rheumatoid arthritis. J Rheumatol. 2005;32(10):1875–83.PubMed

95.

Tang K, Beaton DE, Amick BC 3rd, Hogg-Johnson S, Cote P, Loisel P. Confirmatory factor analysis of the Work Limitations Questionnaire (WLQ-25) in workers’ compensation claimants with chronic upper-limb disorders. J Occup Rehabil. 2013;23(2):228–38.PubMedCrossRef

96.

Brozek JL, Guyatt GH, Heels-Ansdell D, Degl’Innocenti A, Armstrong D, Fallone CA, et al. Specific HRQL instruments and symptom scores were more responsive than preference-based generic instruments in patients with GERD. J Clin Epidemiol. 2009;62(1):102–10.PubMedCrossRef

97.

Ozminkowski RJ, Goetzel RZ, Long SR. A validity analysis of the Work Productivity Short Inventory (WPSI) instrument measuring employee health and productivity. J Occup Environ Med. 2003;45(11):1183–95.PubMedCrossRef

Title: Estimating Productivity Costs in Health Economic Evaluations: A Review of Instruments and Psychometric Evidence
Author: Kenneth Tang
Publication date: 01-01-2015
Publisher: Springer International Publishing
Published in: PharmacoEconomics / Issue 1/2015
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI: https://doi.org/10.1007/s40273-014-0209-z

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Estimating Productivity Costs in Health Economic Evaluations: A Review of Instruments and Psychometric Evidence

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2015

Reduce Mortality Risk Above All Else: A Discrete-Choice Experiment in Acute Coronary Syndrome Patients

Validation of the Underlying Assumptions of the Quality-Adjusted Life-Years Outcome: Results from the ECHOUTCOME European Project

A Primer on Marginal Effects—Part I: Theory and Formulae

Concepts of ‘Personalization’ in Personalized Medicine: Implications for Economic Evaluation

Healthy Decisions: Towards Uncertainty Tolerance in Healthcare Policy

Pertuzumab in Combination with Trastuzumab and Docetaxel for the Treatment of HER2-Positive Metastatic or Locally Recurrent Unresectable Breast Cancer