Skip to main content
Top
Published in: Journal of Occupational Rehabilitation 2/2017

01-06-2017

Confirmatory Factor and Rasch Analyses Support a Revised 14-Item Version of the Organizational, Policies, and Practices (OPP) Scale

Authors: Qiyun Shi, Joy C. MacDermid, Kenneth Tang, Kathryn E. Sinden, Dave Walton, Ruby Grewal

Published in: Journal of Occupational Rehabilitation | Issue 2/2017

Login to get access

Abstract

Background The long version of the organizational, policies and practices (OPP) had a high burden and short versions were developed to solve this drawback. The 11-item version showed promise, but the ergonomic subscale was deficient. The OPP-14 was developed by adding three additional items to the ergonomics subscale. The aim of this study is to evaluate the factor structure using confirmatory factor and Rasch analyses in healthy firefighters. Methods A sample of 261 firefighters (Mean age 42 years, 95 % male) were sampled. A confirmatory factor and Rasch analyses were used to assess the internal consistency, factor structure and other psychometric characteristics of revised OPP-14. Results The OPP-14 demonstrates sound factor structure and internal consistency in firefighters. Confirmatory factor analysis confirmed the consistency of the original 4-domain structure (CFI = 0.97, TLI = 0.96, and RMSEA = 0.053). The 5 items showing misfit initially with disordered thresholds were rescored. The four subscales satisfied Rasch expectations with well target and acceptable reliability. Conclusions The OPP-14 scale shows a promising factor structure in this sample and remediated deficits found in OPP-11. This version may be preferable for musculoskeletal concerns or work applications where ergonomic indicators are relevant.
Appendix
Available only for authorised users
Literature
1.
go back to reference Shannon HS, Mayr J, Haines T. Overview of the relationship between organizational and workplace factors and injury rates. Saf Sci. 1997;26(3):201–17.CrossRef Shannon HS, Mayr J, Haines T. Overview of the relationship between organizational and workplace factors and injury rates. Saf Sci. 1997;26(3):201–17.CrossRef
2.
go back to reference Williams RM, Westmorland MG, Shannon HS, Amick BC 3rd. Disability management practices in Ontario health care workplaces. J Occup Rehabil. 2007;17(1):153–65.CrossRefPubMed Williams RM, Westmorland MG, Shannon HS, Amick BC 3rd. Disability management practices in Ontario health care workplaces. J Occup Rehabil. 2007;17(1):153–65.CrossRefPubMed
3.
go back to reference Friesen MN, Yassi A, Cooper J. Return-to-work: the importance of human interactions and organizational structures. Work. 2001;17(1):11–22.PubMed Friesen MN, Yassi A, Cooper J. Return-to-work: the importance of human interactions and organizational structures. Work. 2001;17(1):11–22.PubMed
4.
go back to reference Hunt HA, Habeck RV, VanTol B, Scully SM. Disability prevention among Michigan employers, 1988–1993. 1993. Hunt HA, Habeck RV, VanTol B, Scully SM. Disability prevention among Michigan employers, 1988–1993. 1993.
5.
go back to reference Lewchuk W, Robb AL, Walters V. The effectiveness of bill 70 and joint health and safety committees in reducing injuries in the workplace: the case of Ontario. Can Public Policy/Anal de Polit. 1996; 225–43. Lewchuk W, Robb AL, Walters V. The effectiveness of bill 70 and joint health and safety committees in reducing injuries in the workplace: the case of Ontario. Can Public Policy/Anal de Polit. 1996; 225–43.
6.
go back to reference Shannon HS, Robson LS, Sale JE. Creating safer and healthier workplaces: role of organizational factors and job characteristics*. Am J Ind Med. 2001;40(3):319–34.CrossRefPubMed Shannon HS, Robson LS, Sale JE. Creating safer and healthier workplaces: role of organizational factors and job characteristics*. Am J Ind Med. 2001;40(3):319–34.CrossRefPubMed
7.
go back to reference Habeck RV, Hunt HA, VanTol B. Workplace factors associated with preventing and managing work disability. Rehabil Couns Bull. 1998;42(2):98–143. Habeck RV, Hunt HA, VanTol B. Workplace factors associated with preventing and managing work disability. Rehabil Couns Bull. 1998;42(2):98–143.
8.
go back to reference Habeck RV, Leahy MJ, Hunt HA, Chan F. Employer factors related to workers’ compensation claims and disability management. Rehabil Couns Bull. 1991. Habeck RV, Leahy MJ, Hunt HA, Chan F. Employer factors related to workers’ compensation claims and disability management. Rehabil Couns Bull. 1991.
9.
go back to reference Amick BC, Habeck RV, Hunt A, Fossel AH, Chapin A, Keller RB, et al. Measuring the impact of organizational behaviors on work disability prevention and management. J Occup Rehabil. 2000;10(1):21–38.CrossRef Amick BC, Habeck RV, Hunt A, Fossel AH, Chapin A, Keller RB, et al. Measuring the impact of organizational behaviors on work disability prevention and management. J Occup Rehabil. 2000;10(1):21–38.CrossRef
10.
go back to reference Tang K, MacDermid JC, Amick BC, Beaton DE. The 11-item workplace organizational policies and practices questionnaire (OPP-11): examination of its construct validity, factor structure, and predictive validity in injured workers with upper-limb disorders. Am J Ind Med. 2011;54(11):834–46.CrossRefPubMed Tang K, MacDermid JC, Amick BC, Beaton DE. The 11-item workplace organizational policies and practices questionnaire (OPP-11): examination of its construct validity, factor structure, and predictive validity in injured workers with upper-limb disorders. Am J Ind Med. 2011;54(11):834–46.CrossRefPubMed
11.
go back to reference Muggleton JM, Allen R, Chappell PH. Hand and arm injuries associated with repetitive manual work in industry: a review of disorders, risk factors and preventive measures. Ergonomics. 1999;42(5):714–39.CrossRefPubMed Muggleton JM, Allen R, Chappell PH. Hand and arm injuries associated with repetitive manual work in industry: a review of disorders, risk factors and preventive measures. Ergonomics. 1999;42(5):714–39.CrossRefPubMed
12.
go back to reference Shapiro SS, Wilk MB. An analysis of variance test for normality (complete samples). Biometrika. 1965;52(3/4):591–611.CrossRef Shapiro SS, Wilk MB. An analysis of variance test for normality (complete samples). Biometrika. 1965;52(3/4):591–611.CrossRef
13.
go back to reference Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press; 2008.CrossRef Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press; 2008.CrossRef
14.
go back to reference Nunnally JC, Bernstein IH, Berge JMF. Psychometric theory. New York: McGraw-Hill; 1967. Nunnally JC, Bernstein IH, Berge JMF. Psychometric theory. New York: McGraw-Hill; 1967.
15.
go back to reference Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed
16.
go back to reference Kline RB. Principles and practice of structural equation modeling. NY: Guilford press; 2010. Kline RB. Principles and practice of structural equation modeling. NY: Guilford press; 2010.
17.
go back to reference Jöreskog KG. Testing structural equation models, vol. 154. Beverly Hills: Sage Focus Editions; 1993. Jöreskog KG. Testing structural equation models, vol. 154. Beverly Hills: Sage Focus Editions; 1993.
18.
go back to reference Brown TA. Confirmatory factor analysis for applied research. NY: Guilford Press; 2006. Brown TA. Confirmatory factor analysis for applied research. NY: Guilford Press; 2006.
19.
go back to reference Rasch G. Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. 1960. Rasch G. Studies in mathematical psychology: I. Probabilistic models for some intelligence and attainment tests. 1960.
20.
go back to reference Bond T, Fox C. Applying the Rasch model: fundamental measurement in the human sciences. London: Lawrence Erlbaum; 2007. Bond T, Fox C. Applying the Rasch model: fundamental measurement in the human sciences. London: Lawrence Erlbaum; 2007.
21.
go back to reference Wolfe E, Smith E Jr. Instrument development tools and activities for measure validation using Rasch models: part I-instrument development tools. J Appl Meas. 2007;8(1):97–123.PubMed Wolfe E, Smith E Jr. Instrument development tools and activities for measure validation using Rasch models: part I-instrument development tools. J Appl Meas. 2007;8(1):97–123.PubMed
22.
go back to reference Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Care Res. 2007;57(8):1358–62.CrossRef Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Care Res. 2007;57(8):1358–62.CrossRef
23.
go back to reference Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.CrossRefPubMed Tennant A, McKenna SP, Hagell P. Application of Rasch analysis in the development and application of quality of life instruments. Value Health. 2004;7:S22–6.CrossRefPubMed
24.
go back to reference Guttman L. The basis for scalogram analysis. Bobbs-Merrill, College Division; 1949. Guttman L. The basis for scalogram analysis. Bobbs-Merrill, College Division; 1949.
25.
go back to reference Smith RM. Fit analysis in latent trait measurement models. J Appl Meas. 2000;1(2):199.PubMed Smith RM. Fit analysis in latent trait measurement models. J Appl Meas. 2000;1(2):199.PubMed
26.
go back to reference Tennant A, Pallant J. Unidimensionality matters! (A tale of two Smiths?). Rasch Meas Trans. 2006;20(1):1048–51. Tennant A, Pallant J. Unidimensionality matters! (A tale of two Smiths?). Rasch Meas Trans. 2006;20(1):1048–51.
27.
go back to reference Wright B. Local dependency, correlations and principal components. Rasch Meas Trans. 1996;10(3):509–11. Wright B. Local dependency, correlations and principal components. Rasch Meas Trans. 1996;10(3):509–11.
28.
go back to reference Wright BD, Stone MH. Best test design. Rasch Meas. 1979. Wright BD, Stone MH. Best test design. Rasch Meas. 1979.
29.
go back to reference Andrich D. Category ordering and their utility. Rasch Meas Trans. 1996;9(4):464–5. Andrich D. Category ordering and their utility. Rasch Meas Trans. 1996;9(4):464–5.
30.
go back to reference Linacre J. Step disordering and Rasch thurstone thresholds. Rasch Meas Trans. 1991;5(3):171. Linacre J. Step disordering and Rasch thurstone thresholds. Rasch Meas Trans. 1991;5(3):171.
31.
go back to reference Linacre JM. Investigating rating scale category utility. J Outcome Meas. 1999;3(2):103.PubMed Linacre JM. Investigating rating scale category utility. J Outcome Meas. 1999;3(2):103.PubMed
32.
go back to reference Andrich D. An index of person separation in latent trait theory, the traditional KR-20 index, and the Guttman scale response pattern. Educ Res Perspect. 1982;9(1):95–104. Andrich D. An index of person separation in latent trait theory, the traditional KR-20 index, and the Guttman scale response pattern. Educ Res Perspect. 1982;9(1):95–104.
33.
go back to reference Wright B. Reliability and separation. Rasch Meas Trans. 1996;9(4):472. Wright B. Reliability and separation. Rasch Meas Trans. 1996;9(4):472.
34.
go back to reference Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46(1):1–18.CrossRefPubMed Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46(1):1–18.CrossRefPubMed
35.
go back to reference Tennant A, Horton M, Pallant J. Introduction to Rasch analysis: a workbook. Department of Rehabilitation Medicine, University of Leeds; 2011. Tennant A, Horton M, Pallant J. Introduction to Rasch analysis: a workbook. Department of Rehabilitation Medicine, University of Leeds; 2011.
36.
go back to reference Smith Jr EV. Understanding Rasch measurement: detecting and evaluating the impact of multidimenstionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002. Smith Jr EV. Understanding Rasch measurement: detecting and evaluating the impact of multidimenstionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002.
37.
go back to reference Embretson SE, Reise SP. Item response theory for psychologists. London: Lawrence Erlbaum; 2000. Embretson SE, Reise SP. Item response theory for psychologists. London: Lawrence Erlbaum; 2000.
38.
go back to reference Steinberg L, Thissen D. Uses of item response theory and the testlet concept in the measurement of psychopathology. Psychol Methods. 1996;1(1):81.CrossRef Steinberg L, Thissen D. Uses of item response theory and the testlet concept in the measurement of psychopathology. Psychol Methods. 1996;1(1):81.CrossRef
39.
go back to reference Tennant A, Pallant J. DIF matters: a practical approach to test if differential item functioning makes a difference. Rasch Meas Trans. 2007;20(4):1082–4. Tennant A, Pallant J. DIF matters: a practical approach to test if differential item functioning makes a difference. Rasch Meas Trans. 2007;20(4):1082–4.
40.
go back to reference Truchon M, Fillion L, Gelinas C. Validation of a French Canadian version of the Organizational Policies and Practices (OPP) Questionnaire. Work. 2003;20:111–9.PubMed Truchon M, Fillion L, Gelinas C. Validation of a French Canadian version of the Organizational Policies and Practices (OPP) Questionnaire. Work. 2003;20:111–9.PubMed
41.
go back to reference Stock SR. Workplace ergonomic factors and the development of musculoskeletal disorders of the neck and upper limbs: a meta-analysis. Am J Ind Med. 1991;19(1):87–107.CrossRefPubMed Stock SR. Workplace ergonomic factors and the development of musculoskeletal disorders of the neck and upper limbs: a meta-analysis. Am J Ind Med. 1991;19(1):87–107.CrossRefPubMed
42.
go back to reference Wahlström J. Ergonomics, musculoskeletal disorders and computer work. Occup Med. 2005;55(3):168–76.CrossRef Wahlström J. Ergonomics, musculoskeletal disorders and computer work. Occup Med. 2005;55(3):168–76.CrossRef
43.
go back to reference Reichelt PA, Conrad KM. Musculoskeletal injury: ergonomics and physical fitness in firefighters. Occup Med. 1994;10(4):735–46. Reichelt PA, Conrad KM. Musculoskeletal injury: ergonomics and physical fitness in firefighters. Occup Med. 1994;10(4):735–46.
44.
go back to reference Kang S-K, Kim W. Work-related musculoskeletal disorders in firefighters. J Korean Med Assoc. 2008;51(12):1111–7.CrossRef Kang S-K, Kim W. Work-related musculoskeletal disorders in firefighters. J Korean Med Assoc. 2008;51(12):1111–7.CrossRef
45.
go back to reference David G. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup Med. 2005;55(3):190–9.CrossRef David G. Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup Med. 2005;55(3):190–9.CrossRef
46.
go back to reference McAtamney L, Corlett EN. RULA: a survey method for the investigation of work-related upper limb disorders. Appl Ergon. 1993;24(2):91–9.CrossRefPubMed McAtamney L, Corlett EN. RULA: a survey method for the investigation of work-related upper limb disorders. Appl Ergon. 1993;24(2):91–9.CrossRefPubMed
47.
go back to reference da Costa BR, Vieira ER. Risk factors for work-related musculoskeletal disorders: a systematic review of recent longitudinal studies. Am J Ind Med. 2010;53(3):285–323.PubMed da Costa BR, Vieira ER. Risk factors for work-related musculoskeletal disorders: a systematic review of recent longitudinal studies. Am J Ind Med. 2010;53(3):285–323.PubMed
48.
go back to reference Lowe WA, Barnes B. An examination of the relationship between leadership practices and organizational commitment in the fire service. Nova Southeastern University; 2000. Lowe WA, Barnes B. An examination of the relationship between leadership practices and organizational commitment in the fire service. Nova Southeastern University; 2000.
49.
go back to reference Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7(3):286.CrossRef Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7(3):286.CrossRef
Metadata
Title
Confirmatory Factor and Rasch Analyses Support a Revised 14-Item Version of the Organizational, Policies, and Practices (OPP) Scale
Authors
Qiyun Shi
Joy C. MacDermid
Kenneth Tang
Kathryn E. Sinden
Dave Walton
Ruby Grewal
Publication date
01-06-2017
Publisher
Springer US
Published in
Journal of Occupational Rehabilitation / Issue 2/2017
Print ISSN: 1053-0487
Electronic ISSN: 1573-3688
DOI
https://doi.org/10.1007/s10926-016-9653-2

Other articles of this Issue 2/2017

Journal of Occupational Rehabilitation 2/2017 Go to the issue