Skip to main content
Top
Published in: BMC Health Services Research 1/2010

Open Access 01-12-2010 | Research article

Clinimetric quality of the fire fighting simulation test as part of the Dutch fire fighters Workers' Health Surveillance

Authors: Marie-Christine J Plat, Monique HW Frings-Dresen, Judith K Sluiter

Published in: BMC Health Services Research | Issue 1/2010

Login to get access

Abstract

Background

Clinimetric data for the fire fighting simulation test (FFST), a new test proposed for the Workers' Health Surveillance (WHS) of Dutch fire fighters, were evaluated.

Methods

Twenty-one fire fighters took the FFST three times with one and three weeks between testing. Clinimetric quality was determined by means of reliability, agreement and validity. For reliability and agreement, the intraclass correlation coefficient (ICC), and standard error of measurement (SEM), were analysed. For construct validity, the tests from 45 fire fighters were correlated with their own and their supervisors' rated work ability.

Results

The ICCs were 0.56 and 0.79 at the one-week and three-week test-retest periods, respectively. Testing times ranged from 9 to 17 minutes; the SEMs were 70 s at the one-week and 40 s at the three-week test-retest periods. The construct validity was moderate (-0.47 ≤ r ≤ -0.33; p < 0.05).

Conclusions

The FFST was reliable with acceptable agreement after three weeks. Construct validity was moderate. We recommend using FFST as a part of the WHS for Dutch fire fighters. It is advised that fire fighters should perform the FFST once as a trial before judging their performance in testing time during the second performance.
Appendix
Available only for authorised users
Literature
1.
go back to reference Technical and ethical guidelines for workers' health surveillance (OSH No. 72). 1998, Geneva, International Labour Office, (Occupational Safety and Health Series No. 72) Technical and ethical guidelines for workers' health surveillance (OSH No. 72). 1998, Geneva, International Labour Office, (Occupational Safety and Health Series No. 72)
2.
go back to reference Sluiter JK, Frings-Dresen MH: What do we know about ageing at work? Evidence-based fitness for duty and health in fire fighters. Ergonomics. 2007, 50 (11): 1897-1913. 10.1080/00140130701676005.CrossRefPubMed Sluiter JK, Frings-Dresen MH: What do we know about ageing at work? Evidence-based fitness for duty and health in fire fighters. Ergonomics. 2007, 50 (11): 1897-1913. 10.1080/00140130701676005.CrossRefPubMed
3.
go back to reference Sothmann MS, Saupe K, Jasenof D, Blaney J: Heart rate response of firefighters to actual emergencies. Implications for cardiorespiratory fitness. J Occup Med. 1992, 34 (8): 797-800. 10.1097/00043764-199208000-00014.CrossRefPubMed Sothmann MS, Saupe K, Jasenof D, Blaney J: Heart rate response of firefighters to actual emergencies. Implications for cardiorespiratory fitness. J Occup Med. 1992, 34 (8): 797-800. 10.1097/00043764-199208000-00014.CrossRefPubMed
4.
go back to reference Gledhill N, Jamnik VK: Characterization of the physical demands of firefighting. Can J Sport Sci. 1992, 17 (3): 207-213.PubMed Gledhill N, Jamnik VK: Characterization of the physical demands of firefighting. Can J Sport Sci. 1992, 17 (3): 207-213.PubMed
5.
go back to reference Smith DL, Petruzzello SJ, Kramer JM, Misner JE: Physiological, psychophysical, and psychological responses of firefighters to firefighting training drills. Aviat Space Environ Med. 1996, 67 (11): 1063-1068.PubMed Smith DL, Petruzzello SJ, Kramer JM, Misner JE: Physiological, psychophysical, and psychological responses of firefighters to firefighting training drills. Aviat Space Environ Med. 1996, 67 (11): 1063-1068.PubMed
6.
go back to reference Bos J, Mol E, Visser B, Frings-Dresen M: The physical demands upon (Dutch) fire-fighters in relation to the maximum acceptable energetic workload. Ergonomics. 2004, 47 (4): 446-460. 10.1080/00140130310001643283.CrossRefPubMed Bos J, Mol E, Visser B, Frings-Dresen M: The physical demands upon (Dutch) fire-fighters in relation to the maximum acceptable energetic workload. Ergonomics. 2004, 47 (4): 446-460. 10.1080/00140130310001643283.CrossRefPubMed
7.
go back to reference Holmér I, Gavhed D: Classification of metabolic and respiratory demands in fire fighting activity with extreme workloads. Applied ergonomics. 2007, 38: 45-52. 10.1016/j.apergo.2006.01.004.CrossRefPubMed Holmér I, Gavhed D: Classification of metabolic and respiratory demands in fire fighting activity with extreme workloads. Applied ergonomics. 2007, 38: 45-52. 10.1016/j.apergo.2006.01.004.CrossRefPubMed
8.
go back to reference Lusa S, Louhevaara V, Kinnunen K: Are the job demands on physical work capacity equal for young and aging firefighters?. J occup med. 1994, 36 (1): 70-74.PubMed Lusa S, Louhevaara V, Kinnunen K: Are the job demands on physical work capacity equal for young and aging firefighters?. J occup med. 1994, 36 (1): 70-74.PubMed
9.
go back to reference Sluiter JK, Frings-Dresen MH: Pre-employment and Periodical Workers' Health Surveillance in the Fire fighting sector. In Dutch: Aanstellingskeuring en Periodiek Preventief Medisch Onderzoek (PPMO) voor de Brandweersector. 2006, Amsterdam: Coronel Institute for Occupational and Environmental Health, Academic Medical Center, report no. 06-03 Sluiter JK, Frings-Dresen MH: Pre-employment and Periodical Workers' Health Surveillance in the Fire fighting sector. In Dutch: Aanstellingskeuring en Periodiek Preventief Medisch Onderzoek (PPMO) voor de Brandweersector. 2006, Amsterdam: Coronel Institute for Occupational and Environmental Health, Academic Medical Center, report no. 06-03
10.
go back to reference Sluiter JK: High-demand jobs: Age-related diversity in work ability?. Applied Ergonomics. 2006, 37: 429-440. 10.1016/j.apergo.2006.04.007.CrossRefPubMed Sluiter JK: High-demand jobs: Age-related diversity in work ability?. Applied Ergonomics. 2006, 37: 429-440. 10.1016/j.apergo.2006.04.007.CrossRefPubMed
11.
go back to reference Sothmann MS, Gebhardt DL, Baker TA, Kastello GM, Sheppard VA: Performance requirements of physically strenuous occupations: validating, minimum standards for muscular strength and endurance. Ergonomics. 2004, 47 (8): 864-875. 10.1080/00140130410001670372.CrossRefPubMed Sothmann MS, Gebhardt DL, Baker TA, Kastello GM, Sheppard VA: Performance requirements of physically strenuous occupations: validating, minimum standards for muscular strength and endurance. Ergonomics. 2004, 47 (8): 864-875. 10.1080/00140130410001670372.CrossRefPubMed
12.
go back to reference Punakallio A: Trial-to-trial reproducibility and test-retest stability of two dynamic balance tests among male firefighters. Int J Sports Med. 2004, 25 (3): 163-169. 10.1055/s-2003-45251.CrossRefPubMed Punakallio A: Trial-to-trial reproducibility and test-retest stability of two dynamic balance tests among male firefighters. Int J Sports Med. 2004, 25 (3): 163-169. 10.1055/s-2003-45251.CrossRefPubMed
13.
go back to reference Williams-Bell FM, Villar R, Sharratt MT, Hughson RL: Physiological demands of the firefighter candidate physical ability test. Med Sci Sports Exerc. 2009, 41 (3): 653-662. 10.1249/MSS.0b013e31818ad117.CrossRefPubMed Williams-Bell FM, Villar R, Sharratt MT, Hughson RL: Physiological demands of the firefighter candidate physical ability test. Med Sci Sports Exerc. 2009, 41 (3): 653-662. 10.1249/MSS.0b013e31818ad117.CrossRefPubMed
14.
go back to reference Reilly T, Iggleden C, Gennser M, Tipton M: Occupational fitness standards for beach lifeguards. Phase 2: the development of an easily administered fitness test. Occup Med. 2006, 56 (1): 12-17. 10.1093/occmed/kqi168.CrossRef Reilly T, Iggleden C, Gennser M, Tipton M: Occupational fitness standards for beach lifeguards. Phase 2: the development of an easily administered fitness test. Occup Med. 2006, 56 (1): 12-17. 10.1093/occmed/kqi168.CrossRef
15.
go back to reference Deakin JM, Pelot R, Smith JT, Stevenson JT, Wolfe LA: The development of a bona fide physical maintenance standard for CD and DND fire fighters. 1998, Ergonomics Research Group Queens University Kingston, Ontario Deakin JM, Pelot R, Smith JT, Stevenson JT, Wolfe LA: The development of a bona fide physical maintenance standard for CD and DND fire fighters. 1998, Ergonomics Research Group Queens University Kingston, Ontario
16.
go back to reference van Blitterswijk M, Lagrand R, Zijden van der J: Guideline Task Specific Condition testing, for fire fighters Rotterdam. 2006, [In Dutch: Handboek Taak Specifieke Conditietest voor uitrukdienst-personeel Brandweer Rotterdam]. Rotterdam van Blitterswijk M, Lagrand R, Zijden van der J: Guideline Task Specific Condition testing, for fire fighters Rotterdam. 2006, [In Dutch: Handboek Taak Specifieke Conditietest voor uitrukdienst-personeel Brandweer Rotterdam]. Rotterdam
17.
go back to reference de Vet HC, Terwee CB, Bouter LM: Current challenges in clinimetrics. Journal of Clinical Epidemiology. 2003, 56: 1137-1141. 10.1016/j.jclinepi.2003.08.012.CrossRefPubMed de Vet HC, Terwee CB, Bouter LM: Current challenges in clinimetrics. Journal of Clinical Epidemiology. 2003, 56: 1137-1141. 10.1016/j.jclinepi.2003.08.012.CrossRefPubMed
18.
go back to reference de Vet HC, Terwee CB, Knol DL, Bouter LM: When to use agreement versus reliability measures. Journal of Clinical Epidemiology. 2006, 59: 1033-1039. 10.1016/j.jclinepi.2005.10.015.CrossRefPubMed de Vet HC, Terwee CB, Knol DL, Bouter LM: When to use agreement versus reliability measures. Journal of Clinical Epidemiology. 2006, 59: 1033-1039. 10.1016/j.jclinepi.2005.10.015.CrossRefPubMed
19.
go back to reference Streiner DL, Norman GR: Reliability. Health Measurement scales: a practical guide to their development and use. 2003, Oxford Medical Publications, 126-152. 3 Streiner DL, Norman GR: Reliability. Health Measurement scales: a practical guide to their development and use. 2003, Oxford Medical Publications, 126-152. 3
20.
go back to reference Streiner DL, Norman GR: Validity. Health Measurement scales: a practical guide to their development and use. 2003, Oxford Medical Publications, 172-193. 3 Streiner DL, Norman GR: Validity. Health Measurement scales: a practical guide to their development and use. 2003, Oxford Medical Publications, 172-193. 3
21.
go back to reference Rutjes AW, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PM: Evaluation of diagnostic tests when there is no gold standard: A review of methods. Health technology assessment. 2007, 11 (50). Rutjes AW, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PM: Evaluation of diagnostic tests when there is no gold standard: A review of methods. Health technology assessment. 2007, 11 (50).
22.
go back to reference Thomas S, Reading J, Shephard RJ: Revision of the Physical Activity Readiness Questionnaire (PAR-Q). Can J Sport Sci. 1992, 17 (4): 338-345.PubMed Thomas S, Reading J, Shephard RJ: Revision of the Physical Activity Readiness Questionnaire (PAR-Q). Can J Sport Sci. 1992, 17 (4): 338-345.PubMed
23.
go back to reference Tuomi K, Ilmarinen J, Jahkola A, Katajarinne L, Tulkki A: Work Ability Index. 1997, Helsinki: Finnish Institute of Occupational Health Tuomi K, Ilmarinen J, Jahkola A, Katajarinne L, Tulkki A: Work Ability Index. 1997, Helsinki: Finnish Institute of Occupational Health
24.
go back to reference Shrout PE, Fleiss JL: Intraclass Correlations: Uses in Assessing Rater Reliability. Psychological Bulletin. 1979, 86 (2): 420-428. 10.1037/0033-2909.86.2.420.CrossRefPubMed Shrout PE, Fleiss JL: Intraclass Correlations: Uses in Assessing Rater Reliability. Psychological Bulletin. 1979, 86 (2): 420-428. 10.1037/0033-2909.86.2.420.CrossRefPubMed
25.
go back to reference Terwee CB, Bot SD, de Boer MR, Windt van der DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, Windt van der DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.CrossRefPubMed
26.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.CrossRefPubMed Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1: 307-310.CrossRefPubMed
27.
go back to reference Innes E, Straker L: Validity of work-related assessments. Work. 1999, 13: 125-152.PubMed Innes E, Straker L: Validity of work-related assessments. Work. 1999, 13: 125-152.PubMed
Metadata
Title
Clinimetric quality of the fire fighting simulation test as part of the Dutch fire fighters Workers' Health Surveillance
Authors
Marie-Christine J Plat
Monique HW Frings-Dresen
Judith K Sluiter
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2010
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-10-32

Other articles of this Issue 1/2010

BMC Health Services Research 1/2010 Go to the issue