Skip to main content
Top
Published in: BMC Pediatrics 1/2021

Open Access 01-12-2021 | Research article

Inter-rater reliability and test-retest reliability of the Performance and Fitness (PERF-FIT) test battery for children: a test for motor skill related fitness

Authors: Bouwien C. M. Smits-Engelsman, Eline Smit, Rosemary Xorlanyo Doe-Asinyo, Stella Elikplim Lawerteh, Wendy Aertssen, Gillian Ferguson, Dorothee L. Jelsma

Published in: BMC Pediatrics | Issue 1/2021

Login to get access

Abstract

Background

The Performance and Fitness (PERF-FIT) test battery for children is a recently developed, valid assessment tool for measuring motor skill-related physical fitness in 5 to 12-year-old children living in low-income settings. The aim of this study was to determine: (1) inter-rater reliability and (2) test-retest reliability of the PERF-FIT in children from 3 different countries (Ghana, South Africa and the Netherlands).

Method

For inter-rater reliability 29 children, (16 boys and 13 girls, 6–10 years) were scored by 2 raters simultaneously. For test–retest reliability 72 children, (33 boys and 39 girls, 5–12 years) performed the test twice, minimally 1 week and maximally 2 weeks apart. Relative and absolute reliability indices were calculated. ANOVA was used to examine differences between the three assessor teams in the three countries.

Results

The PERF-FIT demonstrated excellent inter-rater reliability (ICC, 0.99) and good test-retest reliability (ICC, ≥ 0.80) for 11 of the 12 tasks, with a poor ICC for the Jumping item, due to low spread in values. A significant difference between first and second test occasion was present on half of the items, but the differences were small (Cohen’s d 0.01–0.17), except for Stepping, Side jump and Bouncing and Catching (Cohen’s d 0.34, 0.41 and 0.33, respectively). Overall, measurement error, Limits of Agreement and Coefficient of Variation had acceptable levels to support clinical use. No systematic dissimilarities in error were found between first and second measurement between the three countries but for one item (Overhead throw).

Conclusions

The PERF-FIT can reliably measure motor skill related fitness in 5 to 12-year-old children in different settings and help clinicians monitor levels of fundamental motor skills (throwing, bouncing, catching, jumping, hopping and balance), power and agility.
Literature
1.
go back to reference Valentini NC, Clark JE, Whitall J. Developmental co-ordination disorder in socially disadvantaged Brazilian children. Child Care Health Dev. 2015;41(Suppl 6):970–9.CrossRef Valentini NC, Clark JE, Whitall J. Developmental co-ordination disorder in socially disadvantaged Brazilian children. Child Care Health Dev. 2015;41(Suppl 6):970–9.CrossRef
2.
go back to reference Ortega FB, Ruiz JR, Castillo MJ, Sjöström M. Physical fitness in childhood and adolescence: a powerful marker of health. Sweden Int J Obes. 2008;32(Suppl 1):1. Ortega FB, Ruiz JR, Castillo MJ, Sjöström M. Physical fitness in childhood and adolescence: a powerful marker of health. Sweden Int J Obes. 2008;32(Suppl 1):1.
4.
go back to reference Pienaar AE. Developmental co-ordination disorder in an ethno-racially diverse African nation: should norms of the MABC be adjusted? J Hum Mov Stud. 2004;47:75–92. Pienaar AE. Developmental co-ordination disorder in an ethno-racially diverse African nation: should norms of the MABC be adjusted? J Hum Mov Stud. 2004;47:75–92.
6.
go back to reference Kaster T, Dooley FL, Fitzgerald JS, Walch TJ, Annandale M, Ferrar K, Lang JJ, Smith JJ, Tomkinson GR. Temporal trends in the sit-ups performance of 9,939,289 children and adolescents between 1964 and 2017. J Sports Sci. 2020;38(16):1913–23.CrossRef Kaster T, Dooley FL, Fitzgerald JS, Walch TJ, Annandale M, Ferrar K, Lang JJ, Smith JJ, Tomkinson GR. Temporal trends in the sit-ups performance of 9,939,289 children and adolescents between 1964 and 2017. J Sports Sci. 2020;38(16):1913–23.CrossRef
7.
go back to reference Dooley FL, Kaster T, Fitzgerald JS, Walch TJ, Annandale M, Ferrar K, Lang JJ, Smith JJ, Tomkinson GR. A systematic analysis of temporal trends in the handgrip strength of 2,216,320 children and adolescents between 1967 and 2017. Sports Med. 2020;50(6):1129–44.CrossRef Dooley FL, Kaster T, Fitzgerald JS, Walch TJ, Annandale M, Ferrar K, Lang JJ, Smith JJ, Tomkinson GR. A systematic analysis of temporal trends in the handgrip strength of 2,216,320 children and adolescents between 1967 and 2017. Sports Med. 2020;50(6):1129–44.CrossRef
8.
go back to reference Tomkinson GR, Léger LA, Olds TS, Cazorla G. Secular trends in the performance of children and adolescents (1980-2000). Sports Med. 2003;33(4):285–300.CrossRef Tomkinson GR, Léger LA, Olds TS, Cazorla G. Secular trends in the performance of children and adolescents (1980-2000). Sports Med. 2003;33(4):285–300.CrossRef
9.
go back to reference Tomkinson GR, Lang JJ, Tremblay MS. Temporal trends in the cardiorespiratory fitness of children and adolescents representing 19 high-income and upper middle-income countries between 1981 and 2014. Br J Sports Med. 2019;53(8):478–86.CrossRef Tomkinson GR, Lang JJ, Tremblay MS. Temporal trends in the cardiorespiratory fitness of children and adolescents representing 19 high-income and upper middle-income countries between 1981 and 2014. Br J Sports Med. 2019;53(8):478–86.CrossRef
10.
go back to reference Henderson SE, Sugden DA. The movement assessment battery for children. London: The Psychological Corporation; 1992. Henderson SE, Sugden DA. The movement assessment battery for children. London: The Psychological Corporation; 1992.
11.
go back to reference Henderson SE, Sugden DA, Barnett AL. Movement Assessment Battery for Children-2: Examiner’s manual (2nd ed.). London: Pearson Assessment; 2007. Henderson SE, Sugden DA, Barnett AL. Movement Assessment Battery for Children-2: Examiner’s manual (2nd ed.). London: Pearson Assessment; 2007.
12.
go back to reference Bruininks RH. Bruininks–Oseretsky test of motor proficiency: Examiner’s manual. Circle Pines: American Guidance Service; 1978. Bruininks RH. Bruininks–Oseretsky test of motor proficiency: Examiner’s manual. Circle Pines: American Guidance Service; 1978.
13.
go back to reference Bruininks RH, Bruininks BD. Bruininks–Oseretsky test of motor proficiency: Examiner’s manual (2nd ed.). Windsor: NFER-Nelson; 2005. Bruininks RH, Bruininks BD. Bruininks–Oseretsky test of motor proficiency: Examiner’s manual (2nd ed.). Windsor: NFER-Nelson; 2005.
15.
go back to reference Van Waelvelde H, Peersman W, Lenoir M, Smits-Engelsman B, Henderson SE. The movement assessment battery for children: similarities and differences between 4- and 5-year-old children from Flanders and the USA. Ped Phys Ther. 2007;20:3–8. Van Waelvelde H, Peersman W, Lenoir M, Smits-Engelsman B, Henderson SE. The movement assessment battery for children: similarities and differences between 4- and 5-year-old children from Flanders and the USA. Ped Phys Ther. 2007;20:3–8.
17.
go back to reference Tripathi R, Joshua AM, Kotian MS, Tedla JS. Normal motor development of Indian children on Peabody developmental motor Scales-2 (PDMS-2). Ped PhysTher. 2008;20:167–72. Tripathi R, Joshua AM, Kotian MS, Tedla JS. Normal motor development of Indian children on Peabody developmental motor Scales-2 (PDMS-2). Ped PhysTher. 2008;20:167–72.
18.
go back to reference World Health Organization. International classification of functioning, disability and health—children & youth version. Geneva; 2007. World Health Organization. International classification of functioning, disability and health—children & youth version. Geneva; 2007.
19.
go back to reference Livesey D, Lum Mow M, Toshack T, Zheng Y. The relationship between motor performance and peer relations in 9- to 12-year-old children. Child Care Health Dev. 2010;37(4):581–8.CrossRef Livesey D, Lum Mow M, Toshack T, Zheng Y. The relationship between motor performance and peer relations in 9- to 12-year-old children. Child Care Health Dev. 2010;37(4):581–8.CrossRef
20.
go back to reference Caspersen CJ, Powell KE, Christenson GM. Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. Public Health Rep. 1985;100:126–31.PubMedPubMedCentral Caspersen CJ, Powell KE, Christenson GM. Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. Public Health Rep. 1985;100:126–31.PubMedPubMedCentral
21.
go back to reference Corbin CB, Pangrazi RP, Franks BD. Definitions: Health, fitness, and physical activity. President's Council on Physical Fitness and Sports Research Digest; 2000. Corbin CB, Pangrazi RP, Franks BD. Definitions: Health, fitness, and physical activity. President's Council on Physical Fitness and Sports Research Digest; 2000.
23.
go back to reference Smits-Engelsman B, Cavalcante Neto JL, Draghi TTG, Rohr LA, Jelsma LD. Construct validity of the PERF-FIT, a test of motor skill-related fitness for children in low resource areas. Res Dev Disabil. 2020b;102:103663.CrossRef Smits-Engelsman B, Cavalcante Neto JL, Draghi TTG, Rohr LA, Jelsma LD. Construct validity of the PERF-FIT, a test of motor skill-related fitness for children in low resource areas. Res Dev Disabil. 2020b;102:103663.CrossRef
24.
go back to reference Bruton A, Conway JH, Holgate ST. Reliability: what is it and how is it measured? Phys. 2000;86(Suppl 2):94–9. Bruton A, Conway JH, Holgate ST. Reliability: what is it and how is it measured? Phys. 2000;86(Suppl 2):94–9.
25.
go back to reference Warburton DE, Gledhill N, Jamnik VK, Bredin SS, McKenzie DC, Stone J, Charlesworth S, Shephard RJ. Evidence-based risk assessment and recommendations for physical activity clearance: consensus document 2011. Appl Physiol Nutr Metab. 2011;36(Suppl 1):S266–98.CrossRef Warburton DE, Gledhill N, Jamnik VK, Bredin SS, McKenzie DC, Stone J, Charlesworth S, Shephard RJ. Evidence-based risk assessment and recommendations for physical activity clearance: consensus document 2011. Appl Physiol Nutr Metab. 2011;36(Suppl 1):S266–98.CrossRef
26.
go back to reference Smits-Engelsman BCM. Performance and fitness battery for children. Cape Town: PERF-FIT, Manual; 2018. Smits-Engelsman BCM. Performance and fitness battery for children. Cape Town: PERF-FIT, Manual; 2018.
28.
go back to reference Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(Suppl 2):420.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(Suppl 2):420.CrossRef
29.
go back to reference Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(Suppl 4):284–90.CrossRef Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(Suppl 4):284–90.CrossRef
30.
go back to reference Cicchetti D, Bronen R, Spencer S, Haut S, Berg A, Oliver P, Tyrer P. Rating scales, scales of measurement, issues of reliability: resolving some critical issues for clinicians and researchers. J Nerv Ment Dis. 2006;194:557–64.CrossRef Cicchetti D, Bronen R, Spencer S, Haut S, Berg A, Oliver P, Tyrer P. Rating scales, scales of measurement, issues of reliability: resolving some critical issues for clinicians and researchers. J Nerv Ment Dis. 2006;194:557–64.CrossRef
31.
go back to reference Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 3rd ed. Upper Saddle River, NJ: Pearson/Prentice Hall; 2009. Portney LG, Watkins MP. Foundations of clinical research: applications to practice. 3rd ed. Upper Saddle River, NJ: Pearson/Prentice Hall; 2009.
32.
go back to reference Field A. Discovering statistics using IBM SPSS statistics, 2013; 5th edition. ISBN: 9781526419521 Sage Publications Ltd (UK). Field A. Discovering statistics using IBM SPSS statistics, 2013; 5th edition. ISBN: 9781526419521 Sage Publications Ltd (UK).
34.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986:307–10. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986:307–10.
35.
go back to reference Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–40.PubMed Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–40.PubMed
36.
go back to reference De Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide: Cambridge University Press; 2011. De Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide: Cambridge University Press; 2011.
37.
go back to reference Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26:217–38.CrossRef Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26:217–38.CrossRef
38.
go back to reference Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, Roberts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud. 2011;48:661–71.CrossRef Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, Roberts C, Shoukri M, Streiner DL. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud. 2011;48:661–71.CrossRef
39.
go back to reference D’Olhaberriague L, Litvan I, Mitsias P, Mansbach HH. A reappraisal of reliability and validity studies in stroke. Stroke. 1996;27(Suppl 12):2331–6.CrossRef D’Olhaberriague L, Litvan I, Mitsias P, Mansbach HH. A reappraisal of reliability and validity studies in stroke. Stroke. 1996;27(Suppl 12):2331–6.CrossRef
40.
go back to reference De Vet HCW, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59(Suppl 10):1033–9.CrossRef De Vet HCW, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59(Suppl 10):1033–9.CrossRef
41.
go back to reference Stratford PW, Goldsmith CH. Use of the standard error as a reliability index of interest: an applied example using elbow flexor strength data. Phys Ther. 1997;77:745–50.CrossRef Stratford PW, Goldsmith CH. Use of the standard error as a reliability index of interest: an applied example using elbow flexor strength data. Phys Ther. 1997;77:745–50.CrossRef
43.
go back to reference Strainer DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use 5 ed. Oxford: University Press; 2014. ISBN-13:9780199685219 https://doi.org/10.1093/med/9780199685219.001.0001 Strainer DL, Norman GR, Cairney J. Health Measurement Scales: A practical guide to their development and use 5 ed. Oxford: University Press; 2014. ISBN-13:9780199685219 https://​doi.​org/​10.​1093/​med/​9780199685219.​001.​0001
Metadata
Title
Inter-rater reliability and test-retest reliability of the Performance and Fitness (PERF-FIT) test battery for children: a test for motor skill related fitness
Authors
Bouwien C. M. Smits-Engelsman
Eline Smit
Rosemary Xorlanyo Doe-Asinyo
Stella Elikplim Lawerteh
Wendy Aertssen
Gillian Ferguson
Dorothee L. Jelsma
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2021
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-021-02589-0

Other articles of this Issue 1/2021

BMC Pediatrics 1/2021 Go to the issue