Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2022

Open Access 01-12-2022 | Research

Reliability of a human pose tracking algorithm for measuring upper limb joints: comparison with photography-based goniometry

Authors: Jingyuan Fan, Fanbin Gu, Lulu Lv, Zhejin Zhang, Changbing Zhu, Jian Qi, Honggang Wang, Xiaolin Liu, Jiantao Yang, Qingtang Zhu

Published in: BMC Musculoskeletal Disorders | Issue 1/2022

Login to get access

Abstract

Background

Range of motion (ROM) measurements are essential for diagnosing and evaluating upper extremity conditions. Clinical goniometry is the most commonly used methods but it is time-consuming and skill-demanding. Recent advances in human tracking algorithm suggest potential for automatic angle measuring from RGB images. It provides an attractive alternative for at-distance measuring. However, the reliability of this method has not been fully established. The purpose of this study is to evaluate if the results of algorithm are as reliable as human raters in upper limb movements.

Methods

Thirty healthy young adults (20 males, 10 females) participated in this study. Participants were asked to performed a 6-motion task including movement of shoulder, elbow and wrist. Images of movements were captured by commercial digital cameras. Each movement was measured by a pose tracking algorithm (OpenPose) and compared with the surgeon-measurement results. The mean differences between the two measurements were compared. Pearson correlation coefficients were used to determine the relationship. Reliability was investigated by the intra-class correlation coefficients.

Results

Comparing this algorithm-based method with manual measurement, the mean differences were less than 3 degrees in 5 motions (shoulder abduction: 0.51; shoulder elevation: 2.87; elbow flexion:0.38; elbow extension:0.65; wrist extension: 0.78) except wrist flexion. All the intra-class correlation coefficients were larger than 0.60. The Pearson coefficients also showed high correlations between the two measurements (p < 0.001).

Conclusions

Our results indicated that pose estimation is a reliable method to measure the shoulder and elbow angles, supporting RGB images for measuring joint ROM. Our results presented the possibility that patients can assess their ROM by photos taken by a digital camera.

Trial registration

This study was registered in the Clinical Trials Center of The First Affiliated Hospital, Sun Yat-sen University (2021–387).
Appendix
Available only for authorised users
Literature
1.
go back to reference Suk M, Hanson B, Norvell D, Helfet D. Musculoskeletal Outcomes Measures and Instruments. Vol 1. Dübendorf, Switzerland: AO Foundation Publishing; 2009. 84–386. Suk M, Hanson B, Norvell D, Helfet D. Musculoskeletal Outcomes Measures and Instruments. Vol 1. Dübendorf, Switzerland: AO Foundation Publishing; 2009. 84–386.
2.
go back to reference Boone DC, Azen SP, Lin CM, Spence C, Baron C, Lee L. Reliability of goniometric measurements. Phys Ther. 1978;58(11):1355–60.CrossRef Boone DC, Azen SP, Lin CM, Spence C, Baron C, Lee L. Reliability of goniometric measurements. Phys Ther. 1978;58(11):1355–60.CrossRef
3.
go back to reference Bovens AM, van Baak MA, Vrencken JG, Wijnen JA, Verstappen FT. Variability and reliability of joint measurements. Am J Sports Med. 1990;18(1):58–63.CrossRef Bovens AM, van Baak MA, Vrencken JG, Wijnen JA, Verstappen FT. Variability and reliability of joint measurements. Am J Sports Med. 1990;18(1):58–63.CrossRef
4.
go back to reference Naeemabadi M, Dinesen B, Andersen OK, Madsen NK, Simonsen OH, Hansen J. Developing a telerehabilitation programme for postoperative recovery from knee surgery: specifications and requirements. BMJ Health Care Inform. 2019;26(1):e000022.CrossRef Naeemabadi M, Dinesen B, Andersen OK, Madsen NK, Simonsen OH, Hansen J. Developing a telerehabilitation programme for postoperative recovery from knee surgery: specifications and requirements. BMJ Health Care Inform. 2019;26(1):e000022.CrossRef
5.
go back to reference Behnoush B, Tavakoli N, Bazmi E, Nateghi Fard F, Pourgharib Shahi MH, Okazi A, Mokhtari T. Smartphone and universal goniometer for measurement of elbow joint motions: a comparative study. Asian J Sports Med. 2016;7(2):e30668.CrossRef Behnoush B, Tavakoli N, Bazmi E, Nateghi Fard F, Pourgharib Shahi MH, Okazi A, Mokhtari T. Smartphone and universal goniometer for measurement of elbow joint motions: a comparative study. Asian J Sports Med. 2016;7(2):e30668.CrossRef
6.
go back to reference Lendner N, Wells E, Lavi I, Kwok YY, Ho PC, Wollstein R. Utility of the iPhone 4 Gyroscope Application in the Measurement of Wrist Motion. Hand (New York, NY). 2019;14(3):352–6.CrossRef Lendner N, Wells E, Lavi I, Kwok YY, Ho PC, Wollstein R. Utility of the iPhone 4 Gyroscope Application in the Measurement of Wrist Motion. Hand (New York, NY). 2019;14(3):352–6.CrossRef
7.
go back to reference Vauclair F, Aljurayyan A, Abduljabbar FH, Barimani B, Goetti P, Houghton F, Harvey EJ, Rouleau DM. The smartphone inclinometer: a new tool to determine elbow range of motion? Eur J Orthop Surg Traumatol. 2018;28(3):415–21.CrossRef Vauclair F, Aljurayyan A, Abduljabbar FH, Barimani B, Goetti P, Houghton F, Harvey EJ, Rouleau DM. The smartphone inclinometer: a new tool to determine elbow range of motion? Eur J Orthop Surg Traumatol. 2018;28(3):415–21.CrossRef
8.
go back to reference Meislin MA, Wagner ER, Shin AY. A comparison of elbow range of motion measurements: smartphone-based digital photography versus goniometric measurements. J Hand Surg Am. 2016;41(4):510-515.e511.CrossRef Meislin MA, Wagner ER, Shin AY. A comparison of elbow range of motion measurements: smartphone-based digital photography versus goniometric measurements. J Hand Surg Am. 2016;41(4):510-515.e511.CrossRef
9.
go back to reference Buvik A, Bugge E, Knutsen G, Småbrekke A, Wilsgaard T. Quality of care for remote orthopaedic consultations using telemedicine: a randomised controlled trial. BMC Health Serv Res. 2016;16(1):483.CrossRef Buvik A, Bugge E, Knutsen G, Småbrekke A, Wilsgaard T. Quality of care for remote orthopaedic consultations using telemedicine: a randomised controlled trial. BMC Health Serv Res. 2016;16(1):483.CrossRef
10.
go back to reference Kim SH, Kwon OY, Park KN, Jeon IC, Weon JH. Lower extremity strength and the range of motion in relation to squat depth. J Hum Kinet. 2015;45:59–69.CrossRef Kim SH, Kwon OY, Park KN, Jeon IC, Weon JH. Lower extremity strength and the range of motion in relation to squat depth. J Hum Kinet. 2015;45:59–69.CrossRef
11.
go back to reference Ota M, Tateuchi H, Hashiguchi T, Kato T, Ogino Y, Yamagata M, Ichihashi N. Verification of reliability and validity of motion analysis systems during bilateral squat using human pose tracking algorithm. Gait Posture. 2020;80:62–7.CrossRef Ota M, Tateuchi H, Hashiguchi T, Kato T, Ogino Y, Yamagata M, Ichihashi N. Verification of reliability and validity of motion analysis systems during bilateral squat using human pose tracking algorithm. Gait Posture. 2020;80:62–7.CrossRef
12.
go back to reference Buechi R, Faes L, Bachmann LM, Thiel MA, Bodmer NS, Schmid MK, Job O, Lienhard KR. Evidence assessing the diagnostic performance of medical smartphone apps: a systematic review and exploratory meta-analysis. BMJ Open. 2017;7(12):e018280.CrossRef Buechi R, Faes L, Bachmann LM, Thiel MA, Bodmer NS, Schmid MK, Job O, Lienhard KR. Evidence assessing the diagnostic performance of medical smartphone apps: a systematic review and exploratory meta-analysis. BMJ Open. 2017;7(12):e018280.CrossRef
13.
go back to reference Mitchell K, Gutierrez SB, Sutton S, Morton S, Morgenthaler A. Reliability and validity of goniometric iPhone applications for the assessment of active shoulder external rotation. Physiother Theory Pract. 2014;30(7):521–5.CrossRef Mitchell K, Gutierrez SB, Sutton S, Morton S, Morgenthaler A. Reliability and validity of goniometric iPhone applications for the assessment of active shoulder external rotation. Physiother Theory Pract. 2014;30(7):521–5.CrossRef
14.
go back to reference Kim TS, Park DD, Lee YB, Han DG, Shim JS, Lee YJ, Kim PC. A study on the measurement of wrist motion range using the iPhone 4 gyroscope application. Ann Plast Surg. 2014;73(2):215–8.CrossRef Kim TS, Park DD, Lee YB, Han DG, Shim JS, Lee YJ, Kim PC. A study on the measurement of wrist motion range using the iPhone 4 gyroscope application. Ann Plast Surg. 2014;73(2):215–8.CrossRef
15.
go back to reference Hayes K, Walton JR, Szomor ZR, Murrell GA. Reliability of five methods for assessing shoulder range of motion. Aust J Physiother. 2001;47(4):289–94.CrossRef Hayes K, Walton JR, Szomor ZR, Murrell GA. Reliability of five methods for assessing shoulder range of motion. Aust J Physiother. 2001;47(4):289–94.CrossRef
16.
go back to reference Scott KL, Skotak CM, Renfree KJ. Remote Assessment of wrist range of motion: inter- and intra-observer agreement of provider estimation and direct measurement with photographs and tracings. J Hand Surg. 2019;44(11):954–65.CrossRef Scott KL, Skotak CM, Renfree KJ. Remote Assessment of wrist range of motion: inter- and intra-observer agreement of provider estimation and direct measurement with photographs and tracings. J Hand Surg. 2019;44(11):954–65.CrossRef
17.
go back to reference Kolber MJ, Vega F, Widmayer K, Cheng MS. The reliability and minimal detectable change of shoulder mobility measurements using a digital inclinometer. Physiother Theory Pract. 2011;27(2):176–84.CrossRef Kolber MJ, Vega F, Widmayer K, Cheng MS. The reliability and minimal detectable change of shoulder mobility measurements using a digital inclinometer. Physiother Theory Pract. 2011;27(2):176–84.CrossRef
18.
go back to reference Boissy P, Diop-Fallou S, Lebel K, Bernier M, Balg F, Tousignant-Laflamme Y. Trueness and minimal detectable change of smartphone inclinometer measurements of shoulder range of motion. Telemed J E Health. 2017;23(6):503–6.CrossRef Boissy P, Diop-Fallou S, Lebel K, Bernier M, Balg F, Tousignant-Laflamme Y. Trueness and minimal detectable change of smartphone inclinometer measurements of shoulder range of motion. Telemed J E Health. 2017;23(6):503–6.CrossRef
19.
go back to reference Ma M, Proffitt R, Skubic M. Validation of a Kinect V2 based rehabilitation game. PLoS One. 2018;13(8):e0202338.CrossRef Ma M, Proffitt R, Skubic M. Validation of a Kinect V2 based rehabilitation game. PLoS One. 2018;13(8):e0202338.CrossRef
20.
go back to reference Zago M, Luzzago M, Marangoni T, De Cecco M, Tarabini M, Galli M. 3D Tracking of human motion using visual skeletonization and stereoscopic vision. Front Bioeng Biotechnol. 2020;8:181.CrossRef Zago M, Luzzago M, Marangoni T, De Cecco M, Tarabini M, Galli M. 3D Tracking of human motion using visual skeletonization and stereoscopic vision. Front Bioeng Biotechnol. 2020;8:181.CrossRef
21.
go back to reference Cao Z, Hidalgo G, Simon T, Wei S-E, Sheikh Y. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE Trans Pattern Anal Mach Intell. 2019;43(1):172–86.CrossRef Cao Z, Hidalgo G, Simon T, Wei S-E, Sheikh Y. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE Trans Pattern Anal Mach Intell. 2019;43(1):172–86.CrossRef
22.
go back to reference Ota M, Tateuchi H, Hashiguchi T, Ichihashi N. Verification of validity of gait analysis systems during treadmill walking and running using human pose tracking algorithm. Gait Posture. 2021;85:290–7.CrossRef Ota M, Tateuchi H, Hashiguchi T, Ichihashi N. Verification of validity of gait analysis systems during treadmill walking and running using human pose tracking algorithm. Gait Posture. 2021;85:290–7.CrossRef
23.
go back to reference Park KW, Lee EJ, Lee JS, Jeong J, Choi N, Jo S, Jung M, Do JY, Kang DW, Lee JG, et al. Machine learning-based automatic rating for cardinal symptoms of Parkinson disease. Neurology. 2021;96(13):e1761–9.CrossRef Park KW, Lee EJ, Lee JS, Jeong J, Choi N, Jo S, Jung M, Do JY, Kang DW, Lee JG, et al. Machine learning-based automatic rating for cardinal symptoms of Parkinson disease. Neurology. 2021;96(13):e1761–9.CrossRef
24.
go back to reference Sato K, Nagashima Y, Mano T, Iwata A, Toda T. Quantifying normal and parkinsonian gait features from home movies: Practical application of a deep learning-based 2D pose estimator. PLoS One. 2019;14(11):e0223549.CrossRef Sato K, Nagashima Y, Mano T, Iwata A, Toda T. Quantifying normal and parkinsonian gait features from home movies: Practical application of a deep learning-based 2D pose estimator. PLoS One. 2019;14(11):e0223549.CrossRef
25.
go back to reference Armstrong AD, MacDermid JC, Chinchalkar S, Stevens RS, King GJ. Reliability of range-of-motion measurement in the elbow and forearm. J Shoulder Elbow Surg. 1998;7(6):573–80.CrossRef Armstrong AD, MacDermid JC, Chinchalkar S, Stevens RS, King GJ. Reliability of range-of-motion measurement in the elbow and forearm. J Shoulder Elbow Surg. 1998;7(6):573–80.CrossRef
26.
go back to reference Blonna D, Zarkadas PC, Fitzsimmons JS, O’Driscoll SW. Validation of a photography-based goniometry method for measuring joint range of motion. J Shoulder Elbow Surg. 2012;21(1):29–35.CrossRef Blonna D, Zarkadas PC, Fitzsimmons JS, O’Driscoll SW. Validation of a photography-based goniometry method for measuring joint range of motion. J Shoulder Elbow Surg. 2012;21(1):29–35.CrossRef
27.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRef Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRef
28.
go back to reference Jacklin PB, Roberts JA, Wallace P, Haines A, Harrison R, Barber JA, Thompson SG, Lewis L, Currell R, Parker S, et al. Virtual outreach: economic evaluation of joint teleconsultations for patients referred by their general practitioner for a specialist opinion. BMJ. 2003;327(7406):84.CrossRef Jacklin PB, Roberts JA, Wallace P, Haines A, Harrison R, Barber JA, Thompson SG, Lewis L, Currell R, Parker S, et al. Virtual outreach: economic evaluation of joint teleconsultations for patients referred by their general practitioner for a specialist opinion. BMJ. 2003;327(7406):84.CrossRef
29.
go back to reference Terwee CB, de Winter AF, Scholten RJ, Jans MP, Devillé W, van Schaardenburg D, Bouter LM. Interobserver reproducibility of the visual estimation of range of motion of the shoulder. Arch Phys Med Rehabil. 2005;86(7):1356–61.CrossRef Terwee CB, de Winter AF, Scholten RJ, Jans MP, Devillé W, van Schaardenburg D, Bouter LM. Interobserver reproducibility of the visual estimation of range of motion of the shoulder. Arch Phys Med Rehabil. 2005;86(7):1356–61.CrossRef
30.
go back to reference Beshara P, Chen JF, Read AC, Lagadec P, Wang T, Walsh WR. The reliability and validity of wearable inertial sensors coupled with the Microsoft Kinect to measure shoulder range-of-motion. Sensors (Basel, Switzerland). 2020;20(24):7238.CrossRef Beshara P, Chen JF, Read AC, Lagadec P, Wang T, Walsh WR. The reliability and validity of wearable inertial sensors coupled with the Microsoft Kinect to measure shoulder range-of-motion. Sensors (Basel, Switzerland). 2020;20(24):7238.CrossRef
31.
go back to reference Lee SH, Yoon C, Chung SG, Kim HC, Kwak Y, Park HW, Kim K. Measurement of shoulder range of motion in patients with adhesive capsulitis using a Kinect. PLoS One. 2015;10(6):e0129398.CrossRef Lee SH, Yoon C, Chung SG, Kim HC, Kwak Y, Park HW, Kim K. Measurement of shoulder range of motion in patients with adhesive capsulitis using a Kinect. PLoS One. 2015;10(6):e0129398.CrossRef
32.
go back to reference Ienaga N, Fujita K, Koyama T, Sasaki T, Sugiura Y, Saito H. Development and user evaluation of a smartphone-based system to assess range of motion of wrist joint. J Hand Surg Glob Online. 2020;2(6):339–42.CrossRef Ienaga N, Fujita K, Koyama T, Sasaki T, Sugiura Y, Saito H. Development and user evaluation of a smartphone-based system to assess range of motion of wrist joint. J Hand Surg Glob Online. 2020;2(6):339–42.CrossRef
33.
go back to reference Yu F, Zeng L, Pan D, Sui X, Tang J. Evaluating the accuracy of hand models obtained from two 3D scanning techniques. Sci Rep. 2020;10(1):11875.CrossRef Yu F, Zeng L, Pan D, Sui X, Tang J. Evaluating the accuracy of hand models obtained from two 3D scanning techniques. Sci Rep. 2020;10(1):11875.CrossRef
34.
go back to reference Zl A, Ccc B, Pgd B, Xc A. Refraction effect analysis of using a hand-held laser scanner with glass support for 3D anthropometric measurement of the hand: strategy comparison and application. J Measurement. 2008;41(8):851–61.CrossRef Zl A, Ccc B, Pgd B, Xc A. Refraction effect analysis of using a hand-held laser scanner with glass support for 3D anthropometric measurement of the hand: strategy comparison and application. J Measurement. 2008;41(8):851–61.CrossRef
35.
go back to reference Cook JR, Baker NA, Cham R, Hale E, Redfern MS. Measurements of wrist and finger postures: a comparison of goniometric and motion capture techniques. J Appl Biomech. 2007;23(1):70–8.CrossRef Cook JR, Baker NA, Cham R, Hale E, Redfern MS. Measurements of wrist and finger postures: a comparison of goniometric and motion capture techniques. J Appl Biomech. 2007;23(1):70–8.CrossRef
36.
go back to reference Chang C-C, Li Z, Cai X, Dempsey P. Error control and calibration in three-dimensional anthropometric measurement of the hand by laser scanning with glass support. J Measurement. 2007;40(1):21–7.CrossRef Chang C-C, Li Z, Cai X, Dempsey P. Error control and calibration in three-dimensional anthropometric measurement of the hand by laser scanning with glass support. J Measurement. 2007;40(1):21–7.CrossRef
37.
go back to reference Zulkarnain RF, Kim GY, Adikrishna A, Hong HP, Kim YJ, Jeon IH. Digital data acquisition of shoulder range of motion and arm motion smoothness using Kinect v2. J Shoulder Elbow Surg. 2017;26(5):895–901.CrossRef Zulkarnain RF, Kim GY, Adikrishna A, Hong HP, Kim YJ, Jeon IH. Digital data acquisition of shoulder range of motion and arm motion smoothness using Kinect v2. J Shoulder Elbow Surg. 2017;26(5):895–901.CrossRef
38.
go back to reference Wilson JD, Khan-Perez J, Marley D, Buttress S, Walton M, Li B, Roy B. Can shoulder range of movement be measured accurately using the Microsoft Kinect sensor plus Medical Interactive Recovery Assistant (MIRA) software? J Shoulder Elbow Surg. 2017;26(12):e382–9.CrossRef Wilson JD, Khan-Perez J, Marley D, Buttress S, Walton M, Li B, Roy B. Can shoulder range of movement be measured accurately using the Microsoft Kinect sensor plus Medical Interactive Recovery Assistant (MIRA) software? J Shoulder Elbow Surg. 2017;26(12):e382–9.CrossRef
39.
go back to reference Chu H, Joo S, Kim J, Kim JK, Kim C, Seo J, Kang DG, Lee HS, Sung KK, Lee S. Validity and reliability of POM-Checker in measuring shoulder range of motion: protocol for a single center comparative study. Medicine. 2018;97(25):e11082.CrossRef Chu H, Joo S, Kim J, Kim JK, Kim C, Seo J, Kang DG, Lee HS, Sung KK, Lee S. Validity and reliability of POM-Checker in measuring shoulder range of motion: protocol for a single center comparative study. Medicine. 2018;97(25):e11082.CrossRef
Metadata
Title
Reliability of a human pose tracking algorithm for measuring upper limb joints: comparison with photography-based goniometry
Authors
Jingyuan Fan
Fanbin Gu
Lulu Lv
Zhejin Zhang
Changbing Zhu
Jian Qi
Honggang Wang
Xiaolin Liu
Jiantao Yang
Qingtang Zhu
Publication date
01-12-2022
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2022
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/s12891-022-05826-4

Other articles of this Issue 1/2022

BMC Musculoskeletal Disorders 1/2022 Go to the issue