Top

Published in:

Open Access 01-03-2018 | Mobile & Wireless Health

Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research

Authors: Francesco Luke Siena, Bill Byrom, Paul Watts, Philip Breedon

Published in: Journal of Medical Systems | Issue 3/2018

Abstract

Applications utilising 3D Camera technologies for the measurement of health outcomes in the health and wellness sector continues to expand. The Intel® RealSense™ is one of the leading 3D depth sensing cameras currently available on the market and aligns itself for use in many applications, including robotics, automation, and medical systems. One of the most prominent areas is the production of interactive solutions for rehabilitation which includes gait analysis and facial tracking. Advancements in depth camera technology has resulted in a noticeable increase in the integration of these technologies into portable platforms, suggesting significant future potential for pervasive in-clinic and field based health assessment solutions. This paper reviews the Intel RealSense technology’s technical capabilities and discusses its application to clinical research and includes examples where the Intel RealSense camera range has been used for the measurement of health outcomes. This review supports the use of the technology to develop robust, objective movement and mobility-based endpoints to enable accurate tracking of the effects of treatment interventions in clinical trials.

Microsoft ® Corporation, Redmond, Washington, USA, https://www.microsoft.com

Good OS (2017) Kinect is officially dead. Really. Officially. It's dead. In: Polygon. https://www.polygon.com/2017/10/25/16543192/kinect-discontinued-microsoft-announcement. Accessed 20 Nov 2017

Breedon P, Byrom B, Siena L, Muehlhausen W. (2016) Enhancing the Measurement of Clinical Outcomes Using Microsoft Kinect. Interactive Technologies and Games (iTAG), 2016 International Conference on 2016 Oct 26 (pp. 61-69). https://doi.org/10.1109/iTAG.2016.17.

Intel. (2017) Intel® Euclid™ Development Kit. https://www.intel.co.uk/content/www/uk/en/support/articles/000024177/emerging-technologies/intel-euclid-development-kit.html . Accessed 24 January 2018

Intel. (2016) Intel® RealSense™ SDK 2016 R2 Documentation Face Landmark Data. https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_face_face_landmark_data.html. Accessed 4 July 2017

Intel. (2017) Intel® RealSense™ Camera SR300 Product Data Sheet. https://software.intel.com/sites/default/files/managed/0c/ec/realsense-sr300-product-datasheet-rev-1-0.pdf Accessed 4 July 2017

Intel. (2016) Introducing the Intel® RealSense™ R200 Camera (world facing). https://software.intel.com/en-us/articles/realsense-r200-camera Accessed 4 July 2017

Intel. (2016) Intel® RealSense™ Camera R200 Product Data Sheet. https://software.intel.com/sites/default/files/managed/d7/a9/realsense-camera-r200-product-datasheet.pdf Accessed 4 July 2017

Intel. (2016) What's New in the 2016 R2 Intel RealSense SDK?. https://software.intel.com/en-us/blogs/2016/05/21/new-r2. Accessed 10 November 2017

Intel. (2017) A Comparison of Intel® RealSense™ Front-Facing Camera SR300 and F200. https://software.intel.com/en-us/articles/a-comparison-of-intel-realsensetm-front-facing-camera-sr300-and-f200. Accessed 10 November 2017

10.

Intel. (2017) Intel® RealSense SDK for Windows* (Discontinued). https://software.intel.com/en-us/realsense-sdk-windows-eol. Accessed 10 November 2017

11.

Intel. (2017) https://software.intel.com/sites/landingpage/realsense/camera-sdk/v1.1/documentation/html/index.html?doc_advanced_module_range_specification.html. Accessed 4 July 2017

12.

Shires L, Battersby S, Lewis J, Brown D, Sherkat N, Standen P (2013) Enhancing the tracking capabilities of the Microsoft Kinect for stroke rehabilitation. In Serious Games and Applications for Health (SeGAH), 2013, 2nd International Conference on 2013 May 2 (pp. 1-8). https://doi.org/10.1109/SeGAH.2013.6665316.

13.

Intel. (2016) Intel® RealSense™ 3D Camera ZR300. https://click.intel.com/intelr-realsensetm-development-kit-featuring-the-zr300.html. Accessed 4 July 2017

14.

Intel. (2016) Intel® RealSense™ 3D Camera ZR300 Data Sheet. http://click.intel.com/media/ZR300-Product-Datasheet-Public-002.pdf. Accessed 4 July 2017

15.

Intel. (2016) A Comparison of Intel® RealSense™ Front-Facing Camera SR300 and F200. https://software.intel.com/en-us/articles/a-comparison-of-intel-realsensetm-front-facing-camera-sr300-and-f200. Accessed 10 November 2017

16.

Intel. (2017) Intel® RealSense™ Depth Camera D400-Series. https://software.intel.com/en-us/realsense/d400. Accessed 10 November 2017

17.

Sin, H., and Lee, G., Additional virtual reality training using Xbox Kinect in stroke survivors with hemiplegia. American journal of physical medicine & rehabilitation. 92(10):871–880, 2013. https://doi.org/10.1097/PHM.0b013e3182a38e40.CrossRef

18.

Galna, B., Jackson, D., Schofield, G., McNaney, R., Webster, M., Barry, G., Mhiripiri, D., Balaam, M., Olivier, P., and Rochester, L., Retraining function in people with Parkinson’s disease using the Microsoft kinect: game design and pilot testing. Journal of neuroengineering and rehabilitation. 11(1):60, 2014. https://doi.org/10.1186/1743-0003-11-60.CrossRefPubMedPubMedCentral

19.

Ortiz-Gutiérrez, R., Cano-de-la-Cuerda, R., Galán-del-Río, F., Alguacil-Diego, I.M., Palacios-Ceña, D., and Miangolarra-Page, J.C., A telerehabilitation program improves postural control in multiple sclerosis patients: a Spanish preliminary study. International journal of environmental research and public health. 10(11):5697–5710, 2013. https://doi.org/10.3390/ijerph10115697.CrossRefPubMedPubMedCentral

20.

Luna-Oliva, L., Ortiz-Gutiérrez, R.M., Cano-de la Cuerda, R., Piédrola, R.M., Alguacil-Diego, I.M., Sánchez-Camarero, C., and Martínez Culebras, M.D., Kinect Xbox 360 as a therapeutic modality for children with cerebral palsy in a school environment: a preliminary study. NeuroRehabilitation. 33(4):513–521, 2013. https://doi.org/10.3233/NRE-131001.PubMed

21.

Byrom, B., Breedon, P., and Muehlhausen, W., A Review Evaluating the Validity of Motion-Based Gaming Platforms to Measure Clinical Outcomes in Clinical Research. Value in Health. 19(7):A357–A358, 2016.CrossRef

22.

Chhor, J., Gong, Y., and Rau, P.L., Breakout: Design and Evaluation of a Serious Game for Health Employing Intel RealSense, InInternational Conference on Cross-Cultural Design 2017 Jul 9 (pp. 531-545). Springer, Cham, 2017.

23.

Ferche, O., Moldoveanu, A., and Moldoveanu, F., Evaluating Lightweight Optical Hand Tracking for Virtual Reality Rehabilitation. Romanian Journal of Human-Computer Interaction. 9(2):85, 2016.

24.

Baldominos, A., Saez, Y., and del Pozo, C.G., An approach to physical rehabilitation using state-of-the-art virtual reality and motion tracking technologies. Procedia Computer Science. 64:10–16, 2015. https://doi.org/10.1016/j.procs.2015.08.457.CrossRef

25.

Cidota, M.A., Lukosch, S.G., Dezentje, P., Bank, P.J., Lukosch, H.K., and Clifford, R., Serious Gaming in Augmented Reality using HMDs for Assessment of Upper Extremity Motor Dysfunctions. i-com. 15(2):155–169, 2016. https://doi.org/10.1515/icom-2016-0020.CrossRef

26.

House R, Lasso A, Harish V, Baum Z, Fichtinger G.Evaluation of the Intel RealSense SR300 camera for image-guided interventions and application in vertebral level localization. InSPIE Medical Imaging. International Society for Optics and Photonics. (pp. 101352Z-101352Z), 2017. https://doi.org/10.1117/12.2255899.

27.

Silva V, Soares F, Esteves JS, Figueiredo J, Santos C, Pereira AP. (2017) Happiness and Sadness Recognition System—Preliminary Results with an Intel RealSense 3D Sensor. InCONTROLO 2016, Springer International Publishing. (pp. 385-395).

28.

Bandini, A., Namasivayam, A., and Yunusova, Y., Video-based tracking of jaw movements during speech: Preliminary results and future directions. Proc. Interspeech 2017. 2017:689–693, 2017. https://doi.org/10.21437/Interspeech.2017-1371.CrossRef

29.

Intel. (2017) 3D People Full-Body Scanning System With Intel® RealSense™ 3D Cameras and Intel® Edison: How We Did It. https://software.intel.com/en-us/articles/cappasity-3d-people-full-body-scan-with-intel-realsense-and-intel-edison. Accessed 4 July 2017

30.

Downing, G., Biomarkers Definitions Working Group. Biomarkers and Surrogate Endpoints. Clinical Pharmacology & Therapeutics. 69:89–95, 2001.CrossRef

31.

Byrom, B., Watson, C., Doll, H., Coons, S.J., Eremenco, S., Ballinger, R., Mc Carthy, M., Crescioni, M., O’Donohoe, P., Howry, C., and ePRO Consortium, Selection of and Evidentiary Considerations for Wearable Devices and Their Measurements for Use in Regulatory Decision Making: Recommendations from the ePRO Consortium. Value in Health, 2017. https://doi.org/10.1016/j.jval.2017.09.012.

32.

Alabbasi, H.A., Moldoveanu, P., and Moldoveanu, A., Real time facial emotion recognition using kinect V2 sensor. IOSR J. Comput. Eng. Ver. II. 17(3):2278–2661, 2015. https://doi.org/10.9790/0661-17326168.

33.

Li, S., Cui, L., Zhu, C., Li, B., Zhao, N., and Zhu, T., Emotion recognition using Kinect motion capture data of human gaits. PeerJ. 4:e2364, 2015. https://doi.org/10.7717/peerj.2364.CrossRef

34.

Bajcar, A. Borkowska and K. Jach. (2017). The usability of system and users emotions during work with interface designed for disabled – the pilot study, in IADIS International Conference Interfaces and Human Computer Interaction 2017, Lisbon, pp. 46-53.

35.

Ťupa, O., Procházka, A., Vyšata, O., Schätz, M., Mareš, J., Vališ, M., and Mařík, V., Motion tracking and gait feature estimation for recognising Parkinson’s disease using MS Kinect. Biomedical engineering online. 14(1):97, 2015. https://doi.org/10.1186/s12938-015-0092-7.CrossRefPubMedPubMedCentral

36.

Huang J, Zhou W, Li H, Li W. (2015) Sign language recognition using real-sense. InSignal and Information Processing (ChinaSIP), IEEE China Summit and International Conference (pp. 166-170). IEEE. 10.1109/ChinaSIP.2015.7230384

Title: Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research
Authors: Francesco Luke Siena
Bill Byrom
Paul Watts
Philip Breedon
Publication date: 01-03-2018
Publisher: Springer US
Published in: Journal of Medical Systems / Issue 3/2018
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI: https://doi.org/10.1007/s10916-018-0905-x

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Utilising the Intel RealSense Camera for Measuring Health Outcomes in Clinical Research

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2018

Different Digitalization Techniques for 3D Printing of Anatomical Pieces

Assessment of Subtle Changes in Diabetes-Associated Arteriosclerosis using Photoplethysmographic Pulse Wave from Index Finger

A Visual Decision Support Tool for Appendectomy Care

Healthcare-based on Cloud Electrocardiogram System: A Medical Center Experience in Middle Taiwan

Design of an Orthopedic Product by Using Additive Manufacturing Technology: The Arm Splint

Analysis and Fem Simulation Methodology of Dynamic Behavior of Human Rotator Cuff in Repetitive Routines: Musician Case Study