Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Research article

Sensors vs. experts - A performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients

Authors: Michael Marschollek, Anja Rehwald, Klaus-Hendrik Wolf, Matthias Gietzelt, Gerhard Nemitz, Hubertus Meyer zu Schwabedissen, Mareike Schulze

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Background

Fall events contribute significantly to mortality, morbidity and costs in our ageing population. In order to identify persons at risk and to target preventive measures, many scores and assessment tools have been developed. These often require expertise and are costly to implement. Recent research investigates the use of wearable inertial sensors to provide objective data on motion features which can be used to assess individual fall risk automatically. So far it is unknown how well this new method performs in comparison with conventional fall risk assessment tools. The aim of our research is to compare the predictive performance of our new sensor-based method with conventional and established methods, based on prospective data.

Methods

In a first study phase, 119 inpatients of a geriatric clinic took part in motion measurements using a wireless triaxial accelerometer during a Timed Up&Go (TUG) test and a 20 m walk. Furthermore, the St. Thomas Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) was performed, and the multidisciplinary geriatric care team estimated the patients' fall risk. In a second follow-up phase of the study, 46 of the participants were interviewed after one year, including a fall and activity assessment. The predictive performances of the TUG, the STRATIFY and team scores are compared. Furthermore, two automatically induced logistic regression models based on conventional clinical and assessment data (CONV) as well as sensor data (SENSOR) are matched.

Results

Among the risk assessment scores, the geriatric team score (sensitivity 56%, specificity 80%) outperforms STRATIFY and TUG. The induced logistic regression models CONV and SENSOR achieve similar performance values (sensitivity 68%/58%, specificity 74%/78%, AUC 0.74/0.72, +LR 2.64/2.61). Both models are able to identify more persons at risk than the simple scores.

Conclusions

Sensor-based objective measurements of motion parameters in geriatric patients can be used to assess individual fall risk, and our prediction model's performance matches that of a model based on conventional clinical and assessment data. Sensor-based measurements using a small wearable device may contribute significant information to conventional methods and are feasible in an unsupervised setting. More prospective research is needed to assess the cost-benefit relation of our approach.
Appendix
Available only for authorised users
Literature
1.
go back to reference von Renteln-Kruse W, Krause T, Dieckmann P, Vogel J: Geriatric patients' mobility status as reflected by the relevant items of the Barthel index and in-hospital falls. J Am Geriatr Soc. 2006, 54: 1012-1013. 10.1111/j.1532-5415.2006.00755.x.CrossRefPubMed von Renteln-Kruse W, Krause T, Dieckmann P, Vogel J: Geriatric patients' mobility status as reflected by the relevant items of the Barthel index and in-hospital falls. J Am Geriatr Soc. 2006, 54: 1012-1013. 10.1111/j.1532-5415.2006.00755.x.CrossRefPubMed
2.
go back to reference Oliver D, Daly F, Martin FC, McMurdo ME: Risk factors and risk assessment tools for falls in hospital in-patients: a systematic review. Age Ageing. 2004, 33: 122-130. 10.1093/ageing/afh017.CrossRefPubMed Oliver D, Daly F, Martin FC, McMurdo ME: Risk factors and risk assessment tools for falls in hospital in-patients: a systematic review. Age Ageing. 2004, 33: 122-130. 10.1093/ageing/afh017.CrossRefPubMed
3.
go back to reference Steinhagen-Thiessen E, Borchelt M: Morbidität, Medikation und Funktionalität im Alter [Morbidity, medication and functional status in the elderly]. Die Berliner Altersstudie [The Berlin Aging Study]. Edited by: Mayer KU, Baltes PB. 1996, Berlin: Akademie Verlag, 151-184. Steinhagen-Thiessen E, Borchelt M: Morbidität, Medikation und Funktionalität im Alter [Morbidity, medication and functional status in the elderly]. Die Berliner Altersstudie [The Berlin Aging Study]. Edited by: Mayer KU, Baltes PB. 1996, Berlin: Akademie Verlag, 151-184.
4.
go back to reference Stevens JA, Corso PS, Finkelstein EA, Miller TR: The costs of fatal and non-fatal falls among older adults. Inj Prev. 2006, 12: 290-295. 10.1136/ip.2005.011015.CrossRefPubMedPubMedCentral Stevens JA, Corso PS, Finkelstein EA, Miller TR: The costs of fatal and non-fatal falls among older adults. Inj Prev. 2006, 12: 290-295. 10.1136/ip.2005.011015.CrossRefPubMedPubMedCentral
5.
go back to reference Gillespie LD, Robertson MC, Gillespie WJ, Lamb SE, Gates S, Cumming RG, Rowe BH: Interventions for preventing falls in older people living in the community. Cochrane Database Syst Rev. 2009, CD007146- Gillespie LD, Robertson MC, Gillespie WJ, Lamb SE, Gates S, Cumming RG, Rowe BH: Interventions for preventing falls in older people living in the community. Cochrane Database Syst Rev. 2009, CD007146-
6.
go back to reference Podsiadlo D, Richardson S: The timed "Up & Go": a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc. 1991, 39: 142-148.CrossRefPubMed Podsiadlo D, Richardson S: The timed "Up & Go": a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc. 1991, 39: 142-148.CrossRefPubMed
7.
go back to reference Oliver D, Britton M, Seed P, Martin FC, Hopper AH: Development and evaluation of evidence based risk assessment tool (STRATIFY) to predict which elderly inpatients will fall: case-control and cohort studies. Bmj. 1997, 315: 1049-1053.CrossRefPubMedPubMedCentral Oliver D, Britton M, Seed P, Martin FC, Hopper AH: Development and evaluation of evidence based risk assessment tool (STRATIFY) to predict which elderly inpatients will fall: case-control and cohort studies. Bmj. 1997, 315: 1049-1053.CrossRefPubMedPubMedCentral
8.
go back to reference Gates S, Smith LA, Fisher JD, Lamb SE: Systematic review of accuracy of screening instruments for predicting fall risk among independently living older adults. J Rehabil Res Dev. 2008, 45: 1105-1116. 10.1682/JRRD.2008.04.0057.CrossRefPubMed Gates S, Smith LA, Fisher JD, Lamb SE: Systematic review of accuracy of screening instruments for predicting fall risk among independently living older adults. J Rehabil Res Dev. 2008, 45: 1105-1116. 10.1682/JRRD.2008.04.0057.CrossRefPubMed
9.
go back to reference Oliver D, Papaioannou A, Giangregorio L, Thabane L, Reizgys K, Foster G: A systematic review and meta-analysis of studies using the STRATIFY tool for prediction of falls in hospital patients: how well does it work?. Age Ageing. 2008, 37: 621-627. 10.1093/ageing/afn203.CrossRefPubMed Oliver D, Papaioannou A, Giangregorio L, Thabane L, Reizgys K, Foster G: A systematic review and meta-analysis of studies using the STRATIFY tool for prediction of falls in hospital patients: how well does it work?. Age Ageing. 2008, 37: 621-627. 10.1093/ageing/afn203.CrossRefPubMed
10.
go back to reference Kikuchi R, Kozaki K, Iwata A, Hasegawa H, Toba K: Evaluation of risk of falls in patients at a memory impairment outpatient clinic. Geriatr Gerontol Int. 2009, 9: 298-303. 10.1111/j.1447-0594.2009.00539.x.CrossRefPubMed Kikuchi R, Kozaki K, Iwata A, Hasegawa H, Toba K: Evaluation of risk of falls in patients at a memory impairment outpatient clinic. Geriatr Gerontol Int. 2009, 9: 298-303. 10.1111/j.1447-0594.2009.00539.x.CrossRefPubMed
11.
go back to reference Kristensen MT, Foss NB, Kehlet H: Timed "up & go" test as a predictor of falls within 6 months after hip fracture surgery. Phys Ther. 2007, 87: 24-30. 10.2522/ptj.20050271.CrossRefPubMed Kristensen MT, Foss NB, Kehlet H: Timed "up & go" test as a predictor of falls within 6 months after hip fracture surgery. Phys Ther. 2007, 87: 24-30. 10.2522/ptj.20050271.CrossRefPubMed
12.
go back to reference Hale WA, Delaney MJ, McGaghie WC: Characteristics and predictors of falls in elderly patients. J Fam Pract. 1992, 34: 577-581.PubMed Hale WA, Delaney MJ, McGaghie WC: Characteristics and predictors of falls in elderly patients. J Fam Pract. 1992, 34: 577-581.PubMed
13.
go back to reference Tinetti ME: Performance-oriented assessment of mobility problems in elderly patients. J Am Geriatr Soc. 1986, 34: 119-126.CrossRefPubMed Tinetti ME: Performance-oriented assessment of mobility problems in elderly patients. J Am Geriatr Soc. 1986, 34: 119-126.CrossRefPubMed
14.
go back to reference Narayanan MR, Scalzi ME, Redmond SJ, Lord SR, Celler BG, Lovell NH: A wearable triaxial accelerometry system for longitudinal assessment of falls risk. Conf Proc IEEE Eng Med Biol Soc. 2008, 2008: 2840-2843.PubMed Narayanan MR, Scalzi ME, Redmond SJ, Lord SR, Celler BG, Lovell NH: A wearable triaxial accelerometry system for longitudinal assessment of falls risk. Conf Proc IEEE Eng Med Biol Soc. 2008, 2008: 2840-2843.PubMed
15.
go back to reference Narayanan MR, Lord SR, Budge MM, Celler BG, Lovell NH: Falls management: detection and prevention, using a waist-mounted triaxial accelerometer. Conf Proc IEEE Eng Med Biol Soc. 2007, 2007: 4037-4040.PubMed Narayanan MR, Lord SR, Budge MM, Celler BG, Lovell NH: Falls management: detection and prevention, using a waist-mounted triaxial accelerometer. Conf Proc IEEE Eng Med Biol Soc. 2007, 2007: 4037-4040.PubMed
16.
go back to reference Marschollek M, Nemitz G, Gietzelt M, Wolf KH, Meyer Zu, Schwabedissen H, Haux R: Predicting in-patient falls in a geriatric clinic: a clinical study combining assessment data and simple sensory gait measurements. Z Gerontol Geriatr. 2009, 42: 317-321. 10.1007/s00391-009-0035-7.CrossRefPubMed Marschollek M, Nemitz G, Gietzelt M, Wolf KH, Meyer Zu, Schwabedissen H, Haux R: Predicting in-patient falls in a geriatric clinic: a clinical study combining assessment data and simple sensory gait measurements. Z Gerontol Geriatr. 2009, 42: 317-321. 10.1007/s00391-009-0035-7.CrossRefPubMed
17.
go back to reference Gietzelt M, Nemitz G, Wolf KH, Meyer Zu Schwabedissen H, Haux R, Marschollek M: A clinical study to assess fall risk using a single waist accelerometer. Inform Health Soc Care. 2009, 34: 181-188. 10.3109/17538150903356275.CrossRefPubMed Gietzelt M, Nemitz G, Wolf KH, Meyer Zu Schwabedissen H, Haux R, Marschollek M: A clinical study to assess fall risk using a single waist accelerometer. Inform Health Soc Care. 2009, 34: 181-188. 10.3109/17538150903356275.CrossRefPubMed
18.
go back to reference Marschollek M, Rehwald A, Wolf KH, Gietzelt M, Nemitz G, Meyer Zu Schwabedissen H, Haux R: Sensor-based Fall Risk Assessment - an Expert 'to go'. Methods Inf Med. 2011, 50: Marschollek M, Rehwald A, Wolf KH, Gietzelt M, Nemitz G, Meyer Zu Schwabedissen H, Haux R: Sensor-based Fall Risk Assessment - an Expert 'to go'. Methods Inf Med. 2011, 50:
19.
go back to reference Marschollek M, Wolf KH, Gietzelt M, Nemitz G, Meyer Zu Schwabedissen H, Haux R: Assessing elderly persons' fall risk using spectral analysis on accelerometric data--a clinical evaluation study. Conf Proc IEEE Eng Med Biol Soc. 2008, 2008: 3682-3685.PubMed Marschollek M, Wolf KH, Gietzelt M, Nemitz G, Meyer Zu Schwabedissen H, Haux R: Assessing elderly persons' fall risk using spectral analysis on accelerometric data--a clinical evaluation study. Conf Proc IEEE Eng Med Biol Soc. 2008, 2008: 3682-3685.PubMed
20.
go back to reference Mahoney FI, Barthel DW: Functional Evaluation: The Barthel Index. Md State Med J. 1965, 14: 61-65.PubMed Mahoney FI, Barthel DW: Functional Evaluation: The Barthel Index. Md State Med J. 1965, 14: 61-65.PubMed
21.
go back to reference Marschollek M, Rehwald A, Gietzelt M, Song B, Wolf KH, Haux R: Daily activities and fall risk - A follow-up study to identify relevant activities for sensor-based fall risk assessment. Stud Health Technol Inform. 2010, 160: 68-72.PubMed Marschollek M, Rehwald A, Gietzelt M, Song B, Wolf KH, Haux R: Daily activities and fall risk - A follow-up study to identify relevant activities for sensor-based fall risk assessment. Stud Health Technol Inform. 2010, 160: 68-72.PubMed
22.
go back to reference Lamb SE, Jorstad-Stein EC, Hauer K, Becker C: Development of a common outcome data set for fall injury prevention trials: the Prevention of Falls Network Europe consensus. J Am Geriatr Soc. 2005, 53: 1618-1622. 10.1111/j.1532-5415.2005.53455.x.CrossRefPubMed Lamb SE, Jorstad-Stein EC, Hauer K, Becker C: Development of a common outcome data set for fall injury prevention trials: the Prevention of Falls Network Europe consensus. J Am Geriatr Soc. 2005, 53: 1618-1622. 10.1111/j.1532-5415.2005.53455.x.CrossRefPubMed
23.
go back to reference Witten IH, Frank E: Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems). 2005, Morgan Kaufmann Publishers Inc. Witten IH, Frank E: Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems). 2005, Morgan Kaufmann Publishers Inc.
24.
go back to reference Ikeda M, Itoh S, Ishigaki T, Yamauchi K: Application of resampling techniques to the statistical analysis of the Brier score. Methods Inf Med. 2001, 40: 259-264.PubMed Ikeda M, Itoh S, Ishigaki T, Yamauchi K: Application of resampling techniques to the statistical analysis of the Brier score. Methods Inf Med. 2001, 40: 259-264.PubMed
25.
go back to reference Kim EA, Mordiffi SZ, Bee WH, Devi K, Evans D: Evaluation of three fall-risk assessment tools in an acute care setting. J Adv Nurs. 2007, 60: 427-435. 10.1111/j.1365-2648.2007.04419.x.CrossRefPubMed Kim EA, Mordiffi SZ, Bee WH, Devi K, Evans D: Evaluation of three fall-risk assessment tools in an acute care setting. J Adv Nurs. 2007, 60: 427-435. 10.1111/j.1365-2648.2007.04419.x.CrossRefPubMed
26.
go back to reference Nordin E, Lindelof N, Rosendahl E, Jensen J, Lundin-Olsson L: Prognostic validity of the Timed Up-and-Go test, a modified Get-Up-and-Go test, staff's global judgement and fall history in evaluating fall risk in residential care facilities. Age Ageing. 2008, 37: 442-448. 10.1093/ageing/afn101.CrossRefPubMed Nordin E, Lindelof N, Rosendahl E, Jensen J, Lundin-Olsson L: Prognostic validity of the Timed Up-and-Go test, a modified Get-Up-and-Go test, staff's global judgement and fall history in evaluating fall risk in residential care facilities. Age Ageing. 2008, 37: 442-448. 10.1093/ageing/afn101.CrossRefPubMed
27.
go back to reference Thrane G, Joakimsen RM, Thornquist E: The association between timed up and go test and history of falls: the Tromso study. BMC Geriatr. 2007, 7: 1-10.1186/1471-2318-7-1.CrossRefPubMedPubMedCentral Thrane G, Joakimsen RM, Thornquist E: The association between timed up and go test and history of falls: the Tromso study. BMC Geriatr. 2007, 7: 1-10.1186/1471-2318-7-1.CrossRefPubMedPubMedCentral
28.
go back to reference Lord SR, Menz HB, Tiedemann A: A physiological profile approach to falls risk assessment and prevention. Phys Ther. 2003, 83: 237-252.PubMed Lord SR, Menz HB, Tiedemann A: A physiological profile approach to falls risk assessment and prevention. Phys Ther. 2003, 83: 237-252.PubMed
29.
go back to reference Marschollek M: Recent progress in sensor-enhanced health information systems - slowly but sustainably. Inform Health Soc Care. 2009, 34: 225-230. 10.3109/17538150903358610.CrossRefPubMed Marschollek M: Recent progress in sensor-enhanced health information systems - slowly but sustainably. Inform Health Soc Care. 2009, 34: 225-230. 10.3109/17538150903358610.CrossRefPubMed
30.
go back to reference Van Hoecke S, Volckaert B, Dhoedt B, De Turck F: Large-scale Performance Evaluation of e-Homecare Architectures Using the WS-NS Simulator. Methods Inf Med. 2010, 49: Van Hoecke S, Volckaert B, Dhoedt B, De Turck F: Large-scale Performance Evaluation of e-Homecare Architectures Using the WS-NS Simulator. Methods Inf Med. 2010, 49:
31.
go back to reference Mancini F, Sousa FS, Hummel AD, Falcao AE, Yi LC, Ortolani CF, Sigulem D, Pisa IT: Classification of Postural Profiles among Mouth-breathing Children by Learning Vector Quantization. Methods Inf Med. 2010, 49: Mancini F, Sousa FS, Hummel AD, Falcao AE, Yi LC, Ortolani CF, Sigulem D, Pisa IT: Classification of Postural Profiles among Mouth-breathing Children by Learning Vector Quantization. Methods Inf Med. 2010, 49:
32.
go back to reference Hoerbst A, Ammenwerth E: Electronic health records. A systematic review on quality requirements. Methods Inf Med. 2010, 49: 320-336. 10.3414/ME10-01-0038.CrossRefPubMed Hoerbst A, Ammenwerth E: Electronic health records. A systematic review on quality requirements. Methods Inf Med. 2010, 49: 320-336. 10.3414/ME10-01-0038.CrossRefPubMed
33.
go back to reference Pecchia L, Bath PA, Pendleton N, Bracale M: Analytic Hierarchy Process (AHP) for Examining Healthcare Professionals' Assessments of Risk Factors. The Relative Importance of Risk Factors for Falls in Community-dwelling Older People. Methods Inf Med. 2010, 50: Pecchia L, Bath PA, Pendleton N, Bracale M: Analytic Hierarchy Process (AHP) for Examining Healthcare Professionals' Assessments of Risk Factors. The Relative Importance of Risk Factors for Falls in Community-dwelling Older People. Methods Inf Med. 2010, 50:
34.
go back to reference Mathie MJ, Coster AC, Lovell NH, Celler BG, Lord SR, Tiedemann A: A pilot study of long-term monitoring of human movements in the home using accelerometry. J Telemed Telecare. 2004, 10: 144-151. 10.1258/135763304323070788.CrossRefPubMed Mathie MJ, Coster AC, Lovell NH, Celler BG, Lord SR, Tiedemann A: A pilot study of long-term monitoring of human movements in the home using accelerometry. J Telemed Telecare. 2004, 10: 144-151. 10.1258/135763304323070788.CrossRefPubMed
35.
go back to reference Marschollek M, Ludwig W, Schapiewski I, Schriever E, Schubert R, Dybowski H, Meyer Zu Schwabedissen H, Howe J, Haux R: Multimodal Home Monitoring of Elderly People--First Results from the LASS Study. Proceedings - 21st International Conference on Advanced Information Networking an Applications. 2007, Niagara Falls, CA: IEEE Computer Society, 2: 815-819. Marschollek M, Ludwig W, Schapiewski I, Schriever E, Schubert R, Dybowski H, Meyer Zu Schwabedissen H, Howe J, Haux R: Multimodal Home Monitoring of Elderly People--First Results from the LASS Study. Proceedings - 21st International Conference on Advanced Information Networking an Applications. 2007, Niagara Falls, CA: IEEE Computer Society, 2: 815-819.
36.
go back to reference Marschollek M, Wolf KH, Plischke M, Ludwig W, Haux R, Mihailidis A, Howe J: People's perceptions and expectations of assistive health-enabling technologies: an empirical study in Germany. Assist Technol. 2009, 21: 86-93. 10.1080/10400430903050460.CrossRefPubMed Marschollek M, Wolf KH, Plischke M, Ludwig W, Haux R, Mihailidis A, Howe J: People's perceptions and expectations of assistive health-enabling technologies: an empirical study in Germany. Assist Technol. 2009, 21: 86-93. 10.1080/10400430903050460.CrossRefPubMed
37.
go back to reference Fensli R, Pedersen PE, Gundersen T, Hejlesen O: Sensor acceptance model - measuring patient acceptance of wearable sensors. Methods Inf Med. 2008, 47: 89-95.PubMed Fensli R, Pedersen PE, Gundersen T, Hejlesen O: Sensor acceptance model - measuring patient acceptance of wearable sensors. Methods Inf Med. 2008, 47: 89-95.PubMed
Metadata
Title
Sensors vs. experts - A performance comparison of sensor-based fall risk assessment vs. conventional assessment in a sample of geriatric patients
Authors
Michael Marschollek
Anja Rehwald
Klaus-Hendrik Wolf
Matthias Gietzelt
Gerhard Nemitz
Hubertus Meyer zu Schwabedissen
Mareike Schulze
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-48

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue