Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions

Authors: Illapha Cuba Gyllensten, Amanda Crundall-Goode, Ronald M. Aarts, Kevin M. Goode

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

Home telemonitoring (HTM) of chronic heart failure (HF) promises to improve care by timely indications when a patient’s condition is worsening. Simple rules of sudden weight change have been demonstrated to generate many alerts with poor sensitivity. Trend alert algorithms and bio-impedance (a more sensitive marker of fluid change), should produce fewer false alerts and reduce workload. However, comparisons between such approaches on the decisions made and the time spent reviewing alerts has not been studied.

Methods

Using HTM data from an observational trial of 91 HF patients, a simulated telemonitoring station was created and used to present virtual caseloads to clinicians experienced with HF HTM systems. Clinicians were randomised to either a simple (i.e. an increase of 2 kg in the past 3 days) or advanced alert method (either a moving average weight algorithm or bio-impedance cumulative sum algorithm).

Results

In total 16 clinicians reviewed the caseloads, 8 randomised to a simple alert method and 8 to the advanced alert methods. Total time to review the caseloads was lower in the advanced arms than the simple arm (80 ± 42 vs. 149 ± 82 min) but agreements on actions between clinicians were low (Fleiss kappa 0.33 and 0.31) and despite having high sensitivity many alerts in the bio-impedance arm were not considered to need further action.

Conclusion

Advanced alerting algorithms with higher specificity are likely to reduce the time spent by clinicians and increase the percentage of time spent on changes rated as most meaningful. Work is needed to present bio-impedance alerts in a manner which is intuitive for clinicians.
Appendix
Available only for authorised users
Literature
1.
go back to reference McMurray JJV, Adamopoulos S, Anker SD, et al. ESC guidelines for the diagnosis and treatment of acute and chronic heart failure 2012 the task force for the diagnosis and treatment of acute and chronic heart failure 2012 of the European society of cardiology. Developed in collaboration with the heart failure association (HFA) of the ESC. Eur Heart J. 2012;33:1787–847.CrossRefPubMed McMurray JJV, Adamopoulos S, Anker SD, et al. ESC guidelines for the diagnosis and treatment of acute and chronic heart failure 2012 the task force for the diagnosis and treatment of acute and chronic heart failure 2012 of the European society of cardiology. Developed in collaboration with the heart failure association (HFA) of the ESC. Eur Heart J. 2012;33:1787–847.CrossRefPubMed
2.
go back to reference Maggioni AP, Dahlström U, Filippatos G, et al. EURObservational research programme: regional differences and 1-year follow-up results of the heart failure pilot survey (ESC-HF pilot). Eur J Heart Fail. 2013;15:808–17.CrossRefPubMed Maggioni AP, Dahlström U, Filippatos G, et al. EURObservational research programme: regional differences and 1-year follow-up results of the heart failure pilot survey (ESC-HF pilot). Eur J Heart Fail. 2013;15:808–17.CrossRefPubMed
3.
go back to reference Conway A, Inglis SC, Chang AM, et al. Not all systematic reviews are systematic: a meta-review of the quality of systematic reviews for non-invasive remote monitoring in heart failure. J Telemed Telecare. 2013;19:326–37.CrossRefPubMed Conway A, Inglis SC, Chang AM, et al. Not all systematic reviews are systematic: a meta-review of the quality of systematic reviews for non-invasive remote monitoring in heart failure. J Telemed Telecare. 2013;19:326–37.CrossRefPubMed
4.
go back to reference Clarke M, Shah A, Sharma U. Systematic review of studies on telemonitoring of patients with congestive heart failure: a meta-analysis. J Telemed Telecare. 2011;17:7–14.CrossRefPubMed Clarke M, Shah A, Sharma U. Systematic review of studies on telemonitoring of patients with congestive heart failure: a meta-analysis. J Telemed Telecare. 2011;17:7–14.CrossRefPubMed
5.
go back to reference Inglis SC, Clark RA, McAlister FA, et al. Which components of heart failure programmes Are effective? a systematic review and meta-analysis of the outcomes of structured telephone support or telemonitoring as the primary component of chronic heart failure management in 8323 patients: abridged Cochrane review. Eur J Heart Fail. 2011;13:1028–40.CrossRefPubMed Inglis SC, Clark RA, McAlister FA, et al. Which components of heart failure programmes Are effective? a systematic review and meta-analysis of the outcomes of structured telephone support or telemonitoring as the primary component of chronic heart failure management in 8323 patients: abridged Cochrane review. Eur J Heart Fail. 2011;13:1028–40.CrossRefPubMed
6.
go back to reference Polisena J, Tran K, Cimon K, et al. Home telemonitoring for congestive heart failure: a systematic review and meta-analysis. J Telemed Telecare. 2010;16:68–76.CrossRefPubMed Polisena J, Tran K, Cimon K, et al. Home telemonitoring for congestive heart failure: a systematic review and meta-analysis. J Telemed Telecare. 2010;16:68–76.CrossRefPubMed
8.
go back to reference Koehler F, Winkler S, Schieber M, et al. Telemedical Interventional Monitoring in Heart Failure (TIM-HF), a randomized, controlled intervention trial investigating the impact of telemedicine on mortality in ambulatory patients with heart failure: study design. Eur J Heart Fail. 2010;12:1354–62.CrossRefPubMed Koehler F, Winkler S, Schieber M, et al. Telemedical Interventional Monitoring in Heart Failure (TIM-HF), a randomized, controlled intervention trial investigating the impact of telemedicine on mortality in ambulatory patients with heart failure: study design. Eur J Heart Fail. 2010;12:1354–62.CrossRefPubMed
10.
go back to reference Ong MK, Romano PS, Edgington S, et al. Effectiveness of remote patient monitoring after discharge of hospitalized patients with heart failure: The better effectiveness after transition–heart failure (beat-hf) randomized clinical trial. JAMA Intern Med. 2016;176:310–8.CrossRefPubMedPubMedCentral Ong MK, Romano PS, Edgington S, et al. Effectiveness of remote patient monitoring after discharge of hospitalized patients with heart failure: The better effectiveness after transition–heart failure (beat-hf) randomized clinical trial. JAMA Intern Med. 2016;176:310–8.CrossRefPubMedPubMedCentral
11.
go back to reference Boyne JJJ, Vrijhoef HJM. Implementing telemonitoring in heart failure care: barriers from the perspectives of patients, healthcare professionals and healthcare organizations. Curr Heart Fail Rep. 2013;10:254–61.CrossRefPubMed Boyne JJJ, Vrijhoef HJM. Implementing telemonitoring in heart failure care: barriers from the perspectives of patients, healthcare professionals and healthcare organizations. Curr Heart Fail Rep. 2013;10:254–61.CrossRefPubMed
12.
go back to reference Radhakrishnan K, Bowles K, Hanlon A, et al. A retrospective study on patient characteristics and telehealth alerts indicative of Key medical events for heart failure patients at a home health agency. Telemed E-Health. 2013;19:664–70.CrossRef Radhakrishnan K, Bowles K, Hanlon A, et al. A retrospective study on patient characteristics and telehealth alerts indicative of Key medical events for heart failure patients at a home health agency. Telemed E-Health. 2013;19:664–70.CrossRef
13.
go back to reference Zhang J, Goode KM, Cuddihy PE, et al. Predicting hospitalization due to worsening heart failure using daily weight measurement: analysis of the Trans-European Network-Home-Care Management System (TEN-HMS) study. Eur J Heart Fail. 2009;11:420–7.CrossRefPubMed Zhang J, Goode KM, Cuddihy PE, et al. Predicting hospitalization due to worsening heart failure using daily weight measurement: analysis of the Trans-European Network-Home-Care Management System (TEN-HMS) study. Eur J Heart Fail. 2009;11:420–7.CrossRefPubMed
14.
go back to reference Ledwidge MT, O’Hanlon R, Lalor L, et al. Can individualized weight monitoring using the HeartPhone algorithm improve sensitivity for clinical deterioration of heart failure? Eur J Heart Fail. 2013;15:447–55.CrossRefPubMed Ledwidge MT, O’Hanlon R, Lalor L, et al. Can individualized weight monitoring using the HeartPhone algorithm improve sensitivity for clinical deterioration of heart failure? Eur J Heart Fail. 2013;15:447–55.CrossRefPubMed
15.
go back to reference Anand IS, Tang WHW, Greenberg BH, et al. Design and Performance of a Multisensor Heart Failure Monitoring Algorithm: Results From the Multisensor Monitoring in Congestive Heart Failure (MUSIC) Study. J Card Fail. 2012;18:289–95.CrossRefPubMed Anand IS, Tang WHW, Greenberg BH, et al. Design and Performance of a Multisensor Heart Failure Monitoring Algorithm: Results From the Multisensor Monitoring in Congestive Heart Failure (MUSIC) Study. J Card Fail. 2012;18:289–95.CrossRefPubMed
16.
go back to reference Cuba Gyllensten I, Bonomi AG, Goode KM, et al. Early indication of decompensated heart failure in patients on home-telemonitoring: a comparison of prediction algorithms based on daily weight and noninvasive transthoracic Bio-impedance. JMIR Med Inform. 2016;4:e3.CrossRefPubMedPubMedCentral Cuba Gyllensten I, Bonomi AG, Goode KM, et al. Early indication of decompensated heart failure in patients on home-telemonitoring: a comparison of prediction algorithms based on daily weight and noninvasive transthoracic Bio-impedance. JMIR Med Inform. 2016;4:e3.CrossRefPubMedPubMedCentral
17.
go back to reference Abraham WT, Compton S, Haas GJ, et al. Intrathoracic Impedance vs Daily Weight Monitoring for Predicting Worsening Heart Failure Events: Results of the Fluid Accumulation Status Trial (FAST). Congest Heart Fail. 2011;17:51–5.CrossRefPubMed Abraham WT, Compton S, Haas GJ, et al. Intrathoracic Impedance vs Daily Weight Monitoring for Predicting Worsening Heart Failure Events: Results of the Fluid Accumulation Status Trial (FAST). Congest Heart Fail. 2011;17:51–5.CrossRefPubMed
18.
go back to reference Bourge RC, Abraham WT, Adamson PB, et al. Randomized controlled trial of an implantable continuous hemodynamic monitor in patients with advanced heart failure: the COMPASS-HF study. J Am Coll Cardiol. 2008;51:1073–9.CrossRefPubMed Bourge RC, Abraham WT, Adamson PB, et al. Randomized controlled trial of an implantable continuous hemodynamic monitor in patients with advanced heart failure: the COMPASS-HF study. J Am Coll Cardiol. 2008;51:1073–9.CrossRefPubMed
19.
go back to reference Abraham WT, Adamson PB, Bourge RC, et al. Wireless pulmonary artery haemodynamic monitoring in chronic heart failure: a randomised controlled trial. Lancet. 2011;377:658–66.CrossRefPubMed Abraham WT, Adamson PB, Bourge RC, et al. Wireless pulmonary artery haemodynamic monitoring in chronic heart failure: a randomised controlled trial. Lancet. 2011;377:658–66.CrossRefPubMed
20.
go back to reference Leslie BT. Device diagnostics and early identification of acute decompensated heart failure: a systematic review. J Cardiovasc Nurs. 2014;29:68–81.CrossRef Leslie BT. Device diagnostics and early identification of acute decompensated heart failure: a systematic review. J Cardiovasc Nurs. 2014;29:68–81.CrossRef
21.
go back to reference Alexandru CA. Reducing the risks of telehealthcare expansion through the automation of efficiency evaluation. Edinburgh: Doctoral Thesis, The University of Edinburgh; 2015. Alexandru CA. Reducing the risks of telehealthcare expansion through the automation of efficiency evaluation. Edinburgh: Doctoral Thesis, The University of Edinburgh; 2015.
22.
go back to reference Habetha J. The MyHeart project--fighting cardiovascular diseases by prevention and early diagnosis. Conf Proc Annu Int Conf IEEE Eng Med Biol Soc IEEE Eng Med Biol Soc Annu Conf. 2006; Suppl: 6746–6749. doi:10.1109/IEMBS.2006.260937. PMID 17959502. Habetha J. The MyHeart project--fighting cardiovascular diseases by prevention and early diagnosis. Conf Proc Annu Int Conf IEEE Eng Med Biol Soc IEEE Eng Med Biol Soc Annu Conf. 2006; Suppl: 6746–6749. doi:10.​1109/​IEMBS.​2006.​260937. PMID 17959502.
23.
go back to reference Larsen FF, Mogensen L, Tedner B. Transthoracic electrical impedance at 1 and 100 kHz - a means for separating thoracic fluid compartments? Clin Physiol. 1987;7:105–13.CrossRefPubMed Larsen FF, Mogensen L, Tedner B. Transthoracic electrical impedance at 1 and 100 kHz - a means for separating thoracic fluid compartments? Clin Physiol. 1987;7:105–13.CrossRefPubMed
24.
go back to reference Cuba-Gyllensten I, Gastelurrutia P, Riistama J, et al. A novel wearable vest for tracking pulmonary congestion in acutely decompensated heart failure. Int J Cardiol. 2014;177:199–201.CrossRefPubMed Cuba-Gyllensten I, Gastelurrutia P, Riistama J, et al. A novel wearable vest for tracking pulmonary congestion in acutely decompensated heart failure. Int J Cardiol. 2014;177:199–201.CrossRefPubMed
25.
go back to reference Braunschweig F. Overcoming the resistance to impedance monitoring in heart failure patients. Europace. 2010;12:614–5.CrossRefPubMed Braunschweig F. Overcoming the resistance to impedance monitoring in heart failure patients. Europace. 2010;12:614–5.CrossRefPubMed
26.
27.
go back to reference Adamson PB, Zile MR, Cho YK, et al. Hemodynamic factors associated with acute decompensated heart failure: part 2—use in automated detection. J Card Fail. 2011;17:366–73.CrossRefPubMed Adamson PB, Zile MR, Cho YK, et al. Hemodynamic factors associated with acute decompensated heart failure: part 2—use in automated detection. J Card Fail. 2011;17:366–73.CrossRefPubMed
28.
go back to reference Yu C-M, Wang L, Chau E, et al. Intrathoracic impedance monitoring in patients with heart failure. Circulation. 2005;112:841–8.CrossRefPubMed Yu C-M, Wang L, Chau E, et al. Intrathoracic impedance monitoring in patients with heart failure. Circulation. 2005;112:841–8.CrossRefPubMed
29.
go back to reference Nielsen J, Landauer TK. A mathematical model of the finding of usability problems. ACM, pp. 206–213. Nielsen J, Landauer TK. A mathematical model of the finding of usability problems. ACM, pp. 206–213.
30.
go back to reference Wilson SR, Cram P. Another sobering result for home telehealth—and where we might go next: Comment on ‘a randomized controlled trial of telemonitoring in older adults with multiple health issues to prevent hospitalizations and emergency department visits’. Arch Intern Med. 2012;172:779–80.PubMed Wilson SR, Cram P. Another sobering result for home telehealth—and where we might go next: Comment on ‘a randomized controlled trial of telemonitoring in older adults with multiple health issues to prevent hospitalizations and emergency department visits’. Arch Intern Med. 2012;172:779–80.PubMed
31.
go back to reference van Veldhuisen DJ, Braunschweig F, Conraads V, et al. Intrathoracic impedance monitoring, audible patient alerts, and outcome in patients with heart failure/clinical perspective. Circulation. 2011;124:1719–26.CrossRefPubMed van Veldhuisen DJ, Braunschweig F, Conraads V, et al. Intrathoracic impedance monitoring, audible patient alerts, and outcome in patients with heart failure/clinical perspective. Circulation. 2011;124:1719–26.CrossRefPubMed
32.
go back to reference Böhm M, Drexler H, Oswald H, et al. Fluid status telemedicine alerts for heart failure: a randomized controlled trial. Eur Heart J. 2016;37:3154–63.CrossRefPubMed Böhm M, Drexler H, Oswald H, et al. Fluid status telemedicine alerts for heart failure: a randomized controlled trial. Eur Heart J. 2016;37:3154–63.CrossRefPubMed
33.
go back to reference Vanderheyden M, Houben R, Verstreken S, et al. Continuous monitoring of intrathoracic impedance and right ventricular pressures in patients with heart failure. Circ Heart Fail. 2010;3:370–7.CrossRefPubMed Vanderheyden M, Houben R, Verstreken S, et al. Continuous monitoring of intrathoracic impedance and right ventricular pressures in patients with heart failure. Circ Heart Fail. 2010;3:370–7.CrossRefPubMed
34.
go back to reference Zile MR, Sharma V, Johnson JW, et al. Prediction of All-cause mortality based on the direct measurement of intrathoracic impedance. Circ Heart Fail. 2016;9:e002543.CrossRefPubMed Zile MR, Sharma V, Johnson JW, et al. Prediction of All-cause mortality based on the direct measurement of intrathoracic impedance. Circ Heart Fail. 2016;9:e002543.CrossRefPubMed
35.
go back to reference Cuba-Gyllensten I, Gastelurrutia P, Bonomi AG, et al. A method to adapt thoracic impedance based on chest geometry and composition to assess congestion in heart failure patients. Med Eng Phys. 2016;38:538–46.CrossRef Cuba-Gyllensten I, Gastelurrutia P, Bonomi AG, et al. A method to adapt thoracic impedance based on chest geometry and composition to assess congestion in heart failure patients. Med Eng Phys. 2016;38:538–46.CrossRef
Metadata
Title
Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions
Authors
Illapha Cuba Gyllensten
Amanda Crundall-Goode
Ronald M. Aarts
Kevin M. Goode
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-016-0398-9

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue