Skip to main content
Top
Published in: BMC Geriatrics 1/2020

Open Access 01-12-2020 | Care | Research article

External validation of the detection of indicators and vulnerabilities for emergency room trips (DIVERT) scale: a retrospective cohort study

Authors: Fabrice I. Mowbray, Aaron Jones, Connie Schumacher, John Hirdes, Andrew P. Costa

Published in: BMC Geriatrics | Issue 1/2020

Login to get access

Abstract

Background

The Detection of Indicators and Vulnerabilities of Emergency Room Trips (DIVERT) scale was developed to classify and estimate the risk of emergency department (ED) use among home care clients. The objective of this study was to externally validate the DIVERT scale in a secondary population of home care clients.

Methods

We conducted a retrospective cohort study, linking data from the Home Care Reporting System and the National Ambulatory Care Reporting System. Data were collected on older long-stay home care clients who received a RAI Home Care (RAI-HC) assessment. Data were collected for home care clients in the Canadian provinces of Ontario and Alberta, as well as in the cities of Winnipeg, Manitoba and Whitehorse, Yukon Territories between April 1, 2011 and September 30, 2014. The DIVERT scale was originally derived from the items of the RAI-HC through the use of recursive partitioning informed by a multinational clinical panel. This scale is currently implemented alongside the RAI-HC in provinces across Canada. The primary outcome of this study was ED visitation within 6 months of a RAI-HC assessment.

Results

The cohort contained 1,001,133 home care clients. The vast majority of cases received services in Ontario (88%), followed by Alberta (8%), Winnipeg (4%), and Whitehorse (< 1%). Across the four cohorts, the DIVERT scale demonstrated similar discriminative ability to the original validation work for all outcomes during the six-month follow-up: ED visitation (AUC = 0.617–0.647), two or more ED visits (AUC = 0.628–0.634) and hospital admission (AUC = 0.617–0.664).

Conclusions

The findings of this study support the external validity of the DIVERT scale. More specifically, the predictive accuracy of the DIVERT scale from the original work was similar to the accuracy demonstrated within a new cohort, created from different geographical regions and time periods.
Literature
1.
go back to reference Rutschmann OT, Chevalley T, Zumwald C, Luthy C, Vermeulen B, Sarasin FP. Pitfalls in the emergency department triage of frail elderly clients without specific complaints. Swiss Med Wkly. 2005;135(9/10):145–50.PubMed Rutschmann OT, Chevalley T, Zumwald C, Luthy C, Vermeulen B, Sarasin FP. Pitfalls in the emergency department triage of frail elderly clients without specific complaints. Swiss Med Wkly. 2005;135(9/10):145–50.PubMed
2.
go back to reference Pines JM, Mullins PM, Cooper JK, et al. National trends in emergency department use, care patterns, and quality of care of older adults in the United States. J Am Geriatr Soc. 2013;61:12–7.CrossRef Pines JM, Mullins PM, Cooper JK, et al. National trends in emergency department use, care patterns, and quality of care of older adults in the United States. J Am Geriatr Soc. 2013;61:12–7.CrossRef
3.
go back to reference Aminzadeh F, Dalziel WB. Older adults in the emergency department: a systematic review of patterns of use, adverse outcomes, and effectiveness of interventions. Ann Emerg Med. 2002;39:238–47.CrossRef Aminzadeh F, Dalziel WB. Older adults in the emergency department: a systematic review of patterns of use, adverse outcomes, and effectiveness of interventions. Ann Emerg Med. 2002;39:238–47.CrossRef
4.
go back to reference Nugus P, Holdgate A, Fry M, et al. Work pressure and client flow management in the emergency department: findings from an ethnographic study. Acad Emerg Med. 2011;18(10):1045–52.CrossRef Nugus P, Holdgate A, Fry M, et al. Work pressure and client flow management in the emergency department: findings from an ethnographic study. Acad Emerg Med. 2011;18(10):1045–52.CrossRef
5.
go back to reference Salvi F, et al. The elderly in the emergency department: a critical review of problems and solutions. Intern Emerg Med. 2007;2(4):292–301.CrossRef Salvi F, et al. The elderly in the emergency department: a critical review of problems and solutions. Intern Emerg Med. 2007;2(4):292–301.CrossRef
6.
go back to reference Kellermann AL, Martinez R. The ER, 50 years on. N Engl J Med. 2011;364:2278–9.CrossRef Kellermann AL, Martinez R. The ER, 50 years on. N Engl J Med. 2011;364:2278–9.CrossRef
8.
go back to reference Carriere G. Seniors’ use of home care. Ottawa: Health Statistics Division, Statistics Canada 2006;17(4):43–47. Carriere G. Seniors’ use of home care. Ottawa: Health Statistics Division, Statistics Canada 2006;17(4):43–47.
9.
go back to reference Wilson D, Truman C. Comparing the health service utilization of long-term-care residents, home-care recipients, and the well elderly. Can J Nurs Res. 2005;37:138–54.PubMed Wilson D, Truman C. Comparing the health service utilization of long-term-care residents, home-care recipients, and the well elderly. Can J Nurs Res. 2005;37:138–54.PubMed
10.
go back to reference Alessi CA, Stuck AE, Aronow HU, et al. The process of care in preventive in-home comprehensive geriatric assessment. J Am Geriatr Soc. 1997;45:1044–50.CrossRef Alessi CA, Stuck AE, Aronow HU, et al. The process of care in preventive in-home comprehensive geriatric assessment. J Am Geriatr Soc. 1997;45:1044–50.CrossRef
11.
go back to reference Stuck AE, Aronow HU, Steiner A, et al. A trial of annual in-home comprehensive geriatric assessments for elderly people living in the community. N Engl J Med. 1995;333:1184–9.CrossRef Stuck AE, Aronow HU, Steiner A, et al. A trial of annual in-home comprehensive geriatric assessments for elderly people living in the community. N Engl J Med. 1995;333:1184–9.CrossRef
12.
go back to reference Stuck AE, Elkuch P, Dapp U, et al. Feasibility and yield of a self-administered questionnaire for health risk appraisal in older people in three European countries. Age Ageing. 2002;31:463–7.CrossRef Stuck AE, Elkuch P, Dapp U, et al. Feasibility and yield of a self-administered questionnaire for health risk appraisal in older people in three European countries. Age Ageing. 2002;31:463–7.CrossRef
13.
go back to reference van Rossum E, Frederiks CM, Philipsen H, et al. Effects of preventive home visits to elderly people. BMJ. 1993;307:27–32.CrossRef van Rossum E, Frederiks CM, Philipsen H, et al. Effects of preventive home visits to elderly people. BMJ. 1993;307:27–32.CrossRef
14.
go back to reference Costa AP, Hirdes JP, Bell CM, et al. Derivation and validation of the detection of indicators and vulnerability for emergency room trips scale for classifying the risk of emergency department use in frail community-dwelling older adults. J Am Geriatr Soc. 2015;63:763–9.CrossRef Costa AP, Hirdes JP, Bell CM, et al. Derivation and validation of the detection of indicators and vulnerability for emergency room trips scale for classifying the risk of emergency department use in frail community-dwelling older adults. J Am Geriatr Soc. 2015;63:763–9.CrossRef
15.
go back to reference Cardiac Care Network of Ontario. Strategy for community management of heart failure in Ontario, 2014. Cardiac Care Network of Ontario. Strategy for community management of heart failure in Ontario, 2014.
16.
go back to reference Health Quality Ontario. Key observations: 2014–15 quality improvement plans community care access centres. Ontario: Queen’s Printer for Ontario; 2014. Health Quality Ontario. Key observations: 2014–15 quality improvement plans community care access centres. Ontario: Queen’s Printer for Ontario; 2014.
17.
go back to reference Costa AP, Schumacher C, Jones A, et al. DIVERT-collaboration action research and evaluation (CARE) trial protocol: a multiprovincial pragmatic cluster randomised trial of cardiorespiratory management in home care. BMJ Open. 2019;9:e030301.CrossRef Costa AP, Schumacher C, Jones A, et al. DIVERT-collaboration action research and evaluation (CARE) trial protocol: a multiprovincial pragmatic cluster randomised trial of cardiorespiratory management in home care. BMJ Open. 2019;9:e030301.CrossRef
18.
go back to reference Collins GS, de Groot JA, Dutton S, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014;14:40.CrossRef Collins GS, de Groot JA, Dutton S, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014;14:40.CrossRef
20.
go back to reference Canadian Institute for Health Information. Data Quality Documentation, Home Care Reporting System - 2012-2013. Ottawa: Canadian Institute for Health Information; 2014. Canadian Institute for Health Information. Data Quality Documentation, Home Care Reporting System - 2012-2013. Ottawa: Canadian Institute for Health Information; 2014.
21.
go back to reference Canadian Institute for Health Information. Data Quality Documentation, National Ambulatory Care Reporting System - Current-Year Information, 2014-2015. Ottawa: Canadian Institute for Health Information; 2015. Canadian Institute for Health Information. Data Quality Documentation, National Ambulatory Care Reporting System - Current-Year Information, 2014-2015. Ottawa: Canadian Institute for Health Information; 2015.
22.
go back to reference Hirdes JP, Ljunggren G, Morris JN, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.CrossRef Hirdes JP, Ljunggren G, Morris JN, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.CrossRef
23.
go back to reference Landi F, Tua E, Onder G, et al. Minimum data set for home care: a valid instrument to assess frail older people living in the community. Med Care. 2000;38:1184–90.CrossRef Landi F, Tua E, Onder G, et al. Minimum data set for home care: a valid instrument to assess frail older people living in the community. Med Care. 2000;38:1184–90.CrossRef
24.
go back to reference Crane SJ, Tung EE, Hanson GJ, et al. Use of an electronic administrative database to identify older community dwelling adults at high-risk for hospitalization or emergency department visits: the elders risk assessment index. BMC Health Serv Res. 2010;10:338.CrossRef Crane SJ, Tung EE, Hanson GJ, et al. Use of an electronic administrative database to identify older community dwelling adults at high-risk for hospitalization or emergency department visits: the elders risk assessment index. BMC Health Serv Res. 2010;10:338.CrossRef
25.
go back to reference Boult C, Dowd B, McCaffrey D, et al. Screening elders for risk of hospital admission. J Am Geriatr Soc. 1993;41:811–7.CrossRef Boult C, Dowd B, McCaffrey D, et al. Screening elders for risk of hospital admission. J Am Geriatr Soc. 1993;41:811–7.CrossRef
26.
go back to reference Shelton P, Sager MA, Schraeder C. The community assessment risk screen (CARS): identifying elderly persons at risk for hospitalization or emergency department visit. Am J Manag Care. 2000;6:925–33.PubMed Shelton P, Sager MA, Schraeder C. The community assessment risk screen (CARS): identifying elderly persons at risk for hospitalization or emergency department visit. Am J Manag Care. 2000;6:925–33.PubMed
27.
go back to reference Jones A, Costa AP, Pesevski A, McNicholas PD. Predicting hospital and emergency department utilization among community-dwelling older adults. PLoS One. 2018;13(11):e0206662.CrossRef Jones A, Costa AP, Pesevski A, McNicholas PD. Predicting hospital and emergency department utilization among community-dwelling older adults. PLoS One. 2018;13(11):e0206662.CrossRef
28.
go back to reference Turcotte M. Canadians with unmet home care needs. Ottawa: Statistics Canada; 2014. ISSN 2291-0859. Turcotte M. Canadians with unmet home care needs. Ottawa: Statistics Canada; 2014. ISSN 2291-0859.
29.
go back to reference Schumacher C, Lackey C, Haughton D, et al. A chronic disease management model for home care patients with cardio-respiratory symptoms: the DIVERT-CARE intervention. Can J Cardiovas Nus. 2018;28:18–26. Schumacher C, Lackey C, Haughton D, et al. A chronic disease management model for home care patients with cardio-respiratory symptoms: the DIVERT-CARE intervention. Can J Cardiovas Nus. 2018;28:18–26.
30.
go back to reference Kuziemsky C. Decision-making in healthcare as a complex adaptive system. Healthc Manage Forum. 2016;29(1):4–7.CrossRef Kuziemsky C. Decision-making in healthcare as a complex adaptive system. Healthc Manage Forum. 2016;29(1):4–7.CrossRef
31.
go back to reference Lindstrom RR. Evidence-based decision-making in healthcare: exploring the issues throught the lens of complex, adaptive systems theory. Helathc Pap. 2003;3(3):29–35.CrossRef Lindstrom RR. Evidence-based decision-making in healthcare: exploring the issues throught the lens of complex, adaptive systems theory. Helathc Pap. 2003;3(3):29–35.CrossRef
32.
go back to reference Martin T, Hofman JM, Sharma A, AndersonA WDJ. Exploring limits to prediction in complex social systems. In: Proceedings of the 25th International Conference on World Wide Web; 2016. p. 683–94.CrossRef Martin T, Hofman JM, Sharma A, AndersonA WDJ. Exploring limits to prediction in complex social systems. In: Proceedings of the 25th International Conference on World Wide Web; 2016. p. 683–94.CrossRef
33.
go back to reference Buurman BM, van den Berg W, Korevaar JC, et al. Risk for poor outcomes in older patients discharged from an emergency department: feasibility of four screening instruments. Eur J Emerg Med. 2011;18:215–20.CrossRef Buurman BM, van den Berg W, Korevaar JC, et al. Risk for poor outcomes in older patients discharged from an emergency department: feasibility of four screening instruments. Eur J Emerg Med. 2011;18:215–20.CrossRef
Metadata
Title
External validation of the detection of indicators and vulnerabilities for emergency room trips (DIVERT) scale: a retrospective cohort study
Authors
Fabrice I. Mowbray
Aaron Jones
Connie Schumacher
John Hirdes
Andrew P. Costa
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Care
Published in
BMC Geriatrics / Issue 1/2020
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-020-01816-0

Other articles of this Issue 1/2020

BMC Geriatrics 1/2020 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.