Skip to main content
Top
Published in: Journal of General Internal Medicine 4/2015

01-04-2015 | Original Research

Predicting and Communicating Risk of Clinical Deterioration: An Observational Cohort Study of Internal Medicine Residents

Authors: John T. Ratelle, M.D., Diana J. Kelm, M.D., Andrew J. Halvorsen, M.S., Colin P. West, M.D. Ph.D., Amy S. Oxentenko, M.D.

Published in: Journal of General Internal Medicine | Issue 4/2015

Login to get access

Abstract

Background

Despite its importance, little is known about internal medicine (IM) residents’ ability to assess and communicate a patient’s overnight risk during the resident-to-resident handoff.

Objective

To evaluate IM residents’ ability to identify patients at risk for clinical deterioration using the Patient Acuity Rating (PAR) tool (scored on a 1–7 symmetric scale; 1=“Extremely unlikely”, 7=“Extremely likely”), and to measure how well IM residents conveyed a patient’s potential for clinical deterioration during day-to-night handoff.

Design and Participants

Observational cohort study of 46 postgraduate year 1 (PGY-1) and 32 postgraduate year 3 (PGY-3) internal medicine residents rotating on one of four general medicine services from October 2013 through January 2014.

Main Measures

Primary outcomes were (1) level of agreement between resident handoff giver and receiver regarding patients’ clinical risk and (2) accuracy of resident-assigned PAR score in predicting a patient’s risk of clinical deterioration over the subsequent 24 hours.

Key Results

Analysis of PGY-1 giver–receiver handoff agreement revealed an intraclass correlation coefficient (ICC) (95 % CI) of 0.51 (0.45–0.56), while PGY-3 giver–receiver agreement yielded an ICC (95 % CI) of 0.42 (0.36–0.47). Based on 865 ratings of 378 patients, PGY-1 handoff giver PAR scores of 5 and 6+ were significantly associated with increased odds of clinical deterioration within 24 hours (aOR = 6.5 and 12.4; P = 0.03 and 0.005, respectively). For the 1,170 PAR ratings of 438 patients assigned by PGY-3 handoff givers, PAR scores of 4, 5, and 6+ were significantly associated with increased odds of an event within 24 hours (aORs = 6.0, 9.6, and 18.1; P = 0.03, 0.01, and 0.0008, respectively).

Conclusions

The PAR is a useful tool to quantify IM residents’ judgment of patient stability, and may be particularly valuable during resident handoff, given that the level of agreement between giver and receiver regarding patient risk is only fair.
Literature
1.
go back to reference Desai SV, Feldman L, Brown L, et al. Effect of the 2011 vs 2003 duty hour regulation-compliant models on sleep duration, trainee education, and continuity of patient care among internal medicine house staff: a randomized trial. JAMA Intern Med. 2013;173:649–55.CrossRefPubMed Desai SV, Feldman L, Brown L, et al. Effect of the 2011 vs 2003 duty hour regulation-compliant models on sleep duration, trainee education, and continuity of patient care among internal medicine house staff: a randomized trial. JAMA Intern Med. 2013;173:649–55.CrossRefPubMed
3.
go back to reference Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168:1755–60.CrossRefPubMed Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168:1755–60.CrossRefPubMed
4.
go back to reference Fletcher KE, Parekh V, Halasyamani L, et al. Work hour rules and contributors to patient care mistakes: a focus group study with internal medicine residents. J Hosp Med. 2008;3:228–37.CrossRefPubMed Fletcher KE, Parekh V, Halasyamani L, et al. Work hour rules and contributors to patient care mistakes: a focus group study with internal medicine residents. J Hosp Med. 2008;3:228–37.CrossRefPubMed
5.
go back to reference Arora V, Johnson J, Lovinger D, Humphrey HJ, Meltzer DO. Communication failures in patient sign-out and suggestions for improvement: a critical incident analysis. Qual Saf Health Care. 2005;14:401.CrossRefPubMedCentralPubMed Arora V, Johnson J, Lovinger D, Humphrey HJ, Meltzer DO. Communication failures in patient sign-out and suggestions for improvement: a critical incident analysis. Qual Saf Health Care. 2005;14:401.CrossRefPubMedCentralPubMed
6.
go back to reference Wohlauer MV, Arora VM, Horwitz LI, Bass EJ, Mahar SE, Philibert I. The patient handoff: a comprehensive curricular blueprint for resident education to improve continuity of care. Acad Med. 2012;87:411–8.CrossRefPubMedCentralPubMed Wohlauer MV, Arora VM, Horwitz LI, Bass EJ, Mahar SE, Philibert I. The patient handoff: a comprehensive curricular blueprint for resident education to improve continuity of care. Acad Med. 2012;87:411–8.CrossRefPubMedCentralPubMed
7.
go back to reference Cohen MD, Hilligoss PB. The published literature on handoffs in hospitals: deficiencies identified in an extensive review. Qual Saf Health Care. 2010;19:493–7.PubMed Cohen MD, Hilligoss PB. The published literature on handoffs in hospitals: deficiencies identified in an extensive review. Qual Saf Health Care. 2010;19:493–7.PubMed
8.
go back to reference Vidyarthi AR, Arora V, Schnipper JL, Wall SD, Wachter RM. Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign-out. J Hosp Med. 2006;1:257–66.CrossRefPubMed Vidyarthi AR, Arora V, Schnipper JL, Wall SD, Wachter RM. Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign-out. J Hosp Med. 2006;1:257–66.CrossRefPubMed
9.
go back to reference Wiese J. Teaching in the Hospital. Philadelphia: ACP Press; 2010. Wiese J. Teaching in the Hospital. Philadelphia: ACP Press; 2010.
10.
go back to reference Rothman MJ, Rothman SI, Beals J 4th. Development and validation of a continuous measure of patient condition using the Electronic Medical Record. J Biomed Inform. 2013;46:837–48.CrossRefPubMed Rothman MJ, Rothman SI, Beals J 4th. Development and validation of a continuous measure of patient condition using the Electronic Medical Record. J Biomed Inform. 2013;46:837–48.CrossRefPubMed
11.
go back to reference Kirkland LL, Malinchoc M, O'Byrne M, et al. A clinical deterioration prediction tool for internal medicine patients. Am J Med Qual. 2013;28:135–42.CrossRefPubMed Kirkland LL, Malinchoc M, O'Byrne M, et al. A clinical deterioration prediction tool for internal medicine patients. Am J Med Qual. 2013;28:135–42.CrossRefPubMed
12.
go back to reference Edelson DP, Retzer E, Weidman EK, et al. Patient acuity rating: quantifying clinical judgment regarding inpatient stability. J Hosp Med. 2011;6:475–9.CrossRefPubMedCentralPubMed Edelson DP, Retzer E, Weidman EK, et al. Patient acuity rating: quantifying clinical judgment regarding inpatient stability. J Hosp Med. 2011;6:475–9.CrossRefPubMedCentralPubMed
13.
go back to reference Phillips AW, Yuen TC, Retzer E, Woodruff J, Arora V, Edelson DP. Supplementing cross-cover communication with the patient acuity rating. J Gen Intern Med. 2013;28:406–11.CrossRefPubMedCentralPubMed Phillips AW, Yuen TC, Retzer E, Woodruff J, Arora V, Edelson DP. Supplementing cross-cover communication with the patient acuity rating. J Gen Intern Med. 2013;28:406–11.CrossRefPubMedCentralPubMed
14.
15.
go back to reference Ong M, Bostrom A, Vidyarthi A, McCulloch C, Auerbach A. House staff team workload and organization effects on patient outcomes in an academic general internal medicine inpatient service. Arch Intern Med. 2007;167:47–52.CrossRefPubMed Ong M, Bostrom A, Vidyarthi A, McCulloch C, Auerbach A. House staff team workload and organization effects on patient outcomes in an academic general internal medicine inpatient service. Arch Intern Med. 2007;167:47–52.CrossRefPubMed
16.
go back to reference Averbukh Y, Southern W. The impact of the number of admissions to the inpatient medical teaching team on patient safety outcomes. J Grad Med Educ. 2012;4:307–11.CrossRefPubMedCentralPubMed Averbukh Y, Southern W. The impact of the number of admissions to the inpatient medical teaching team on patient safety outcomes. J Grad Med Educ. 2012;4:307–11.CrossRefPubMedCentralPubMed
17.
go back to reference Thanarajasingam U, McDonald FS, Halvorsen AJ, et al. Service census caps and unit-based admissions: resident workload, conference attendance, duty hour compliance, and patient safety. Mayo Clin Proc. 2012;87:320–7.CrossRefPubMedCentralPubMed Thanarajasingam U, McDonald FS, Halvorsen AJ, et al. Service census caps and unit-based admissions: resident workload, conference attendance, duty hour compliance, and patient safety. Mayo Clin Proc. 2012;87:320–7.CrossRefPubMedCentralPubMed
18.
go back to reference Greenstein EA, Arora VM, Staisiunas PG, Banerjee SS, Farnan JM. Characterising physician listening behaviour during hospitalist handoffs using the HEAR checklist. BMJ Qual Saf. 2013;22:203–9.CrossRefPubMed Greenstein EA, Arora VM, Staisiunas PG, Banerjee SS, Farnan JM. Characterising physician listening behaviour during hospitalist handoffs using the HEAR checklist. BMJ Qual Saf. 2013;22:203–9.CrossRefPubMed
19.
go back to reference McQuillan A, Carthey J, Catchpole K, McCulloch P, Ridout DA, Goldman AP. Creating a safe, reliable hospital at night handover: a case study in implementation science. BMJ Qual Saf. 2013. McQuillan A, Carthey J, Catchpole K, McCulloch P, Ridout DA, Goldman AP. Creating a safe, reliable hospital at night handover: a case study in implementation science. BMJ Qual Saf. 2013.
Metadata
Title
Predicting and Communicating Risk of Clinical Deterioration: An Observational Cohort Study of Internal Medicine Residents
Authors
John T. Ratelle, M.D.
Diana J. Kelm, M.D.
Andrew J. Halvorsen, M.S.
Colin P. West, M.D. Ph.D.
Amy S. Oxentenko, M.D.
Publication date
01-04-2015
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 4/2015
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-014-3114-4

Other articles of this Issue 4/2015

Journal of General Internal Medicine 4/2015 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.