Skip to main content
Top
Published in: Neurocritical Care 1/2022

26-04-2022 | Care | Original work

Prognosis Predictions by Families, Physicians, and Nurses of Patients with Severe Acute Brain Injury: Agreement and Accuracy

Authors: Whitney A. Kiker, Rachel Rutz Voumard, Wesley Plinke, W. T. Longstreth Jr., J. Randall Curtis, Claire J. Creutzfeldt

Published in: Neurocritical Care | Issue 1/2022

Login to get access

Abstract

Background

Effective shared decision-making relies on some degree of alignment between families and the medical team regarding a patient’s likelihood of recovery. Patients with severe acute brain injury (SABI) are often unable to participate in decisions, and therefore family members make decisions on their behalf. The goal of this study was to evaluate agreement between prognostic predictions by families, physicians, and nurses of patients with SABI regarding their likelihood of regaining independence and to measure each group’s prediction accuracy.

Methods

This observational cohort study, conducted from 01/2018 to 07/2020, was based in the neuroscience and medical/cardiac intensive care units of a single center. Patient eligibility included a diagnosis of SABI—specifically stroke, traumatic brain injury, or hypoxic ischemic encephalopathy—and a Glasgow Coma Scale ≤ 12 after hospital day 2. At enrollment, families, physicians, and nurses were asked separately to predict a patient’s likelihood of recovering to independence within 6 months on a 0–100 scale, regardless of whether a formal family meeting had occurred. True outcome was based on modified Rankin Scale assessment through a family report or medical chart review. Prognostic agreement was measured by (1) intraclass correlation coefficient; (2) mean group prediction comparisons using paired Student’s t-tests; and (3) prevalence of concordance, defined as an absolute difference of less than 20 percentage points between predictions. Accuracy for each group was measured by calculating the area under a receiver operating characteristic curve (C statistic) and compared by using DeLong’s test.

Results

Data were collected from 222 patients and families, 45 physicians, and 103 nurses. Complete data on agreement and accuracy were available for 187 and 177 patients, respectively. The intraclass correlation coefficient, in which 1 indicates perfect correlation and 0 indicates no correlation, was 0.49 for physician-family pairs, 0.40 for family-nurse pairs, and 0.66 for physician-nurse pairs. The difference in mean predictions between families and physicians was 23.5 percentage points (p < 0.001), 25.4 between families and nurses (p < 0.001), and 1.9 between physicians and nurses (p = 0.38). Prevalence of concordance was 39.6% for family-physician pairs, 30.0% for family-nurse pairs, and 56.2% for physician-nurse pairs. The C statistic for prediction accuracy was 0.65 for families, 0.82 for physicians, and 0.76 for nurses. The p values for differences in C statistics were < 0.05 for family-physician and family-nurse groups and 0.18 for physician-nurse groups.

Conclusions

For patients with SABI, agreement in predictions between families, physicians, and nurses regarding likelihood of recovery is poor. Accuracy appears higher for physicians and nurses compared with families, with no significant difference between physicians and nurses.
Appendix
Available only for authorised users
Literature
1.
go back to reference Adelman EE, Zahuranec DB. Surrogate decision making in neurocritical care. Continuum (Minneap Minn). 2012;18(3):655–8.PubMed Adelman EE, Zahuranec DB. Surrogate decision making in neurocritical care. Continuum (Minneap Minn). 2012;18(3):655–8.PubMed
3.
go back to reference Boyd EA, Lo B, Evans LR, Malvar G, Apatira L, Luce JM, et al. “It’s not just what the doctor tells me:” factors that influence surrogate decision-makers’ perceptions of prognosis. Crit Care Med. 2010;38(5):1270–5.CrossRefPubMedPubMedCentral Boyd EA, Lo B, Evans LR, Malvar G, Apatira L, Luce JM, et al. “It’s not just what the doctor tells me:” factors that influence surrogate decision-makers’ perceptions of prognosis. Crit Care Med. 2010;38(5):1270–5.CrossRefPubMedPubMedCentral
4.
go back to reference Ford D, Zapka J, Gebregziabher M, Yang C, Sterba K. Factors associated with illness perception among critically ill patients and surrogates. Chest. 2010;138(1):59–67.CrossRefPubMed Ford D, Zapka J, Gebregziabher M, Yang C, Sterba K. Factors associated with illness perception among critically ill patients and surrogates. Chest. 2010;138(1):59–67.CrossRefPubMed
5.
go back to reference Newman AR. Nurses’ perceptions of diagnosis and prognosis-related communication: an integrative review. Cancer Nurs. 2016;39(5):E48-60.CrossRefPubMed Newman AR. Nurses’ perceptions of diagnosis and prognosis-related communication: an integrative review. Cancer Nurs. 2016;39(5):E48-60.CrossRefPubMed
7.
go back to reference Butler R, Monsalve M, Thomas GW, Herman T, Segre AM, Polgreen PM, et al. Estimating time physicians and other health care workers spend with patients in an intensive care unit using a sensor network. Am J Med. 2018;131(8):972.e9-972.e15.CrossRefPubMed Butler R, Monsalve M, Thomas GW, Herman T, Segre AM, Polgreen PM, et al. Estimating time physicians and other health care workers spend with patients in an intensive care unit using a sensor network. Am J Med. 2018;131(8):972.e9-972.e15.CrossRefPubMed
8.
go back to reference Creutzfeldt CJ, Longstreth WT, Holloway RG. Predicting decline and survival in severe acute brain injury: the fourth trajectory. BMJ. 2015;351:h3904.CrossRefPubMed Creutzfeldt CJ, Longstreth WT, Holloway RG. Predicting decline and survival in severe acute brain injury: the fourth trajectory. BMJ. 2015;351:h3904.CrossRefPubMed
9.
go back to reference White DB, Ernecoff N, Buddadhumaruk P, Hong S, Weissfeld L, Curtis JR, et al. Prevalence of and factors related to discordance about prognosis between physicians and surrogate decision makers of critically ill patients. JAMA. 2016;315(19):2086–94.CrossRefPubMed White DB, Ernecoff N, Buddadhumaruk P, Hong S, Weissfeld L, Curtis JR, et al. Prevalence of and factors related to discordance about prognosis between physicians and surrogate decision makers of critically ill patients. JAMA. 2016;315(19):2086–94.CrossRefPubMed
10.
go back to reference Frick S, Uehlinger DE, Zuercher Zenklusen RM. Medical futility: predicting outcome of intensive care unit patients by nurses and doctors—a prospective comparative study. Crit Care Med. 2003;31(2):456–61.CrossRefPubMed Frick S, Uehlinger DE, Zuercher Zenklusen RM. Medical futility: predicting outcome of intensive care unit patients by nurses and doctors—a prospective comparative study. Crit Care Med. 2003;31(2):456–61.CrossRefPubMed
11.
go back to reference Detsky ME, Harhay MO, Bayard DF, et al. Discriminative accuracy of physician and nurse predictions for survival and functional outcomes 6 months after an ICU admission. JAMA. 2017;317(21):2187–95.CrossRefPubMedPubMedCentral Detsky ME, Harhay MO, Bayard DF, et al. Discriminative accuracy of physician and nurse predictions for survival and functional outcomes 6 months after an ICU admission. JAMA. 2017;317(21):2187–95.CrossRefPubMedPubMedCentral
12.
go back to reference Hwang DY, Dell CA, Sparks MJ, et al. Clinician judgment vs formal scales for predicting intracerebral hemorrhage outcomes. Neurology. 2016;86(2):126–33.CrossRefPubMedPubMedCentral Hwang DY, Dell CA, Sparks MJ, et al. Clinician judgment vs formal scales for predicting intracerebral hemorrhage outcomes. Neurology. 2016;86(2):126–33.CrossRefPubMedPubMedCentral
13.
go back to reference Kiker WA, Rutz Voumard R, Andrews LIB, Holloway RG, Brumback LC, Engelberg RA, et al. Assessment of discordance between physicians and family members regarding prognosis in patients with severe acute brain injury. JAMA Netw Open. 2021;4(10):e2128991.CrossRefPubMedPubMedCentral Kiker WA, Rutz Voumard R, Andrews LIB, Holloway RG, Brumback LC, Engelberg RA, et al. Assessment of discordance between physicians and family members regarding prognosis in patients with severe acute brain injury. JAMA Netw Open. 2021;4(10):e2128991.CrossRefPubMedPubMedCentral
14.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRefPubMed Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRefPubMed
15.
go back to reference Mirr MP. Decisions made by family members of patients with severe head injury. AACN Clin Issues Crit Care Nurs. 1991;2(2):242–51.CrossRefPubMed Mirr MP. Decisions made by family members of patients with severe head injury. AACN Clin Issues Crit Care Nurs. 1991;2(2):242–51.CrossRefPubMed
16.
go back to reference Qureshi AI, Palesch YY, Barsan WG, et al. Intensive blood-pressure lowering in patients with acute cerebral hemorrhage. N Engl J Med. 2016;375(11):1033–43.CrossRefPubMedPubMedCentral Qureshi AI, Palesch YY, Barsan WG, et al. Intensive blood-pressure lowering in patients with acute cerebral hemorrhage. N Engl J Med. 2016;375(11):1033–43.CrossRefPubMedPubMedCentral
17.
go back to reference Hofmeijer J, Kappelle LJ, Algra A, et al. Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy After Middle Cerebral Artery infarction with Life-threatening Edema Trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 2009;8(4):326–33.CrossRefPubMed Hofmeijer J, Kappelle LJ, Algra A, et al. Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy After Middle Cerebral Artery infarction with Life-threatening Edema Trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 2009;8(4):326–33.CrossRefPubMed
18.
go back to reference Liu J, Tang W, Chen G, Lu Y, Feng C, Tu XM. Correlation and agreement: overview and clarification of competing concepts and measures. Shanghai Arch Psychiatry. 2016;28(2):115–20.PubMedPubMedCentral Liu J, Tang W, Chen G, Lu Y, Feng C, Tu XM. Correlation and agreement: overview and clarification of competing concepts and measures. Shanghai Arch Psychiatry. 2016;28(2):115–20.PubMedPubMedCentral
19.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed
20.
go back to reference Guo B, Yuan Y. A comparative review of methods for comparing means using partially paired data. Stat Methods Med Res. 2017;26(3):1323–40.CrossRefPubMed Guo B, Yuan Y. A comparative review of methods for comparing means using partially paired data. Stat Methods Med Res. 2017;26(3):1323–40.CrossRefPubMed
21.
go back to reference Lloyd CB, Nietert PJ, Silvestri GA. Intensive care decision making in the seriously ill and elderly. Crit Care Med. 2004;32:649–54.CrossRefPubMed Lloyd CB, Nietert PJ, Silvestri GA. Intensive care decision making in the seriously ill and elderly. Crit Care Med. 2004;32:649–54.CrossRefPubMed
22.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36.CrossRefPubMed
23.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.CrossRefPubMed DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.CrossRefPubMed
24.
go back to reference Lang F, Quill T. Making decisions with families at the end of life. Am Fam Physician. 2004;70(4):719–23.PubMed Lang F, Quill T. Making decisions with families at the end of life. Am Fam Physician. 2004;70(4):719–23.PubMed
26.
go back to reference Pratt AK, Chang JJ, Sederstrom NO. A fate worse than death: prognostication of devastating brain injury. Crit Care Med. 2019;47(4):591–8.CrossRefPubMed Pratt AK, Chang JJ, Sederstrom NO. A fate worse than death: prognostication of devastating brain injury. Crit Care Med. 2019;47(4):591–8.CrossRefPubMed
27.
go back to reference Palstam A, Sjödin A, Sunnerhagen KS. Participation and autonomy five years after stroke: a longitudinal observational study. PLoS One. 2019;4(7):e0219513.CrossRef Palstam A, Sjödin A, Sunnerhagen KS. Participation and autonomy five years after stroke: a longitudinal observational study. PLoS One. 2019;4(7):e0219513.CrossRef
28.
go back to reference Pallesen H, Aadal L, Moe S, Arntzen C. Gateway to recovery: a comparative analysis of stroke patients’ experiences of change and learning in Norway and Denmark. Rehabil Res Pract. 2019;2019:1726964.PubMedPubMedCentral Pallesen H, Aadal L, Moe S, Arntzen C. Gateway to recovery: a comparative analysis of stroke patients’ experiences of change and learning in Norway and Denmark. Rehabil Res Pract. 2019;2019:1726964.PubMedPubMedCentral
29.
go back to reference You JJ, Downar J, Fowler RA, et al. Barriers to goals of care discussions with seriously ill hospitalized patients and their families: a multicenter survey of clinicians [published correction appears in JAMA Intern Med. 2015;175(4):659]. JAMA Intern Med. 2015;175(4):549–56. You JJ, Downar J, Fowler RA, et al. Barriers to goals of care discussions with seriously ill hospitalized patients and their families: a multicenter survey of clinicians [published correction appears in JAMA Intern Med. 2015;175(4):659]. JAMA Intern Med. 2015;175(4):549–56.
30.
go back to reference Wilson ME, Dobler CC, Zubek L, et al. Prevalence of disagreement about appropriateness of treatment between ICU patients/surrogates and clinicians. Chest. 2019;155(6):1140–7.CrossRefPubMed Wilson ME, Dobler CC, Zubek L, et al. Prevalence of disagreement about appropriateness of treatment between ICU patients/surrogates and clinicians. Chest. 2019;155(6):1140–7.CrossRefPubMed
31.
go back to reference Schutz RE, Coats HL, Engelberg RA, Curtis JR, Creutzfeldt CJ. Is there hope? Is she there? How families and clinicians experience severe acute brain injury. J Palliat Med. 2017;20(2):170–6.CrossRefPubMed Schutz RE, Coats HL, Engelberg RA, Curtis JR, Creutzfeldt CJ. Is there hope? Is she there? How families and clinicians experience severe acute brain injury. J Palliat Med. 2017;20(2):170–6.CrossRefPubMed
32.
go back to reference Clayton JM, Hancock K, Parker S, et al. Sustaining hope when communicating with terminally ill patients and their families: a systematic review. Psychooncology. 2008;17(7):641–59.CrossRefPubMed Clayton JM, Hancock K, Parker S, et al. Sustaining hope when communicating with terminally ill patients and their families: a systematic review. Psychooncology. 2008;17(7):641–59.CrossRefPubMed
33.
go back to reference Becker KJ, Baxter AB, Cohen WA, et al. Withdrawal of support in intracerebral hemorrhage may lead to self-fulfilling prophecies. Neurology. 2001;56(6):766–72.CrossRefPubMed Becker KJ, Baxter AB, Cohen WA, et al. Withdrawal of support in intracerebral hemorrhage may lead to self-fulfilling prophecies. Neurology. 2001;56(6):766–72.CrossRefPubMed
34.
go back to reference Creutzfeldt CJ, Becker KJ, Weinstein JR, et al. Do-not-attempt-resuscitation orders and prognostic models for intraparenchymal hemorrhage. Crit Care Med. 2011;39(1):158–62.CrossRefPubMedPubMedCentral Creutzfeldt CJ, Becker KJ, Weinstein JR, et al. Do-not-attempt-resuscitation orders and prognostic models for intraparenchymal hemorrhage. Crit Care Med. 2011;39(1):158–62.CrossRefPubMedPubMedCentral
35.
go back to reference Izzy S, Compton R, Carandang R, Hall W, Muehlschlegel S. Self-fulfilling prophecies through withdrawal of care: do they exist in traumatic brain injury, too? Neurocrit Care. 2013;19(3):347–63.CrossRefPubMed Izzy S, Compton R, Carandang R, Hall W, Muehlschlegel S. Self-fulfilling prophecies through withdrawal of care: do they exist in traumatic brain injury, too? Neurocrit Care. 2013;19(3):347–63.CrossRefPubMed
Metadata
Title
Prognosis Predictions by Families, Physicians, and Nurses of Patients with Severe Acute Brain Injury: Agreement and Accuracy
Authors
Whitney A. Kiker
Rachel Rutz Voumard
Wesley Plinke
W. T. Longstreth Jr.
J. Randall Curtis
Claire J. Creutzfeldt
Publication date
26-04-2022
Publisher
Springer US
Keyword
Care
Published in
Neurocritical Care / Issue 1/2022
Print ISSN: 1541-6933
Electronic ISSN: 1556-0961
DOI
https://doi.org/10.1007/s12028-022-01501-7

Other articles of this Issue 1/2022

Neurocritical Care 1/2022 Go to the issue