Skip to main content
Top
Published in: BMC Palliative Care 1/2019

Open Access 01-12-2019 | Care | Study protocol

An online international comparison of thresholds for triggering a negative response to the “Surprise Question”: a study protocol

Authors: Nicola White, Linda Oostendorp, Victoria Vickerstaff, Christina Gerlach, Yvonne Engels, Maud Maessen, Christopher Tomlinson, Johan Wens, Bert Leysen, Guido Biasco, Sofia Zambrano, Steffen Eychmüller, Christina Avgerinou, Rabih Chattat, Giovanni Ottoboni, Carel Veldhoven, Patrick Stone

Published in: BMC Palliative Care | Issue 1/2019

Login to get access

Abstract

Background

The Surprise Question (SQ) “would I be surprised if this patient were to die in the next 12 months?” has been suggested to help clinicians, and especially General Practitioners (GPs), identify people who might benefit from palliative care. The prognostic accuracy of this approach is unclear and little is known about how GPs use this tool in practice. Are GPs consistent, individually and as a group? Are there international differences in the use of the tool? Does including the alternative Surprise Question (“Would I be surprised if the patient were still alive after 12 months?”) alter the response? What is the impact on the treatment plan in response to the SQ? This study aims to address these questions.

Methods

An online study will be completed by 600 (100 per country) registered GPs. They will be asked to review 20 hypothetical patient vignettes. For each vignette they will be asked to provide a response to the following four questions: (1) the SQ [Yes/No]; (2) the alternative SQ [Yes/No]; (3) the percentage probability of dying [0% no chance – 100% certain death]; and (4) the proposed treatment plan [multiple choice]. A “surprise threshold” for each participant will be calculated by comparing the responses to the SQ with the probability estimates of death. We will use linear regression to explore any differences in thresholds between countries and other clinician-related factors, such as years of experience. We will describe the actions taken by the clinicians and explore the differences between groups. We will also investigate the relationship between the alternative SQ and the other responses. Participants will receive a certificate of completion and the option to receive feedback on their performance.

Discussion

This study explores the extent to which the SQ is consistently used at an individual, group, and national level. The findings of this study will help to understand the clinical value of using the SQ in routine practice.

Trial registration

Clinicaltrials.gov NCT03697213 (05/10/2018). Prospectively registered.
Appendix
Available only for authorised users
Literature
1.
go back to reference Glare P, Virik K, Jones M, Hudson M, Eychmuller S, Simes J, Christakis N. A systematic review ofphysicians' survival predictions in terminally ill cancer patients. BMJ. 2003;327:195. Glare P, Virik K, Jones M, Hudson M, Eychmuller S, Simes J, Christakis N. A systematic review ofphysicians' survival predictions in terminally ill cancer patients. BMJ. 2003;327:195.
2.
go back to reference Glare PA, Sinclair CT. Palliative medicine review: prognostication. J Palliat Med. 2008;11(1):84–103.CrossRef Glare PA, Sinclair CT. Palliative medicine review: prognostication. J Palliat Med. 2008;11(1):84–103.CrossRef
3.
go back to reference Maltoni M, Caraceni A, Brunelli C, Broeckaert B, Christakis N, Eychmueller S, Glare P, Nabal M, Viganò A, Larkin P, et al. Prognostic factors in advanced Cancer patients: evidence-based clinical recommendations—a study by the steering Committee of the European Association for palliative care. J Clin Oncol. 2005;23(25):6240–8.CrossRef Maltoni M, Caraceni A, Brunelli C, Broeckaert B, Christakis N, Eychmueller S, Glare P, Nabal M, Viganò A, Larkin P, et al. Prognostic factors in advanced Cancer patients: evidence-based clinical recommendations—a study by the steering Committee of the European Association for palliative care. J Clin Oncol. 2005;23(25):6240–8.CrossRef
4.
go back to reference White N, Reid F, Harris A, Harries P, Stone P. A systematic review of predictions of survival in palliative care: how accurate are clinicians and who are the experts? PLoS One. 2016;11(8):e0161407.CrossRef White N, Reid F, Harris A, Harries P, Stone P. A systematic review of predictions of survival in palliative care: how accurate are clinicians and who are the experts? PLoS One. 2016;11(8):e0161407.CrossRef
5.
go back to reference Zhou M, Holden L, Lao N, Lam H, Zeng L, Chow E. Accuracy of clinicians’ prediction of survival and prognostic factors indicative of survival: a systematic review. Hong Kong Journal of Radiology. 2013;16(3):168–82.CrossRef Zhou M, Holden L, Lao N, Lam H, Zeng L, Chow E. Accuracy of clinicians’ prediction of survival and prognostic factors indicative of survival: a systematic review. Hong Kong Journal of Radiology. 2013;16(3):168–82.CrossRef
6.
go back to reference Gibbins J, McCoubrie R, Maher J, Wee B, Forbes K. Recognizing that it is part and parcel of what they do: teaching palliative care to medical students in the UK. Palliat Med. 2010;24(3):299–305.CrossRef Gibbins J, McCoubrie R, Maher J, Wee B, Forbes K. Recognizing that it is part and parcel of what they do: teaching palliative care to medical students in the UK. Palliat Med. 2010;24(3):299–305.CrossRef
7.
go back to reference Henson L, Gao W, Higginson I, Smith M, Davies J, Ellis-Smith C, Daveson B. Emergency department attendance by patients with cancer in the last month of life: a systematic review and meta-analysis. Lancet. 2015;385:S41.CrossRef Henson L, Gao W, Higginson I, Smith M, Davies J, Ellis-Smith C, Daveson B. Emergency department attendance by patients with cancer in the last month of life: a systematic review and meta-analysis. Lancet. 2015;385:S41.CrossRef
8.
go back to reference Seow H, Brazil K, Sussman J, Pereira J, Marshall D, Austin PC, Husain A, Rangrej J, Barbera L. Impact of community based, specialist palliative care teams on hospitalisations and emergency department visits late in life and hospital deaths: a pooled analysis. BMJ. 2014;348:3496. Seow H, Brazil K, Sussman J, Pereira J, Marshall D, Austin PC, Husain A, Rangrej J, Barbera L. Impact of community based, specialist palliative care teams on hospitalisations and emergency department visits late in life and hospital deaths: a pooled analysis. BMJ. 2014;348:3496.
9.
go back to reference El-Jawahri A, Greer JA, Temel JS. Does palliative care improve outcomes for patients with incurable illness? A review of the evidence. J Support Oncol. 2011;9(3):87–94.CrossRef El-Jawahri A, Greer JA, Temel JS. Does palliative care improve outcomes for patients with incurable illness? A review of the evidence. J Support Oncol. 2011;9(3):87–94.CrossRef
10.
go back to reference Higginson IJ, Evans CJ. What is the evidence that palliative care teams improve outcomes for Cancer patients and their families? The Cancer Journal. 2010;16(5):423–35.CrossRef Higginson IJ, Evans CJ. What is the evidence that palliative care teams improve outcomes for Cancer patients and their families? The Cancer Journal. 2010;16(5):423–35.CrossRef
11.
go back to reference Higginson IJ, Finlay IG, Goodwin DM, Hood K, Edwards AGK, Cook A, Douglas H-R, Normand CE. Is there evidence that palliative care teams Alter end-of-life experiences of patients and their caregivers? J Pain Symptom Manag. 2003;25(2):150–68.CrossRef Higginson IJ, Finlay IG, Goodwin DM, Hood K, Edwards AGK, Cook A, Douglas H-R, Normand CE. Is there evidence that palliative care teams Alter end-of-life experiences of patients and their caregivers? J Pain Symptom Manag. 2003;25(2):150–68.CrossRef
12.
go back to reference Hately J, Laurence V, Scott A, Baker R, Thomas P. Breathlessness clinics within specialist palliative care settings can improve the quality of life and functional capacity of patients with lung cancer. Palliat Med. 2003;17(5):410–7.CrossRef Hately J, Laurence V, Scott A, Baker R, Thomas P. Breathlessness clinics within specialist palliative care settings can improve the quality of life and functional capacity of patients with lung cancer. Palliat Med. 2003;17(5):410–7.CrossRef
13.
go back to reference Mitchell S, Loew J, Millington-Sanders C, Dale J: Providing end-of-life care in general practice: findings of a national GP questionnaire survey. Br J Gen Pract 2016:bjgpsep-2016-2066-2650-mitchell-fl-p. Mitchell S, Loew J, Millington-Sanders C, Dale J: Providing end-of-life care in general practice: findings of a national GP questionnaire survey. Br J Gen Pract 2016:bjgpsep-2016-2066-2650-mitchell-fl-p.
14.
go back to reference Abarshi E, Echteld M, Donker G, Van den Block L, Onwuteaka-Philipsen B, Deliens L. Discussing end-of-life issues in the last months of life: a nationwide study among general practitioners. J Palliat Med. 2011;14(3):323–30.CrossRef Abarshi E, Echteld M, Donker G, Van den Block L, Onwuteaka-Philipsen B, Deliens L. Discussing end-of-life issues in the last months of life: a nationwide study among general practitioners. J Palliat Med. 2011;14(3):323–30.CrossRef
15.
go back to reference The End of Life Care Strategy. In. Edited by Department of Health; 2008. The End of Life Care Strategy. In. Edited by Department of Health; 2008.
16.
go back to reference Meier EA, Gallegos JV, Thomas LPM, Depp CA, Irwin SA, Jeste DV. Defining a good death (successful dying): literature review and a call for research and public dialogue. Am J Geriatr Psychiatry. 2016;24(4):261–71.CrossRef Meier EA, Gallegos JV, Thomas LPM, Depp CA, Irwin SA, Jeste DV. Defining a good death (successful dying): literature review and a call for research and public dialogue. Am J Geriatr Psychiatry. 2016;24(4):261–71.CrossRef
17.
go back to reference Lynn J. Living long in fragile health: the new demographics shape end of life care. Hastings Cent Rep. 2005;35(7):s14–8.CrossRef Lynn J. Living long in fragile health: the new demographics shape end of life care. Hastings Cent Rep. 2005;35(7):s14–8.CrossRef
18.
go back to reference Lynn J. The utility and value of the “surprise question” for patients with serious illness. Can Med Assoc J. 2017;189(33):E1072–3.CrossRef Lynn J. The utility and value of the “surprise question” for patients with serious illness. Can Med Assoc J. 2017;189(33):E1072–3.CrossRef
19.
go back to reference Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. Can Med Assoc J. 2017;189(13):E484–93.CrossRef Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. Can Med Assoc J. 2017;189(13):E484–93.CrossRef
20.
go back to reference White N, Kupeli N, Vickerstaff V, Stone P. How accurate is theSurprise question’ at identifying patients at the end of life? A systematic review and meta-analysis. BMC Med. 2017;15(1):139.CrossRef White N, Kupeli N, Vickerstaff V, Stone P. How accurate is theSurprise question’ at identifying patients at the end of life? A systematic review and meta-analysis. BMC Med. 2017;15(1):139.CrossRef
21.
go back to reference Mitchell GK, Senior HE, Rhee JJ, Ware RS, Young S, Teo PC, Murray S, Boyd K, Clayton JM. Using intuition or a formal palliative care needs assessment screening process in general practice to predict death within 12 months: a randomised controlled trial. Palliat Med. 2018;32(2):384–94.CrossRef Mitchell GK, Senior HE, Rhee JJ, Ware RS, Young S, Teo PC, Murray S, Boyd K, Clayton JM. Using intuition or a formal palliative care needs assessment screening process in general practice to predict death within 12 months: a randomised controlled trial. Palliat Med. 2018;32(2):384–94.CrossRef
22.
go back to reference Elliott M, Nicholson C. A qualitative study exploring use of the surprise question in the care of older people: perceptions of general practitioners and challenges for practice. BMJ Support Palliat Care. 2014:bmjspcare–2014-000679. Elliott M, Nicholson C. A qualitative study exploring use of the surprise question in the care of older people: perceptions of general practitioners and challenges for practice. BMJ Support Palliat Care. 2014:bmjspcare–2014-000679.
24.
go back to reference Weijers F, Veldhoven C, Verhagen C, Vissers K, Engels Y. Adding a second surprise question triggers general practitioners to increase the thoroughness of palliative care planning: results of a pilot RCT with cage vignettes. BMC palliative care. 2018;17(1):64.CrossRef Weijers F, Veldhoven C, Verhagen C, Vissers K, Engels Y. Adding a second surprise question triggers general practitioners to increase the thoroughness of palliative care planning: results of a pilot RCT with cage vignettes. BMC palliative care. 2018;17(1):64.CrossRef
25.
go back to reference Hinkka H, Kosunen E, Lammi U-K, Metsänoja R, Puustelli A, Kellokumpu-Lehtinen P. Decision making in terminal care: a survey of Finnish doctors' treatment decisions in end-of-life scenarios involving a terminal cancer and a terminal dementia patient. Palliat Med. 2002;16(3):195–204.CrossRef Hinkka H, Kosunen E, Lammi U-K, Metsänoja R, Puustelli A, Kellokumpu-Lehtinen P. Decision making in terminal care: a survey of Finnish doctors' treatment decisions in end-of-life scenarios involving a terminal cancer and a terminal dementia patient. Palliat Med. 2002;16(3):195–204.CrossRef
28.
go back to reference European Organisation for Research and Treatment of Cancer (EORTC): EORTC quality of life group translation procedure. In., 4th edn; 2017. European Organisation for Research and Treatment of Cancer (EORTC): EORTC quality of life group translation procedure. In., 4th edn; 2017.
29.
go back to reference Oostendorp L, White N, Harries P, Yardley S, Tomlinson C, Ricciardi F, Gokalp H, Stone P: 35 online randomised controlled trial to improve clinical estimates of survival (ORACLES): study design. BMJ Support Palliat Care 2018, 8(3):373–373. Oostendorp L, White N, Harries P, Yardley S, Tomlinson C, Ricciardi F, Gokalp H, Stone P: 35 online randomised controlled trial to improve clinical estimates of survival (ORACLES): study design. BMJ Support Palliat Care 2018, 8(3):373–373.
30.
go back to reference White N, Harries P, Harris AJL, Vickerstaff V, Lodge P, McGowan C, Minton O, Tomlinson C, Tookman A, Reid F, et al. How do palliative care doctors recognise imminently dying patients? A judgement analysis. BMJ Open. (in press). White N, Harries P, Harris AJL, Vickerstaff V, Lodge P, McGowan C, Minton O, Tomlinson C, Tookman A, Reid F, et al. How do palliative care doctors recognise imminently dying patients? A judgement analysis. BMJ Open. (in press).
31.
go back to reference White N, Harries P, Harris AJ, Vickerstaff V, Lodge P, McGowan C, Minton O, Tomlinson C, Tookman A, Reid F et al: 44 an evidenced-based heuristics model (or rule of thumb) to improve doctors’ intuition about when patients are imminently dying. BMJ Support Palliat Care 2018, 8:376–376. White N, Harries P, Harris AJ, Vickerstaff V, Lodge P, McGowan C, Minton O, Tomlinson C, Tookman A, Reid F et al: 44 an evidenced-based heuristics model (or rule of thumb) to improve doctors’ intuition about when patients are imminently dying. BMJ Support Palliat Care 2018, 8:376–376.
33.
go back to reference Curtis P, Taylor G, Harris M. How preferred learning approaches change with time: a survey of GPs and GP specialist trainees. Education for Primary Care. 2018:1–6. Curtis P, Taylor G, Harris M. How preferred learning approaches change with time: a survey of GPs and GP specialist trainees. Education for Primary Care. 2018:1–6.
Metadata
Title
An online international comparison of thresholds for triggering a negative response to the “Surprise Question”: a study protocol
Authors
Nicola White
Linda Oostendorp
Victoria Vickerstaff
Christina Gerlach
Yvonne Engels
Maud Maessen
Christopher Tomlinson
Johan Wens
Bert Leysen
Guido Biasco
Sofia Zambrano
Steffen Eychmüller
Christina Avgerinou
Rabih Chattat
Giovanni Ottoboni
Carel Veldhoven
Patrick Stone
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Palliative Care / Issue 1/2019
Electronic ISSN: 1472-684X
DOI
https://doi.org/10.1186/s12904-019-0413-x

Other articles of this Issue 1/2019

BMC Palliative Care 1/2019 Go to the issue