Skip to main content
Top
Published in:

Open Access 01-12-2024 | Research

Development of a core outcome set for psychological therapy trials on acute psychiatric inpatient wards

Authors: Pamela Jacobsen, Katherine Berry, Lucy Clarkson, Rebecca Hiscocks, India Hopkins, Ceri Morgan, Dhaarna Tandon, Ashley-Louise Teale, Natasha Tyler, Lisa Wood

Published in: BMC Psychiatry | Issue 1/2024

Login to get access

Abstract

Background

Consensus on what outcomes should be included in trials of psychological therapies on acute psychiatric inpatient wards is currently lacking. Inclusion of different viewpoints, including service user perspectives, is crucial in ensuring that future trials measure outcomes which are meaningful and important. Development of a Core Outcome Set (COS), a minimum standardised set of outcomes to be measured and reported, would help improve synthesis and interpretation of clinical trial data in this area.

Methods

Stage 1 of the COS development involved compiling a comprehensive long-list of outcomes from key sources including i) a systematic review of outcomes from published trials, ii) online survey of key stakeholders (service users, carers, healthcare professionals, researchers, and end users of research), iii) qualitative interviews with service users and carers. Stage 2 involved stakeholder groups short-listing the outcomes using consensus methods (e-Delphi survey). The final outcome set was derived from the short-list at a consensus meeting of stakeholders, facilitated by an Independent Chair.

Results

A long-list of 68 outcomes was compiled from the systematic review (n = 30 trials), online stakeholder survey (n = 100 participants) and qualitative interviews (n = 15 participants). Fifty stakeholders took part in the e-Delphi study, where the long-list was cut down to a short-list of 12 outcomes over 2 rounds. Nine stakeholders took part in the final consensus meeting, and after some outcomes were removed and/or amalgamated, a final set of 6 outcomes was recommended for inclusion in the COS. These were Ability to Cope, Hopefulness, Quality of Life, Psychosis Symptoms, Mood, and Self-Harm Behaviours.

Conclusions

Widespread future adoption of the COS will reduce research waste by ensuring that outcomes are more easily comparable across trials, and that the full range of stakeholder priorities are represented in trial outcomes. This makes it more likely that effective therapies will be identified in a timely fashion and successfully implemented in routine clinical practice. The final 6-outcome COS should be feasible to implement given the need keep participant burden to a minimum in inpatient trials. Further work is needed to make recommendations for the best outcome measurement instruments to use, including the use of patient-reported outcomes alongside clinician-rated measures.

Trial registration

Not applicable.
Appendix
Available only for authorised users
Literature
2.
go back to reference Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST. The COMET Handbook: version 1.0. Trials. 2017;18. Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST. The COMET Handbook: version 1.0. Trials. 2017;18.
3.
go back to reference Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–15.CrossRef Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–15.CrossRef
5.
go back to reference Neil ST, Kilbride M, Pitt L, Nothard S, Welford M, Sellwood W, et al. The questionnaire about the process of recovery (QPR): A measurement tool developed in collaboration with service users. Psychosis. 2009;1(2):145–55.CrossRef Neil ST, Kilbride M, Pitt L, Nothard S, Welford M, Sellwood W, et al. The questionnaire about the process of recovery (QPR): A measurement tool developed in collaboration with service users. Psychosis. 2009;1(2):145–55.CrossRef
6.
go back to reference Gargon E, Gorst SL, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 6th annual update to a systematic review of core outcome sets for research. PLoS ONE. 2021;16(1): e0244878.CrossRefPubMedPubMedCentral Gargon E, Gorst SL, Matvienko-Sikar K, Williamson PR. Choosing important health outcomes for comparative effectiveness research: 6th annual update to a systematic review of core outcome sets for research. PLoS ONE. 2021;16(1): e0244878.CrossRefPubMedPubMedCentral
7.
go back to reference Fiorillo A, Luciano M, Del Vecchio V, Sampogna G, Obradors-Tarragó C, Maj M, et al. Priorities for mental health research in Europe: A survey among national stakeholders’ associations within the ROAMER project. World Psychiatry. 2013;12(2):165–70.CrossRefPubMedPubMedCentral Fiorillo A, Luciano M, Del Vecchio V, Sampogna G, Obradors-Tarragó C, Maj M, et al. Priorities for mental health research in Europe: A survey among national stakeholders’ associations within the ROAMER project. World Psychiatry. 2013;12(2):165–70.CrossRefPubMedPubMedCentral
8.
go back to reference Brohan E, Thornicroft G, Rüsch N, Lasalvia A, Campbell MM, Yalçınkaya-Alkar Ö, et al. Measuring discrimination experienced by people with a mental illness: replication of the short-form DISCUS in six world regions. Psychol Med. 2023;53(9):3963–73.CrossRefPubMed Brohan E, Thornicroft G, Rüsch N, Lasalvia A, Campbell MM, Yalçınkaya-Alkar Ö, et al. Measuring discrimination experienced by people with a mental illness: replication of the short-form DISCUS in six world regions. Psychol Med. 2023;53(9):3963–73.CrossRefPubMed
9.
go back to reference Goulden R, Corker E, Evans-Lacko S, Rose D, Thornicroft G, Henderson C. Newspaper coverage of mental illness in the UK, 1992–2008. BMC Public Health. 2011;11(1):796.CrossRefPubMedPubMedCentral Goulden R, Corker E, Evans-Lacko S, Rose D, Thornicroft G, Henderson C. Newspaper coverage of mental illness in the UK, 1992–2008. BMC Public Health. 2011;11(1):796.CrossRefPubMedPubMedCentral
10.
go back to reference Gabbidon J, Farrelly S, Hatch SL, Henderson C, Williams P, Bhugra D, et al. Discrimination Attributed to Mental Illness or Race-Ethnicity by Users of Community Psychiatric Services. Psychiatr Serv. 2014;65(11):1360–6.CrossRefPubMed Gabbidon J, Farrelly S, Hatch SL, Henderson C, Williams P, Bhugra D, et al. Discrimination Attributed to Mental Illness or Race-Ethnicity by Users of Community Psychiatric Services. Psychiatr Serv. 2014;65(11):1360–6.CrossRefPubMed
11.
go back to reference Fricker M. Epistemic injustice: Power and the ethics of knowing. Oxford, UK: Oxford University Press; 2007.CrossRef Fricker M. Epistemic injustice: Power and the ethics of knowing. Oxford, UK: Oxford University Press; 2007.CrossRef
13.
go back to reference Organization WH. Mental Health Atlas 2020. Geneva: World Health Organization; 2021. Organization WH. Mental Health Atlas 2020. Geneva: World Health Organization; 2021.
14.
go back to reference Wood L, Alsawy S. Patient experiences of psychiatric inpatient care: a systematic review of qualitative evidence. Journal of Psychiatric Intensive Care. 2016;12(1):35–43.CrossRef Wood L, Alsawy S. Patient experiences of psychiatric inpatient care: a systematic review of qualitative evidence. Journal of Psychiatric Intensive Care. 2016;12(1):35–43.CrossRef
15.
go back to reference Phillips C, Tai S, Berry K. Experiences of acute mental health inpatient care in the UK: from admission to readmission. Psychosis. 2022;14(1):22–33.CrossRef Phillips C, Tai S, Berry K. Experiences of acute mental health inpatient care in the UK: from admission to readmission. Psychosis. 2022;14(1):22–33.CrossRef
16.
go back to reference Lelliott P, Quirk A. What is life like on acute psychiatric wards? Curr Opin Psychiatr. 2004;17(4):297–301.CrossRef Lelliott P, Quirk A. What is life like on acute psychiatric wards? Curr Opin Psychiatr. 2004;17(4):297–301.CrossRef
17.
go back to reference Jacobsen P, Peters E, Robinson EJ, Chadwick P. Mindfulness-based crisis interventions (MBCI) for psychosis within acute inpatient psychiatric settings; a feasibility randomised controlled trial. BMC Psychiatry. 2020;20(1):193.CrossRefPubMedPubMedCentral Jacobsen P, Peters E, Robinson EJ, Chadwick P. Mindfulness-based crisis interventions (MBCI) for psychosis within acute inpatient psychiatric settings; a feasibility randomised controlled trial. BMC Psychiatry. 2020;20(1):193.CrossRefPubMedPubMedCentral
18.
go back to reference Thornicroft G, Farrelly S, Szmukler G, Birchwood M, Waheed W, Flach C, et al. Clinical outcomes of Joint Crisis Plans to reduce compulsory treatment for people with psychosis: a randomised controlled trial. The Lancet. 2013;381(9878):1634–41.CrossRef Thornicroft G, Farrelly S, Szmukler G, Birchwood M, Waheed W, Flach C, et al. Clinical outcomes of Joint Crisis Plans to reduce compulsory treatment for people with psychosis: a randomised controlled trial. The Lancet. 2013;381(9878):1634–41.CrossRef
19.
go back to reference Priebe S, Katsakou C, Amos T, Leese M, Morriss R, Rose D, et al. Patients’ views and readmissions 1 year after involuntary hospitalisation. Br J Psychiatry. 2009;194(1):49–54.CrossRefPubMed Priebe S, Katsakou C, Amos T, Leese M, Morriss R, Rose D, et al. Patients’ views and readmissions 1 year after involuntary hospitalisation. Br J Psychiatry. 2009;194(1):49–54.CrossRefPubMed
20.
go back to reference Bowers L, Chaplin R, Quirk A, Lelliott P, Bowers L, Chaplin R, et al. A conceptual model of the aims and functions of acute inpatient psychiatry. J Ment Health. 2009;18(4):316–25.CrossRef Bowers L, Chaplin R, Quirk A, Lelliott P, Bowers L, Chaplin R, et al. A conceptual model of the aims and functions of acute inpatient psychiatry. J Ment Health. 2009;18(4):316–25.CrossRef
21.
go back to reference Jacobsen P, Tan M. Provision of National Institute for Health and Care Excellence-adherent cognitive behavior therapy for psychosis from inpatient to community settings: A national survey of care pathways in NHS mental health trusts. Health Science Reports. 2020;3(4): e198.CrossRefPubMedPubMedCentral Jacobsen P, Tan M. Provision of National Institute for Health and Care Excellence-adherent cognitive behavior therapy for psychosis from inpatient to community settings: A national survey of care pathways in NHS mental health trusts. Health Science Reports. 2020;3(4): e198.CrossRefPubMedPubMedCentral
23.
go back to reference Tyler N, Wright N, Grundy A, Waring J. Developing a core outcome set for interventions to improve discharge from mental health inpatient services: a survey, Delphi and consensus meeting with key stakeholder groups. BMJ Open. 2020;10(5): e034215.CrossRefPubMedPubMedCentral Tyler N, Wright N, Grundy A, Waring J. Developing a core outcome set for interventions to improve discharge from mental health inpatient services: a survey, Delphi and consensus meeting with key stakeholder groups. BMJ Open. 2020;10(5): e034215.CrossRefPubMedPubMedCentral
24.
go back to reference Addington DE, McKenzie E, Wang J, Smith HP, Adams B, Ismail Z. Development of a Core Set of Performance Measures for Evaluating Schizophrenia Treatment Services. Psychiatr Serv. 2012;63(6):584–91.CrossRefPubMed Addington DE, McKenzie E, Wang J, Smith HP, Adams B, Ismail Z. Development of a Core Set of Performance Measures for Evaluating Schizophrenia Treatment Services. Psychiatr Serv. 2012;63(6):584–91.CrossRefPubMed
25.
go back to reference McKenzie E, Matkin L, Sousa Fialho L, Emelurumonye IN, Gintner T, Ilesanmi C, et al. Developing an International Standard Set of Patient-Reported Outcome Measures for Psychotic Disorders. Psychiatr Serv. 2021;73(3):249–58.CrossRefPubMed McKenzie E, Matkin L, Sousa Fialho L, Emelurumonye IN, Gintner T, Ilesanmi C, et al. Developing an International Standard Set of Patient-Reported Outcome Measures for Psychotic Disorders. Psychiatr Serv. 2021;73(3):249–58.CrossRefPubMed
27.
go back to reference Jacobsen P, Hodkinson K, Peters E, Chadwick P. A systematic scoping review of psychological therapies for psychosis within acute psychiatric in-patient settings. Brit J Psychiat. 2018;213(2):490–7.CrossRefPubMed Jacobsen P, Hodkinson K, Peters E, Chadwick P. A systematic scoping review of psychological therapies for psychosis within acute psychiatric in-patient settings. Brit J Psychiat. 2018;213(2):490–7.CrossRefPubMed
28.
go back to reference Paterson C, Karatzias T, Dickson A, Harper S, Dougall N, Hutton P. Psychological therapy for inpatients receiving acute mental health care: A systematic review and meta-analysis of controlled trials. Br J Clin Psychol. 2018;57(4):453–72.CrossRefPubMed Paterson C, Karatzias T, Dickson A, Harper S, Dougall N, Hutton P. Psychological therapy for inpatients receiving acute mental health care: A systematic review and meta-analysis of controlled trials. Br J Clin Psychol. 2018;57(4):453–72.CrossRefPubMed
29.
go back to reference Wood L, Williams C, Billings J, Johnson S. A systematic review and meta-analysis of cognitive behavioural informed psychological interventions for psychiatric inpatients with psychosis. Schizophr Res. 2020;222:133–44.CrossRefPubMed Wood L, Williams C, Billings J, Johnson S. A systematic review and meta-analysis of cognitive behavioural informed psychological interventions for psychiatric inpatients with psychosis. Schizophr Res. 2020;222:133–44.CrossRefPubMed
30.
go back to reference Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson PR. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. J Clin Epidemiol. 2018;96:84–92.CrossRefPubMedPubMedCentral Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson PR. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. J Clin Epidemiol. 2018;96:84–92.CrossRefPubMedPubMedCentral
31.
go back to reference Morgan C, Clarkson L, Hiscocks R, Hopkins I, Berry K, Tyler N, et al. What should inpatient psychological therapies be for? Qualitative views of service users on outcomes. Health Expect. 2023;n/a(n/a). Morgan C, Clarkson L, Hiscocks R, Hopkins I, Berry K, Tyler N, et al. What should inpatient psychological therapies be for? Qualitative views of service users on outcomes. Health Expect. 2023;n/a(n/a).
32.
go back to reference Awenat YF, Peters S, Gooding PA, Pratt D, Huggett C, Harris K, et al. Qualitative analysis of ward staff experiences during research of a novel suicide-prevention psychological therapy for psychiatric inpatients: Understanding the barriers and facilitators. PLoS ONE. 2019;14(9): e0222482.CrossRefPubMedPubMedCentral Awenat YF, Peters S, Gooding PA, Pratt D, Huggett C, Harris K, et al. Qualitative analysis of ward staff experiences during research of a novel suicide-prevention psychological therapy for psychiatric inpatients: Understanding the barriers and facilitators. PLoS ONE. 2019;14(9): e0222482.CrossRefPubMedPubMedCentral
33.
go back to reference Bhui K, Stansfeld S, Hull S, Priebe S, Mole F, Feder G. Ethnic variations in pathways to and use of specialist mental health services in the UK: Systematic review. Br J Psychiatry. 2003;182(2):105–16.CrossRefPubMed Bhui K, Stansfeld S, Hull S, Priebe S, Mole F, Feder G. Ethnic variations in pathways to and use of specialist mental health services in the UK: Systematic review. Br J Psychiatry. 2003;182(2):105–16.CrossRefPubMed
34.
go back to reference Wood L, Williams C, Enache G, Withers F, Fullarton K, Salehi D, et al. Examining cognitive functioning of adult acute psychiatric inpatients through a brief screening assessment. Psychiatr Rehabil J. 2019;42(1):64–70.CrossRefPubMed Wood L, Williams C, Enache G, Withers F, Fullarton K, Salehi D, et al. Examining cognitive functioning of adult acute psychiatric inpatients through a brief screening assessment. Psychiatr Rehabil J. 2019;42(1):64–70.CrossRefPubMed
35.
go back to reference Wood L, Byrne R, Enache G, Morrison T. A brief cognitive therapy intervention for internalised stigma in acute inpatients who experience psychosis: a feasibility randomised controlled trial. Psychiatry Res. 2018;262:303–10.CrossRefPubMed Wood L, Byrne R, Enache G, Morrison T. A brief cognitive therapy intervention for internalised stigma in acute inpatients who experience psychosis: a feasibility randomised controlled trial. Psychiatry Res. 2018;262:303–10.CrossRefPubMed
36.
go back to reference Sheaves B, Freeman D, Isham L, McInerney J, Nickless A, Yu L-M, et al. Stabilising sleep for patients admitted at acute crisis to a psychiatric hospital (OWLS): an assessor-blind pilot randomised controlled trial. Psychol Med. 2018;48:1694–704.CrossRefPubMed Sheaves B, Freeman D, Isham L, McInerney J, Nickless A, Yu L-M, et al. Stabilising sleep for patients admitted at acute crisis to a psychiatric hospital (OWLS): an assessor-blind pilot randomised controlled trial. Psychol Med. 2018;48:1694–704.CrossRefPubMed
37.
go back to reference Matvienko-Sikar K, Avery K, Blazeby JM, Devane D, Dodd S, Egan AM, et al. Use of core outcome sets was low in clinical trials published in major medical journals. J Clin Epidemiol. 2022;142:19–28.CrossRefPubMed Matvienko-Sikar K, Avery K, Blazeby JM, Devane D, Dodd S, Egan AM, et al. Use of core outcome sets was low in clinical trials published in major medical journals. J Clin Epidemiol. 2022;142:19–28.CrossRefPubMed
Metadata
Title
Development of a core outcome set for psychological therapy trials on acute psychiatric inpatient wards
Authors
Pamela Jacobsen
Katherine Berry
Lucy Clarkson
Rebecca Hiscocks
India Hopkins
Ceri Morgan
Dhaarna Tandon
Ashley-Louise Teale
Natasha Tyler
Lisa Wood
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2024
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-024-06294-x