Skip to main content
Top
Published in: BMC Psychiatry 1/2019

Open Access 01-12-2019 | Research article

The side effects of service changes: exploring the longitudinal impact of participation in a randomised controlled trial (DOORWAYS) on staff perceptions of barriers to change

Authors: Caroline Laker, Matteo Cella, Deborah Agbediro, Felicity Callard, Til Wykes

Published in: BMC Psychiatry | Issue 1/2019

Login to get access

Abstract

Background

Staff and service users have expressed concerns that service improvements in British mental health wards have been slow or transient. It is possible that certain changes are positive for some (e.g. service users), but negative for others (e.g. staff), which may affect implementation success. In this study, we explore whether a programme of change to improve the therapeutic milieu on mental health wards influenced staff perceptions of barriers to change, 12 months after implementation.

Method

A cluster randomised controlled trial called DOORWAYS was conducted on eight British, inner-city acute mental health wards. Randomisation was achieved using a list randomly generated by a computer. A psychologist trained ward staff (mainly nurses) to deliver evidence-based groups and supported their initial implementation. The impact of these changes was measured over 12 months (when 4 wards were randomised), according to nurses’ perceptions of barriers to change (VOCALISE), using unstructured multivariate linear regression models. This innovative analysis method allows maximum use of data in randomised controlled trials with reduced sample sizes due to substantial drop out rates. The contextual influences of occupational status (staff) and of workplace setting (ward) were also considered.

Results

Staff who participated in the intervention had significantly worse perceptions of barriers to change at follow up. The perceptions of staff in the control group did not change over time. In both groups (N = 120), direct care staff had more negative perceptions of barriers to change, and perceptions varied according to ward. Across time, direct care staff in the intervention group became more negative than those in the control group.

Conclusion

Participation in this program of change, worsened staff perceptions of barriers to change. In addition, occupational status (being from the direct care group) had a negative effect on perceptions of barriers to change, an effect that continued across time and was worse in the intervention group. Those providing direct care should be offered extra support when changes are introduced and through the implementation process. More effort should be placed around reducing the perceived burden of innovation for staff in mental health wards.

Trial registration

ISRCTN, ISRCTN 06545047. Registered 29/04/2010, https://​www.​isrctn.​com/​search?​q=​06545047
Appendix
Available only for authorised users
Literature
1.
go back to reference Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, et al. An implementation research agenda. Implement SciImplement Sci. 2009;4:18. PubMed PMID: 19351400. Pubmed Central PMCID: 2671479CrossRef Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, et al. An implementation research agenda. Implement SciImplement Sci. 2009;4:18. PubMed PMID: 19351400. Pubmed Central PMCID: 2671479CrossRef
2.
go back to reference Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.PubMedPubMedCentralCrossRef Grol RP, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.PubMedPubMedCentralCrossRef
3.
go back to reference Williams N, Glisson C, Hemmelgarn A, Green P. Mechanisms of Change in the ARC organizational strategy: increasing mental health clinicians EBP adoption through improved organizational culture and capacity. Adm Policy Ment Health Ment Health Serv Res. 2017;44(2):269–83.CrossRef Williams N, Glisson C, Hemmelgarn A, Green P. Mechanisms of Change in the ARC organizational strategy: increasing mental health clinicians EBP adoption through improved organizational culture and capacity. Adm Policy Ment Health Ment Health Serv Res. 2017;44(2):269–83.CrossRef
4.
go back to reference Corry P. Behind closed doors – acute mental health care in the UK. London: Rethink; 2004. Corry P. Behind closed doors – acute mental health care in the UK. London: Rethink; 2004.
5.
go back to reference Evans J, Rose D, Flach C, Csipke E, Glossop H, McCrone P, et al. VOICE: developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology. J Ment Health. 2012;21(1):57–71.PubMedPubMedCentralCrossRef Evans J, Rose D, Flach C, Csipke E, Glossop H, McCrone P, et al. VOICE: developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology. J Ment Health. 2012;21(1):57–71.PubMedPubMedCentralCrossRef
6.
go back to reference Csipke E, Flach C, McCrone P, Rose D, Tilley J, Wykes T, et al. Inpatient care 50 years after the process of deinstitutionalisation. Soc Psychiatry Psychiatr Epidemiol. 2013;49(4):665–71.PubMedPubMedCentralCrossRef Csipke E, Flach C, McCrone P, Rose D, Tilley J, Wykes T, et al. Inpatient care 50 years after the process of deinstitutionalisation. Soc Psychiatry Psychiatr Epidemiol. 2013;49(4):665–71.PubMedPubMedCentralCrossRef
7.
go back to reference Sharac J, McCrone P, Sabes-Figuera R, Csipke E, Wood A, Wykes T. Nurse and patient activities and interaction on psychiatric inpatients wards: a literature review. Int J Nurs Stud. 2010;47(7):909–17.PubMedPubMedCentralCrossRef Sharac J, McCrone P, Sabes-Figuera R, Csipke E, Wood A, Wykes T. Nurse and patient activities and interaction on psychiatric inpatients wards: a literature review. Int J Nurs Stud. 2010;47(7):909–17.PubMedPubMedCentralCrossRef
8.
go back to reference Wykes T, Csipke E, Williams P, Koeser L, Nash S, Rose D, et al. Improving patient experiences of mental health inpatient care: a randonmised controlled trial. Psychol Med. 2018;48(3):488–97.PubMedCrossRef Wykes T, Csipke E, Williams P, Koeser L, Nash S, Rose D, et al. Improving patient experiences of mental health inpatient care: a randonmised controlled trial. Psychol Med. 2018;48(3):488–97.PubMedCrossRef
11.
go back to reference Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21.PubMedPubMedCentralCrossRef Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21.PubMedPubMedCentralCrossRef
12.
go back to reference Alexander JA, Hearld LR. Methods and metrics challenges of delivery-system research. Implement Sci. 2012;7(1):1–11.CrossRef Alexander JA, Hearld LR. Methods and metrics challenges of delivery-system research. Implement Sci. 2012;7(1):1–11.CrossRef
14.
go back to reference Landaeta R, Mun JH, Rabadi G. Identifying sources of resistance to change in healthcare. Int J Healthc Technol Manag. 2008;9(1):74–96.CrossRef Landaeta R, Mun JH, Rabadi G. Identifying sources of resistance to change in healthcare. Int J Healthc Technol Manag. 2008;9(1):74–96.CrossRef
15.
go back to reference Schoenwald SK, Carter RE, Chapman JE, Sheidow AJ. Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Admin Pol Ment Health. 2008;35(5):379–94.CrossRef Schoenwald SK, Carter RE, Chapman JE, Sheidow AJ. Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Admin Pol Ment Health. 2008;35(5):379–94.CrossRef
16.
go back to reference Cleary M. The realities of mental health nursing in acute inpatient environments. Int J Ment Health Nurs. 2004;13(1):53–60.PubMedCrossRef Cleary M. The realities of mental health nursing in acute inpatient environments. Int J Ment Health Nurs. 2004;13(1):53–60.PubMedCrossRef
17.
go back to reference Brennan G, Flood C, Bowers L. Constraints and blocks to change and improvement on acute psychiatric wards--lessons from the city nurses project. J Psychiatr Ment Health Nurs. 2006;13(5):475–82.PubMedCrossRef Brennan G, Flood C, Bowers L. Constraints and blocks to change and improvement on acute psychiatric wards--lessons from the city nurses project. J Psychiatr Ment Health Nurs. 2006;13(5):475–82.PubMedCrossRef
18.
go back to reference Totman J, Hundt GL, Wearn E, Paul M, Johnson S. Factors affecting staff morale on inpatient mental health wards in England: a qualitative investigation. BMC Psychiatry. 2011;11:68.PubMedPubMedCentralCrossRef Totman J, Hundt GL, Wearn E, Paul M, Johnson S. Factors affecting staff morale on inpatient mental health wards in England: a qualitative investigation. BMC Psychiatry. 2011;11:68.PubMedPubMedCentralCrossRef
19.
go back to reference Bowers L. Safewards: a new model of conflict and containment on psychiatric wards. J Psychiatr Ment Health Nurs. 2014;13(5):475–82. Bowers L. Safewards: a new model of conflict and containment on psychiatric wards. J Psychiatr Ment Health Nurs. 2014;13(5):475–82.
20.
go back to reference Kindy D, Petersen S, Parkhurst D. Perilous work: nurses’ experiences in psychiatric units with high risks of assault. Arch Psychiatr Nurs. 2005;19(4):169–75.PubMedCrossRef Kindy D, Petersen S, Parkhurst D. Perilous work: nurses’ experiences in psychiatric units with high risks of assault. Arch Psychiatr Nurs. 2005;19(4):169–75.PubMedCrossRef
21.
go back to reference Kuokkanen L, Suominen T, Harkonen E, Kukkurainen ML, Doran D. Effects of organizational change on work-related empowerment, employee satisfaction, and motivation. Nurs Adm Q. 2009;33(2):116–24.PubMedCrossRef Kuokkanen L, Suominen T, Harkonen E, Kukkurainen ML, Doran D. Effects of organizational change on work-related empowerment, employee satisfaction, and motivation. Nurs Adm Q. 2009;33(2):116–24.PubMedCrossRef
22.
go back to reference Martin A, Jones ES, Callan VJ. The role of psychological climate in facilitating employee adjustment during organisational change. Eur J Work Organ Psychol. 2005;14:263–89.CrossRef Martin A, Jones ES, Callan VJ. The role of psychological climate in facilitating employee adjustment during organisational change. Eur J Work Organ Psychol. 2005;14:263–89.CrossRef
23.
go back to reference Lewin K. Field theory in social science. NewYork: Harper & Row; 1951. Lewin K. Field theory in social science. NewYork: Harper & Row; 1951.
24.
go back to reference Schein E. Kurt Lewin’s change theory in the field and in the classroom: notes toward a model of managed learning. Syst Pract. 1996;9(1):27–47.CrossRef Schein E. Kurt Lewin’s change theory in the field and in the classroom: notes toward a model of managed learning. Syst Pract. 1996;9(1):27–47.CrossRef
25.
go back to reference Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C. Perceptions of the impact of a large-scale collaborative improvement programme: experience in the UK safer patients initiative. J Eval Clin PractJ Eval Clin Pract. 2009;15(3):524–40.CrossRef Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C. Perceptions of the impact of a large-scale collaborative improvement programme: experience in the UK safer patients initiative. J Eval Clin PractJ Eval Clin Pract. 2009;15(3):524–40.CrossRef
26.
go back to reference Laker C, Callard F, Flach C, Williams P, Sayer J, Wykes T. The challenge of change in acute mental health services: measuring staff perceptions of barriers to change and their relationship to job status and satisfaction using a new measure (VOCALISE). Implement SciI. 2014;9(1):23.CrossRef Laker C, Callard F, Flach C, Williams P, Sayer J, Wykes T. The challenge of change in acute mental health services: measuring staff perceptions of barriers to change and their relationship to job status and satisfaction using a new measure (VOCALISE). Implement SciI. 2014;9(1):23.CrossRef
27.
go back to reference Laker C, Cella M, Callard F, Wykes T. Why is change a challenge in acute mental health wards? A cross-sectional investigation of the relationships between burnout, occupational status and nurses’ perceptions of barriers to change. Int J Ment Health Nurs. 2019;28(1):190–8.PubMedCrossRef Laker C, Cella M, Callard F, Wykes T. Why is change a challenge in acute mental health wards? A cross-sectional investigation of the relationships between burnout, occupational status and nurses’ perceptions of barriers to change. Int J Ment Health Nurs. 2019;28(1):190–8.PubMedCrossRef
28.
go back to reference Laker C, Cella M, Callard F, Wykes T. The impact of ward climate on staff perceptions of barriers to research driven service changes on mental health wards: a cross sectional study. J Psychiatr Ment Health Nurs. 2019;28:190–8.CrossRef Laker C, Cella M, Callard F, Wykes T. The impact of ward climate on staff perceptions of barriers to research driven service changes on mental health wards: a cross sectional study. J Psychiatr Ment Health Nurs. 2019;28:190–8.CrossRef
29.
go back to reference Penn D, Roberts DL, Combs D, Serne A. The development of the social cognition and interaction training program for schizophrenia spectrum disorders. Psychiatr Serv. 2007;58:449–51.PubMedCrossRef Penn D, Roberts DL, Combs D, Serne A. The development of the social cognition and interaction training program for schizophrenia spectrum disorders. Psychiatr Serv. 2007;58:449–51.PubMedCrossRef
30.
go back to reference Ruddle A, Mason O, Wykes T. A review of hearing voices groups: evidence and mechanisms of change. Clin Psychol Rev. 2011;31:757–66.PubMedCrossRef Ruddle A, Mason O, Wykes T. A review of hearing voices groups: evidence and mechanisms of change. Clin Psychol Rev. 2011;31:757–66.PubMedCrossRef
31.
go back to reference Knight MTD, Wykes T, Hayward P. Group treatment of perceived stigma and self esteem in schizophrenia: a waiting list trial of efficacy. Behav Cogn Psychother. 2006;34:305–18.CrossRef Knight MTD, Wykes T, Hayward P. Group treatment of perceived stigma and self esteem in schizophrenia: a waiting list trial of efficacy. Behav Cogn Psychother. 2006;34:305–18.CrossRef
32.
go back to reference Lineham M. Skills training manual for the treatment of borderline personality disorder. New York: Guildford Press; 1997. Lineham M. Skills training manual for the treatment of borderline personality disorder. New York: Guildford Press; 1997.
33.
go back to reference Grey S. Problem solving groups for psychiatric inpatients: a practical guide. London: Whiting & Birch; 2015. Grey S. Problem solving groups for psychiatric inpatients: a practical guide. London: Whiting & Birch; 2015.
34.
go back to reference Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003. Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
35.
go back to reference Green SB. How many subjects does it take to do a regression analysis? Multivar Behav Res. 1991;26:499–510.CrossRef Green SB. How many subjects does it take to do a regression analysis? Multivar Behav Res. 1991;26:499–510.CrossRef
36.
go back to reference Frost C, Kenward M, Fox N. Optimizing the design of clinical trials where the outcome is a rate. Can estimating a baseline rate in a run-in period increase efficiency? Stat Med. 2008;27:3717–31.PubMedCrossRef Frost C, Kenward M, Fox N. Optimizing the design of clinical trials where the outcome is a rate. Can estimating a baseline rate in a run-in period increase efficiency? Stat Med. 2008;27:3717–31.PubMedCrossRef
37.
go back to reference Laird N, Waire J. Random-effects models for longitudinal data. Biometrics. 1982;38(4):513–24.CrossRef Laird N, Waire J. Random-effects models for longitudinal data. Biometrics. 1982;38(4):513–24.CrossRef
38.
go back to reference Molenberghs G, Kenward MG. Missing data in clinical studies. Chichester: Wiley & Sons Ltd; 2007.CrossRef Molenberghs G, Kenward MG. Missing data in clinical studies. Chichester: Wiley & Sons Ltd; 2007.CrossRef
39.
go back to reference White I, Thompson S. Adjusting for partially missing baseline measurements in randomized trials. Stat Med. 2005;24(7):993–1007.PubMedCrossRef White I, Thompson S. Adjusting for partially missing baseline measurements in randomized trials. Stat Med. 2005;24(7):993–1007.PubMedCrossRef
40.
go back to reference Carpenter JR, Kenward MG. Missing data in randomised controlled trials – a practical guide. Birmingham: National Institute for Health Research; 2008. Carpenter JR, Kenward MG. Missing data in randomised controlled trials – a practical guide. Birmingham: National Institute for Health Research; 2008.
41.
42.
go back to reference Carpenter J, Kenward M. Multiple imputation and its application. Chichester: Wiley; 2013.CrossRef Carpenter J, Kenward M. Multiple imputation and its application. Chichester: Wiley; 2013.CrossRef
43.
go back to reference NMC. The Code: Professional standards of practice and behaviour for nurses, midwives and nursing associates. London: Nursing & Midwifery Council; 2018. NMC. The Code: Professional standards of practice and behaviour for nurses, midwives and nursing associates. London: Nursing & Midwifery Council; 2018.
44.
go back to reference Diefenbach T. New public management in public sector organisations: the dark sides of managerialistic ‘enlightenment’. Public Adm. 2009;87:892–909.CrossRef Diefenbach T. New public management in public sector organisations: the dark sides of managerialistic ‘enlightenment’. Public Adm. 2009;87:892–909.CrossRef
45.
go back to reference Teo S, Yeung M, Change E. Administrative stressors and nursing job outcomes in Australian public and non-profit health care organisations. J Clin Nurs. 2011;21:1443–52.CrossRef Teo S, Yeung M, Change E. Administrative stressors and nursing job outcomes in Australian public and non-profit health care organisations. J Clin Nurs. 2011;21:1443–52.CrossRef
46.
go back to reference Taylor-Watt J, Cruikshank A, Innes J, Brome B, Shah A. Reducing physical violence and developing a safety culture across wards in East London. Br J Ment Health Nurs. 2017;6(1):35–43.CrossRef Taylor-Watt J, Cruikshank A, Innes J, Brome B, Shah A. Reducing physical violence and developing a safety culture across wards in East London. Br J Ment Health Nurs. 2017;6(1):35–43.CrossRef
Metadata
Title
The side effects of service changes: exploring the longitudinal impact of participation in a randomised controlled trial (DOORWAYS) on staff perceptions of barriers to change
Authors
Caroline Laker
Matteo Cella
Deborah Agbediro
Felicity Callard
Til Wykes
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2019
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-019-2370-6

Other articles of this Issue 1/2019

BMC Psychiatry 1/2019 Go to the issue