Skip to main content
Top
Published in: Archives of Public Health 1/2019

Open Access 01-12-2019 | Climate Change | Research

File audit to assess sustained fidelity to a recovery and wellbeing oriented mental health service model: an Australian case study

Authors: Cara L. Jones, Frank P. Deane, Keren Wolstencroft, Adam Zimmermann

Published in: Archives of Public Health | Issue 1/2019

Login to get access

Abstract

Background

Over the past decade there has been increasing attention to implementing recovery-oriented approaches within mental health service practice and enhancing fidelity to such approaches. However, as is often the case with evidence-based practices, less attention has been paid to the sustainability of recovery-oriented approaches over time. This study sought to investigate whether fidelity to a recovery-oriented practice framework – the Collaborative Recovery Model could be sustained over time.

Method

The study setting was an Australian community managed mental health organisation. A file audit of consumer support plans was undertaken using the Goal and Action Plan Instrument for Quality audit tool (GAP-IQ). The audit tool assessed 17 areas for quality. Consumers (n = 116) from a large community managed mental health organisation participated in the study. Sustained fidelity to the Collaborative Recovery Model (CRM) was determined by comparing results from the file audit to a similar audit conducted 3 years earlier.

Results

The file audit revealed a significant increase in fidelity to CRM practices between 2011 and 2014. Fidelity to individual audit items that comprise the GAP-IQ was also found to significantly increase across 16 of the 17 GAP-IQ audit items, with the exception of the ‘Action Plan Review’ audit item.

Conclusions

A comparison of file audit data across different time points within the same setting can provide useful feedback about whether or not a practice is being sustained over time. Although fidelity increased overtime the study design does not allow conclusions that training and coaching practices implemented by the organisation were responsible.
Appendix
Available only for authorised users
Literature
1.
go back to reference Roberts G, Wolfson P. The rediscovery of recovery: open to all. Adv Psychiatr Treat. 2004;10(1):37–48.CrossRef Roberts G, Wolfson P. The rediscovery of recovery: open to all. Adv Psychiatr Treat. 2004;10(1):37–48.CrossRef
2.
go back to reference Kidd SA, George L, O'Connell M, Sylvestre J, Kirkpatrick H, Browne G, et al. Fidelity and recovery-orientation in assertive community treatment. Community Ment Health J. 2010;46(4):342–50.PubMedCrossRef Kidd SA, George L, O'Connell M, Sylvestre J, Kirkpatrick H, Browne G, et al. Fidelity and recovery-orientation in assertive community treatment. Community Ment Health J. 2010;46(4):342–50.PubMedCrossRef
3.
go back to reference Piat M, Lal S. Service providers' experiences and perspectives on recovery-oriented mental health system reform. Psychiatr Rehabil J. 2012;35(4):289–96.PubMedPubMedCentralCrossRef Piat M, Lal S. Service providers' experiences and perspectives on recovery-oriented mental health system reform. Psychiatr Rehabil J. 2012;35(4):289–96.PubMedPubMedCentralCrossRef
4.
go back to reference Deane FP, Crowe TP, King R, Kavanagh DJ, Oades LG. Challenges in implementing evidence-based practice into mental health services. Aust Health Rev. 2006;30(3):305–9.PubMedCrossRef Deane FP, Crowe TP, King R, Kavanagh DJ, Oades LG. Challenges in implementing evidence-based practice into mental health services. Aust Health Rev. 2006;30(3):305–9.PubMedCrossRef
5.
go back to reference Drake RE, Goldman HE, Leff HS, Lehman AF, Dixon L, Mueser KT, et al. Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001;52(2):179–82.PubMedCrossRef Drake RE, Goldman HE, Leff HS, Lehman AF, Dixon L, Mueser KT, et al. Implementing evidence-based practices in routine mental health service settings. Psychiatr Serv. 2001;52(2):179–82.PubMedCrossRef
6.
go back to reference Slade M, Amering M, Oades L. Recovery: an international perspective. Epidemiol Psichiatr Soc. 2008;17(2):128–37.PubMedCrossRef Slade M, Amering M, Oades L. Recovery: an international perspective. Epidemiol Psichiatr Soc. 2008;17(2):128–37.PubMedCrossRef
7.
go back to reference Le Boutillier C, Leamy M, Bird VJ, Davidson L, Willams J, Slade M. What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv. 2011;62(12):1470–6.PubMedCrossRef Le Boutillier C, Leamy M, Bird VJ, Davidson L, Willams J, Slade M. What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv. 2011;62(12):1470–6.PubMedCrossRef
8.
go back to reference Oades L, Anderson J. Recovery in Australia: Marshalling strengths and living values. Int Rev Psychiatry. 2012;24(1):5–10.PubMedCrossRef Oades L, Anderson J. Recovery in Australia: Marshalling strengths and living values. Int Rev Psychiatry. 2012;24(1):5–10.PubMedCrossRef
9.
go back to reference Commonwealth of Australia. Fourth National Mental Health Plan - An agenda for collaborative government action in mental health 2009-2014. In: Health, editor ACT2009. Commonwealth of Australia. Fourth National Mental Health Plan - An agenda for collaborative government action in mental health 2009-2014. In: Health, editor ACT2009.
10.
go back to reference Australian Health Ministers Advisory Council. A national framework for recovery-oriented mental health services: Guide for practitioners and providers. In: DoHa A, editor. . Canberra: ACT: Commonwealth of Australia; 2013. p. 1–88. Australian Health Ministers Advisory Council. A national framework for recovery-oriented mental health services: Guide for practitioners and providers. In: DoHa A, editor. . Canberra: ACT: Commonwealth of Australia; 2013. p. 1–88.
11.
go back to reference Deane FP, Andresen R, Crowe TP, Oades LG, Ciarrochi J, Williams V. A comparison of two coaching approaches to enhance implementation of a recovery-oriented mental health service model. Adm Policy Ment Health Ment Health Serv Res. 2014;41(5):660–7.CrossRef Deane FP, Andresen R, Crowe TP, Oades LG, Ciarrochi J, Williams V. A comparison of two coaching approaches to enhance implementation of a recovery-oriented mental health service model. Adm Policy Ment Health Ment Health Serv Res. 2014;41(5):660–7.CrossRef
12.
go back to reference Oades LG, Deane FP, Crowe TP. The collaborative recovery model: positive organisations enabling the use of strengths and values to serve recovery in enduring mental illness. In: Boniwel I, David S, editors. Oxford handbook of happiness. Oxford: Oxford University Press; 2012. p. 1050–66. Oades LG, Deane FP, Crowe TP. The collaborative recovery model: positive organisations enabling the use of strengths and values to serve recovery in enduring mental illness. In: Boniwel I, David S, editors. Oxford handbook of happiness. Oxford: Oxford University Press; 2012. p. 1050–66.
13.
go back to reference Marshall SL, Oades LG, Crowe TP. Mental health consumers' perceptions of receiving recovery-focused services. J Eval Clin Pract. 2009;15(4):654–9.PubMedCrossRef Marshall SL, Oades LG, Crowe TP. Mental health consumers' perceptions of receiving recovery-focused services. J Eval Clin Pract. 2009;15(4):654–9.PubMedCrossRef
14.
go back to reference Wolstencroft KE, Deane FP, Jones CL, Zimmermann A, Cox M. Consumer and staff perspectives of the implementation frequency and value of recovery and wellbeing oriented practices. Int J Ment Health Syst. 2018;12(1):60.PubMedPubMedCentralCrossRef Wolstencroft KE, Deane FP, Jones CL, Zimmermann A, Cox M. Consumer and staff perspectives of the implementation frequency and value of recovery and wellbeing oriented practices. Int J Ment Health Syst. 2018;12(1):60.PubMedPubMedCentralCrossRef
15.
go back to reference Crowe TP, Deane FP, Oades LG, Caputi P, Morland K. Effectiveness of a collaborative recovery training program in Australia in promoting positive views about recovery. Psychiatr Serv. 2006;57(10):1497–500.PubMedCrossRef Crowe TP, Deane FP, Oades LG, Caputi P, Morland K. Effectiveness of a collaborative recovery training program in Australia in promoting positive views about recovery. Psychiatr Serv. 2006;57(10):1497–500.PubMedCrossRef
16.
go back to reference Kelly PJ, Deane FD. Relationship between therapeutic homework and clinical outcomes for individuals with severe mental illness. Aust N Z J Psychiatry. 2009;43(10):968–975.CrossRef Kelly PJ, Deane FD. Relationship between therapeutic homework and clinical outcomes for individuals with severe mental illness. Aust N Z J Psychiatry. 2009;43(10):968–975.CrossRef
17.
go back to reference Uppal S, Oades LG, Crowe TP, Deane FP. Barriers to transfer of collaborative recovery training into Australian mental health services: implications for the development of evidence-based services. J Eval Clin Pract. 2010;16(3):451–5.PubMed Uppal S, Oades LG, Crowe TP, Deane FP. Barriers to transfer of collaborative recovery training into Australian mental health services: implications for the development of evidence-based services. J Eval Clin Pract. 2010;16(3):451–5.PubMed
18.
go back to reference Tsai J, Salyers MP, McGuire AB. A cross-sectional study of recovery training and staff attitudes in four community mental health centres. Psychiatr Rehabil J. 2011;34(3):186–93.PubMedCrossRef Tsai J, Salyers MP, McGuire AB. A cross-sectional study of recovery training and staff attitudes in four community mental health centres. Psychiatr Rehabil J. 2011;34(3):186–93.PubMedCrossRef
19.
go back to reference Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(17):1–19. Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(17):1–19.
20.
go back to reference Bond GR, Drake RE, McHugo GJ, Peterson AE, Jones AM, Williams J. Long-term sustainability of evidence-based practices in community mental health agencies. Adm Policy Ment Health Ment Health Serv Res. 2014;41(2):228–36.CrossRef Bond GR, Drake RE, McHugo GJ, Peterson AE, Jones AM, Williams J. Long-term sustainability of evidence-based practices in community mental health agencies. Adm Policy Ment Health Ment Health Serv Res. 2014;41(2):228–36.CrossRef
21.
go back to reference Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014;41(3):337–46.PubMedCrossRef Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014;41(3):337–46.PubMedCrossRef
22.
go back to reference Swain K, Whitley R, Mchugo GJ, Drake RE. The sustainability of evidence-based practices in routine mental health agencies. J Commun Ment Health. 2010;46(2):119–29.CrossRef Swain K, Whitley R, Mchugo GJ, Drake RE. The sustainability of evidence-based practices in routine mental health agencies. J Commun Ment Health. 2010;46(2):119–29.CrossRef
23.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.PubMedCrossRef Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.PubMedCrossRef
24.
go back to reference Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health Ment Health Serv Res. 2011;38(1):32–43.CrossRef Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ, Southam-Gerow MA. Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health Ment Health Serv Res. 2011;38(1):32–43.CrossRef
25.
go back to reference Cuddeback GS, Morrissey JP, Domino ME, Monroe-DeVita M, Teague GB, Moser LL. Fidelity to recovery-oriented ACT practices and consumer outcomes. Psychiatr Serv. 2013;64(4):312–23.PubMedCrossRef Cuddeback GS, Morrissey JP, Domino ME, Monroe-DeVita M, Teague GB, Moser LL. Fidelity to recovery-oriented ACT practices and consumer outcomes. Psychiatr Serv. 2013;64(4):312–23.PubMedCrossRef
26.
go back to reference Ritter PL, Stewart AL, Kaymaz H, Sobel DS, Block DA, Lorig KR. Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001;54(2):136–41.PubMedCrossRef Ritter PL, Stewart AL, Kaymaz H, Sobel DS, Block DA, Lorig KR. Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001;54(2):136–41.PubMedCrossRef
27.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
28.
go back to reference Kelly P, Deane FP, Kazantzis N, Crowe TP, Oades L. Use of homework by mental health case managers in the rehabilitation of persistent and recurrent psychiatric disability. J Ment Health. 2006;15(1):95–101.CrossRef Kelly P, Deane FP, Kazantzis N, Crowe TP, Oades L. Use of homework by mental health case managers in the rehabilitation of persistent and recurrent psychiatric disability. J Ment Health. 2006;15(1):95–101.CrossRef
29.
go back to reference Mueser KT, Meyer PS, Penn DL, Clancy R, Clancy DM, Salyers MP. The illness management and recovery program: rationale, development, and preliminary findings. Schizophr Bull. 2006;32(1):S32–43.PubMedPubMedCentralCrossRef Mueser KT, Meyer PS, Penn DL, Clancy R, Clancy DM, Salyers MP. The illness management and recovery program: rationale, development, and preliminary findings. Schizophr Bull. 2006;32(1):S32–43.PubMedPubMedCentralCrossRef
Metadata
Title
File audit to assess sustained fidelity to a recovery and wellbeing oriented mental health service model: an Australian case study
Authors
Cara L. Jones
Frank P. Deane
Keren Wolstencroft
Adam Zimmermann
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Climate Change
Published in
Archives of Public Health / Issue 1/2019
Electronic ISSN: 2049-3258
DOI
https://doi.org/10.1186/s13690-019-0377-6

Other articles of this Issue 1/2019

Archives of Public Health 1/2019 Go to the issue