Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-11-2020 | Original Paper

The Family Psychoeducation Fidelity Scale: Psychometric Properties

Authors: I. Joa, J. O. Johannessen, K. S. Heiervang, A. A. Sviland, H. A. Nordin, M. Landers, T. Ruud, R. E. Drake, G. R. Bond

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2020

Abstract

This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

Available only for authorised users

Awad, A. G., & Voruganti, L. N. (2008). The burden of schizophrenia on caregivers: a review. Pharmacoeconomics, 26(2), 149–162. https://doi.org/10.2165/00019053-200826020-00005.CrossRefPubMed

Berry, K., & Haddock, G. (2008). The implementation of the NICE guidelines for schizophrenia: Barriers to the implementation of psychological interventions and recommendations for the future. Psychology and Psychotherapy, 81(Pt 4), 419–436. https://doi.org/10.1348/147608308X329540.CrossRefPubMed

Bond, G. R., Becker, D. R., & Drake, R. E. (2011). Measurement of fidelity of implementation of evidence-based practices: Case Example of the IPS Fidelity Scale. Clinical Psychology: Science and Practice, 18(2), 126–141. https://doi.org/10.1111/j.1468-2850.2011.01244.x.CrossRef

Bond, G. R., & Drake, R. E. (2019). Assessing the fidelity of evidence-based practices: History and current status of a standardized measurement methodology. Administration and Policy in Mental Health and Mental Health. https://doi.org/10.1007/s10488-019-00991-6.CrossRef

Bond, G. R., Drake, R. E., McHugo, G. J., Rapp, C. A., & Whitley, R. (2009). Strategies for improving fidelity in the national evidence-based practices project. Research on Social Work Practice, 19(5), 569–581. https://doi.org/10.1177/1049731509335531.CrossRef

Cabral, R. R., & Chaves, A. C. (2010). Multi-family group intervention in a programme for patients with first-episode psychosis: a Brazilian experience. International Journal of Social Psychiatry, 56(5), 527–532. https://doi.org/10.1177/0020764009102754.CrossRefPubMed

Day, K., & Petrakis, M. (2017). Family interventions in early psychosis service delivery: A systematized review. Social Work in Mental Health, 15(6), 632–650. https://doi.org/10.1080/15332985.2016.1271381.CrossRef

Dixon, L., McFarlane, W. R., Lefley, H., Lucksted, A., Cohen, M., Falloon, I., …, Sondheimer, D. (2001). Evidence-based practices for services to families of people with psychiatric disabilities. Psychiatric Services, 52(7), 903–910. https://doi.org/10.1176/appi.ps.52.7.903.CrossRefPubMed

Drake, R. E., Goldman, H. H., Leff, H. S., Lehman, A. F., Dixon, L., Mueser, K. T., et al. (2001). Implementing evidence-based practices in routine mental health service settings. Psychiatric Services, 52(2), 179–182. https://doi.org/10.1176/appi.ps.52.2.179.CrossRefPubMed

Eassom, E., Giacco, D., Dirik, A., & Priebe, S. (2014). Implementing family involvement in the treatment of patients with psychosis: A systematic review of facilitating and hindering factors. British Medical Journal Open, 4(10), e006108. https://doi.org/10.1136/bmjopen-2014-006108.CrossRef

Helsedirektoratet. (2013). Utredning, behandling og oppfølging av personer med psykoselidelser. Retrieved from https://www.helsebiblioteket.no/retningslinjer/psykoselidelser/forord

Jeppesen, P., Petersen, L., Thorup, A., Abel, M. B., ⊘ehlenschlæger, J., Christensen, T. Ø., …, Nordentoft, M. (2005). Integrated treatment of first-episode psychosis: Effect of treatment on family burden: OPUS trial. British Journal of Psychiatry, 187(S48), s85–s90. https://doi.org/10.1192/bjp.187.48.s85.CrossRef

Kavanagh, D. J., Piatkowska, O., Clark, D., O'halloran, P., Manicavasagar, V., Rosen, A., et al. (1993). Application of cognitive-behavioural family intervention for schizophrenia in multidisciplinary teams: What can the matter be? Australian Psychologist, 28(3), 181–188. https://doi.org/10.1080/00050069308258899.CrossRef

Kealey, E. M., Leckman-Westin, E., Jewell, T. J., & Finnerty, M. T. (2015). Multifamily group psychoeducation in New York State: Implementation and fidelity outcomes. Psychiatric Services, 66(11), 1194–1199. https://doi.org/10.1176/appi.ps.201400403.CrossRefPubMed

Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2013.00863.CrossRefPubMedPubMedCentral

Lobban, F., Postlethwaite, A., Glentworth, D., Pinfold, V., Wainwright, L., Dunn, G., …, Haddock, G. (2013). A systematic review of randomised controlled trials of interventions reporting outcomes for relatives of people with psychosis. Clinical Psychology Review, 33(3), 372–382. https://doi.org/10.1016/j.cpr.2012.12.004.CrossRefPubMed

Lu, W., Yanos, P. T., Gottlieb, J. D., Duva, S. M., Silverstein, S. M., Xie, H., Mueser, K. T. (2012). Use of fidelity assessments to train clinicians in the CBT for PTSD program for clients with serious mental illness. Psychiatric Services, 63(8), 785–792. https://doi.org/10.1176/appi.ps.201000458.CrossRefPubMed

McFarlane, W. R. (2004). Multifamily groups in the treatment of severe psychiatric disorders. New York: The Guilford Press.

McFarlane, W. R. (2016). Family interventions for Schizophrenia and the psychoses: A review. Family Process, 55(3), 460–482. https://doi.org/10.1111/famp.12235.CrossRefPubMed

McFarlane, W. R., Dixon, L., & Colleagues. (2002). Evidence-based practice implementation package on family psychoeducation. Retrieved from Lebanon, NH.

McFarlane, W. R., Dixon, L., Lukens, E., & Lucksted, A. (2003). Family psychoeducation and schizophrenia: A review of the literature. Journal of Marital and Family Therapy, 29(2), 223–245.CrossRef

McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30–46.CrossRef

McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50(6), 818–824. https://doi.org/10.1176/ps.50.6.818.CrossRefPubMed

McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., …, Finnerty, M. T. (2007). Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services, 58(10), 1279–1284. https://doi.org/10.1176/ps.2007.58.10.1279.CrossRefPubMed

McWilliams, S., Egan, P., Jackson, D., Renwick, L., Foley, S., Behan, C., …, O'Callaghan, E. (2010). Caregiver psychoeducation for first-episode psychosis. European Psychiatry, 25(1), 33–38. https://doi.org/10.1016/j.eurpsy.2009.08.006.CrossRefPubMed

Miklowitz, D., O’Brien, M., & Schlosser, D. (2010). Clinicians’ treatment manual for familyfocused therapy for prodromal youth (FFT-PY). In U. University of California at Los Angeles (Ed.): Unpublished Treatment Manual.

Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24(3), 315–340. https://doi.org/10.1177/109821400302400303.CrossRef

Nilsen, L., Frich, J. C., Friis, S., Norheim, I., & Rossberg, J. I. (2016). Participants' perceived benefits of family intervention following a first episode of psychosis: A qualitative study. Early Intervention Psychiatry, 10(2), 152–159. https://doi.org/10.1111/eip.12153.CrossRef

Nilsen, L., Frich, J. C., Friis, S., & Rossberg, J. I. (2014). Patients' and family members' experiences of a psychoeducational family intervention after a first episode psychosis: A qualitative study. Issues in Mental Health Nursing, 35(1), 58–68. https://doi.org/10.3109/01612840.2013.837992.CrossRefPubMed

Pharoah, F., Mari, J., Rathbone, J., & Wong, W. (2010). Family intervention for schizophrenia. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.CD000088.pub2.CrossRefPubMed

Selick, A., Durbin, J., Vu, N., O'Connor, K., Volpe, T., & Lin, E. (2017). Barriers and facilitators to implementing family support and education in Early Psychosis Intervention programmes: A systematic review. Early Intervention Psychiatry, 11(5), 365–374. https://doi.org/10.1111/eip.12400.CrossRef

Yesufu-Udechuku, A., Harrison, B., Mayo-Wilson, E., Young, N., Woodhams, P., Shiers, D., …, Kendall, T. (2015). Interventions to improve the experience of caring for people with severe mental illness: Systematic review and meta-analysis. The British Journal of Psychiatry, 206(4), 268–274. https://doi.org/10.1192/bjp.bp.114.147561.CrossRefPubMed

Title: The Family Psychoeducation Fidelity Scale: Psychometric Properties
Authors: I. Joa
J. O. Johannessen
K. S. Heiervang
A. A. Sviland
H. A. Nordin
M. Landers
T. Ruud
R. E. Drake
G. R. Bond
Publication date: 01-11-2020
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2020
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-020-01040-3

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

The Family Psychoeducation Fidelity Scale: Psychometric Properties

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2020

Race and Equity in Statewide Implementation Programs: An Application of the Policy Ecology of Implementation Framework

Psychometric Properties of a Fidelity Scale for Illness Management and Recovery

Commentary: Challenges and Opportunites in the Assessment of Fidelity and Related Constructs

The Physical Health Care Fidelity Scale: Psychometric Properties

Assessing the Fidelity of Evidence-Based Practices: History and Current Status of a Standardized Measurement Methodology

Using Complier Average Causal Effect Estimation to Examine Student Outcomes of the PAX Good Behavior Game When Integrated with the PATHS Curriculum