Top

Published in:

01-02-2019 | Original Paper

Provider Readiness and Adaptations of Competency Drivers During Scale-Up of the Family Check-Up

Authors: Anne Marie Mauricio, Jenna Rudo-Stern, Thomas J. Dishion, Kirsten Letham, Monique Lopez

Published in: Journal of Prevention | Issue 1/2019

Abstract

We used provider (n = 112) data that staff at the agency disseminating the Family Check-Up (FCU; REACH Institute) collected to profile provider diversity in community settings and to examine whether provider profiles are related to implementation fidelity. Prior to FCU training, REACH Institute staff administered the FCU Provider Readiness Assessment (PRA), a provider self-report measure that assesses provider characteristics previously linked with provider uptake of evidence-based interventions. We conducted a latent class analysis using PRA subscale scores as latent class indicators. Results supported four profiles: experienced high readiness (ExHR), experienced low readiness (ExLR), moderate experience (ME), and novice. The ExHR class was higher than all other classes on: (1) personality variables (i.e., agreeableness, conscientiousness, openness, extraversion); (2) evidence-based practice attitudes; (3) work-related enthusiasm and engagement; and (4) their own well-being. The ExHR class was also higher than ExLR and ME classes on clinical flexibility. The ME class was lowest of all classes on conscientiousness, supervision, clinical flexibility, work-related enthusiasm and engagement, and well-being. During the FCU certification process, FCU Consultants rated providers’ fidelity to the model. Twenty-three of the 112 providers that completed the PRA also participated in certification. We conducted follow-up regression analyses using fidelity data for these 23 providers to explore associations between probability of class membership and fidelity. The likelihood of being in the ExHR class was related to higher FCU fidelity, whereas the likelihood of being in the ExLR class was related to lower fidelity. We discuss how provider readiness assessment data can be used to guide the adaptation of provider selection, training, and consultation in community settings.

Available only for authorised users

Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74. https://doi.org/10.1023/B:MHSR.0000024351.12294.65.CrossRefPubMedPubMedCentral

Aarons, G. A., Fettes, D. L., Flores, L. E., Jr., & Sommerfeld, D. H. (2009). Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy, 47(11), 954–960. https://doi.org/10.1016/j.brat.2009.07.006.CrossRefPubMedPubMedCentral

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7.CrossRef

August, G. J., Winters, K. C., Realmuto, G. M., Tarter, R., Perry, C., & Hektner, J. M. (2004). Moving evidence-based drug abuse prevention programs from basic science to practice: “Bridging the efficacyeffectiveness interface”. Substance Use & Misuse, 39(10–12), 2017–2053.CrossRef

Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 41(6), 788–799. https://doi.org/10.1007/s10488-013-0529-x.CrossRefPubMed

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. https://doi.org/10.1037/0033-2909.107.2.238.CrossRefPubMed

Campbell, B. K., Buti, A., Fussell, H. E., Srikanth, P., McCarty, D., & Guydish, J. R. (2013). Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. The American Journal of Drug and Alcohol Abuse, 39(5), 304–311. https://doi.org/10.3109/00952990.2013.799175.CrossRefPubMedPubMedCentral

Chambers, D. A., Glasgow, R., & Stange, K. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), 117–128. https://doi.org/10.1186/1748-5908-8-117.CrossRefPubMedPubMedCentral

Chang, H., Shaw, D. S., Dishion, T. J., Gardner, F., & Wilson, M. N. (2014). Direct and indirect effects of the Family Check-Up on self-regulation from toddlerhood to early school-age. Journal of Abnormal Child Psychology, 42(7), 1117–1128. https://doi.org/10.1007/s10802-014-9859-8.CrossRefPubMedPubMedCentral

Demerouti, E., Mostert, K., & Bakker, A. B. (2010). Burnout and work engagement: A thorough investigation of the independency of both constructs. Journal of Occupational Health Psychology, 15(3), 209–222. https://doi.org/10.1037/a0019408.CrossRefPubMed

Dishion, T. J., Connell, A., Weaver, C., Shaw, D., Gardner, F., & Wilson, M. (2008). The Family Check-Up with high-risk indigent families: Preventing problem behavior by increasing parents’ positive behavior support in early childhood. Child Development, 79(5), 1395–1414. https://doi.org/10.1111/j.1467-8624.2008.01195.x.CrossRefPubMedPubMedCentral

Dishion, T. J., & Kavanagh, K. (2003). Intervening in adolescent problem behavior: A family-centered approach. New York: Guilford Press.

Dishion, T. J., Knutson, N., Brauer, L., Gill, A., & Risso, J. (2010). Family check-up: COACH ratings manual. Unpublished coding manual. Available from Child and Family Center.

Dishion, T. J., Nelson, S. E., & Kavanagh, K. (2003). The Family Check-Up with high-risk young adolescents: Preventing early-onset substance use by parent monitoring. Behavior Therapy, 34(4), 553–571. https://doi.org/10.1016/S0005-7894(03)80035-7.CrossRef

Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: An ecological, family-centered approach to mental health care. Washington, DC: American Psychological Association. https://doi.org/10.1037/11485-000.CrossRef

Dishion, T. J., Stormshak, E. A., & Kavanagh, K. A. (2012). Everyday parenting: A professional’s guide to building family management skills. Champaign: Research Press Publishers.

Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531–540. https://doi.org/10.1177/1049731509335549.CrossRef

Forehand, R., Dorsey, S., Jones, D. J., Long, N., & McMahon, R. J. (2010). Adherence and flexibility: They can (and do) coexist! Clinical Psychology: Science and Practice, 17(3), 258–264. https://doi.org/10.1111/j.1468-2850.2010.01217.x.CrossRef

Goldberg, L. R. (1990). An alternative” description of personality”: The big-five factor structure. Journal of Personality and Social Psychology, 59(6), 1216–1229. https://doi.org/10.1037/0022-3514.59.6.1216.CrossRefPubMed

Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and interventions research. Clinical Psychology: Science and Practice, 13(1), 73–89. https://doi.org/10.1111/j.1468-2850.2006.00008.x.CrossRef

Kakeeto, M., Lundmark, R., Hasson, H., & Thiele Schwarz, U. (2017). Meeting patient needs trumps adherence. A cross-sectional study of adherence and adaptations when national guidelines are used in practice. Journal of Evaluation in Clinical Practice, 23(4), 830–838. https://doi.org/10.1111/jep.12726.CrossRefPubMed

Kilbourne, A. M., Neumann, M. S., Pincus, H. A., Bauer, M. S., & Stall, R. (2007). Implementing evidence-based interventions in health care: Application of the replicating effective programs framework. Implementation Science, 2, 1–10. https://doi.org/10.1186/1748-5908-2-42.CrossRef

Klimes-Dougan, B., August, G. J., Lee, C. Y. S., Realmuto, G. M., Bloomquist, M. L., Horowitz, J. L., et al. (2009). Practitioner and site characteristics that relate to fidelity of implementation: The Early Risers prevention program in a going-to-scale intervention trial. Professional Psychology: Research and Practice, 40(5), 467–475. https://doi.org/10.1037/a0014623.CrossRef

Lewis, C., Darnell, D., Kerns, S., Monroe-DeVita, M., Landes, S. J., Lyon, A. R., et al. (2016). Proceedings of the 3rd Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2015: Advancing efficient methodologies through community partnerships and team science. Implementation Science, 11(1), 85. https://doi.org/10.1186/s13012-016-0428-0.CrossRefPubMedCentral

Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722.CrossRef

Mahrer, A. R. (2005). Empirically supported therapies and therapy relationships: What are the serious problems and plausible alternatives? Journal of Contemporary Psychotherapy, 35, 3–25. https://doi.org/10.1007/s10879-005-0800-x.CrossRef

Muthén, L. K., & Muthén, B. O. (1998–2011). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.

Nelson, T. D., & Steele, R. G. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 319–330. https://doi.org/10.1007/s10488-006-0111-x.CrossRefPubMed

O’Connell, M. E., Boat, T., & Warner, K. E. (2009). Committee on the prevention of mental disorders and substance abuse among children, youth, and young adults: Research advances and promising interventions. In Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities.

Salyers, M. P., Fukui, S., Rollins, A. L., Firmin, R., Gearhart, T., Noll, J. P., et al. (2015). Burnout and self-reported quality of care in community mental health. Administration and Policy in Mental Health and Mental Health Services Research, 42(1), 61–69. https://doi.org/10.1007/s10488-014-0544-6.CrossRefPubMed

Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410–421. https://doi.org/10.1037/a0013788.CrossRefPubMedPubMedCentral

Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6(2), 461–464. https://doi.org/10.1214/aos/1176344136.CrossRef

Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333–343. https://doi.org/10.1007/BF02294360.CrossRef

Shaw, D. S., Connell, A., Dishion, T. J., Wilson, M. N., & Gardner, F. (2009). Improvements in maternal depression as a mediator of intervention effects on early childhood problem behavior. Development and Psychopathology, 21(2), 417–439. https://doi.org/10.1017/S0954579409000236.CrossRefPubMedPubMedCentral

Skriner, L. C., Wolk, C. B., Stewart, R. E., Adams, D. R., Rubin, R. M., Evans, A. C., et al. (2017). Therapist and organizational factors associated with participation in evidence-based practice initiatives in a large urban publicly-funded mental health system. The Journal of Behavioral Health Services & Research. https://doi.org/10.1007/s11414-017-9552-0.CrossRef

Smith, J. D., Dishion, T. J., Shaw, D. S., & Wilson, M. N. (2013). Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors. Journal of Consulting and Clinical Psychology, 81(6), 962–974. https://doi.org/10.1037/a0033950.CrossRefPubMed

Smith, J. D., Rudo-Stern, J., Dishion, T. J., Stormshak, E. A., Montag, S., Brown, K., et al. (in press). A quasi-experimental study of the effectiveness and efficiency of observationally assessing fidelity to a family-centered intervention. Journal of Clinical Child and Adolescent Psychology.

Steiger, J. (1989). Causal modeling: A supplementary module for SYSTAT and SYGRAPH. Evanston, IL: Systat.

Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. https://doi.org/10.1007/BF02291170.CrossRef

Van Ryzin, M. J., & Dishion, T. J. (2012). The impact of a family-centered intervention on the ecology of adolescent antisocial behavior: Modeling developmental sequelae and trajectories during adolescence. Development and Psychopathology, 24(03), 1139–1155. https://doi.org/10.1017/S0954579412000582.CrossRefPubMed

Van Ryzin, M. J., Stormshak, E. A., & Dishion, T. J. (2012). Engaging parents in the family check-up in middle school: Longitudinal effects on family conflict and problem behavior through the high school transition. Journal of Adolescent Health, 50(6), 627–633. https://doi.org/10.1016/j.jadohealth.2011.10.255.CrossRef

Title: Provider Readiness and Adaptations of Competency Drivers During Scale-Up of the Family Check-Up
Authors: Anne Marie Mauricio
Jenna Rudo-Stern
Thomas J. Dishion
Kirsten Letham
Monique Lopez
Publication date: 01-02-2019
Publisher: Springer US
Published in: Journal of Prevention / Issue 1/2019
Print ISSN: 2731-5533
Electronic ISSN: 2731-5541
DOI: https://doi.org/10.1007/s10935-018-00533-0

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Provider Readiness and Adaptations of Competency Drivers During Scale-Up of the Family Check-Up

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2019

Qualitative Comparative Analysis: A Mixed-Method Tool for Complex Implementation Questions

Acknowledgment of Reviewers of Volume 39

Redesigning Implementation Measurement for Monitoring and Quality Improvement in Community Delivery Settings

Three Critical Elements for Real-Time Monitoring of Implementation and Adaptation of Prevention Programs

Reconciling Adaptation and Fidelity: Implications for Scaling Up High Quality Youth Programs

Testing and Exploring the Limits of Traditional Notions of Fidelity and Adaptation in Implementation of Preventive Interventions