Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Short report

Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants

Authors: Clayton R. Cook, Chayna Davis, Eric C. Brown, Jill Locke, Mark G. Ehrhart, Gregory A. Aarons, Madeline Larson, Aaron R. Lyon

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

The Evidence-Based Practice Attitude Scale (EBPAS) is a widely used tool, but it has not been adapted and validated for use in schools, the most common setting where youth access behavioral health services. This study examined the factor structure, psychometric properties, and criterion-related validity of the school-adapted EBPAS in a sample of school-based behavioral health consultants.

Method

A research team comprised of experts in implementation of evidence-based practices in schools along with the original developer adapted the EBPAS for the school setting. The adapted instrument was administered to a representative sample (n = 196) of school-based behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses.

Results

The original EBPAS factor structure was confirmed, with the final model supporting four first-order factors that load onto a second-order factor capturing general attitudes toward evidence-based practice. Correlations among the subscales indicated both unique and shared variance. Correlations between EBPAS scores and consultant variables demonstrated differential criterion-related validity, with the total score and the Requirements and Openness subscales demonstrating the strongest correlations.

Conclusions

The adapted EBPAS performed well when administered to behavioral health consultants operating in the educator sector, supporting the relevance of assessing attitudes in school settings. Potential directions for future research and applications of the EBPAS in schools and other service sectors are discussed.
Appendix
Available only for authorised users
Literature
1.
Glisson C, Schoenwald SK, Kelleher K, Landsverk J, Hoagwood KE, Mayberg S, Green P. Research network on youth mental health. Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Adm Policy Ment Hlth. 2008;35:124–33.CrossRef
2.
Glisson C, Schoenwald SK. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005;7:243–59.CrossRefPubMed
3.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.CrossRefPubMedPubMedCentral
4.
Aarons GA. Measuring provider attitudes toward evidence-based practice: consideration of organizational context and individual differences. Child Adolesc Psychiatr Clin N Am. 2005;14:255–71.CrossRefPubMedPubMedCentral
5.
Patterson DA, Maguin E, Dulmus CN, Nisbet BC. Individual worker-level attitudes toward empirically supported treatments. Res Soc Work Pract. 2013;23:95–9.CrossRefPubMedPubMedCentral
6.
Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;2:61–74.CrossRef
7.
Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a geographically diverse sample of community mental health providers. Adm Policy Ment H. 2007;34:465.CrossRef
8.
Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and United States norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;3:701–17.CrossRef
9.
10.
11.
Borntrager CF, Chorpita BF, Higa-McMillan C, Weisz JR. Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? Psychiatr Serv. 2009;60:677–81.CrossRefPubMed
12.
Rye M, Torres EM, Friborg O, Skre I, Aarons GA. The Evidence-Based Practice Attitude Scale-36 (EBPAS-36): a brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples. Implement Sci. 2017;12:44.CrossRefPubMedPubMedCentral
13.
Burns BJ, Costello EJ, Angold A, Tweed D, Stangl D, Farmer EM, Erkanli A. Children’s mental health service use across service sectors. Health Aff. 1995;14:147–59.CrossRef
14.
Farmer EM, Burns BJ, Phillips SD, Angold A, Costello EJ. Pathways into and through mental health services for children and adolescents. Psychiatr Serv. 2003;54:60–6.CrossRefPubMed
15.
Gottfredson DC, Gottfredson GD. Quality of school-based prevention programs: results from a national survey. J Res Crime Delinq. 2002;39:3–5.CrossRef
16.
Owens JS, Lyon AR, Brandt NE, Warner CM, Nadeem E, Spiel C, Wagner M. Implementation science in school mental health: key constructs in a developing research agenda. Sch Ment Heal. 2014;6:99–111.CrossRef
17.
Rones M, Hoagwood K. School-based mental health services: a research review. Clin Child Fam Psychol Rev. 2000;3:223–41.CrossRefPubMed
18.
19.
20.
Provan KG, Milward HB. A preliminary theory of interorganizational network effectiveness: a comparative study of four community mental health systems. Adm Sci Q. 1995;30:1–33.CrossRef
21.
Carlson CI, Tombari ML. Multilevel school consultation training: preliminary program evaluation. Prof Sch Psychol. 1986;1:89.
22.
Montano DE, Kasprzyk D. Theory of reasoned action, theory of planned behavior, and the integrated behavioral model. In: Glanz K, Rimer BK, Viswanath K, editors. Health behavior and health education: Theory, research, and practice; 2015. p. 67–96.
23.
Guiney MC, Zibulsky J. Competent consultation: developing self-efficacy for process and problem aspects of consultation. J Educ Psychol Consult. 2017;27:52–71.CrossRef
24.
Hambleton RK, Merenda P, Spielberger C. Adapting Educational and Psychological Tests for Cross-Cultural Assessment. Hillsdale, NJ: Erlbaum; 2005.
25.
Rea LM, Parker RA. Designing and Conducting Survey Research. San Francisco: Jossey-Boss; 2014.
26.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implementat Sci. 2015;10:21.CrossRef
27.
Schwarzer R, Jerusalem M. Generalized self-efficacy scale. In: Weinman UJ, Wright S, Johnston M, editors. Measures in health psychology: a user’s portfolio. Causal and control beliefs. Windsor: Nfer-Nelson; 1995. p. 35–7.
28.
Muthén LK, Muthén BO. Mplus v8.0 [statistical software]. Los Angeles: Muthén & Muthén; 1998-2017.
29.
30.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.CrossRef
31.
Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1.CrossRef
32.
Browne MW, Cudeck R. Alternative ways of assessing model fit. Sage Focus Ed. 1993;154:136.
33.
Tabachnick BG, Fidell LS. Using multivariate statistics. Boston: Allyn & Bacon/Pearson Education; 2007.
34.
McMillan JH, Schumacher S. Research in education: a conceptual introduction. 5th ed. New York: Addison Wesley Longman; 2001.
35.
Cook CR, Lyon AR, Kubergovic D, Wright DB, Zhang Y. A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. Sch Ment Health. 2015;7:49–60.
36.
Reinke WM, Stormont M, Herman KC, Puri R, Goel N. Supporting children’s mental health in schools: teacher perceptions of needs, roles, and barriers. School Psychol Quart. 2011;26:1.CrossRef
37.
Lau A, Barnett M, Stadnick N, Saifan D, Regan J, Wiltsey Stirman S, Brookman-Frazee L. Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children’s mental health services. J Consult Clinic Psychol. 2017;85:664.CrossRef
38.
Pemberton JR, Conners-Burrow NA, Sigel BA, Sievers CM, Stokes LD, Kramer TL. Factors associated with clinician participation in TF-CBT post-workshop training components. Adm Policy Ment Health Ment Health Serv Res. 2015;25:1.
39.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38:4–23.CrossRef
40.
41.
Ajzen I, Fishbein M. The influence of attitudes on behavior. In: Albarracín D, Johnson BT, Zanna MP, editors. The handbook of attitudes. New Jersey: Erlbaum; 2005. p. 73–221.
42.
Hicks TB, Shahidullah JD, Carlson JS, Palejwala MH. Nationally Certified School Psychologists’ use and reported barriers to using evidence-based interventions in schools: The influence of graduate program training and education. Sch Psych Quarter. 2014;29:469–87.
43.
Solomon BG, Klein SA, Politylo BC. The effect of performance feedback on teachers’ treatment integrity: a meta-analysis of the single-case literature. Sch Psychol Rev. 2012;41:160.
44.
Blömeke S, Delaney S. Assessment of teacher knowledge across countries: a review of the state of research. In: Blömeke S, Hsieh FJ, Kaiser G, Schmidt WH, editors. International perspectives on teacher knowledge, beliefs and opportunities to learn. Dordrecht: Springer; 2014. p. 542–85.CrossRef
45.
Forman SG, Olin SS, Hoagwood KE, Crowe M, Saka N. Evidence-based interventions in schools: developers’ views of implementation barriers and facilitators. Sch Ment Health. 2009;1:26–36.CrossRef
Metadata
Title
Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants
Authors
Clayton R. Cook
Chayna Davis
Eric C. Brown
Jill Locke
Mark G. Ehrhart
Gregory A. Aarons
Madeline Larson
Aaron R. Lyon
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0804-z

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue

Debate

The advantages and limitations of guideline adaptation frameworks

Research

Community health worker support to improve HIV treatment outcomes for older children and adolescents in Zimbabwe: a process evaluation of the ZENITH trial

Study protocol

Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women

Research

Audience segmentation to disseminate behavioral health evidence to legislators: an empirical clustering analysis

Research

Testing implementation support for evidence-based programs in community settings: a replication cluster-randomized trial of Getting To Outcomes®

Research

Process evaluation of Samoa’s national salt reduction strategy (MASIMA): what interventions can be successfully replicated in lower-income countries?