Top

The Journal of Behavioral Health Services & Research

Published in:

01-04-2016

An Exploratory Factor Analysis of the Knowledge of Evidence-Based Services Questionnaire

Authors: Kelsie H. Okamura, MA, Brad J. Nakamura, PhD, Charles Mueller, PhD, Kentaro Hayashi, PhD, Charmaine K. Higa McMillan, PhD

Published in: The Journal of Behavioral Health Services & Research | Issue 2/2016

Abstract

Recent developments for disseminating and implementing evidence-based practices (EBPs) have emphasized the importance of increasing therapists’ knowledge of such techniques. However, systematic efforts to measure knowledge in therapists serving youth have mostly relied on poorly researched study-specific measures. This study investigated the structure of EBP knowledge in a large sample of youth community therapists (N = 240) via a therapist report instrument emphasizing therapeutic commonalities across various types of treatment approaches. Findings supported a three-factor structure of knowledge with scores on factors varying by therapists’ primary practice setting and education level. The relationships between therapist knowledge of and attitudes towards EBPs are also discussed.

Chambless DL, Hollon SD. Defining empirically supported therapies. Journal of Consulting and Clinical Psychology 1998; 66: 7–18. DOI: 10.1037/0022-006X.66.1.7.CrossRefPubMed

Lonigan CJ, Elbert JC, Johnson S. Empirically supported psychosocial interventions for children: An overview. Journal of Clinical Child Psychology 1998; 27: 138–145. DOI: 10.1207/s15374424jccp2702_1.CrossRefPubMed

Chorpita BF, Yim LM, Donkervoet JC, et al. Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force. Clinical Psychology: Science and Practice 2002; 9(2): 165–190. DOI: 10.1093/clipsy/9.2.165.

Hoagwood K, Burns BJ, Kiser L, et al. Evidence-based practice in child and adolescent mental health services. Psychiatric Services 2001; 52: 1179–1189. DOI: 10.1176/appi.ps.52.9.1179.

Task Force on Promotion and Dissemination of Psychological Procedures. Training in and dissemination of empirically-validated psychological treatments: Report and recommendations. Clinical Psychologist 1995; 48: 3–23.

Daleiden E, Lee J, Tolman R. Annual evaluation report: Fiscal year 2004. Honolulu, HI: Hawaii Department of Health, Child and Adolescent Mental Health Division 2004. Retrieved February 25, 2008, from http://hawaii.gov/health/mental-health/camhd/library/pdf/rpteval/ge/ge/ge011.pdf

Weersing RV, Weisz JR, Donenberg GR. Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child Psychology 2002; 31: 168–180.CrossRef

Becker KD, Nakamura BJ, Young J, et al. What better place than here? What better time than now? ABCT’s burgeoning role in the dissemination and implementation of evidence-based practices. The Behavior Therapist 2009; 32: 89–96.

Chorpita BF, Regan J. Dissemination of effective mental health treatment procedures: Maximizing the return on a significant investment. Behaviour Research & Therapy 2009; 47: 990–993. DOI: 10.1016/j.brat.2009.07.002.CrossRef

10.

Fixsen DL, Naoom SF, Blase KA, et al. Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Research Institute, The National Implementation Research Network, 2005. (FMHI Publication #231).

11.

Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science 2009; 4(50): 1–15. DOI:10.1186/1748-5908-4-50

12.

Rogers EM. Diffusion of innovations (5th ed.). New York: Free Press, 2003.

13.

Arbuthnot J. (1974). Environmental knowledge and recycling behavior as a function of attitudes and personality characteristics. Personality and Social Psychology Bulletin; 1: 119–121. DOI: 10.1177/014616727400100140.CrossRef

14.

Higa CK, Chorpita BF. Evidence-based therapies: Translating research into practice. In R. G. Steele, T. D. Elkin, & M. C. Roberts (Eds.), Handbook of evidence-based therapies for children and adolescents: Bridging science and practice (pp. 45-61). New York: Springer-Verlag, 2007.

15.

Sanders M, Prinz R, Shapiro C. Predicting utilization of evidence-based parenting interventions with organizational, service-provider and client variables. Administrative Policy and Mental Health 2009; 36: 133–143. DOI: 10.1007/s10488-009-0205-3.CrossRef

16.

Seng A, Prinz R, Sanders M. The role of training variables in effective dissemination of evidence-based parenting interventions. International Journal of Mental Health Promotion 2006; 8: 19–27.CrossRef

17.

Persons JB. Why practicing psychologists are slow to adopt empirically validated treatments. In S. C. Hayes, V. M. Follette, R. M. Dawes, & K. E. Grady (Eds.), Scientific standards of psychological practice: Issues and recommendations (pp. 141–157). Reno, NV: Context Press, 1995.

18.

Kazdin AE. Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist 2008; 63: 146–159. DOI: 10.1037/0003-066X.63.3.146.CrossRefPubMed

19.

Miller W, Sorensen J, Selzer J, et al. Disseminating evidence based practices in substance abuse treatment: A review with suggestions. Journal of Substance Abuse Treatment 2006; 31: 25–39. DOI: 10.1016/j.jsat.2006.03.005.

20.

Chorpita BF, Daleiden E. Evidence-based Services Committee—Biennial report—Effective psychological interventions for youth with behavioral and emotional needs. Honolulu, HI: Hawaii Department of Health Child and Adolescent Mental Health Division, 2009.

21.

Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology 2009; 77: 566–579. DOI: 10.1037/a0014565.CrossRefPubMed

22.

Chorpita BF, Daleiden EL, Weisz JR. Identifying and selecting the common elements of evidence-based interventions: A distillation and matching model. Mental Health Services Research 2005; 7: 5–20. DOI: 10.1007/s11020-005-1962-6.

23.

Chorpita BF, Weisz JR. Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, or Conduct Problems (MATCH-ADTC). Satellite Beach, FL: PracticeWise, LLC, 2009.

24.

Weisz JR, Chorpita BF, Palinkas LA, et al. Testing standard and modular designs for psychotherapy with youth depression, anxiety, and conduct problems: A randomized effectiveness trial. Archives of General Psychiatry 2012; 69: 274–282. DOI:10.1001/archgenpsychiatry.2011.147

25.

Garland AF, Hawley KM, Brookman-Frazee L, et al. Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child & Adolescent Psychiatry 2008; 47: 505–515. DOI: 10.1097/CHI.0b013e31816765c2.

26.

Beidas RS, Barmish AJ, Kendall PC. Training as usual: Can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? The Behavior Therapist 2009; 32: 97–101.

27.

Stumpf RE, Higa-McMillan CK, Chorpita BF. Implementation of Evidence-Based Services for Youth: Assessing Provider Knowledge. Behavior Modification 2009; 33: 48–65. DOI: 10.1177/0145445508322625.CrossRefPubMed

28.

Kreiter CD, Frisbie DA. Effectiveness of multiple true-false items. Applied Measurement in Education 1989; 2: 207–216.CrossRef

29.

Weist M, Lever N, Stephan S, et al. Formative evaluation of a framework for high quality, evidence-based services in school mental health. School Mental Health 2009; 1: 196–211. DOI: 10.1007/s12310-009-9018-5.

30.

Orimoto TE, Higa-McMillan CK, Mueller, CW, et al. Measurement and organization of therapeutic practice elements in a youth community mental health setting. Psychiatric Services 2012; 63: 343–350. DOI: 10.1176/appi.ps.201100129 CrossRefPubMed

31.

Nakamura BJ, Higa-McMillan CK, Okamura KH, et al. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Administration and Policy in Mental Health and Mental Health Services Research 2011; 38: 287–300. DOI: 10.1007/s10488-011-0351-2

32.

Lim A, Nakamura BJ, Higa-McMillan CK., et al. Effects of workshop trainings on evidence-based practice knowledge and attitudes among youth community mental health providers. Behaviour Research and Therapy 2012; 50(6): 397–406. DOI: 10.1016/j.brat.2012.03.008

33.

Jensen-Doss A, Hawley KM. Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child and Adolescent Psychology 2010; 39: 885–896. DOI: 10.1080/15374416.2010.517169 CrossRefPubMedPubMedCentral

34.

Jensen-Doss A, Hawley KM. Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research 2011; 38, 476–485. DOI: 10.1007/s10488-011-0334-3 CrossRefPubMed

35.

Jensen-Doss A, Hawley KM, Lopez M, et al. Using evidence-based treatments: The experiences of youth providers working under a mandate. Professional Psychology: Research and Practice 2009; 40(4): 417–424. DOI: 10.1037/a0014690

36.

37.

Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Mental Health Services Research 2004; 6: 61–74. DOI: 10.1023/B:MHSR.0000024351.12294.65.CrossRefPubMedPubMedCentral

38.

Aarons GA, Glisson C, Hoagwood K, et al. Research Network on Youth Mental Health. Psychometric properties and U.S. National norms of the Evidence‐Based Practice Attitude Scale (EBPAS). Psychological Assessment 2010; 22(2): 356–365. DOI:10.1037/a0019188

39.

Borntrager CF, Chorpita BF, Higa-McMillan CK, et al. Provider attitudes toward evidence-based practices: Are the concerns with the evidence or with the manuals? Psychiatric Services 2009; 60: 677–681. DOI: 10.1176/appi.ps.60.5.677.

40.

SPSS, Inc. PASW® Statistics 18 Core System User’s Guide: Prentice Hall, 2010.

41.

Little RJA, Rubin DB. Statistical Analysis with Missing Data. Wiley, New York, 1987.

42.

Cohen J. Quantitative methods in psychology: A power primer. Psychological Bulletin 1992; 112: 155–159.CrossRefPubMed

43.

Comrey AL, Lee HB. A first course in factor analysis (Second edition). Hillsdale, NJ: Erlbaum, 1992.

44.

Cattell RB. The scree test for the number of factors. Multivariate Behavioral Research 1966; 1: 245–276. DOI: 10.1207/s15327906mbr0102_10.CrossRefPubMed

45.

Nunnally JC. Psychometric Theory: Second Edition. New York: McGraw Hill, 1978.

46.

Tabachnick BG, Fidell LS. Using Multivariate Statistics, Sixth Edition. Needham Heights, MA: Allyn & Bacon, 2007.

47.

Garland AF, Brookman-Frazee L, Hurlburt M, et al. Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services 2010; 61(8): 788–795. DOI: 10.1176/appi.ps.61.8.788

48.

Borntrager C, Chorpita BF, Higa-McMillan CK, et al. Usual care for trauma-exposed youth: Are clinician-reported therapy techniques evidence-based? Children and Youth Services Review 2013; 35: 133–141. doi:10.1016/j.childyouth.2012.09.018

Title: An Exploratory Factor Analysis of the Knowledge of Evidence-Based Services Questionnaire
Authors: Kelsie H. Okamura, MA
Brad J. Nakamura, PhD
Charles Mueller, PhD
Kentaro Hayashi, PhD
Charmaine K. Higa McMillan, PhD
Publication date: 01-04-2016
Publisher: Springer US
Published in: The Journal of Behavioral Health Services & Research / Issue 2/2016
Print ISSN: 1094-3412
Electronic ISSN: 2168-6793
DOI: https://doi.org/10.1007/s11414-013-9384-5

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

An Exploratory Factor Analysis of the Knowledge of Evidence-Based Services Questionnaire

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2016

Erratum to: Gender and Race/Ethnicity Differences in Mental Health Care Use Before and During the Great Recession

Latinos’ Access to Online and Formal Mental Health Support

Innovative Graduate Research Education for Advancement of Implementation Science in Adolescent Behavioral Health

How Community Organizations Promote Continuity of Care for Young People with Mental Health Problems

The State and Sustainability of Telepsychiatry Programs

Gender and Race/Ethnicity Differences in Mental Health Care Use before and during the Great Recession