Skip to main content
Top
Published in: Health Research Policy and Systems 1/2015

Open Access 01-12-2015 | Research

Psychometric properties of the Dutch version of the Evidence-Based Practice Attitude Scale (EBPAS)

Authors: Maartje A. M. S. van Sonsbeek, Giel J. M. Hutschemaekers, Jan W. Veerman, Marloes Kleinjan, Gregory A. Aarons, Bea G. Tiemens

Published in: Health Research Policy and Systems | Issue 1/2015

Login to get access

Abstract

Background

The Evidence-Based Practice Attitude Scale (EBPAS) was developed in the United States to assess attitudes of mental health and welfare professionals toward evidence-based interventions. Although the EBPAS has been translated in different languages and is being used in several countries, all research on the psychometric properties of the EBPAS within youth care has been carried out in the United States. The purpose of this study was to investigate the psychometric properties of the Dutch version of the EBPAS.

Methods

After translation into Dutch, the Dutch version of the EBPAS was examined in a diverse sample of 270 youth care professionals working in five institutions in the Netherlands. We examined the factor structure with both exploratory and confirmatory factor analyses and the internal consistency reliability. We also conducted multiple linear regression analyses to examine the association of EBPAS scores with professionals’ characteristics. It was hypothesized that responses to the EBPAS items could be explained by one general factor plus four specific factors, good to excellent internal consistency reliability would be found, and EBPAS scores would vary by age, sex, and educational level.

Results

The exploratory factor analysis suggested a four-factor solution according to the hypothesized dimensions: Requirements, Appeal, Openness, and Divergence. Cronbach’s alphas ranged from 0.67 to 0.89, and the overall scale alpha was 0.72. The confirmatory factor analyses confirmed the factor structure and suggested that the lower order EBPAS factors are indicators of a higher order construct. However, Divergence was not significantly correlated with any of the subscales or the total score. The confirmatory bifactor analysis endorsed that variance was explained both by a general attitude towards evidence-based interventions and by four specific factors. The regression analyses showed an association between EBPAS scores and youth care professionals’ age, sex, and educational level.

Conclusions

The present study provides strong support for a structure with a general factor plus four specific factors and internal consistency reliability of the Dutch version of the EBPAS in a diverse sample of youth care professionals. Hence, the factor structure and reliability of the original version of the EBPAS seem generalizable to the Dutch version of the EBPAS.
Literature
1.
go back to reference Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based practice attitude scale-50. Admin Pol Ment Health. 2012;39(5):331–40. doi:10.1007/s10488-010-0302-3.CrossRef Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based practice attitude scale-50. Admin Pol Ment Health. 2012;39(5):331–40. doi:10.​1007/​s10488-010-0302-3.CrossRef
3.
go back to reference Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. Br Med J. 1996;312(7023):71–2.CrossRef Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. Br Med J. 1996;312(7023):71–2.CrossRef
4.
go back to reference Barnoski R. Outcome evaluation of Washington State’s research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy; 2004. Barnoski R. Outcome evaluation of Washington State’s research-based programs for juvenile offenders. Olympia, WA: Washington State Institute for Public Policy; 2004.
5.
go back to reference Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA, et al. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7:56. doi:10.1186/1748-5908-7-56.CrossRefPubMedPubMedCentral Aarons GA, Glisson C, Green PD, Hoagwood K, Kelleher KJ, Landsverk JA, et al. The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study. Implement Sci. 2012;7:56. doi:10.​1186/​1748-5908-7-56.CrossRefPubMedPubMedCentral
6.
go back to reference Bickman L. A measurement feedback system (MFS) is necessary to improve mental health outcomes. J Am Acad Child Adolesc Psychiatry. 2008;47(10):1114–9.CrossRefPubMed Bickman L. A measurement feedback system (MFS) is necessary to improve mental health outcomes. J Am Acad Child Adolesc Psychiatry. 2008;47(10):1114–9.CrossRefPubMed
7.
go back to reference Bickman L, Kelley SD, Breda C, de Andrade AR, Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiat Serv. 2011;62(12):1423–9.CrossRef Bickman L, Kelley SD, Breda C, de Andrade AR, Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiat Serv. 2011;62(12):1423–9.CrossRef
8.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
9.
11.
go back to reference Damanpour F. Organizational innovation: a meta-analysis of effects of determinants and moderators. Acad Manage J. 1991;34(3):555–90.CrossRef Damanpour F. Organizational innovation: a meta-analysis of effects of determinants and moderators. Acad Manage J. 1991;34(3):555–90.CrossRef
12.
go back to reference Frambach RT, Schillewaert N. Organizational innovation adoption: a multi-level framework of determinants and opportunities for future research. J Bus Res. 2002;55(2):163–76.CrossRef Frambach RT, Schillewaert N. Organizational innovation adoption: a multi-level framework of determinants and opportunities for future research. J Bus Res. 2002;55(2):163–76.CrossRef
15.
go back to reference Olson JM, Stone J. The influence of behavior on attitudes. In: Albarracín D, Johnson BT, Zanna MP, editors. The handbook of attitudes. Mahwah, NJ: Lawrence Erlbaum Associates Publishers; 2005. p. 223–71. Olson JM, Stone J. The influence of behavior on attitudes. In: Albarracín D, Johnson BT, Zanna MP, editors. The handbook of attitudes. Mahwah, NJ: Lawrence Erlbaum Associates Publishers; 2005. p. 223–71.
16.
go back to reference Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;22(2):356–65. doi:10.1037/a0019188.CrossRefPubMed Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychol Assess. 2010;22(2):356–65. doi:10.​1037/​a0019188.CrossRefPubMed
17.
go back to reference Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a geographically diverse sample of community mental health providers. Admin Pol Ment Health. 2007;34(5):465–9. doi:10.1007/s10488-007-0127-x.CrossRef Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene CM. Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a geographically diverse sample of community mental health providers. Admin Pol Ment Health. 2007;34(5):465–9. doi:10.​1007/​s10488-007-0127-x.CrossRef
18.
go back to reference Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.CrossRefPubMedPubMedCentral Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.CrossRefPubMedPubMedCentral
19.
go back to reference McColl A, Smith H, White P, Field J. General practitioners’ perceptions of the route to evidence based medicine: a questionnaire survey. Brit Med J. 1998;316(7128):361–5.CrossRefPubMedPubMedCentral McColl A, Smith H, White P, Field J. General practitioners’ perceptions of the route to evidence based medicine: a questionnaire survey. Brit Med J. 1998;316(7128):361–5.CrossRefPubMedPubMedCentral
21.
go back to reference Melas CD, Zampetakis LA, Dimopoulou A, Moustakis V. Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychol Assess. 2012;24(4):867–76. doi:10.1037/a0027445.CrossRefPubMed Melas CD, Zampetakis LA, Dimopoulou A, Moustakis V. Evaluating the properties of the Evidence-Based Practice Attitude Scale (EBPAS) in health care. Psychol Assess. 2012;24(4):867–76. doi:10.​1037/​a0027445.CrossRefPubMed
24.
go back to reference Aarons GA. Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiat Serv. 2006;57(8):1162–9.CrossRef Aarons GA. Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiat Serv. 2006;57(8):1162–9.CrossRef
26.
go back to reference Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, et al. Individual and organizational predictors of community therapists’ use of evidence-based practices in a large public mental health system. JAMA Psychiatry. 2015. Ahead of print. Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, et al. Individual and organizational predictors of community therapists’ use of evidence-based practices in a large public mental health system. JAMA Psychiatry. 2015. Ahead of print.
27.
go back to reference Lopez MA, Osterberg LD, Jensen-Doss A, Rae WA. Effects of workshop training for providers under mandated use of an evidence-based practice. Admin Pol Ment Health. 2011;38(4):301–12. doi:10.1007/s10488-010-0326-8.CrossRef Lopez MA, Osterberg LD, Jensen-Doss A, Rae WA. Effects of workshop training for providers under mandated use of an evidence-based practice. Admin Pol Ment Health. 2011;38(4):301–12. doi:10.​1007/​s10488-010-0326-8.CrossRef
28.
go back to reference Gioia D. Using an organizational change model to qualitatively understand practitioner adoption of evidence-based practice in community mental health. Best Pract Ment Health. 2007;3(1):1–15. Gioia D. Using an organizational change model to qualitatively understand practitioner adoption of evidence-based practice in community mental health. Best Pract Ment Health. 2007;3(1):1–15.
30.
go back to reference Nakamura BJ, Higa-McMillan CK, Okamura KH, Shimabukuro S. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Admin Pol Ment Health. 2011;38(4):287–300. doi:10.1007/s10488-011-0351-2.CrossRef Nakamura BJ, Higa-McMillan CK, Okamura KH, Shimabukuro S. Knowledge of and attitudes towards evidence-based practices in community child mental health practitioners. Admin Pol Ment Health. 2011;38(4):287–300. doi:10.​1007/​s10488-011-0351-2.CrossRef
32.
go back to reference Aarons GA, Green A, Miller E. Researching readiness for implementation of evidence-based practice: a comprehensive review of the Evidence-Based Practice Attitude Scale (EBPAS). In: Kelly B, Perkins D, editors. Cambridge handbook of implementation science for psychology in education: how to promote evidence based practice. Cambridge: Cambridge University Press; 2012. Aarons GA, Green A, Miller E. Researching readiness for implementation of evidence-based practice: a comprehensive review of the Evidence-Based Practice Attitude Scale (EBPAS). In: Kelly B, Perkins D, editors. Cambridge handbook of implementation science for psychology in education: how to promote evidence based practice. Cambridge: Cambridge University Press; 2012.
33.
go back to reference Sareen J, Jagdeo A, Cox B, Clara I, ten Have M, Belik S-L, et al. Perceived barriers to mental health service utilization in the United States, Ontario, and the Netherlands. Psychiat Serv. 2007;58(3):357–64.CrossRef Sareen J, Jagdeo A, Cox B, Clara I, ten Have M, Belik S-L, et al. Perceived barriers to mental health service utilization in the United States, Ontario, and the Netherlands. Psychiat Serv. 2007;58(3):357–64.CrossRef
34.
go back to reference NetQuestionnaires Nederland BV. NetQuestionnaires, Version 6.5. Amsterdam: NETQ Insights B.V., Released; 2002. NetQuestionnaires Nederland BV. NetQuestionnaires, Version 6.5. Amsterdam: NETQ Insights B.V., Released; 2002.
35.
go back to reference IBM Corp. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp; 2011. IBM Corp. IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp; 2011.
36.
go back to reference Muthén LK, Muthén BO. Mplus User’s Guide. Seventh Edition. Los Angeles, CA: Muthén & Muthén; 1998–2012 Muthén LK, Muthén BO. Mplus User’s Guide. Seventh Edition. Los Angeles, CA: Muthén & Muthén; 1998–2012
37.
go back to reference Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272.CrossRef Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272.CrossRef
38.
go back to reference Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994. Nunnally J, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
39.
go back to reference Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Allyn and Bacon; 2007. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Allyn and Bacon; 2007.
45.
go back to reference Lauteslager M. Wetenschap, akkoord, maar welke wetenschap? Het EBP-debat dat maar geen debat wil worden. Tijdschr Psychother. 2011;37(4):276–93.CrossRef Lauteslager M. Wetenschap, akkoord, maar welke wetenschap? Het EBP-debat dat maar geen debat wil worden. Tijdschr Psychother. 2011;37(4):276–93.CrossRef
46.
go back to reference Lauteslager M. Wetenschap, akkoord, maar welke wetenschap? Psychotherapie als bouwpakket of trukendoos. Tijdschr Psychother. 2011;37(5):350–66.CrossRef Lauteslager M. Wetenschap, akkoord, maar welke wetenschap? Psychotherapie als bouwpakket of trukendoos. Tijdschr Psychother. 2011;37(5):350–66.CrossRef
48.
go back to reference van der Zwet RJM, Beneken genaamd Kolmer DM, Schalk R. Social workers’ orientation toward the evidence-based practice process: a Dutch survey. Research on Social Work Practice. 2014. doi:10.1177/1049731514540340 van der Zwet RJM, Beneken genaamd Kolmer DM, Schalk R. Social workers’ orientation toward the evidence-based practice process: a Dutch survey. Research on Social Work Practice. 2014. doi:10.1177/1049731514540340
Metadata
Title
Psychometric properties of the Dutch version of the Evidence-Based Practice Attitude Scale (EBPAS)
Authors
Maartje A. M. S. van Sonsbeek
Giel J. M. Hutschemaekers
Jan W. Veerman
Marloes Kleinjan
Gregory A. Aarons
Bea G. Tiemens
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2015
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-015-0058-z

Other articles of this Issue 1/2015

Health Research Policy and Systems 1/2015 Go to the issue