Skip to main content
Top
Published in: BMC Health Services Research 1/2009

Open Access 01-12-2009 | Research article

Development and assessment of the Alberta Context Tool

Authors: Carole A Estabrooks, Janet E Squires, Greta G Cummings, Judy M Birdsell, Peter G Norton

Published in: BMC Health Services Research | Issue 1/2009

Login to get access

Abstract

Background

The context of healthcare organizations such as hospitals is increasingly accepted as having the potential to influence the use of new knowledge. However, the mechanisms by which the organizational context influences evidence-based practices are not well understood. Current measures of organizational context lack a theory-informed approach, lack construct clarity and generally have modest psychometric properties. This paper presents the development and initial psychometric validation of the Alberta Context Tool (ACT), an eight dimension measure of organizational context for healthcare settings.

Methods

Three principles guided the development of the ACT: substantive theory, brevity, and modifiability. The Promoting Action on Research Implementation in Health Services (PARiHS) framework and related literature were used to guide selection of items in the ACT. The ACT was required to be brief enough to be tolerated in busy and resource stretched work settings and to assess concepts of organizational context that were potentially modifiable. The English version of the ACT was completed by 764 nurses (752 valid responses) working in seven Canadian pediatric care hospitals as part of its initial validation. Cronbach's alpha, exploratory factor analysis, analysis of variance, and tests of association were used to assess instrument reliability and validity.

Results

Factor analysis indicated a 13-factor solution (accounting for 59.26% of the variance in 'organizational context'). The composition of the factors was similar to those originally conceptualized. Cronbach's alpha for the 13 factors ranged from .54 to .91 with 4 factors performing below the commonly accepted alpha cut off of .70. Bivariate associations between instrumental research utilization levels (which the ACT was developed to predict) and the ACT's 13 factors were statistically significant at the 5% level for 12 of the 13 factors. Each factor also showed a trend of increasing mean score ranging from the lowest level to the highest level of instrumental research use, indicating construct validity.

Conclusions

To date, no completely satisfactory measures of organizational context are available for use in healthcare. The ACT assesses several core domains to provide a comprehensive account of organizational context in healthcare settings. The tool's strengths are its brevity (allowing it to be completed in busy healthcare settings) and its focus on dimensions of organizational context that are modifiable. Refinements of the instrument for acute, long term care, and home care settings are ongoing.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rycroft-Malone J: The PARIHS framework - A framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004, 19 (4): 297-304.CrossRefPubMed Rycroft-Malone J: The PARIHS framework - A framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004, 19 (4): 297-304.CrossRefPubMed
2.
go back to reference Wallin L, Estabrooks CA, Midodzi WK, Cummings GG: Development and validation of a derived measure of research utilization by nurses. Nurs Res. 2006, 55 (3): 149-160. 10.1097/00006199-200605000-00001.CrossRefPubMed Wallin L, Estabrooks CA, Midodzi WK, Cummings GG: Development and validation of a derived measure of research utilization by nurses. Nurs Res. 2006, 55 (3): 149-160. 10.1097/00006199-200605000-00001.CrossRefPubMed
3.
go back to reference Dopson S, FitzGerald L, Ferlie E, Gabbay J, Locock L: No magic targets! Changing clinical practice to become more evidence based. Health Care Manage Rev. 2002, 27 (3): 35-47.CrossRefPubMed Dopson S, FitzGerald L, Ferlie E, Gabbay J, Locock L: No magic targets! Changing clinical practice to become more evidence based. Health Care Manage Rev. 2002, 27 (3): 35-47.CrossRefPubMed
4.
go back to reference Meijers JM, Janssen MA, Cummings GG, Wallin L, Estabrooks CA, R H: Assessing the relationships between contextual factors and research utilization in nursing: Systematic literature review. J Adv Nurs. 2006, 55 (5): 622-635. 10.1111/j.1365-2648.2006.03954.x.CrossRefPubMed Meijers JM, Janssen MA, Cummings GG, Wallin L, Estabrooks CA, R H: Assessing the relationships between contextual factors and research utilization in nursing: Systematic literature review. J Adv Nurs. 2006, 55 (5): 622-635. 10.1111/j.1365-2648.2006.03954.x.CrossRefPubMed
6.
go back to reference Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: Literature review and Delphi study. Int J Qual Health Care. 2004, 16 (2): 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: Literature review and Delphi study. Int J Qual Health Care. 2004, 16 (2): 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed
7.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
8.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: Effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed Grol R, Grimshaw J: From best evidence to best practice: Effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed
9.
go back to reference Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: A conceptual framework. Qual Saf Health Care. 1998, 7 (3): 149-158. 10.1136/qshc.7.3.149.CrossRef Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: A conceptual framework. Qual Saf Health Care. 1998, 7 (3): 149-158. 10.1136/qshc.7.3.149.CrossRef
10.
go back to reference Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C: Ingredients for change: Revisiting a conceptual framework. Qual Saf Health Care. 2002, 11 (2): 174-180. 10.1136/qhc.11.2.174.CrossRefPubMedPubMedCentral Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C: Ingredients for change: Revisiting a conceptual framework. Qual Saf Health Care. 2002, 11 (2): 174-180. 10.1136/qhc.11.2.174.CrossRefPubMedPubMedCentral
11.
go back to reference McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K: Getting evidence into practice: The meaning of 'context'. J Adv Nurs. 2002, 38 (1): 94-104. 10.1046/j.1365-2648.2002.02150.x.CrossRefPubMed McCormack B, Kitson A, Harvey G, Rycroft-Malone J, Titchen A, Seers K: Getting evidence into practice: The meaning of 'context'. J Adv Nurs. 2002, 38 (1): 94-104. 10.1046/j.1365-2648.2002.02150.x.CrossRefPubMed
12.
go back to reference Schein EH: Organizational Culture and Leadership. 1985, San Francisco: Jossey-Bass Publishers Schein EH: Organizational Culture and Leadership. 1985, San Francisco: Jossey-Bass Publishers
13.
go back to reference Wright J, McCormack B, Coffey A, McCarthy G: Evaluating the context within which continence care is provided in rehabilitation units for older people. International Journal of Older People Nursing. 2007, 2 (1): 9-19. 10.1111/j.1748-3743.2007.00046.x.CrossRefPubMed Wright J, McCormack B, Coffey A, McCarthy G: Evaluating the context within which continence care is provided in rehabilitation units for older people. International Journal of Older People Nursing. 2007, 2 (1): 9-19. 10.1111/j.1748-3743.2007.00046.x.CrossRefPubMed
14.
go back to reference Goleman D, Boyatzis RE, McKee A: The New Leaders: Transforming the Art of Leadership into the Science of Results. 2002, London: Little, Brown Goleman D, Boyatzis RE, McKee A: The New Leaders: Transforming the Art of Leadership into the Science of Results. 2002, London: Little, Brown
15.
go back to reference Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004, 13 (8): 913-924. 10.1111/j.1365-2702.2004.01007.x.CrossRefPubMed Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2004, 13 (8): 913-924. 10.1111/j.1365-2702.2004.01007.x.CrossRefPubMed
16.
go back to reference Estabrooks CA, Squires JE, Adachi AM, Kong L, Norton PG: Utilization of Health Research in Acute Care Settings in Alberta Technical Report. 2008, Edmonton: Faculty of Nursing, University of Alberta Estabrooks CA, Squires JE, Adachi AM, Kong L, Norton PG: Utilization of Health Research in Acute Care Settings in Alberta Technical Report. 2008, Edmonton: Faculty of Nursing, University of Alberta
17.
go back to reference Acock AC: Working with missing data. Family Science Review. 1997, 10 (1): 76-102. Acock AC: Working with missing data. Family Science Review. 1997, 10 (1): 76-102.
18.
go back to reference Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to their Development and Use. 2003, Oxford: Oxford University Press, 3 Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to their Development and Use. 2003, Oxford: Oxford University Press, 3
19.
go back to reference Thompson B: Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications. 2004, Washington, DC: American Psychological AssociationCrossRef Thompson B: Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications. 2004, Washington, DC: American Psychological AssociationCrossRef
20.
go back to reference Kline P: An Easy Guide to Factor Analysis. 1994, London: Routledge Kline P: An Easy Guide to Factor Analysis. 1994, London: Routledge
21.
go back to reference Nunnally J, Bernstein I: Psychometric Theory. 1994, New York: McGraw-Hill, 3 Nunnally J, Bernstein I: Psychometric Theory. 1994, New York: McGraw-Hill, 3
22.
go back to reference Betz NE: Test construction. The Psychology Research Handbook: A Guide for Graduate Students and Research Assistants. Edited by: Leong FTL, Austin JT. 2000, Thousand Oaks, CA: Sage Publications, 239-250. Betz NE: Test construction. The Psychology Research Handbook: A Guide for Graduate Students and Research Assistants. Edited by: Leong FTL, Austin JT. 2000, Thousand Oaks, CA: Sage Publications, 239-250.
23.
go back to reference Angus J, Hodnett E, O'Brien-Pallas L: Implementing evidence-based nursing practice: A tale of two intrapartum nursing units. Nurs Inq. 2003, 10 (4): 218-228. 10.1046/j.1440-1800.2003.00193.x.CrossRefPubMed Angus J, Hodnett E, O'Brien-Pallas L: Implementing evidence-based nursing practice: A tale of two intrapartum nursing units. Nurs Inq. 2003, 10 (4): 218-228. 10.1046/j.1440-1800.2003.00193.x.CrossRefPubMed
24.
go back to reference Hunt M: The process of translating research findings into practice. J Adv Nurs. 1987, 12: 101-110. 10.1111/j.1365-2648.1987.tb01308.x.CrossRefPubMed Hunt M: The process of translating research findings into practice. J Adv Nurs. 1987, 12: 101-110. 10.1111/j.1365-2648.1987.tb01308.x.CrossRefPubMed
25.
go back to reference Davies S, McDonnell A, Brown J, Shewan J: Practice nurses' use of evidence-based research. Nurs Times. 1999, 95 (4): 57-60.PubMed Davies S, McDonnell A, Brown J, Shewan J: Practice nurses' use of evidence-based research. Nurs Times. 1999, 95 (4): 57-60.PubMed
26.
go back to reference Estabrooks CA, Midodzi WK, Cummings GG, Wallin L: Predicting research use in nursing organizations: A multilevel analysis. Nurs Res. 2007, 56 (4 Suppl): S7-23. 10.1097/01.NNR.0000280647.18806.98.CrossRefPubMed Estabrooks CA, Midodzi WK, Cummings GG, Wallin L: Predicting research use in nursing organizations: A multilevel analysis. Nurs Res. 2007, 56 (4 Suppl): S7-23. 10.1097/01.NNR.0000280647.18806.98.CrossRefPubMed
27.
go back to reference Ferlie E, Fitzgerald , Wood M: Getting evidence into clincial practice: An organisational behaviour perspective. J Health Serv Res Policy. 2000, 5 (2): 96-102.PubMed Ferlie E, Fitzgerald , Wood M: Getting evidence into clincial practice: An organisational behaviour perspective. J Health Serv Res Policy. 2000, 5 (2): 96-102.PubMed
28.
go back to reference Estabrooks CA: The conceptual structure of research utilization. Res Nurs Health. 1999, 22 (3): 203-216. 10.1002/(SICI)1098-240X(199906)22:3<203::AID-NUR3>3.0.CO;2-9.CrossRefPubMed Estabrooks CA: The conceptual structure of research utilization. Res Nurs Health. 1999, 22 (3): 203-216. 10.1002/(SICI)1098-240X(199906)22:3<203::AID-NUR3>3.0.CO;2-9.CrossRefPubMed
29.
go back to reference Estabrooks CA, Kenny DJ, Cummings GG, Adewale AJ, Mallidou AA: A comparison of research utilization among nurses working in Canadian civilian and United States Army healthcare settings. Res Nurs Health. 2007, 30 (3): 282-296. 10.1002/nur.20218.CrossRefPubMed Estabrooks CA, Kenny DJ, Cummings GG, Adewale AJ, Mallidou AA: A comparison of research utilization among nurses working in Canadian civilian and United States Army healthcare settings. Res Nurs Health. 2007, 30 (3): 282-296. 10.1002/nur.20218.CrossRefPubMed
30.
go back to reference Estabrooks CA, Scott S, Squires JE, Stevens B, O'Brien-Pallas L, Watt-Watson J, Profetto-McGrath J, McGilton K, Golden-Biddle K, Lander J, et al: Patterns of research utilization on patient care units. Implement Sci. 2008, 3: 31-10.1186/1748-5908-3-31.CrossRefPubMedPubMedCentral Estabrooks CA, Scott S, Squires JE, Stevens B, O'Brien-Pallas L, Watt-Watson J, Profetto-McGrath J, McGilton K, Golden-Biddle K, Lander J, et al: Patterns of research utilization on patient care units. Implement Sci. 2008, 3: 31-10.1186/1748-5908-3-31.CrossRefPubMedPubMedCentral
31.
go back to reference Glick WH: Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Acad Manage Rev. 1985, 10 (3): 601-616. 10.2307/258140. Glick WH: Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Acad Manage Rev. 1985, 10 (3): 601-616. 10.2307/258140.
32.
go back to reference Rosenthal R, Rosnow RL: Essentials of Behavioural Research: Methods and Data Analysis. 1991, New York: McGraw Hill, 2 Rosenthal R, Rosnow RL: Essentials of Behavioural Research: Methods and Data Analysis. 1991, New York: McGraw Hill, 2
33.
go back to reference Keppel G: Design & Analysis: A Researcher's Handbook. 1991, Englewood Cliffs, NJ: Prentice-Hall, 3 Keppel G: Design & Analysis: A Researcher's Handbook. 1991, Englewood Cliffs, NJ: Prentice-Hall, 3
35.
go back to reference Klein KJ, Conn AB, Smith DB, Sorra JS: Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. J Appl Psychol. 2001, 86 (1): 3-16. 10.1037/0021-9010.86.1.3.CrossRefPubMed Klein KJ, Conn AB, Smith DB, Sorra JS: Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. J Appl Psychol. 2001, 86 (1): 3-16. 10.1037/0021-9010.86.1.3.CrossRefPubMed
36.
go back to reference Vogus TJ, Sutcliffe KM: The Safety Organizing Scale: Development and validation of a behavioral measure of safety culture in hospital nursing units. Med Care. 2007, 45 (1): 46-54. 10.1097/01.mlr.0000244635.61178.7a.CrossRefPubMed Vogus TJ, Sutcliffe KM: The Safety Organizing Scale: Development and validation of a behavioral measure of safety culture in hospital nursing units. Med Care. 2007, 45 (1): 46-54. 10.1097/01.mlr.0000244635.61178.7a.CrossRefPubMed
37.
go back to reference Bliese PD: Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. Multilevel Theory, Research and Methods in Organizations: Foundations, Extensions and New Directions. Edited by: Klein KJ, Kozlowski SWJ. 2000, San Francisco: Jossey-Bass, 349-381. Bliese PD: Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. Multilevel Theory, Research and Methods in Organizations: Foundations, Extensions and New Directions. Edited by: Klein KJ, Kozlowski SWJ. 2000, San Francisco: Jossey-Bass, 349-381.
38.
go back to reference Young TL, Kirchdoerfer LJ, Osterhaus JT: A development and validation process for a disease-specific quality of life instrument. Drug Inf J. 1996, 30 (1): 185-193. Young TL, Kirchdoerfer LJ, Osterhaus JT: A development and validation process for a disease-specific quality of life instrument. Drug Inf J. 1996, 30 (1): 185-193.
Metadata
Title
Development and assessment of the Alberta Context Tool
Authors
Carole A Estabrooks
Janet E Squires
Greta G Cummings
Judy M Birdsell
Peter G Norton
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2009
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-9-234

Other articles of this Issue 1/2009

BMC Health Services Research 1/2009 Go to the issue