Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
BMC Medical Informatics and Decision Making
Published in: BMC Medical Informatics and Decision Making 1/2016

Open Access 01-12-2016 | Research article

Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations

Authors: Caitlyn Timmings, Sobia Khan, Julia E. Moore, Christine Marquez, Kasha Pyka, Sharon E. Straus

Published in: BMC Medical Informatics and Decision Making | Issue 1/2016

Login to get access

Abstract

Background

To address challenges related to selecting a valid, reliable, and appropriate readiness assessment measure in practice, we developed an online decision support tool to aid frontline implementers in healthcare settings in this process. The focus of this paper is to describe a multi-step, end-user driven approach to developing this tool for use during the planning stages of implementation.

Methods

A multi-phase, end-user driven approach was used to develop and test the usability of a readiness decision support tool. First, readiness assessment measures that are valid, reliable, and appropriate for healthcare settings were identified from a systematic review. Second, a mapping exercise was performed to categorize individual items of included measures according to key readiness constructs from an existing framework. Third, a modified Delphi process was used to collect stakeholder ratings of the included measures on domains of feasibility, relevance, and likelihood to recommend. Fourth, two versions of a decision support tool prototype were developed and evaluated for usability.

Results

Nine valid and reliable readiness assessment measures were included in the decision support tool. The mapping exercise revealed that of the nine measures, most measures (78 %) focused on assessing readiness for change at the organizational versus the individual level, and that four measures (44 %) represented all constructs of organizational readiness. During the modified Delphi process, stakeholders rated most measures as feasible and relevant for use in practice, and reported that they would be likely to recommend use of most measures. Using data from the mapping exercise and stakeholder panel, an algorithm was developed to link users to a measure based on characteristics of their organizational setting and their readiness for change assessment priorities. Usability testing yielded recommendations that were used to refine the Ready, Set, Change! decision support tool .

Conclusions

Ready, Set, Change! decision support tool is an implementation support that is designed to facilitate the routine incorporation of a readiness assessment as an early step in implementation. Use of this tool in practice may offer time and resource-saving implications for implementation.
Appendix
Available only for authorised users
Literature
1.
Davis D, Evans M, Jadad A, Perrier L, Rath D, Ryan D, et al. The case for KT: shortening the journey from evidence to effect. BMJ. 2003;327(7405):33–5.PubMedCentralCrossRefPubMed
2.
Devereaux MW, Drynan AK, Lowry S, MacLennan D, Figdor M, Fancott C, et al. Evaluating organizational readiness for change: A preliminary mixed-model assessment of an interprofessional rehabilitation hospital. Healthc Q. 2006;9(4):66–74.CrossRefPubMed
3.
4.
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13–24.CrossRefPubMed
5.
6.
Leeman J, Calancie L, Hartman MA, Escoffery CT, Herrmann AK, Tague LE, et al. What strategies are used to build practitioners¿ capacity to implement community-based interventions and are they effective?: A systematic review. Implement Sci. 2015;10(1):80.PubMedCentralCrossRefPubMed
7.
Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42.PubMedCentralCrossRefPubMed
8.
Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet. 2014;383(9912):156–65.CrossRefPubMed
9.
10.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.PubMedCentralCrossRefPubMed
11.
Fixsen DL, Naoom SF, Blase KA, Friedman RM. Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231); 2005.
12.
Straus SE, Tetroe J, Graham ID. Knowledge translation in health care: Moving from evidence to practice. 2nd ed. West Sussex, UK: Wiley; 2013.CrossRef
13.
Kotter JP. Leading Change. New Boston: Harvard Business Press; 1996.
14.
Jones RA, Jimmieson NL, Griffiths A. The impact of organizational culture and reshaping capabilities on change implementation success: the mediating role of readiness for change. J Manag Stud. 2005;42(2):361–86.CrossRef
15.
Amataykul M. EHR? Assess readiness first. Healthc Financ Manage. 2005;59(5):112–3.
16.
Holt DT, Helfrich CD, Hall CG, Weiner BJ. Are you ready? How health professionals can comprehensively conceptualize readiness for change. J Gen Intern Med. 2010;25(1):50–5.PubMedCentralCrossRefPubMed
17.
Jennett PA, Gagnon MP, Brandstadt HK. Preparing for success: Readiness models for rural telehealth. J Postgrad Med. 2005;51:279–85.PubMed
18.
Weiner BJ, Amick H, Lee SYD. Conceptualization and measurement of organizational readiness for change. Med Care Res Rev. 2008;65(4):379–436.CrossRefPubMed
19.
Attieh R, Gagnon MP, Estabrooks CA, Légaré F, Ouimet M, Roch G, et al. Organizational readiness for knowledge translation in chronic care: a review of theoretical components. Implement Sci. 2013;8:138.PubMedCentralCrossRefPubMed
20.
Khan S, Timmings C, Moore JE, Marquez C, Pyka K, Gheihman G, et al. The development of an online decision support tool for organizational readiness for change. Implement Sci. 2014;9:56.PubMedCentralCrossRefPubMed
21.
22.
Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 1979;86(2):420.CrossRefPubMed
23.
Müller R, Büttner P. A critical discussion of intraclass correlation coefficients. Stat Med. 1994;13(23–24):2465–76.CrossRefPubMed
24.
Saldana L, Chamberlain P, Wang W, Brown H. Predicting program start-up using the stages of implementation measure. Administration Policy Mental Health Res. 2012;39:419–25.CrossRef
25.
Jones J, Hunter D. Consensus methods for medical and health services research. Br Med J. 1995;311:376–80.CrossRef
26.
Kastner M, Lottridge D, Marquez C, Newton D, Straus SE. Usability evaluation of a clinical decision support tool for osteoporosis disease management. Implement Sci. 2010;5(1):96.PubMedCentralCrossRefPubMed
27.
Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Inter J of Human-Com Interaction. 2008;24(6):574–94.CrossRef
28.
29.
Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess R, editors. Analyzing Qualitative Data. London: Routledge; 1994. p. 173–94.CrossRef
30.
Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
31.
32.
33.
34.
35.
36.
Holt DT, Armenakis AA, Feild HS, Harris SG. Readiness for organizational change: The systematic development of a scale. J Applied Behav Sci. 2007;43(2):232–55.CrossRef
37.
Eby LT, Adams DM, Russell JEA, Gaby SH. Perceptions of organizational readiness for change: Factors related to employees’ reactions to the implementation of team-based selling. Human Relations. 2000;53(3):419–42.CrossRef
38.
Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abus Treat. 2002;22(4):197–209.CrossRef
39.
Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009;4(38):38.PubMedCentralCrossRefPubMed
40.
Cherry B. Assessing organizational readiness for electronic health record adoption in long-term care facilities. J Gerontol Nurs. 2011;37(10):14–9.CrossRefPubMed
41.
Anderson N, West M. Team Climate Inventory. Berkshire: NFER-NELSON Publishing Company Ltd; 1994.
42.
Bobiak SN, Zyzanski SJ, Ruhe MC, Carter CA, Ragan B, Flocke SA, et al. Measuring practice capacity for change: a tool for guiding quality improvement in primary care settings. Qual Manage Healthcare. 2009;18(4):278–84.
43.
Armenakis AA, Harris SG, Mossholder KW. Creating readiness for organizational change. Human Relations. 1993;46(6):681–703.CrossRef
44.
Bouckenooghe D. The role of organizational politics, contextual resources, and formal communication on change recipients’ commitment to change: A multilevel study. Eur J Work Organizational Psychol. 2012;21(4):575–602.CrossRef
45.
Snyder-Halpern R. Development and pilot testing of an Organizational Information Technology/Systems Innovation Readiness Scale (OITIRS). American Medical Informatics Association: Annual Symposium Proceedings. 2002;702–206
46.
Touré M, Poissant L, Swaine BR. Assessment of organizational readiness for e-health in a rehabilitation centre. Disabil Rehabil. 2012;34(2):167–73.CrossRefPubMed
Metadata
Title
Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations
Authors
Caitlyn Timmings
Sobia Khan
Julia E. Moore
Christine Marquez
Kasha Pyka
Sharon E. Straus
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2016
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-016-0262-y

Other articles of this Issue 1/2016

BMC Medical Informatics and Decision Making 1/2016 Go to the issue

Research article

The eClinical Care Pathway Framework: a novel structure for creation of online complex clinical care pathways and its application in the management of sexually transmitted infections

Research article

Tracing the decision-making process of physicians with a Decision Process Matrix

Research article

Feasibility of extracting data from electronic medical records for research: an international comparative study

Research article

Surveillance of HIV assisted partner services using routine health information systems in Kenya

Research article

A randomized controlled trial comparing in-person and wiki-inspired nominal group techniques for engaging stakeholders in chronic kidney disease research prioritization

Research article

Patient question set proliferation: scope and informatics challenges of patient question set management in a large multispecialty practice with case examples pertaining to tobacco use, menopause, and Urology and Orthopedics specialties