Top

Published in:

Open Access 01-12-2015 | Study protocol

Tailoring implementation strategies for evidence-based recommendations using computerised clinical decision support systems: protocol for the development of the GUIDES tools

Authors: Stijn Van de Velde, Pavel Roshanov, Tiina Kortteisto, Ilkka Kunnamo, Bert Aertgeerts, Per Olav Vandvik, Signe Flottorp

Published in: Implementation Science | Issue 1/2015

Abstract

Background

A computerised clinical decision support system (CCDSS) is a technology that uses patient-specific data to provide relevant medical knowledge at the point of care. It is considered to be an important quality improvement intervention, and the implementation of CCDSS is growing substantially. However, the significant investments do not consistently result in value for money due to content, context, system and implementation issues. The Guideline Implementation with Decision Support (GUIDES) project aims to improve the impact of CCDSS through optimised implementation based on high-quality evidence-based recommendations. To achieve this, we will develop tools that address the factors that determine successful CCDSS implementation.

Methods/design

We will develop the GUIDES tools in four steps, using the methods and results of the Tailored Implementation for Chronic Diseases (TICD) project as a starting point: (1) a review of research evidence and frameworks on the determinants of implementing recommendations using CCDSS; (2) a synthesis of a comprehensive framework for the identified determinants; (3) the development of tools for use of the framework and (4) pilot testing the utility of the tools through the development of a tailored CCDSS intervention in Norway, Belgium and Finland. We selected the conservative management of knee osteoarthritis as a prototype condition for the pilot. During the process, the authors will collaborate with an international expert group to provide input and feedback on the tools.

Discussion

This project will provide guidance and tools on methods of identifying implementation determinants and selecting strategies to implement evidence-based recommendations through CCDSS. We will make the GUIDES tools available to CCDSS developers, implementers, researchers, funders, clinicians, managers, educators, and policymakers internationally. The tools and recommendations will be generic, which makes them scalable to a large spectrum of conditions. Ultimately, the better implementation of CCDSS may lead to better-informed decisions and improved care and patient outcomes for a wide range of conditions.

Protocol registration

PROSPERO, CRD42016033738

Available only for authorised users

Scott IA, Glasziou PP. Improving effectiveness of clinical medicine: the need for better translation of science into practice. Med J Aust. 2012;197(7):374–8.CrossRefPubMed

Scott I. Ten clinician-driven strategies for maximising value of Australian health care. Aust Health Rev. 2014;38(2):125–33. doi:10.1071/AH13248.CrossRefPubMed

Haynes RB, Wilczynski NL, Computerized Clinical Decision Support System Systematic Review Team. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: methods of a decision-maker-researcher partnership systematic review. Implement Sci. 2010;5:12. doi:10.1186/1748-5908-5-12.CrossRefPubMedPubMedCentral

Wright A, Sittig DF, Ash JS, Feblowitz J, Meltzer S, McMullen C, et al. Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc. 2011;18(3):232–42.CrossRefPubMedPubMedCentral

Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30. doi:10.1197/jamia.M1370.CrossRefPubMedPubMedCentral

Quinn CC, Clough SS, Minor JM, Lender D, Okafor MC, Gruber-Baldini A. WellDoc mobile diabetes management randomized controlled trial: change in clinical and behavioral outcomes and patient and physician satisfaction. Diabetes Technol Ther. 2008;10(3):160–8. doi:10.1089/dia.2008.0283.CrossRefPubMed

Coiera E, Lau AY, Tsafnat G, Sintchenko V, Magrabi F. The changing nature of clinical decision support systems: a focus on consumers, genomics, public health and decision safety. Yearb Med Inform. 2009:84–95.

Agoritsas T, Heen AF, Brandt L, Alonso-Coello P, Kristiansen A, Akl EA, et al. Decision aids that really promote shared decision making: the pace quickens. BMJ. 2015;350:g7624. doi:10.1136/bmj.g7624.CrossRefPubMedPubMedCentral

Elwyn G, Scholl I, Tietbohl C, Mann M, Edwards AG, Clay C, et al. “Many miles to go …”: a systematic review of the implementation of patient decision support interventions into routine clinical practice. BMC Med Inform Decis Mak. 2013;13 Suppl 2:S14. doi:10.1186/1472-6947-13-S2-S14.CrossRefPubMedPubMedCentral

10.

Murphy EV. Clinical decision support: effectiveness in improving quality processes and clinical outcomes and factors that may influence success. Yale J Biol Med. 2014;87(2):187–97.PubMedPubMedCentral

11.

E-Health for a Healthier Europe! Swedish Presidency of the European Union. 2009. https://joinup.ec.europa.eu/community/epractice/document/eu-ehealth-healthier-europe. Accessed 18 Jan 2016.

12.

Roshanov PS, Fernandes N, Wilczynski JM, Hemens BJ, You JJ, Handler SM, et al. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ. 2013;346:f657. doi:10.1136/bmj.f657.CrossRefPubMed

13.

Watson R. European Union leads way on e-health, but obstacles remain. BMJ. 2010;341:c5195. doi:10.1136/bmj.c5195.CrossRefPubMed

14.

Lobach D, Sanders GD, Bright TJ, Wong A, Dhurjati R, Bristow E. et al. Enabling health care decisionmaking through clinical decision support and knowledge management. Evid Rep Technol Assess (Full Rep). 2012(203):1–784.

15.

Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;3:CD001096. doi:10.1002/14651858.CD001096.pub2.

16.

Moja L, Kwag KH, Lytras T, Bertizzolo L, Brandt L, Pecoraro V, et al. Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. Am J Public Health. 2014;104(12):e12–22. doi:10.2105/AJPH.2014.302164.CrossRefPubMedPubMedCentral

17.

van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006;13(2):138–47. doi:10.1197/jamia.M1809.CrossRefPubMedPubMedCentral

18.

Myers RB, Jones SL, Sittig DF. Review of reported clinical information system adverse events in US Food and Drug Administration databases. Appl Clin Inform. 2011;2(1):63–74. doi:10.4338/ACI-2010-11-RA-0064.CrossRefPubMedPubMedCentral

19.

Coiera E, Westbrook J, Wyatt J. The safety and quality of decision support systems. Yearb Med Inform. 2006:20–5.

20.

Ash JS, Sittig DF, Campbell EM, Guappone KP, Dykstra RH. Some unintended consequences of clinical decision support systems. AMIA Annu Symp Proc. 2007:26–30.

21.

Goddard K, Roudsari A, Wyatt JC. Automation bias—a hidden issue for clinical decision support system use. Stud Health Technol Inform. 2011;164:17–22.PubMed

22.

Ash JS, Sittig DF, Dykstra R, Campbell E, Guappone K. The unintended consequences of computerized provider order entry: findings from a mixed methods exploration. Int J Med Inform. 2009;78 Suppl 1:S69–76. doi:10.1016/j.ijmedinf.2008.07.015.CrossRefPubMed

23.

Qaseem A, Forland F, Macbeth F, Ollenschlager G, Phillips S, van der Wees P, et al. Guidelines International Network: toward international standards for clinical practice guidelines. Ann Intern Med. 2012;156(7):525–31. doi:10.7326/0003-4819-156-7-201204030-00009.CrossRefPubMed

24.

Wensing M, Oxman A, Baker R, Godycki-Cwirko M, Flottorp S, Szecsenyi J, et al. Tailored Implementation For Chronic Diseases (TICD): a project protocol. Implement Sci. 2011;6:103. doi:10.1186/1748-5908-6-103.CrossRefPubMedPubMedCentral

25.

Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;4:CD005470. doi:10.1002/14651858.CD005470.pub3.

26.

Lobach DF. The road to effective clinical decision support: are we there yet? BMJ. 2013;346:f1616. doi:10.1136/bmj.f1616.CrossRefPubMed

27.

Miller A, Moon B, Anders S, Walden R, Brown S, Montella D. Integrating computerized clinical decision support systems into clinical work: a meta-synthesis of qualitative research. Int J Med Inform. 2015. doi:10.1016/j.ijmedinf.2015.09.005.PubMed

28.

Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765. doi:10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral

29.

Sirajuddin AM, Osheroff JA, Sittig DF, Chuo J, Velasco F, Collins DA. Implementation pearls from a new guidebook on improving medication use and outcomes with clinical decision support. Effective CDS is essential for addressing healthcare performance improvement imperatives. J Healthc Inf Manag. 2009;23(4):38–45.PubMedPubMedCentral

30.

Coiera E, Aarts J, Kulikowski C. The dangerous decade. J Am Med Inform Assoc. 2012;19(1):2–5. doi:10.1136/amiajnl-2011-000674.CrossRefPubMed

31.

GUIDES project website. 2015. http://www.guidesproject.org/. Accessed Jan 19 2016.

32.

Vandvik PO, Brandt L, Alonso-Coello P, Treweek S, Akl EA, Kristiansen A, et al. Creating clinical practice guidelines we can trust, use, and share: a new era is imminent. Chest. 2013;144(2):381–9. doi:10.1378/chest.13-0746.CrossRefPubMed

33.

Van de Velde S, Vander Stichele R, Fauquert B, Geens S, Heselmans A, Ramaekers D, et al. EBMPracticeNet: a bilingual national electronic point-of-care project for retrieval of evidence-based clinical guideline information and decision support. JMIR Res Protoc. 2013;2(2):e23. doi:10.2196/resprot.2644.CrossRefPubMedPubMedCentral

34.

Kortteisto T, Komulainen J, Makela M, Kunnamo I, Kaila M. Clinical decision support must be useful, functional is not enough: a qualitative study of computer-based clinical decision support in primary care. BMC Health Serv Res. 2012;12:349. doi:10.1186/1472-6963-12-349.CrossRefPubMedPubMedCentral

35.

Makela M, Kunnamo L. Implementing evidence in Finnish primary care. Use of electronic guidelines in daily practice. Scand J Prim Health Care. 2001;19(4):214–7.CrossRefPubMed

36.

Varonen H, Kortteisto T, Kaila M, Group EBS. What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians. Fam Pract. 2008;25(3):162–7. doi:10.1093/fampra/cmn020.CrossRefPubMed

37.

Hirsh J, Guyatt G. Clinical experts or methodologists to write clinical guidelines? Lancet. 2009;374(9686):273–5. doi:10.1016/S0140-6736(09)60787-X.CrossRefPubMed

38.

Crossing the quality chasm: a new health system for the 21st century. Washington, D.C.: National Academy Press; 2001.

39.

Acir N, Oztura I, Kuntalp M, Baklan B, Guzelis C. Automatic detection of epileptiform events in EEG by a three-stage procedure based on artificial neural networks. IEEE Trans Biomed Eng. 2005;52(1):30–40.CrossRefPubMed

40.

Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15. doi:10.1186/1745-6215-14-15.CrossRefPubMedPubMedCentral

41.

Scott SD, Rotter T, Hartling L, Chambers T, Bannar-Martin KH. A protocol for a systematic review of the use of process evaluations in knowledge translation research. Syst Rev. 2014;3:149. doi:10.1186/2046-4053-3-149.CrossRefPubMedPubMedCentral

42.

Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013;10:CD010414. doi:10.1002/14651858.CD010414.pub2.

43.

Glenton C, Lewin S, Scheel IB. Still too little qualitative research to shed light on results from reviews of effectiveness trials: a case study of a Cochrane review on the use of lay health workers. Implement Sci. 2011;6:53. doi:10.1186/1748-5908-6-53.CrossRefPubMedPubMedCentral

44.

Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:35. doi:10.1186/1748-5908-8-35.CrossRefPubMedPubMedCentral

45.

Balshem H, Helfand M, Schunemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401–6. doi:10.1016/j.jclinepi.2010.07.015.CrossRefPubMed

46.

Whiting P, Savovic J, Higgins JP, Caldwell DM, Reeves BC, Shea B, et al. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2015. doi:10.1016/j.jclinepi.2015.06.005.PubMed

47.

Treweek S, Oxman AD, Alderson P, Bossuyt PM, Brandt L, Brozek J, et al. Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence (DECIDE): protocol and preliminary results. Implement Sci. 2013;8:6. doi:10.1186/1748-5908-8-6.CrossRefPubMedPubMedCentral

48.

Askari M, Wierenga PC, Eslami S, Medlock S, de Rooij SE, Abu-Hanna A. Assessing quality of care of elderly patients using the ACOVE quality indicator set: a systematic review. PLoS One. 2011;6(12):e28631. doi:10.1371/journal.pone.0028631.CrossRefPubMedPubMedCentral

49.

Jamtvedt G, Dahm KT, Holm I, Odegaard-Jensen J, Flottorp S. Choice of treatment modalities was not influenced by pain, severity or co-morbidity in patients with knee osteoarthritis. Physiother Res Int. 2010;15(1):16–23. doi:10.1002/pri.452.PubMed

50.

Gronhaug G, Osteras N, Hagen KB. Quality of hip and knee osteoarthritis management in primary health care in a Norwegian county: a cross-sectional survey. BMC Health Serv Res. 2014;14:598. doi:10.1186/s12913-014-0598-x.CrossRefPubMedPubMedCentral

51.

Brosseau L, Rahman P, Toupin-April K, Poitras S, King J, De Angelis G, et al. A systematic critical appraisal for non-pharmacological management of osteoarthritis using the appraisal of guidelines research and evaluation II instrument. PLoS One. 2014;9(1):e82986. doi:10.1371/journal.pone.0082986.CrossRefPubMedPubMedCentral

52.

Nelson AE, Allen KD, Golightly YM, Goode AP, Jordan JM. A systematic review of recommendations and guidelines for the management of osteoarthritis: the chronic osteoarthritis management initiative of the U.S. bone and joint initiative. Semin Arthritis Rheum. 2014;43(6):701–12. doi:10.1016/j.semarthrit.2013.11.012.CrossRefPubMed

53.

Ash JS, Sittig DF, McMullen CK, Wright A, Bunce A, Mohan V, et al. Multiple perspectives on clinical decision support: a qualitative study of fifteen clinical and vendor organizations. BMC Med Inform Decis Mak. 2015;15:35. doi:10.1186/s12911-015-0156-4.CrossRefPubMedPubMedCentral

54.

Berlin A, Sorani M, Sim I. A taxonomic description of computer-based clinical decision support systems. J Biomed Inform. 2006;39(6):656–67. http://dx.doi.org/10.1016/j.jbi.2005.12.003.CrossRefPubMed

55.

Kalra D, Fernando B, Morrison Z, Sheikh A. A review of the empirical evidence of the value of structuring and coding of clinical information within electronic health records for direct patient care. Inform Prim Care. 2012;20(3):171–80.CrossRefPubMed

56.

Ho YX, Gadd CS, Kohorst KL, Rosenbloom ST. A qualitative analysis evaluating the purposes and practices of clinical documentation. Appl Clin Inform. 2014;5(1):153–68. doi:10.4338/ACI-2013-10-RA-0081.CrossRefPubMedPubMedCentral

Title: Tailoring implementation strategies for evidence-based recommendations using computerised clinical decision support systems: protocol for the development of the GUIDES tools
Authors: Stijn Van de Velde
Pavel Roshanov
Tiina Kortteisto
Ilkka Kunnamo
Bert Aertgeerts
Per Olav Vandvik
Signe Flottorp
Publication date: 01-12-2015
Publisher: BioMed Central
Published in: Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-016-0393-7

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Tailoring implementation strategies for evidence-based recommendations using computerised clinical decision support systems: protocol for the development of the GUIDES tools

Abstract

Background

Methods/design

Discussion

Protocol registration

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods/design

Discussion

Protocol registration

Please log in to get access to this content

Other articles of this Issue 1/2015

How can we improve stroke thrombolysis rates? A review of health system factors and approaches associated with thrombolysis administration rates in acute stroke care

Implementation of a patient decision aid for men with localized prostate cancer: evaluation of patient outcomes and practice variation

Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation

A systematic review of the use of the Consolidated Framework for Implementation Research

Collaborative approach to Optimise MEdication use for Older people in Nursing homes (COME-ON): study protocol of a cluster controlled trial

Erratum to: ‘Evaluation of quality improvement for cesarean sections programmes through mixed methods’