Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medical Informatics and Decision Making
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

Naturalistic study of guideline implementation tool use via evaluation of website access and physician survey

Authors: Melissa J. Armstrong, Gary S. Gronseth, Richard Dubinsky, Sonja Potrebic, Rebecca Penfold Murray, Thomas S. D. Getchius, Carol Rheaume, Anna R Gagliardi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

Clinical guidelines support decision-making at the point-of-care but the onus is often on individual users such as physicians to implement them. Research shows that the inclusion of implementation tools in or with guidelines (GItools) is associated with guideline use. However, there is little research on which GItools best support implementation by individual physicians. The purpose of this study was to investigate naturalistic access and use of GItools produced by the American Academy of Neurology (AAN) to inform future tool development.

Methods

Website accesses over six months were summarized for eight AAN guidelines and associated GItools published between July 2012 and August 2013. Academy members were surveyed about use of tools accompanying the sport concussion guideline. Data were analyzed using summary statistics and the Chi-square test.

Results

The clinician summary was accessed more frequently (29.0%, p < 0.001) compared with the slide presentation (26.8%), patient summary (23.2%) or case study (20.9%), although this varied by guideline topic. For the sport concussion guideline, which was accompanied by a greater variety of GItools, the mobile phone quick reference check application was most frequently accessed, followed by the clinician summary, patient summary, and slide presentation. For the sports concussion guideline survey, most respondents (response rate 21.8%, 168/797) were aware of the guideline (88.1%) and had read the guideline (78.6%). For GItool use, respondents indicated reading the reference card (51.2%), clinician summary (45.2%), patient summary (28.0%), mobile phone application (26.2%), and coach/athletic trainer summary (20.2%). Patterns of sports concussion GItool use were similar between respondents who said they had and had not yet implemented the guideline.

Conclusions

Developers faced with resource limitations may wish to prioritize the development of printable or mobile application clinician summaries, which were accessed significantly more than other types of GItools. Further research is needed to understand how to optimize the design of such GItools.
Literature
1.
Shekelle P, Woolf S, Grimshaw JM, Schünemann HJ, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRefPubMedPubMedCentral
2.
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.CrossRefPubMed
3.
Sheldon TA, Cullum N, Dawson D, Lankshear A, Lowson K, Watt I, et al. What’s the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients’ notes, and interviews. BMJ. 2004;239:999.CrossRef
4.
Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.CrossRefPubMed
5.
Francke AL, Smit MC, de Veer AJE, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008;8:38.CrossRefPubMedPubMedCentral
6.
Baiardini I, Braido F, Bonini M, Compalati E, Canonica GW. Why do doctors and patients not follow guidelines? Curr Opin Allergy Clin Immunol. 2009;9:228–33.CrossRefPubMed
7.
Gagliardi AR. “More bang for the buck”: exploring optimal approaches for guideline implementation through interviews with international developers. BMC Health Serv Res. 2012;12:404.CrossRefPubMedPubMedCentral
8.
Kryworuchko J, Stacey D, Bai N, Graham ID. Twelve years of clinical practice guideline development, dissemination and evaluation in Canada (1994 to 2005). Implement Sci. 2009;4:49.CrossRefPubMedPubMedCentral
9.
Lavis JN, Oxman AD, Moynihan R, Paulsen EJ. Evidence-informed health policy 3 - interviews with the directors of organizations that support the use of research evidence. Implement Sci. 2008;3:55.CrossRefPubMedPubMedCentral
10.
McKillop A, Crisp J, Walsh K. Practice guidelines need to address the ‘how’ and the ‘what’ of implementation. Prim Health Care Res Dev. 2012;13:48–59.CrossRefPubMed
11.
Mickan S, Burls A, Glasziou P. Patterns of ‘leakage’ in the utilisation of clinical guidelines: a systematic review. Postgrad Med J. 2011;87:670–9.CrossRefPubMedPubMedCentral
12.
Okelo SO, Butz AM, Sharma R, Diette GB, Pitts SI, King TM, et al. Interventions to modify health care provider adherence to asthma guidelines: a systematic review. Pediatrics. 2013;132:517–34.CrossRefPubMedPubMedCentral
13.
Murthy L, Shepperd S, Clarke MJ, Garner SE, Lavis JN, Perrier L, et al. Interventions to improve the use of systematic reviews in decision-making by health system managers, policy makers, and clinicians. Cochrane Database Syst Rev. 2012;9:CD009401.
14.
15.
16.
Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability. BMJ Open. 2015;5:e007047.CrossRefPubMedPubMedCentral
17.
Gagliardi AR, Brouwers MC. Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice. Implement Sci. 2012;7:67.CrossRefPubMedPubMedCentral
18.
Gagliardi AR, Brouwers MC, Bhattacharyya OK, Guideline Implementation Research and Application Network. A framework of the desirable features of guideline implementation tools (GItools): Delphi survey and assessment of GItools. Implement Sci. 2014;9:98.CrossRefPubMedPubMedCentral
19.
20.
Leviton LC, Hughes EFX. Research on the utilization of evaluations. A review and synthesis. Eval Rev. 1981;5:525–48.CrossRef
21.
22.
Gronseth GS, Paduga R. Evidence-based guideline update: steroids and antivirals for Bell palsy: report of the guideline development subcommittee of the American academy of neurology. Neurology. 2012;79:2209–13.CrossRefPubMed
23.
Armstrong MJ, Miyasaki JM. Evidence-based guideline: pharmacologic treatment of chorea in Huntington disease: report of the guideline development subcommittee of the American Academy of Neurology. Neurology. 2012;79:597–603.CrossRefPubMedPubMedCentral
24.
Muaygil T, Gronseth G, Camicioli R. Evidence-based guideline: diagnostic accuracy of CSF 14-3-3 in sporadic Creutzfeldt-Jakob disease: report of the guideline development subcommittee of the American Academy of Neurology. Neurology. 2012;79:1499–506.CrossRef
25.
Baird RA, Wiebe S, Zunt JR, Halperin JJ, Gronseth G, Roos KL. Evidence-based guideline: treatment of parenchymal neurocysticercosis: report of the Guideline Development Subcommittee of the American Academy of Neurology. Neurology. 2013;80:1424–9.CrossRefPubMedPubMedCentral
26.
Morris 3rd GL, Gloss D, Buchhalter J, Mack KJ, Nickels K, Harden C. Evidence-based guideline update: vagus nerve stimulation for the treatment of epilepsy: report of the Guideline Development Subcommittee of the American Academy of Neurology. Neurology. 2013;81:1453–9.CrossRefPubMedPubMedCentral
27.
Bhidayasiri R, Fahn S, Weiner WJ, Gronseth GS, Sullivan KL, Zesiewicz TA. Evidence-based guideline: treatment of tardive syndromes: report of the guideline development subcommittee of the American academy of neurology. Neurology. 2013;81:463–9.CrossRefPubMed
28.
Armstrong MJ, Gronseth G, Anderson DC, Biller J, Cucchiara B, Dafer R, et al. Summary of evidence-based guideline: periprocedural management of antithrombotic medications in patients with ischemic cerebrovascular disease: report of the guideline development subcommittee of the American academy of neurology. Neurology. 2013;80:2065–9.CrossRefPubMedPubMedCentral
29.
Giza CC, Kutcher JS, Ashwal S, Barth J, Getchius TS, Gioia GA, et al. Summary of evidence-based guideline update: evaluation and management of concussion in sports: report of the guideline development subcommittee of the American academy of neurology. Neurology. 2013;80:2250–7.CrossRefPubMedPubMedCentral
30.
Harris JS, Mueller K, Low P, Peplowski B, Koziol-McLain J. Suggested improvements in practice guidelines: market research to support clinical quality improvement. J Occup Environ Med. 2000;42:377–84.CrossRefPubMed
31.
Kastner M, et al. The development of a guideline implementability tool (GUIDE-IT): a qualitative study of family physician perspectives. BMC Fam Pract. 2014;15(1):19.CrossRefPubMedPubMedCentral
32.
Jones NE, et al. Implementation of the Canadian clinical practice guidelines for nutrition support: a multiple case study of barriers and enablers. Nutr Clin Pract. 2007;22(4):449–57.CrossRefPubMed
33.
Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, Chatterjee A, Perrier L, Graham ID, Straus SE, Zwarenstein M, Brouwers M. Guideline uptake is influenced by six implementability domains for creating and communicating guidelines:a realist review. Journal of Clinical Epidemiology. 2015;68(5):498-509.
34.
Patel VL, Arocha JF, Diermeier M, Greenes RA, Shortliffe EH. Methods of cognitive analysis to support the design and evaluation of biomedical systems: the case of clinical practice guidelines. J Biomed Inform. 2001;34:52–66.CrossRefPubMed
35.
Weiss CH. The many meanings of research utilization. Pub Admin Rev. 1979;39:426–31.CrossRef
36.
Giguere A, Légaré F, Grad R, Pluye P, Haynes RB, Cauchon M, et al. Decision boxes for clinicians to support evidence-based practice and shared decision making: the user experience. Implement Sci. 2012;7:72.CrossRefPubMedPubMedCentral
37.
Versloot J, Grudniewicz A, Chatterjee A, Hayden L, Kastner M, Bhattacharyya O. Format guidelines to make them vivid, intuitive, and visual: use simple formatting rules to optimize usability and accessibility of clinical practice guidelines. Int J Evid Based Healthc. 2015;13:52–7.CrossRefPubMed
38.
Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med. 2013;45:732–6.CrossRefPubMed
39.
Huckvale K, Morrison C, Ouyang J, Ghaghada A, Car J. The evolution of mobile apps for asthma: an updated systematic assessment of content and tools. BMC Med. 2015;13:58.CrossRefPubMedPubMedCentral
40.
Zeumer R, Frosch DL, Kuzemchak MD, Politi MC. Physicians’ perceptions of shared decision-making behaviours: a qualitative study demonstrating the continued chasm between aspirations and clinical practice. Health Expect. 2015;18:2465–76.CrossRef
41.
42.
Solberg LI. Guideline implementation: what the literature doesn’t tell us. Jt Comm J Qual Improv. 2000;26:525–37.CrossRefPubMed
Metadata
Title
Naturalistic study of guideline implementation tool use via evaluation of website access and physician survey
Authors
Melissa J. Armstrong
Gary S. Gronseth
Richard Dubinsky
Sonja Potrebic
Rebecca Penfold Murray
Thomas S. D. Getchius
Carol Rheaume
Anna R Gagliardi
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-016-0404-2

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue

Research article

Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions

Research article

Factors influencing the development of primary care data collection projects from electronic health records: a systematic review of the literature

Research article

Patient perspectives on engagement in decision-making in early management of non-ST elevation acute coronary syndrome: a qualitative study

Research article

Assessment of a Business-to-Consumer (B2C) model for Telemonitoring patients with Chronic Heart Failure (CHF)

Software

A Fast Healthcare Interoperability Resources (FHIR) layer implemented over i2b2

Research article

Health care professionals’ attitudes towards evidence-based medicine in the workers’ compensation setting: a cohort study