Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

Health care providers’ perceptions of use and influence of clinical decision support reminders: qualitative study following a randomized trial to improve HPV vaccination rates

Authors: Brian E. Dixon, Monica L. Kasting, Shannon Wilson, Amit Kulkarni, Gregory D. Zimet, Stephen M. Downs

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

Human Papillomavirus (HPV) leads to serious health issues and remains the most common sexually transmitted infection. Despite availability of effective vaccines, HPV vaccination rates are suboptimal. Furthermore, providers recommend the HPV vaccine less than half the time for eligible patients. Prior informatics research has demonstrated the effectiveness of computer-based clinical decision support (CDS) in changing provider behavior, especially in the area of preventative services.

Methods

Following a randomized clinical trial to test the effect of a CDS intervention on HPV vaccination rates, we conducted semi-structured interviews with health care providers to understand whether they noticed the CDS reminders and why providers did or did not respond to the prompts. Eighteen providers, a mix of medical doctors and nurse practitioners, were interviewed from five publicly-funded, urban health clinics. Interview data were qualitatively analyzed by two independent researchers using inductive content analysis.

Results

While most providers recalled seeing the CDS reminders, few of them perceived the intervention as effective in changing their behavior. Providers stated many reasons for why they did not perceive a change in their behavior, yet the results of the trial showed HPV vaccination rates increased as a result of the intervention.

Conclusions

CDS reminders may be effective at changing provider behavior even if providers perceive them to be of little use.

Trial registration

ClinicalTrials.gov Identifier: NCT02551887
Registered on September 15, 2015
Appendix
Available only for authorised users
Literature
2.
go back to reference National Institutes of Health. HPV and Cancer. Bethesda: National Cancer Institute; 2015. National Institutes of Health. HPV and Cancer. Bethesda: National Cancer Institute; 2015.
3.
go back to reference U.S. Food and Drug Administration. FDA approves Gardasil 9 for prevention of certain cancers caused by five additional types of HPV. Silver Spring: Administration FaD; 2014. U.S. Food and Drug Administration. FDA approves Gardasil 9 for prevention of certain cancers caused by five additional types of HPV. Silver Spring: Administration FaD; 2014.
4.
go back to reference Stokley S, Jeyarajah J, Yankey D, Cano M, Gee J, Roark J, Curtis R, Markowitz L, Immunization Services Division NCfIaRD, CDC. Human papillomavirus vaccination coverage among adolescents, 2007–2013, and postlicensure vaccine safety monitoring, 2006–2014 - United States. MMWR Morb Mortal Wkly Rep. 2014;63(29):620–4.PubMed Stokley S, Jeyarajah J, Yankey D, Cano M, Gee J, Roark J, Curtis R, Markowitz L, Immunization Services Division NCfIaRD, CDC. Human papillomavirus vaccination coverage among adolescents, 2007–2013, and postlicensure vaccine safety monitoring, 2006–2014 - United States. MMWR Morb Mortal Wkly Rep. 2014;63(29):620–4.PubMed
5.
go back to reference Reagan-Steiner S, Yankey D, Jeyarajah J, Elam-Evans LD, Curtis CR, MacNeil J, Markowitz LE, Singleton JA. National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years - United States, 2015. MMWR Morb Mortal Wkly Rep. 2016;65(33):850–8.CrossRefPubMed Reagan-Steiner S, Yankey D, Jeyarajah J, Elam-Evans LD, Curtis CR, MacNeil J, Markowitz LE, Singleton JA. National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years - United States, 2015. MMWR Morb Mortal Wkly Rep. 2016;65(33):850–8.CrossRefPubMed
6.
go back to reference Gilkey MB, Malo TL, Shah PD, Hall ME, Brewer NT. Quality of physician communication about human papillomavirus vaccine: findings from a national survey. Cancer Epidemiol Biomark Prev. 2015 Nov;24(11):1673-9. Gilkey MB, Malo TL, Shah PD, Hall ME, Brewer NT. Quality of physician communication about human papillomavirus vaccine: findings from a national survey. Cancer Epidemiol Biomark Prev. 2015 Nov;24(11):1673-9.
7.
go back to reference Gilkey MB, Calo WA, Moss JL, Shah PD, Marciniak MW, Brewer NT. Provider communication and HPV vaccination: the impact of recommendation quality. Vaccine. 2016;34(9):1187–92.CrossRefPubMedPubMedCentral Gilkey MB, Calo WA, Moss JL, Shah PD, Marciniak MW, Brewer NT. Provider communication and HPV vaccination: the impact of recommendation quality. Vaccine. 2016;34(9):1187–92.CrossRefPubMedPubMedCentral
8.
go back to reference Bendik M, Mayo RM, Parker VG. Contributing factors to HPV vaccine uptake in college-age women. J Cancer Educ. 2009;24:17. Bendik M, Mayo RM, Parker VG. Contributing factors to HPV vaccine uptake in college-age women. J Cancer Educ. 2009;24:17.
9.
go back to reference Centers for Disease Control and Prevention. National and state vaccination coverage among adolescents aged 13–17 years--United States, 2011. MMWR Morb Mortal Wkly Rep. 2012;61(34):671–7. Centers for Disease Control and Prevention. National and state vaccination coverage among adolescents aged 13–17 years--United States, 2011. MMWR Morb Mortal Wkly Rep. 2012;61(34):671–7.
10.
go back to reference Brewer NT, Gottlieb SL, Reiter PL, McRee AL, Liddon N, Markowitz L, Smith JS. Longitudinal predictors of human papillomavirus vaccine initiation among adolescent girls in a high-risk geographic area. Sex Transm Dis. 2011;38(3):197–204.CrossRefPubMedPubMedCentral Brewer NT, Gottlieb SL, Reiter PL, McRee AL, Liddon N, Markowitz L, Smith JS. Longitudinal predictors of human papillomavirus vaccine initiation among adolescent girls in a high-risk geographic area. Sex Transm Dis. 2011;38(3):197–204.CrossRefPubMedPubMedCentral
11.
go back to reference Liddon NC, Hood JE, Leichliter JS. Intent to receive HPV vaccine and reasons for not vaccinating among unvaccinated adolescent and young women: findings from the 2006–2008 National Survey of Family Growth. Vaccine. 2012;30(16):2676–82.CrossRefPubMed Liddon NC, Hood JE, Leichliter JS. Intent to receive HPV vaccine and reasons for not vaccinating among unvaccinated adolescent and young women: findings from the 2006–2008 National Survey of Family Growth. Vaccine. 2012;30(16):2676–82.CrossRefPubMed
12.
go back to reference Zimet GD, Weiss TW, Rosenthal SL, Good MB, Vichnin MD. Reasons for non-vaccination against HPV and future vaccination intentions among 19–26 year-old women. BMC Womens Health. 2010;10(1):27.CrossRefPubMedPubMedCentral Zimet GD, Weiss TW, Rosenthal SL, Good MB, Vichnin MD. Reasons for non-vaccination against HPV and future vaccination intentions among 19–26 year-old women. BMC Womens Health. 2010;10(1):27.CrossRefPubMedPubMedCentral
13.
go back to reference Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144(10):742–52.CrossRefPubMed Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144(10):742–52.CrossRefPubMed
14.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293(10):1223–38.CrossRefPubMed
15.
go back to reference Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ (Clin Res Ed). 2005;330(7494):765.CrossRef Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ (Clin Res Ed). 2005;330(7494):765.CrossRef
16.
go back to reference Lobach D, Sanders GD, Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux R, Samsa G, Hasselblad V, et al. Enabling health care decisionmaking through clinical decision support and knowledge management. Evid Rep Technol Assess. 2012;203:1–784. Lobach D, Sanders GD, Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux R, Samsa G, Hasselblad V, et al. Enabling health care decisionmaking through clinical decision support and knowledge management. Evid Rep Technol Assess. 2012;203:1–784.
17.
go back to reference Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:92.CrossRefPubMedPubMedCentral Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, Weise-Kelly L, Navarro T, Wilczynski NL, Haynes RB. Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implement Sci. 2011;6:92.CrossRefPubMedPubMedCentral
18.
go back to reference Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H, Tang PC. Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc. 2001;8(6):527–34.CrossRefPubMedPubMedCentral Sim I, Gorman P, Greenes RA, Haynes RB, Kaplan B, Lehmann H, Tang PC. Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc. 2001;8(6):527–34.CrossRefPubMedPubMedCentral
19.
go back to reference Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4.CrossRefPubMed Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4.CrossRefPubMed
21.
go back to reference Rajamani S, Bieringer A, Muscoplat M. Characterizing the access of clinical decision support offered by immunization information system in Minnesota. Online J Public Health Informa. 2015;7(3):e227. Rajamani S, Bieringer A, Muscoplat M. Characterizing the access of clinical decision support offered by immunization information system in Minnesota. Online J Public Health Informa. 2015;7(3):e227.
22.
go back to reference Biondich PG, Dixon BE, Duke J, Mamlin B, Grannis S, Takesue BY, Downs SM, Tierney WM. Regenstrief medical informatics: experiences with clinical decision support systems. In: Greenes RA, editor. Clinical decision support: the road to broad adoption. 2nd ed. Burlington: Elsevier, Inc.; 2014. p. 165–87.CrossRef Biondich PG, Dixon BE, Duke J, Mamlin B, Grannis S, Takesue BY, Downs SM, Tierney WM. Regenstrief medical informatics: experiences with clinical decision support systems. In: Greenes RA, editor. Clinical decision support: the road to broad adoption. 2nd ed. Burlington: Elsevier, Inc.; 2014. p. 165–87.CrossRef
23.
go back to reference McDonald CJ, Hui SL, Tierney WM. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992;9(5):304–12.PubMed McDonald CJ, Hui SL, Tierney WM. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992;9(5):304–12.PubMed
24.
go back to reference Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001;345(13):965–70.CrossRefPubMed Dexter PR, Perkins S, Overhage JM, Maharry K, Kohler RB, McDonald CJ. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001;345(13):965–70.CrossRefPubMed
25.
go back to reference Zimet G, Dixon BE, Xiao S, Tu W, Kulkarni A, Dugan T, Sheley M, Downs SM: Physician reminders and recommendation scripts for HPV vaccination: A randomized clinical trial. Acad Pediatr. 2017. (In Press). Zimet G, Dixon BE, Xiao S, Tu W, Kulkarni A, Dugan T, Sheley M, Downs SM: Physician reminders and recommendation scripts for HPV vaccination: A randomized clinical trial. Acad Pediatr. 2017. (In Press).
26.
go back to reference Kasting ML, Wilson S, Dixon BE, Downs SM, Kulkarni A, Zimet GD. A qualitative study of healthcare provider awareness and informational needs regarding the nine-valent HPV vaccine. Vaccine. 2016;34(11):1331–4.CrossRefPubMedPubMedCentral Kasting ML, Wilson S, Dixon BE, Downs SM, Kulkarni A, Zimet GD. A qualitative study of healthcare provider awareness and informational needs regarding the nine-valent HPV vaccine. Vaccine. 2016;34(11):1331–4.CrossRefPubMedPubMedCentral
27.
go back to reference Kasting ML, Wilson S, Dixon BE, Downs SM, Kulkarni A, Zimet GD. Healthcare providers’ beliefs and attitudes regarding risk compensation following HPV vaccination. Papillomavirus Res. 2016;2:116–21.CrossRefPubMed Kasting ML, Wilson S, Dixon BE, Downs SM, Kulkarni A, Zimet GD. Healthcare providers’ beliefs and attitudes regarding risk compensation following HPV vaccination. Papillomavirus Res. 2016;2:116–21.CrossRefPubMed
28.
go back to reference Anand V, Biondich PG, Liu G, Rosenman M, Downs SM. Child Health Improvement through Computer Automation: the CHICA system. Stud Health Technol Inform. 2004;107(Pt 1):187–91.PubMed Anand V, Biondich PG, Liu G, Rosenman M, Downs SM. Child Health Improvement through Computer Automation: the CHICA system. Stud Health Technol Inform. 2004;107(Pt 1):187–91.PubMed
29.
go back to reference Biondich PG, Downs SM, Anand V, Carroll AE. Automating the recognition and prioritization of needed preventive services: early results from the CHICA system. AMIA Annu Symp Proc. 2005;2005:51–55. Biondich PG, Downs SM, Anand V, Carroll AE. Automating the recognition and prioritization of needed preventive services: early results from the CHICA system. AMIA Annu Symp Proc. 2005;2005:51–55.
32.
go back to reference Dixon BE. What is Health Information Exchange? In: Dixon BE, editor. Health Information Exchange: Navigating and Managing a Network of Health Information Systems. Waltham: Academic Press; 2016. p. 3–20.CrossRef Dixon BE. What is Health Information Exchange? In: Dixon BE, editor. Health Information Exchange: Navigating and Managing a Network of Health Information Systems. Waltham: Academic Press; 2016. p. 3–20.CrossRef
33.
go back to reference Zhu VJ, Grannis SJ, Rosenman MB, Downs SM. Implementing broad scale childhood immunization decision support as a web service. AMIA Ann Symp Proc. 2009;2009:745–9. Zhu VJ, Grannis SJ, Rosenman MB, Downs SM. Implementing broad scale childhood immunization decision support as a web service. AMIA Ann Symp Proc. 2009;2009:745–9.
34.
go back to reference Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18(1):59–82.CrossRef Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2006;18(1):59–82.CrossRef
35.
go back to reference Patton MQ. Qualitative evaluation and research methods. 4th ed. Thousand Oaks: SAGE Publications, Inc; 2015. Patton MQ. Qualitative evaluation and research methods. 4th ed. Thousand Oaks: SAGE Publications, Inc; 2015.
36.
37.
go back to reference Babbie E. The Basics of Social Research. 5th ed. Belmont: Wadsworth; 2011. Babbie E. The Basics of Social Research. 5th ed. Belmont: Wadsworth; 2011.
38.
go back to reference Downe-Wamboldt B. Content analysis: method, applications, and issues. Health Care Women Int. 1992;13(3):313–21.CrossRefPubMed Downe-Wamboldt B. Content analysis: method, applications, and issues. Health Care Women Int. 1992;13(3):313–21.CrossRefPubMed
39.
go back to reference Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed
40.
go back to reference McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976;295(24):1351–5.CrossRefPubMed McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976;295(24):1351–5.CrossRefPubMed
41.
go back to reference Edmunds M, Peddicord D, Bates DW. Clinical informatics policy and regulations. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. Zurich: Springer International Publishing; 2016. p. 47–66.CrossRef Edmunds M, Peddicord D, Bates DW. Clinical informatics policy and regulations. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. Zurich: Springer International Publishing; 2016. p. 47–66.CrossRef
42.
go back to reference Xierali IM, Hsiao CJ, Puffer JC, Green LA, Rinaldo JC, Bazemore AW, Burke MT, Phillips RL Jr. The rise of electronic health record adoption among family physicians. Ann Fam Med. 2013;11(1):14–9.CrossRefPubMedPubMedCentral Xierali IM, Hsiao CJ, Puffer JC, Green LA, Rinaldo JC, Bazemore AW, Burke MT, Phillips RL Jr. The rise of electronic health record adoption among family physicians. Ann Fam Med. 2013;11(1):14–9.CrossRefPubMedPubMedCentral
43.
go back to reference McDonald CJ, Callaghan FM, Weissman A, Goodwin RM, Mundkur M, Kuhn T. Use of internist’s free time by ambulatory care Electronic Medical Record systems. JAMA Intern Med. 2014;174(11):1860–3.CrossRefPubMed McDonald CJ, Callaghan FM, Weissman A, Goodwin RM, Mundkur M, Kuhn T. Use of internist’s free time by ambulatory care Electronic Medical Record systems. JAMA Intern Med. 2014;174(11):1860–3.CrossRefPubMed
44.
go back to reference Holden RJ, Voida S, Savoy A, Jones JF, Kulanthaivel A. Human factors engineering and human–computer interaction: supporting user performance and experience. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. Zurich: Springer International Publishing; 2016. p. 287–307.CrossRef Holden RJ, Voida S, Savoy A, Jones JF, Kulanthaivel A. Human factors engineering and human–computer interaction: supporting user performance and experience. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. Zurich: Springer International Publishing; 2016. p. 287–307.CrossRef
45.
go back to reference Rosland AM, Nelson K, Sun H, Dolan ED, Maynard C, Bryson C, Stark R, Shear JM, Kerr E, Fihn SD, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care. 2013;19(7):e263–72.PubMed Rosland AM, Nelson K, Sun H, Dolan ED, Maynard C, Bryson C, Stark R, Shear JM, Kerr E, Fihn SD, et al. The patient-centered medical home in the Veterans Health Administration. Am J Manag Care. 2013;19(7):e263–72.PubMed
46.
go back to reference Dexter PR, Perkins SM, Maharry KS, Jones K, McDonald CJ. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA. 2004;292(19):2366–71.CrossRefPubMed Dexter PR, Perkins SM, Maharry KS, Jones K, McDonald CJ. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA. 2004;292(19):2366–71.CrossRefPubMed
47.
go back to reference Nazi KM, Hogan TP, Woods SS, Simon SR, Ralston JD. Consumer health informatics: engaging and empowering patients and families. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. 1st ed. Zurich: Springer International Publishing; 2016. p. 459–500.CrossRef Nazi KM, Hogan TP, Woods SS, Simon SR, Ralston JD. Consumer health informatics: engaging and empowering patients and families. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. 1st ed. Zurich: Springer International Publishing; 2016. p. 459–500.CrossRef
48.
go back to reference Col N, Correa-de-Araujo R. Consumers and clinical decision support. In: Greenes RA, editor. Clinical decision support (Second edition). Oxford: Academic Press; 2014. p. 741–69.CrossRef Col N, Correa-de-Araujo R. Consumers and clinical decision support. In: Greenes RA, editor. Clinical decision support (Second edition). Oxford: Academic Press; 2014. p. 741–69.CrossRef
49.
go back to reference Haque SN, Dixon BE, Grannis SJ. Public health informatics. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. 1st ed. Zurich: Springer International Publishing; 2016. p. 501–20.CrossRef Haque SN, Dixon BE, Grannis SJ. Public health informatics. In: Finnell JT, Dixon BE, editors. Clinical informatics study guide: text and review. 1st ed. Zurich: Springer International Publishing; 2016. p. 501–20.CrossRef
Metadata
Title
Health care providers’ perceptions of use and influence of clinical decision support reminders: qualitative study following a randomized trial to improve HPV vaccination rates
Authors
Brian E. Dixon
Monica L. Kasting
Shannon Wilson
Amit Kulkarni
Gregory D. Zimet
Stephen M. Downs
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0521-6

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue