Skip to main content
Top
Published in: Journal of General Internal Medicine 3/2021

01-03-2021 | Original Research

Effect of Outpatient Note Templates on Note Quality: NOTE (Notation Optimization through Template Engineering) Randomized Clinical Trial

Authors: Jeremy A. Epstein, MD, Joseph Cofrancesco Jr, MD, MPH, Mary Catherine Beach, MD, MPH, Amanda Bertram, MS, Helene F. Hedian, MD, Sara Mixter, MD, MPH, Hsin-Chieh Yeh, PhD, Gail Berkenblit, MD, PhD

Published in: Journal of General Internal Medicine | Issue 3/2021

Login to get access

Abstract

Background

This is the first randomized controlled trial evaluating the impact of note template design on note quality using a simulated patient encounter and a validated assessment tool.

Objective

To compare note quality between two different templates using a novel randomized clinical simulation process.

Design

A randomized non-blinded controlled trial of a standard note template versus redesigned template.

Participants

PGY 1-3 IM residents.

Interventions

Residents documented the simulated patient encounter using one of two templates. The standard template was modeled after the usual outpatient progress note. The new template placed the assessment and plan section in the beginning, grouped subjective data into the assessment, and deemphasized less useful elements.

Main Measures

Note length; time to note completion; note template evaluation by resident authors; note evaluation by faculty reviewers.

Key Results

36 residents participated, 19 randomized to standard template, 17 to new. New template generated shorter notes (103 vs 285 lines, p < 0.001) that took the same time to complete (19.8 vs 21.6 min, p = 0.654). Using a 5-point Likert scale, residents considered new notes to have increased visual appeal (4 vs 3, p = 0.05) and less redundancy and clutter (4 vs 3, p = 0.006). Overall template satisfaction was not statistically different. Faculty reviewers rated the standard note more up-to-date (4.3 vs 2.7, p = 0.001), accurate (3.9 vs 2.6, p = 0.003), and useful (4 vs 2.8, p = 0.002), but less organized (3.3 vs 4.5, p < 0.001). Total quality was not statistically different.

Conclusions

Residents rated the new note template more visually appealing, shorter, and less cluttered. Faculty reviewers rated both note types equivalent in the overall quality but rated new notes inferior in terms of accuracy and usefulness though better organized. This study demonstrates a novel method of a simulated clinical encounter to evaluate note templates before the introduction into practice.

Trial Registration

ClinicalTrials.​gov ID: NCT04333238
Appendix
Available only for authorised users
Literature
1.
go back to reference Hirschtick RE. A piece of my mind. Copy-and-paste. JAMA. 2006;295(20):2335-2336.CrossRef Hirschtick RE. A piece of my mind. Copy-and-paste. JAMA. 2006;295(20):2335-2336.CrossRef
2.
go back to reference Han H, Lopp L. Writing and reading in the electronic health record: an entirely new world. Med Educ Online 2013;18:1-7.CrossRef Han H, Lopp L. Writing and reading in the electronic health record: an entirely new world. Med Educ Online 2013;18:1-7.CrossRef
3.
go back to reference Dean SM, Eickhoff JC, Bakel LA. The effectiveness of a bundled intervention to improve resident progress notes in an electronic health record. J Hosp Med 2015;10(2):104-107.CrossRef Dean SM, Eickhoff JC, Bakel LA. The effectiveness of a bundled intervention to improve resident progress notes in an electronic health record. J Hosp Med 2015;10(2):104-107.CrossRef
4.
go back to reference Aylor M, Campbell EM, Winter C, Phillipi CA. Resident Notes in an Electronic Health Record A Mixed-Methods Study Using a Standardized Intervention With Qualitative Analysis. Clin Pediatr 2016:0009922816658651. Aylor M, Campbell EM, Winter C, Phillipi CA. Resident Notes in an Electronic Health Record A Mixed-Methods Study Using a Standardized Intervention With Qualitative Analysis. Clin Pediatr 2016:0009922816658651.
5.
go back to reference Lin C-T, McKenzie M, Pell J, Caplan L. Health care provider satisfaction with a new electronic progress note format: SOAP vs APSO format. JAMA Intern Med 2013;173(2):160-162.CrossRef Lin C-T, McKenzie M, Pell J, Caplan L. Health care provider satisfaction with a new electronic progress note format: SOAP vs APSO format. JAMA Intern Med 2013;173(2):160-162.CrossRef
6.
go back to reference Fanucchi L, Yan D, Conigliaro RL. Duly noted: Lessons from a two-site intervention to assess and improve the quality of clinical documentation in the electronic health record. Appl Clin Inform 2016;7(3):653-659.CrossRef Fanucchi L, Yan D, Conigliaro RL. Duly noted: Lessons from a two-site intervention to assess and improve the quality of clinical documentation in the electronic health record. Appl Clin Inform 2016;7(3):653-659.CrossRef
7.
go back to reference Kahn D, Stewart E, Duncan M, et al. A Prescription for Note Bloat: An Effective Progress Note Template. J Hosp Med 2018;13(6):378-382.CrossRef Kahn D, Stewart E, Duncan M, et al. A Prescription for Note Bloat: An Effective Progress Note Template. J Hosp Med 2018;13(6):378-382.CrossRef
8.
go back to reference Hyppönen H, Saranto K, Vuokko R, et al. Impacts of structuring the electronic health record: a systematic review protocol and results of previous reviews. Int J Med Inform 2014;83(3):159-169.CrossRef Hyppönen H, Saranto K, Vuokko R, et al. Impacts of structuring the electronic health record: a systematic review protocol and results of previous reviews. Int J Med Inform 2014;83(3):159-169.CrossRef
9.
go back to reference Weed LL. Medical Records That Guide and Teach. N Engl J Med 1968;278(11):593-600.CrossRef Weed LL. Medical Records That Guide and Teach. N Engl J Med 1968;278(11):593-600.CrossRef
10.
go back to reference Brown PJ, Marquard JL, Amster B, et al. What do physicians read (and ignore) in electronic progress notes? Appl Clin Inform 2014;5(2):430-444.CrossRef Brown PJ, Marquard JL, Amster B, et al. What do physicians read (and ignore) in electronic progress notes? Appl Clin Inform 2014;5(2):430-444.CrossRef
11.
go back to reference Koopman RJ, Steege LMB, Moore JL, et al. Physician Information Needs and Electronic Health Records (EHRs): Time to Reengineer the Clinic Note. J Am Board Fam Med 2015;28(3):316-323.CrossRef Koopman RJ, Steege LMB, Moore JL, et al. Physician Information Needs and Electronic Health Records (EHRs): Time to Reengineer the Clinic Note. J Am Board Fam Med 2015;28(3):316-323.CrossRef
13.
go back to reference Weiner M. Forced Inefficiencies of the Electronic Health Record. J Gen Intern Med 2019;34(11):2299-2301.CrossRef Weiner M. Forced Inefficiencies of the Electronic Health Record. J Gen Intern Med 2019;34(11):2299-2301.CrossRef
14.
go back to reference Atkins D. So Many Nudges, So Little Time: Can Cost-effectiveness Tell Us When It Is Worthwhile to Try to Change Provider Behavior? J Gen Intern Med 2019;34(6):783-784.CrossRef Atkins D. So Many Nudges, So Little Time: Can Cost-effectiveness Tell Us When It Is Worthwhile to Try to Change Provider Behavior? J Gen Intern Med 2019;34(6):783-784.CrossRef
15.
go back to reference Chokshi SK, Troxel A, Belli H, et al. User-Centered Development of a Behavioral Economics Inspired Electronic Health Record Clinical Decision Support Module. Stud Health Technol Inform 2019;264:1155-1158.PubMedPubMedCentral Chokshi SK, Troxel A, Belli H, et al. User-Centered Development of a Behavioral Economics Inspired Electronic Health Record Clinical Decision Support Module. Stud Health Technol Inform 2019;264:1155-1158.PubMedPubMedCentral
16.
go back to reference Kuhn T, Basch P, Barr M, Yackel T. Medical Informatics Committee of the American College of P. Clinical documentation in the 21st century: executive summary of a policy position paper from the American College of Physicians. Ann Intern Med 2015;162(4):301-303.CrossRef Kuhn T, Basch P, Barr M, Yackel T. Medical Informatics Committee of the American College of P. Clinical documentation in the 21st century: executive summary of a policy position paper from the American College of Physicians. Ann Intern Med 2015;162(4):301-303.CrossRef
17.
go back to reference Clarke MA, Steege LM, Moore JL, Koopman RJ, Belden JL, Kim MS. Determining primary care physician information needs to inform ambulatory visit note display. Appl Clin Inform 2014;5(1):169-190.CrossRef Clarke MA, Steege LM, Moore JL, Koopman RJ, Belden JL, Kim MS. Determining primary care physician information needs to inform ambulatory visit note display. Appl Clin Inform 2014;5(1):169-190.CrossRef
18.
go back to reference Shoolin J, Ozeran L, Hamann C, Bria W. Association of Medical Directors of Information Systems consensus on inpatient electronic health record documentation. Appl Clin Inform 2013;4(2):293-303.CrossRef Shoolin J, Ozeran L, Hamann C, Bria W. Association of Medical Directors of Information Systems consensus on inpatient electronic health record documentation. Appl Clin Inform 2013;4(2):293-303.CrossRef
19.
go back to reference Styron JF, Evans PJ. The evolution of office notes and the electronic medical record: The CAPS note. Cleve Clin J Med 2016;83(7):542-544.CrossRef Styron JF, Evans PJ. The evolution of office notes and the electronic medical record: The CAPS note. Cleve Clin J Med 2016;83(7):542-544.CrossRef
20.
go back to reference Burke HB, Hoang A, Becher D, et al. QNOTE: an instrument for measuring the quality of EHR clinical notes. J Am Med Inform Assoc 2014;21(5):910-916.CrossRef Burke HB, Hoang A, Becher D, et al. QNOTE: an instrument for measuring the quality of EHR clinical notes. J Am Med Inform Assoc 2014;21(5):910-916.CrossRef
21.
go back to reference Stetson PD, Bakken S, Wrenn JO, Siegler EL. Assessing Electronic Note Quality Using the Physician Documentation Quality Instrument (PDQI-9). Appl Clin Inform 2012;3(2):164-174.CrossRef Stetson PD, Bakken S, Wrenn JO, Siegler EL. Assessing Electronic Note Quality Using the Physician Documentation Quality Instrument (PDQI-9). Appl Clin Inform 2012;3(2):164-174.CrossRef
23.
go back to reference Neri PM, Volk LA, Samaha S, et al. Relationship between documentation method and quality of chronic disease visit notes. Appl Clin Inform 2014;5(2):480-490.CrossRef Neri PM, Volk LA, Samaha S, et al. Relationship between documentation method and quality of chronic disease visit notes. Appl Clin Inform 2014;5(2):480-490.CrossRef
24.
go back to reference Edwards ST, Neri PM, Volk LA, Schiff GD, Bates DW. Association of note quality and quality of care: a cross-sectional study. BMJ Qual Saf 2014;23(5):406-413.CrossRef Edwards ST, Neri PM, Volk LA, Schiff GD, Bates DW. Association of note quality and quality of care: a cross-sectional study. BMJ Qual Saf 2014;23(5):406-413.CrossRef
25.
go back to reference Embi PJ, Yackel TR, Logan JR, Bowen JL, Cooney TG, Gorman PN. Impacts of computerized physician documentation in a teaching hospital: perceptions of faculty and resident physicians. J Am Med Inform Assoc. 2004;11(4):300-309.CrossRef Embi PJ, Yackel TR, Logan JR, Bowen JL, Cooney TG, Gorman PN. Impacts of computerized physician documentation in a teaching hospital: perceptions of faculty and resident physicians. J Am Med Inform Assoc. 2004;11(4):300-309.CrossRef
26.
go back to reference Rizvi RF, Harder KA, Hultman GM, et al. A comparative observational study of inpatient clinical note-entry and reading/retrieval styles adopted by physicians. Int J Med Inform 2016;90:1-11.CrossRef Rizvi RF, Harder KA, Hultman GM, et al. A comparative observational study of inpatient clinical note-entry and reading/retrieval styles adopted by physicians. Int J Med Inform 2016;90:1-11.CrossRef
27.
go back to reference Pollard SE, Neri PM, Wilcox AR, et al. How physicians document outpatient visit notes in an electronic health record. Int J Med Inform 2013;82(1):39-46.CrossRef Pollard SE, Neri PM, Wilcox AR, et al. How physicians document outpatient visit notes in an electronic health record. Int J Med Inform 2013;82(1):39-46.CrossRef
Metadata
Title
Effect of Outpatient Note Templates on Note Quality: NOTE (Notation Optimization through Template Engineering) Randomized Clinical Trial
Authors
Jeremy A. Epstein, MD
Joseph Cofrancesco Jr, MD, MPH
Mary Catherine Beach, MD, MPH
Amanda Bertram, MS
Helene F. Hedian, MD
Sara Mixter, MD, MPH
Hsin-Chieh Yeh, PhD
Gail Berkenblit, MD, PhD
Publication date
01-03-2021
Publisher
Springer International Publishing
Published in
Journal of General Internal Medicine / Issue 3/2021
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-020-06188-0

Other articles of this Issue 3/2021

Journal of General Internal Medicine 3/2021 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.