Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2011

Open Access 01-12-2011 | Research article

Redesign of a computerized clinical reminder for colorectal cancer screening: a human-computer interaction evaluation

Authors: Jason J Saleem, David A Haggstrom, Laura G Militello, Mindy Flanagan, Chris L Kiess, Nicole Arbuckle, Bradley N Doebbeling

Published in: BMC Medical Informatics and Decision Making | Issue 1/2011

Login to get access

Abstract

Background

Based on barriers to the use of computerized clinical decision support (CDS) learned in an earlier field study, we prototyped design enhancements to the Veterans Health Administration's (VHA's) colorectal cancer (CRC) screening clinical reminder to compare against the VHA's current CRC reminder.

Methods

In a controlled simulation experiment, 12 primary care providers (PCPs) used prototypes of the current and redesigned CRC screening reminder in a within-subject comparison. Quantitative measurements were based on a usability survey, workload assessment instrument, and workflow integration survey. We also collected qualitative data on both designs.

Results

Design enhancements to the VHA's existing CRC screening clinical reminder positively impacted aspects of usability and workflow integration but not workload. The qualitative analysis revealed broad support across participants for the design enhancements with specific suggestions for improving the reminder further.

Conclusions

This study demonstrates the value of a human-computer interaction evaluation in informing the redesign of information tools to foster uptake, integration into workflow, and use in clinical practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Gosbee J: Introduction to the human factors engineering series. Jt Comm J Qual Saf. 2004, 30: 215-219.PubMed Gosbee J: Introduction to the human factors engineering series. Jt Comm J Qual Saf. 2004, 30: 215-219.PubMed
2.
go back to reference Johnson CW: Why did that happen? Exploring the proliferation of barely usable software in healthcare systems. Qual Saf Health Care. 2006, 15 (Suppl 1): i76-i81.CrossRefPubMedPubMedCentral Johnson CW: Why did that happen? Exploring the proliferation of barely usable software in healthcare systems. Qual Saf Health Care. 2006, 15 (Suppl 1): i76-i81.CrossRefPubMedPubMedCentral
3.
go back to reference Karsh BT, Weinger MB, Abbott PA, Wears RL: Health information technology: fallacies and sober realities. J Am Med Inform Assoc. 2010, 17: 617-623. 10.1136/jamia.2010.005637.CrossRefPubMedPubMedCentral Karsh BT, Weinger MB, Abbott PA, Wears RL: Health information technology: fallacies and sober realities. J Am Med Inform Assoc. 2010, 17: 617-623. 10.1136/jamia.2010.005637.CrossRefPubMedPubMedCentral
4.
go back to reference Kushniruk AW, Patel VL: Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform. 2004, 37: 56-76. 10.1016/j.jbi.2004.01.003.CrossRefPubMed Kushniruk AW, Patel VL: Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform. 2004, 37: 56-76. 10.1016/j.jbi.2004.01.003.CrossRefPubMed
5.
go back to reference Saathoff A: Human factors considerations relevant to CPOE implementations. J Healthc Inf Manag. 2005, 19: 71-78.PubMed Saathoff A: Human factors considerations relevant to CPOE implementations. J Healthc Inf Manag. 2005, 19: 71-78.PubMed
6.
go back to reference Scanlon M: Computer physician order entry and the real world: we're only humans. Jt Comm J Qual Saf. 2004, 30: 342-346.PubMed Scanlon M: Computer physician order entry and the real world: we're only humans. Jt Comm J Qual Saf. 2004, 30: 342-346.PubMed
7.
go back to reference Zayas-Caban T, Dixon BE: Considerations for the design of safe and effective consumer health IT applications in the home. Qual Saf Health Care. 2010, 19 (Suppl 3): i61-i67. 10.1136/qshc.2010.041897.CrossRefPubMed Zayas-Caban T, Dixon BE: Considerations for the design of safe and effective consumer health IT applications in the home. Qual Saf Health Care. 2010, 19 (Suppl 3): i61-i67. 10.1136/qshc.2010.041897.CrossRefPubMed
8.
go back to reference Saleem JJ, Militello LG, Arbuckle N, Flanagan M, Haggstrom DA, Linder JA: Provider perceptions of colorectal cancer screening clinical decision support at three benchmark institutions. AMIA Annu Symp Proc. 2009, 2009: 558-562.PubMedPubMedCentral Saleem JJ, Militello LG, Arbuckle N, Flanagan M, Haggstrom DA, Linder JA: Provider perceptions of colorectal cancer screening clinical decision support at three benchmark institutions. AMIA Annu Symp Proc. 2009, 2009: 558-562.PubMedPubMedCentral
9.
go back to reference Doebbeling BN, Saleem JJ, Militello LG, Flanagan M, Haggstrom DA, Arbuckle N: Integration of computerized decision support into clinical workflow: Investigating social, technical, and contextual factors. 2011, In Review Doebbeling BN, Saleem JJ, Militello LG, Flanagan M, Haggstrom DA, Arbuckle N: Integration of computerized decision support into clinical workflow: Investigating social, technical, and contextual factors. 2011, In Review
10.
go back to reference Bretthauer M: Evidence for colorectal cancer screening. Best Pract Res Clin Gastroenterol. 2010, 24: 417-425. 10.1016/j.bpg.2010.06.005.CrossRefPubMed Bretthauer M: Evidence for colorectal cancer screening. Best Pract Res Clin Gastroenterol. 2010, 24: 417-425. 10.1016/j.bpg.2010.06.005.CrossRefPubMed
11.
go back to reference Gellad ZF, Provenzale D: Colorectal cancer: national and international perspective on the burden of disease and public health impact. Gastroenterology. 2010, 138: 2177-2190. 10.1053/j.gastro.2010.01.056.CrossRefPubMed Gellad ZF, Provenzale D: Colorectal cancer: national and international perspective on the burden of disease and public health impact. Gastroenterology. 2010, 138: 2177-2190. 10.1053/j.gastro.2010.01.056.CrossRefPubMed
12.
go back to reference Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L: Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003, 10: 523-530. 10.1197/jamia.M1370.CrossRefPubMedPubMedCentral Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L: Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003, 10: 523-530. 10.1197/jamia.M1370.CrossRefPubMedPubMedCentral
13.
go back to reference Jaspers MW, Smeulers M, Vermeulen H, Peute LW: Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. 2011, 18: 327-334. 10.1136/amiajnl-2011-000094.CrossRefPubMedPubMedCentral Jaspers MW, Smeulers M, Vermeulen H, Peute LW: Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. 2011, 18: 327-334. 10.1136/amiajnl-2011-000094.CrossRefPubMedPubMedCentral
14.
go back to reference Patel VL, Zhang J, Yoskowitz NA, Green R, Sayan OR: Translational cognition for decision support in critical care environments: a review. J Biomed Inform. 2008, 41: 413-431. 10.1016/j.jbi.2008.01.013.CrossRefPubMedPubMedCentral Patel VL, Zhang J, Yoskowitz NA, Green R, Sayan OR: Translational cognition for decision support in critical care environments: a review. J Biomed Inform. 2008, 41: 413-431. 10.1016/j.jbi.2008.01.013.CrossRefPubMedPubMedCentral
15.
go back to reference Shiffman RN, Liaw Y, Brandt CA, Corb GJ: Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc. 1999, 6: 104-114. 10.1136/jamia.1999.0060104.CrossRefPubMedPubMedCentral Shiffman RN, Liaw Y, Brandt CA, Corb GJ: Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc. 1999, 6: 104-114. 10.1136/jamia.1999.0060104.CrossRefPubMedPubMedCentral
16.
go back to reference Sittig DF, Wright A, Osheroff JA, Middleton B, Teich JM, Ash JS: Grand challenges in clinical decision support. J Biomed Inform. 2008, 41: 387-392. 10.1016/j.jbi.2007.09.003.CrossRefPubMed Sittig DF, Wright A, Osheroff JA, Middleton B, Teich JM, Ash JS: Grand challenges in clinical decision support. J Biomed Inform. 2008, 41: 387-392. 10.1016/j.jbi.2007.09.003.CrossRefPubMed
17.
go back to reference Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM: Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005, 12: 438-447. 10.1197/jamia.M1777.CrossRefPubMedPubMedCentral Saleem JJ, Patterson ES, Militello L, Render ML, Orshansky G, Asch SM: Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005, 12: 438-447. 10.1197/jamia.M1777.CrossRefPubMedPubMedCentral
18.
go back to reference Torpy JM, Lynm C, Glass RM: JAMA patient page. Colon cancer screening. JAMA. 2006, 295: 1208-10.1001/jama.295.10.1208.CrossRefPubMed Torpy JM, Lynm C, Glass RM: JAMA patient page. Colon cancer screening. JAMA. 2006, 295: 1208-10.1001/jama.295.10.1208.CrossRefPubMed
20.
go back to reference Hart S, Staveland L, Development of the NASA TLX (Task Load Index): Results from empirical and theoretical research. Human Mental Workload. Edited by: Hancock PA, Meshkati N. 1988, North-Holland: Elsevier Science Publishers, 139-183.CrossRef Hart S, Staveland L, Development of the NASA TLX (Task Load Index): Results from empirical and theoretical research. Human Mental Workload. Edited by: Hancock PA, Meshkati N. 1988, North-Holland: Elsevier Science Publishers, 139-183.CrossRef
21.
go back to reference Hendy KC, Hamilton KM, Landry LN: Measuring subjective workload: When is one scale better than many?. Hum Factors. 1993, 35: 579-601. Hendy KC, Hamilton KM, Landry LN: Measuring subjective workload: When is one scale better than many?. Hum Factors. 1993, 35: 579-601.
22.
go back to reference Nygren TE: Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Hum Factors. 1991, 33: 17-33. Nygren TE: Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Hum Factors. 1991, 33: 17-33.
23.
go back to reference Lewis JR: IBM Computer Usability Satisfaction Questionnaires: Psychometric evaluation and instructions for use. Int J Human-Comp Inter. 1995, 7: 57-78.CrossRef Lewis JR: IBM Computer Usability Satisfaction Questionnaires: Psychometric evaluation and instructions for use. Int J Human-Comp Inter. 1995, 7: 57-78.CrossRef
24.
go back to reference Flanagan M, Arbuckle N, Saleem JJ, Militello LG, Haggstrom DA, Doebbeling BN: Development of a workflow integration survey (WIS) for implementing computerized clinical decision support. AMIA Annu Symp Proc. 2011, 427-34. Flanagan M, Arbuckle N, Saleem JJ, Militello LG, Haggstrom DA, Doebbeling BN: Development of a workflow integration survey (WIS) for implementing computerized clinical decision support. AMIA Annu Symp Proc. 2011, 427-34.
25.
go back to reference Saleem JJ, Patterson ES, Militello L, Asch SM, Doebbeling BN, Render ML: Using human factors methods to design a new interface for an electronic medical record. AMIA Annu Symp Proc. 2007, 640-644. Saleem JJ, Patterson ES, Militello L, Asch SM, Doebbeling BN, Render ML: Using human factors methods to design a new interface for an electronic medical record. AMIA Annu Symp Proc. 2007, 640-644.
Metadata
Title
Redesign of a computerized clinical reminder for colorectal cancer screening: a human-computer interaction evaluation
Authors
Jason J Saleem
David A Haggstrom
Laura G Militello
Mindy Flanagan
Chris L Kiess
Nicole Arbuckle
Bradley N Doebbeling
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2011
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-11-74

Other articles of this Issue 1/2011

BMC Medical Informatics and Decision Making 1/2011 Go to the issue