Skip to main content
Top
Published in: Journal of Medical Systems 5/2012

01-10-2012 | ORIGINAL PAPER

How are Health Professionals Using Health Information Exchange Systems? Measuring Usage for Evaluation and System Improvement

Authors: Joshua R. Vest, ‘Jon (Sean) Jasperson

Published in: Journal of Medical Systems | Issue 5/2012

Login to get access

Abstract

Health information exchange (HIE) is an avenue to improving patient care and an important priority under the Meaningful Use requirements. However, we know very little about the usage of HIE systems. Understanding how healthcare professionals actually utilize HIE systems will provide practical insights to system evaluation, help guide system improvement, and help organizations assess performance. We developed a novel way of describing professionals’ HIE usage from the log files of an operational HIE-facilitating organization. The system employed a webpage-style interface. The screen number, types, and variation served to cluster all sessions in to five categories of HIE usage: minimal usage, repetitive searching, clinical information, mixed information, and demographic information. This method reduced the 1,661 different patterns into five recognizable groups for analysis. Overall, most users engaged with the system in a minimal fashion. In terms of user characteristics, minimal usage was highest among physicians and the highest percentage of clinical information usage was among nurses. Usage also differed by organization with repetitive searching most common in settings with scheduled encounters and uncommon in the faster-paced emergency department. Lastly, usage also varied by timing of the patient encounter. Within a single HIE system, discernible types of users behavior existed and varied across jobs, organizations, and time. This approach relied on objective data and can be replicated. In addition, our approach demonstrates that substantial variation in user behaviors exists beyond the more simplistic measures of adoption/non-adoption or access/no-access applied in previous research. This approach can help leaders and evaluators assess their own and other organizations.
Literature
1.
go back to reference President’s Council of Advisors on Science and Technology. Report to the President. Realizing the Full Potential of Health Information Technology to Improve Healthcare for Americans: The Path Forward. Washington, DC: Executive Office of the President. 2010. President’s Council of Advisors on Science and Technology. Report to the President. Realizing the Full Potential of Health Information Technology to Improve Healthcare for Americans: The Path Forward. Washington, DC: Executive Office of the President. 2010.
4.
go back to reference 111th Congress of the United States of America. American Recovery and Reinvestment Act of 2009. 111th Congress of the United States of America. American Recovery and Reinvestment Act of 2009.
5.
go back to reference Department of Health & Human Services. 42 CFR Parts 412, 413, 422 et al. Medicare and Medicaid Programs; Electronic Health Record Incentive Program; Final Rule. Federal Register. 2010;75(144):44314–588. Department of Health & Human Services. 42 CFR Parts 412, 413, 422 et al. Medicare and Medicaid Programs; Electronic Health Record Incentive Program; Final Rule. Federal Register. 2010;75(144):44314–588.
6.
go back to reference Hripcsak, G., Kaushal, R., Johnson, K. B., Ash, J. S., Bates, D. W., Block, R., et al., The United Hospital Fund meeting on evaluating health information exchange. Journal of Biomedical Informatics 40(6 S1):S3–S10, 2007.CrossRef Hripcsak, G., Kaushal, R., Johnson, K. B., Ash, J. S., Bates, D. W., Block, R., et al., The United Hospital Fund meeting on evaluating health information exchange. Journal of Biomedical Informatics 40(6 S1):S3–S10, 2007.CrossRef
7.
go back to reference Institute of Medicine. Fostering Rapid Advances in Health Care: Learning from System Demonstrations. Corrigan J, Greiner A, Erikson S, editors. Washington, D.C.: National Academy Press. 2003. Institute of Medicine. Fostering Rapid Advances in Health Care: Learning from System Demonstrations. Corrigan J, Greiner A, Erikson S, editors. Washington, D.C.: National Academy Press. 2003.
8.
go back to reference Branger P, van’t Hooft A, van der Wouden HC. Coordinating shared care using electronic data interchange. Medinfo 95 Proceedings. 8 Pt 2: 1669; 1995. Branger P, van’t Hooft A, van der Wouden HC. Coordinating shared care using electronic data interchange. Medinfo 95 Proceedings. 8 Pt 2: 1669; 1995.
9.
go back to reference Hessler, B. J., Soper, P., Bondy, J., Hanes, P., and Davidson, A., Assessing the Relationship Between Health Information Exchanges and Public Health Agencies. Journal of Public Health Management and Practice. 15(5):416–24, 2009. doi:10.1097/01.PHH.0000359636.63529.74. Hessler, B. J., Soper, P., Bondy, J., Hanes, P., and Davidson, A., Assessing the Relationship Between Health Information Exchanges and Public Health Agencies. Journal of Public Health Management and Practice. 15(5):416–24, 2009. doi:10.​1097/​01.​PHH.​0000359636.​63529.​74.
10.
go back to reference Overhage, J., Deter, P., Perkins, S., Cordell, W., McGoff, J., and McGrath, R., A randomized, controlled trial of clinical information shared from another institution. Annals of Emergency Medicine. 39(1):14–23, 2002.CrossRef Overhage, J., Deter, P., Perkins, S., Cordell, W., McGoff, J., and McGrath, R., A randomized, controlled trial of clinical information shared from another institution. Annals of Emergency Medicine. 39(1):14–23, 2002.CrossRef
11.
go back to reference Wilcox A, Kuperman G, Dorr DA, Hripcsak G, Narus SP, Thornton SN, et al. Architectural strategies and issues with health information exchange. AMIA Annual Symposium Proceedings. 2006:814–8. Wilcox A, Kuperman G, Dorr DA, Hripcsak G, Narus SP, Thornton SN, et al. Architectural strategies and issues with health information exchange. AMIA Annual Symposium Proceedings. 2006:814–8.
12.
go back to reference Grossman, J. M., Bodenheimer, T. S., McKenzie, K., and MARKETWATCH, Hospital-Physician Portals: The Role of Competition in Driving Clinical Data Exchange. Health Affairs 25(6):1629–36, 2006.CrossRef Grossman, J. M., Bodenheimer, T. S., McKenzie, K., and MARKETWATCH, Hospital-Physician Portals: The Role of Competition in Driving Clinical Data Exchange. Health Affairs 25(6):1629–36, 2006.CrossRef
13.
go back to reference Vest, J. R., Zhao, H., Jasperson, J., Gamm, L. D., and Ohsfeldt, R. L., Factors motivating and affecting health information exchange usage. Journal of the American Medical Informatics Association. 18(2):143–9, 2011.CrossRef Vest, J. R., Zhao, H., Jasperson, J., Gamm, L. D., and Ohsfeldt, R. L., Factors motivating and affecting health information exchange usage. Journal of the American Medical Informatics Association. 18(2):143–9, 2011.CrossRef
14.
go back to reference Classen, D. C., Kanhouwa, M., Will, D., Casper, J., Lewin, J., and Walker, J., The patient safety institute demonstration project: a model for implementing a local health information infrastructure. Journal of Healthcare Information Management. 19(4):75–86, 2005. Classen, D. C., Kanhouwa, M., Will, D., Casper, J., Lewin, J., and Walker, J., The patient safety institute demonstration project: a model for implementing a local health information infrastructure. Journal of Healthcare Information Management. 19(4):75–86, 2005.
15.
go back to reference Johnson KB, Gadd C, Aronsky D, Yang K, Tang L, Estrin V, et al. The MidSouth eHealth Alliance: Use and Impact in the First Year. AMIA Annual Symposium Proceedings. 2008:333–7. Johnson KB, Gadd C, Aronsky D, Yang K, Tang L, Estrin V, et al. The MidSouth eHealth Alliance: Use and Impact in the First Year. AMIA Annual Symposium Proceedings. 2008:333–7.
16.
go back to reference Vest, J. R., and Jasperson, J., What should we measure? Conceptualizing usage in health information exchange. Journal of the American Medical Informatics Association. 17(3):302–7, 2010. Vest, J. R., and Jasperson, J., What should we measure? Conceptualizing usage in health information exchange. Journal of the American Medical Informatics Association. 17(3):302–7, 2010.
17.
go back to reference Gadd CS, Ho Y-X, Cala CM, Blakemore D, Chen Q, Frisse ME, et al. User perspectives on the usability of a regional health information exchange. Journal of the American Medical Informatics Association. 2011; in press. Gadd CS, Ho Y-X, Cala CM, Blakemore D, Chen Q, Frisse ME, et al. User perspectives on the usability of a regional health information exchange. Journal of the American Medical Informatics Association. 2011; in press.
18.
go back to reference Labkoff, S. E., and Yasnoff, W. A., A framework for systematic evaluation of health information infrastructure progress in communities. Journal of Biomedical Informatics. 40(2):100–5, 2007.CrossRef Labkoff, S. E., and Yasnoff, W. A., A framework for systematic evaluation of health information infrastructure progress in communities. Journal of Biomedical Informatics. 40(2):100–5, 2007.CrossRef
19.
go back to reference Johnson, K. B., and Gadd, C., Playing smallball: Approaches to evaluating pilot health information exchange systems. Journal of Biomedical Informatics 40(6 Supplement 1):S21–S6, 2007.CrossRef Johnson, K. B., and Gadd, C., Playing smallball: Approaches to evaluating pilot health information exchange systems. Journal of Biomedical Informatics 40(6 Supplement 1):S21–S6, 2007.CrossRef
20.
go back to reference Burton-Jones, A., and Straub, D. W., Reconceptualizing system usage: An approach and empirical test. Information Systems Research. 17(3):228–46, 2006.CrossRef Burton-Jones, A., and Straub, D. W., Reconceptualizing system usage: An approach and empirical test. Information Systems Research. 17(3):228–46, 2006.CrossRef
21.
go back to reference Hripcsak, G., Sengupta, S., Wilcox, A., and Green, R. A., Emergency department access to a longitudinal medical record. Journal of the American Medical Informatics Association. 14(2):235–8, 2007.CrossRef Hripcsak, G., Sengupta, S., Wilcox, A., and Green, R. A., Emergency department access to a longitudinal medical record. Journal of the American Medical Informatics Association. 14(2):235–8, 2007.CrossRef
22.
go back to reference Larum, H., Ellingsen, G., and Faxvaag, A., Doctors’ use of electronic medical records systems in hospitals: cross sectional survey. BMJ. 323(7325):1344–8, 2001.CrossRef Larum, H., Ellingsen, G., and Faxvaag, A., Doctors’ use of electronic medical records systems in hospitals: cross sectional survey. BMJ. 323(7325):1344–8, 2001.CrossRef
23.
go back to reference Ross, S. E., Schilling, L. M., Fernald, D. H., Davidson, A. J., and West, D. R., Health information exchange in small-to-medium sized family medicine practices: Motivators, barriers, and potential facilitators of adoption. International Journal of Medical Informatics. 79(2):123–9, 2010. doi:10.1016/j.ijmedinf.2009.12.001.CrossRef Ross, S. E., Schilling, L. M., Fernald, D. H., Davidson, A. J., and West, D. R., Health information exchange in small-to-medium sized family medicine practices: Motivators, barriers, and potential facilitators of adoption. International Journal of Medical Informatics. 79(2):123–9, 2010. doi:10.​1016/​j.​ijmedinf.​2009.​12.​001.CrossRef
24.
go back to reference Shapiro, J. S., Kannry, J., Kushniruk, A. W., and Kuperman, G., The New York Clinical Information Exchange Clinical Advisory S, Emergency Physicians’ Perceptions of Health Information Exchange. Journal of the American Medical Informatics Association 14(6):700–5, 2007.CrossRef Shapiro, J. S., Kannry, J., Kushniruk, A. W., and Kuperman, G., The New York Clinical Information Exchange Clinical Advisory S, Emergency Physicians’ Perceptions of Health Information Exchange. Journal of the American Medical Informatics Association 14(6):700–5, 2007.CrossRef
25.
go back to reference eHealth Initiative. The State of Health Information Exchange in 2010: Connecting the Nation to Achieve Meaningful Use. Washington, DC. 2010. eHealth Initiative. The State of Health Information Exchange in 2010: Connecting the Nation to Achieve Meaningful Use. Washington, DC. 2010.
26.
go back to reference Rudin, R. S., Simon, S. R., Volk, L. A., Tripathi, M., and Bates, D., Understanding the Decisions and Values of Stakeholders in Health Information Exchanges: Experiences From Massachusetts. American Journal of Public Health. 99(5):950–5, 2009.CrossRef Rudin, R. S., Simon, S. R., Volk, L. A., Tripathi, M., and Bates, D., Understanding the Decisions and Values of Stakeholders in Health Information Exchanges: Experiences From Massachusetts. American Journal of Public Health. 99(5):950–5, 2009.CrossRef
27.
go back to reference Johnson, K. B., Unertl, K. M., Chen, Q., Lorenzi, N. M., Nian, H., Bailey, J., et al., Health information exchange usage in emergency departments and clinics: the who, what, and why. Journal of the American Medical Informatics Association. 18(5):690–7, 2011.CrossRef Johnson, K. B., Unertl, K. M., Chen, Q., Lorenzi, N. M., Nian, H., Bailey, J., et al., Health information exchange usage in emergency departments and clinics: the who, what, and why. Journal of the American Medical Informatics Association. 18(5):690–7, 2011.CrossRef
28.
go back to reference Vest, J. R., and Gamm, L. D., Health information exchange: persistant challenges & new strategies. Journal of the American Medical Informatics Association. 17(3):288–94, 2010. Vest, J. R., and Gamm, L. D., Health information exchange: persistant challenges & new strategies. Journal of the American Medical Informatics Association. 17(3):288–94, 2010.
29.
go back to reference Smith, H. L., Bullers, W. I., Jr., and Piland, N. F., Does information technology make a difference in healthcare organization performance? A multiyear study. Hospital Topics. 78(2):13–22, 2000.CrossRef Smith, H. L., Bullers, W. I., Jr., and Piland, N. F., Does information technology make a difference in healthcare organization performance? A multiyear study. Hospital Topics. 78(2):13–22, 2000.CrossRef
30.
go back to reference Devaraj, S., and Kohli, R., Performance impacts of information technology: is actual usage the missing link. Management Science. 49(3):273–89, 2003.CrossRef Devaraj, S., and Kohli, R., Performance impacts of information technology: is actual usage the missing link. Management Science. 49(3):273–89, 2003.CrossRef
31.
go back to reference Vest JR, Gamm L, Ohsfeldt R, Zhao H, Jasperson J. Factors Associated with Health Information Exchange System Usage in a Safety-Net Ambulatory Care Clinic Setting. Journal of Medical Systems. 2011:1–7. Vest JR, Gamm L, Ohsfeldt R, Zhao H, Jasperson J. Factors Associated with Health Information Exchange System Usage in a Safety-Net Ambulatory Care Clinic Setting. Journal of Medical Systems. 2011:1–7.
32.
go back to reference Vest, J. R., Health information exchange and healthcare utilization. Journal of Medical Systems. 33(3):223–31, 2009.CrossRef Vest, J. R., Health information exchange and healthcare utilization. Journal of Medical Systems. 33(3):223–31, 2009.CrossRef
33.
go back to reference Huang, C.-Y., Shen, Y.-C., Chiang, I.-P., and Lin, C.-S., Characterizing Web users’ online information behavior. Journal of the American Society for Information Science and Technology. 58(13):1988–97, 2007.CrossRef Huang, C.-Y., Shen, Y.-C., Chiang, I.-P., and Lin, C.-S., Characterizing Web users’ online information behavior. Journal of the American Society for Information Science and Technology. 58(13):1988–97, 2007.CrossRef
34.
go back to reference Brzinsky-Fay, C., Kohler, U., and Luniak, M., Sequence analysis with Stata. The Stata Journal. 6(4):435–60, 2006. Brzinsky-Fay, C., Kohler, U., and Luniak, M., Sequence analysis with Stata. The Stata Journal. 6(4):435–60, 2006.
35.
go back to reference Department of Health & Human Services, 45 CFR Part 170 Health Information Technology: Initial Set of Standards, Implementation Specifications, and Certification Criteria for Electronic Health Record Technology; Interim Final Rule. Federal Register. 75(8):2014–47, 2010. Department of Health & Human Services, 45 CFR Part 170 Health Information Technology: Initial Set of Standards, Implementation Specifications, and Certification Criteria for Electronic Health Record Technology; Interim Final Rule. Federal Register. 75(8):2014–47, 2010.
37.
go back to reference Kuperman, G. J., Blair, J. S., Franck, R. A., Devaraj, S., and Low, A. F. H., For the NHIN Trial Implementations Core Services Content Working Group. Developing data content specifications for the Nationwide Health Information Network Trial Implementations. Journal of the American Medical Informatics Association. 17(1):6–12, 2010.CrossRef Kuperman, G. J., Blair, J. S., Franck, R. A., Devaraj, S., and Low, A. F. H., For the NHIN Trial Implementations Core Services Content Working Group. Developing data content specifications for the Nationwide Health Information Network Trial Implementations. Journal of the American Medical Informatics Association. 17(1):6–12, 2010.CrossRef
39.
go back to reference Adler-Milstein, J., Bates, D. W., and Jha, A. K., A Survey of Health Information Exchange Organizations in the United States: Implications for Meaningful Use. Annals of Internal Medicine. 154(10):666–71, 2011. Adler-Milstein, J., Bates, D. W., and Jha, A. K., A Survey of Health Information Exchange Organizations in the United States: Implications for Meaningful Use. Annals of Internal Medicine. 154(10):666–71, 2011.
40.
go back to reference Malin, B., Nyemba, S., and Paulett, J., Learning relational policies from electronic health record access logs. Journal of Biomedical Informatics. 44(2):333–42, 2011.CrossRef Malin, B., Nyemba, S., and Paulett, J., Learning relational policies from electronic health record access logs. Journal of Biomedical Informatics. 44(2):333–42, 2011.CrossRef
42.
go back to reference Healthcare Information & Management Systems Society. Health Information Exchanges: Similarities and Differences. HIMSS HIE Common Practices Survey Results White Paper Chicago, IL. 2009. Healthcare Information & Management Systems Society. Health Information Exchanges: Similarities and Differences. HIMSS HIE Common Practices Survey Results White Paper Chicago, IL. 2009.
43.
go back to reference Rudin, R. S., Why clinicians use or don’t use health information exchange. Journal of the American Medical Informatics Association 18(4):529, 2011.CrossRef Rudin, R. S., Why clinicians use or don’t use health information exchange. Journal of the American Medical Informatics Association 18(4):529, 2011.CrossRef
44.
go back to reference Ash, J. S., and Guappone, K. P., Qualitative evaluation of health information exchange efforts. Journal of Biomedical Informatics 40(6 Supplement 1):S33–S9, 2007.CrossRef Ash, J. S., and Guappone, K. P., Qualitative evaluation of health information exchange efforts. Journal of Biomedical Informatics 40(6 Supplement 1):S33–S9, 2007.CrossRef
Metadata
Title
How are Health Professionals Using Health Information Exchange Systems? Measuring Usage for Evaluation and System Improvement
Authors
Joshua R. Vest
‘Jon (Sean) Jasperson
Publication date
01-10-2012
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 5/2012
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-011-9810-2

Other articles of this Issue 5/2012

Journal of Medical Systems 5/2012 Go to the issue