Skip to main content
Top
Published in: Journal of Clinical Monitoring and Computing 4/2012

01-08-2012

The evolution of eProtocols that enable reproducible clinical research and care methods

Authors: Denitza P. Blagev, Eliotte L. Hirshberg, Katherine Sward, B. Taylor Thompson, Roy Brower, Jonathon Truwit, Duncan Hite, Jay Steingrub, James F. Orme Jr., Terry P. Clemmer, Lindell K. Weaver, Frank Thomas, Colin K. Grissom, Dean Sorenson, Dean F. Sittig, C. Jane Wallace, Thomas D. East, Homer R. Warner, Alan H. Morris

Published in: Journal of Clinical Monitoring and Computing | Issue 4/2012

Login to get access

Abstract

Unnecessary variation in clinical care and clinical research reduces our ability to determine what healthcare interventions are effective. Reducing this unnecessary variation could lead to further healthcare quality improvement and more effective clinical research. We have developed and used electronic decision support tools (eProtocols) to reduce unnecessary variation. Our eProtocols have progressed from a locally developed mainframe computer application in one clinical site (LDS Hospital) to web-based applications available in multiple languages and used internationally. We use eProtocol-insulin as an example to illustrate this evolution. We initially developed eProtocol-insulin as a local quality improvement effort to manage stress hyperglycemia in the adult intensive care unit (ICU). We extended eProtocol-insulin use to translate our quality improvement results into usual clinical care at Intermountain Healthcare ICUs. We exported eProtocol-insulin to support research in other US and international institutions, and extended our work to the pediatric ICU. We iteratively refined eProtocol-insulin throughout these transitions, and incorporated new knowledge about managing stress hyperglycemia in the ICU. Based on our experience in the development and clinical use of eProtocols, we outline remaining challenges to eProtocol development, widespread distribution and use, and suggest a process for eProtocol development. Technical and regulatory issues, as well as standardization of protocol development, validation and maintenance, need to be addressed. Resolution of these issues should facilitate general use of eProtocols to improve patient care.
Literature
1.
go back to reference Gould SJ. Full house: the spread of excellence from Plato to Darwin. 1st ed. New York: Harmony Books; 1996. Gould SJ. Full house: the spread of excellence from Plato to Darwin. 1st ed. New York: Harmony Books; 1996.
2.
go back to reference Kurzweil R. The singularity is near—when humans transcend biology. New York: Viking Penguin; 2005. Kurzweil R. The singularity is near—when humans transcend biology. New York: Viking Penguin; 2005.
3.
go back to reference Frank RH. The Darwin economy: liberty, competition, and the common good. Princeton N.J.: Princeton University Press; 2011. Frank RH. The Darwin economy: liberty, competition, and the common good. Princeton N.J.: Princeton University Press; 2011.
4.
go back to reference Hulley S, Cummings S. Designing clinical research. Baltimore: Williams and Wilkins; 1988. Hulley S, Cummings S. Designing clinical research. Baltimore: Williams and Wilkins; 1988.
5.
go back to reference Morris A. The importance of protocol-directed patient management for research on lung-protective ventilation. In: Dreyfuss D, Saumon G, Hubamyr R, editors. Ventilator-induced lung injury. New York: Taylor & Francis Group; 2006. p. 537–610. Morris A. The importance of protocol-directed patient management for research on lung-protective ventilation. In: Dreyfuss D, Saumon G, Hubamyr R, editors. Ventilator-induced lung injury. New York: Taylor & Francis Group; 2006. p. 537–610.
6.
go back to reference Shewart W. Economic control of quality of manufactured product. New York, NY: D. Van Nostrand Co., Inc. (republished in 1980, American Society for Quality Control, 230 W. Wells St, Milwaukee, Wisconsin 53203); 1931. Shewart W. Economic control of quality of manufactured product. New York, NY: D. Van Nostrand Co., Inc. (republished in 1980, American Society for Quality Control, 230 W. Wells St, Milwaukee, Wisconsin 53203); 1931.
7.
go back to reference Deming W. Quality, productivity, and competitive position. Cambridge: Massachusetts Institute of Technology, Center for Advanced Engineering Study; 1982. Deming W. Quality, productivity, and competitive position. Cambridge: Massachusetts Institute of Technology, Center for Advanced Engineering Study; 1982.
8.
go back to reference Deming W. Out of the crisis. Cambridge: Massachusetts Institute of Technology, Center for Advanced engineering Study; 1986. Deming W. Out of the crisis. Cambridge: Massachusetts Institute of Technology, Center for Advanced engineering Study; 1986.
9.
go back to reference James B, Horn S, Stephenson R. Management by fact: what is CPI and how is it used? In: Horn S, Hopkins D, editors. Clinical practice improvement: a new technology for developing cost-effective quality health care. New York: Faulker & Gray, Inc.; 1994. p. 39–54. James B, Horn S, Stephenson R. Management by fact: what is CPI and how is it used? In: Horn S, Hopkins D, editors. Clinical practice improvement: a new technology for developing cost-effective quality health care. New York: Faulker & Gray, Inc.; 1994. p. 39–54.
10.
go back to reference East TD, Böhm SH, Wallace CJ, Clemmer TP, Weaver LK, Orme JF Jr, et al. A successful computerized protocol for clinical management of pressure control inverse ratio ventilation in ARDS patients. Chest. 1992;101(3):697–710.PubMedCrossRef East TD, Böhm SH, Wallace CJ, Clemmer TP, Weaver LK, Orme JF Jr, et al. A successful computerized protocol for clinical management of pressure control inverse ratio ventilation in ARDS patients. Chest. 1992;101(3):697–710.PubMedCrossRef
11.
go back to reference Morris A, Wallace C, Menlove R, Clemmer T, Orme J, Weaver L, et al. Randomized clinical trial of pressure-controlled inverse ratio ventilation and extracorporeal CO2 removal for ARDS [erratum 1994;149(3, Pt 1):838, Letters to the editor 1995;151(1):255–256, 1995;151(4):1269–1270, and 1997;156(3):1016–1017]. Am J Respir Crit Care Med. 1994;149(2):295–305. Morris A, Wallace C, Menlove R, Clemmer T, Orme J, Weaver L, et al. Randomized clinical trial of pressure-controlled inverse ratio ventilation and extracorporeal CO2 removal for ARDS [erratum 1994;149(3, Pt 1):838, Letters to the editor 1995;151(1):255–256, 1995;151(4):1269–1270, and 1997;156(3):1016–1017]. Am J Respir Crit Care Med. 1994;149(2):295–305.
12.
go back to reference East T, Heermann L, Bradshaw R, Lugo A, Sailors R, Ershler L, et al. Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial. Proc AMIA Symp. 1999:251–5. East T, Heermann L, Bradshaw R, Lugo A, Sailors R, Ershler L, et al. Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial. Proc AMIA Symp. 1999:251–5.
13.
go back to reference Morris AH, Orme J Jr, Truwit JD, Steingrub J, Grissom C, Lee KH, et al. A replicable method for blood glucose control in critically ill patients. Crit Care Med. 2008;36(6):1787–95.PubMedCrossRef Morris AH, Orme J Jr, Truwit JD, Steingrub J, Grissom C, Lee KH, et al. A replicable method for blood glucose control in critically ill patients. Crit Care Med. 2008;36(6):1787–95.PubMedCrossRef
14.
go back to reference Morris AH, Orme J, Rocha BH, Holmen J, Clemmer T, Nelson N, et al. An electronic protocol for translation of research results to clinical practice: a preliminary report. J Diabetes Sci Technol. 2008;2(5):802–8.PubMed Morris AH, Orme J, Rocha BH, Holmen J, Clemmer T, Nelson N, et al. An electronic protocol for translation of research results to clinical practice: a preliminary report. J Diabetes Sci Technol. 2008;2(5):802–8.PubMed
15.
go back to reference Sward K, Orme J Jr, Sorenson D, Baumann L, Morris AH. Reasons for declining computerized insulin protocol recommendations: application of a framework. J Biomed Inform. 2008;41(3):488–97.PubMedCrossRef Sward K, Orme J Jr, Sorenson D, Baumann L, Morris AH. Reasons for declining computerized insulin protocol recommendations: application of a framework. J Biomed Inform. 2008;41(3):488–97.PubMedCrossRef
16.
go back to reference Thompson B, Orme J, Zheng H, Luckett P, Truwit J, Willson D, et al. Multicenter validation of a computer-based clinical decision support tool for glucose control in adult and pediatric intensive care units. J Diabetes Sci Technol. 2008;2(3):357–68.PubMed Thompson B, Orme J, Zheng H, Luckett P, Truwit J, Willson D, et al. Multicenter validation of a computer-based clinical decision support tool for glucose control in adult and pediatric intensive care units. J Diabetes Sci Technol. 2008;2(3):357–68.PubMed
17.
go back to reference Jaspers MWM, Smeulers M, Vermeulen H, Peute LW. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. 2011;18(3):327–34.PubMedCrossRef Jaspers MWM, Smeulers M, Vermeulen H, Peute LW. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc. 2011;18(3):327–34.PubMedCrossRef
18.
go back to reference Gardner RM, Crapo RO, Morris AH, Beus ML. Computerized decision-making in the pulmonary function laboratory. Respir Care. 1982;27:799–808.PubMed Gardner RM, Crapo RO, Morris AH, Beus ML. Computerized decision-making in the pulmonary function laboratory. Respir Care. 1982;27:799–808.PubMed
19.
go back to reference Kanner RE, Morris AH. Clinical pulmonary function testing, a manual of uniform laboratory procedures for the intermountain area. 1st ed. Salt Lake City: Intermountain Thoracic Society; 1975. Kanner RE, Morris AH. Clinical pulmonary function testing, a manual of uniform laboratory procedures for the intermountain area. 1st ed. Salt Lake City: Intermountain Thoracic Society; 1975.
20.
go back to reference Morris AH, Kanner RE, Crapo RO, Gardner RM. Clinical pulmonary function testing: a manual of uniform laboratory procedures. 2nd ed. Salt Lake City: Intermountain Thoracic Society; 1984. Morris AH, Kanner RE, Crapo RO, Gardner RM. Clinical pulmonary function testing: a manual of uniform laboratory procedures. 2nd ed. Salt Lake City: Intermountain Thoracic Society; 1984.
21.
go back to reference Morris A, Orme J Jr, Truwit J, Steingrub J, Grissom C, Lee K, et al. A replicable method for blood glucose control in critically ill patients. Crit Care Med. 2008;36:1787–95.PubMedCrossRef Morris A, Orme J Jr, Truwit J, Steingrub J, Grissom C, Lee K, et al. A replicable method for blood glucose control in critically ill patients. Crit Care Med. 2008;36:1787–95.PubMedCrossRef
22.
go back to reference Morris A. Developing and implementing computerized protocols for standardization of clinical decisions. Ann Int Med. 2000;132:373–83.PubMed Morris A. Developing and implementing computerized protocols for standardization of clinical decisions. Ann Int Med. 2000;132:373–83.PubMed
23.
go back to reference Warner H, Olmsted C, Rutherford B. HELP—a program for medical decision-making. Comp Biomed Res. 1972;5:65–74.CrossRef Warner H, Olmsted C, Rutherford B. HELP—a program for medical decision-making. Comp Biomed Res. 1972;5:65–74.CrossRef
24.
25.
go back to reference McKinley BA, Moore FA, Sailors RM, Cocanour CS, Marquez A, Wright RK, et al. Computerized decision support for mechanical ventilation of trauma induced ARDS: results of a randomized clinical trial. J Trauma. 2001;50(3):415–24; discussion 25. McKinley BA, Moore FA, Sailors RM, Cocanour CS, Marquez A, Wright RK, et al. Computerized decision support for mechanical ventilation of trauma induced ARDS: results of a randomized clinical trial. J Trauma. 2001;50(3):415–24; discussion 25.
26.
go back to reference McKinley BA, Moore LJ, Sucher JF, Todd SR, Turner KL, Valdivia A, et al. Computer protocol facilitates evidence-based care of sepsis in the surgical intensive care unit. J Trauma. 2011;70(5):1153–67 10.097/TA.0b013e31821598e9. McKinley BA, Moore LJ, Sucher JF, Todd SR, Turner KL, Valdivia A, et al. Computer protocol facilitates evidence-based care of sepsis in the surgical intensive care unit. J Trauma. 2011;70(5):1153–67 10.097/TA.0b013e31821598e9.
27.
go back to reference The Acute Respiratory Distress Syndrome Network. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. New Engl J Med. 2000;342(18):1301–8.CrossRef The Acute Respiratory Distress Syndrome Network. Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. New Engl J Med. 2000;342(18):1301–8.CrossRef
28.
go back to reference The National Heart Lung and Blood Institute Acute Respiratory Distress Syndrome Clinical Trials Network. Pulmonary-artery versus central venous catheter to guide treatment of acute lung injury. N Engl J Med. 2006;354(21):2213–24.CrossRef The National Heart Lung and Blood Institute Acute Respiratory Distress Syndrome Clinical Trials Network. Pulmonary-artery versus central venous catheter to guide treatment of acute lung injury. N Engl J Med. 2006;354(21):2213–24.CrossRef
29.
go back to reference The National Heart Lung and Blood Institute Acute Respiratory Distress Syndrome Clinical Trials Network. Comparison of two fluid-management strategies in acute lung injury. N Engl J Med. 2006;354(24):2564–75.CrossRef The National Heart Lung and Blood Institute Acute Respiratory Distress Syndrome Clinical Trials Network. Comparison of two fluid-management strategies in acute lung injury. N Engl J Med. 2006;354(24):2564–75.CrossRef
30.
go back to reference van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, Schetz M, et al. Intensive insulin therapy in the critically ill patients. N Engl J Med. 2001;345(19):1359–67.PubMedCrossRef van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, Schetz M, et al. Intensive insulin therapy in the critically ill patients. N Engl J Med. 2001;345(19):1359–67.PubMedCrossRef
31.
go back to reference Sorenson D, Grissom CK, Carpenter L, Austin A, Sward K, Napoli L, et al. A frame-based representation for a bedside ventilator weaning protocol. J Biomed Inform. 2008;41(3):461–8.PubMedCrossRef Sorenson D, Grissom CK, Carpenter L, Austin A, Sward K, Napoli L, et al. A frame-based representation for a bedside ventilator weaning protocol. J Biomed Inform. 2008;41(3):461–8.PubMedCrossRef
32.
go back to reference Greenes RA. Clinical decision support: the road ahead. Amsterdam; Boston: Elsevier Academic Press; 2007. Greenes RA. Clinical decision support: the road ahead. Amsterdam; Boston: Elsevier Academic Press; 2007.
33.
go back to reference Rocha R, Bradshaw R, Hulse N, Rocha B. The clinical knowledge management infrastructure of Intermountain Healthcare. In: Greenes R, editor. Clinical decision support: the road ahead. Boston: Academic Press; 2006. p. 469–502. Rocha R, Bradshaw R, Hulse N, Rocha B. The clinical knowledge management infrastructure of Intermountain Healthcare. In: Greenes R, editor. Clinical decision support: the road ahead. Boston: Academic Press; 2006. p. 469–502.
34.
go back to reference Hirshberg E, Lacroix J, Sward K, Willson D, Morris AH. Blood glucose control in critically ill adults and children: a survey on stated practice. Chest. 2008;133(6):1328–35.PubMedCrossRef Hirshberg E, Lacroix J, Sward K, Willson D, Morris AH. Blood glucose control in critically ill adults and children: a survey on stated practice. Chest. 2008;133(6):1328–35.PubMedCrossRef
35.
go back to reference Hirshberg E, Larsen G, Van Duker H. Alterations in glucose homeostasis in the pediatric intensive care unit: Hyperglycemia and glucose variability are associated with increased mortality and morbidity*. Pediatr Crit Care Med. 2008;9(4):361–6.PubMedCrossRef Hirshberg E, Larsen G, Van Duker H. Alterations in glucose homeostasis in the pediatric intensive care unit: Hyperglycemia and glucose variability are associated with increased mortality and morbidity*. Pediatr Crit Care Med. 2008;9(4):361–6.PubMedCrossRef
36.
go back to reference Griesdale DEG, de Souza RJ, van Dam RM, Heyland DK, Cook DJ, Malhotra A, et al. Intensive insulin therapy and mortality among critically ill patients: a meta-analysis including NICE-SUGAR study data. CMAJ. 2009:cmaj.090206. Griesdale DEG, de Souza RJ, van Dam RM, Heyland DK, Cook DJ, Malhotra A, et al. Intensive insulin therapy and mortality among critically ill patients: a meta-analysis including NICE-SUGAR study data. CMAJ. 2009:cmaj.090206.
37.
go back to reference The NICE-SUGAR Study Investigators. Supplement to: the NICE-SUGAR Study Investigators. Intensive versus conventional glucose control in critically ill patients. N Engl J Med 2009;360:1283–97. doi:10.1056/NEJMoa0810625; Supplementary Appendix. Available from: {The NICE-SUGAR Study Investigators, 2009 #3337}. The NICE-SUGAR Study Investigators. Supplement to: the NICE-SUGAR Study Investigators. Intensive versus conventional glucose control in critically ill patients. N Engl J Med 2009;360:1283–97. doi:10.​1056/​NEJMoa0810625; Supplementary Appendix. Available from: {The NICE-SUGAR Study Investigators, 2009 #3337}.
38.
go back to reference Kawamoto K, Del Fiol G, Strasberg HR, Hulse N, Curtis C, Cimino JJ, et al. Multi-national, multi-institutional analysis of clinical decision support data needs to inform development of the HL7 virtual medical record standard. AMIA Annu Symp Proc. 2010;2010:377–81.PubMed Kawamoto K, Del Fiol G, Strasberg HR, Hulse N, Curtis C, Cimino JJ, et al. Multi-national, multi-institutional analysis of clinical decision support data needs to inform development of the HL7 virtual medical record standard. AMIA Annu Symp Proc. 2010;2010:377–81.PubMed
39.
go back to reference Honiden S, Inzucchi SE. Analytic review: glucose controversies in the ICU. J Intensive Care Med. 2011;26(3):135–50.PubMedCrossRef Honiden S, Inzucchi SE. Analytic review: glucose controversies in the ICU. J Intensive Care Med. 2011;26(3):135–50.PubMedCrossRef
40.
41.
go back to reference Preiser JC, Devos P, Ruiz-Santana S, Melot C, Annane D, Groeneveld J, et al. A prospective randomised multi-centre controlled trial on tight glucose control by intensive insulin therapy in adult intensive care units: the glucontrol study. Intensive Care Med. 2009;35(10):1738–48.PubMedCrossRef Preiser JC, Devos P, Ruiz-Santana S, Melot C, Annane D, Groeneveld J, et al. A prospective randomised multi-centre controlled trial on tight glucose control by intensive insulin therapy in adult intensive care units: the glucontrol study. Intensive Care Med. 2009;35(10):1738–48.PubMedCrossRef
42.
go back to reference Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med. 2009;360(15):1477–9.PubMedCrossRef Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med. 2009;360(15):1477–9.PubMedCrossRef
43.
go back to reference Young FE. Validation of medical software: present policy of the Food and Drug Administration. Ann Int Med. 1987;106(4):628–9.PubMed Young FE. Validation of medical software: present policy of the Food and Drug Administration. Ann Int Med. 1987;106(4):628–9.PubMed
44.
go back to reference Hamburg MA. Shattuck lecture. Innovation, regulation, and the FDA. N Engl J Med. [Historical Article Lectures]2010;2;363(23):2228–32. Hamburg MA. Shattuck lecture. Innovation, regulation, and the FDA. N Engl J Med. [Historical Article Lectures]2010;2;363(23):2228–32.
48.
go back to reference Miller RA, Gardner RM. Recommendations for responsible monitoring and regulation of clinical software systems. J Am Med Inform Assoc. 1997;4(6):442–57.PubMedCrossRef Miller RA, Gardner RM. Recommendations for responsible monitoring and regulation of clinical software systems. J Am Med Inform Assoc. 1997;4(6):442–57.PubMedCrossRef
49.
go back to reference Singh H, Classen DC, Sittig DF. Creating an oversight infrastructure for electronic health record-related patient safety hazards. J Patient Saf. 2011;7(4):169–74. Singh H, Classen DC, Sittig DF. Creating an oversight infrastructure for electronic health record-related patient safety hazards. J Patient Saf. 2011;7(4):169–74.
50.
go back to reference Mehta RH, Peterson ED, Califf RM (2007) Performance measures have a major effect on cardiovascular outcomes: a review. Am J Med. 2007;120(5):398–402.e6. Mehta RH, Peterson ED, Califf RM (2007) Performance measures have a major effect on cardiovascular outcomes: a review. Am J Med. 2007;120(5):398–402.e6.
51.
go back to reference Schneeweiss S, Patrick AR, Maclure M, Dormuth CR, Glynn RJ. Adherence to b-blocker therapy under drug cost-sharing in patients with and without acute myocardial infarction. Am J Manag Care. 2007;13(8):445–52. Schneeweiss S, Patrick AR, Maclure M, Dormuth CR, Glynn RJ. Adherence to b-blocker therapy under drug cost-sharing in patients with and without acute myocardial infarction. Am J Manag Care. 2007;13(8):445–52.
52.
go back to reference Hepner KA, Rowe M, Rost K, Hickey SC, Sherbourne CD, Ford DE, et al. The effect of adherence to practice guidelines on depression outcomes. Ann Intern Med. 2007;147(5):320–9. Hepner KA, Rowe M, Rost K, Hickey SC, Sherbourne CD, Ford DE, et al. The effect of adherence to practice guidelines on depression outcomes. Ann Intern Med. 2007;147(5):320–9.
53.
go back to reference Brunkhorst F, Engel C, Ragaller M, Welte T, Rossaint R, Gerlach H, et al. Practice and perception—a nationwide survey of therapy habits in sepsis. Crit Care Med. 2008;36(10):1–6.CrossRef Brunkhorst F, Engel C, Ragaller M, Welte T, Rossaint R, Gerlach H, et al. Practice and perception—a nationwide survey of therapy habits in sepsis. Crit Care Med. 2008;36(10):1–6.CrossRef
54.
go back to reference Hersh AL, Shapiro DJ, Pavia AT, Shah SS. Antibiotic prescribing in ambulatory pediatrics in the United States. Pediatrics. 2011;128(6):1053–61.PubMedCrossRef Hersh AL, Shapiro DJ, Pavia AT, Shah SS. Antibiotic prescribing in ambulatory pediatrics in the United States. Pediatrics. 2011;128(6):1053–61.PubMedCrossRef
Metadata
Title
The evolution of eProtocols that enable reproducible clinical research and care methods
Authors
Denitza P. Blagev
Eliotte L. Hirshberg
Katherine Sward
B. Taylor Thompson
Roy Brower
Jonathon Truwit
Duncan Hite
Jay Steingrub
James F. Orme Jr.
Terry P. Clemmer
Lindell K. Weaver
Frank Thomas
Colin K. Grissom
Dean Sorenson
Dean F. Sittig
C. Jane Wallace
Thomas D. East
Homer R. Warner
Alan H. Morris
Publication date
01-08-2012
Publisher
Springer Netherlands
Published in
Journal of Clinical Monitoring and Computing / Issue 4/2012
Print ISSN: 1387-1307
Electronic ISSN: 1573-2614
DOI
https://doi.org/10.1007/s10877-012-9356-y

Other articles of this Issue 4/2012

Journal of Clinical Monitoring and Computing 4/2012 Go to the issue