Skip to main content
Top
Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2013

Open Access 01-12-2013 | Review

Evaluation of emergency department performance – a systematic review on recommended performance and quality-in-care measures

Authors: Christian Michel Sørup, Peter Jacobsen, Jakob Lundager Forberg

Published in: Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine | Issue 1/2013

Login to get access

Abstract

Background

Evaluation of emergency department (ED) performance remains a difficult task due to the lack of consensus on performance measures that reflects high quality, efficiency, and sustainability.

Aim

To describe, map, and critically evaluate which performance measures that the published literature regard as being most relevant in assessing overall ED performance.

Methods

Following the PRISMA guidelines, a systematic literature review of review articles reporting accentuated ED performance measures was conducted in the databases of PubMed, Cochrane Library, and Web of Science. Study eligibility criteria includes: 1) the main purpose was to discuss, analyse, or promote performance measures best reflecting ED performance, 2) the article was a review article, and 3) the article reported macro-level performance measures, thus reflecting an overall departmental performance level.

Results

A number of articles addresses this study’s objective (n = 14 of 46 unique hits). Time intervals and patient-related measures were dominant in the identified performance measures in review articles from US, UK, Sweden and Canada. Length of stay (LOS), time between patient arrival to initial clinical assessment, and time between patient arrivals to admission were highlighted by the majority of articles. Concurrently, “patients left without being seen” (LWBS), unplanned re-attendance within a maximum of 72 hours, mortality/morbidity, and number of unintended incidents were the most highlighted performance measures that related directly to the patient. Performance measures related to employees were only stated in two of the 14 included articles.

Conclusions

A total of 55 ED performance measures were identified. ED time intervals were the most recommended performance measures followed by patient centeredness and safety performance measures. ED employee related performance measures were rarely mentioned in the investigated literature. The study’s results allow for advancement towards improved performance measurement and standardised assessment across EDs.
Appendix
Available only for authorised users
Literature
3.
go back to reference Solberg LI, Asplin BR, Weinick RM, Magid DJ: Emergency department crowding: consensus development of potential measures. Ann Emerg Med. 2003, 42 (6): 824-834. 10.1016/S0196-0644(03)00816-3.CrossRefPubMed Solberg LI, Asplin BR, Weinick RM, Magid DJ: Emergency department crowding: consensus development of potential measures. Ann Emerg Med. 2003, 42 (6): 824-834. 10.1016/S0196-0644(03)00816-3.CrossRefPubMed
4.
go back to reference Walley P, Silvester K, Mountford S: Health-care process improvement decisions: a systems perspective. Int J Health Care Qual Assur. 2006, 19 (1): 93-104. 10.1108/09526860610642618.CrossRef Walley P, Silvester K, Mountford S: Health-care process improvement decisions: a systems perspective. Int J Health Care Qual Assur. 2006, 19 (1): 93-104. 10.1108/09526860610642618.CrossRef
5.
go back to reference Shetty A, Gunja N, Byth K, Vukasovic M: Senior streaming assessment further evaluation after Triage zone: a novel model of care encompassing various emergency department throughput measures. Emerg Med Australas. 2012, 24 (4): 374-382. 10.1111/j.1742-6723.2012.01550.x.CrossRefPubMed Shetty A, Gunja N, Byth K, Vukasovic M: Senior streaming assessment further evaluation after Triage zone: a novel model of care encompassing various emergency department throughput measures. Emerg Med Australas. 2012, 24 (4): 374-382. 10.1111/j.1742-6723.2012.01550.x.CrossRefPubMed
6.
go back to reference Hallas P, Ekelund U, Bjornsen LP, Brabrand M: Hoping for a domino effect: a new specialty in Sweden is a breath of fresh air for the development of Scandinavian emergency medicine. SJTREM. 2013, 21 (1): 26-PubMedCentralPubMed Hallas P, Ekelund U, Bjornsen LP, Brabrand M: Hoping for a domino effect: a new specialty in Sweden is a breath of fresh air for the development of Scandinavian emergency medicine. SJTREM. 2013, 21 (1): 26-PubMedCentralPubMed
7.
go back to reference Göransson KE, Ehrenberg A, Ehnfors M: Triage in emergency departments: national survey. J Clin Nurs. 2005, 14 (9): 1067-1074. 10.1111/j.1365-2702.2005.01191.x.CrossRefPubMed Göransson KE, Ehrenberg A, Ehnfors M: Triage in emergency departments: national survey. J Clin Nurs. 2005, 14 (9): 1067-1074. 10.1111/j.1365-2702.2005.01191.x.CrossRefPubMed
8.
go back to reference Graff L, Stevens C, Spaite D, Foody J: Measuring and improving quality in emergency medicine. Acad Emerg Med. 2002, 9 (11): 1091-1107. 10.1111/j.1553-2712.2002.tb01563.x.CrossRefPubMed Graff L, Stevens C, Spaite D, Foody J: Measuring and improving quality in emergency medicine. Acad Emerg Med. 2002, 9 (11): 1091-1107. 10.1111/j.1553-2712.2002.tb01563.x.CrossRefPubMed
9.
go back to reference Neely A, Gregory M, Platts K: Performance measurement system design: a literature review and research agenda. IJOPM. 2005, 25 (12): 1228-1263. Neely A, Gregory M, Platts K: Performance measurement system design: a literature review and research agenda. IJOPM. 2005, 25 (12): 1228-1263.
10.
go back to reference Kaplan RS, Norton DP: The balanced scorecard: measures that drive performance. Harv Bus Rev (USA). 2005, 83 (7): 172-180. Kaplan RS, Norton DP: The balanced scorecard: measures that drive performance. Harv Bus Rev (USA). 2005, 83 (7): 172-180.
11.
go back to reference Nicolay CR, Purkayastha S, Greenhalgh A, Benn J, Chaturvedi S, Phillips N, Darzi A: Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare. Br J Surg. 2012, 99 (3): 324-335. 10.1002/bjs.7803.CrossRefPubMed Nicolay CR, Purkayastha S, Greenhalgh A, Benn J, Chaturvedi S, Phillips N, Darzi A: Systematic review of the application of quality improvement methodologies from the manufacturing industry to surgical healthcare. Br J Surg. 2012, 99 (3): 324-335. 10.1002/bjs.7803.CrossRefPubMed
12.
go back to reference Neely A, Bourne M: Why measurement initatives fail. MBE. 2000, 4 (4): 3-7. Neely A, Bourne M: Why measurement initatives fail. MBE. 2000, 4 (4): 3-7.
13.
go back to reference Huang S, Chen P, Yang M, Chang W, Lee H: Using a balanced scorecard to improve the performance of an emergency department. Nurs Econ. 2004, 22 (3): 140-146.PubMed Huang S, Chen P, Yang M, Chang W, Lee H: Using a balanced scorecard to improve the performance of an emergency department. Nurs Econ. 2004, 22 (3): 140-146.PubMed
14.
go back to reference Samani DZ, Kohan MZ: Framework for implementing balanced scorecard in hospitals. JIBED. 2011, 5 (4): 362-368. 10.1504/JIBED.2011.042390.CrossRef Samani DZ, Kohan MZ: Framework for implementing balanced scorecard in hospitals. JIBED. 2011, 5 (4): 362-368. 10.1504/JIBED.2011.042390.CrossRef
15.
go back to reference Alessandrini EA, Knapp J: Measuring quality in pediatric emergency care. Clin Ped Emerg Med. 2011, 12 (2): 102-112. 10.1016/j.cpem.2011.05.002.CrossRef Alessandrini EA, Knapp J: Measuring quality in pediatric emergency care. Clin Ped Emerg Med. 2011, 12 (2): 102-112. 10.1016/j.cpem.2011.05.002.CrossRef
16.
go back to reference Coleman P, Nicholl J: Consensus methods to identify a set of potential performance indicators for systems of emergency and urgent care. J Health Serv Res Policy. 2010, 15: 12-18. 10.1258/jhsrp.2009.009096.CrossRefPubMed Coleman P, Nicholl J: Consensus methods to identify a set of potential performance indicators for systems of emergency and urgent care. J Health Serv Res Policy. 2010, 15: 12-18. 10.1258/jhsrp.2009.009096.CrossRefPubMed
17.
go back to reference Kelman S, Friedman JN: Performance improvement and performance dysfunction: an empirical examination of distortionary impacts of the emergency room wait-time target in the English National Health Service. JPART. 2009, 19 (4): 917-946.CrossRef Kelman S, Friedman JN: Performance improvement and performance dysfunction: an empirical examination of distortionary impacts of the emergency room wait-time target in the English National Health Service. JPART. 2009, 19 (4): 917-946.CrossRef
19.
go back to reference Cameron PA, Schull MJ, Cooke MW: A framework for measuring quality in the emergency department. Emerg Med J. 2011, 28 (9): 735-740. 10.1136/emj.2011.112250.CrossRefPubMed Cameron PA, Schull MJ, Cooke MW: A framework for measuring quality in the emergency department. Emerg Med J. 2011, 28 (9): 735-740. 10.1136/emj.2011.112250.CrossRefPubMed
20.
go back to reference Lindsay P, Schull M, Bronskill S, Anderson G: The development of indicators to measure the quality of clinical care in emergency departments following a modified-Delphi approach. Acad Emerg Med. 2002, 9 (11): 1131-1139. 10.1111/j.1553-2712.2002.tb01567.x.CrossRefPubMed Lindsay P, Schull M, Bronskill S, Anderson G: The development of indicators to measure the quality of clinical care in emergency departments following a modified-Delphi approach. Acad Emerg Med. 2002, 9 (11): 1131-1139. 10.1111/j.1553-2712.2002.tb01567.x.CrossRefPubMed
21.
go back to reference Schull MJ, Guttmann A, Leaver CA, Vermeulen M, Hatcher CM, Rowe BH, Zwarenstein M, Anderson GM: Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. CJEM. 2011, 13 (5): 300-309.PubMed Schull MJ, Guttmann A, Leaver CA, Vermeulen M, Hatcher CM, Rowe BH, Zwarenstein M, Anderson GM: Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. CJEM. 2011, 13 (5): 300-309.PubMed
22.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010, 8 (5): 336-341. 10.1016/j.ijsu.2010.02.007.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg. 2010, 8 (5): 336-341. 10.1016/j.ijsu.2010.02.007.CrossRefPubMed
23.
go back to reference Traberg A: PhD Thesis. Management-By-Objectives in Healthcare. 2011, Technical University of Denmark: DTU Management Engineering Traberg A: PhD Thesis. Management-By-Objectives in Healthcare. 2011, Technical University of Denmark: DTU Management Engineering
24.
go back to reference Persell SD, Kaiser D, Dolan NC, Andrews B, Levi S, Khandekar J, Gavagan T, Thompson JA, Friesema EM, Baker DW: Changes in performance after implementation of a multifaceted electronic-health-record-based quality improvement system. Med Care. 2011, 49 (2): 117-125. 10.1097/MLR.0b013e318202913d.CrossRefPubMed Persell SD, Kaiser D, Dolan NC, Andrews B, Levi S, Khandekar J, Gavagan T, Thompson JA, Friesema EM, Baker DW: Changes in performance after implementation of a multifaceted electronic-health-record-based quality improvement system. Med Care. 2011, 49 (2): 117-125. 10.1097/MLR.0b013e318202913d.CrossRefPubMed
25.
go back to reference Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE: A systematic review of quality indicators for evaluating pediatric trauma care. Crit Care Med. 2010, 38 (4): 1187-1196. 10.1097/CCM.0b013e3181d455fe.CrossRefPubMed Stelfox HT, Bobranska-Artiuch B, Nathens A, Straus SE: A systematic review of quality indicators for evaluating pediatric trauma care. Crit Care Med. 2010, 38 (4): 1187-1196. 10.1097/CCM.0b013e3181d455fe.CrossRefPubMed
26.
go back to reference Stelfox HT, Straus SE, Nathens A, Bobranska-Artiuch B: Evidence for quality indicators to evaluate adult trauma care: a systematic review. Crit Care Med. 2011, 39 (4): 846-859. 10.1097/CCM.0b013e31820a859a.CrossRefPubMed Stelfox HT, Straus SE, Nathens A, Bobranska-Artiuch B: Evidence for quality indicators to evaluate adult trauma care: a systematic review. Crit Care Med. 2011, 39 (4): 846-859. 10.1097/CCM.0b013e31820a859a.CrossRefPubMed
27.
go back to reference Pines JM, Fermann GJ, Ferroggiaro AA, Irvin CB, Mazer M, Frank Peacock W, Schuur JD, Weber EJ, Pollack CV: The role of the society for academic emergency medicine in the development of guidelines and performance measures. Acad Emerg Med. 2010, 17 (11): e130-e140. 10.1111/j.1553-2712.2010.00914.x.CrossRefPubMed Pines JM, Fermann GJ, Ferroggiaro AA, Irvin CB, Mazer M, Frank Peacock W, Schuur JD, Weber EJ, Pollack CV: The role of the society for academic emergency medicine in the development of guidelines and performance measures. Acad Emerg Med. 2010, 17 (11): e130-e140. 10.1111/j.1553-2712.2010.00914.x.CrossRefPubMed
28.
go back to reference Baker DW, Qaseem A: Evidence-based performance measures: preventing unintended consequences of quality measurement. Ann Intern Med. 2011, 155 (9): 638-640. 10.7326/0003-4819-155-9-201111010-00015.CrossRefPubMed Baker DW, Qaseem A: Evidence-based performance measures: preventing unintended consequences of quality measurement. Ann Intern Med. 2011, 155 (9): 638-640. 10.7326/0003-4819-155-9-201111010-00015.CrossRefPubMed
29.
go back to reference Beniuk K, Boyle AA, Clarkson PJ: Emergency department crowding: prioritising quantified crowding measures using a Delphi study. Emerg Med J. 2012, 29 (11): 868-871. 10.1136/emermed-2011-200646.CrossRefPubMed Beniuk K, Boyle AA, Clarkson PJ: Emergency department crowding: prioritising quantified crowding measures using a Delphi study. Emerg Med J. 2012, 29 (11): 868-871. 10.1136/emermed-2011-200646.CrossRefPubMed
30.
go back to reference Hung GR, Chalut D: A consensus-established set of important indicators of pediatric emergency department performance. Pediatr Emerg Care. 2008, 24 (1): 9-15.PubMed Hung GR, Chalut D: A consensus-established set of important indicators of pediatric emergency department performance. Pediatr Emerg Care. 2008, 24 (1): 9-15.PubMed
31.
go back to reference Guttmann A, Razzaq A, Lindsay P, Zagorski B, Anderson G: Development of measures of the quality of emergency department care for children using a structured panel process. Pediatrics. 2006, 118 (1): 114-123. 10.1542/peds.2005-3029.CrossRefPubMed Guttmann A, Razzaq A, Lindsay P, Zagorski B, Anderson G: Development of measures of the quality of emergency department care for children using a structured panel process. Pediatrics. 2006, 118 (1): 114-123. 10.1542/peds.2005-3029.CrossRefPubMed
32.
go back to reference Welch SJ, Asplin BR, Stone-Griffith S, Davidson SJ, Augustine J, Schuur J: Emergency department operational metrics, measures and definitions: results of the second performance measures and benchmarking summit. Ann Emerg Med. 2011, 58 (1): 33-40. 10.1016/j.annemergmed.2010.08.040.CrossRefPubMed Welch SJ, Asplin BR, Stone-Griffith S, Davidson SJ, Augustine J, Schuur J: Emergency department operational metrics, measures and definitions: results of the second performance measures and benchmarking summit. Ann Emerg Med. 2011, 58 (1): 33-40. 10.1016/j.annemergmed.2010.08.040.CrossRefPubMed
33.
go back to reference McClelland MS, Jones K, Siegel B, Pines JM: A field test of time-based emergency department quality measures. Ann Emerg Med. 2012, 59 (1): 1-10. 10.1016/j.annemergmed.2011.06.013. e2CrossRefPubMed McClelland MS, Jones K, Siegel B, Pines JM: A field test of time-based emergency department quality measures. Ann Emerg Med. 2012, 59 (1): 1-10. 10.1016/j.annemergmed.2011.06.013. e2CrossRefPubMed
34.
go back to reference Ekelund U, Kurland L, Eklund F, Torkki P, Letterstål A, Lindmarker P, Castrén M: Patient throughput times and inflow patterns in Swedish emergency departments. A basis for ANSWER, A National SWedish emergency registry. SJTREM. 2011, 19 (1): 19-37. Ekelund U, Kurland L, Eklund F, Torkki P, Letterstål A, Lindmarker P, Castrén M: Patient throughput times and inflow patterns in Swedish emergency departments. A basis for ANSWER, A National SWedish emergency registry. SJTREM. 2011, 19 (1): 19-37.
35.
go back to reference Heyworth J: Emergency medicine - quality indicators: the United Kingdom perspective. Acad Emerg Med. 2011, 18 (12): 1239-1241. 10.1111/j.1553-2712.2011.01223.x.CrossRefPubMed Heyworth J: Emergency medicine - quality indicators: the United Kingdom perspective. Acad Emerg Med. 2011, 18 (12): 1239-1241. 10.1111/j.1553-2712.2011.01223.x.CrossRefPubMed
36.
go back to reference Sibbritt D, Isbister GK, Walker R: Emergency department performance indicators that encompass the patient journey. Qual Manag Health Care. 2006, 15 (1): 27-38.CrossRefPubMed Sibbritt D, Isbister GK, Walker R: Emergency department performance indicators that encompass the patient journey. Qual Manag Health Care. 2006, 15 (1): 27-38.CrossRefPubMed
37.
go back to reference Boudreaux ED, O’Hea EL: Patient satisfaction in the emergency department: a review of the literature and implications for practice. J Emerg Med. 2004, 26 (1): 13-26. 10.1016/j.jemermed.2003.04.003.CrossRefPubMed Boudreaux ED, O’Hea EL: Patient satisfaction in the emergency department: a review of the literature and implications for practice. J Emerg Med. 2004, 26 (1): 13-26. 10.1016/j.jemermed.2003.04.003.CrossRefPubMed
38.
go back to reference Muntlin Å, Gunningberg L, Carlsson M: Patients’ perceptions of quality of care at an emergency department and identification of areas for quality improvement. J Clin Nurs. 2006, 15 (8): 1045-1056. 10.1111/j.1365-2702.2006.01368.x.CrossRefPubMed Muntlin Å, Gunningberg L, Carlsson M: Patients’ perceptions of quality of care at an emergency department and identification of areas for quality improvement. J Clin Nurs. 2006, 15 (8): 1045-1056. 10.1111/j.1365-2702.2006.01368.x.CrossRefPubMed
39.
go back to reference Göransson KE, von Rosen A: Patient experience of the triage encounter in a Swedish emergency department. Int Emerg Nurs. 2010, 18 (1): 36-40. 10.1016/j.ienj.2009.10.001.CrossRefPubMed Göransson KE, von Rosen A: Patient experience of the triage encounter in a Swedish emergency department. Int Emerg Nurs. 2010, 18 (1): 36-40. 10.1016/j.ienj.2009.10.001.CrossRefPubMed
40.
go back to reference Crouch R, Cooke M: Making care count: introducing the emergency department quality indicators. Int Emerg Nurs. 2011, 19 (2): 67-68.CrossRefPubMed Crouch R, Cooke M: Making care count: introducing the emergency department quality indicators. Int Emerg Nurs. 2011, 19 (2): 67-68.CrossRefPubMed
41.
go back to reference Lin BYJ, Wan TTH, Hsu CC, Hung F, Juan C, Lin C: Relationships of hospital-based emergency department culture to work satisfaction and intent to leave of emergency physicians and nurses. Health Serv Manage Res. 2012, 25 (2): 68-77. 10.1258/hsmr.2012.012011.CrossRefPubMed Lin BYJ, Wan TTH, Hsu CC, Hung F, Juan C, Lin C: Relationships of hospital-based emergency department culture to work satisfaction and intent to leave of emergency physicians and nurses. Health Serv Manage Res. 2012, 25 (2): 68-77. 10.1258/hsmr.2012.012011.CrossRefPubMed
42.
go back to reference Benneyan JC, Lloyd RC, Plsek PE: Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003, 12 (6): 458-464. 10.1136/qhc.12.6.458.PubMedCentralCrossRefPubMed Benneyan JC, Lloyd RC, Plsek PE: Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003, 12 (6): 458-464. 10.1136/qhc.12.6.458.PubMedCentralCrossRefPubMed
43.
go back to reference Gordon BD, Flottemesch TJ, Asplin BR: Accuracy of staff-initiated emergency department tracking system timestamps in identifying actual event times. Ann Emerg Med. 2008, 52 (5): 504-511. 10.1016/j.annemergmed.2007.11.036.PubMedCentralCrossRefPubMed Gordon BD, Flottemesch TJ, Asplin BR: Accuracy of staff-initiated emergency department tracking system timestamps in identifying actual event times. Ann Emerg Med. 2008, 52 (5): 504-511. 10.1016/j.annemergmed.2007.11.036.PubMedCentralCrossRefPubMed
44.
go back to reference Jones P, Schimanski K: The four hour target to reduce emergency department ‘waiting time’: a systematic review of clinical outcomes. Emerg Med Australas. 2010, 22 (5): 391-398. 10.1111/j.1742-6723.2010.01330.x.CrossRefPubMed Jones P, Schimanski K: The four hour target to reduce emergency department ‘waiting time’: a systematic review of clinical outcomes. Emerg Med Australas. 2010, 22 (5): 391-398. 10.1111/j.1742-6723.2010.01330.x.CrossRefPubMed
Metadata
Title
Evaluation of emergency department performance – a systematic review on recommended performance and quality-in-care measures
Authors
Christian Michel Sørup
Peter Jacobsen
Jakob Lundager Forberg
Publication date
01-12-2013
Publisher
BioMed Central
DOI
https://doi.org/10.1186/1757-7241-21-62

Other articles of this Issue 1/2013

Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 1/2013 Go to the issue