Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

New Zealand’s emergency department target – did it reduce ED length of stay, and if so, how and when?

Authors: Tim Tenbensel, Linda Chalmers, Peter Jones, Sarah Appleton-Dyer, Lisa Walton, Shanthi Ameratunga

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

In 2009, the New Zealand government introduced a hospital emergency department (ED) target – 95% of patients seen, treated or discharged within 6 h - in order to alleviate crowding in public hospital EDs. While these targets were largely met by 2012, research suggests that such targets can be met without corresponding overall reductions in ED length-of-stay (LOS). Our research explores whether the NZ ED time target actually reduced ED LOS, and if so, how and when.

Methods

We adopted a mixed-methods approach with integration of data sources. After selecting four hospitals as case study sites, we collected all ED utilisation data for the period 2006 to 2012. ED LOS data was derived in two forms-reported ED LOS, and total ED LOS - which included time spent in short-stay units. This data was used to identify changes in the length of ED stay, and describe the timing of these changes to these indicators. Sixty-eight semi-structured interviews and two surveys of hospital clinicians and managers were conducted between 2011 and 2013. This data was then explored to identify factors that could account for ED LOS changes and their timing.

Results

Reported ED LOS reduced in all sites after the introduction of the target, and continued to reduce in 2011 and 2012. However, total ED LOS only decreased from 2008 to 2010, and did not reduce further in any hospital. Increased use of short-stay units largely accounted for these differences. Interview and survey data showed changes to improve patient flow were introduced in the early implementation period, whereas increased ED resources, better information systems to monitor target performance, and leadership and social marketing strategies mainly took throughout 2011 and 2012 when total ED LOS was not reducing.

Conclusions

While the ED target clearly stimulated improvements in patient flow, our analysis also questions the value of ED targets as a long term approach. Increased use of short-stay units suggests that the target became less effective in ‘standing for’ improved timeliness of hospital care in response to increasing acute demand. As such, the overall challenges in managing demand for acute and urgent care in New Zealand hospitals remain.
Appendix
Available only for authorised users
Literature
1.
go back to reference Elder E, Johnston ANB, Crilly J. Review article: systematic review of three key strategies designed to improve patient flow through the emergency department. Emergency Medicine Australasia. 2015;27(5):394–404.CrossRefPubMed Elder E, Johnston ANB, Crilly J. Review article: systematic review of three key strategies designed to improve patient flow through the emergency department. Emergency Medicine Australasia. 2015;27(5):394–404.CrossRefPubMed
2.
go back to reference Mason S, Weber EJ, Coster J, Freeman J, Locker T. Time patients spend in the emergency department: England's 4-hour rule - a case of hitting the target but missing the point? Ann Emerg Med. 2012;59(5):341–9.CrossRefPubMed Mason S, Weber EJ, Coster J, Freeman J, Locker T. Time patients spend in the emergency department: England's 4-hour rule - a case of hitting the target but missing the point? Ann Emerg Med. 2012;59(5):341–9.CrossRefPubMed
3.
go back to reference Richardson DB, Mountain D. Myths versus facts in emergency department overcrowding and hospital access block. Med J Aust. 2009;190(7):369–74.PubMed Richardson DB, Mountain D. Myths versus facts in emergency department overcrowding and hospital access block. Med J Aust. 2009;190(7):369–74.PubMed
4.
go back to reference Liew D, Liew D, Kennedy MP. Emergency department length of stay independently predicts excess inpatient length of stay. Med J Aust. 2003;179(10):524–6.PubMed Liew D, Liew D, Kennedy MP. Emergency department length of stay independently predicts excess inpatient length of stay. Med J Aust. 2003;179(10):524–6.PubMed
5.
go back to reference Pines J, Hollander J, Localio R, Metlay J. The association between emergency department crowding and hospital performance on antibiotic timing for pneumonia and percutaneous intervention for myocardial infarction. Acad Emerg Med. 2006;13(8):873.CrossRefPubMed Pines J, Hollander J, Localio R, Metlay J. The association between emergency department crowding and hospital performance on antibiotic timing for pneumonia and percutaneous intervention for myocardial infarction. Acad Emerg Med. 2006;13(8):873.CrossRefPubMed
6.
go back to reference Pines JM, Hollander JE. Emergency department crowding is associated with poor Care for Patients with Severe Pain. Ann Emerg Med. 2008;51(1):1–5.CrossRefPubMed Pines JM, Hollander JE. Emergency department crowding is associated with poor Care for Patients with Severe Pain. Ann Emerg Med. 2008;51(1):1–5.CrossRefPubMed
7.
go back to reference Sprivulis PC, Silva J-AD, I.G. Jacobs A, RL F, GA J. The association between hospital overcrowding and mortality among patients admitted via Western Australian emergency departments. Medical Journal of Australia. 2006;184(5):208.PubMed Sprivulis PC, Silva J-AD, I.G. Jacobs A, RL F, GA J. The association between hospital overcrowding and mortality among patients admitted via Western Australian emergency departments. Medical Journal of Australia. 2006;184(5):208.PubMed
8.
go back to reference Working Group for Achieving Quality in Emergency Departments. Recommendations to improve quality and the measurement of quality in New Zealand emergency departments. Wellington: Ministry of Health; 2008. Working Group for Achieving Quality in Emergency Departments. Recommendations to improve quality and the measurement of quality in New Zealand emergency departments. Wellington: Ministry of Health; 2008.
9.
go back to reference Cumming J, McDonald J, Barr C, Martin G, Gerring Z, Daubé J. New Zealand Health System Review. 2014. Contract No.: 2. Cumming J, McDonald J, Barr C, Martin G, Gerring Z, Daubé J. New Zealand Health System Review. 2014. Contract No.: 2.
10.
go back to reference Ardagh M. How to achieve New Zealand’s shorter stays in emergency departments health target. N Z Med J. 2010;123(1316):95–103.PubMed Ardagh M. How to achieve New Zealand’s shorter stays in emergency departments health target. N Z Med J. 2010;123(1316):95–103.PubMed
11.
go back to reference Bevan G, Hood C. What's measured is what matters: targets and gaming in the English public health care system. Public Admin. 2006;84(3):517–38.CrossRef Bevan G, Hood C. What's measured is what matters: targets and gaming in the English public health care system. Public Admin. 2006;84(3):517–38.CrossRef
12.
go back to reference Boyle A, Mason S. What has the 4-hour access standard achieved? Br J Hosp Med. 2014;75(11):620–2.CrossRef Boyle A, Mason S. What has the 4-hour access standard achieved? Br J Hosp Med. 2014;75(11):620–2.CrossRef
13.
go back to reference Kelman S, Friedman JN. Performance improvement and performance dysfunction: an empirical examination of distortionary impacts of the emergency room wait-time target in the English National Health Service. J Publ Adm Res Theor. 2009;19(4):917–46.CrossRef Kelman S, Friedman JN. Performance improvement and performance dysfunction: an empirical examination of distortionary impacts of the emergency room wait-time target in the English National Health Service. J Publ Adm Res Theor. 2009;19(4):917–46.CrossRef
14.
go back to reference Tenbensel T, Chalmers L, Willing E. Comparing the implementation consequences of the immunisation and emergency department health targets in New Zealand: a tale of two targets. Journal of Health Organization and Management. 2016;30(6):1009–24.CrossRefPubMed Tenbensel T, Chalmers L, Willing E. Comparing the implementation consequences of the immunisation and emergency department health targets in New Zealand: a tale of two targets. Journal of Health Organization and Management. 2016;30(6):1009–24.CrossRefPubMed
15.
go back to reference Locker T, Mason S, Wardrope J, Walters S. Targets and moving goal posts: changes in waiting times in a UK emergency department. Emerg Med J. 2005;22(10):710–4.CrossRefPubMedPubMedCentral Locker T, Mason S, Wardrope J, Walters S. Targets and moving goal posts: changes in waiting times in a UK emergency department. Emerg Med J. 2005;22(10):710–4.CrossRefPubMedPubMedCentral
16.
go back to reference Jones P, Chalmers L, Wells S, Ameratunga S, Carswell P, Ashton T, et al. Implementing performance improvement in New Zealand emergency departments: the six hour time target policy national research project protocol. BMC Health Serv Res. 2012;12(1):45.CrossRefPubMedPubMedCentral Jones P, Chalmers L, Wells S, Ameratunga S, Carswell P, Ashton T, et al. Implementing performance improvement in New Zealand emergency departments: the six hour time target policy national research project protocol. BMC Health Serv Res. 2012;12(1):45.CrossRefPubMedPubMedCentral
17.
go back to reference Jones P, Harper A, Wells S, Curtis E, Carswell P, Reid P, et al. Selection and validation of quality indicators for the shorter stays in emergency departments National Research Project. Emergency Medicine Australasia. 2012;24(3):303–12.CrossRefPubMed Jones P, Harper A, Wells S, Curtis E, Carswell P, Reid P, et al. Selection and validation of quality indicators for the shorter stays in emergency departments National Research Project. Emergency Medicine Australasia. 2012;24(3):303–12.CrossRefPubMed
18.
go back to reference Harper A, Jones P, Wimsett J, Stewart J, Le Fevre J, Wells S, et al. The effect of the shorter stays in emergency departments health target on the quality of ED discharge summaries. Emerg Med J. 2016;11:11. Harper A, Jones P, Wimsett J, Stewart J, Le Fevre J, Wells S, et al. The effect of the shorter stays in emergency departments health target on the quality of ED discharge summaries. Emerg Med J. 2016;11:11.
19.
go back to reference Jones P, Wells S, Harper A, LeFevre J, Stewart J, Curtis E, et al. Is a national time target for emergency department stay associated with changes in the quality of care for acute asthma? A multicentre pre-intervention post-intervention study. Emergency Medicine Australasia. 2016;28(1):48–55.CrossRefPubMed Jones P, Wells S, Harper A, LeFevre J, Stewart J, Curtis E, et al. Is a national time target for emergency department stay associated with changes in the quality of care for acute asthma? A multicentre pre-intervention post-intervention study. Emergency Medicine Australasia. 2016;28(1):48–55.CrossRefPubMed
20.
go back to reference Chalmers L. Inside the Black Box of Emergency Department Time Target Implementation in New Zealand (PhD thesis). Auckland: University of Auckland; 2014. Chalmers L. Inside the Black Box of Emergency Department Time Target Implementation in New Zealand (PhD thesis). Auckland: University of Auckland; 2014.
21.
go back to reference Jones P, Sopina E, Ashton T. Resource implications of a national health target: the New Zealand experience of a shorter stays in emergency departments target. Emerg Med Australas. 2014;26(6):579–84.CrossRefPubMed Jones P, Sopina E, Ashton T. Resource implications of a national health target: the New Zealand experience of a shorter stays in emergency departments target. Emerg Med Australas. 2014;26(6):579–84.CrossRefPubMed
22.
go back to reference Lowthian J, Curtis A, Stoelwinder J, McNeil J, Cameron P. Emergency demand and repeat attendances by older patients. Intern Med J. 2013;43(5):554–60.CrossRefPubMed Lowthian J, Curtis A, Stoelwinder J, McNeil J, Cameron P. Emergency demand and repeat attendances by older patients. Intern Med J. 2013;43(5):554–60.CrossRefPubMed
23.
go back to reference Boyle A, Beniuk K, Higginson I, Atkinson P. Emergency department crowding: time for interventions and policy evaluations. Emergency Medicine International. 2012:1–8. Boyle A, Beniuk K, Higginson I, Atkinson P. Emergency department crowding: time for interventions and policy evaluations. Emergency Medicine International. 2012:1–8.
24.
go back to reference Morris ZS, Boyle A, Beniuk K, Robinson S. Emergency department crowding: towards an agenda for evidence-based intervention. Emerg Med J. 2012;29(6):460–6.CrossRefPubMed Morris ZS, Boyle A, Beniuk K, Robinson S. Emergency department crowding: towards an agenda for evidence-based intervention. Emerg Med J. 2012;29(6):460–6.CrossRefPubMed
25.
go back to reference Lowthian J, Curtis A, Straney L, McKimm A, Keogh M, Stripp A. Redesigning emergency patient flow with timely quality care at the Alfred. EMA - Emergency Medicine Australasia. 2015;27(1):35–41.CrossRefPubMed Lowthian J, Curtis A, Straney L, McKimm A, Keogh M, Stripp A. Redesigning emergency patient flow with timely quality care at the Alfred. EMA - Emergency Medicine Australasia. 2015;27(1):35–41.CrossRefPubMed
26.
go back to reference Scott T, Mannion R, Davies HTO, Marshall MN. Implementing culture change in health care: theory and practice. Int J Qual Health Care. 2003;15(2):111–8.CrossRefPubMed Scott T, Mannion R, Davies HTO, Marshall MN. Implementing culture change in health care: theory and practice. Int J Qual Health Care. 2003;15(2):111–8.CrossRefPubMed
27.
go back to reference Freeman JV, Croft S, Cross S, Yap C, Mason S. The impact of the 4 h target on patient care and outcomes in the emergency department: an analysis of hospital incidence data. Emerg Med J. 2010;27(12):921–7.CrossRefPubMed Freeman JV, Croft S, Cross S, Yap C, Mason S. The impact of the 4 h target on patient care and outcomes in the emergency department: an analysis of hospital incidence data. Emerg Med J. 2010;27(12):921–7.CrossRefPubMed
28.
go back to reference Mason S, Nicholl J, Locker T. Four hour emergency target. Targets still lead care in emergency departments. BMJ (Clinical research ed). 2010;341. Mason S, Nicholl J, Locker T. Four hour emergency target. Targets still lead care in emergency departments. BMJ (Clinical research ed). 2010;341.
29.
go back to reference Jones P, Schimanski K. The four hour target to reduce emergency department ‘waiting time’: a systematic review of clinical outcomes. Emergency Medicine Australasia. 2010;22:391–8.CrossRefPubMed Jones P, Schimanski K. The four hour target to reduce emergency department ‘waiting time’: a systematic review of clinical outcomes. Emergency Medicine Australasia. 2010;22:391–8.CrossRefPubMed
31.
go back to reference Perera ML, Davies AW, Gnaneswaran N, Giles M, Liew D, Ritchie P, et al. Clearing emergency departments and clogging wards: National Emergency Access Target and the law of unintended consequences. EMA - Emergency Medicine Australasia. 2014;26(6):549–55.CrossRefPubMed Perera ML, Davies AW, Gnaneswaran N, Giles M, Liew D, Ritchie P, et al. Clearing emergency departments and clogging wards: National Emergency Access Target and the law of unintended consequences. EMA - Emergency Medicine Australasia. 2014;26(6):549–55.CrossRefPubMed
32.
go back to reference Sullivan C, Staib A, Khanna S, Good NM, Boyle J, Cattell R, et al. The national emergency access target (NEAT) and the 4-hour rule: Time to review the target. Medical Journal of Australia. 2016;204(9):354.e1-.e5.CrossRef Sullivan C, Staib A, Khanna S, Good NM, Boyle J, Cattell R, et al. The national emergency access target (NEAT) and the 4-hour rule: Time to review the target. Medical Journal of Australia. 2016;204(9):354.e1-.e5.CrossRef
33.
go back to reference Schull M, Vermeulen M, Guttmann A, Stukel T. Better performance on length-of-stay benchmarks associated with reduced risk following emergency department discharge: an observational cohort study. Canadian Journal of Emergency Medicine. 2015;17(3):253–62.PubMed Schull M, Vermeulen M, Guttmann A, Stukel T. Better performance on length-of-stay benchmarks associated with reduced risk following emergency department discharge: an observational cohort study. Canadian Journal of Emergency Medicine. 2015;17(3):253–62.PubMed
34.
go back to reference Bevan G, Hood C. Have targets improved performance in the English NHS? Br Med J. 2006;332(7538):419–22.CrossRef Bevan G, Hood C. Have targets improved performance in the English NHS? Br Med J. 2006;332(7538):419–22.CrossRef
35.
go back to reference Mays N. Use of Targets to Improve Health System Performance: English NHS Experience and Implications for New Zealand. Wellington: New Zealand Treasury; 2006. Contract No.: Working Paper 06/06. Mays N. Use of Targets to Improve Health System Performance: English NHS Experience and Implications for New Zealand. Wellington: New Zealand Treasury; 2006. Contract No.: Working Paper 06/06.
36.
go back to reference Propper C, Sutton M, Whitnall C, Windmeijer F. Did 'targets and terror' reduce waiting times in England for hospital care? BE Journal of Economic Analysis and Policy. 2008;8(2). Propper C, Sutton M, Whitnall C, Windmeijer F. Did 'targets and terror' reduce waiting times in England for hospital care? BE Journal of Economic Analysis and Policy. 2008;8(2).
37.
go back to reference Stokes B. Four Hour Rule Program Progress and Issues Review. Department of Health WA; 2011 December 2011. Stokes B. Four Hour Rule Program Progress and Issues Review. Department of Health WA; 2011 December 2011.
38.
go back to reference Sullivan CM, Staib A, Flores J, Aggarwal L, Scanlon A, Martin JH, et al. Aiming to be NEAT: safely improving and sustaining access to emergency care in a tertiary referral hospital. Aust Health Rev. 2014;38(5):564–74.CrossRefPubMed Sullivan CM, Staib A, Flores J, Aggarwal L, Scanlon A, Martin JH, et al. Aiming to be NEAT: safely improving and sustaining access to emergency care in a tertiary referral hospital. Aust Health Rev. 2014;38(5):564–74.CrossRefPubMed
39.
go back to reference Silk K. The National Emergency Access Target: aiming for the target but what about the goal? Melbourne: Deeble institute; 2016 26 April 2016. Silk K. The National Emergency Access Target: aiming for the target but what about the goal? Melbourne: Deeble institute; 2016 26 April 2016.
40.
go back to reference Ardagh M, Drew L. What have five years of the shorter stays in the emergency department health target done to us? N Z Med J. 2015;128(1421):47–54.PubMed Ardagh M, Drew L. What have five years of the shorter stays in the emergency department health target done to us? N Z Med J. 2015;128(1421):47–54.PubMed
41.
go back to reference Pollitt C. The logics of performance management. Evaluation. 2013;19(4):346–63.CrossRef Pollitt C. The logics of performance management. Evaluation. 2013;19(4):346–63.CrossRef
42.
go back to reference Maumill L, Zic M, Esson AA, Geelhoed GC, Borland MM, Johnson C, et al. The National Emergency Access Target (NEAT): can quality go with timeliness? Med J Aust. 2013;198(3):153–7.CrossRefPubMed Maumill L, Zic M, Esson AA, Geelhoed GC, Borland MM, Johnson C, et al. The National Emergency Access Target (NEAT): can quality go with timeliness? Med J Aust. 2013;198(3):153–7.CrossRefPubMed
43.
go back to reference Radnor Z. Muddled, massaging, manœuvring or manipulated?: a typology of organisational gaming. Int J Product Perform Manag. 2008;57(4):316–28.CrossRef Radnor Z. Muddled, massaging, manœuvring or manipulated?: a typology of organisational gaming. Int J Product Perform Manag. 2008;57(4):316–28.CrossRef
44.
go back to reference Committee PAS. On target? Government by measurement, fifth report of session 2002–03. London: United Kingdom Parliament; 2003. Committee PAS. On target? Government by measurement, fifth report of session 2002–03. London: United Kingdom Parliament; 2003.
45.
go back to reference Galipeau J, Pussegoda K, Stevens A, Brehaut JC, Curran J, Forster AJ, et al. Effectiveness and safety of short-stay units in the emergency department: a systematic review. Acad Emerg Med. 2015;22(8):893–907.CrossRefPubMed Galipeau J, Pussegoda K, Stevens A, Brehaut JC, Curran J, Forster AJ, et al. Effectiveness and safety of short-stay units in the emergency department: a systematic review. Acad Emerg Med. 2015;22(8):893–907.CrossRefPubMed
46.
go back to reference Zonderland ME, Boucherie RJ, Carter MW, Stanford DA. Modeling the effect of short stay units on patient admissions. Operations Research for Health Care. 2015;5:21–7.CrossRef Zonderland ME, Boucherie RJ, Carter MW, Stanford DA. Modeling the effect of short stay units on patient admissions. Operations Research for Health Care. 2015;5:21–7.CrossRef
47.
go back to reference Bryant PA, Hopper SM. Alternatives to ward admission from the emergency department. J Paediatr Child Health. 2016;52(2):237–40.CrossRefPubMed Bryant PA, Hopper SM. Alternatives to ward admission from the emergency department. J Paediatr Child Health. 2016;52(2):237–40.CrossRefPubMed
48.
go back to reference Power J, McManus O. Development of a short-stay unit in an emergency department. Emergency Nurse. 2013;21(2):18–22.CrossRefPubMed Power J, McManus O. Development of a short-stay unit in an emergency department. Emergency Nurse. 2013;21(2):18–22.CrossRefPubMed
49.
go back to reference Greene JC. Mixed methods in social inquiry (Vol. 9). San Fransisco, CA: Jossey-Bass; 2007. Greene JC. Mixed methods in social inquiry (Vol. 9). San Fransisco, CA: Jossey-Bass; 2007.
51.
go back to reference Mason S, Locker T, Careter A, Walters S, Stride C, Casson J. What are the organisational factors that influence waiting times in Emergency Departments. Sheffield: National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO); 2006. Mason S, Locker T, Careter A, Walters S, Stride C, Casson J. What are the organisational factors that influence waiting times in Emergency Departments. Sheffield: National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO); 2006.
52.
go back to reference Lee Y-J, Greene J. The Predictive Validity of an ESL Placement Test: A Mixed Methods Approach. Journal of Mixed Methods Research, 1(4),. 2007;1(4):366–89. Lee Y-J, Greene J. The Predictive Validity of an ESL Placement Test: A Mixed Methods Approach. Journal of Mixed Methods Research, 1(4),. 2007;1(4):366–89.
53.
go back to reference Onwuegbuzie AJ, Dickinson WB. Mixed methods analysis and information visualization: graphical display for effective communication of research results. Qual Rep. 2008;13(2):204–25. Onwuegbuzie AJ, Dickinson WB. Mixed methods analysis and information visualization: graphical display for effective communication of research results. Qual Rep. 2008;13(2):204–25.
54.
go back to reference Tenbensel T, Edlin R, Wilkinson-Meyers L, Field A, Walton L, Appleton S, et al. Evaluation of A&M, HML Telephone Triage, and St John Transport Initiatives. Auckland: Uniservices, University of Auckland; 2014 16 May 2014. Tenbensel T, Edlin R, Wilkinson-Meyers L, Field A, Walton L, Appleton S, et al. Evaluation of A&M, HML Telephone Triage, and St John Transport Initiatives. Auckland: Uniservices, University of Auckland; 2014 16 May 2014.
55.
go back to reference Rees GH. Organisational readiness and lean thinking implementation: findings from three emergency department case studies in New Zealand. Health Serv Manag Res. 2014;27(1–2):1–9.CrossRef Rees GH. Organisational readiness and lean thinking implementation: findings from three emergency department case studies in New Zealand. Health Serv Manag Res. 2014;27(1–2):1–9.CrossRef
Metadata
Title
New Zealand’s emergency department target – did it reduce ED length of stay, and if so, how and when?
Authors
Tim Tenbensel
Linda Chalmers
Peter Jones
Sarah Appleton-Dyer
Lisa Walton
Shanthi Ameratunga
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2617-1

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue