Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2012

Open Access 01-12-2012 | Research article

A review on the relation between simulation and improvement in hospitals

Authors: Wineke AM van Lent, Peter VanBerkel, Wim H van Harten

Published in: BMC Medical Informatics and Decision Making | Issue 1/2012

Login to get access

Abstract

Background

Simulation applications on operations management in hospitals are frequently published and claim to support decision-making on operations management subjects. However, the reported implementation rates of recommendations are low and the actual impact of the changes recommended by the modeler has hardly been examined. This paper examines: 1) the execution rate of simulation study recommendations, 2) the research methods used to evaluate implementation of recommendations, 3) factors contributing to implementation, and 4) the differences regarding implementation between literature and practice.

Results

Altogether 16 hospitals executed the recommendations (at least partially). Implementation results were hardly reported upon; 1 study described a before-and-after design, 2 a partial before and after design. Factors that help implementation were grouped according to 1) technical quality, of which data availability, validation/verification with historic data/expert opinion, and the development of the conceptual model were mentioned most frequently 2) process quality, with client involvement and 3) outcome quality with, presentation of results. The survey response rate of traceable authors was 61%, 18 authors implemented the results at least partially. Among these responses, evaluation methods were relatively better with 3 time series designs and 2 before-and-after designs.

Conclusions

Although underreported in literature, implementation of recommendations seems limited; this review provides recommendations on project design, implementation conditions and evaluation methods to increase implementation.

Methods

A literature review in PubMed and Business Source Elite on stochastic simulation applications on operations management in individual hospitals published between 1997 and 2008. From those reporting implementation, cross references were added. In total, 89 papers were included. A scoring list was used for data extraction. Two reviewers evaluated each paper separately; in case of discrepancies, they jointly determined the scores. The findings were validated with a survey to the original authors.
Appendix
Available only for authorised users
Literature
1.
go back to reference Anderson GF, Frogner BK, Reinhardt UE: Health spending in OECD countries in 2004: an update. Health Aff. 2007, 26: 1481-10.1377/hlthaff.26.5.1481.CrossRef Anderson GF, Frogner BK, Reinhardt UE: Health spending in OECD countries in 2004: an update. Health Aff. 2007, 26: 1481-10.1377/hlthaff.26.5.1481.CrossRef
2.
go back to reference Lowery JC: Getting started in simulation in healthcare. WSC '98 Proceedings of the 30th conference on Winter simulation. 1998, IEEE Computer Society Press Los Alamitos, CA, 31-36. Lowery JC: Getting started in simulation in healthcare. WSC '98 Proceedings of the 30th conference on Winter simulation. 1998, IEEE Computer Society Press Los Alamitos, CA, 31-36.
3.
go back to reference Brandeau ML, Sainfort F, Pierskalla WP: Operations research and health care. A Handbook of methods and applications. 2004, International Series in Operations Research & Management Science. Kluwer Academic Publisher, Boston/Dordrecht/London, 70 Brandeau ML, Sainfort F, Pierskalla WP: Operations research and health care. A Handbook of methods and applications. 2004, International Series in Operations Research & Management Science. Kluwer Academic Publisher, Boston/Dordrecht/London, 70
4.
go back to reference Research Into Global Healthcare Tools (RIGHT): Modelling and Simulation Techniques for Healthcare Decision Making: A Selection framework. 2008, Cambridge: Engineering Design Centre, University of Cambridge Research Into Global Healthcare Tools (RIGHT): Modelling and Simulation Techniques for Healthcare Decision Making: A Selection framework. 2008, Cambridge: Engineering Design Centre, University of Cambridge
5.
go back to reference Jun JB, Jacobson SH, Swisher JR: Application of discrete-event simulation in health care clinics: a survey. J Oper Res Soc. 1999, 50 (2): 109-123.CrossRef Jun JB, Jacobson SH, Swisher JR: Application of discrete-event simulation in health care clinics: a survey. J Oper Res Soc. 1999, 50 (2): 109-123.CrossRef
6.
go back to reference Brailsford SC, Harper PR, Patel B, Pitt M: An analysis of the academic literature on simulation and modelling in health care. J Simul. 2009, 3 (3): 130-140. 10.1057/jos200910.CrossRef Brailsford SC, Harper PR, Patel B, Pitt M: An analysis of the academic literature on simulation and modelling in health care. J Simul. 2009, 3 (3): 130-140. 10.1057/jos200910.CrossRef
7.
go back to reference Amoako-Gyampah K, Meredith JR: The operations management research agenda: An update. J Oper Manage. 1989, 8: 250-262. 10.1016/0272-6963(89)90027-2.CrossRef Amoako-Gyampah K, Meredith JR: The operations management research agenda: An update. J Oper Manage. 1989, 8: 250-262. 10.1016/0272-6963(89)90027-2.CrossRef
8.
go back to reference Pannirselvam GP, Ferguson LA, Ash RC, Siferd SP: Operations management research: an update for the 1990s. J Oper Manage. 1999, 18 (1): 95-112. 10.1016/S0272-6963(99)00009-1.CrossRef Pannirselvam GP, Ferguson LA, Ash RC, Siferd SP: Operations management research: an update for the 1990s. J Oper Manage. 1999, 18 (1): 95-112. 10.1016/S0272-6963(99)00009-1.CrossRef
9.
go back to reference Fone D, Hollinghurst S, Temple M, Round A, Lester N, Weightman A: Systematic review of the use and value of computer simulation modelling in population health and health care delivery. J Public Health. 2003, 25 (4): 325-335. 10.1093/pubmed/fdg075.CrossRef Fone D, Hollinghurst S, Temple M, Round A, Lester N, Weightman A: Systematic review of the use and value of computer simulation modelling in population health and health care delivery. J Public Health. 2003, 25 (4): 325-335. 10.1093/pubmed/fdg075.CrossRef
10.
go back to reference Klein R, Dittus R, Roberts S, Wilson J: Simulation modeling and health-care decision making. Med Decis Making. 1993, 13 (4): 347-10.1177/0272989X9301300411.CrossRefPubMed Klein R, Dittus R, Roberts S, Wilson J: Simulation modeling and health-care decision making. Med Decis Making. 1993, 13 (4): 347-10.1177/0272989X9301300411.CrossRefPubMed
11.
go back to reference Smith-Daniels V, Schweikhart S, Smith-Daniels D: Capacity management in health care services: review and future research directions. Decision Sciences. 1988, 19 (4): 889-919. 10.1111/j.1540-5915.1988.tb00310.x.CrossRef Smith-Daniels V, Schweikhart S, Smith-Daniels D: Capacity management in health care services: review and future research directions. Decision Sciences. 1988, 19 (4): 889-919. 10.1111/j.1540-5915.1988.tb00310.x.CrossRef
12.
go back to reference Vanberkel PT, Boucherie RJ, Hans EW, Hurink JL, Litvak Nl: A survey of health care models that encompass multiple departments. Int J of Health Manage Inf. 2010, 1 (1): 37-69. Vanberkel PT, Boucherie RJ, Hans EW, Hurink JL, Litvak Nl: A survey of health care models that encompass multiple departments. Int J of Health Manage Inf. 2010, 1 (1): 37-69.
13.
go back to reference Wilson JCT: Implementation of computer simulation projects in health care. J Oper Res Soc. 1981, 32 (9): 825-832.CrossRefPubMed Wilson JCT: Implementation of computer simulation projects in health care. J Oper Res Soc. 1981, 32 (9): 825-832.CrossRefPubMed
14.
go back to reference VanBerkel P, Blake J: A comprehensive simulation for wait time reduction and capacity planning applied in general surgery. Health Care Manag Sc. 2007, 10: 373-385. 10.1007/s10729-007-9035-6.CrossRef VanBerkel P, Blake J: A comprehensive simulation for wait time reduction and capacity planning applied in general surgery. Health Care Manag Sc. 2007, 10: 373-385. 10.1007/s10729-007-9035-6.CrossRef
15.
go back to reference Lagergren M: What is the role and contribution of models to management and research in the health services? A view from Europe. Eur J Oper Res. 1998, 105: 257-266. 10.1016/S0377-2217(97)00233-6.CrossRef Lagergren M: What is the role and contribution of models to management and research in the health services? A view from Europe. Eur J Oper Res. 1998, 105: 257-266. 10.1016/S0377-2217(97)00233-6.CrossRef
16.
go back to reference Carter L, Ulrich D, Goldsmith M: Best practices in leadership development and organization change: how the best companies ensure meaningful change and sustainable leadership. 2005, San Francisco: Pfeiffer Carter L, Ulrich D, Goldsmith M: Best practices in leadership development and organization change: how the best companies ensure meaningful change and sustainable leadership. 2005, San Francisco: Pfeiffer
17.
go back to reference Christensen CM: The innovator's dilemma: when new technologies cause great firms to fail. 1997, Harvard: Business School Pr Christensen CM: The innovator's dilemma: when new technologies cause great firms to fail. 1997, Harvard: Business School Pr
18.
go back to reference Kotter JP: Leading change. 1996, Harvard: Business School Pr Kotter JP: Leading change. 1996, Harvard: Business School Pr
19.
go back to reference Rogers EM: Diffusion of innovations. 1995, New York: Free Press Rogers EM: Diffusion of innovations. 1995, New York: Free Press
20.
go back to reference Eldabi T, Irani Z, Paul RJ: A proposed approach for modelling health-care systems for understanding. J Manag Med. 2002, 16 (2/3): 170-187. 10.1108/02689230210434916.CrossRefPubMed Eldabi T, Irani Z, Paul RJ: A proposed approach for modelling health-care systems for understanding. J Manag Med. 2002, 16 (2/3): 170-187. 10.1108/02689230210434916.CrossRefPubMed
21.
go back to reference Harper PR, Pitt MA: On the challenges of healthcare modelling and a proposed project life cycle for successful implementation. J Oper Res Soc. 2004, 55 (6): 657-661. 10.1057/palgrave.jors.2601719.CrossRef Harper PR, Pitt MA: On the challenges of healthcare modelling and a proposed project life cycle for successful implementation. J Oper Res Soc. 2004, 55 (6): 657-661. 10.1057/palgrave.jors.2601719.CrossRef
22.
go back to reference McHaney R, Cronan TP: Toward an empirical understanding of computer simulation implementation success. Inf Manage. 2000, 37 (3): 135-151. 10.1016/S0378-7206(99)00041-5.CrossRef McHaney R, Cronan TP: Toward an empirical understanding of computer simulation implementation success. Inf Manage. 2000, 37 (3): 135-151. 10.1016/S0378-7206(99)00041-5.CrossRef
23.
go back to reference McHaney R, White D, Heilman GE: Simulation project success and failure: Survey findings. Simul & Gaming. 2002, 33 (1): 49-CrossRef McHaney R, White D, Heilman GE: Simulation project success and failure: Survey findings. Simul & Gaming. 2002, 33 (1): 49-CrossRef
24.
go back to reference Robinson S, Pidd M: Provider and customer expectations of successful simulation projects. J Oper Res Soc. 1998, 49 (3): 200-209.CrossRef Robinson S, Pidd M: Provider and customer expectations of successful simulation projects. J Oper Res Soc. 1998, 49 (3): 200-209.CrossRef
25.
go back to reference Robinson S: Measuring service quality in the process of delivering a simulation study: the customer's perspective. Int Trans Oper Res. 1998, 5 (5): 357-374. 10.1111/j.1475-3995.1998.tb00120.x.CrossRef Robinson S: Measuring service quality in the process of delivering a simulation study: the customer's perspective. Int Trans Oper Res. 1998, 5 (5): 357-374. 10.1111/j.1475-3995.1998.tb00120.x.CrossRef
26.
go back to reference Eccles M, Grimshaw J, Campbell M, Ramsay C: Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care. 2003, 12 (1): 47-10.1136/qhc.12.1.47.CrossRefPubMedPubMedCentral Eccles M, Grimshaw J, Campbell M, Ramsay C: Research designs for studies evaluating the effectiveness of change and improvement strategies. Qual Saf Health Care. 2003, 12 (1): 47-10.1136/qhc.12.1.47.CrossRefPubMedPubMedCentral
27.
go back to reference Lehaney B, Clarke SA, Paul RJ: A case of an intervention in an outpatients department. J Oper Res Soc. 1999, 50 (9): 877-891.CrossRef Lehaney B, Clarke SA, Paul RJ: A case of an intervention in an outpatients department. J Oper Res Soc. 1999, 50 (9): 877-891.CrossRef
28.
go back to reference Forsberg H, Aronsson H, Keller C, Lindblad S: Managing health care decisions and improvement through simulation modeling. Qual Manag Health Care. 2011, 20 (1): 15-29. 10.1136/bmjqs.2008.028381.CrossRefPubMed Forsberg H, Aronsson H, Keller C, Lindblad S: Managing health care decisions and improvement through simulation modeling. Qual Manag Health Care. 2011, 20 (1): 15-29. 10.1136/bmjqs.2008.028381.CrossRefPubMed
29.
go back to reference Proudlove NC, Black S, Fletcher A: OR and the challenge to improve the NHS: modelling for insight and improvement in in-patient flows. J Oper Res Soc. 2007, 58: 145-158.CrossRef Proudlove NC, Black S, Fletcher A: OR and the challenge to improve the NHS: modelling for insight and improvement in in-patient flows. J Oper Res Soc. 2007, 58: 145-158.CrossRef
30.
go back to reference Brailsford SC: Tutorial: advances and challenges in healthcare simulation modeling. 2007, 1436-1448. Brailsford SC: Tutorial: advances and challenges in healthcare simulation modeling. 2007, 1436-1448.
31.
go back to reference Fletcher A, Worthington D: What is a generic hospital model? A comparison of generic and specific hospital models of emergency patient flows. Health Care Manag Sc. 2009, 12 (4): 374-391. 10.1007/s10729-009-9108-9.CrossRef Fletcher A, Worthington D: What is a generic hospital model? A comparison of generic and specific hospital models of emergency patient flows. Health Care Manag Sc. 2009, 12 (4): 374-391. 10.1007/s10729-009-9108-9.CrossRef
32.
go back to reference Dumas A, Gunal MM, Pidd M: Moving from specific to generic: generic modelling in health care. Proceedings of the 2007 INFORMS Simulation Society Research Workshop. 2007 Dumas A, Gunal MM, Pidd M: Moving from specific to generic: generic modelling in health care. Proceedings of the 2007 INFORMS Simulation Society Research Workshop. 2007
33.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Qy. 2004, 82 (4): 581-10.1111/j.0887-378X.2004.00325.x.CrossRef Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Qy. 2004, 82 (4): 581-10.1111/j.0887-378X.2004.00325.x.CrossRef
34.
go back to reference Robinson S: General concepts of quality for discrete-event simulation. Eur J Oper Res. 2002, 138 (1): 103-117. 10.1016/S0377-2217(01)00127-8.CrossRef Robinson S: General concepts of quality for discrete-event simulation. Eur J Oper Res. 2002, 138 (1): 103-117. 10.1016/S0377-2217(01)00127-8.CrossRef
Metadata
Title
A review on the relation between simulation and improvement in hospitals
Authors
Wineke AM van Lent
Peter VanBerkel
Wim H van Harten
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2012
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-12-18

Other articles of this Issue 1/2012

BMC Medical Informatics and Decision Making 1/2012 Go to the issue