Skip to main content
Top
Published in: BMC Surgery 1/2016

Open Access 01-12-2016 | Debate

Debate: what is the best method to monitor surgical performance?

Authors: Stefan H. Steiner, William H. Woodall

Published in: BMC Surgery | Issue 1/2016

Login to get access

Abstract

Background

There is considerable recent interest in the monitoring of individual surgeon or hospital surgical outcomes. If one aggregates data over time and assesses performance with a funnel plot, then the detection of any process deterioration or improvement could be delayed. The variable life adjusted display (VLAD) is widely used for monitoring on a case-by-case basis, but we show that use of the risk-adjusted Bernoulli cumulative sum (RA-CUSUM) chart leads to much better performance.

Discussion

We use simulation to illustrate that the RA-CUSUM chart has better performance than the VLAD in detecting changes in the rates of adverse events.

Summary

We recommend the RA-CUSUM approach over the VLAD approach for monitoring surgical performance. If the VLAD is used, we recommend running the RA-CUSUM chart in the background to generate signals that the process performance has changed.
Literature
1.
go back to reference O’Neill S, Wigmore SJ, Harrison EM. Debate: should we use variable adjusted life displays (VLAD) to identify variations in performance in general surgery? BMC Surg. 2015;15:102.CrossRefPubMed O’Neill S, Wigmore SJ, Harrison EM. Debate: should we use variable adjusted life displays (VLAD) to identify variations in performance in general surgery? BMC Surg. 2015;15:102.CrossRefPubMed
2.
go back to reference Lovegrove J, Valencia O, Treasure T, Sherlaw-Johnson C, Gallivan S. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet. 1997;350:1128–30.CrossRefPubMed Lovegrove J, Valencia O, Treasure T, Sherlaw-Johnson C, Gallivan S. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet. 1997;350:1128–30.CrossRefPubMed
3.
go back to reference Poloniecki J, Valencia O, Littlejohns P. Cumulative risk-adjusted mortality chart for detecting changes in death rate: observational study of heart surgery. Br Med J. 1998;316:1697–700.CrossRef Poloniecki J, Valencia O, Littlejohns P. Cumulative risk-adjusted mortality chart for detecting changes in death rate: observational study of heart surgery. Br Med J. 1998;316:1697–700.CrossRef
4.
go back to reference Steiner SH, Cook R, Farewell V, Treasure T. Monitoring surgical performance using risk-adjusted cumulative sum charts. Biostatistics. 2000;1:441–52.CrossRefPubMed Steiner SH, Cook R, Farewell V, Treasure T. Monitoring surgical performance using risk-adjusted cumulative sum charts. Biostatistics. 2000;1:441–52.CrossRefPubMed
5.
go back to reference Moustakides GV. Optimal stopping times for detecting changes in distributions. Ann Stat. 1986;14:1379–87.CrossRef Moustakides GV. Optimal stopping times for detecting changes in distributions. Ann Stat. 1986;14:1379–87.CrossRef
6.
go back to reference Zhang X, Woodall WH. Dynamic probability control limits for risk-adjusted Bernoulli CUSUM charts. Stat Med. 2015;34:3336–48.CrossRefPubMed Zhang X, Woodall WH. Dynamic probability control limits for risk-adjusted Bernoulli CUSUM charts. Stat Med. 2015;34:3336–48.CrossRefPubMed
7.
go back to reference Steiner SH. Risk-adjusted monitoring of outcomes in health care, chapter 14. In: Lawless J, editor. Statistics in action: a Canadian outlook. Statistical Society of Canada, Chapman and Hall/CRC; 2015, p. 245–64. Steiner SH. Risk-adjusted monitoring of outcomes in health care, chapter 14. In: Lawless J, editor. Statistics in action: a Canadian outlook. Statistical Society of Canada, Chapman and Hall/CRC; 2015, p. 245–64.
8.
go back to reference Woodall WH, Fogel SL, Steiner SH. The monitoring and improvement of surgical outcome quality. J Qual Technol. 2015;47:383–99. Woodall WH, Fogel SL, Steiner SH. The monitoring and improvement of surgical outcome quality. J Qual Technol. 2015;47:383–99.
9.
go back to reference Sherlaw-Johnson C. A method for detecting runs of good and bad clinical outcomes on variable life adjusted display (VLAD) charts. Health Care Manag Sci. 2005;8:61–65. Sherlaw-Johnson C. A method for detecting runs of good and bad clinical outcomes on variable life adjusted display (VLAD) charts. Health Care Manag Sci. 2005;8:61–65.
Metadata
Title
Debate: what is the best method to monitor surgical performance?
Authors
Stefan H. Steiner
William H. Woodall
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Surgery / Issue 1/2016
Electronic ISSN: 1471-2482
DOI
https://doi.org/10.1186/s12893-016-0131-8

Other articles of this Issue 1/2016

BMC Surgery 1/2016 Go to the issue