Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2007

Open Access 01-12-2007 | Research article

The CUSUM chart method as a tool for continuous monitoring of clinical outcomes using routinely collected data

Authors: Thabani Sibanda, Nokuthaba Sibanda

Published in: BMC Medical Research Methodology | Issue 1/2007

Login to get access

Abstract

Background

The lack of robust systems for monitoring quality in healthcare has been highlighted. Statistical process control (SPC) methods, utilizing the increasingly available routinely collected electronic patient records, could be used in creating surveillance systems that could lead to rapid detection of periods of deteriorating standards. We aimed to develop and test a CUmulative SUM (CUSUM) based surveillance system that could be used in continuous monitoring of clinical outcomes, using routinely collected data. The low Apgar score (5 minute Apgar score < 7) was used as an example outcome.

Method

A surveillance system based on the Observed minus Expected (O-E) as well as the 2-sided Log-Likelihood CUSUM charts was developed. The Log-Likelihood chart was designed to detect a 50% rise (deterioration) and halving (improvement) in the odds of low Apgar scores. Baseline rates were calculated from data for 2001 to 2004, and were used to monitor deliveries for 2005. Deliveries for nulliparous and multiparous women were monitored separately. All analyses were retrospective.

Results

The CUSUM system detected periods of increased rates of low Apgar scores for each of the nulliparous and multiparous cohorts. The overall rate for 2005 was eventually found to be 0.67%, which was higher than the baseline reference rate of 0.44% from 2001 to 2004.

Conclusion

CUSUM methods can be used in continuous monitoring of clinical outcomes using routinely collected data. Used prospectively, they could lead to the prompt detection of periods of suboptimal standards.
Appendix
Available only for authorised users
Literature
1.
go back to reference Commission for Healthcare Audit and Inspection: Investigation into 10 maternal deaths at, or following delivery at, Northwick Park Hospital, North West London Hospitals NHS Trust, between April 2002 and April 2005. 2006, London , Healthcare Commission, 116 p.- Commission for Healthcare Audit and Inspection: Investigation into 10 maternal deaths at, or following delivery at, Northwick Park Hospital, North West London Hospitals NHS Trust, between April 2002 and April 2005. 2006, London , Healthcare Commission, 116 p.-
2.
go back to reference Hawkins DM, Olwell DH: Cumulative sum charts and charting for quality improvement. Statistics for engineering and physical science. 1998, New York, London , Springer, xvi, 247 p.- Hawkins DM, Olwell DH: Cumulative sum charts and charting for quality improvement. Statistics for engineering and physical science. 1998, New York, London , Springer, xvi, 247 p.-
3.
go back to reference Page ES: Continuous inspection schemes. Biometrika. 1954, 41 (1-2): 100-115. 10.1093/biomet/41.1-2.100.CrossRef Page ES: Continuous inspection schemes. Biometrika. 1954, 41 (1-2): 100-115. 10.1093/biomet/41.1-2.100.CrossRef
4.
go back to reference Wohl H: The cusum plot: its utility in the analysis of clinical data. N Engl J Med. 1977, 296 (18): 1044-1045.CrossRefPubMed Wohl H: The cusum plot: its utility in the analysis of clinical data. N Engl J Med. 1977, 296 (18): 1044-1045.CrossRefPubMed
6.
go back to reference Bolsin S, Colson M: The use of the Cusum technique in the assessment of trainee competence in new procedures. Int J Qual Health Care. 2000, 12 (5): 433-438. 10.1093/intqhc/12.5.433.CrossRefPubMed Bolsin S, Colson M: The use of the Cusum technique in the assessment of trainee competence in new procedures. Int J Qual Health Care. 2000, 12 (5): 433-438. 10.1093/intqhc/12.5.433.CrossRefPubMed
7.
go back to reference Steiner SH, Cook RJ, Farewell VT: Risk-adjusted monitoring of binary surgical outcomes. Med Decis Making. 2001, 21 (3): 163-169. 10.1177/02729890122062451.CrossRefPubMed Steiner SH, Cook RJ, Farewell VT: Risk-adjusted monitoring of binary surgical outcomes. Med Decis Making. 2001, 21 (3): 163-169. 10.1177/02729890122062451.CrossRefPubMed
8.
go back to reference Attilakos G, Sibanda T, Draycott T: Was The Higher Failure Rate Of The Kiwi Omnicup In A Randomized Study Attributed To A Learning Curve? . Journal of Obstetrics & Gynaecology. 2005, 25 (Suppl 1): Attilakos G, Sibanda T, Draycott T: Was The Higher Failure Rate Of The Kiwi Omnicup In A Randomized Study Attributed To A Learning Curve? . Journal of Obstetrics & Gynaecology. 2005, 25 (Suppl 1):
9.
go back to reference Apgar V: A proposal for a new method of evaluation of the newborn infant. Curr Res Anesth Analg. 1953, 32 (4): 260-267.PubMed Apgar V: A proposal for a new method of evaluation of the newborn infant. Curr Res Anesth Analg. 1953, 32 (4): 260-267.PubMed
10.
go back to reference National Institute for Clinical Excellence: Electronic Fetal Monitoring: Evidence-based Clinical Guideline Number 8. Evidence-based Clinical Guidelines. 2001 National Institute for Clinical Excellence: Electronic Fetal Monitoring: Evidence-based Clinical Guideline Number 8. Evidence-based Clinical Guidelines. 2001
11.
go back to reference Royal College of Obstetricians and Gynaecologists: Improving patient safety: Risk management for maternity and gynaecology: Clinical Governance Advice Number 2. Clinical Governance Advice. 2005, London Royal College of Obstetricians and Gynaecologists: Improving patient safety: Risk management for maternity and gynaecology: Clinical Governance Advice Number 2. Clinical Governance Advice. 2005, London
12.
go back to reference Mann S, Marcus R, Sachs B: Lessons from the cockpit: How team training can reduce errors in L & D. Contemporary OB/GYN. 2006 Mann S, Marcus R, Sachs B: Lessons from the cockpit: How team training can reduce errors in L & D. Contemporary OB/GYN. 2006
13.
go back to reference Draycott T, Sibanda T, Owen L, Akande V, Winter C, Reading S, Whitelaw A: Does training in obstetric emergencies improve neonatal outcome?. BJOG: An International Journal of Obstetrics and Gynaecology. 2006, 113 (2): 177-182. 10.1111/j.1471-0528.2006.00800.x.CrossRef Draycott T, Sibanda T, Owen L, Akande V, Winter C, Reading S, Whitelaw A: Does training in obstetric emergencies improve neonatal outcome?. BJOG: An International Journal of Obstetrics and Gynaecology. 2006, 113 (2): 177-182. 10.1111/j.1471-0528.2006.00800.x.CrossRef
14.
go back to reference Maresh M, Dawson AM, Beard RW: Assessment of an on-line computerized perinatal data collection and information system. Br J Obstet Gynaecol. 1986, 93 (12): 1239-1245.CrossRefPubMed Maresh M, Dawson AM, Beard RW: Assessment of an on-line computerized perinatal data collection and information system. Br J Obstet Gynaecol. 1986, 93 (12): 1239-1245.CrossRefPubMed
15.
go back to reference Cleary R, Beard RW, Coles J, Devlin HB, Hopkins A, Roberts S, Schumacher D, Wickings HI: The quality of routinely collected maternity data. Br J Obstet Gynaecol. 1994, 101 (12): 1042-1047.CrossRefPubMed Cleary R, Beard RW, Coles J, Devlin HB, Hopkins A, Roberts S, Schumacher D, Wickings HI: The quality of routinely collected maternity data. Br J Obstet Gynaecol. 1994, 101 (12): 1042-1047.CrossRefPubMed
16.
go back to reference Khwaja HA, Syed H, Cranston DW: Coding errors: a comparative analysis of hospital and prospectively collected departmental data. BJU International. 2002, 89 (3): 178-180. 10.1046/j.1464-4096.2001.01428.x.CrossRefPubMed Khwaja HA, Syed H, Cranston DW: Coding errors: a comparative analysis of hospital and prospectively collected departmental data. BJU International. 2002, 89 (3): 178-180. 10.1046/j.1464-4096.2001.01428.x.CrossRefPubMed
17.
go back to reference Ricci M, Goldman AP, de Leval MR, Cohen GA, Devaney F, Carthey J: Pitfalls of adverse event reporting in paediatric cardiac intensive care. Arch Dis Child. 2004, 89 (9): 856-859. 10.1136/adc.2003.040154.CrossRefPubMedPubMedCentral Ricci M, Goldman AP, de Leval MR, Cohen GA, Devaney F, Carthey J: Pitfalls of adverse event reporting in paediatric cardiac intensive care. Arch Dis Child. 2004, 89 (9): 856-859. 10.1136/adc.2003.040154.CrossRefPubMedPubMedCentral
18.
go back to reference Sari ABA, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. 2007, 334 (7584): 79- Sari ABA, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. 2007, 334 (7584): 79-
19.
go back to reference Aylin P, Best N, Bottle A, Marshall C: Following Shipman: a pilot system for monitoring mortality rates in primary care. Lancet. 2003, 362 (9382): 485-491. 10.1016/S0140-6736(03)14077-9.CrossRefPubMed Aylin P, Best N, Bottle A, Marshall C: Following Shipman: a pilot system for monitoring mortality rates in primary care. Lancet. 2003, 362 (9382): 485-491. 10.1016/S0140-6736(03)14077-9.CrossRefPubMed
Metadata
Title
The CUSUM chart method as a tool for continuous monitoring of clinical outcomes using routinely collected data
Authors
Thabani Sibanda
Nokuthaba Sibanda
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2007
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-7-46

Other articles of this Issue 1/2007

BMC Medical Research Methodology 1/2007 Go to the issue