Skip to main content
Top
Published in: Trials 1/2009

Open Access 01-12-2009 | Research

Baseline hospital performance and the impact of medical emergency teams: Modelling vs. conventional subgroup analysis

Authors: Jack Chen, Arthas Flabouris, Rinaldo Bellomo, Ken Hillman, Simon Finfer, MERIT investigators for the Simpson Centre and the ANZICS Clinical Trial Group

Published in: Trials | Issue 1/2009

Login to get access

Abstract

Background

To compare two approaches to the statistical analysis of the relationship between the baseline incidence of adverse events and the effect of medical emergency teams (METs).

Methods

Using data from a cluster randomized controlled trial (the MERIT study), we analysed the relationship between the baseline incidence of adverse events and its change from baseline to the MET activation phase using quadratic modelling techniques. We compared the findings with those obtained with conventional subgroup analysis.

Results

Using linear and quadratic modelling techniques, we found that each unit increase in the baseline incidence of adverse events in MET hospitals was associated with a 0.59 unit subsequent reduction in adverse events (95%CI: 0.33 to 0.86) after MET implementation and activation. This applied to cardiac arrests (0.74; 95%CI: 0.52 to 0.95), unplanned ICU admissions (0.56; 95%CI: 0.26 to 0.85) and unexpected deaths (0.68; 95%CI: 0.45 to 0.90). Control hospitals showed a similar reduction only for cardiac arrests (0.95; 95%CI: 0.56 to 1.32). Comparison using conventional subgroup analysis, on the other hand, detected no significant difference between MET and control hospitals.

Conclusions

Our study showed that, in the MERIT study, when there was dependence of treatment effect on baseline performance, an approach based on regression modelling helped illustrate the nature and magnitude of such dependence while sub-group analysis did not. The ability to assess the nature and magnitude of such dependence may have policy implications. Regression technique may thus prove useful in analysing data when there is a conditional treatment effect.
Appendix
Available only for authorised users
Literature
1.
go back to reference Donaldson MS, Kohn LT, Corrigan J: To err is human: building a safer health system. 2000, Washington, D.C: National Academy Press Donaldson MS, Kohn LT, Corrigan J: To err is human: building a safer health system. 2000, Washington, D.C: National Academy Press
2.
go back to reference Institute of Medicine: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington D.C.:National Academies Press Institute of Medicine: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington D.C.:National Academies Press
3.
go back to reference Aspden P, Institute of Medicine (Committee on the Work Environment forNurses and Patient Safety): Patient safety: achieving a new standard for care. 2004, Washington, D.C:National Academies Press Aspden P, Institute of Medicine (Committee on the Work Environment forNurses and Patient Safety): Patient safety: achieving a new standard for care. 2004, Washington, D.C:National Academies Press
4.
go back to reference Byers JF, White SV: Patient safety: principles andpractice. 2004, New York, NY: Springer Byers JF, White SV: Patient safety: principles andpractice. 2004, New York, NY: Springer
5.
go back to reference Child AP, Institute of Medicine (Committee on the Work Environment forNurses and Patient Safety): Keeping patients safe: transforming the work environment of nurses. 2004, Washington, D.C:National Academies Press Child AP, Institute of Medicine (Committee on the Work Environment forNurses and Patient Safety): Keeping patients safe: transforming the work environment of nurses. 2004, Washington, D.C:National Academies Press
6.
go back to reference United States, Congress, House, Committee on Energy and Commerce: Patient Safety and Quality Improvement Act report (to accompany H.R. 663) (including cost estimate of the Congressional Budget Office). 2003, Washington, D.C:U.S. G.P.O United States, Congress, House, Committee on Energy and Commerce: Patient Safety and Quality Improvement Act report (to accompany H.R. 663) (including cost estimate of the Congressional Budget Office). 2003, Washington, D.C:U.S. G.P.O
7.
go back to reference Argyris C: On organizational learning. 1999, Malden, Mass: Blackwell Business, 2 Argyris C: On organizational learning. 1999, Malden, Mass: Blackwell Business, 2
8.
go back to reference Jackson MC: Systems thinking: creative holism for managers. 2002, Chichester: Wiley Jackson MC: Systems thinking: creative holism for managers. 2002, Chichester: Wiley
9.
go back to reference Green LW, Kreuter MW, Green LW: Health program planning: an educational and ecological approach. 2005, New York: McGraw-Hill, 4 Green LW, Kreuter MW, Green LW: Health program planning: an educational and ecological approach. 2005, New York: McGraw-Hill, 4
10.
go back to reference Windsor RA: Evaluation of health promotion, health education, and disease prevention programs. 2004, Boston: McGraw-Hill, 3 Windsor RA: Evaluation of health promotion, health education, and disease prevention programs. 2004, Boston: McGraw-Hill, 3
11.
go back to reference Hillman K, Chen J, Brown D: A Clinical Model for Health Services Research - The Medical Emergency Team. J Crit Care. 2003, 18 (3): 195-199. 10.1016/j.jcrc.2003.08.011.CrossRefPubMed Hillman K, Chen J, Brown D: A Clinical Model for Health Services Research - The Medical Emergency Team. J Crit Care. 2003, 18 (3): 195-199. 10.1016/j.jcrc.2003.08.011.CrossRefPubMed
12.
go back to reference Hillman K, Parr M, Flabouris A, Bishop G, Stewart A: Redefining in-hospital resuscitation: the concept of the medical emergency team. Resuscitation. 2001, 48 (2): 105-110. 10.1016/S0300-9572(00)00334-8.CrossRefPubMed Hillman K, Parr M, Flabouris A, Bishop G, Stewart A: Redefining in-hospital resuscitation: the concept of the medical emergency team. Resuscitation. 2001, 48 (2): 105-110. 10.1016/S0300-9572(00)00334-8.CrossRefPubMed
13.
go back to reference Braithwaite RS, DeVita MA, Mahidhara R, Simmons RL, Stuart S, Foraida M, Medical Emergency Response Improvement Team (MERIT): Use of medical emergency team (MET) responses to detect medical errors. Quality and Safety in Health Care. 2004, 13: 255-259. 10.1136/qshc.2003.009324.CrossRefPubMedPubMedCentral Braithwaite RS, DeVita MA, Mahidhara R, Simmons RL, Stuart S, Foraida M, Medical Emergency Response Improvement Team (MERIT): Use of medical emergency team (MET) responses to detect medical errors. Quality and Safety in Health Care. 2004, 13: 255-259. 10.1136/qshc.2003.009324.CrossRefPubMedPubMedCentral
14.
go back to reference Lee A, Bishop G, Hillman K, Daffurn K: The Medical Emergency Team. Anaesth Intensive Care. 1995, 23: 183-186.PubMed Lee A, Bishop G, Hillman K, Daffurn K: The Medical Emergency Team. Anaesth Intensive Care. 1995, 23: 183-186.PubMed
15.
go back to reference Audit Commission: Critical to success the place of efficient and effective critical care services within the acute hospitals. London. 1999 Audit Commission: Critical to success the place of efficient and effective critical care services within the acute hospitals. London. 1999
16.
go back to reference Department of Health (UK): Critical Care Outreach. 2003, Department of Health (UK) Department of Health (UK): Critical Care Outreach. 2003, Department of Health (UK)
18.
go back to reference Ball C, Kirkby M, Williams S: Effect of the critical care outreach team on patient survival to discharge from hospital and readmission to critical care: non-randomised population based study. BMJ. 2003, 327 (7422): 1014-10.1136/bmj.327.7422.1014.CrossRefPubMedPubMedCentral Ball C, Kirkby M, Williams S: Effect of the critical care outreach team on patient survival to discharge from hospital and readmission to critical care: non-randomised population based study. BMJ. 2003, 327 (7422): 1014-10.1136/bmj.327.7422.1014.CrossRefPubMedPubMedCentral
19.
go back to reference Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G: A prospective before-and-after trial of a medical emergency team. Med J Aust. 2003, 179 (6): 283-7.PubMed Bellomo R, Goldsmith D, Uchino S, Buckmaster J, Hart GK, Opdam H, Silvester W, Doolan L, Gutteridge G: A prospective before-and-after trial of a medical emergency team. Med J Aust. 2003, 179 (6): 283-7.PubMed
20.
go back to reference Braithwaite RS, DeVita M, Stuart S, Foraida M, Simmons RL: Can cardiac arrests be prevented in hospitalised patients? Results of a medical crisis response team (Condition C). Journal of General Internal Medicine. 2003, 18 (Supplement 1): 222-223. Braithwaite RS, DeVita M, Stuart S, Foraida M, Simmons RL: Can cardiac arrests be prevented in hospitalised patients? Results of a medical crisis response team (Condition C). Journal of General Internal Medicine. 2003, 18 (Supplement 1): 222-223.
21.
go back to reference Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TV: Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ. 2002, 324 (7334): 387-90. 10.1136/bmj.324.7334.387.CrossRefPubMedPubMedCentral Buist MD, Moore GE, Bernard SA, Waxman BP, Anderson JN, Nguyen TV: Effects of a medical emergency team on reduction of incidence of and mortality from unexpected cardiac arrests in hospital: preliminary study. BMJ. 2002, 324 (7334): 387-90. 10.1136/bmj.324.7334.387.CrossRefPubMedPubMedCentral
22.
go back to reference DeVita MA, Schaefer J, Lutz J, Dongilli T, Wang H: Improving medical crisis team performance. Crit Care Med. 2004, 32 (2 Suppl): S61-S65. 10.1097/01.CCM.0000110872.86812.1C.CrossRefPubMed DeVita MA, Schaefer J, Lutz J, Dongilli T, Wang H: Improving medical crisis team performance. Crit Care Med. 2004, 32 (2 Suppl): S61-S65. 10.1097/01.CCM.0000110872.86812.1C.CrossRefPubMed
23.
go back to reference DeVita MA, Braithwaite RS, Mahidhara R, Stuart S, Foraida M, Simmons RL, Medical Emergency Response Improvement Team (MERIT): Use of medical emergency team responses to reduce hospital cardiopulmonary arrests. Qual Saf Health Care. 2004, 13 (4): 251-254. 10.1136/qshc.2003.006585.CrossRefPubMedPubMedCentral DeVita MA, Braithwaite RS, Mahidhara R, Stuart S, Foraida M, Simmons RL, Medical Emergency Response Improvement Team (MERIT): Use of medical emergency team responses to reduce hospital cardiopulmonary arrests. Qual Saf Health Care. 2004, 13 (4): 251-254. 10.1136/qshc.2003.006585.CrossRefPubMedPubMedCentral
24.
go back to reference Kenward G, Castle N, Hodgetts TJ, Shaikh L: Evaluation of a Medical Emergency Team one year after implementation. Resuscitation. 2004, 61: 257-263. 10.1016/j.resuscitation.2004.01.021.CrossRefPubMed Kenward G, Castle N, Hodgetts TJ, Shaikh L: Evaluation of a Medical Emergency Team one year after implementation. Resuscitation. 2004, 61: 257-263. 10.1016/j.resuscitation.2004.01.021.CrossRefPubMed
25.
go back to reference Leary T, Ridley S: Impact of an outreach team on re-admissions to a critical care unit. Anaesthesia. 2003, 58 (4): 328-332. 10.1046/j.1365-2044.2003.03077.x.CrossRefPubMed Leary T, Ridley S: Impact of an outreach team on re-admissions to a critical care unit. Anaesthesia. 2003, 58 (4): 328-332. 10.1046/j.1365-2044.2003.03077.x.CrossRefPubMed
26.
go back to reference Pittard AJ: Out of our reach? Assessing the impact of introducing a critical care outreach service. Anaesthesia. 2003, 58 (9): 882-885. 10.1046/j.1365-2044.2003.03331.x.CrossRefPubMed Pittard AJ: Out of our reach? Assessing the impact of introducing a critical care outreach service. Anaesthesia. 2003, 58 (9): 882-885. 10.1046/j.1365-2044.2003.03331.x.CrossRefPubMed
27.
go back to reference The MERIT investigators: Introduction of medical emergency team (MET) system - a cluster-randomised controlled trial. Lancet. 2005, 365: 2091-2097. 10.1016/S0140-6736(05)66733-5.CrossRef The MERIT investigators: Introduction of medical emergency team (MET) system - a cluster-randomised controlled trial. Lancet. 2005, 365: 2091-2097. 10.1016/S0140-6736(05)66733-5.CrossRef
28.
go back to reference Williams S, Schmaltz SP, Morton DJ, Koss RG, Loeb JM: Quality of Care in U.S. Hospitals as Reflected by Standardized Measures, 2002-2004. The New England Journal of Medicine. 2005, 353: 255-264. 10.1056/NEJMsa043778.CrossRefPubMed Williams S, Schmaltz SP, Morton DJ, Koss RG, Loeb JM: Quality of Care in U.S. Hospitals as Reflected by Standardized Measures, 2002-2004. The New England Journal of Medicine. 2005, 353: 255-264. 10.1056/NEJMsa043778.CrossRefPubMed
29.
go back to reference Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M: Analysis of cluster randomized trials in primary care: a practical approach. Family Practice. 2000, 17 (2): 192-196. 10.1093/fampra/17.2.192.CrossRefPubMed Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M: Analysis of cluster randomized trials in primary care: a practical approach. Family Practice. 2000, 17 (2): 192-196. 10.1093/fampra/17.2.192.CrossRefPubMed
30.
go back to reference Kerry M, Bland JM: Analysis of a trial randomized in clusters. Br Med J. 1998, 316: 54-54.CrossRef Kerry M, Bland JM: Analysis of a trial randomized in clusters. Br Med J. 1998, 316: 54-54.CrossRef
31.
go back to reference Long J, Ervin L: Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model. The American Statistician. 2000, 217-224. 10.2307/2685594. 54 Long J, Ervin L: Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model. The American Statistician. 2000, 217-224. 10.2307/2685594. 54
32.
go back to reference MacKinnon JG, White H: Some heteroskedasticity consistent covariance matrix estimators with improved finite sample properties. Journal of Econometrics. 1985, 29: 305-325. 10.1016/0304-4076(85)90158-7.CrossRef MacKinnon JG, White H: Some heteroskedasticity consistent covariance matrix estimators with improved finite sample properties. Journal of Econometrics. 1985, 29: 305-325. 10.1016/0304-4076(85)90158-7.CrossRef
33.
go back to reference StataCorp: Stata statistical software: Release 8.2. 2004, College Station, Texas: Stata Corporation StataCorp: Stata statistical software: Release 8.2. 2004, College Station, Texas: Stata Corporation
34.
go back to reference Winters BD, Pham J, Pronovost PJ: Rapid Response Teams - Walk, Don't Run. JAMA. 2006, 296 (13): 1646-1647. 10.1001/jama.296.13.1645.CrossRef Winters BD, Pham J, Pronovost PJ: Rapid Response Teams - Walk, Don't Run. JAMA. 2006, 296 (13): 1646-1647. 10.1001/jama.296.13.1645.CrossRef
36.
go back to reference Vickters A, Altman D: Statistical notes: Analysing controlled trials with baseline and followup measurements. BMJ. 2001, 323 (7321): 1123-1124. 10.1136/bmj.323.7321.1123.CrossRef Vickters A, Altman D: Statistical notes: Analysing controlled trials with baseline and followup measurements. BMJ. 2001, 323 (7321): 1123-1124. 10.1136/bmj.323.7321.1123.CrossRef
37.
go back to reference Morton V, Gorgerson DJ: Effect of regression to the mean on decision making in health care. BMJ. 2003, 1083-1084. 10.1136/bmj.326.7398.1083. 326 Morton V, Gorgerson DJ: Effect of regression to the mean on decision making in health care. BMJ. 2003, 1083-1084. 10.1136/bmj.326.7398.1083. 326
38.
go back to reference Bland JM, Altman DA: Statistical Notes: regressiontowards the mean. BMJ. 1994, 1499-308 Bland JM, Altman DA: Statistical Notes: regressiontowards the mean. BMJ. 1994, 1499-308
Metadata
Title
Baseline hospital performance and the impact of medical emergency teams: Modelling vs. conventional subgroup analysis
Authors
Jack Chen
Arthas Flabouris
Rinaldo Bellomo
Ken Hillman
Simon Finfer
MERIT investigators for the Simpson Centre and the ANZICS Clinical Trial Group
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Trials / Issue 1/2009
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-10-117

Other articles of this Issue 1/2009

Trials 1/2009 Go to the issue