Skip to main content
Top
Published in: World Journal of Surgery 4/2015

01-04-2015 | Scientific Review

The Impact of Feedback of Surgical Outcome Data on Surgical Performance: A Systematic Review

Authors: Mahiben Maruthappu, Abhishek Trehan, Ashton Barnett-Vanes, Peter McCulloch, Matthew J. Carty

Published in: World Journal of Surgery | Issue 4/2015

Login to get access

Abstract

Background

Increasing patient demands, costs and emphasis on safety have led to performance tracking of individual surgeons. Several methods of using these data, including feedback have been proposed. Our aim was to systematically review the impact of feedback of outcome data to surgeons on their performance.

Study design

MEDLINE, Embase, PsycINFO, AMED and the Cochrane Database of Systematic Reviews (from their inception to February 2013) were searched. Two reviewers independently reviewed citations using predetermined inclusion and exclusion criteria. Forty two data-points per study were extracted.

Results

The search strategy yielded 1,531 citations. Seven studies were eligible comprising 18,632 cases or procedures by 52 surgeons. Overall, feedback was found to be a powerful method for improving surgical outcomes or indicators of surgical performance, including reductions in hospital mortality after CABG of 24 % (P = 0.001), decreases of stroke and mortality following carotid endarterectomy from 5.2 to 2.3 %, improved ovarian cancer resection from 77 to 85 % (P = 0.157) and reductions in wound infection rates from 14 to 10.3 %. Improvements in performance occurred in concert with reduced costs: for hepaticojejunostomy, implementation of feedback was associated with a decrease in overall hospital costs from $24,446 to $20,240 (P < 0.01). Similarly, total cost of carotid endarterectomy and following management decreased from $13,344 to $9548.

Conclusions

The available literature suggests that feedback can improve surgical performance and outcomes; however, given the heterogeneity and limited number of studies, in addition to their non-randomised nature, it is difficult to draw clear conclusions from the literature with regard to the efficacy of feedback and the specific nuances required to optimise the impact of feedback. There is a clear need for more rigorous studies to determine how feedback of outcome data may impact performance, and whether this low-cost intervention has potential to benefit surgical practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fraher EP, Knapton A, Sheldon GF, Meyer A, Ricketts TC (2013) Projecting surgeon supply using a dynamic model. Ann Surg 257(5):867–872CrossRefPubMed Fraher EP, Knapton A, Sheldon GF, Meyer A, Ricketts TC (2013) Projecting surgeon supply using a dynamic model. Ann Surg 257(5):867–872CrossRefPubMed
2.
go back to reference Lyu H, Wick EC, Housman M, Freischlag J, Makary MA (2013) Patient satisfaction as a possible indicator of quality surgical care. JAMA Surg 148(4):362–367CrossRefPubMed Lyu H, Wick EC, Housman M, Freischlag J, Makary MA (2013) Patient satisfaction as a possible indicator of quality surgical care. JAMA Surg 148(4):362–367CrossRefPubMed
3.
go back to reference Cooper M, Makary MA (2012) A comprehensive unit-based safety program (CUSP) in surgery: improving quality through transparency. Surg Clin North Am 92(1):51–63CrossRefPubMed Cooper M, Makary MA (2012) A comprehensive unit-based safety program (CUSP) in surgery: improving quality through transparency. Surg Clin North Am 92(1):51–63CrossRefPubMed
6.
go back to reference Godlee F (2012) Measure your team’s performance, and publish the results. BMJ 345:e4590CrossRef Godlee F (2012) Measure your team’s performance, and publish the results. BMJ 345:e4590CrossRef
8.
go back to reference Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, Chong V, Fabri PJ, Gibbs JO, Grover F, Hammermeister K, Irvin G 3rd, McDonald G, Passaro E Jr, Phillips L, Scamman F, Spencer J, Stremple Jf (1998) The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg 228(4):491–507CrossRefPubMedCentralPubMed Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, Chong V, Fabri PJ, Gibbs JO, Grover F, Hammermeister K, Irvin G 3rd, McDonald G, Passaro E Jr, Phillips L, Scamman F, Spencer J, Stremple Jf (1998) The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg 228(4):491–507CrossRefPubMedCentralPubMed
9.
go back to reference van de Ridder JM, Stokking KM, McGaghie WC, ten Cate OT (2008) What is feedback in clinical education? Med Educ 42(2):189–197CrossRefPubMed van de Ridder JM, Stokking KM, McGaghie WC, ten Cate OT (2008) What is feedback in clinical education? Med Educ 42(2):189–197CrossRefPubMed
10.
go back to reference Kluger A, DeNisi A (1996) The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull 119(2):254–284CrossRef Kluger A, DeNisi A (1996) The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull 119(2):254–284CrossRef
11.
go back to reference Bienstock JL, Katz NT, Cox SM, Hueppchen N, Erickson S, Puscheck EE et al (2007) To the point: medical education reviews—providing feedback. Am J Obstet Gynecol 196(6):508–513CrossRefPubMed Bienstock JL, Katz NT, Cox SM, Hueppchen N, Erickson S, Puscheck EE et al (2007) To the point: medical education reviews—providing feedback. Am J Obstet Gynecol 196(6):508–513CrossRefPubMed
13.
14.
go back to reference O’Connor GT, Plume SK, Olmstead EM, Morton JR, Maloney CT, Nugent WC et al (1996) A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. JAMA 275(11):841–846CrossRefPubMed O’Connor GT, Plume SK, Olmstead EM, Morton JR, Maloney CT, Nugent WC et al (1996) A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. JAMA 275(11):841–846CrossRefPubMed
15.
go back to reference Findlay JM, Nykolyn L, Lubkey TB, Wong JH, Mouradian M, Senthilselvan A (2002) Auditing carotid endarterectomy: a regional experience. Can J Neurol Sci 29(4):326–332CrossRefPubMed Findlay JM, Nykolyn L, Lubkey TB, Wong JH, Mouradian M, Senthilselvan A (2002) Auditing carotid endarterectomy: a regional experience. Can J Neurol Sci 29(4):326–332CrossRefPubMed
16.
go back to reference Olcott CIV, Mitchell RS, Steinberg GK, Zarins CK (2000) Institutional peer review can reduce the risk and cost of carotid endarterectomy. Arch Surg 135(8):939–942CrossRefPubMed Olcott CIV, Mitchell RS, Steinberg GK, Zarins CK (2000) Institutional peer review can reduce the risk and cost of carotid endarterectomy. Arch Surg 135(8):939–942CrossRefPubMed
17.
go back to reference Reilly J, McIntosh J, Currie K (2002) Changing surgical practice through feedback of performance data. J Adv Nurs 38(6):607–614CrossRefPubMed Reilly J, McIntosh J, Currie K (2002) Changing surgical practice through feedback of performance data. J Adv Nurs 38(6):607–614CrossRefPubMed
18.
go back to reference Rodriguez JF, Trobo AR, Garcia MV, Martinez MJ, Millan CP, Vazquez MC et al (2006) The effect of performance feedback on wound infection rate in abdominal hysterectomy. Am J Infect Control 34(4):182–187CrossRefPubMed Rodriguez JF, Trobo AR, Garcia MV, Martinez MJ, Millan CP, Vazquez MC et al (2006) The effect of performance feedback on wound infection rate in abdominal hysterectomy. Am J Infect Control 34(4):182–187CrossRefPubMed
19.
go back to reference Aletti GD, Dowdy SC, Gostout BS, Jones MB, Stanhope RC, Wilson TO et al (2009) Quality improvement in the surgical approach to advanced ovarian cancer: the Mayo Clinic experience. J Am Coll Surg 208(4):614–620CrossRefPubMed Aletti GD, Dowdy SC, Gostout BS, Jones MB, Stanhope RC, Wilson TO et al (2009) Quality improvement in the surgical approach to advanced ovarian cancer: the Mayo Clinic experience. J Am Coll Surg 208(4):614–620CrossRefPubMed
20.
go back to reference Pitt HA, Murray KP, Bowman HM, Coleman J, Gordon TA, Yeo CJ et al (1999) Clinical pathway implementation improves outcomes for complex biliary surgery. Surgery 126(4):751–756 discussion 756–8CrossRefPubMed Pitt HA, Murray KP, Bowman HM, Coleman J, Gordon TA, Yeo CJ et al (1999) Clinical pathway implementation improves outcomes for complex biliary surgery. Surgery 126(4):751–756 discussion 756–8CrossRefPubMed
21.
go back to reference Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB (2006) Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Med Teach 28(2):117–128CrossRefPubMed Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB (2006) Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Med Teach 28(2):117–128CrossRefPubMed
22.
go back to reference Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD (2006) Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care 15(6):433–436CrossRefPubMedCentralPubMed Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD (2006) Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care 15(6):433–436CrossRefPubMedCentralPubMed
23.
go back to reference Rogers DA, Regehr G, Howdieshell TR, Yeh KA, Palm E (2000) The impact of external feedback on computer-assisted learning for surgical technical skill training. Am J Surg 179(4):341–343CrossRefPubMed Rogers DA, Regehr G, Howdieshell TR, Yeh KA, Palm E (2000) The impact of external feedback on computer-assisted learning for surgical technical skill training. Am J Surg 179(4):341–343CrossRefPubMed
24.
go back to reference Miller DC, Murtagh DS, Suh RS, Knapp PM, Schuster TG, Dunn RL et al (2011) Regional collaboration to improve radiographic staging practices among men with early stage prostate cancer. J Urol 186(3):844–849CrossRefPubMed Miller DC, Murtagh DS, Suh RS, Knapp PM, Schuster TG, Dunn RL et al (2011) Regional collaboration to improve radiographic staging practices among men with early stage prostate cancer. J Urol 186(3):844–849CrossRefPubMed
25.
go back to reference Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. (2009) Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev (2):CD003030 Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. (2009) Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev (2):CD003030
Metadata
Title
The Impact of Feedback of Surgical Outcome Data on Surgical Performance: A Systematic Review
Authors
Mahiben Maruthappu
Abhishek Trehan
Ashton Barnett-Vanes
Peter McCulloch
Matthew J. Carty
Publication date
01-04-2015
Publisher
Springer US
Published in
World Journal of Surgery / Issue 4/2015
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-014-2897-0

Other articles of this Issue 4/2015

World Journal of Surgery 4/2015 Go to the issue