Skip to main content
Top
Published in: Techniques in Coloproctology 6/2016

01-06-2016 | Original Article

Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgery

Authors: J. D. Foster, D. Miskovic, A. S. Allison, J. A. Conti, J. Ockrim, E. J. Cooper, G. B. Hanna, N. K. Francis

Published in: Techniques in Coloproctology | Issue 6/2016

Login to get access

Abstract

Background

Laparoscopic rectal resection is technically challenging, with outcomes dependent upon technical performance. No robust objective assessment tool exists for laparoscopic rectal resection surgery. This study aimed to investigate the application of the objective clinical human reliability analysis (OCHRA) technique for assessing technical performance of laparoscopic rectal surgery and explore the validity and reliability of this technique.

Methods

Laparoscopic rectal cancer resection operations were described in the format of a hierarchical task analysis. Potential technical errors were defined. The OCHRA technique was used to identify technical errors enacted in videos of twenty consecutive laparoscopic rectal cancer resection operations from a single site. The procedural task, spatial location, and circumstances of all identified errors were logged. Clinical validity was assessed through correlation with clinical outcomes; reliability was assessed by test–retest.

Results

A total of 335 execution errors identified, with a median 15 per operation. More errors were observed during pelvic tasks compared with abdominal tasks (p < 0.001). Within the pelvis, more errors were observed during dissection on the right side than the left (p = 0.03). Test–retest confirmed reliability (r = 0.97, p < 0.001). A significant correlation was observed between error frequency and mesorectal specimen quality (r s = 0.52, p = 0.02) and with blood loss (r s = 0.609, p = 0.004).

Conclusions

OCHRA offers a valid and reliable method for evaluating technical performance of laparoscopic rectal surgery.
Literature
1.
go back to reference Jeong SY, Park JW, Nam BH et al (2014) Open versus laparoscopic surgery for mid-rectal or low-rectal cancer after neoadjuvant chemoradiotherapy (COREAN trial): survival outcomes of an open-label, non-inferiority, randomised controlled trial. Lancet Oncol 15:767–774CrossRefPubMed Jeong SY, Park JW, Nam BH et al (2014) Open versus laparoscopic surgery for mid-rectal or low-rectal cancer after neoadjuvant chemoradiotherapy (COREAN trial): survival outcomes of an open-label, non-inferiority, randomised controlled trial. Lancet Oncol 15:767–774CrossRefPubMed
2.
go back to reference Bonjer HJ, Deijen CL, Haglind E; COLOR II Study Group (2015) A randomized trial of laparoscopic versus open surgery for rectal cancer. N Engl J Med 373:194 Bonjer HJ, Deijen CL, Haglind E; COLOR II Study Group (2015) A randomized trial of laparoscopic versus open surgery for rectal cancer. N Engl J Med 373:194
3.
go back to reference Fleshman J, Branda M, Sargent DJ et al (2015) Effect of laparoscopic-assisted resection vs open resection of stage II or III rectal cancer on pathologic outcomes: the ACOSOG Z6051 randomized clinical trial. JAMA 314:1346–1355CrossRefPubMed Fleshman J, Branda M, Sargent DJ et al (2015) Effect of laparoscopic-assisted resection vs open resection of stage II or III rectal cancer on pathologic outcomes: the ACOSOG Z6051 randomized clinical trial. JAMA 314:1346–1355CrossRefPubMed
4.
go back to reference Stevenson AR, Solomon MJ, Lumley JW et al (2015) Effect of laparoscopic-assisted resection vs open resection on pathological outcomes in rectal cancer: the ALaCaRT randomized clinical trial. JAMA 314:1356–1363CrossRefPubMed Stevenson AR, Solomon MJ, Lumley JW et al (2015) Effect of laparoscopic-assisted resection vs open resection on pathological outcomes in rectal cancer: the ALaCaRT randomized clinical trial. JAMA 314:1356–1363CrossRefPubMed
5.
go back to reference Mackenzie H, Miskovic D, Ni M et al (2013) Clinical and educational proficiency gain of supervised laparoscopic colorectal surgical trainees. Surg Endosc 27:2704–2711CrossRefPubMed Mackenzie H, Miskovic D, Ni M et al (2013) Clinical and educational proficiency gain of supervised laparoscopic colorectal surgical trainees. Surg Endosc 27:2704–2711CrossRefPubMed
6.
go back to reference Quirke P, Steele R, Monson J, NCRI Colorectal Cancer Study Group et al (2009) Effect of the plane of surgery achieved on local recurrence in patients with operable rectal cancer: a prospective study using data from the MRC CR07 and NCIC-CTG CO16 randomised clinical trial. Lancet 373:821–828CrossRefPubMedPubMedCentral Quirke P, Steele R, Monson J, NCRI Colorectal Cancer Study Group et al (2009) Effect of the plane of surgery achieved on local recurrence in patients with operable rectal cancer: a prospective study using data from the MRC CR07 and NCIC-CTG CO16 randomised clinical trial. Lancet 373:821–828CrossRefPubMedPubMedCentral
7.
go back to reference Martling AL, Holm T, Rutqvist LE, Moran BJ, Heald RJ, Cedemark B (2000) Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Stockholm Colorectal Cancer Study Group. Basingstoke Bowel Cancer Research Project. Lancet 356:93–96CrossRefPubMed Martling AL, Holm T, Rutqvist LE, Moran BJ, Heald RJ, Cedemark B (2000) Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Stockholm Colorectal Cancer Study Group. Basingstoke Bowel Cancer Research Project. Lancet 356:93–96CrossRefPubMed
8.
go back to reference Nagtegaal ID, van de Velde CJ, van der Worp E, Kapiteijn E, Quirke P, van Krieken JH (2002) Macroscopic evaluation of rectal cancer resection specimen: clinical significance of the pathologist in quality control. J Clin Oncol 20:1729–1734CrossRefPubMed Nagtegaal ID, van de Velde CJ, van der Worp E, Kapiteijn E, Quirke P, van Krieken JH (2002) Macroscopic evaluation of rectal cancer resection specimen: clinical significance of the pathologist in quality control. J Clin Oncol 20:1729–1734CrossRefPubMed
9.
go back to reference Foster JD, Francis NK (2015) Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools? Tech Coloproctol 19:1–4CrossRefPubMed Foster JD, Francis NK (2015) Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools? Tech Coloproctol 19:1–4CrossRefPubMed
10.
go back to reference Cuschieri A (2005) Reducing errors in the operating room. Surgical proficiency and quality assurance of execution. Surg Endosc 19:1022–1027CrossRefPubMed Cuschieri A (2005) Reducing errors in the operating room. Surgical proficiency and quality assurance of execution. Surg Endosc 19:1022–1027CrossRefPubMed
11.
go back to reference Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29:409–414CrossRefPubMed Joice P, Hanna GB, Cuschieri A (1998) Errors enacted during endoscopic surgery—a human reliability analysis. Appl Ergon 29:409–414CrossRefPubMed
12.
go back to reference Miskovic D, Ni M, Wyles SM, Parvaiz A, Hanna GB (2012) Observational clinical human reliability analysis (OCHRA) for competency assessment in laparoscopic colorectal surgery at the specialist level. Surg Endosc 26:796–803CrossRefPubMed Miskovic D, Ni M, Wyles SM, Parvaiz A, Hanna GB (2012) Observational clinical human reliability analysis (OCHRA) for competency assessment in laparoscopic colorectal surgery at the specialist level. Surg Endosc 26:796–803CrossRefPubMed
13.
go back to reference Tang B, Hanna GB, Bax NM, Cuschieri A (2004) Analysis of technical surgical errors during initial experience of laparoscopic pyloromyotomy by a group of Dutch pediatric surgeons. Surg Endosc 18:1716–1720CrossRefPubMed Tang B, Hanna GB, Bax NM, Cuschieri A (2004) Analysis of technical surgical errors during initial experience of laparoscopic pyloromyotomy by a group of Dutch pediatric surgeons. Surg Endosc 18:1716–1720CrossRefPubMed
14.
go back to reference Miskovic D, Foster JD, Agha A et al (2015) Standardisation of laparoscopic total mesorectal excision for rectal cancer—a structured international expert consensus. Ann Surg 261:716–722CrossRefPubMed Miskovic D, Foster JD, Agha A et al (2015) Standardisation of laparoscopic total mesorectal excision for rectal cancer—a structured international expert consensus. Ann Surg 261:716–722CrossRefPubMed
15.
go back to reference Foster JD, Gash KJ, Carter FJ et al (2014) Development and evaluation of a cadaveric training curriculum for low rectal cancer surgery in the English Lorec National Development Programme. Colorectal Dis 16:O308–O319CrossRefPubMed Foster JD, Gash KJ, Carter FJ et al (2014) Development and evaluation of a cadaveric training curriculum for low rectal cancer surgery in the English Lorec National Development Programme. Colorectal Dis 16:O308–O319CrossRefPubMed
16.
go back to reference Holm T, Ljung A, Häggmark T, Jurell G, Lagergren J (2007) Extended abdominoperineal resection with gluteus maximus flap reconstruction of the pelvic floor for rectal cancer. Br J Surg 94:232–238CrossRefPubMed Holm T, Ljung A, Häggmark T, Jurell G, Lagergren J (2007) Extended abdominoperineal resection with gluteus maximus flap reconstruction of the pelvic floor for rectal cancer. Br J Surg 94:232–238CrossRefPubMed
17.
go back to reference Wilson PJ (2012) Use of human reliability analysis to evaluate surgical technique for rectal cancer. University of Dundee, PhD Thesis Wilson PJ (2012) Use of human reliability analysis to evaluate surgical technique for rectal cancer. University of Dundee, PhD Thesis
18.
go back to reference Tang B, Hanna GB, Joice P, Cuschieri A (2004) Identification and categorization of technical errors by Observational Clinical Human Reliability Assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139:1215–1220CrossRefPubMed Tang B, Hanna GB, Joice P, Cuschieri A (2004) Identification and categorization of technical errors by Observational Clinical Human Reliability Assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139:1215–1220CrossRefPubMed
19.
go back to reference Tang B, Hanna GB, Cuschieri A (2005) Analysis of errors enacted by surgical trainees during skills training courses. Surgery 138:14–20CrossRefPubMed Tang B, Hanna GB, Cuschieri A (2005) Analysis of errors enacted by surgical trainees during skills training courses. Surgery 138:14–20CrossRefPubMed
20.
go back to reference Williams GT, Quirke P, Shepherd NA (2007) Minimum dataset for colorectal cancer. Histopathology Reports (2nd edn). Royal College of Pathologists, London Williams GT, Quirke P, Shepherd NA (2007) Minimum dataset for colorectal cancer. Histopathology Reports (2nd edn). Royal College of Pathologists, London
21.
go back to reference Munz Y, Moorthy K, Bann S, Shah J, Ivanova S, Darzi SA (2004) Ceiling effect in technical skills of surgical residents. Am J Surg 188:294–300CrossRefPubMed Munz Y, Moorthy K, Bann S, Shah J, Ivanova S, Darzi SA (2004) Ceiling effect in technical skills of surgical residents. Am J Surg 188:294–300CrossRefPubMed
22.
go back to reference Hanna GB, Shimi S, Cuschieri A (1997) Optimal port locations for endoscopic intracorporeal knotting. Surg Endosc 11:397–401CrossRefPubMed Hanna GB, Shimi S, Cuschieri A (1997) Optimal port locations for endoscopic intracorporeal knotting. Surg Endosc 11:397–401CrossRefPubMed
23.
go back to reference Collinson FJ, Jayne DG, Pigazzi A et al (2012) An international, multicentre, prospective, randomised, controlled, unblinded, parallel-group trial of robotic-assisted versus standard laparoscopic surgery for the curative treatment of rectal cancer. Int J Colorectal Dis 27:233–241CrossRefPubMed Collinson FJ, Jayne DG, Pigazzi A et al (2012) An international, multicentre, prospective, randomised, controlled, unblinded, parallel-group trial of robotic-assisted versus standard laparoscopic surgery for the curative treatment of rectal cancer. Int J Colorectal Dis 27:233–241CrossRefPubMed
Metadata
Title
Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgery
Authors
J. D. Foster
D. Miskovic
A. S. Allison
J. A. Conti
J. Ockrim
E. J. Cooper
G. B. Hanna
N. K. Francis
Publication date
01-06-2016
Publisher
Springer Milan
Published in
Techniques in Coloproctology / Issue 6/2016
Print ISSN: 1123-6337
Electronic ISSN: 1128-045X
DOI
https://doi.org/10.1007/s10151-016-1444-4

Other articles of this Issue 6/2016

Techniques in Coloproctology 6/2016 Go to the issue