Skip to main content
Top
Published in: Gynecological Surgery 1/2017

Open Access 01-12-2017 | Original Article

Applying a statistical method in transvaginal ultrasound training: lessons from the learning curve cumulative summation test (LC-CUSUM) for endometriosis mapping

Authors: Vered H. Eisenberg, Juan L. Alcazar, Nissim Arbib, Eyal Schiff, Reuven Achiron, Motti Goldenberg, David Soriano

Published in: Gynecological Surgery | Issue 1/2017

Login to get access

Abstract

Background

Methods available for assessing the learning curve, such as a predefined number of procedures or direct mentoring are lacking. Our aim was to describe the use of a statistical method to identify the minimal training length of an experienced sonographer, newly trained in deep infiltrating endometriosis (DIE) mapping by evaluating the learning curve of transvaginal ultrasound (TVUS) in the preoperative assessment of endometriosis.

Methods

A retrospective study in a tertiary referral center for endometriosis. Reports and stored data from TVUS scans performed by one operator with training in general gynecological ultrasound, but not in endometriosis mapping, were analyzed retrospectively for patients who subsequently underwent laparoscopy, which served as a reference standard. The performance of TVUS was assessed for the following sites: endometriomas, bladder, vagina, pouch of Douglas, bowel and uterosacral ligaments, and correlated with laparoscopic findings. Sensitivity, specificity, PPV, NPV, and accuracy were calculated, and the operator’s diagnostic performance was assessed using the learning curve cumulative summation test (LC-CUSUM).

Results

Data from 94 women were available for analysis. The learning curve using the LC-CUSUM graph showed that the sonographer reached the predefined level of proficiency in detecting endometriosis lesions after 20, 26, 32, 31, 38, and 44 examinations for endometriomas, bladder nodules, vaginal nodules, pouch of Douglas obliteration, bowel nodules, and uterosacral ligament nodules, respectively.

Conclusions

LC-CUSUM allows monitoring of individual performance during the learning process of new methodologies. This study shows that a sonographer trained in general gynecologic ultrasonography, who devotes time to learn TVUS for DIE mapping, can achieve proficiency for diagnosing the major types of endometriotic lesions after examining less than 50 patients who subsequently undergo surgery in a training setting.
Appendix
Available only for authorised users
Literature
1.
go back to reference Melis GB, Ajossa S, Guerriero S et al (1994) Epidemiology and diagnosis of endometriosis. Ann N Y Acad Sci 734:352–357CrossRefPubMed Melis GB, Ajossa S, Guerriero S et al (1994) Epidemiology and diagnosis of endometriosis. Ann N Y Acad Sci 734:352–357CrossRefPubMed
2.
go back to reference Dmowski WP, Lesniewicz R, Rana N, Pepping P, Noursalehi M (1997) Changing trends in the diagnosis of endometriosis: a comparative study of women with pelvic endometriosis presenting with chronic pelvic pain or infertility. Fertil Steril 67:238–243CrossRefPubMed Dmowski WP, Lesniewicz R, Rana N, Pepping P, Noursalehi M (1997) Changing trends in the diagnosis of endometriosis: a comparative study of women with pelvic endometriosis presenting with chronic pelvic pain or infertility. Fertil Steril 67:238–243CrossRefPubMed
3.
go back to reference Bazot M, Thomassin I, Hourani R, Cortez A, Darai E (2004) Diagnostic accuracy of transvaginal sonography for deep pelvic endometriosis. Ultrasound Obstet Gynecol 24:180–185CrossRefPubMed Bazot M, Thomassin I, Hourani R, Cortez A, Darai E (2004) Diagnostic accuracy of transvaginal sonography for deep pelvic endometriosis. Ultrasound Obstet Gynecol 24:180–185CrossRefPubMed
4.
go back to reference Bazot M, Darai E, Biau DJ, Ballester M, Dessolle L (2011) Learning curve of transvaginal ultrasound for the diagnosis of endometriomas assessed by the cumulative summation test (LC-CUSUM). Fertil Steril 95:301–303CrossRefPubMed Bazot M, Darai E, Biau DJ, Ballester M, Dessolle L (2011) Learning curve of transvaginal ultrasound for the diagnosis of endometriomas assessed by the cumulative summation test (LC-CUSUM). Fertil Steril 95:301–303CrossRefPubMed
5.
go back to reference Ballard K, Lowton K, Wright J (2006) What’s the delay? A qualitative study of women’s experiences of reaching a diagnosis of endometriosis. Fertil Steril and agreement with endometriosis findings at laparoscopyand agreement with endometriosis findings at laparoscopy 86:1296–1301 Ballard K, Lowton K, Wright J (2006) What’s the delay? A qualitative study of women’s experiences of reaching a diagnosis of endometriosis. Fertil Steril and agreement with endometriosis findings at laparoscopyand agreement with endometriosis findings at laparoscopy 86:1296–1301
6.
go back to reference Hudelist G, Fritzer N, Thomas A et al (2012) Diagnostic delay for endometriosis in Austria and Germany: causes and possible consequences. Hum Reprod 27:3412–3416CrossRefPubMed Hudelist G, Fritzer N, Thomas A et al (2012) Diagnostic delay for endometriosis in Austria and Germany: causes and possible consequences. Hum Reprod 27:3412–3416CrossRefPubMed
7.
go back to reference Nnoaham KE, Hummelshoj L, Webster P et al (2011) World Endometriosis Research Foundation Global Study of Women’s Health consortium. Impact of endometriosis on quality of life and work productivity: a multicenter study across ten countries. Fertil Steril 96:366–373CrossRefPubMedPubMedCentral Nnoaham KE, Hummelshoj L, Webster P et al (2011) World Endometriosis Research Foundation Global Study of Women’s Health consortium. Impact of endometriosis on quality of life and work productivity: a multicenter study across ten countries. Fertil Steril 96:366–373CrossRefPubMedPubMedCentral
8.
go back to reference Tammaa A, Fritzer N, Strunk G, Krell A, Salzer H, Hudelist G (2014) Learning curve for the detection of pouch of Douglas obliteration and deep infiltrating endometriosis of the rectum. Hum Reprod 29:1199–1204CrossRefPubMed Tammaa A, Fritzer N, Strunk G, Krell A, Salzer H, Hudelist G (2014) Learning curve for the detection of pouch of Douglas obliteration and deep infiltrating endometriosis of the rectum. Hum Reprod 29:1199–1204CrossRefPubMed
9.
go back to reference Piketty M, Chopin N, Dousset B et al (2009) Preoperative work-up for patients with deeply infiltrating endometriosis: transvaginal ultrasonography must definitely be the first-line imaging examination. Hum Reprod 24:602–607CrossRefPubMed Piketty M, Chopin N, Dousset B et al (2009) Preoperative work-up for patients with deeply infiltrating endometriosis: transvaginal ultrasonography must definitely be the first-line imaging examination. Hum Reprod 24:602–607CrossRefPubMed
10.
go back to reference Hudelist G, Ballard K, English J et al (2011) Transvaginal sonography vs. clinical examination in the preoperative diagnosis of deep infiltrating endometriosis. Ultrasound Obstet Gynecol 37:480–487CrossRefPubMed Hudelist G, Ballard K, English J et al (2011) Transvaginal sonography vs. clinical examination in the preoperative diagnosis of deep infiltrating endometriosis. Ultrasound Obstet Gynecol 37:480–487CrossRefPubMed
11.
go back to reference Hudelist G, English J, Thomas A, Tinelli A, Singer CF, Keckstein J (2011) Diagnostic accuracy of transvaginal ultrasound for non-invasive diagnosis of bowel endometriosis: systematic review and meta-analysis. Ultrasound Obstet Gynecol 37:257–263CrossRefPubMed Hudelist G, English J, Thomas A, Tinelli A, Singer CF, Keckstein J (2011) Diagnostic accuracy of transvaginal ultrasound for non-invasive diagnosis of bowel endometriosis: systematic review and meta-analysis. Ultrasound Obstet Gynecol 37:257–263CrossRefPubMed
12.
go back to reference Alcazar JL, Laparte C, Jurado M, Lopez-Garcia G (1997) The role of transvaginal ultrasonography combined with color velocity imaging and pulse Doppler in the diagnosis of endometrioma. Fertil Steril 67:487–491CrossRefPubMed Alcazar JL, Laparte C, Jurado M, Lopez-Garcia G (1997) The role of transvaginal ultrasonography combined with color velocity imaging and pulse Doppler in the diagnosis of endometrioma. Fertil Steril 67:487–491CrossRefPubMed
13.
go back to reference Van Holsbeke C, Van Calster B, Guerriero M et al (2009) Imaging in gynaecology: how good are we in identifying endometriomas? Facts Views Vis ObGyn 1:7–17PubMedPubMedCentral Van Holsbeke C, Van Calster B, Guerriero M et al (2009) Imaging in gynaecology: how good are we in identifying endometriomas? Facts Views Vis ObGyn 1:7–17PubMedPubMedCentral
14.
go back to reference Abrao MS, Gonçalves MO, Dias JA Jr, Podgaec S, Chamie LP, Blasbalg R (2007) Comparison between clinical examination, transvaginal sonography and magnetic resonance imaging for the diagnosis of deep endometriosis. Hum Reprod 22:3092–3097CrossRefPubMed Abrao MS, Gonçalves MO, Dias JA Jr, Podgaec S, Chamie LP, Blasbalg R (2007) Comparison between clinical examination, transvaginal sonography and magnetic resonance imaging for the diagnosis of deep endometriosis. Hum Reprod 22:3092–3097CrossRefPubMed
15.
go back to reference Wohl H (1977) The cusum plot: Its’ utility in the analysis of clinical data. N Engl J Med 296:1044–1045CrossRefPubMed Wohl H (1977) The cusum plot: Its’ utility in the analysis of clinical data. N Engl J Med 296:1044–1045CrossRefPubMed
16.
go back to reference Biau DJ, Porcher R, Salomon LJ (2008) CUSUM: a tool for ongoing assessment of performance. Ultrasound Obstet Gynecol 31:252–255CrossRefPubMed Biau DJ, Porcher R, Salomon LJ (2008) CUSUM: a tool for ongoing assessment of performance. Ultrasound Obstet Gynecol 31:252–255CrossRefPubMed
17.
go back to reference Biau DJ, Williams SM, Schlup MM, Nizard RS, Porcher R (2008) Quantitative and individualized assessment of the learning curve using LC-CUSUM. Br J Surg 95:925–929CrossRefPubMed Biau DJ, Williams SM, Schlup MM, Nizard RS, Porcher R (2008) Quantitative and individualized assessment of the learning curve using LC-CUSUM. Br J Surg 95:925–929CrossRefPubMed
18.
go back to reference Van Holsbeke C, Van Calster B, Guerriero S et al (2010) Endometriomas: their ultrasound characteristics. Ultrasound Obstet Gynecol 35:730–740PubMed Van Holsbeke C, Van Calster B, Guerriero S et al (2010) Endometriomas: their ultrasound characteristics. Ultrasound Obstet Gynecol 35:730–740PubMed
19.
go back to reference Guerriero S, Ajossa S, Mais V, Risalvato A, Lai MP, Melis GB (1998) The diagnosis of endometriomas using colour Doppler energy imaging. Hum Reprod 13:1691–1695CrossRefPubMed Guerriero S, Ajossa S, Mais V, Risalvato A, Lai MP, Melis GB (1998) The diagnosis of endometriomas using colour Doppler energy imaging. Hum Reprod 13:1691–1695CrossRefPubMed
20.
go back to reference Exacoustos C, Malzoni M, Di Giovanni A et al (2014) Ultrasound mapping system for the surgical management of deep infiltrating endometriosis. Fertil Steril 102:143–150CrossRefPubMed Exacoustos C, Malzoni M, Di Giovanni A et al (2014) Ultrasound mapping system for the surgical management of deep infiltrating endometriosis. Fertil Steril 102:143–150CrossRefPubMed
21.
go back to reference Hudelist G, Fritzer N, Staettner S et al (2013) Uterine sliding sign: a simple sonographic predictor for presence of deep infiltrating endometriosis of the rectum. Ultrasound Obstet Gynecol 41:692–695CrossRefPubMed Hudelist G, Fritzer N, Staettner S et al (2013) Uterine sliding sign: a simple sonographic predictor for presence of deep infiltrating endometriosis of the rectum. Ultrasound Obstet Gynecol 41:692–695CrossRefPubMed
22.
go back to reference Reid S, Lu C, Casikar I et al (2013) Prediction of pouch of Douglas obliteration in women with suspected endometriosis using a new real-time dynamic transvaginal ultrasound technique: the sliding sign. Ultrasound Obstet Gynecol 41:685–691CrossRefPubMed Reid S, Lu C, Casikar I et al (2013) Prediction of pouch of Douglas obliteration in women with suspected endometriosis using a new real-time dynamic transvaginal ultrasound technique: the sliding sign. Ultrasound Obstet Gynecol 41:685–691CrossRefPubMed
23.
go back to reference American Society for Reproductive Medicine (1997) Revised American Society for Reproductive Medicine Classification of endometriosis. Am Soc Reprod Med 5:817–821 American Society for Reproductive Medicine (1997) Revised American Society for Reproductive Medicine Classification of endometriosis. Am Soc Reprod Med 5:817–821
24.
go back to reference Alcázar JL, Guerriero S, Laparte C, Ajossa S, Ruiz-Zambrana A, Melis GB (2011) Diagnostic performance of transvaginal gray-scale ultrasound for specific diagnosis of benign ovarian cysts in relation to menopausal status. Maturitas 68:182–188CrossRefPubMed Alcázar JL, Guerriero S, Laparte C, Ajossa S, Ruiz-Zambrana A, Melis GB (2011) Diagnostic performance of transvaginal gray-scale ultrasound for specific diagnosis of benign ovarian cysts in relation to menopausal status. Maturitas 68:182–188CrossRefPubMed
25.
go back to reference Guerriero S, Ajossa S, Minguez JA et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in uterosacral ligaments, rectovaginal septum, vagina and bladder: systematic review and meta-analysis. Ultrasound Obstet Gynecol 46:534–545CrossRefPubMed Guerriero S, Ajossa S, Minguez JA et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in uterosacral ligaments, rectovaginal septum, vagina and bladder: systematic review and meta-analysis. Ultrasound Obstet Gynecol 46:534–545CrossRefPubMed
26.
go back to reference Guerriero S, Ajossa S, Orozco R et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in the rectosigmoid: systematic review and meta-analysis. Ultrasound Obstet Gynecol 47:281–289CrossRefPubMed Guerriero S, Ajossa S, Orozco R et al (2015) Accuracy of transvaginal ultrasound for diagnosis of deep endometriosis in the rectosigmoid: systematic review and meta-analysis. Ultrasound Obstet Gynecol 47:281–289CrossRefPubMed
27.
go back to reference Saba L, Guerriero S, Sulis R et al (2011) Learning curve in the detection of ovarian and deep endometriosis by using Magnetic Resonance comparison with surgical results. Eur J Radiol 79:237–244CrossRefPubMed Saba L, Guerriero S, Sulis R et al (2011) Learning curve in the detection of ovarian and deep endometriosis by using Magnetic Resonance comparison with surgical results. Eur J Radiol 79:237–244CrossRefPubMed
28.
go back to reference Alcazar JL, Diaz L, Florez P, Guerriero S, Jurado M (2013) Intensive training program for ultrasound diagnosis of adnexal masses: protocol and preliminary results. Ultrasound Obstet Gynecol 42:218–223CrossRefPubMed Alcazar JL, Diaz L, Florez P, Guerriero S, Jurado M (2013) Intensive training program for ultrasound diagnosis of adnexal masses: protocol and preliminary results. Ultrasound Obstet Gynecol 42:218–223CrossRefPubMed
29.
go back to reference Piessens S, Healey M, Maher P, Tsaltas J, Rombauts L (2014) Can anyone screen for deep infiltrating endometriosis with transvaginal ultrasound? Aust N Z J Obstet Gynaecol 54:462–468CrossRefPubMed Piessens S, Healey M, Maher P, Tsaltas J, Rombauts L (2014) Can anyone screen for deep infiltrating endometriosis with transvaginal ultrasound? Aust N Z J Obstet Gynaecol 54:462–468CrossRefPubMed
30.
go back to reference Guerriero S, Condous G, Van Den Bosch T et al (2016) Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: a consensus opinion from the International Deep Endometriosis Analysis (IDEA) group. Ultrasound Obstet Gynecol. https://doi.org/10.1002/uog.15955 Guerriero S, Condous G, Van Den Bosch T et al (2016) Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: a consensus opinion from the International Deep Endometriosis Analysis (IDEA) group. Ultrasound Obstet Gynecol. https://​doi.​org/​10.​1002/​uog.​15955
Metadata
Title
Applying a statistical method in transvaginal ultrasound training: lessons from the learning curve cumulative summation test (LC-CUSUM) for endometriosis mapping
Authors
Vered H. Eisenberg
Juan L. Alcazar
Nissim Arbib
Eyal Schiff
Reuven Achiron
Motti Goldenberg
David Soriano
Publication date
01-12-2017
Publisher
Springer Berlin Heidelberg
Published in
Gynecological Surgery / Issue 1/2017
Print ISSN: 1613-2076
Electronic ISSN: 1613-2084
DOI
https://doi.org/10.1186/s10397-017-1022-4

Other articles of this Issue 1/2017

Gynecological Surgery 1/2017 Go to the issue