Skip to main content
Top
Published in: Archives of Gynecology and Obstetrics 6/2012

01-06-2012 | General Gynecology

Subjective assessment of ovarian masses using pattern recognition: the impact of experience on diagnostic performance and interobserver variability

Authors: Florian Faschingbauer, Michaela Benz, Lothar Häberle, Tamme W. Goecke, Matthias W. Beckmann, Stefan Renner, Andreas Müller, Thomas Wittenberg, Christian Münzenmayer

Published in: Archives of Gynecology and Obstetrics | Issue 6/2012

Login to get access

Abstract

Purpose

To compare diagnostic performance and interobserver variability in a group of 36 examiners, with four different levels of experience.

Methods

Nine junior trainees, eight level I senior trainees, 11 level II senior gynecologists, and eight level III expert sonologists classified 105 ultrasound images of adnexal masses into three subgroups of ovarian lesions (malignancies, functional cysts, and dermoid cysts).

Results

The level III sonologists obtained the best diagnostic results together with the lowest interobserver variability (κ = 0.70, SD = 0.04). They achieved significantly better results in comparison with the junior trainees and also the senior trainees (κ = 0.51, SD = 0.12, p < 0.001; and κ = 0.51, SD = 0.09, p < 0.001). Differences between level III sonologists and the group of level II observers did not reach statistical significance (κ = 0.65, SD = 0.09, p = 0.70). There were no significant differences between senior and junior trainees (p = 1.0) and both groups achieved a significantly poorer diagnostic performance in comparison with the level II observers (p < 0.01 and p < 0.01). For all observers, the largest differences were seen for classifying malignancies, the best results for classifying functional cysts, and the poorest for evaluating dermoid cysts.

Conclusions

Diagnostic performance of pattern recognition significantly improves with an increasing level of experience, emphasizing the importance of standardized ultrasound training programs with supervision by experts.
Literature
1.
go back to reference Borgfeldt C, Andolf E (1999) Transvaginal sonographic ovarian findings in a random sample of women 25–40 years old. Ultrasound Obstet Gynecol 13:345–350PubMedCrossRef Borgfeldt C, Andolf E (1999) Transvaginal sonographic ovarian findings in a random sample of women 25–40 years old. Ultrasound Obstet Gynecol 13:345–350PubMedCrossRef
2.
go back to reference Sankaranarayanan R, Ferlay J (2006) Worldwide burden of gynaecological cancer: the size of the problem. Best Pract Res Clin Obstet Gynaecol 20:207–225PubMedCrossRef Sankaranarayanan R, Ferlay J (2006) Worldwide burden of gynaecological cancer: the size of the problem. Best Pract Res Clin Obstet Gynaecol 20:207–225PubMedCrossRef
3.
go back to reference Killackey MA, Neuwirth RS (1988) Evaluation and management of the pelvic mass: a review of 540 cases. Obstet Gynecol 71:319–322PubMed Killackey MA, Neuwirth RS (1988) Evaluation and management of the pelvic mass: a review of 540 cases. Obstet Gynecol 71:319–322PubMed
4.
go back to reference Eriksson L, Kjellgren O, von Schoultz B (1985) Functional cyst or ovarian cancer: histopathological findings during 1 year of surgery. Gynecol Obstet Invest 19:155–159PubMedCrossRef Eriksson L, Kjellgren O, von Schoultz B (1985) Functional cyst or ovarian cancer: histopathological findings during 1 year of surgery. Gynecol Obstet Invest 19:155–159PubMedCrossRef
5.
go back to reference Theodoridis TD, Zepiridis L, Mikos T et al (2009) Comparison of diagnostic accuracy of transvaginal ultrasound with laparoscopy in the management of patients with adnexal masses. Arch Gynecol Obstet 280:767–773PubMedCrossRef Theodoridis TD, Zepiridis L, Mikos T et al (2009) Comparison of diagnostic accuracy of transvaginal ultrasound with laparoscopy in the management of patients with adnexal masses. Arch Gynecol Obstet 280:767–773PubMedCrossRef
6.
go back to reference Caspi B, Appelman Z, Rabinerson D et al (1997) The growth pattern of ovarian dermoid cysts: a prospective study in premenopausal and postmenopausal women. Fertil Steril 68:501–505PubMedCrossRef Caspi B, Appelman Z, Rabinerson D et al (1997) The growth pattern of ovarian dermoid cysts: a prospective study in premenopausal and postmenopausal women. Fertil Steril 68:501–505PubMedCrossRef
7.
go back to reference Fleischer AC, Boehm FH, James AE Jr (1982) Sonography and radiology of pelvic masses and other maternal disorders. Semin Roentgenol 17:172–181PubMedCrossRef Fleischer AC, Boehm FH, James AE Jr (1982) Sonography and radiology of pelvic masses and other maternal disorders. Semin Roentgenol 17:172–181PubMedCrossRef
9.
go back to reference Wang S, Johnson S (2011) Prediction of benignity of solid adnexal masses. Arch Gynecol Obstet [Epub ahead of print] Wang S, Johnson S (2011) Prediction of benignity of solid adnexal masses. Arch Gynecol Obstet [Epub ahead of print]
10.
go back to reference Ohel I, Sheiner E, Aricha-Tamir B et al (2010) Three-dimensional power Doppler ultrasound in ovarian cancer and its correlation with histology. Arch Gynecol Obstet 281:919–925PubMedCrossRef Ohel I, Sheiner E, Aricha-Tamir B et al (2010) Three-dimensional power Doppler ultrasound in ovarian cancer and its correlation with histology. Arch Gynecol Obstet 281:919–925PubMedCrossRef
11.
go back to reference Valentin L (2004) Use of morphology to characterize and manage common adnexal masses. Best Pract Res Clin Obstet Gynaecol 18:71–89PubMedCrossRef Valentin L (2004) Use of morphology to characterize and manage common adnexal masses. Best Pract Res Clin Obstet Gynaecol 18:71–89PubMedCrossRef
12.
go back to reference Valentin L, Ameye L, Testa A et al (2006) Ultrasound characteristics of different types of adnexal malignancies. Gynecol Oncol 102:41–48PubMedCrossRef Valentin L, Ameye L, Testa A et al (2006) Ultrasound characteristics of different types of adnexal malignancies. Gynecol Oncol 102:41–48PubMedCrossRef
13.
go back to reference Yazbek J, Raju KS, Ben-Nagi J et al (2007) Accuracy of ultrasound subjective ‘pattern recognition’ for the diagnosis of borderline ovarian tumors. Ultrasound Obstet Gynecol 29:489–495PubMedCrossRef Yazbek J, Raju KS, Ben-Nagi J et al (2007) Accuracy of ultrasound subjective ‘pattern recognition’ for the diagnosis of borderline ovarian tumors. Ultrasound Obstet Gynecol 29:489–495PubMedCrossRef
14.
go back to reference Valentin L (1999) Prospective cross-validation of Doppler ultrasound examination and gray-scale ultrasound imaging for discrimination of benign and malignant pelvic masses. Ultrasound Obstet Gynecol 14:273–283PubMedCrossRef Valentin L (1999) Prospective cross-validation of Doppler ultrasound examination and gray-scale ultrasound imaging for discrimination of benign and malignant pelvic masses. Ultrasound Obstet Gynecol 14:273–283PubMedCrossRef
15.
go back to reference Van Calster B, Timmerman D, Bourne T et al (2007) Discrimination between benign and malignant adnexal masses by specialist ultrasound examination versus serum CA-125. J Natl Cancer Inst 99:1706–1714PubMedCrossRef Van Calster B, Timmerman D, Bourne T et al (2007) Discrimination between benign and malignant adnexal masses by specialist ultrasound examination versus serum CA-125. J Natl Cancer Inst 99:1706–1714PubMedCrossRef
16.
go back to reference Valentin L (1999) Pattern recognition of pelvic masses by gray-scale ultrasound imaging: the contribution of Doppler ultrasound. Ultrasound Obstet Gynecol 14:338–347PubMedCrossRef Valentin L (1999) Pattern recognition of pelvic masses by gray-scale ultrasound imaging: the contribution of Doppler ultrasound. Ultrasound Obstet Gynecol 14:338–347PubMedCrossRef
17.
go back to reference Van Holsbeke C, Daemen A, Yazbek J et al (2010) Ultrasound experience substantially impacts on diagnostic performance and confidence when adnexal masses are classified using pattern recognition. Gynecol Obstet Invest 69:160–168PubMedCrossRef Van Holsbeke C, Daemen A, Yazbek J et al (2010) Ultrasound experience substantially impacts on diagnostic performance and confidence when adnexal masses are classified using pattern recognition. Gynecol Obstet Invest 69:160–168PubMedCrossRef
18.
go back to reference Timmerman D, Schwarzler P, Collins WP et al (1999) Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience. Ultrasound Obstet Gynecol 13:11–16PubMedCrossRef Timmerman D, Schwarzler P, Collins WP et al (1999) Subjective assessment of adnexal masses with the use of ultrasonography: an analysis of interobserver variability and experience. Ultrasound Obstet Gynecol 13:11–16PubMedCrossRef
19.
go back to reference Yazbek J, Raju SK, Ben-Nagi J et al (2008) Effect of quality of gynaecological ultrasonography on management of patients with suspected ovarian cancer: a randomised controlled trial. Lancet Oncol 9:124–131PubMedCrossRef Yazbek J, Raju SK, Ben-Nagi J et al (2008) Effect of quality of gynaecological ultrasonography on management of patients with suspected ovarian cancer: a randomised controlled trial. Lancet Oncol 9:124–131PubMedCrossRef
20.
go back to reference Guerriero S, Alcazar JL, Pascual MA et al (2008) Intraobserver and interobserver agreement of grayscale typical ultrasonographic patterns for the diagnosis of ovarian cancer. Ultrasound Med Biol 34:1711–1716PubMedCrossRef Guerriero S, Alcazar JL, Pascual MA et al (2008) Intraobserver and interobserver agreement of grayscale typical ultrasonographic patterns for the diagnosis of ovarian cancer. Ultrasound Med Biol 34:1711–1716PubMedCrossRef
21.
go back to reference Guerriero S, Alcazar JL, Pascual MA et al (2009) Diagnosis of the most frequent benign ovarian cysts: is ultrasonography accurate and reproducible? J Womens Health (Larchmt) 18:519–527CrossRef Guerriero S, Alcazar JL, Pascual MA et al (2009) Diagnosis of the most frequent benign ovarian cysts: is ultrasonography accurate and reproducible? J Womens Health (Larchmt) 18:519–527CrossRef
22.
go back to reference EFSUMB (2006) Minimum training recommendations for the practice of medical ultrasound. Ultraschall Med 27:79–105CrossRef EFSUMB (2006) Minimum training recommendations for the practice of medical ultrasound. Ultraschall Med 27:79–105CrossRef
23.
go back to reference Patel MD, Feldstein VA, Chen DC, Lipson SD, Filly RA (1999) Endometriomas: diagnostic performance of US. Radiology 210:739–745PubMed Patel MD, Feldstein VA, Chen DC, Lipson SD, Filly RA (1999) Endometriomas: diagnostic performance of US. Radiology 210:739–745PubMed
24.
go back to reference Alcazar JL, Guerriero S, Laparte C et al (2011) Diagnostic performance of transvaginal gray-scale ultrasound for specific diagnosis of benign ovarian cysts in relation to menopausal status. Maturitas 68:182–188PubMedCrossRef Alcazar JL, Guerriero S, Laparte C et al (2011) Diagnostic performance of transvaginal gray-scale ultrasound for specific diagnosis of benign ovarian cysts in relation to menopausal status. Maturitas 68:182–188PubMedCrossRef
25.
go back to reference Benacerraf BR, Finkler NJ, Wojciechowski C, Knapp RC (1990) Sonographic accuracy in the diagnosis of ovarian masses. J Reprod Med 35:491–495PubMed Benacerraf BR, Finkler NJ, Wojciechowski C, Knapp RC (1990) Sonographic accuracy in the diagnosis of ovarian masses. J Reprod Med 35:491–495PubMed
26.
go back to reference Mais V, Guerriero S, Ajossa S et al (1995) Transvaginal ultrasonography in the diagnosis of cystic teratoma. Obstet Gynecol 85:48–52PubMedCrossRef Mais V, Guerriero S, Ajossa S et al (1995) Transvaginal ultrasonography in the diagnosis of cystic teratoma. Obstet Gynecol 85:48–52PubMedCrossRef
27.
go back to reference Guerriero S, Mallarini G, Ajossa S et al (1997) Transvaginal ultrasound and computed tomography combined with clinical parameters and CA-125 determinations in the differential diagnosis of persistent ovarian cysts in premenopausal women. Ultrasound Obstet Gynecol 9:339–343PubMedCrossRef Guerriero S, Mallarini G, Ajossa S et al (1997) Transvaginal ultrasound and computed tomography combined with clinical parameters and CA-125 determinations in the differential diagnosis of persistent ovarian cysts in premenopausal women. Ultrasound Obstet Gynecol 9:339–343PubMedCrossRef
28.
go back to reference Jermy K, Luise C, Bourne T (2001) The characterization of common ovarian cysts in premenopausal women. Ultrasound Obstet Gynecol 17:140–144PubMedCrossRef Jermy K, Luise C, Bourne T (2001) The characterization of common ovarian cysts in premenopausal women. Ultrasound Obstet Gynecol 17:140–144PubMedCrossRef
29.
go back to reference Van Holsbeke C, Yazbek J, Holland TK et al (2008) Real-time ultrasound vs. evaluation of static images in the preoperative assessment of adnexal masses. Ultrasound Obstet Gynecol 32:828–831PubMedCrossRef Van Holsbeke C, Yazbek J, Holland TK et al (2008) Real-time ultrasound vs. evaluation of static images in the preoperative assessment of adnexal masses. Ultrasound Obstet Gynecol 32:828–831PubMedCrossRef
30.
go back to reference Stein SM, Laifer-Narin S, Johnson MB et al (1995) Differentiation of benign and malignant adnexal masses: relative value of gray-scale, color Doppler, and spectral Doppler sonography. AJR Am J Roentgenol 164:381–386PubMed Stein SM, Laifer-Narin S, Johnson MB et al (1995) Differentiation of benign and malignant adnexal masses: relative value of gray-scale, color Doppler, and spectral Doppler sonography. AJR Am J Roentgenol 164:381–386PubMed
Metadata
Title
Subjective assessment of ovarian masses using pattern recognition: the impact of experience on diagnostic performance and interobserver variability
Authors
Florian Faschingbauer
Michaela Benz
Lothar Häberle
Tamme W. Goecke
Matthias W. Beckmann
Stefan Renner
Andreas Müller
Thomas Wittenberg
Christian Münzenmayer
Publication date
01-06-2012
Publisher
Springer-Verlag
Published in
Archives of Gynecology and Obstetrics / Issue 6/2012
Print ISSN: 0932-0067
Electronic ISSN: 1432-0711
DOI
https://doi.org/10.1007/s00404-012-2229-2

Other articles of this Issue 6/2012

Archives of Gynecology and Obstetrics 6/2012 Go to the issue