Skip to main content
Top
Published in: BMC Medical Imaging 1/2013

Open Access 01-12-2013 | Research article

Diagnostic performance and inter-observer concordance in lesion detection with the automated breast volume scanner (ABVS)

Authors: Sebastian Wojcinski, Samuel Gyapong, André Farrokh, Philipp Soergel, Peter Hillemanns, Friedrich Degenhardt

Published in: BMC Medical Imaging | Issue 1/2013

Login to get access

Abstract

Background

Automated whole breast ultrasound scanners of the latest generation have reached a level of comfortable application and high quality volume acquisition. Nevertheless, there is a lack of data concerning this technology. We investigated the diagnostic performance and inter-observer concordance of the Automated Breast Volume Scanner (ABVS) ACUSON S2000™ and questioned its implications in breast cancer diagnostics.

Methods

We collected 100 volume data sets and created a database containing 52 scans with no detectable lesions in conventional ultrasound (BI-RADS®-US 1), 30 scans with benign lesions (BI-RADS®-US 2) and 18 scans with breast cancer (BI-RADS®-US 5).
Two independent examiners evaluated the ABVS data on a separate workstation without any prior knowledge of the patients’ histories.

Results

The inter-rater reliability reached fair agreement (κ=0.36; 95% confidence interval (CI): 0.19-0.53). With respect to the true category, the conditional inter-rater validity coefficient was κ=0.18 (95% CI: 0.00-0.26) for the benign cases and κ=0.80 (95% CI: 0.61-1.00) for the malignant cases.
Combining the assessments of examiner 1 and examiner 2, the diagnostic accuracy (AC), sensitivity (SE) and specificity (SP) for the experimental ABVS were AC = 79.0% (95% CI: 67.3-86.1), SE = 83.3% (95% CI: 57.7-95.6) and SP = 78.1% (% CI: 67.3-86.1), respectively.
However, after the ABVS examination, there were a high number of requests for second-look ultrasounds in up to 48.8% of the healthy women due to assumed suspicious findings in the volume data.
In an exploratory analysis, we estimated that an ABVS examination in addition to mammography alone could detect a relevant number of previously occult breast cancers (about 1 cancer in 300 screened and otherwise healthy women).

Conclusions

The ABVS is a reliable imaging method for the evaluation of the breast with high sensitivity and a fair inter-observer concordance. However, we have to overcome the problem of the high number of false-positive results. Therefore, further prospective studies in larger collectives are necessary to define standard procedures in image acquisition and interpretation. Nevertheless, we consider the ABVS as being suitable for integration into breast diagnostics as a beneficial and reliable imaging method.
Appendix
Available only for authorised users
Literature
1.
go back to reference Parkin DM, Bray F, Ferlay J, Pisani P: Global cancer statistics, 2002. CA Cancer J Clin. 2005, 55 (2): 74-108. 10.3322/canjclin.55.2.74.CrossRefPubMed Parkin DM, Bray F, Ferlay J, Pisani P: Global cancer statistics, 2002. CA Cancer J Clin. 2005, 55 (2): 74-108. 10.3322/canjclin.55.2.74.CrossRefPubMed
2.
go back to reference IARC: World cancer report 2008. 2008, Lyon: International Agency for Research on Cancer, WHO Press IARC: World cancer report 2008. 2008, Lyon: International Agency for Research on Cancer, WHO Press
3.
go back to reference IARC: Globocan database. 2008, Lyon: International Agency for Research on Cancer IARC: Globocan database. 2008, Lyon: International Agency for Research on Cancer
4.
go back to reference Parkin DM, Fernandez LM: Use of statistics to assess the global burden of breast cancer. Breast J. 2006, 12 (1): S70-80.CrossRefPubMed Parkin DM, Fernandez LM: Use of statistics to assess the global burden of breast cancer. Breast J. 2006, 12 (1): S70-80.CrossRefPubMed
5.
go back to reference Duijm LE, Louwman MW, Groenewoud JH, van de Poll-Franse LV, Fracheboud J, Coebergh JW: Inter-observer variability in mammography screening and effect of type and number of readers on screening outcome. Br J Cancer. 2009, 100 (6): 901-907. 10.1038/sj.bjc.6604954.CrossRefPubMedPubMedCentral Duijm LE, Louwman MW, Groenewoud JH, van de Poll-Franse LV, Fracheboud J, Coebergh JW: Inter-observer variability in mammography screening and effect of type and number of readers on screening outcome. Br J Cancer. 2009, 100 (6): 901-907. 10.1038/sj.bjc.6604954.CrossRefPubMedPubMedCentral
6.
go back to reference Independent UK Panel on Breast Cancer Screening: The benefits and harms of breast cancer screening: an independent review. Lancet. 2012, 380 (9855): 1778-1786.CrossRef Independent UK Panel on Breast Cancer Screening: The benefits and harms of breast cancer screening: an independent review. Lancet. 2012, 380 (9855): 1778-1786.CrossRef
7.
go back to reference Zonderland HM, Coerkamp EG, Hermans J, van de Vijver MJ, van Voorthuisen AE: Diagnosis of breast cancer: contribution of US as an adjunct to mammography. Radiology. 1999, 213 (2): 413-422. 10.1148/radiology.213.2.r99nv05413.CrossRefPubMed Zonderland HM, Coerkamp EG, Hermans J, van de Vijver MJ, van Voorthuisen AE: Diagnosis of breast cancer: contribution of US as an adjunct to mammography. Radiology. 1999, 213 (2): 413-422. 10.1148/radiology.213.2.r99nv05413.CrossRefPubMed
8.
go back to reference Buchberger W, Niehoff A, Obrist P, DeKoekkoek-Doll P, Dunser M: Clinically and mammographically occult breast lesions: detection and classification with high-resolution sonography. Semin Ultrasound CT MR. 2000, 21 (4): 325-336. 10.1016/S0887-2171(00)90027-1.CrossRefPubMed Buchberger W, Niehoff A, Obrist P, DeKoekkoek-Doll P, Dunser M: Clinically and mammographically occult breast lesions: detection and classification with high-resolution sonography. Semin Ultrasound CT MR. 2000, 21 (4): 325-336. 10.1016/S0887-2171(00)90027-1.CrossRefPubMed
9.
go back to reference Corsetti V, Ferrari A, Ghirardi M, Bergonzini R, Bellarosa S, Angelini O, Bani C, Ciatto S: Role of ultrasonography in detecting mammographically occult breast carcinoma in women with dense breasts. Radiol Med. 2006, 111 (3): 440-448. 10.1007/s11547-006-0040-5.CrossRefPubMed Corsetti V, Ferrari A, Ghirardi M, Bergonzini R, Bellarosa S, Angelini O, Bani C, Ciatto S: Role of ultrasonography in detecting mammographically occult breast carcinoma in women with dense breasts. Radiol Med. 2006, 111 (3): 440-448. 10.1007/s11547-006-0040-5.CrossRefPubMed
10.
go back to reference Gordon PB, Goldenberg SL: Malignant breast masses detected only by ultrasound: a retrospective review. Cancer. 1995, 76 (4): 626-630. 10.1002/1097-0142(19950815)76:4<626::AID-CNCR2820760413>3.0.CO;2-Z.CrossRefPubMed Gordon PB, Goldenberg SL: Malignant breast masses detected only by ultrasound: a retrospective review. Cancer. 1995, 76 (4): 626-630. 10.1002/1097-0142(19950815)76:4<626::AID-CNCR2820760413>3.0.CO;2-Z.CrossRefPubMed
11.
go back to reference Kolb TM, Lichy J, Newhouse JH: Occult cancer in women with dense breasts: detection with screening US–diagnostic yield and tumor characteristics. Radiology. 1998, 207 (1): 191-199.CrossRefPubMed Kolb TM, Lichy J, Newhouse JH: Occult cancer in women with dense breasts: detection with screening US–diagnostic yield and tumor characteristics. Radiology. 1998, 207 (1): 191-199.CrossRefPubMed
12.
go back to reference Nothacker M, Duda V, Hahn M, Warm M, Degenhardt F, Madjar H, Weinbrenner S, Albert US: Early detection of breast cancer: benefits and risks of supplemental breast ultrasound in asymptomatic women with mammographically dense breast tissue: a systematic review. BMC Cancer. 2009, 9: 335-10.1186/1471-2407-9-335.CrossRefPubMedPubMedCentral Nothacker M, Duda V, Hahn M, Warm M, Degenhardt F, Madjar H, Weinbrenner S, Albert US: Early detection of breast cancer: benefits and risks of supplemental breast ultrasound in asymptomatic women with mammographically dense breast tissue: a systematic review. BMC Cancer. 2009, 9: 335-10.1186/1471-2407-9-335.CrossRefPubMedPubMedCentral
13.
go back to reference Maturo VG, Zusmer NR, Gilson AJ, Smoak WM, Janowitz WR, Bear BE, Goddard J, Dick DE: Ultrasound of the whole breast utilizing a dedicated automated breast scanner. Radiology. 1980, 137 (2): 457-463.CrossRefPubMed Maturo VG, Zusmer NR, Gilson AJ, Smoak WM, Janowitz WR, Bear BE, Goddard J, Dick DE: Ultrasound of the whole breast utilizing a dedicated automated breast scanner. Radiology. 1980, 137 (2): 457-463.CrossRefPubMed
14.
go back to reference Mendelson EB, Baum JK, Berg WA, Merritt CR, Rubin E: BI-RADS: ultrasound. Breast imaging reporting and data system: ACR BI-RADS - breast imaging atlas. Edited by: D’Orsi CJ, Mendelson EB, Ikeda DM. 2002, Reston, VA: American College of Radiology Mendelson EB, Baum JK, Berg WA, Merritt CR, Rubin E: BI-RADS: ultrasound. Breast imaging reporting and data system: ACR BI-RADS - breast imaging atlas. Edited by: D’Orsi CJ, Mendelson EB, Ikeda DM. 2002, Reston, VA: American College of Radiology
15.
go back to reference Wojcinski S, Farrokh A, Hille U, Wiskirchen J, Gyapong S, Soliman AA, Degenhardt F, Hillemanns P: The automated breast volume scanner (ABVS): initial experiences in lesion detection compared with conventional handheld B-mode ultrasound: a pilot study of 50 cases. International journal of women’s health. 2011, 3: 337-346.CrossRefPubMedPubMedCentral Wojcinski S, Farrokh A, Hille U, Wiskirchen J, Gyapong S, Soliman AA, Degenhardt F, Hillemanns P: The automated breast volume scanner (ABVS): initial experiences in lesion detection compared with conventional handheld B-mode ultrasound: a pilot study of 50 cases. International journal of women’s health. 2011, 3: 337-346.CrossRefPubMedPubMedCentral
16.
go back to reference Tozaki M, Isobe S, Yamaguchi M, Ogawa Y, Kohara M, Joo C, Fukuma E: Optimal scanning technique to cover the whole breast using an automated breast volume scanner. Jpn J Radiol. 2010, 28 (4): 325-328. 10.1007/s11604-010-0424-2.CrossRefPubMed Tozaki M, Isobe S, Yamaguchi M, Ogawa Y, Kohara M, Joo C, Fukuma E: Optimal scanning technique to cover the whole breast using an automated breast volume scanner. Jpn J Radiol. 2010, 28 (4): 325-328. 10.1007/s11604-010-0424-2.CrossRefPubMed
19.
go back to reference Zhou XH, Obuchowski NA, McClish DK: Statistical methods in diagnostic medicine: 2nd ed. 2011, New York: WileyCrossRef Zhou XH, Obuchowski NA, McClish DK: Statistical methods in diagnostic medicine: 2nd ed. 2011, New York: WileyCrossRef
20.
go back to reference Newcombe RG: Interval estimation for the difference between independent proportions: comparison of eleven methods. Stat Med. 1998, 17 (8): 873-890. 10.1002/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I.CrossRefPubMed Newcombe RG: Interval estimation for the difference between independent proportions: comparison of eleven methods. Stat Med. 1998, 17 (8): 873-890. 10.1002/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I.CrossRefPubMed
21.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
22.
go back to reference Hahn M, Roessner L, Krainick-Strobel U, Gruber IV, Kramer B, Gall C, Siegmann KC, Wallwiener D, Kagan KO: Sonographic criteria for the differentiation of benign and malignant breast lesions using real-time spatial compound imaging in combination with XRES adaptive image processing. Ultraschall Med. 2012, 33 (3): 270-274.CrossRefPubMed Hahn M, Roessner L, Krainick-Strobel U, Gruber IV, Kramer B, Gall C, Siegmann KC, Wallwiener D, Kagan KO: Sonographic criteria for the differentiation of benign and malignant breast lesions using real-time spatial compound imaging in combination with XRES adaptive image processing. Ultraschall Med. 2012, 33 (3): 270-274.CrossRefPubMed
23.
go back to reference Farrokh A, Wojcinski S, Degenhardt F: Diagnostic value of strain ratio measurement in the differentiation of malignant and benign breast lesions. Ultraschall Med. 2011, 32 (4): 400-405. 10.1055/s-0029-1245335.CrossRefPubMed Farrokh A, Wojcinski S, Degenhardt F: Diagnostic value of strain ratio measurement in the differentiation of malignant and benign breast lesions. Ultraschall Med. 2011, 32 (4): 400-405. 10.1055/s-0029-1245335.CrossRefPubMed
24.
go back to reference Wojcinski S, Farrokh A, Peisker U, Thomas A, Degenhardt F, Hahn M: Neue diagnostische verfahren - sono-elastografie der mamma. Senologie - Zeitschrift für Mammadiagnostik und -therapie. 2011, 7: 15-18. 10.1055/s-0031-1275480.CrossRef Wojcinski S, Farrokh A, Peisker U, Thomas A, Degenhardt F, Hahn M: Neue diagnostische verfahren - sono-elastografie der mamma. Senologie - Zeitschrift für Mammadiagnostik und -therapie. 2011, 7: 15-18. 10.1055/s-0031-1275480.CrossRef
25.
go back to reference Smith CM: Origin and uses of primum non nocere–above all, do no harm!. J Clin Pharmacol. 2005, 45 (4): 371-377. 10.1177/0091270004273680.CrossRefPubMed Smith CM: Origin and uses of primum non nocere–above all, do no harm!. J Clin Pharmacol. 2005, 45 (4): 371-377. 10.1177/0091270004273680.CrossRefPubMed
26.
go back to reference Shin HJ, Kim HH, Cha JH, Park JH, Lee KE, Kim JH: Automated ultrasound of the breast for diagnosis: interobserver agreement on lesion detection and characterization. AJR Am J Roentgenol. 2011, 197 (3): 747-754. 10.2214/AJR.10.5841.CrossRefPubMed Shin HJ, Kim HH, Cha JH, Park JH, Lee KE, Kim JH: Automated ultrasound of the breast for diagnosis: interobserver agreement on lesion detection and characterization. AJR Am J Roentgenol. 2011, 197 (3): 747-754. 10.2214/AJR.10.5841.CrossRefPubMed
27.
go back to reference Golatta M, Franz D, Harcos A, Junkermann H, Rauch G, Scharf A, Schuetz F, Sohn C, Heil J: Interobserver reliability of automated breast volume scanner (ABVS) interpretation and agreement of ABVS findings with hand held breast ultrasound (HHUS), mammography and pathology results. Eur J Radiol. 2013, 82 (8): 332-336. 10.1016/j.ejrad.2013.03.005.CrossRef Golatta M, Franz D, Harcos A, Junkermann H, Rauch G, Scharf A, Schuetz F, Sohn C, Heil J: Interobserver reliability of automated breast volume scanner (ABVS) interpretation and agreement of ABVS findings with hand held breast ultrasound (HHUS), mammography and pathology results. Eur J Radiol. 2013, 82 (8): 332-336. 10.1016/j.ejrad.2013.03.005.CrossRef
28.
go back to reference Lin X, Wang J, Han F, Fu J, Li A: Analysis of eighty-one cases with breast lesions using automated breast volume scanner and comparison with handheld ultrasound. Eur J Radiol. 2012, 81 (5): 873-878. 10.1016/j.ejrad.2011.02.038.CrossRefPubMed Lin X, Wang J, Han F, Fu J, Li A: Analysis of eighty-one cases with breast lesions using automated breast volume scanner and comparison with handheld ultrasound. Eur J Radiol. 2012, 81 (5): 873-878. 10.1016/j.ejrad.2011.02.038.CrossRefPubMed
29.
go back to reference Wang HY, Jiang YX, Zhu QL, Zhang J, Dai Q, Liu H, Lai XJ, Sun Q: Differentiation of benign and malignant breast lesions: a comparison between automatically generated breast volume scans and handheld ultrasound examinations. Eur J Radiol. 2012, 81 (11): 3190-3200. 10.1016/j.ejrad.2012.01.034.CrossRefPubMed Wang HY, Jiang YX, Zhu QL, Zhang J, Dai Q, Liu H, Lai XJ, Sun Q: Differentiation of benign and malignant breast lesions: a comparison between automatically generated breast volume scans and handheld ultrasound examinations. Eur J Radiol. 2012, 81 (11): 3190-3200. 10.1016/j.ejrad.2012.01.034.CrossRefPubMed
30.
go back to reference Wang ZL, Xu JH, Li JL, Huang Y, Tang J: Erratum to: comparison of automated breast volume scanning to hand-held ultrasound and mammography. Radiol Med. 2012, 117 (8): 1443-10.1007/s11547-012-0855-1.CrossRef Wang ZL, Xu JH, Li JL, Huang Y, Tang J: Erratum to: comparison of automated breast volume scanning to hand-held ultrasound and mammography. Radiol Med. 2012, 117 (8): 1443-10.1007/s11547-012-0855-1.CrossRef
31.
go back to reference Wang ZL, Xw JH, Li JL, Huang Y, Tang J: Comparison of automated breast volume scanning to hand-held ultrasound and mammography. Radiol Med. 2012, 117 (8): 1287-1293. 10.1007/s11547-012-0836-4.CrossRefPubMed Wang ZL, Xw JH, Li JL, Huang Y, Tang J: Comparison of automated breast volume scanning to hand-held ultrasound and mammography. Radiol Med. 2012, 117 (8): 1287-1293. 10.1007/s11547-012-0836-4.CrossRefPubMed
32.
go back to reference Zhang J, Lai XJ, Zhu QL, Wang HY, Jiang YX, Liu H, Dai Q, You SS, Xiao MS, Sun Q: Interobserver agreement for sonograms of breast lesions obtained by an automated breast volume scanner. Eur J Radiol. 2012, 81 (9): 2179-2183. 10.1016/j.ejrad.2011.06.043.CrossRefPubMed Zhang J, Lai XJ, Zhu QL, Wang HY, Jiang YX, Liu H, Dai Q, You SS, Xiao MS, Sun Q: Interobserver agreement for sonograms of breast lesions obtained by an automated breast volume scanner. Eur J Radiol. 2012, 81 (9): 2179-2183. 10.1016/j.ejrad.2011.06.043.CrossRefPubMed
33.
go back to reference Tozaki M, Fukuma E: Accuracy of determining preoperative cancer extent measured by automated breast ultrasonography. Jpn J Radiol. 2010, 28 (10): 771-773. 10.1007/s11604-010-0499-9.CrossRefPubMed Tozaki M, Fukuma E: Accuracy of determining preoperative cancer extent measured by automated breast ultrasonography. Jpn J Radiol. 2010, 28 (10): 771-773. 10.1007/s11604-010-0499-9.CrossRefPubMed
34.
go back to reference Isobe S, Tozaki M, Yamaguchi M, Ogawa Y, Homma K, Satomi R, Saito M, Joo C, Fukuma E: Detectability of breast lesions under the nipple using an automated breast volume scanner: comparison with handheld ultrasonography. Jpn J Radiol. 2011, 29 (5): 361-365. 10.1007/s11604-010-0555-5.CrossRefPubMed Isobe S, Tozaki M, Yamaguchi M, Ogawa Y, Homma K, Satomi R, Saito M, Joo C, Fukuma E: Detectability of breast lesions under the nipple using an automated breast volume scanner: comparison with handheld ultrasonography. Jpn J Radiol. 2011, 29 (5): 361-365. 10.1007/s11604-010-0555-5.CrossRefPubMed
35.
go back to reference Kuehn T, Bembenek A, Decker T, Munz DL, Sautter-Bihl ML, Untch M, Wallwiener D: Consensus committee of the german society of, senology: a concept for the clinical implementation of sentinel lymph node biopsy in patients with breast carcinoma with special regard to quality assurance. Cancer. 2005, 103 (3): 451-461. 10.1002/cncr.20786.CrossRefPubMed Kuehn T, Bembenek A, Decker T, Munz DL, Sautter-Bihl ML, Untch M, Wallwiener D: Consensus committee of the german society of, senology: a concept for the clinical implementation of sentinel lymph node biopsy in patients with breast carcinoma with special regard to quality assurance. Cancer. 2005, 103 (3): 451-461. 10.1002/cncr.20786.CrossRefPubMed
36.
go back to reference de Bresser J, de Vos B, van der Ent F, Hulsewe K: Breast MRI in clinically and mammographically occult breast cancer presenting with an axillary metastasis: a systematic review. Eur J Surg Oncol. 2010, 36 (2): 114-119. 10.1016/j.ejso.2009.09.007.CrossRefPubMed de Bresser J, de Vos B, van der Ent F, Hulsewe K: Breast MRI in clinically and mammographically occult breast cancer presenting with an axillary metastasis: a systematic review. Eur J Surg Oncol. 2010, 36 (2): 114-119. 10.1016/j.ejso.2009.09.007.CrossRefPubMed
37.
go back to reference Schwab FD, Burger H, Isenschmid M, Kuhn A, Mueller MD, Gunthert AR: Suspicious axillary lymph nodes in patients with unremarkable imaging of the breast. Eur J Obstet Gynecol Reprod Biol. 2010, 150 (1): 88-91. 10.1016/j.ejogrb.2010.02.011.CrossRefPubMed Schwab FD, Burger H, Isenschmid M, Kuhn A, Mueller MD, Gunthert AR: Suspicious axillary lymph nodes in patients with unremarkable imaging of the breast. Eur J Obstet Gynecol Reprod Biol. 2010, 150 (1): 88-91. 10.1016/j.ejogrb.2010.02.011.CrossRefPubMed
Metadata
Title
Diagnostic performance and inter-observer concordance in lesion detection with the automated breast volume scanner (ABVS)
Authors
Sebastian Wojcinski
Samuel Gyapong
André Farrokh
Philipp Soergel
Peter Hillemanns
Friedrich Degenhardt
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2013
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/1471-2342-13-36

Other articles of this Issue 1/2013

BMC Medical Imaging 1/2013 Go to the issue