Skip to main content
Top
Published in: Journal of Digital Imaging 2/2011

01-04-2011

Assessment of Performance and Reliability of Computer-Aided Detection Scheme Using Content-Based Image Retrieval Approach and Limited Reference Database

Authors: Xiao Hui Wang, Sang Cheol Park, Bin Zheng

Published in: Journal of Imaging Informatics in Medicine | Issue 2/2011

Login to get access

Abstract

Content-based image retrieval approach was used in our computer-aided detection (CAD) schemes for breast cancer detection with mammography. In this study, we assessed CAD performance and reliability using a reference database including 1500 positive (breast mass) regions of interest (ROIs) and1500 normal ROIs. To test the relationship between CAD performance and the similarity level between the queried ROI and the retrieved ROIs, we applied a set of similarity thresholds to the retrieved similar ROIs selected by the CADschemes for all queried suspicious regions, and used only the ROIs that were above the threshold for assessing CAD performance at each threshold level. Using the leave-one-out testing method, we computed areas under receiver operating characteristic (ROC) curves (A Z ) to assess CAD performance. The experimental results showed that as threshold increase, (1) less true positive ROIs can be referenced in the database than normal ROIs and (2) the A Z value was monotonically increased from 0.854±0.004 to 0.932±0.016. This study suggests that (1) in order to more accurately detect and diagnose subtle masses, a large and diverse database is required, and (2) assessing the reliability of the decision scores based on the similarity measurement is important in application of the CBIR-based CAD schemes when the limited database is used.
Literature
1.
go back to reference Nishikawa RM: Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 31:224–235, 2007PubMedCrossRef Nishikawa RM: Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 31:224–235, 2007PubMedCrossRef
2.
go back to reference Hirose T, Nitta N, Shiraishi J, et al: Evaluation of computer-aided diagnosis (CAD) software for the detection of lung nodules on multidetector row computed tomography (MDCT): JAFROC study for the improvement in radiologists’ diagnostic accuracy. Acad Radiol 15:1505–1512, 2008PubMedCrossRef Hirose T, Nitta N, Shiraishi J, et al: Evaluation of computer-aided diagnosis (CAD) software for the detection of lung nodules on multidetector row computed tomography (MDCT): JAFROC study for the improvement in radiologists’ diagnostic accuracy. Acad Radiol 15:1505–1512, 2008PubMedCrossRef
3.
go back to reference Gur D, Sumkin JH, Rockette HE, et al: Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst 96:185–190, 2004PubMedCrossRef Gur D, Sumkin JH, Rockette HE, et al: Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst 96:185–190, 2004PubMedCrossRef
4.
go back to reference Nishikawa RM, Kallergi M: Computer-aided detection in its present form is not an effective aid for screening mammography. Med Phys 33:811–814, 2006PubMedCrossRef Nishikawa RM, Kallergi M: Computer-aided detection in its present form is not an effective aid for screening mammography. Med Phys 33:811–814, 2006PubMedCrossRef
5.
go back to reference Muller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Informatics 73:1–23, 2004CrossRef Muller H, Michoux N, Bandon D, Geissbuhler A: A review of content-based image retrieval systems in medical applications—clinical benefits and future directions. Int J Med Informatics 73:1–23, 2004CrossRef
6.
go back to reference Zheng B: Computer-aided diagnosis in mammography using content-based image retrieval approaches: current status and future perspectives. Algorithm 2:828–849, 2009CrossRef Zheng B: Computer-aided diagnosis in mammography using content-based image retrieval approaches: current status and future perspectives. Algorithm 2:828–849, 2009CrossRef
7.
go back to reference Giger ML, Huo Z, Vyborny CJ, et al: Intelligent CAD workstation for breast imaging using similarity to known lesions and multiple visual prompt aides. Proc SPIE 4684:768–773, 2002CrossRef Giger ML, Huo Z, Vyborny CJ, et al: Intelligent CAD workstation for breast imaging using similarity to known lesions and multiple visual prompt aides. Proc SPIE 4684:768–773, 2002CrossRef
8.
go back to reference El-Naga I, Yang Y, Galatsanos NP, et al: A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23:1233–1244, 2004CrossRef El-Naga I, Yang Y, Galatsanos NP, et al: A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans Med Imaging 23:1233–1244, 2004CrossRef
9.
go back to reference Wei C, Li C, Wilson R: A general framework for content-based medical image retrieval with its application to mammograms. Proc SPIE 5748:134–143, 2005CrossRef Wei C, Li C, Wilson R: A general framework for content-based medical image retrieval with its application to mammograms. Proc SPIE 5748:134–143, 2005CrossRef
10.
go back to reference Alto H, Rangayyan RM, Desautels JE: Content-based retrieval and analysis of mammographic masses. J Electron Imaging 14:023016, 2005CrossRef Alto H, Rangayyan RM, Desautels JE: Content-based retrieval and analysis of mammographic masses. J Electron Imaging 14:023016, 2005CrossRef
11.
go back to reference Tourassi GD, Harrawood B, Singh S, et al: Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. Med Phys 34:140–150, 2007PubMedCrossRef Tourassi GD, Harrawood B, Singh S, et al: Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. Med Phys 34:140–150, 2007PubMedCrossRef
12.
go back to reference Tao Y, Lo SB, Freedman MT, Xuan J: A preliminary study of content-based mammographic masses retrieval. Proc SPIE 6514:65141Z, 2007CrossRef Tao Y, Lo SB, Freedman MT, Xuan J: A preliminary study of content-based mammographic masses retrieval. Proc SPIE 6514:65141Z, 2007CrossRef
13.
go back to reference Zheng B, Mello-Thoms C, Wang X, et al: Interactive computer aided diagnosis of breast masses: computerized selection of visually similar image sets from a reference library. Acad Radiol 14:917–927, 2007PubMedCrossRef Zheng B, Mello-Thoms C, Wang X, et al: Interactive computer aided diagnosis of breast masses: computerized selection of visually similar image sets from a reference library. Acad Radiol 14:917–927, 2007PubMedCrossRef
14.
go back to reference Rosa NA, Felipe JC, Traina AJ, et al: Using relevance feedback to reduce the semantic gap in content-based image retrieval of mammographic masses. Conf Proc IEEE Med Biol Soc 2008:406–409, 2008 Rosa NA, Felipe JC, Traina AJ, et al: Using relevance feedback to reduce the semantic gap in content-based image retrieval of mammographic masses. Conf Proc IEEE Med Biol Soc 2008:406–409, 2008
15.
go back to reference Park SC, Sukthankar R, Mummert L, et al: Optimization of reference library used in content-based medical image retrieval scheme. Med Phys 34:4331–4339, 2007PubMedCrossRef Park SC, Sukthankar R, Mummert L, et al: Optimization of reference library used in content-based medical image retrieval scheme. Med Phys 34:4331–4339, 2007PubMedCrossRef
16.
go back to reference Zheng B, Chang YH, Good WF, Gur D: Adequacy testing of training set sample sizes in the development of a computer-assisted diagnosis scheme. Acad Radiol 4:497–502, 1997PubMedCrossRef Zheng B, Chang YH, Good WF, Gur D: Adequacy testing of training set sample sizes in the development of a computer-assisted diagnosis scheme. Acad Radiol 4:497–502, 1997PubMedCrossRef
17.
go back to reference Gur D, Stalder JS, Hardesty LA, et al: Computer-aided detection performance in mammographic examination of masses: assessment. Radiology 233:418–423, 2004PubMedCrossRef Gur D, Stalder JS, Hardesty LA, et al: Computer-aided detection performance in mammographic examination of masses: assessment. Radiology 233:418–423, 2004PubMedCrossRef
18.
go back to reference Zheng B, Pu J, Park SC, Zuley M, Gur D: Assessment of the relationship between lesion segmentation accuracy and computer-aided diagnosis scheme performance. Proc SPIE 6915:691530-1–691530-11, 2007 Zheng B, Pu J, Park SC, Zuley M, Gur D: Assessment of the relationship between lesion segmentation accuracy and computer-aided diagnosis scheme performance. Proc SPIE 6915:691530-1–691530-11, 2007
19.
go back to reference Wang X, Park SC, Zheng B: Improving performance of content-based image retrieval schemes in searching for similar breast mass regions: an assessment. Phys Med Biol 54:949–961, 2009PubMedCrossRef Wang X, Park SC, Zheng B: Improving performance of content-based image retrieval schemes in searching for similar breast mass regions: an assessment. Phys Med Biol 54:949–961, 2009PubMedCrossRef
20.
go back to reference Zheng B, Lu A, Hardesty LA, et al: A method to improve visual similarity of breast masses for an interactive computer-aided diagnosis environment. Med Phys 33:111–117, 2006PubMedCrossRef Zheng B, Lu A, Hardesty LA, et al: A method to improve visual similarity of breast masses for an interactive computer-aided diagnosis environment. Med Phys 33:111–117, 2006PubMedCrossRef
22.
go back to reference Lehmann TM, Guld MO, Deselaers T, et al: Automatic categorization of medical images for content-based retrieval and data mining. Comput Med Imaging Graph 29:143–155, 2005PubMedCrossRef Lehmann TM, Guld MO, Deselaers T, et al: Automatic categorization of medical images for content-based retrieval and data mining. Comput Med Imaging Graph 29:143–155, 2005PubMedCrossRef
23.
go back to reference Zheng B, Abrams G, Britton CA, et al: Evaluation of an interactive computer-aided diagnosis system for mammography: a pilot study. Proc SPIE 6515:65151M-1–65151M-8, 2007 Zheng B, Abrams G, Britton CA, et al: Evaluation of an interactive computer-aided diagnosis system for mammography: a pilot study. Proc SPIE 6515:65151M-1–65151M-8, 2007
24.
go back to reference Park SC, Pu J, Zheng B: Improving performance of computer-aided detection scheme by combining results from two machine learning classifiers. Acad Radiol 16:266–274, 2009PubMedCrossRef Park SC, Pu J, Zheng B: Improving performance of computer-aided detection scheme by combining results from two machine learning classifiers. Acad Radiol 16:266–274, 2009PubMedCrossRef
25.
go back to reference Mazurowski MA, Zurada JM, Tourassi GD: Selection of samples in case-based computer-aided decision systems. Phys Med Biol 53:6079–6096, 2008PubMedCrossRef Mazurowski MA, Zurada JM, Tourassi GD: Selection of samples in case-based computer-aided decision systems. Phys Med Biol 53:6079–6096, 2008PubMedCrossRef
Metadata
Title
Assessment of Performance and Reliability of Computer-Aided Detection Scheme Using Content-Based Image Retrieval Approach and Limited Reference Database
Authors
Xiao Hui Wang
Sang Cheol Park
Bin Zheng
Publication date
01-04-2011
Publisher
Springer-Verlag
Published in
Journal of Imaging Informatics in Medicine / Issue 2/2011
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-010-9281-x

Other articles of this Issue 2/2011

Journal of Digital Imaging 2/2011 Go to the issue