Skip to main content
Top
Published in: BMC Health Services Research 1/2008

Open Access 01-12-2008 | Research article

Association between Radiologists' Experience and Accuracy in Interpreting Screening Mammograms

Authors: Eduard Molins, Francesc Macià, Francesc Ferrer, Maria-Teresa Maristany, Xavier Castells

Published in: BMC Health Services Research | Issue 1/2008

Login to get access

Abstract

Background

Radiologists have been observed to differ, sometimes substantially, both in their interpretations of mammograms and in their recommendations for follow-up. The aim of this study was to determine how factors related to radiologists' experience affect the accuracy of mammogram readings.

Methods

We selected a random sample of screening mammograms from a population-based breast cancer screening program. The sample was composed of 30 women with histopathologically-confirmed breast cancer and 170 women without breast cancer after a 2-year follow-up (the proportion of cancers was oversampled). These 200 mammograms were read by 21 radiologists routinely interpreting mammograms, with different amount of experience, and by seven readers who did not routinely interpret mammograms. All readers were blinded to the results of the screening. A positive assessment was considered when a BI-RADS III, 0, IV, V was reported (additional evaluation required). Diagnostic accuracy was calculated through sensitivity and specificity.

Results

Average specificity was higher in radiologists routinely interpreting mammograms with regard to radiologists who did not (66% vs 56%; p < .001). Multivariate analysis based on routine readers alone showed that specificity was higher among radiologists who followed-up cases for which they recommended further workup (feedback) (OR 1.37; 95% CI 1.03 to 1.85), those spending less than 25% of the working day on breast radiology (OR 1.49; 95% CI 1.18 to 1.89), and those aged more than 45 years old (OR 1.33; 95% CI 1.12 to 1.59); the variable of average annual volume of mammograms interpreted by radiologists, classified as more or less than 5,000 mammograms per year, was not statistically significant (OR 1.06; 95% CI 0.90 to 1.25).

Conclusion

Among radiologists who read routinely, volume is not associated with better performance when interpreting screening mammograms, although specificity decreased in radiologists not routinely reading mammograms. Follow-up of cases for which further workup is recommended might reduce variability in mammogram readings and improve the quality of breast cancer screening programs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR: Variability in radiologists' interpretations of mammograms. N Engl J Med. 1994, 331: 1493-1499. 10.1056/NEJM199412013312206.CrossRefPubMed Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR: Variability in radiologists' interpretations of mammograms. N Engl J Med. 1994, 331: 1493-1499. 10.1056/NEJM199412013312206.CrossRefPubMed
2.
go back to reference Beam CA, Layde PM, Sullivan DC: Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996, 156: 209-213. 10.1001/archinte.156.2.209.CrossRefPubMed Beam CA, Layde PM, Sullivan DC: Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996, 156: 209-213. 10.1001/archinte.156.2.209.CrossRefPubMed
3.
go back to reference Carney PA, Elmore JG, Abraham LA, Gerrity MS, Hendrick RE, Taplin SH, Barlow WE, Cutter GR, Poplack SP, D'Orsi CJ: Radiologist uncertainty and the interpretation of screening. Med Decis Making. 2004, 24: 255-264. 10.1177/0272989X04265480.CrossRefPubMedPubMedCentral Carney PA, Elmore JG, Abraham LA, Gerrity MS, Hendrick RE, Taplin SH, Barlow WE, Cutter GR, Poplack SP, D'Orsi CJ: Radiologist uncertainty and the interpretation of screening. Med Decis Making. 2004, 24: 255-264. 10.1177/0272989X04265480.CrossRefPubMedPubMedCentral
4.
go back to reference Bull AR, Campbell MJ: Assessment of the psychological impact of a breast screening programme. Br J Radiol. 1991, 64 (762): 510-515.CrossRefPubMed Bull AR, Campbell MJ: Assessment of the psychological impact of a breast screening programme. Br J Radiol. 1991, 64 (762): 510-515.CrossRefPubMed
5.
go back to reference Lampic C, Thurfjell E, Bergh J, Sjoden PO: Short- and long-term anxiety and depression in women recalled after breast cancer screening. Eur J Cancer. 2001, 37: 463-469. 10.1016/S0959-8049(00)00426-3.CrossRefPubMed Lampic C, Thurfjell E, Bergh J, Sjoden PO: Short- and long-term anxiety and depression in women recalled after breast cancer screening. Eur J Cancer. 2001, 37: 463-469. 10.1016/S0959-8049(00)00426-3.CrossRefPubMed
6.
go back to reference Castells X, Molins E, Macià F: Cumulative false positive recall rate and association with participant related factors in a population based breast cancer screening programme. J Epidemiol Community Health. 2006, 60: 316-321. 10.1136/jech.2005.042119.CrossRefPubMedPubMedCentral Castells X, Molins E, Macià F: Cumulative false positive recall rate and association with participant related factors in a population based breast cancer screening programme. J Epidemiol Community Health. 2006, 60: 316-321. 10.1136/jech.2005.042119.CrossRefPubMedPubMedCentral
7.
go back to reference Theberge I, Hebert-Croteau N, Langlois A, Major D, Brisson J: Volume of screening mammography and performance in the Quebec population-based Breast Cancer Screening Program. CMAJ. 2005, 172 (2): 195-199.CrossRefPubMedPubMedCentral Theberge I, Hebert-Croteau N, Langlois A, Major D, Brisson J: Volume of screening mammography and performance in the Quebec population-based Breast Cancer Screening Program. CMAJ. 2005, 172 (2): 195-199.CrossRefPubMedPubMedCentral
8.
go back to reference Barlow WE, Chi C, Carney PA, Taplin SH, D'Orsi C, Cutter G, Hendrick RE, Elmore JG: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2004, 96 (24): 1840-1850.CrossRefPubMedPubMedCentral Barlow WE, Chi C, Carney PA, Taplin SH, D'Orsi C, Cutter G, Hendrick RE, Elmore JG: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2004, 96 (24): 1840-1850.CrossRefPubMedPubMedCentral
9.
go back to reference Elmore JG, Miglioretti DL, Carney PA: Does practice make perfect when interpreting mammography? Part II. J Natl Cancer Inst. 2003, 95: 250-252.CrossRefPubMed Elmore JG, Miglioretti DL, Carney PA: Does practice make perfect when interpreting mammography? Part II. J Natl Cancer Inst. 2003, 95: 250-252.CrossRefPubMed
10.
go back to reference Kan L, Olivotto IA, Warren Burhenne LJ, Sickles EA, Coldman AJ: Standardized abnormal interpretation and cancer detection ratios to assess reading volume and reader performance in a breast screening program. Radiology. 2000, 215 (2): 563-567.CrossRefPubMed Kan L, Olivotto IA, Warren Burhenne LJ, Sickles EA, Coldman AJ: Standardized abnormal interpretation and cancer detection ratios to assess reading volume and reader performance in a breast screening program. Radiology. 2000, 215 (2): 563-567.CrossRefPubMed
11.
go back to reference Elmore JG, Wells CK, Howard DH: Does diagnostic accuracy in mammography depend on radiologists' experience?. J Womens Health. 1998, 7 (4): 443-449.CrossRefPubMed Elmore JG, Wells CK, Howard DH: Does diagnostic accuracy in mammography depend on radiologists' experience?. J Womens Health. 1998, 7 (4): 443-449.CrossRefPubMed
12.
go back to reference Perry N, Broeders M, de Wolf C, Törnberg S, Holland R, von Karsa L, Puthaar E, eds: European Commission. European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis. 2006, Luxembourg: Office for Official Publications of the European Communities, Fourth Perry N, Broeders M, de Wolf C, Törnberg S, Holland R, von Karsa L, Puthaar E, eds: European Commission. European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis. 2006, Luxembourg: Office for Official Publications of the European Communities, Fourth
13.
go back to reference Baker JA, Kornguth PJ, Floyd CE: Breast imaging reporting and data system standardized mammography lexicon: observer variability in lesion description. AJR Am J Roentgenol. 1996, 166 (4): 773-778.CrossRefPubMed Baker JA, Kornguth PJ, Floyd CE: Breast imaging reporting and data system standardized mammography lexicon: observer variability in lesion description. AJR Am J Roentgenol. 1996, 166 (4): 773-778.CrossRefPubMed
14.
go back to reference Lehman C, Holt S, Peacock S, White E, Urban N: Use of the American College of Radiology BI-RADS guidelines by community radiologists: concordance of assessments and recommendations assigned to screening mammograms. AJR Am J Roentgenol. 2002, 179 (1): 15-20.CrossRefPubMed Lehman C, Holt S, Peacock S, White E, Urban N: Use of the American College of Radiology BI-RADS guidelines by community radiologists: concordance of assessments and recommendations assigned to screening mammograms. AJR Am J Roentgenol. 2002, 179 (1): 15-20.CrossRefPubMed
15.
go back to reference Smith-Bindman R, Chu P, Miglioretti DL, Quale C, Rosenberg RD, Cutter G, Geller B, Bacchetti P, Sickles EA, Kerlikowske K: Physician predictors of mammographic accuracy. J Natl Cancer Inst. 2005, 97 (5): 358-367.CrossRefPubMed Smith-Bindman R, Chu P, Miglioretti DL, Quale C, Rosenberg RD, Cutter G, Geller B, Bacchetti P, Sickles EA, Kerlikowske K: Physician predictors of mammographic accuracy. J Natl Cancer Inst. 2005, 97 (5): 358-367.CrossRefPubMed
16.
go back to reference Esserman L, Cowley H, Eberle C, Kirkpatrick A, Chang S, Berbaum K, Gale A: Improving the accuracy of mammography: volume and outcome relationships. J Natl Cancer Inst. 2002, 94 (5): 369-375.CrossRefPubMed Esserman L, Cowley H, Eberle C, Kirkpatrick A, Chang S, Berbaum K, Gale A: Improving the accuracy of mammography: volume and outcome relationships. J Natl Cancer Inst. 2002, 94 (5): 369-375.CrossRefPubMed
17.
go back to reference Beam CA, Conant EF, Sickles EA: Association of volume and volume-independent factors with accuracy in screening mammogram interpretation. J Natl Cancer Inst. 2003, 95 (4): 282-290.CrossRefPubMed Beam CA, Conant EF, Sickles EA: Association of volume and volume-independent factors with accuracy in screening mammogram interpretation. J Natl Cancer Inst. 2003, 95 (4): 282-290.CrossRefPubMed
18.
go back to reference Institute of Medicine: Improving interpretive performance in mammography. Improving breast imaging quality standards. Edited by: Sharyl N, Ball J. 2005, Washington, D.C.: National Academy Press, 24-44. Institute of Medicine: Improving interpretive performance in mammography. Improving breast imaging quality standards. Edited by: Sharyl N, Ball J. 2005, Washington, D.C.: National Academy Press, 24-44.
20.
go back to reference Clark R: Re: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2005, 97: 936.CrossRefPubMed Clark R: Re: Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2005, 97: 936.CrossRefPubMed
21.
go back to reference Smart CR, Byrne C, Smith RA, Garfinkel L, Letton AH, Dodd GD, Beahrs OH: Twenty-year follow-up of the breast cancers diagnosed during the Breast Cancer Detection Demonstration Project. CA Cancer J Clin. 1997, 47 (3): 134-149.CrossRefPubMed Smart CR, Byrne C, Smith RA, Garfinkel L, Letton AH, Dodd GD, Beahrs OH: Twenty-year follow-up of the breast cancers diagnosed during the Breast Cancer Detection Demonstration Project. CA Cancer J Clin. 1997, 47 (3): 134-149.CrossRefPubMed
22.
go back to reference Kerlikowske K, Grady D, Barclay J, Frankel SD, Ominsky SH, Sickles EA, Ernster V: Variability and accuracy in mammographic interpretation using the American College of Radiology Breast Imaging Reporting and Data System. J Natl Cancer Inst. 1998, 90 (23): 1801-1809. 10.1093/jnci/90.23.1801.CrossRefPubMed Kerlikowske K, Grady D, Barclay J, Frankel SD, Ominsky SH, Sickles EA, Ernster V: Variability and accuracy in mammographic interpretation using the American College of Radiology Breast Imaging Reporting and Data System. J Natl Cancer Inst. 1998, 90 (23): 1801-1809. 10.1093/jnci/90.23.1801.CrossRefPubMed
23.
go back to reference Smith-Bindman R, Ballard-Barbash R, Miglioretti DL, Patnick J, Kerlikowske K: Comparing the performance of mammography screening in the USA and the UK. J Med Screen. 2005, 12: 50-54. 10.1258/0969141053279130.CrossRefPubMed Smith-Bindman R, Ballard-Barbash R, Miglioretti DL, Patnick J, Kerlikowske K: Comparing the performance of mammography screening in the USA and the UK. J Med Screen. 2005, 12: 50-54. 10.1258/0969141053279130.CrossRefPubMed
24.
go back to reference Yankaskas BC, Klabunde CN, Ancelle-Park R, Renner G, Wang H, Fracheboud J, Pou G, Bulliard JL: International comparison of performance measures for screening mammography: can it be done?. J Med Screen. 2004, 11: 187-193. 10.1258/0969141042467430.CrossRefPubMed Yankaskas BC, Klabunde CN, Ancelle-Park R, Renner G, Wang H, Fracheboud J, Pou G, Bulliard JL: International comparison of performance measures for screening mammography: can it be done?. J Med Screen. 2004, 11: 187-193. 10.1258/0969141042467430.CrossRefPubMed
25.
go back to reference Smith RA: Breast cancer screening. IARC handbooks of cancer prevention. Edited by: Vainio H, Bianchini F. 2002, Lyon: IARC Press, 2: 119-134. Smith RA: Breast cancer screening. IARC handbooks of cancer prevention. Edited by: Vainio H, Bianchini F. 2002, Lyon: IARC Press, 2: 119-134.
Metadata
Title
Association between Radiologists' Experience and Accuracy in Interpreting Screening Mammograms
Authors
Eduard Molins
Francesc Macià
Francesc Ferrer
Maria-Teresa Maristany
Xavier Castells
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2008
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-8-91

Other articles of this Issue 1/2008

BMC Health Services Research 1/2008 Go to the issue