Skip to main content
Top
Published in: BMC Cancer 1/2015

Open Access 01-12-2015 | Research article

Radiographers supporting radiologists in the interpretation of screening mammography: a viable strategy to meet the shortage in the number of radiologists

Authors: Gabriela Torres-Mejía, Robert A. Smith, María de la Luz Carranza-Flores, Andy Bogart, Louis Martínez-Matsushita, Diana L. Miglioretti, Karla Kerlikowske, Carolina Ortega-Olvera, Ernesto Montemayor-Varela, Angélica Angeles-Llerenas, Sergio Bautista-Arredondo, Gilberto Sánchez-González, Olga G. Martínez-Montañez, Santos R. Uscanga-Sánchez, Eduardo Lazcano-Ponce, Mauricio Hernández-Ávila

Published in: BMC Cancer | Issue 1/2015

Login to get access

Abstract

Background

An alternative approach to the traditional model of radiologists interpreting screening mammography is necessary due to the shortage of radiologists to interpret screening mammograms in many countries.

Methods

We evaluated the performance of 15 Mexican radiographers, also known as radiologic technologists, in the interpretation of screening mammography after a 6 months training period in a screening setting. Fifteen radiographers received 6 months standardized training with radiologists in the interpretation of screening mammography using the Breast Imaging Reporting and Data System (BI-RADS) system. A challenging test set of 110 cases developed by the Breast Cancer Surveillance Consortium was used to evaluate their performance. We estimated sensitivity, specificity, false positive rates, likelihood ratio of a positive test (LR+) and the area under the subject-specific Receiver Operating Characteristic (ROC) curve (AUC) for diagnostic accuracy. A mathematical model simulating the consequences in costs and performance of two hypothetical scenarios compared to the status quo in which a radiologist reads all screening mammograms was also performed.

Results

Radiographer’s sensitivity was comparable to the sensitivity scores achieved by U.S. radiologists who took the test but their false-positive rate was higher. Median sensitivity was 73.3 % (Interquartile range, IQR: 46.7–86.7 %) and the median false positive rate was 49.5 % (IQR: 34.7–57.9 %). The median LR+ was 1.4 (IQR: 1.3-1.7 %) and the median AUC was 0.6 (IQR: 0.6–0.7). A scenario in which a radiographer reads all mammograms first, and a radiologist reads only those that were difficult for the radiographer, was more cost-effective than a scenario in which either the radiographer or radiologist reads all mammograms.

Conclusions

Given the comparable sensitivity achieved by Mexican radiographers and U.S. radiologists on a test set, screening mammography interpretation by radiographers appears to be a possible adjunct to radiologists in countries with shortages of radiologists. Further studies are required to assess the effectiveness of different training programs in order to obtain acceptable screening accuracy, as well as the best approaches for the use of non-physician readers to interpret screening mammography.
Literature
1.
go back to reference Palacio-Mejia LS, Lazcano-Ponce E, Allen-Leigh B, Hernandez-Avila M. [Regional differences in breast and cervical cancer mortality in Mexico between 1979–2006]. Salud Publica Mex. 2009;51 Suppl 2:s208–19.CrossRefPubMed Palacio-Mejia LS, Lazcano-Ponce E, Allen-Leigh B, Hernandez-Avila M. [Regional differences in breast and cervical cancer mortality in Mexico between 1979–2006]. Salud Publica Mex. 2009;51 Suppl 2:s208–19.CrossRefPubMed
2.
go back to reference Mohar A, Bargallo E, Ramirez MT, Lara F, Beltran-Ortega A. [Available resources for the treatment of breast cancer in Mexico]. Salud Publica Mex. 2009;51 Suppl 2:s263–9.PubMed Mohar A, Bargallo E, Ramirez MT, Lara F, Beltran-Ortega A. [Available resources for the treatment of breast cancer in Mexico]. Salud Publica Mex. 2009;51 Suppl 2:s263–9.PubMed
3.
go back to reference Martinez-Montanez OG, Uribe-Zuniga P, Hernandez-Avila M. [Public policies for the detection of breast cancer in Mexico]. Salud Publica Mex. 2009;51 Suppl 2:s350–60.CrossRefPubMed Martinez-Montanez OG, Uribe-Zuniga P, Hernandez-Avila M. [Public policies for the detection of breast cancer in Mexico]. Salud Publica Mex. 2009;51 Suppl 2:s350–60.CrossRefPubMed
4.
go back to reference Unger-Saldana K, Infante-Castaneda CB. Breast cancer delay: a grounded model of help-seeking behaviour. Soc Sci Med. 2011;72(7):1096–104.CrossRefPubMed Unger-Saldana K, Infante-Castaneda CB. Breast cancer delay: a grounded model of help-seeking behaviour. Soc Sci Med. 2011;72(7):1096–104.CrossRefPubMed
5.
go back to reference Bright K, Barghash M, Donach M, de la Barrera MG, Schneider RJ, Formenti SC. The role of health system factors in delaying final diagnosis and treatment of breast cancer in Mexico City, Mexico. Breast. 2011;20 Suppl 2:S54–9.CrossRefPubMed Bright K, Barghash M, Donach M, de la Barrera MG, Schneider RJ, Formenti SC. The role of health system factors in delaying final diagnosis and treatment of breast cancer in Mexico City, Mexico. Breast. 2011;20 Suppl 2:S54–9.CrossRefPubMed
7.
go back to reference Torres-Mejía G, Ortega-Olvera C, Angeles-Llerenas A, Villalobos-Hernández A, Lazcano-Ponce E, Salmerón-Castro J, et al. Patrones de utilización de programas de prevención y diagnóstico temprano de cáncer en la mujer. Salud Publica Mex. 2013;55(2):S241–8.PubMed Torres-Mejía G, Ortega-Olvera C, Angeles-Llerenas A, Villalobos-Hernández A, Lazcano-Ponce E, Salmerón-Castro J, et al. Patrones de utilización de programas de prevención y diagnóstico temprano de cáncer en la mujer. Salud Publica Mex. 2013;55(2):S241–8.PubMed
12.
go back to reference Haiart dcaH JA. A comparison of interpretation of screening mammograms by a radiographer, a doctor and a radiologist: results and implications. Br J Clin Pract. 1991;45:43–5. Haiart dcaH JA. A comparison of interpretation of screening mammograms by a radiographer, a doctor and a radiologist: results and implications. Br J Clin Pract. 1991;45:43–5.
13.
go back to reference Field S. UK radiology workforce survey - breast imaging services. Roy Coll Radiologists Newsletter. 1996;45:10–2. Field S. UK radiology workforce survey - breast imaging services. Roy Coll Radiologists Newsletter. 1996;45:10–2.
14.
go back to reference Duijm LE, Louwman MW, Groenewoud JH, van de Poll-Franse LV, Fracheboud J, Coebergh JW. Inter-observer variability in mammography screening and effect of type and number of readers on screening outcome. Br J Cancer. 2009;100(6):901–7.CrossRefPubMedPubMedCentral Duijm LE, Louwman MW, Groenewoud JH, van de Poll-Franse LV, Fracheboud J, Coebergh JW. Inter-observer variability in mammography screening and effect of type and number of readers on screening outcome. Br J Cancer. 2009;100(6):901–7.CrossRefPubMedPubMedCentral
15.
go back to reference Pauli R, Hammond S, Cooke J, Ansell J. Radiographers as film readers in screening mammography: an assessment of competence under test and screening conditions. Br J Radiol. 1996;69(817):10–4.CrossRefPubMed Pauli R, Hammond S, Cooke J, Ansell J. Radiographers as film readers in screening mammography: an assessment of competence under test and screening conditions. Br J Radiol. 1996;69(817):10–4.CrossRefPubMed
16.
go back to reference Bassett I, Holatz-Brown AJ, Bastani R, Pearce J, Hirji K, Chen L. Effects of a programme to train radiologic technologists to identify abnormalities on mammograms. Radiology. 1995;194:189–92.CrossRefPubMed Bassett I, Holatz-Brown AJ, Bastani R, Pearce J, Hirji K, Chen L. Effects of a programme to train radiologic technologists to identify abnormalities on mammograms. Radiology. 1995;194:189–92.CrossRefPubMed
17.
go back to reference Mucci B, Lawson S, Athey G, Scarisbrick G. Radiographers as readers in breast screening: experience with a 'red dot' method. Breast. 1997;6:183–5.CrossRef Mucci B, Lawson S, Athey G, Scarisbrick G. Radiographers as readers in breast screening: experience with a 'red dot' method. Breast. 1997;6:183–5.CrossRef
18.
go back to reference Tonita JM, Hillis JP, Lim CH. Medical radiologic technologist review: effects on a population-based breast cancer screening program. Radiology. 1999;211(2):529–33.CrossRefPubMed Tonita JM, Hillis JP, Lim CH. Medical radiologic technologist review: effects on a population-based breast cancer screening program. Radiology. 1999;211(2):529–33.CrossRefPubMed
19.
go back to reference Sumkin JH, Klaman HM, Graham M, Ruskauff T, Gennari RC, King JL, et al. Prescreening mammography by technologists: a preliminary assessment. AJR Am J Roentgenol. 2003;180(1):253–6.CrossRefPubMed Sumkin JH, Klaman HM, Graham M, Ruskauff T, Gennari RC, King JL, et al. Prescreening mammography by technologists: a preliminary assessment. AJR Am J Roentgenol. 2003;180(1):253–6.CrossRefPubMed
20.
go back to reference van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Flobbe K. Diagnostic performance of breast technologists in reading mammograms in a clinical patient population. Int J Clin Pract. 2010;64(4):442–50.CrossRefPubMed van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Flobbe K. Diagnostic performance of breast technologists in reading mammograms in a clinical patient population. Int J Clin Pract. 2010;64(4):442–50.CrossRefPubMed
21.
go back to reference Reynoso-Noveron N, Villasenor-Navarro Y, Hernandez-Avila M, Mohar-Betancourt A. [In situ and invasive carcinoma identified through an opportunistic screening mammography in asymptomatic women in Mexico City]. Salud publica de Mexico. 2013;55(5):469–77.PubMed Reynoso-Noveron N, Villasenor-Navarro Y, Hernandez-Avila M, Mohar-Betancourt A. [In situ and invasive carcinoma identified through an opportunistic screening mammography in asymptomatic women in Mexico City]. Salud publica de Mexico. 2013;55(5):469–77.PubMed
23.
go back to reference Cataliotti L, De Wolf C, Holland R, Marotti L, Perry N, Redmond K, et al. Guidelines on the standards for the training of specialised health professionals dealing with breast cancer. Eur J Cancer. 2007;43(4):660–75.CrossRefPubMed Cataliotti L, De Wolf C, Holland R, Marotti L, Perry N, Redmond K, et al. Guidelines on the standards for the training of specialised health professionals dealing with breast cancer. Eur J Cancer. 2007;43(4):660–75.CrossRefPubMed
26.
go back to reference Cantor SB, Kattan MW. Determining the area under the ROC curve for a binary diagnostic test. Med Decis Making. 2000;20:468–70.CrossRefPubMed Cantor SB, Kattan MW. Determining the area under the ROC curve for a binary diagnostic test. Med Decis Making. 2000;20:468–70.CrossRefPubMed
29.
go back to reference Knaul FM, Arreola-Ornelas H, Velazquez E, Dorantes J, Mendez O, Avila-Burgos L. [The health care costs of breast cancer: the case of the Mexican Social Security Institute]. Salud Publica Mex. 2009;51 Suppl 2:s286–95.CrossRefPubMed Knaul FM, Arreola-Ornelas H, Velazquez E, Dorantes J, Mendez O, Avila-Burgos L. [The health care costs of breast cancer: the case of the Mexican Social Security Institute]. Salud Publica Mex. 2009;51 Suppl 2:s286–95.CrossRefPubMed
30.
go back to reference Mai V, Sullivan T, Chiarelli AM. Breast cancer screening program in Canada: successes and challenges. Salud Publica Mex. 2009;51 Suppl 2:s228–35.CrossRefPubMed Mai V, Sullivan T, Chiarelli AM. Breast cancer screening program in Canada: successes and challenges. Salud Publica Mex. 2009;51 Suppl 2:s228–35.CrossRefPubMed
31.
go back to reference Torres-Mejia G, Villasenor-Navarro Y, Yunes-Diaz E, Angeles-Llerenas A, Martinez-Montanez OG, Lazcano-Ponce E. [Validity and reliability of mammographic interpretation by Mexican radiologists, using the BI-RADS system]. Rev Invest Clin. 2011;63(2):124–34.PubMed Torres-Mejia G, Villasenor-Navarro Y, Yunes-Diaz E, Angeles-Llerenas A, Martinez-Montanez OG, Lazcano-Ponce E. [Validity and reliability of mammographic interpretation by Mexican radiologists, using the BI-RADS system]. Rev Invest Clin. 2011;63(2):124–34.PubMed
32.
go back to reference Andronis L, Barton P, Bryan S. Sensitivity analysis in economic evaluation: an audit of NICE current practice and a review of its use and value in decision-making. Health Technol Assess. 2009;13(29):iii. ix-xi, 1–61.CrossRefPubMed Andronis L, Barton P, Bryan S. Sensitivity analysis in economic evaluation: an audit of NICE current practice and a review of its use and value in decision-making. Health Technol Assess. 2009;13(29):iii. ix-xi, 1–61.CrossRefPubMed
33.
go back to reference van den Biggelaar FJ, Nelemans PJ, Flobbe K. Performance of radiographers in mammogram interpretation: a systematic review. Breast. 2008;17(1):85–90.CrossRefPubMed van den Biggelaar FJ, Nelemans PJ, Flobbe K. Performance of radiographers in mammogram interpretation: a systematic review. Breast. 2008;17(1):85–90.CrossRefPubMed
34.
go back to reference Soh BP, Lee W, McEntee MF, Kench PL, Reed WM, Heard R, et al. Screening mammography: test set data can reasonably describe actual clinical reporting. Radiology. 2013;268(1):46–53.CrossRefPubMedPubMedCentral Soh BP, Lee W, McEntee MF, Kench PL, Reed WM, Heard R, et al. Screening mammography: test set data can reasonably describe actual clinical reporting. Radiology. 2013;268(1):46–53.CrossRefPubMedPubMedCentral
35.
go back to reference Wivell G, Denton ER, Eve CB, Inglis JC, Harvey I. Can radiographers read screening mammograms? Clin Radiol. 2003;58(1):63–7.CrossRefPubMed Wivell G, Denton ER, Eve CB, Inglis JC, Harvey I. Can radiographers read screening mammograms? Clin Radiol. 2003;58(1):63–7.CrossRefPubMed
36.
go back to reference Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996;156:209–13.CrossRefPubMed Beam CA, Layde PM, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996;156:209–13.CrossRefPubMed
37.
go back to reference Barlow WE, Chi C, Carney PA, Taplin SH, D'Orsi C, Cutter G, et al. Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2004;96:1840–50.CrossRefPubMedPubMedCentral Barlow WE, Chi C, Carney PA, Taplin SH, D'Orsi C, Cutter G, et al. Accuracy of screening mammography interpretation by characteristics of radiologists. J Natl Cancer Inst. 2004;96:1840–50.CrossRefPubMedPubMedCentral
39.
go back to reference Robinson PJA. Pattern recognition and radiographer reporting. Radiography. 1999;4:155–7.CrossRef Robinson PJA. Pattern recognition and radiographer reporting. Radiography. 1999;4:155–7.CrossRef
40.
go back to reference Hillman BJ, Fajardo LL, Hunter TB, Mockbee B, Cook CE, Hagaman RM, et al. Mammogram interpretation by phycician assistants. AJR Am J Roentgenol. 1987;149:907–11.CrossRefPubMed Hillman BJ, Fajardo LL, Hunter TB, Mockbee B, Cook CE, Hagaman RM, et al. Mammogram interpretation by phycician assistants. AJR Am J Roentgenol. 1987;149:907–11.CrossRefPubMed
41.
go back to reference Richardson G. Identifying, evaluating and implementing cost-effective skill mix. J Nurs Manag. 1999;7(5):265–70.CrossRefPubMed Richardson G. Identifying, evaluating and implementing cost-effective skill mix. J Nurs Manag. 1999;7(5):265–70.CrossRefPubMed
43.
go back to reference Smith TN, Traise P, Cook A. The influence of a continuing education program on the image interpretation accuracy of rural radiographers. Rural Remote Health. 2009;9(2):1145.PubMed Smith TN, Traise P, Cook A. The influence of a continuing education program on the image interpretation accuracy of rural radiographers. Rural Remote Health. 2009;9(2):1145.PubMed
45.
go back to reference Petticrew MP SA, Lister-Sharp D, Wright K. False-negative results in screening programmes: systematic review of impact and implications, vol. 4. Southampton: The National Coordinating Centre for Health Technology Assessment; 2000. p. 60. Petticrew MP SA, Lister-Sharp D, Wright K. False-negative results in screening programmes: systematic review of impact and implications, vol. 4. Southampton: The National Coordinating Centre for Health Technology Assessment; 2000. p. 60.
46.
go back to reference Alcorn FS, O'Donnell E, Ackerman LV. The protocol and results of training nonradiologists to scan mammograms. Radiology. 1971;99:523–9.CrossRefPubMed Alcorn FS, O'Donnell E, Ackerman LV. The protocol and results of training nonradiologists to scan mammograms. Radiology. 1971;99:523–9.CrossRefPubMed
47.
go back to reference Dowdy AH, Lagasse LD, Roach P, Wilson D. Lay screeners in mammographic survey programmes. Radiology. 1970;95:619–21.CrossRefPubMed Dowdy AH, Lagasse LD, Roach P, Wilson D. Lay screeners in mammographic survey programmes. Radiology. 1970;95:619–21.CrossRefPubMed
48.
go back to reference Taylor PM, Champness J, Given-Wilson RM, Potts HW, Johnston K. An evaluation of the impact of computer-based prompts on screen readers' interpretation of mammograms. The British journal of radiology. 2004;77(913):21–7.CrossRefPubMed Taylor PM, Champness J, Given-Wilson RM, Potts HW, Johnston K. An evaluation of the impact of computer-based prompts on screen readers' interpretation of mammograms. The British journal of radiology. 2004;77(913):21–7.CrossRefPubMed
49.
go back to reference Scott HJ, Gale AG. Breast screening: PERFORMS identifies key mammographic training needs. The British journal of radiology. 2006;79 Spec No 2:S127-33. Scott HJ, Gale AG. Breast screening: PERFORMS identifies key mammographic training needs. The British journal of radiology. 2006;79 Spec No 2:S127-33.
50.
go back to reference Miglioretti DL, Gard CC, Carney PA, Onega TL, Buist DS, Sickles EA, et al. When radiologists perform best: the learning curve in screening mammogram interpretation. Radiology. 2009;253(3):632–40.CrossRefPubMedPubMedCentral Miglioretti DL, Gard CC, Carney PA, Onega TL, Buist DS, Sickles EA, et al. When radiologists perform best: the learning curve in screening mammogram interpretation. Radiology. 2009;253(3):632–40.CrossRefPubMedPubMedCentral
51.
go back to reference Bennett RL, Sellars SJ, Blanks RG, Moss SM. An observational study to evaluate the performance of units using two radiographers to read screening mammograms. Clin Radiol. 2012;67:114–21.CrossRefPubMed Bennett RL, Sellars SJ, Blanks RG, Moss SM. An observational study to evaluate the performance of units using two radiographers to read screening mammograms. Clin Radiol. 2012;67:114–21.CrossRefPubMed
52.
go back to reference Tabar L, Vitak B, Yen MF, Chen HH, Smith RA, Duffy SW. Number needed to screen: lives saved over 20 years of follow-up in mammographic screening. J Med Screen. 2004;11(3):126–9.CrossRefPubMed Tabar L, Vitak B, Yen MF, Chen HH, Smith RA, Duffy SW. Number needed to screen: lives saved over 20 years of follow-up in mammographic screening. J Med Screen. 2004;11(3):126–9.CrossRefPubMed
53.
go back to reference Tabar L, Yen MF, Vitak B, Chen HH, Smith RA, Duffy SW. Mammography service screening and mortality in breast cancer patients: 20-year follow-up before and after introduction of screening. Lancet. 2003;361(9367):1405–10.CrossRefPubMed Tabar L, Yen MF, Vitak B, Chen HH, Smith RA, Duffy SW. Mammography service screening and mortality in breast cancer patients: 20-year follow-up before and after introduction of screening. Lancet. 2003;361(9367):1405–10.CrossRefPubMed
Metadata
Title
Radiographers supporting radiologists in the interpretation of screening mammography: a viable strategy to meet the shortage in the number of radiologists
Authors
Gabriela Torres-Mejía
Robert A. Smith
María de la Luz Carranza-Flores
Andy Bogart
Louis Martínez-Matsushita
Diana L. Miglioretti
Karla Kerlikowske
Carolina Ortega-Olvera
Ernesto Montemayor-Varela
Angélica Angeles-Llerenas
Sergio Bautista-Arredondo
Gilberto Sánchez-González
Olga G. Martínez-Montañez
Santos R. Uscanga-Sánchez
Eduardo Lazcano-Ponce
Mauricio Hernández-Ávila
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2015
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/s12885-015-1399-2

Other articles of this Issue 1/2015

BMC Cancer 1/2015 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine