Skip to main content
Top
Published in: European Radiology 10/2015

01-10-2015 | Breast

Discrepant screening mammography assessments at blinded and non-blinded double reading: impact of arbitration by a third reader on screening outcome

Authors: Elisabeth G. Klompenhouwer, Adri C. Voogd, Gerard J. den Heeten, Luc J. A. Strobbe, Vivianne C. Tjan-Heijnen, Mireille J. M. Broeders, Lucien E. M. Duijm

Published in: European Radiology | Issue 10/2015

Login to get access

Abstract

Objectives

To determine the value of adding a third reader for arbitration of discrepant screening mammography assessments.

Methods

We included a consecutive series of 84,927 digital screening mammograms, double read in a blinded or non-blinded fashion. Arbitration was retrospectively performed by a third screening radiologist. Two years’ follow-up was performed.

Results

Discrepant readings comprised 57.2 % (830/1452) and 29.1 % (346/1188) of recalls at blinded and non-blinded double readings, respectively. At blinded double reading, arbitration would have decreased recall rate (3.4 to 2.2 %, p < 0.001) and programme sensitivity (83.2 to 76.0 %, p = 0.013), would not have influenced the cancer detection rate (CDR; 7.5 to 6.8 per 1,000 screens, p = 0.258) and would have increased the positive predictive value of recall (PPV; 22.3 to 31.2 %, p < 0.001). At non-blinded double reading, arbitration would have decreased recall rate (2.8 to 2.3 %, p < 0.001) and increased PPV (23.2 to 27.5 %, p = 0.021), but would not have affected CDR (6.6 to 6.3 per 1,000 screens, p = 0.604) and programme sensitivity (76.0 to 72.7 %, p = 0.308).

Conclusion

Arbitration of discrepant screening mammography assessments is a good tool to improve recall rate and PPV, but is not desirable as it reduces the programme sensitivity at blinded double reading.

Key points

Blinded double reading results in higher programme sensitivity than non-blinded reading.
Discrepant readings occur more often at blinded compared to non-blinded reading.
Arbitration of discrepant readings reduces the recall rate and PPV.
Arbitration would reduce the programme sensitivity at blinded double reading.
Literature
1.
go back to reference Perry N, Broeders M, de Wolf C, Tornberg S, Holland R, von Karsa L (2008) European guidelines for quality assurance in breast cancer screening and diagnosis. Fourth edition–summary document. Ann Oncol 19:614–622CrossRefPubMed Perry N, Broeders M, de Wolf C, Tornberg S, Holland R, von Karsa L (2008) European guidelines for quality assurance in breast cancer screening and diagnosis. Fourth edition–summary document. Ann Oncol 19:614–622CrossRefPubMed
2.
go back to reference Harvey SC, Geller B, Oppenheimer RG, Pinet M, Riddell L, Garra B (2003) Increase in cancer detection and recall rates with independent double interpretation of screening mammography. AJR Am J Roentgenol 180:1461–1467CrossRefPubMed Harvey SC, Geller B, Oppenheimer RG, Pinet M, Riddell L, Garra B (2003) Increase in cancer detection and recall rates with independent double interpretation of screening mammography. AJR Am J Roentgenol 180:1461–1467CrossRefPubMed
3.
go back to reference Thurfjell EL, Lernevall KA, Taube AA (1994) Benefit of independent double reading in a population-based mammography screening program. Radiology 191:241–244CrossRefPubMed Thurfjell EL, Lernevall KA, Taube AA (1994) Benefit of independent double reading in a population-based mammography screening program. Radiology 191:241–244CrossRefPubMed
4.
go back to reference Brown J, Bryan S, Warren R (1996) Mammography screening: an incremental cost effectiveness analysis of double versus single reading of mammograms. BMJ 312:809–812PubMedCentralCrossRefPubMed Brown J, Bryan S, Warren R (1996) Mammography screening: an incremental cost effectiveness analysis of double versus single reading of mammograms. BMJ 312:809–812PubMedCentralCrossRefPubMed
5.
go back to reference Leivo T, Salminen T, Sintonen H et al (1999) Incremental cost-effectiveness of double-reading mammograms. Breast Cancer Res Treat 54:261–267CrossRefPubMed Leivo T, Salminen T, Sintonen H et al (1999) Incremental cost-effectiveness of double-reading mammograms. Breast Cancer Res Treat 54:261–267CrossRefPubMed
6.
go back to reference Ciatto S, Ambrogetti D, Bonardi R et al (2005) Second reading of screening mammograms increases cancer detection and recall rates. Results in the Florence screening programme. J Med Screen 12:103–106CrossRefPubMed Ciatto S, Ambrogetti D, Bonardi R et al (2005) Second reading of screening mammograms increases cancer detection and recall rates. Results in the Florence screening programme. J Med Screen 12:103–106CrossRefPubMed
7.
go back to reference Klompenhouwer EG, Voogd AC, den Heeten GJ et al (2015) Blinded double reading yields a higher programme sensitivity than non-blinded double reading at digital screening mammography: a prospected population based study in the south of The Netherlands. Eur J Cancer 51:391–399CrossRefPubMed Klompenhouwer EG, Voogd AC, den Heeten GJ et al (2015) Blinded double reading yields a higher programme sensitivity than non-blinded double reading at digital screening mammography: a prospected population based study in the south of The Netherlands. Eur J Cancer 51:391–399CrossRefPubMed
8.
go back to reference Shaw CM, Flanagan FL, Fenlon HM, McNicholas MM (2009) Consensus review of discordant findings maximizes cancer detection rate in double-reader screening mammography: Irish National Breast Screening Program experience. Radiology 250:354–362CrossRefPubMed Shaw CM, Flanagan FL, Fenlon HM, McNicholas MM (2009) Consensus review of discordant findings maximizes cancer detection rate in double-reader screening mammography: Irish National Breast Screening Program experience. Radiology 250:354–362CrossRefPubMed
9.
go back to reference Duijm LE, Groenewoud JH, Hendriks JH, de Koning HJ (2004) Independent double reading of screening mammograms in The Netherlands: effect of arbitration following reader disagreements. Radiology 231:564–570CrossRefPubMed Duijm LE, Groenewoud JH, Hendriks JH, de Koning HJ (2004) Independent double reading of screening mammograms in The Netherlands: effect of arbitration following reader disagreements. Radiology 231:564–570CrossRefPubMed
10.
go back to reference Ciatto S, Ambrogetti D, Risso G et al (2005) The role of arbitration of discordant reports at double reading of screening mammograms. J Med Screen 12:125–127CrossRefPubMed Ciatto S, Ambrogetti D, Risso G et al (2005) The role of arbitration of discordant reports at double reading of screening mammograms. J Med Screen 12:125–127CrossRefPubMed
11.
go back to reference Caumo F, Brunelli S, Tosi E et al (2011) On the role of arbitration of discordant double readings of screening mammography: experience from two Italian programmes. Radiol Med 116:84–91CrossRefPubMed Caumo F, Brunelli S, Tosi E et al (2011) On the role of arbitration of discordant double readings of screening mammography: experience from two Italian programmes. Radiol Med 116:84–91CrossRefPubMed
12.
go back to reference Fracheboud J, de Koning HJ, Boer R et al (2001) Nationwide breast cancer screening programme fully implemented in The Netherlands. Breast 10:6–11CrossRefPubMed Fracheboud J, de Koning HJ, Boer R et al (2001) Nationwide breast cancer screening programme fully implemented in The Netherlands. Breast 10:6–11CrossRefPubMed
13.
go back to reference Liberman L, Menell JH (2002) Breast imaging reporting and data system (BI-RADS). Radiol Clin N Am 40:409CrossRefPubMed Liberman L, Menell JH (2002) Breast imaging reporting and data system (BI-RADS). Radiol Clin N Am 40:409CrossRefPubMed
14.
go back to reference Sobin LH, Wittekind C (2002) TNM classification of malignant tumours. Wiley-Liss, New York Sobin LH, Wittekind C (2002) TNM classification of malignant tumours. Wiley-Liss, New York
15.
go back to reference Brewer NT, Salz T, Lillie SE (2007) Systematic review: the long-term effects of false-positive mammograms. Ann Intern Med 146:502–510CrossRefPubMed Brewer NT, Salz T, Lillie SE (2007) Systematic review: the long-term effects of false-positive mammograms. Ann Intern Med 146:502–510CrossRefPubMed
16.
go back to reference van der Steeg AF, Keyzer-Dekker CM, De Vries J, Roukema JA (2011) Effect of abnormal screening mammogram on quality of life. Br J Surg 98:537–542CrossRefPubMed van der Steeg AF, Keyzer-Dekker CM, De Vries J, Roukema JA (2011) Effect of abnormal screening mammogram on quality of life. Br J Surg 98:537–542CrossRefPubMed
17.
go back to reference Keyzer-Dekker CM, De Vries J, van Esch L et al (2012) Anxiety after an abnormal screening mammogram is a serious problem. Breast 21:83–88CrossRefPubMed Keyzer-Dekker CM, De Vries J, van Esch L et al (2012) Anxiety after an abnormal screening mammogram is a serious problem. Breast 21:83–88CrossRefPubMed
18.
go back to reference Bond M, Pavey T, Welch K et al (2013) Systematic review of the psychological consequences of false-positive screening mammograms. Health Technol Assess 17:1–170, v–viCrossRefPubMed Bond M, Pavey T, Welch K et al (2013) Systematic review of the psychological consequences of false-positive screening mammograms. Health Technol Assess 17:1–170, v–viCrossRefPubMed
19.
go back to reference Brett J, Austoker J (2001) Women who are recalled for further investigation for breast screening: psychological consequences 3 years after recall and factors affecting re-attendance. J Public Health Med 23:292–300CrossRefPubMed Brett J, Austoker J (2001) Women who are recalled for further investigation for breast screening: psychological consequences 3 years after recall and factors affecting re-attendance. J Public Health Med 23:292–300CrossRefPubMed
20.
go back to reference Klompenhouwer EG, Duijm LE, Voogd AC et al (2014) Re-attendance at biennial screening mammography following a repeated false positive recall. Breast Cancer Res Treat 145:429–437CrossRefPubMed Klompenhouwer EG, Duijm LE, Voogd AC et al (2014) Re-attendance at biennial screening mammography following a repeated false positive recall. Breast Cancer Res Treat 145:429–437CrossRefPubMed
21.
go back to reference Lampic C, Thurfjell E, Sjoden PO (2003) The influence of a false-positive mammogram on a woman's subsequent behaviour for detecting breast cancer. Eur J Cancer 39:1730–1737CrossRefPubMed Lampic C, Thurfjell E, Sjoden PO (2003) The influence of a false-positive mammogram on a woman's subsequent behaviour for detecting breast cancer. Eur J Cancer 39:1730–1737CrossRefPubMed
22.
go back to reference Alamo-Junquera D, Murta-Nascimento C, Macia F et al (2012) Effect of false-positive results on reattendance at breast cancer screening programmes in Spain. Eur J Pub Health 22:404–408CrossRef Alamo-Junquera D, Murta-Nascimento C, Macia F et al (2012) Effect of false-positive results on reattendance at breast cancer screening programmes in Spain. Eur J Pub Health 22:404–408CrossRef
23.
go back to reference Seigneurin A, Exbrayat C, Labarere J, Delafosse P, Poncet F, Colonna M (2011) Association of diagnostic work-up with subsequent attendance in a breast cancer screening program for false-positive cases. Breast Cancer Res Treat 127:221–228CrossRefPubMed Seigneurin A, Exbrayat C, Labarere J, Delafosse P, Poncet F, Colonna M (2011) Association of diagnostic work-up with subsequent attendance in a breast cancer screening program for false-positive cases. Breast Cancer Res Treat 127:221–228CrossRefPubMed
24.
go back to reference McCann J, Stockton D, Godward S (2002) Impact of false-positive mammography on subsequent screening attendance and risk of cancer. Breast Cancer Res 4:R11PubMedCentralCrossRefPubMed McCann J, Stockton D, Godward S (2002) Impact of false-positive mammography on subsequent screening attendance and risk of cancer. Breast Cancer Res 4:R11PubMedCentralCrossRefPubMed
25.
go back to reference Drossaert CH, Boer H, Seydel ER (2001) Does mammographic screening and a negative result affect attitudes towards future breast screening? J Med Screen 8:204–212CrossRefPubMed Drossaert CH, Boer H, Seydel ER (2001) Does mammographic screening and a negative result affect attitudes towards future breast screening? J Med Screen 8:204–212CrossRefPubMed
26.
go back to reference Pinckney RG, Geller BM, Burman M, Littenberg B (2003) Effect of false-positive mammograms on return for subsequent screening mammography. Am J Med 114:120–125CrossRefPubMed Pinckney RG, Geller BM, Burman M, Littenberg B (2003) Effect of false-positive mammograms on return for subsequent screening mammography. Am J Med 114:120–125CrossRefPubMed
27.
go back to reference Roman R, Sala M, De La Vega M et al (2011) Effect of false-positives and women's characteristics on long-term adherence to breast cancer screening. Breast Cancer Res Treat 130:543–552CrossRefPubMed Roman R, Sala M, De La Vega M et al (2011) Effect of false-positives and women's characteristics on long-term adherence to breast cancer screening. Breast Cancer Res Treat 130:543–552CrossRefPubMed
28.
go back to reference Otten JD, Karssemeijer N, Hendriks JH et al (2005) Effect of recall rate on earlier screen detection of breast cancers based on the Dutch performance indicators. J Natl Cancer Inst 97:748–754CrossRefPubMed Otten JD, Karssemeijer N, Hendriks JH et al (2005) Effect of recall rate on earlier screen detection of breast cancers based on the Dutch performance indicators. J Natl Cancer Inst 97:748–754CrossRefPubMed
29.
go back to reference Timmers JM, van Doorne-Nagtegaal HJ, Zonderland HM et al (2012) The Breast Imaging Reporting and Data System (BI-RADS) in the Dutch breast cancer screening programme: its role as an assessment and stratification tool. Eur Radiol 22:1717–1723PubMedCentralCrossRefPubMed Timmers JM, van Doorne-Nagtegaal HJ, Zonderland HM et al (2012) The Breast Imaging Reporting and Data System (BI-RADS) in the Dutch breast cancer screening programme: its role as an assessment and stratification tool. Eur Radiol 22:1717–1723PubMedCentralCrossRefPubMed
30.
go back to reference Duijm LE, Groenewoud JH, Fracheboud J et al (2008) Utilization and cost of diagnostic imaging and biopsies following positive screening mammography in the southern breast cancer screening region of the Netherlands, 2000–2005. Eur Radiol 18:2390–2397CrossRefPubMed Duijm LE, Groenewoud JH, Fracheboud J et al (2008) Utilization and cost of diagnostic imaging and biopsies following positive screening mammography in the southern breast cancer screening region of the Netherlands, 2000–2005. Eur Radiol 18:2390–2397CrossRefPubMed
31.
go back to reference James JJ, Cornford EJ (2009) Does computer-aided detection have a role in the arbitration of discordant double-reading opinions in a breast-screening programme? Clin Radiol 64:46–51CrossRefPubMed James JJ, Cornford EJ (2009) Does computer-aided detection have a role in the arbitration of discordant double-reading opinions in a breast-screening programme? Clin Radiol 64:46–51CrossRefPubMed
Metadata
Title
Discrepant screening mammography assessments at blinded and non-blinded double reading: impact of arbitration by a third reader on screening outcome
Authors
Elisabeth G. Klompenhouwer
Adri C. Voogd
Gerard J. den Heeten
Luc J. A. Strobbe
Vivianne C. Tjan-Heijnen
Mireille J. M. Broeders
Lucien E. M. Duijm
Publication date
01-10-2015
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 10/2015
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-015-3711-6

Other articles of this Issue 10/2015

European Radiology 10/2015 Go to the issue