Skip to main content
Top
Published in: Breast Cancer Research 2/2014

Open Access 01-04-2014 | Research article

A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue

Authors: Arvydas Laurinavicius, Benoit Plancoulaine, Aida Laurinaviciene, Paulette Herlin, Raimundas Meskauskas, Indra Baltrusaityte, Justinas Besusparis, Darius Dasevicius, Nicolas Elie, Yasir Iqbal, Catherine Bor, Ian O Ellis

Published in: Breast Cancer Research | Issue 2/2014

Login to get access

Abstract

Introduction

Immunohistochemical Ki67 labelling index (Ki67 LI) reflects proliferative activity and is a potential prognostic/predictive marker of breast cancer. However, its clinical utility is hindered by the lack of standardized measurement methodologies. Besides tissue heterogeneity aspects, the key element of methodology remains accurate estimation of Ki67-stained/counterstained tumour cell profiles. We aimed to develop a methodology to ensure and improve accuracy of the digital image analysis (DIA) approach.

Methods

Tissue microarrays (one 1-mm spot per patient, n = 164) from invasive ductal breast carcinoma were stained for Ki67 and scanned. Criterion standard (Ki67-Count) was obtained by counting positive and negative tumour cell profiles using a stereology grid overlaid on a spot image. DIA was performed with Aperio Genie/Nuclear algorithms. A bias was estimated by ANOVA, correlation and regression analyses. Calibration steps of the DIA by adjusting the algorithm settings were performed: first, by subjective DIA quality assessment (DIA-1), and second, to compensate the bias established (DIA-2). Visual estimate (Ki67-VE) on the same images was performed by five pathologists independently.

Results

ANOVA revealed significant underestimation bias (P < 0.05) for DIA-0, DIA-1 and two pathologists’ VE, while DIA-2, VE-median and three other VEs were within the same range. Regression analyses revealed best accuracy for the DIA-2 (R-square = 0.90) exceeding that of VE-median, individual VEs and other DIA settings. Bidirectional bias for the DIA-2 with overestimation at low, and underestimation at high ends of the scale was detected. Measurement error correction by inverse regression was applied to improve DIA-2-based prediction of the Ki67-Count, in particular for the clinically relevant interval of Ki67-Count < 40%. Potential clinical impact of the prediction was tested by dichotomising the cases at the cut-off values of 10, 15, and 20%. Misclassification rate of 5-7% was achieved, compared to that of 11-18% for the VE-median-based prediction.

Conclusions

Our experiments provide methodology to achieve accurate Ki67-LI estimation by DIA, based on proper validation, calibration, and measurement error correction procedures, guided by quantified bias from reference values obtained by stereology grid count. This basic validation step is an important prerequisite for high-throughput automated DIA applications to investigate tissue heterogeneity and clinical utility aspects of Ki67 and other immunohistochemistry (IHC) biomarkers.
Appendix
Available only for authorised users
Literature
1.
go back to reference Gu J, Ogilvie RW: Virtual microscopy and virtual slides in teaching, diagnosis and research. Advances in Pathology, Microscopy & Molecular Morphology. Edited by: Gu J, Hacker GW. 2005, Boca Raton, London, New York, Singapore: CRC Press, Taylor & Francis Group Gu J, Ogilvie RW: Virtual microscopy and virtual slides in teaching, diagnosis and research. Advances in Pathology, Microscopy & Molecular Morphology. Edited by: Gu J, Hacker GW. 2005, Boca Raton, London, New York, Singapore: CRC Press, Taylor & Francis Group
2.
go back to reference Soenksen D: Digital pathology at the crossroads of major health care trends: corporate innovation as an engine for change. Arch Pathol Lab Med. 2009, 133: 555-559.PubMed Soenksen D: Digital pathology at the crossroads of major health care trends: corporate innovation as an engine for change. Arch Pathol Lab Med. 2009, 133: 555-559.PubMed
3.
go back to reference Kayser K, Borkenfeld S, Kayser G: How to introduce virtual microscopy (VM) in routine diagnostic pathology: constraints, ideas, and solutions. Anal Cell Pathol (Amst). 2012, 35: 3-10.CrossRef Kayser K, Borkenfeld S, Kayser G: How to introduce virtual microscopy (VM) in routine diagnostic pathology: constraints, ideas, and solutions. Anal Cell Pathol (Amst). 2012, 35: 3-10.CrossRef
4.
go back to reference Kayser K, Gortler J, Borkenfeld S, Kayser G: How to measure diagnosis-associated information in virtual slides. Diagn Pathol. 2011, 6: S9-10.1186/1746-1596-6-S1-S9.CrossRefPubMedPubMedCentral Kayser K, Gortler J, Borkenfeld S, Kayser G: How to measure diagnosis-associated information in virtual slides. Diagn Pathol. 2011, 6: S9-10.1186/1746-1596-6-S1-S9.CrossRefPubMedPubMedCentral
5.
go back to reference Madabhushi A, Agner S, Basavanhally A, Doyle S, Lee G: Computer-aided prognosis: predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data. Comput Med Imaging Graph. 2011, 35: 506-514. 10.1016/j.compmedimag.2011.01.008.CrossRefPubMed Madabhushi A, Agner S, Basavanhally A, Doyle S, Lee G: Computer-aided prognosis: predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data. Comput Med Imaging Graph. 2011, 35: 506-514. 10.1016/j.compmedimag.2011.01.008.CrossRefPubMed
6.
go back to reference The quest for quantitative microscopy. Nat Methods. 2012, 9: 627-DOI: 10.1038/nmeth.2102 The quest for quantitative microscopy. Nat Methods. 2012, 9: 627-DOI: 10.1038/nmeth.2102
7.
go back to reference Laurinavicius A, Laurinaviciene A, Dasevicius D, Elie N, Plancoulaine B, Bor C, Herlin P: Digital image analysis in pathology: benefits and obligation. Anal Cell Pathol (Amst). 2012, 35: 75-78.CrossRef Laurinavicius A, Laurinaviciene A, Dasevicius D, Elie N, Plancoulaine B, Bor C, Herlin P: Digital image analysis in pathology: benefits and obligation. Anal Cell Pathol (Amst). 2012, 35: 75-78.CrossRef
8.
go back to reference Tadrous PJ: On the concept of objectivity in digital image analysis in pathology. Pathology. 2010, 42: 207-211. 10.3109/00313021003641758.CrossRefPubMed Tadrous PJ: On the concept of objectivity in digital image analysis in pathology. Pathology. 2010, 42: 207-211. 10.3109/00313021003641758.CrossRefPubMed
9.
go back to reference Riber-Hansen R, Vainer B, Steiniche T: Digital image analysis: a review of reproducibility, stability and basic requirements for optimal results. APMIS. 2012, 120: 276-289. 10.1111/j.1600-0463.2011.02854.x.CrossRefPubMed Riber-Hansen R, Vainer B, Steiniche T: Digital image analysis: a review of reproducibility, stability and basic requirements for optimal results. APMIS. 2012, 120: 276-289. 10.1111/j.1600-0463.2011.02854.x.CrossRefPubMed
10.
go back to reference Goldhirsch A, Wood WC, Coates AS, Gelber RD, Thurlimann B, Senn HJ: Strategies for subtypes–dealing with the diversity of breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2011. Ann Oncol. 2011, 22: 1736-1747. 10.1093/annonc/mdr304.CrossRefPubMedPubMedCentral Goldhirsch A, Wood WC, Coates AS, Gelber RD, Thurlimann B, Senn HJ: Strategies for subtypes–dealing with the diversity of breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2011. Ann Oncol. 2011, 22: 1736-1747. 10.1093/annonc/mdr304.CrossRefPubMedPubMedCentral
11.
go back to reference Dowsett M, Nielsen TO, A’Hern R, Bartlett J, Coombes RC, Cuzick J, Ellis M, Henry NL, Hugh JC, Lively T, McShane L, Paik S, Penault-Llorca F, Prudkin L, Regan M, Salter J, Sotiriou C, Smith IE, Viale G, Zujewski JA, Hayes D, International Ki67 in Breast Cancer Working Group: Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in Breast Cancer working group. J Natl Cancer Inst. 2011, 103: 1656-1664. 10.1093/jnci/djr393.CrossRefPubMedPubMedCentral Dowsett M, Nielsen TO, A’Hern R, Bartlett J, Coombes RC, Cuzick J, Ellis M, Henry NL, Hugh JC, Lively T, McShane L, Paik S, Penault-Llorca F, Prudkin L, Regan M, Salter J, Sotiriou C, Smith IE, Viale G, Zujewski JA, Hayes D, International Ki67 in Breast Cancer Working Group: Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in Breast Cancer working group. J Natl Cancer Inst. 2011, 103: 1656-1664. 10.1093/jnci/djr393.CrossRefPubMedPubMedCentral
12.
go back to reference Gudlaugsson E, Skaland I, Janssen EA, Smaaland R, Shao Z, Malpica A, Voorhorst F, Baak JP: Comparison of the effect of different techniques for measurement of Ki67 proliferation on reproducibility and prognosis prediction accuracy in breast cancer. Histopathology. 2012, 61: 1134-1144. 10.1111/j.1365-2559.2012.04329.x.CrossRefPubMed Gudlaugsson E, Skaland I, Janssen EA, Smaaland R, Shao Z, Malpica A, Voorhorst F, Baak JP: Comparison of the effect of different techniques for measurement of Ki67 proliferation on reproducibility and prognosis prediction accuracy in breast cancer. Histopathology. 2012, 61: 1134-1144. 10.1111/j.1365-2559.2012.04329.x.CrossRefPubMed
13.
go back to reference Laurinavicius A, Laurinaviciene A, Ostapenko V, Dasevicius D, Jarmalaite S, Lazutka J: Immunohistochemistry profiles of breast ductal carcinoma: factor analysis of digital image analysis data. Diagn Pathol. 2012, 7: 27-10.1186/1746-1596-7-27.CrossRefPubMedPubMedCentral Laurinavicius A, Laurinaviciene A, Ostapenko V, Dasevicius D, Jarmalaite S, Lazutka J: Immunohistochemistry profiles of breast ductal carcinoma: factor analysis of digital image analysis data. Diagn Pathol. 2012, 7: 27-10.1186/1746-1596-7-27.CrossRefPubMedPubMedCentral
14.
go back to reference Gundersen HJ, Bendtsen TF, Korbo L, Marcussen N, Moller A, Nielsen K, Nyengaard JR, Pakkenberg B, Sorensen FB, Vesterby A, West MJ: Some new, simple and efficient stereological methods and their use in pathological research and diagnosis. APMIS. 1988, 96: 379-394. 10.1111/j.1699-0463.1988.tb05320.x.CrossRefPubMed Gundersen HJ, Bendtsen TF, Korbo L, Marcussen N, Moller A, Nielsen K, Nyengaard JR, Pakkenberg B, Sorensen FB, Vesterby A, West MJ: Some new, simple and efficient stereological methods and their use in pathological research and diagnosis. APMIS. 1988, 96: 379-394. 10.1111/j.1699-0463.1988.tb05320.x.CrossRefPubMed
15.
go back to reference Baddeley A, Jensen EBV: Stereology for Statisticians. 2005, Boca Raton, FL, USA: Chapman & Hall/CRC Baddeley A, Jensen EBV: Stereology for Statisticians. 2005, Boca Raton, FL, USA: Chapman & Hall/CRC
16.
go back to reference Kieu K, Mora M: Precision of stereological planar area predictors. J Microsc. 2006, 222: 201-211. 10.1111/j.1365-2818.2006.01588.x.CrossRefPubMed Kieu K, Mora M: Precision of stereological planar area predictors. J Microsc. 2006, 222: 201-211. 10.1111/j.1365-2818.2006.01588.x.CrossRefPubMed
17.
go back to reference Kieu K, Mora M, et al: Advances on the precision of several stereological volume estimators. Ecs10: The 10th European Congress of Stereology and Image Analysis: June 22-26, 2009. Edited by: Capasso V. 2009, Bologna, Italy: The MIRIAM Project Series, ESCULAPIO Pub. Co., 17-26. Kieu K, Mora M, et al: Advances on the precision of several stereological volume estimators. Ecs10: The 10th European Congress of Stereology and Image Analysis: June 22-26, 2009. Edited by: Capasso V. 2009, Bologna, Italy: The MIRIAM Project Series, ESCULAPIO Pub. Co., 17-26.
18.
go back to reference Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res. 1999, 8: 135-160. 10.1191/096228099673819272.CrossRefPubMed Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res. 1999, 8: 135-160. 10.1191/096228099673819272.CrossRefPubMed
19.
go back to reference Krouwer JS: Method Comparison and Bias Estimation Using Patient Samples: Approved Guidelines. 2010, Wayne, PA, USA: Clinical and Laboratory Standards Institute, 2 Krouwer JS: Method Comparison and Bias Estimation Using Patient Samples: Approved Guidelines. 2010, Wayne, PA, USA: Clinical and Laboratory Standards Institute, 2
20.
go back to reference Rimm DL, Giltnane JM, Moeder C, Harigopal M, Chung GG, Camp RL, Burtness B: Bimodal population or pathologist artifact?. J Clin Oncol. 2007, 25: 2487-2488. 10.1200/JCO.2006.07.7537.CrossRefPubMed Rimm DL, Giltnane JM, Moeder C, Harigopal M, Chung GG, Camp RL, Burtness B: Bimodal population or pathologist artifact?. J Clin Oncol. 2007, 25: 2487-2488. 10.1200/JCO.2006.07.7537.CrossRefPubMed
21.
go back to reference Goldhirsch A, Winer EP, Coates AS, Gelber RD, Piccart-Gebhart M, Thurlimann B, Senn HJ: Personalizing the treatment of women with early breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2013. Ann Oncol. 2013, 24: 2206-2223. 10.1093/annonc/mdt303.CrossRefPubMedPubMedCentral Goldhirsch A, Winer EP, Coates AS, Gelber RD, Piccart-Gebhart M, Thurlimann B, Senn HJ: Personalizing the treatment of women with early breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2013. Ann Oncol. 2013, 24: 2206-2223. 10.1093/annonc/mdt303.CrossRefPubMedPubMedCentral
22.
go back to reference Cuzick J, Dowsett M, Pineda S, Wale C, Salter J, Quinn E, Zabaglo L, Mallon E, Green AR, Ellis IO, Howell A, Buzdar AU, Forbes JF: Prognostic value of a combined estrogen receptor, progesterone receptor, ki-67, and human epidermal growth factor receptor 2 immunohistochemical score and comparison with the genomic health recurrence score in early breast cancer. J Clin Oncol. 2011, 29: 4273-4278. 10.1200/JCO.2010.31.2835.CrossRefPubMed Cuzick J, Dowsett M, Pineda S, Wale C, Salter J, Quinn E, Zabaglo L, Mallon E, Green AR, Ellis IO, Howell A, Buzdar AU, Forbes JF: Prognostic value of a combined estrogen receptor, progesterone receptor, ki-67, and human epidermal growth factor receptor 2 immunohistochemical score and comparison with the genomic health recurrence score in early breast cancer. J Clin Oncol. 2011, 29: 4273-4278. 10.1200/JCO.2010.31.2835.CrossRefPubMed
23.
go back to reference Rakha EA, Reis-Filho JS, Ellis IO: Combinatorial biomarker expression in breast cancer. Breast Cancer Res Treat. 2010, 120: 293-308. 10.1007/s10549-010-0746-x.CrossRefPubMed Rakha EA, Reis-Filho JS, Ellis IO: Combinatorial biomarker expression in breast cancer. Breast Cancer Res Treat. 2010, 120: 293-308. 10.1007/s10549-010-0746-x.CrossRefPubMed
24.
go back to reference Varga Z, Diebold J, Dommann-Scherrer C, Frick H, Kaup D, Noske A, Obermann E, Ohlschlegel C, Padberg B, Rakozy C, Oliver SS, Schobinger-Clement S, Schreiber-Facklam H, Singer G, Tapia C, Wagner U, Mastropasqua MG, Viale G, Lehr HA: How reliable Is Ki-67 immunohistochemistry in grade 2 breast carcinomas? A QA study of the Swiss Working Group of Breast- and Gynecopathologists. PLoS One. 2012, 7: 5- Varga Z, Diebold J, Dommann-Scherrer C, Frick H, Kaup D, Noske A, Obermann E, Ohlschlegel C, Padberg B, Rakozy C, Oliver SS, Schobinger-Clement S, Schreiber-Facklam H, Singer G, Tapia C, Wagner U, Mastropasqua MG, Viale G, Lehr HA: How reliable Is Ki-67 immunohistochemistry in grade 2 breast carcinomas? A QA study of the Swiss Working Group of Breast- and Gynecopathologists. PLoS One. 2012, 7: 5-
25.
go back to reference Going JJ: Techniques of mitosis counting. Hum Pathol. 1993, 24: 113-114. 10.1016/0046-8177(93)90072-O.CrossRefPubMed Going JJ: Techniques of mitosis counting. Hum Pathol. 1993, 24: 113-114. 10.1016/0046-8177(93)90072-O.CrossRefPubMed
26.
go back to reference Mohammed ZM, McMillan DC, Elsberger B, Going JJ, Orange C, Mallon E, Doughty JC, Edwards J: Comparison of visual and automated assessment of Ki-67 proliferative activity and their impact on outcome in primary operable invasive ductal breast cancer. Br J Cancer. 2012, 106: 383-388. 10.1038/bjc.2011.569.CrossRefPubMedPubMedCentral Mohammed ZM, McMillan DC, Elsberger B, Going JJ, Orange C, Mallon E, Doughty JC, Edwards J: Comparison of visual and automated assessment of Ki-67 proliferative activity and their impact on outcome in primary operable invasive ductal breast cancer. Br J Cancer. 2012, 106: 383-388. 10.1038/bjc.2011.569.CrossRefPubMedPubMedCentral
Metadata
Title
A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue
Authors
Arvydas Laurinavicius
Benoit Plancoulaine
Aida Laurinaviciene
Paulette Herlin
Raimundas Meskauskas
Indra Baltrusaityte
Justinas Besusparis
Darius Dasevicius
Nicolas Elie
Yasir Iqbal
Catherine Bor
Ian O Ellis
Publication date
01-04-2014
Publisher
BioMed Central
Published in
Breast Cancer Research / Issue 2/2014
Electronic ISSN: 1465-542X
DOI
https://doi.org/10.1186/bcr3639

Other articles of this Issue 2/2014

Breast Cancer Research 2/2014 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine