Skip to main content
Top
Published in: BMC Cancer 1/2013

Open Access 01-12-2013 | Technical advance

Automatic registration of multi-modal microscopy images for integrative analysis of prostate tissue sections

Authors: Giuseppe Lippolis, Anders Edsjö, Leszek Helczynski, Anders Bjartell, Niels Chr Overgaard

Published in: BMC Cancer | Issue 1/2013

Login to get access

Abstract

Background

Prostate cancer is one of the leading causes of cancer related deaths. For diagnosis, predicting the outcome of the disease, and for assessing potential new biomarkers, pathologists and researchers routinely analyze histological samples. Morphological and molecular information may be integrated by aligning microscopic histological images in a multiplex fashion. This process is usually time-consuming and results in intra- and inter-user variability. The aim of this study is to investigate the feasibility of using modern image analysis methods for automated alignment of microscopic images from differently stained adjacent paraffin sections from prostatic tissue specimens.

Methods

Tissue samples, obtained from biopsy or radical prostatectomy, were sectioned and stained with either hematoxylin & eosin (H&E), immunohistochemistry for p63 and AMACR or Time Resolved Fluorescence (TRF) for androgen receptor (AR).
Image pairs were aligned allowing for translation, rotation and scaling. The registration was performed automatically by first detecting landmarks in both images, using the scale invariant image transform (SIFT), followed by the well-known RANSAC protocol for finding point correspondences and finally aligned by Procrustes fit. The Registration results were evaluated using both visual and quantitative criteria as defined in the text.

Results

Three experiments were carried out. First, images of consecutive tissue sections stained with H&E and p63/AMACR were successfully aligned in 85 of 88 cases (96.6%). The failures occurred in 3 out of 13 cores with highly aggressive cancer (Gleason score ≥ 8). Second, TRF and H&E image pairs were aligned correctly in 103 out of 106 cases (97%).
The third experiment considered the alignment of image pairs with the same staining (H&E) coming from a stack of 4 sections. The success rate for alignment dropped from 93.8% in adjacent sections to 22% for sections furthest away.

Conclusions

The proposed method is both reliable and fast and therefore well suited for automatic segmentation and analysis of specific areas of interest, combining morphological information with protein expression data from three consecutive tissue sections. Finally, the performance of the algorithm seems to be largely unaffected by the Gleason grade of the prostate tissue samples examined, at least up to Gleason score 7.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jemal A, Bray F, Center MM, Ferlay J, Ward E, Forman D: Global cancer statistics. CA Cancer J Clin. 2011, 61 (2): 69-90. 10.3322/caac.20107.CrossRefPubMed Jemal A, Bray F, Center MM, Ferlay J, Ward E, Forman D: Global cancer statistics. CA Cancer J Clin. 2011, 61 (2): 69-90. 10.3322/caac.20107.CrossRefPubMed
2.
go back to reference Heidenreich A, Aus G, Bolla M, Joniau S, Matveev VB, Schmid HP, Zattoni F: EAU guidelines on prostate cancer. Eur Urol. 2008, 53 (1): 68-80. 10.1016/j.eururo.2007.09.002.CrossRefPubMed Heidenreich A, Aus G, Bolla M, Joniau S, Matveev VB, Schmid HP, Zattoni F: EAU guidelines on prostate cancer. Eur Urol. 2008, 53 (1): 68-80. 10.1016/j.eururo.2007.09.002.CrossRefPubMed
3.
go back to reference Gleason DF: Classification of prostatic carcinomas. Cancer Chemother Rep. 1966, 50 (3): 125-128.PubMed Gleason DF: Classification of prostatic carcinomas. Cancer Chemother Rep. 1966, 50 (3): 125-128.PubMed
4.
go back to reference Bjartell A, Montironi R, Berney DM, Egevad L: Tumour markers in prostate cancer II: diagnostic and prognostic cellular biomarkers. Acta Oncol. 2011, 50 (Suppl 1): 76-84.CrossRefPubMed Bjartell A, Montironi R, Berney DM, Egevad L: Tumour markers in prostate cancer II: diagnostic and prognostic cellular biomarkers. Acta Oncol. 2011, 50 (Suppl 1): 76-84.CrossRefPubMed
5.
go back to reference Kononen J, Bubendorf L, Kallioniemi A, Barlund M, Schraml P, Leighton S, Torhorst J, Mihatsch MJ, Sauter G, Kallioniemi OP: Tissue microarrays for high-throughput molecular profiling of tumor specimens. Nat Med. 1998, 4 (7): 844-847. 10.1038/nm0798-844.CrossRefPubMed Kononen J, Bubendorf L, Kallioniemi A, Barlund M, Schraml P, Leighton S, Torhorst J, Mihatsch MJ, Sauter G, Kallioniemi OP: Tissue microarrays for high-throughput molecular profiling of tumor specimens. Nat Med. 1998, 4 (7): 844-847. 10.1038/nm0798-844.CrossRefPubMed
6.
go back to reference Bubendorf L, Nocito A, Moch H, Sauter G: Tissue microarray (TMA) technology: miniaturized pathology archives for high-throughput in situ studies. J Pathol. 2001, 195 (1): 72-79. 10.1002/path.893.CrossRefPubMed Bubendorf L, Nocito A, Moch H, Sauter G: Tissue microarray (TMA) technology: miniaturized pathology archives for high-throughput in situ studies. J Pathol. 2001, 195 (1): 72-79. 10.1002/path.893.CrossRefPubMed
7.
go back to reference He L, Long LR, Antani S, Thoma GR: Histology image analysis for carcinoma detection and grading. Comput Methods Programs Biomed. 2012, 107 (3): 538-556. 10.1016/j.cmpb.2011.12.007.CrossRefPubMedPubMedCentral He L, Long LR, Antani S, Thoma GR: Histology image analysis for carcinoma detection and grading. Comput Methods Programs Biomed. 2012, 107 (3): 538-556. 10.1016/j.cmpb.2011.12.007.CrossRefPubMedPubMedCentral
8.
go back to reference Ho J, Parwani AV, Jukic DM, Yagi Y, Anthony L, Gilbertson JR: Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. Hum Pathol. 2006, 37 (3): 322-331. 10.1016/j.humpath.2005.11.005.CrossRefPubMed Ho J, Parwani AV, Jukic DM, Yagi Y, Anthony L, Gilbertson JR: Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. Hum Pathol. 2006, 37 (3): 322-331. 10.1016/j.humpath.2005.11.005.CrossRefPubMed
9.
go back to reference Braumann UD, Kuska JP, Einenkel J, Horn LC, Loffler M, Hockel M: Three-dimensional reconstruction and quantification of cervical carcinoma invasion fronts from histological serial sections. IEEE Transactions on Medical Imaging. 2005, 24 (10): 1286-1307.CrossRefPubMed Braumann UD, Kuska JP, Einenkel J, Horn LC, Loffler M, Hockel M: Three-dimensional reconstruction and quantification of cervical carcinoma invasion fronts from histological serial sections. IEEE Transactions on Medical Imaging. 2005, 24 (10): 1286-1307.CrossRefPubMed
10.
go back to reference Kwak JT, Hewitt SM, Sinha S, Bhargava R: Multimodal microscopy for automated histologic analysis of prostate cancer. BMC Cancer. 2011, 11: 62-10.1186/1471-2407-11-62.CrossRefPubMedPubMedCentral Kwak JT, Hewitt SM, Sinha S, Bhargava R: Multimodal microscopy for automated histologic analysis of prostate cancer. BMC Cancer. 2011, 11: 62-10.1186/1471-2407-11-62.CrossRefPubMedPubMedCentral
11.
go back to reference Park H, Piert MR, Khan A, Shah R, Hussain H, Siddiqui J, Chenevert TL, Meyer CR: Registration methodology for histological sections and in vivo imaging of human prostate. Acad Radiol. 2008, 15 (8): 1027-1039. 10.1016/j.acra.2008.01.022.CrossRefPubMedPubMedCentral Park H, Piert MR, Khan A, Shah R, Hussain H, Siddiqui J, Chenevert TL, Meyer CR: Registration methodology for histological sections and in vivo imaging of human prostate. Acad Radiol. 2008, 15 (8): 1027-1039. 10.1016/j.acra.2008.01.022.CrossRefPubMedPubMedCentral
12.
go back to reference Wahlby C, Erlandsson F, Bengtsson E, Zetterberg A: Sequential immunofluorescence staining and image analysis for detection of large numbers of antigens in individual cell nuclei. Cytometry. 2002, 47 (1): 32-41. 10.1002/cyto.10026.CrossRefPubMed Wahlby C, Erlandsson F, Bengtsson E, Zetterberg A: Sequential immunofluorescence staining and image analysis for detection of large numbers of antigens in individual cell nuclei. Cytometry. 2002, 47 (1): 32-41. 10.1002/cyto.10026.CrossRefPubMed
13.
go back to reference Lowe DG: Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, Volume 2. 1999, Kerkyra, Greece: IEEE Computer Society, 1150-1157.CrossRef Lowe DG: Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, Volume 2. 1999, Kerkyra, Greece: IEEE Computer Society, 1150-1157.CrossRef
14.
go back to reference Chen J, Tian J: Rapid multi-modality preregistration based on SIFT descriptor. Conf Proc IEEE Eng Med Biol Soc: 30 Aug-3 Sep 2006; New York, USA. 2006, Piscataway, NJ: IEEE Service Center, USA, 1437-1440.CrossRef Chen J, Tian J: Rapid multi-modality preregistration based on SIFT descriptor. Conf Proc IEEE Eng Med Biol Soc: 30 Aug-3 Sep 2006; New York, USA. 2006, Piscataway, NJ: IEEE Service Center, USA, 1437-1440.CrossRef
15.
go back to reference Tang CM, Dong Y, Su XH: Automatic Registration based on Improved SIFT for Medical Microscopic Sequence Images. Proceedings of 2008 International Symposium on Intelligent Information Technology Application: 20-22 Dec 2008, Volume 1. 2008, Shanghai, China: IEEE Computer Society, 580-583.CrossRef Tang CM, Dong Y, Su XH: Automatic Registration based on Improved SIFT for Medical Microscopic Sequence Images. Proceedings of 2008 International Symposium on Intelligent Information Technology Application: 20-22 Dec 2008, Volume 1. 2008, Shanghai, China: IEEE Computer Society, 580-583.CrossRef
16.
go back to reference Wei LF, Pan L, Lin L, Yu L: The Retinal Image Registration Based on Scale Invariant Feature. 3rd International Conference on Biomedical Engineering and Informatics (Bmei 2010): 16-18 Oct 2010, Volume 2. 2010, Yantai, China: IEEE, 639-643.CrossRef Wei LF, Pan L, Lin L, Yu L: The Retinal Image Registration Based on Scale Invariant Feature. 3rd International Conference on Biomedical Engineering and Informatics (Bmei 2010): 16-18 Oct 2010, Volume 2. 2010, Yantai, China: IEEE, 639-643.CrossRef
17.
go back to reference Zhan Y, Feldman M, Tomaszeweski J, Davatzikos C, Shen D: Registering histological and MR images of prostate for image-based cancer detection. Med Image Comput Comput Assist Interv. 2006, 9 (Pt 2): 620-628.PubMed Zhan Y, Feldman M, Tomaszeweski J, Davatzikos C, Shen D: Registering histological and MR images of prostate for image-based cancer detection. Med Image Comput Comput Assist Interv. 2006, 9 (Pt 2): 620-628.PubMed
18.
go back to reference Seveus L, Vaisala M, Syrjanen S, Sandberg M, Kuusisto A, Harju R, Salo J, Hemmila I, Kojola H, Soini E: Time-resolved fluorescence imaging of europium chelate label in immunohistochemistry and in situ hybridization. Cytometry. 1992, 13 (4): 329-338. 10.1002/cyto.990130402.CrossRefPubMed Seveus L, Vaisala M, Syrjanen S, Sandberg M, Kuusisto A, Harju R, Salo J, Hemmila I, Kojola H, Soini E: Time-resolved fluorescence imaging of europium chelate label in immunohistochemistry and in situ hybridization. Cytometry. 1992, 13 (4): 329-338. 10.1002/cyto.990130402.CrossRefPubMed
19.
go back to reference Siivola P, Pettersson K, Piironen T, Lovgren T, Lilja H, Bjartell A: Time-resolved fluorescence imaging for specific and quantitative immunodetection of human kallikrein 2 and prostate-specific antigen in prostatic tissue sections. Urology. 2000, 56 (4): 682-688. 10.1016/S0090-4295(00)00671-3.CrossRefPubMed Siivola P, Pettersson K, Piironen T, Lovgren T, Lilja H, Bjartell A: Time-resolved fluorescence imaging for specific and quantitative immunodetection of human kallikrein 2 and prostate-specific antigen in prostatic tissue sections. Urology. 2000, 56 (4): 682-688. 10.1016/S0090-4295(00)00671-3.CrossRefPubMed
20.
go back to reference Epstein JI, Allsbrook WC, Amin MB, Egevad LL: The 2005 international society of urological pathology (ISUP) consensus conference on Gleason grading of prostatic carcinoma. Am J Surg Pathol. 2005, 29 (9): 1228-1242. 10.1097/01.pas.0000173646.99337.b1.CrossRefPubMed Epstein JI, Allsbrook WC, Amin MB, Egevad LL: The 2005 international society of urological pathology (ISUP) consensus conference on Gleason grading of prostatic carcinoma. Am J Surg Pathol. 2005, 29 (9): 1228-1242. 10.1097/01.pas.0000173646.99337.b1.CrossRefPubMed
21.
go back to reference Mellinger GT, Gleason D, Bailar J: The histology and prognosis of prostatic cancer. J Urol. 1967, 97 (2): 331-337.PubMed Mellinger GT, Gleason D, Bailar J: The histology and prognosis of prostatic cancer. J Urol. 1967, 97 (2): 331-337.PubMed
22.
go back to reference Zitova B, Flusser J: Image registration methods: a survey. Image and Vision Computing. 2003, 21 (11): 977-1000. 10.1016/S0262-8856(03)00137-9.CrossRef Zitova B, Flusser J: Image registration methods: a survey. Image and Vision Computing. 2003, 21 (11): 977-1000. 10.1016/S0262-8856(03)00137-9.CrossRef
23.
go back to reference Lowe DG: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision. 2004, 60 (2): 91-110.CrossRef Lowe DG: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision. 2004, 60 (2): 91-110.CrossRef
25.
go back to reference Fischler MA, Bolles RC: Random sample consensus - a paradigm for model-fitting with applications to image-analysis and automated cartography. Communications of the Acm. 1981, 24 (6): 381-395. 10.1145/358669.358692.CrossRef Fischler MA, Bolles RC: Random sample consensus - a paradigm for model-fitting with applications to image-analysis and automated cartography. Communications of the Acm. 1981, 24 (6): 381-395. 10.1145/358669.358692.CrossRef
26.
go back to reference Beis JS, Lowe DG: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings: 17-19 Jun 1997. 1997, San Juan, Puerto Rico: IEEE Computer Society, 1000-1006.CrossRef Beis JS, Lowe DG: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings: 17-19 Jun 1997. 1997, San Juan, Puerto Rico: IEEE Computer Society, 1000-1006.CrossRef
Metadata
Title
Automatic registration of multi-modal microscopy images for integrative analysis of prostate tissue sections
Authors
Giuseppe Lippolis
Anders Edsjö
Leszek Helczynski
Anders Bjartell
Niels Chr Overgaard
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2013
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/1471-2407-13-408

Other articles of this Issue 1/2013

BMC Cancer 1/2013 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine