Skip to main content
Top
Published in: Diagnostic Pathology 1/2013

Open Access 01-12-2013 | Software

CognitionMaster: an object-based image analysis framework

Authors: Stephan Wienert, Daniel Heim, Manato Kotani, Björn Lindequist, Albrecht Stenzinger, Masaru Ishii, Peter Hufnagl, Michael Beil, Manfred Dietel, Carsten Denkert, Frederick Klauschen

Published in: Diagnostic Pathology | Issue 1/2013

Login to get access

Abstract

Background

Automated image analysis methods are becoming more and more important to extract and quantify image features in microscopy-based biomedical studies and several commercial or open-source tools are available. However, most of the approaches rely on pixel-wise operations, a concept that has limitations when high-level object features and relationships between objects are studied and if user-interactivity on the object-level is desired.

Results

In this paper we present an open-source software that facilitates the analysis of content features and object relationships by using objects as basic processing unit instead of individual pixels. Our approach enables also users without programming knowledge to compose “analysis pipelines“ that exploit the object-level approach. We demonstrate the design and use of example pipelines for the immunohistochemistry-based cell proliferation quantification in breast cancer and two-photon fluorescence microscopy data about bone-osteoclast interaction, which underline the advantages of the object-based concept.

Conclusions

We introduce an open source software system that offers object-based image analysis. The object-based concept allows for a straight-forward development of object-related interactive or fully automated image analysis solutions. The presented software may therefore serve as a basis for various applications in the field of digital image analysis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Graham J, Taylor CJ: Automated chromosome analysis using the magiscan image analyser. Anal Quant Cytol. 1980, 2: 237-242.PubMed Graham J, Taylor CJ: Automated chromosome analysis using the magiscan image analyser. Anal Quant Cytol. 1980, 2: 237-242.PubMed
2.
go back to reference Salazar I, Cifuentes JM, Sánchez Quinteiro P, Garcia Caballero T: Structural, morphometric, and immunohistological study of the accessory olfactory bulb in the dog. Anat Rec. 1994, 240: 277-285. 10.1002/ar.1092400216.CrossRefPubMed Salazar I, Cifuentes JM, Sánchez Quinteiro P, Garcia Caballero T: Structural, morphometric, and immunohistological study of the accessory olfactory bulb in the dog. Anat Rec. 1994, 240: 277-285. 10.1002/ar.1092400216.CrossRefPubMed
3.
go back to reference Portet S, Vassy J, Beil M, Millot G, Hebbache A, Rigaut JP, Schoëvaërt D: Quantitative analysis of cytokeratin network topology in the MCF7 cell line. Cytometry. 1999, 35: 203-213. 10.1002/(SICI)1097-0320(19990301)35:3<203::AID-CYTO3>3.0.CO;2-K.CrossRefPubMed Portet S, Vassy J, Beil M, Millot G, Hebbache A, Rigaut JP, Schoëvaërt D: Quantitative analysis of cytokeratin network topology in the MCF7 cell line. Cytometry. 1999, 35: 203-213. 10.1002/(SICI)1097-0320(19990301)35:3<203::AID-CYTO3>3.0.CO;2-K.CrossRefPubMed
4.
go back to reference Brinkmann M, Lütkemeyer D, Gudermann F, Lehmann J: New technologies for automated cell counting based on optical image analysis; The Cellscreen’. Cytotechnology. 2002, 38: 119-127. 10.1023/A:1021118501866.PubMedCentralCrossRefPubMed Brinkmann M, Lütkemeyer D, Gudermann F, Lehmann J: New technologies for automated cell counting based on optical image analysis; The Cellscreen’. Cytotechnology. 2002, 38: 119-127. 10.1023/A:1021118501866.PubMedCentralCrossRefPubMed
5.
go back to reference Gutiérrez R, Gómez F, Roa-Peña L, Romero E: A supervised visual model for finding regions of interest in basal cell carcinoma images. Diagn Pathol. 2011, 6: 26-10.1186/1746-1596-6-26.PubMedCentralCrossRefPubMed Gutiérrez R, Gómez F, Roa-Peña L, Romero E: A supervised visual model for finding regions of interest in basal cell carcinoma images. Diagn Pathol. 2011, 6: 26-10.1186/1746-1596-6-26.PubMedCentralCrossRefPubMed
6.
go back to reference Grimm M, Krimmel M, Alexander D, Munz A, Kluba S, Keutel C, Hoffmann J, Polligkeit J, Reinert S, Hoefert S: Prognostic value of histamine H1 receptor expression in oral squamous cell carcinoma. Clin Oral Investig. 2012, Epub ahead of print Grimm M, Krimmel M, Alexander D, Munz A, Kluba S, Keutel C, Hoffmann J, Polligkeit J, Reinert S, Hoefert S: Prognostic value of histamine H1 receptor expression in oral squamous cell carcinoma. Clin Oral Investig. 2012, Epub ahead of print
7.
go back to reference Schneider CA, Rasband WS, Eliceiri KW: NIH Image to ImageJ: 25 years of image analysis. Nat Meth. 2012, 9: 671-675. 10.1038/nmeth.2089.CrossRef Schneider CA, Rasband WS, Eliceiri KW: NIH Image to ImageJ: 25 years of image analysis. Nat Meth. 2012, 9: 671-675. 10.1038/nmeth.2089.CrossRef
8.
go back to reference Jones TR, Kang I, Wheeler DB, Lindquist RA, Papallo A, Sabatini DM, Golland P, Carpenter AE: Cell profiler analyst: data exploration and analysis software for complex image-based screens. BMC Bioinforma. 2008, 9: 482-10.1186/1471-2105-9-482.CrossRef Jones TR, Kang I, Wheeler DB, Lindquist RA, Papallo A, Sabatini DM, Golland P, Carpenter AE: Cell profiler analyst: data exploration and analysis software for complex image-based screens. BMC Bioinforma. 2008, 9: 482-10.1186/1471-2105-9-482.CrossRef
9.
go back to reference Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, Preibisch S, Rueden C, Saalfeld S, Schmid B, Tinevez J, White DJ, Hartenstein V, Eliceiri K, Tomancak P, Cardona A: Fiji: an open-source platform for biological-image analysis. Nat Meth. 2012, 9: 676-682. 10.1038/nmeth.2019.CrossRef Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, Preibisch S, Rueden C, Saalfeld S, Schmid B, Tinevez J, White DJ, Hartenstein V, Eliceiri K, Tomancak P, Cardona A: Fiji: an open-source platform for biological-image analysis. Nat Meth. 2012, 9: 676-682. 10.1038/nmeth.2019.CrossRef
10.
go back to reference de Chaumont F, Dallongeville S, Chenouard N, Hervé N, Pop S, Provoost T, Meas-Yedid V, Pankajakshan P, Lecomte T, Le Montagner Y, Lagache T, Dufour A, Olivo-Marin J: Icy: an open bioimage informatics platform for extended reproducible research. Nat Meth. 2012, 9: 690-696. 10.1038/nmeth.2075.CrossRef de Chaumont F, Dallongeville S, Chenouard N, Hervé N, Pop S, Provoost T, Meas-Yedid V, Pankajakshan P, Lecomte T, Le Montagner Y, Lagache T, Dufour A, Olivo-Marin J: Icy: an open bioimage informatics platform for extended reproducible research. Nat Meth. 2012, 9: 690-696. 10.1038/nmeth.2075.CrossRef
12.
go back to reference Yoo TS, Ackerman MJ, Lorensen WE, Schroeder W, Chalana V, Aylward S, Metaxas D, Whitaker R: Engineering and algorithm design for an image processing Api: a technical report on ITK–the insight toolkit. Stud Health Technol Inform. 2002, 85: 586-592.PubMed Yoo TS, Ackerman MJ, Lorensen WE, Schroeder W, Chalana V, Aylward S, Metaxas D, Whitaker R: Engineering and algorithm design for an image processing Api: a technical report on ITK–the insight toolkit. Stud Health Technol Inform. 2002, 85: 586-592.PubMed
13.
go back to reference Kayser K, Görtler J, Borkenfeld S, Kayser G: How to measure diagnosis-associated information in virtual slides. Diagn Pathol. 2011, 6 (Suppl 1): S9-10.1186/1746-1596-6-S1-S9.PubMedCentralCrossRefPubMed Kayser K, Görtler J, Borkenfeld S, Kayser G: How to measure diagnosis-associated information in virtual slides. Diagn Pathol. 2011, 6 (Suppl 1): S9-10.1186/1746-1596-6-S1-S9.PubMedCentralCrossRefPubMed
14.
go back to reference Blaschke T, Strobl J: What’s wrong with pixels? Some recent developments interfacing remote sensing and GIS. GIS-Zeitschrift für Geoinformationssysteme. 2001, 06: 12-17. Blaschke T, Strobl J: What’s wrong with pixels? Some recent developments interfacing remote sensing and GIS. GIS-Zeitschrift für Geoinformationssysteme. 2001, 06: 12-17.
15.
go back to reference Hay GJ, Castilla G, Wulder MA, Ruiz JR: An automated object-based approach for the multiscale image segmentation of forest scenes. Int J Appl Earth Obs Geoinf. 2005, 7: 339-359. 10.1016/j.jag.2005.06.005.CrossRef Hay GJ, Castilla G, Wulder MA, Ruiz JR: An automated object-based approach for the multiscale image segmentation of forest scenes. Int J Appl Earth Obs Geoinf. 2005, 7: 339-359. 10.1016/j.jag.2005.06.005.CrossRef
16.
go back to reference Baatz M, Arini N, Schäpe A, Binnig G, Linssen B: Object-oriented image analysis for high content screening: detailed quantification of cells and sub cellular structures with the cellenger software. Cytometry A. 2006, 69: 652-658.CrossRefPubMed Baatz M, Arini N, Schäpe A, Binnig G, Linssen B: Object-oriented image analysis for high content screening: detailed quantification of cells and sub cellular structures with the cellenger software. Cytometry A. 2006, 69: 652-658.CrossRefPubMed
17.
go back to reference Bouzubar N, Walker KJ, Griffiths K, Ellis IO, Elston CW, Robertson JF, Blamey RW, Nicholson RI: Ki67 immunostaining in primary breast cancer: pathological and clinical associations. Br J Cancer. 1989, 59: 943-947. 10.1038/bjc.1989.200.PubMedCentralCrossRefPubMed Bouzubar N, Walker KJ, Griffiths K, Ellis IO, Elston CW, Robertson JF, Blamey RW, Nicholson RI: Ki67 immunostaining in primary breast cancer: pathological and clinical associations. Br J Cancer. 1989, 59: 943-947. 10.1038/bjc.1989.200.PubMedCentralCrossRefPubMed
18.
go back to reference Gerdes J: Ki-67 and other proliferation markers useful for immunohistological diagnostic and prognostic evaluations in human malignancies. Semin Cancer Biol. 1990, 1: 199-206.PubMed Gerdes J: Ki-67 and other proliferation markers useful for immunohistological diagnostic and prognostic evaluations in human malignancies. Semin Cancer Biol. 1990, 1: 199-206.PubMed
19.
go back to reference Ishii M, Egen JG, Klauschen F, Meier-Schellersheim M, Saeki Y, Vacher J, Proia RL, Germain RN: Sphingosine-1-phosphate mobilizes osteoclast precursors and regulates bone homeostasis. Nature. 2010, 465: 966-CrossRef Ishii M, Egen JG, Klauschen F, Meier-Schellersheim M, Saeki Y, Vacher J, Proia RL, Germain RN: Sphingosine-1-phosphate mobilizes osteoclast precursors and regulates bone homeostasis. Nature. 2010, 465: 966-CrossRef
20.
go back to reference Klauschen F, Ishii M, Qi H, Bajénoff M, Egen JG, Germain RN, Meier-Schellersheim M: Quantifying cellular interaction dynamics in 3D fluorescence microscopy data. Nat Protoc. 2009, 4: 1305-1311. 10.1038/nprot.2009.129.PubMedCentralCrossRefPubMed Klauschen F, Ishii M, Qi H, Bajénoff M, Egen JG, Germain RN, Meier-Schellersheim M: Quantifying cellular interaction dynamics in 3D fluorescence microscopy data. Nat Protoc. 2009, 4: 1305-1311. 10.1038/nprot.2009.129.PubMedCentralCrossRefPubMed
24.
go back to reference Velić M, May D, Moresi L: A fast robust algorithm for computing discrete voronoi diagrams. J Math Model Algor. 2009, 8: 343-355. 10.1007/s10852-008-9097-6.CrossRef Velić M, May D, Moresi L: A fast robust algorithm for computing discrete voronoi diagrams. J Math Model Algor. 2009, 8: 343-355. 10.1007/s10852-008-9097-6.CrossRef
25.
go back to reference Zerbe N, Hufnagl P, Schlüns K: Distributed computing in image analysis using open source frameworks and application to image sharpness assessment of histological whole slide images. Diagn Pathol. 2011, 6: S16-10.1186/1746-1596-6-S1-S16.PubMedCentralCrossRefPubMed Zerbe N, Hufnagl P, Schlüns K: Distributed computing in image analysis using open source frameworks and application to image sharpness assessment of histological whole slide images. Diagn Pathol. 2011, 6: S16-10.1186/1746-1596-6-S1-S16.PubMedCentralCrossRefPubMed
26.
go back to reference Romo D, Romero E, González F: Learning regions of interest from low level maps in virtual microscopy. Diagn Pathol. 2011, 6: S22-10.1186/1746-1596-6-S1-S22.PubMedCentralCrossRefPubMed Romo D, Romero E, González F: Learning regions of interest from low level maps in virtual microscopy. Diagn Pathol. 2011, 6: S22-10.1186/1746-1596-6-S1-S22.PubMedCentralCrossRefPubMed
27.
go back to reference Kayser K, Görtler J, Borkenfeld S, Kayser G: Interactive and automated application of virtual microscopy. Diagn Pathol. 2011, 6: S10-10.1186/1746-1596-6-S1-S10.PubMedCentralCrossRefPubMed Kayser K, Görtler J, Borkenfeld S, Kayser G: Interactive and automated application of virtual microscopy. Diagn Pathol. 2011, 6: S10-10.1186/1746-1596-6-S1-S10.PubMedCentralCrossRefPubMed
28.
go back to reference Wienert S, Heim D, Saeger K, Stenzinger A, Beil M, Hufnagl P, Dietel M, Denkert C, Klauschen F: Detection and segmentation of cell nuclei in virtual microscopy images: a minimum-model approach. Sci Rep. 2012, 2: 503-PubMedCentralCrossRefPubMed Wienert S, Heim D, Saeger K, Stenzinger A, Beil M, Hufnagl P, Dietel M, Denkert C, Klauschen F: Detection and segmentation of cell nuclei in virtual microscopy images: a minimum-model approach. Sci Rep. 2012, 2: 503-PubMedCentralCrossRefPubMed
29.
go back to reference Ruifrok AC, Johnston DA: Quantification of histochemical staining by color deconvolution. Anal Quant Cytol Histol. 2001, 23: 291-299.PubMed Ruifrok AC, Johnston DA: Quantification of histochemical staining by color deconvolution. Anal Quant Cytol Histol. 2001, 23: 291-299.PubMed
Metadata
Title
CognitionMaster: an object-based image analysis framework
Authors
Stephan Wienert
Daniel Heim
Manato Kotani
Björn Lindequist
Albrecht Stenzinger
Masaru Ishii
Peter Hufnagl
Michael Beil
Manfred Dietel
Carsten Denkert
Frederick Klauschen
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Diagnostic Pathology / Issue 1/2013
Electronic ISSN: 1746-1596
DOI
https://doi.org/10.1186/1746-1596-8-34

Other articles of this Issue 1/2013

Diagnostic Pathology 1/2013 Go to the issue