Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 11/2016

01-11-2016 | Original Article

Automatic thalamus and hippocampus segmentation from MP2RAGE: comparison of publicly available methods and implications for DTI quantification

Authors: Erhard Næss-Schmidt, Anna Tietze, Jakob Udby Blicher, Mikkel Petersen, Irene K. Mikkelsen, Pierrick Coupé, José V. Manjón, Simon Fristed Eskildsen

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 11/2016

Login to get access

Abstract

Purpose

In both structural and functional MRI, there is a need for accurate and reliable automatic segmentation of brain regions. Inconsistent segmentation reduces sensitivity and may bias results in clinical studies. The current study compares the performance of publicly available segmentation tools and their impact on diffusion quantification, emphasizing the importance of using recently developed segmentation algorithms and imaging techniques.

Methods

Four publicly available, automatic segmentation methods (volBrain, FSL, FreeSurfer and SPM) are compared to manual segmentation of the thalamus and hippocampus imaged with a recently proposed T1-weighted MRI sequence (MP2RAGE). We evaluate morphometric accuracy on 22 healthy subjects and impact on diffusivity measurements obtained from aligned diffusion-weighted images on a subset of 10 subjects.

Results

Compared to manual segmentation, the highest Dice similarity index of the thalamus is obtained with volBrain using a local library (\(M=0.913\), \(\hbox {SD}=0.014\)) followed by volBrain using an external library (\(M=0.868\), \(\hbox {SD}=0.024\)), FSL (\({M}=0.806\), \(\mathrm{SD}=0.034\)), FreeSurfer (\({M}=0.798\), \(\mathrm{SD}=0.049\)) and SPM (\({M}=0.787\), \(\mathrm{SD}=0.031\)). The same order is found for hippocampus with volBrain local (\({M}=0.892\), \(\mathrm{SD}=0.016\)), volBrain external (\({M}=0.859\), \(\mathrm{SD}=0.014\)), FSL (\({M}=0.808\), \(\mathrm{SD}=0.017\)), FreeSurfer (\({M}=0.771\), \(\mathrm{SD}=0.023\)) and SPM (\({M}=0.735\), \(\mathrm{SD}=0.038\)). For diffusivity measurements, volBrain provides values closest to those obtained from manual segmentations. volBrain is the only method where FA values do not differ significantly from manual segmentation of the thalamus.

Conclusions

Overall we find that volBrain is superior in thalamus and hippocampus segmentation compared to FSL, FreeSurfer and SPM. Furthermore, the choice of segmentation technique and training library affects quantitative results from diffusivity measures in thalamus and hippocampus.
Footnotes
Literature
1.
go back to reference Mulder ER, de Jong RA, Knol DL, van Schijndel RA, Cover KS, Visser PJ, Barkhof F, Vrenken H (2014) Hippocampal volume change measurement: quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST. Neuroimage 92:169–181CrossRefPubMed Mulder ER, de Jong RA, Knol DL, van Schijndel RA, Cover KS, Visser PJ, Barkhof F, Vrenken H (2014) Hippocampal volume change measurement: quantitative assessment of the reproducibility of expert manual outlining and the automated methods FreeSurfer and FIRST. Neuroimage 92:169–181CrossRefPubMed
2.
go back to reference Heckemann RA, Hajnal JV, Aljabar P, Rueckert D, Hammers A (2006) Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. Neuroimage 33(1):115–126CrossRefPubMed Heckemann RA, Hajnal JV, Aljabar P, Rueckert D, Hammers A (2006) Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. Neuroimage 33(1):115–126CrossRefPubMed
3.
go back to reference Rohlfing T, Brandt R, Menzel R, Maurer CR (2004) Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. Neuroimage 21(4):1428–1442CrossRefPubMed Rohlfing T, Brandt R, Menzel R, Maurer CR (2004) Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. Neuroimage 21(4):1428–1442CrossRefPubMed
4.
go back to reference Aljabar P, Heckemann RA, Hammers A, Hajnal JV, Rueckert D (2009) Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3):726–738CrossRefPubMed Aljabar P, Heckemann RA, Hammers A, Hajnal JV, Rueckert D (2009) Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3):726–738CrossRefPubMed
5.
go back to reference Coupé P, Manjón JV, Fonov V, Pruessner J, Robles M, Collins DL (2011) Patch-based segmentation using expert priors: application to hippocampus and ventricle segmentation. Neuroimage 54(2):940–954CrossRefPubMed Coupé P, Manjón JV, Fonov V, Pruessner J, Robles M, Collins DL (2011) Patch-based segmentation using expert priors: application to hippocampus and ventricle segmentation. Neuroimage 54(2):940–954CrossRefPubMed
6.
go back to reference Tong T, Wolz R, Coupé P, Hajnal JV, Rueckert D (2013) Segmentation of MR images via discriminative dictionary learning and sparse coding: application to hippocampus labeling. Neuroimage 76:11–23CrossRefPubMed Tong T, Wolz R, Coupé P, Hajnal JV, Rueckert D (2013) Segmentation of MR images via discriminative dictionary learning and sparse coding: application to hippocampus labeling. Neuroimage 76:11–23CrossRefPubMed
7.
go back to reference Eskildsen SF, Coupé P, Fonov V, Manjón JV, Leung KK, Guizard N, Wassef SN, Østergaard LR, Collins DL (2012) BEaST: brain extraction based on nonlocal segmentation technique. Neuroimage 59(3):2362–2373CrossRefPubMed Eskildsen SF, Coupé P, Fonov V, Manjón JV, Leung KK, Guizard N, Wassef SN, Østergaard LR, Collins DL (2012) BEaST: brain extraction based on nonlocal segmentation technique. Neuroimage 59(3):2362–2373CrossRefPubMed
8.
go back to reference Falangola MF, Jensen JH, Tabesh A, Hu C, Deardorff RL, Babb JS, Ferris S, Helpern JA (2013) Non-Gaussian diffusion MRI assessment of brain microstructure in mild cognitive impairment and Alzheimer’s disease. Magn Reson Imaging 31(6):840–846CrossRefPubMed Falangola MF, Jensen JH, Tabesh A, Hu C, Deardorff RL, Babb JS, Ferris S, Helpern JA (2013) Non-Gaussian diffusion MRI assessment of brain microstructure in mild cognitive impairment and Alzheimer’s disease. Magn Reson Imaging 31(6):840–846CrossRefPubMed
9.
go back to reference Mitchell AS, Sherman SM, Sommer MA, Mair RG, Vertes RP, Chudasama Y (2014) Advances in understanding mechanisms of thalamic relays in cognition and behavior. J Neurosci 34(46):15340–15346CrossRefPubMedPubMedCentral Mitchell AS, Sherman SM, Sommer MA, Mair RG, Vertes RP, Chudasama Y (2014) Advances in understanding mechanisms of thalamic relays in cognition and behavior. J Neurosci 34(46):15340–15346CrossRefPubMedPubMedCentral
10.
go back to reference Vestergaard-Poulsen P, Wegener G, Hansen B, Bjarkam CR, Blackband SJ, Nielsen NC, Jespersen SN (2011) Diffusion-weighted MRI and quantitative biophysical modeling of hippocampal neurite loss in chronic stress. PLoS ONE 6(7):e20653CrossRefPubMedPubMedCentral Vestergaard-Poulsen P, Wegener G, Hansen B, Bjarkam CR, Blackband SJ, Nielsen NC, Jespersen SN (2011) Diffusion-weighted MRI and quantitative biophysical modeling of hippocampal neurite loss in chronic stress. PLoS ONE 6(7):e20653CrossRefPubMedPubMedCentral
11.
go back to reference Granziera C, Daducci A, Romascano D, Roche A, Helms G, Krueger G, Hadjikhani N (2014) Structural abnormalities in the thalamus of migraineurs with aura: a multiparametric study at 3 T. Hum Brain Mapp 35(4):1461–1468CrossRefPubMed Granziera C, Daducci A, Romascano D, Roche A, Helms G, Krueger G, Hadjikhani N (2014) Structural abnormalities in the thalamus of migraineurs with aura: a multiparametric study at 3 T. Hum Brain Mapp 35(4):1461–1468CrossRefPubMed
12.
go back to reference Coupé P, Eskildsen SF, Manjón JV, Fonov VS, Collins DL (2012) Simultaneous segmentation and grading of anatomical structures for patient’s classification: application to Alzheimer’s disease. Neuroimage 59(4):3736–3747CrossRefPubMed Coupé P, Eskildsen SF, Manjón JV, Fonov VS, Collins DL (2012) Simultaneous segmentation and grading of anatomical structures for patient’s classification: application to Alzheimer’s disease. Neuroimage 59(4):3736–3747CrossRefPubMed
13.
go back to reference Marques JP, Kober T, Krueger G, van der Zwaag W, Van de Moortele PFF, Gruetter R (2010) MP2RAGE, a self bias-field corrected sequence for improved segmentation and T1-mapping at high field. Neuroimage 49(2):1271–1281CrossRefPubMed Marques JP, Kober T, Krueger G, van der Zwaag W, Van de Moortele PFF, Gruetter R (2010) MP2RAGE, a self bias-field corrected sequence for improved segmentation and T1-mapping at high field. Neuroimage 49(2):1271–1281CrossRefPubMed
14.
go back to reference Fujimoto K, Polimeni JR, van der Kouwe AJW, Reuter M, Kober T, Benner T, Fischl B, Wald LL (2014) Quantitative comparison of cortical surface reconstructions from MP2RAGE and multi-echo MPRAGE data at 3 and 7 T. Neuroimage 90:60–73CrossRefPubMed Fujimoto K, Polimeni JR, van der Kouwe AJW, Reuter M, Kober T, Benner T, Fischl B, Wald LL (2014) Quantitative comparison of cortical surface reconstructions from MP2RAGE and multi-echo MPRAGE data at 3 and 7 T. Neuroimage 90:60–73CrossRefPubMed
15.
go back to reference Dudo RO, Hart PE, Stork D (2001) Pattern classification, 2nd edn. Wiley, Hoboken Dudo RO, Hart PE, Stork D (2001) Pattern classification, 2nd edn. Wiley, Hoboken
16.
go back to reference Leemans A, Jeurissen B, Sijbers J, Jones D (2009) ExploreDTI: a graphical toolbox for processing, analyzing, and visualizing diffusion MR data. In: Proceedings 17th scientific meeting, international society for magnetic resonance in medicine, vol 17, no 2, p 3537 Leemans A, Jeurissen B, Sijbers J, Jones D (2009) ExploreDTI: a graphical toolbox for processing, analyzing, and visualizing diffusion MR data. In: Proceedings 17th scientific meeting, international society for magnetic resonance in medicine, vol 17, no 2, p 3537
17.
go back to reference Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31(3):1116–1128CrossRefPubMed Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31(3):1116–1128CrossRefPubMed
18.
go back to reference Power BD, Wilkes FA, Hunter-Dickson M, van Westen D, Santillo AF, Walterfang M, Nilsson C, Velakoulis D, Looi JCL (2015) Validation of a protocol for manual segmentation of the thalamus on magnetic resonance imaging scans. Psychiatry Res 232(1):98–105CrossRefPubMed Power BD, Wilkes FA, Hunter-Dickson M, van Westen D, Santillo AF, Walterfang M, Nilsson C, Velakoulis D, Looi JCL (2015) Validation of a protocol for manual segmentation of the thalamus on magnetic resonance imaging scans. Psychiatry Res 232(1):98–105CrossRefPubMed
19.
go back to reference Boccardi M, Bocchetta M, Apostolova LG, Barnes J, Bartzokis G, Corbetta G,DeCarliC, deToledo-Morrell L, Firbank M, Ganzola R, Gerritsen L, Henneman W, Killiany RJ, Malykhin N, Pasqualetti P, Pruessner JC, Redolfi A, Robitaille N, Soininen H, Tolomeo D, Wang L, Watson C, Wolf H, Duvernoy H, Duchesne S, Jack CR, Frisoni GB (2014) Delphi definition of the EADC-ADNI harmonized protocol for hippocampal segmentation on magnetic resonance. Alzheimers Dement 11(2):126–138 Boccardi M, Bocchetta M, Apostolova LG, Barnes J, Bartzokis G, Corbetta G,DeCarliC, deToledo-Morrell L, Firbank M, Ganzola R, Gerritsen L, Henneman W, Killiany RJ, Malykhin N, Pasqualetti P, Pruessner JC, Redolfi A, Robitaille N, Soininen H, Tolomeo D, Wang L, Watson C, Wolf H, Duvernoy H, Duchesne S, Jack CR, Frisoni GB (2014) Delphi definition of the EADC-ADNI harmonized protocol for hippocampal segmentation on magnetic resonance. Alzheimers Dement 11(2):126–138
20.
go back to reference Manjón JV, Coupé P (2015) volBrain: an online MRI brain volumetry system. Hum Brain Mapp 15:2015 Manjón JV, Coupé P (2015) volBrain: an online MRI brain volumetry system. Hum Brain Mapp 15:2015
21.
go back to reference Patenaude B, Smith SM, Kennedy DN, Jenkinson M (2011) A Bayesian model of shape and appearance for subcortical brain segmentation. Neuroimage 56(3):907–922CrossRefPubMedPubMedCentral Patenaude B, Smith SM, Kennedy DN, Jenkinson M (2011) A Bayesian model of shape and appearance for subcortical brain segmentation. Neuroimage 56(3):907–922CrossRefPubMedPubMedCentral
22.
go back to reference Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, Van Der Kouwe A, Killiany R, Kennedy D, Klaveness S, Montillo A, Makris N, Rosen B, Dale AM (2002) Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33(3):341–355CrossRefPubMed Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, Van Der Kouwe A, Killiany R, Kennedy D, Klaveness S, Montillo A, Makris N, Rosen B, Dale AM (2002) Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 33(3):341–355CrossRefPubMed
24.
go back to reference Frisoni GB, Jack CR, Bocchetta M, Bauer C, Frederiksen KS, Liu Y, Preboske G, Swihart T, Blair M, Cavedo E, Grothe MJ, Lanfredi M, Martinez O, Nishikawa M, Portegies M, Stoub T, Ward C, Apostolova LG, Ganzola R, Wolf D, Barkhof F, Bartzokis G, DeCarli C, Csernansky JG, Detoledo-Morrell L, Geerlings MI, Kaye J, Killiany RJ, Lehericy S, Matsuda H, O’Brien J, Silbert LC, Scheltens P, Soininen H, Teipel S, Waldemar G, Fellgiebel A, Barnes J, Firbank M, Gerritsen L, Henneman W, Malykhin N, Pruessner JC, Wang L, Watsonl C, Wolf H, Deleon M, Pantel J, Ferrari C, Bosco P, Pasqualetti P, Duchesne S, Duvernoy H, Boccardi M, Albert MS, Bennet D, Camicioli R, Collins DL, Dubois B, Hampel H, Denheijer T, Hock C, Jagust W, Launer L, Maller JJ, Mueller S, Sachdev P, Simmons A, Thompson PM, Visser PJ, Wahlund LO, Weiner MW, Winblad B (2015) The EADC-ADNI harmonized protocol for manual hippocampal segmentation on magnetic resonance: evidence of validity. Alzheimer’s Dement 11(2):111–125CrossRef Frisoni GB, Jack CR, Bocchetta M, Bauer C, Frederiksen KS, Liu Y, Preboske G, Swihart T, Blair M, Cavedo E, Grothe MJ, Lanfredi M, Martinez O, Nishikawa M, Portegies M, Stoub T, Ward C, Apostolova LG, Ganzola R, Wolf D, Barkhof F, Bartzokis G, DeCarli C, Csernansky JG, Detoledo-Morrell L, Geerlings MI, Kaye J, Killiany RJ, Lehericy S, Matsuda H, O’Brien J, Silbert LC, Scheltens P, Soininen H, Teipel S, Waldemar G, Fellgiebel A, Barnes J, Firbank M, Gerritsen L, Henneman W, Malykhin N, Pruessner JC, Wang L, Watsonl C, Wolf H, Deleon M, Pantel J, Ferrari C, Bosco P, Pasqualetti P, Duchesne S, Duvernoy H, Boccardi M, Albert MS, Bennet D, Camicioli R, Collins DL, Dubois B, Hampel H, Denheijer T, Hock C, Jagust W, Launer L, Maller JJ, Mueller S, Sachdev P, Simmons A, Thompson PM, Visser PJ, Wahlund LO, Weiner MW, Winblad B (2015) The EADC-ADNI harmonized protocol for manual hippocampal segmentation on magnetic resonance: evidence of validity. Alzheimer’s Dement 11(2):111–125CrossRef
25.
go back to reference Næss-Schmidt ET, Tietze A, Mikkelsen IK, Petersen M, Blicher JU, Coupé P, Manjón JV, Eskildsen SF (2015) Patch-based segmentation from MP2RAGE images: comparison to conventional techniques. In: Wu G, Coupé P, Zhan Y, Munsell B, Rueckert D (eds) First international workshop, patch-techniques in medical imaging. Lecture notes in computer science, held in conjunction with MICCAI 2015, vol 9467. Munich, Germany, pp.180–187 Næss-Schmidt ET, Tietze A, Mikkelsen IK, Petersen M, Blicher JU, Coupé P, Manjón JV, Eskildsen SF (2015) Patch-based segmentation from MP2RAGE images: comparison to conventional techniques. In: Wu G, Coupé P, Zhan Y, Munsell B, Rueckert D (eds) First international workshop, patch-techniques in medical imaging. Lecture notes in computer science, held in conjunction with MICCAI 2015, vol 9467. Munich, Germany, pp.180–187
26.
go back to reference Barbagallo G, Nicoletti G, Cherubini A, Trotta M, Tallarico T, Chiriaco C, Nisticò R, Salvino D, Bono F, Valentino P, Quattrone A (2014) Diffusion tensor MRI changes in gray structures of the frontal-subcortical circuits in amyotrophic lateral sclerosis. Neurol Sci 35(6):911–918CrossRefPubMed Barbagallo G, Nicoletti G, Cherubini A, Trotta M, Tallarico T, Chiriaco C, Nisticò R, Salvino D, Bono F, Valentino P, Quattrone A (2014) Diffusion tensor MRI changes in gray structures of the frontal-subcortical circuits in amyotrophic lateral sclerosis. Neurol Sci 35(6):911–918CrossRefPubMed
27.
go back to reference Okubo G, Okada T, Yamamoto A, KanagakiM, Fushimi Y, Okada T, Murata K, Togashi K (2015) MP2RAGE for deep gray matter measurement of the brain: a comparative study with MPRAGE. J Magn Reson Imaging 43(1):55–62 Okubo G, Okada T, Yamamoto A, KanagakiM, Fushimi Y, Okada T, Murata K, Togashi K (2015) MP2RAGE for deep gray matter measurement of the brain: a comparative study with MPRAGE. J Magn Reson Imaging 43(1):55–62
Metadata
Title
Automatic thalamus and hippocampus segmentation from MP2RAGE: comparison of publicly available methods and implications for DTI quantification
Authors
Erhard Næss-Schmidt
Anna Tietze
Jakob Udby Blicher
Mikkel Petersen
Irene K. Mikkelsen
Pierrick Coupé
José V. Manjón
Simon Fristed Eskildsen
Publication date
01-11-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 11/2016
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1433-0

Other articles of this Issue 11/2016

International Journal of Computer Assisted Radiology and Surgery 11/2016 Go to the issue