Top

Published in:

Open Access 01-06-2021 | Original Article

Neural representations underlying mental imagery as unveiled by representation similarity analysis

Authors: Maddalena Boccia, Valentina Sulpizio, Federica Bencivenga, Cecilia Guariglia, Gaspare Galati

Published in: Brain Structure and Function | Issue 5/2021

Abstract

It is commonly acknowledged that visual imagery and perception rely on the same content-dependent brain areas in the high-level visual cortex (HVC). However, the way in which our brain processes and organizes previous acquired knowledge to allow the generation of mental images is still a matter of debate. Here, we performed a representation similarity analysis of three previous fMRI experiments conducted in our laboratory to characterize the neural representation underlying imagery and perception of objects, buildings and faces and to disclose possible dissimilarities in the neural structure of such representations. To this aim, we built representational dissimilarity matrices (RDMs) by computing multivariate distances between the activity patterns associated with each pair of stimuli in the content-dependent areas of the HVC and HC. We found that spatial information is widely coded in the HVC during perception (i.e. RSC, PPA and OPA) and imagery (OPA and PPA). Also, visual information seems to be coded in both preferred and non-preferred regions of the HVC, supporting a distributed view of encoding. Overall, the present results shed light upon the spatial coding of imagined and perceived exemplars in the HVC.

Available only for authorised users

Aguirre GK (2007) Continuous carry-over designs for fMRI. Neuroimage 35:1480–1494. https://doi.org/10.1016/j.neuroimage.2007.02.005CrossRefPubMedPubMedCentral

Arbuckle S, Yokoi A, Pruszynski JA, Diedrichsen J (2018) Stability of representational geometry across a wide range of fMRI activity levels. Neuroimage. https://doi.org/10.1101/266585CrossRefPubMed

Beukema P, Diedrichsen J, Verstynen TD (2019) Binding during sequence learning does not alter cortical representations of individual actions. J Neurosci Off J Soc Neurosci 39:6968–6977. https://doi.org/10.1523/JNEUROSCI.2669-18.2019CrossRef

Boccia M, Nemmi F, Guariglia C (2014) Neuropsychology of environmental navigation in humans: review and meta-analysis of fMRI studies in healthy participants. Neuropsychol Rev 24:236–251CrossRef

Boccia M, Piccardi L, Palermo L, Nemmi F, Sulpizio V, Galati G, Guariglia C (2015) A penny for your thoughts! patterns of fMRI activity reveal the content and the spatial topography of visual mental images. Hum Brain Mapp 36:945–958. https://doi.org/10.1002/hbm.22678CrossRefPubMed

Boccia M, Sulpizio V, Palermo L, Piccardi L, Guariglia C, Galati G (2017) I can see where you would be: patterns of fMRI activity reveal imagined landmarks. Neuroimage. https://doi.org/10.1016/j.neuroimage.2016.08.034CrossRefPubMed

Boccia M, Di Vita A, Palermo L, Committeri G, Piccardi L, Guariglia C (2018) The way to “left” Piazza del Popolo: damage to white matter tracts in representational neglect for places. Brain Imaging Behav 12:1720–1729. https://doi.org/10.1007/s11682-018-9839-7CrossRefPubMed

Boccia M, Sulpizio V, Teghil A, Palermo L, Piccardi L, Galati G, Guariglia C (2019) The dynamic contribution of the high-level visual cortex to imagery and perception. Hum Brain Mapp 40:2449–2463. https://doi.org/10.1002/hbm.24535CrossRefPubMedPubMedCentral

Bonner MF, Epstein RA (2017) Coding of navigational affordances in the human visual system. Proc Natl Acad Sci USA 114:4793–4798CrossRef

Cichy RM, Heinzle J, Haynes JD (2012) Imagery and perception share cortical representations of content and location. Cereb Cortex 22:372–380CrossRef

Committeri G, Piccardi L, Galati G, Guariglia C (2015) Where did you “left” Piazza del Popolo? At your “right” temporo-parietal junction. Cortex 73:106–111. https://doi.org/10.1016/j.cortex.2015.08.009CrossRefPubMed

Diedrichsen J, Kriegeskorte N (2017) Representational models: a common framework for understanding encoding, pattern-component, and representational-similarity analysis. PLoS Comput Biol. https://doi.org/10.1371/journal.pcbi.1005508CrossRefPubMedPubMedCentral

Diedrichsen, J., Provost, S., Zareamoghaddam, H., 2016. On the distribution of cross-validated Mahalanobis distances.

Epstein RA, Patai EZ, Julian JB, Spiers HJ (2017) The cognitive map in humans: spatial navigation and beyond. Nat Neurosci 20:1504–1513CrossRef

Farah MJ (1989) The neuropsychology of mental imagery. In: Boller F, Grafman J (eds) The handbook of neuropsychology: disorders of visual behaviour. Elsevier, Amsterdam, pp 395–413

Guariglia C, Pizzamiglio L (2006) Spatial navigation-cognitive and neuropsychological aspects. In: Vecchi G, Bottini T (eds) Imagery and spatial cognition. John Benjamins, Amsterdam

Guariglia C, Pizzamiglio L (2007) The role of imagery in navigation: Neuropsychological evidence. In: Mast Jäncke LF (ed) Spatial processing in navigation, imagery and perception. Springer, New York

Haxby JV, Gobbini MI, Furey ML, Ishai, a, Schouten, J.L., Pietrini, P., (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425–2430. https://doi.org/10.1126/science.1063736CrossRefPubMed

Hoffmann H (2015) violin.m—simple violin plot using matlab default kernel% density estimation. INRES (University of Bonn), Katzenburgweg (5, 53115 Germany)

Ishai A, Ungerleider LG, Martin A, Schouten JL, Haxby JV (1999) Distributed representation of objects in the human ventral visual pathway. Proc Natl Acad Sci USA 96:9379–9384. https://doi.org/10.1073/pnas.96.16.9379CrossRefPubMed

Ishai A, Ungerleider LG, Haxby JV (2000) Distributed neural systems for the generation of visual images. Neuron 28:979–990CrossRef

Johnson M, Johnson M (2014) Decoding individual natural scene representations during perception and imagery. Front Hum Neurosci 8:59PubMedPubMedCentral

Keogh R, Bergmann J, Pearson J (2020) Cortical excitability controls the strength of mental imagery. Elife 9:e50232CrossRef

Koenig-Robert R, Pearson J (2019) Decoding the contents and strength of imagery before volitional engagement. Sci Rep 9:3504CrossRef

Kosslyn SM (1980) Image and Mind Image and Mind. HarvardUniversity Press, Cambridge

Kosslyn SM, Thompson WL (2003) When is early visual cortex activated during visual mental imagery? Psychol Bull 129:723–746CrossRef

Kriegeskorte N, Bandettini P (2007a) Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage 38:649–662. https://doi.org/10.1016/j.neuroimage.2007.02.022CrossRefPubMedPubMedCentral

Kriegeskorte N, Bandettini P (2007b) Combining the tools: activation- and information-based fMRI analysis. Neuroimage 38:666–668. https://doi.org/10.1016/j.neuroimage.2007.06.030CrossRefPubMed

Lee SH, Kravitz DJ, Baker CI (2012) Disentangling visual imagery and perception of real-world objects. Neuroimage 59:4064–4073CrossRef

Liu J, Harris A, Kanwisher N (2010) Perception of face parts and face configurations: an fMRI study. J Cogn Neurosci 22:203–211CrossRef

Mangan AP, Whitaker RT (1999) Partitioning 3D surface meshes using watershed segmentation. IEEE Trans Vis Comput Graph 5:308–321. https://doi.org/10.1109/2945.817348CrossRef

Moro V, Berlucchi G, Lerch J, Tomaiuolo F, Aglioti SM (2008) Selective deficit of mental visual imagery with intact primary visual cortex and visual perception. Cortex 44:109–118CrossRef

Naselaris T, Olman CA, Stansbury DE, Ugurbil K, Gallant JL (2015) A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes. Neuroimage 105:215–228CrossRef

Nonyane BAS, Theobald CM (2007) Design sequences for sensory studies: achieving balance for carry-over and position effects. Br J Math Stat Psychol 60:339–349. https://doi.org/10.1348/000711006X114568CrossRefPubMed

O’Craven KM, Kanwisher N (2000) Mental imagery of faces and places activates corresponding stiimulus-specific brain regions. J Cogn Neurosci 12:1013–1023CrossRef

O’Toole AJ, Jiang F, Abdi H, Haxby JV (2005) Partially distributed representations of objects and faces in ventral temporal cortex. J Cogn Neurosci 17:580–590. https://doi.org/10.1162/0898929053467550CrossRefPubMed

Pearson J (2019) The human imagination: the cognitive neuroscience of visual mental imagery. Nat Rev Neurosci 20(10):624–634. https://doi.org/10.1038/s41583-019-0202-9PMID-31384033CrossRefPubMed

Pearson J (2020) Reply to: assessing the causal role of early visual areas in visual mental imagery. Nat Rev Neurosci 21(9):517–518. https://doi.org/10.1038/s41583-020-0349-4CrossRefPubMed

Reddy L, Tsuchiya N, Serre T (2010) Reading the mind’s eye: decoding category information during mental imagery. Neuroimage 50(2):818–825. https://doi.org/10.1016/j.neuroimage.2009.11.084 (PMID: 20004247; PMCID: PMC2823980)CrossRefPubMed

Van Essen DC, Glasser MF, Dierker DL, Harwell J, Coalson T (2012) Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. Cereb Cortex 22:2241–2262. https://doi.org/10.1093/cercor/bhr291CrossRefPubMed

Van Leemput K, Bakkour A, Benner T, Wiggins G, Wald LL, Augustinack J, Dickerson BC, Golland P, Fischl B (2009) Automated segmentation of hippocampal subfields from ultra-high resolution in vivo MRI. Hippocampus 19:549–557. https://doi.org/10.1002/hipo.20615CrossRefPubMedPubMedCentral

Walther A, Nili H, Ejaz N, Alink A, Kriegeskorte N, Diedrichsen J (2016) Reliability of dissimilarity measures for multi-voxel pattern analysis. Neuroimage 137:188–200. https://doi.org/10.1016/j.neuroimage.2015.12.012CrossRefPubMed

Yokoi A, Arbuckle SA, Diedrichsen J (2018) The role of human primary motor cortex in the production of skilled finger sequences. J Neurosci 38:1430–1442. https://doi.org/10.1523/JNEUROSCI.2798-17.2017CrossRefPubMedPubMedCentral

Title: Neural representations underlying mental imagery as unveiled by representation similarity analysis
Authors: Maddalena Boccia
Valentina Sulpizio
Federica Bencivenga
Cecilia Guariglia
Gaspare Galati
Publication date: 01-06-2021
Publisher: Springer Berlin Heidelberg
Published in: Brain Structure and Function / Issue 5/2021
Print ISSN: 1863-2653
Electronic ISSN: 1863-2661
DOI: https://doi.org/10.1007/s00429-021-02266-z

2024 ASCO Annual Meeting

Springer Medicine

Neural representations underlying mental imagery as unveiled by representation similarity analysis

Abstract

2024 ASCO Annual Meeting

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2021

fMRI evidence reveals emotional biases in bilingual decision making

Neuroplastin expression is essential for hearing and hair cell PMCA expression

Reduced listener–speaker neural coupling underlies speech understanding difficulty in older adults

Intraoperative mapping of pre-central motor cortex and subcortex: a proposal for supplemental cortical and novel subcortical maps to Penfield’s motor homunculus

Hodology of the superior longitudinal system of the human brain: a historical perspective, the current controversies, and a proposal

Continuous theta-burst stimulation modulates language-related inhibitory processes in bilinguals: evidence from event-related potentials