Skip to main content
Top
Published in:

01-04-2023 | Research Article

Faces, English words and Chinese characters: a study of dual-task interference in mono-and bilingual speakers

Authors: Marko Tien, Andrea Albonico, Jason J. S. Barton

Published in: Experimental Brain Research | Issue 4/2023

Login to get access

Abstract

The many-to-many hypothesis suggests that face and visual-word processing tasks share neural resources in the brain, even though they show opposing hemispheric asymmetries in neuroimaging and neuropsychologic studies. Recently it has been suggested that both stimulus and task effects need to be incorporated into the hypothesis. A recent study found dual-task interference between face and text functions that lateralized to the same hemisphere, but not when they lateralized to different hemispheres. However, it is not clear whether a lack of interference between word and face recognition would occur for other languages, particularly those with a morpho-syllabic script, like Chinese, for which there is some evidence of greater right hemispheric involvement. Here, we used the same technique to probe for dual-task interference between English text, Chinese characters and face recognition. We tested 20 subjects monolingual for English and 20 subjects bilingual for Chinese and English. We replicated the prior result for English text and showed similar results for Chinese text with no evidence of interference with faces. We also did not find interference between Chinese and English text. The results support a view in which reading English words, reading Chinese characters and face identification have minimal sharing of neural resources.
Footnotes
1
A post-hoc power analysis showed that the sample size used in the present study led to an estimated power (G*Power software; Faul et al. 2007, 2009) of about 0.92 in detecting a significant interference effect, based on an effect size of η2 = 0.15.
 
Literature
go back to reference Albonico A, Barton JJS (2017) Face perception in pure alexia: complementary contributions of the left fusiform gyrus to facial identity and facial speech processing. Cortex 96:59–72CrossRefPubMed Albonico A, Barton JJS (2017) Face perception in pure alexia: complementary contributions of the left fusiform gyrus to facial identity and facial speech processing. Cortex 96:59–72CrossRefPubMed
go back to reference Antoniou M, Best CT, Tyler MD, Kroosa C (2011) Inter-language interference in VOT production by L2-dominant bilinguals: Asymmetries in phonetic code-switching. J Phon 39:558–570CrossRefPubMedPubMedCentral Antoniou M, Best CT, Tyler MD, Kroosa C (2011) Inter-language interference in VOT production by L2-dominant bilinguals: Asymmetries in phonetic code-switching. J Phon 39:558–570CrossRefPubMedPubMedCentral
go back to reference Barton JJS, Sekunova A, Sheldon C, Johnston S, Iaria G, Scheel M (2010) Reading words, seeing style: The neuropsychology of word, font and handwriting perception. Neuropsychologia 48:3868–3877CrossRefPubMed Barton JJS, Sekunova A, Sheldon C, Johnston S, Iaria G, Scheel M (2010) Reading words, seeing style: The neuropsychology of word, font and handwriting perception. Neuropsychologia 48:3868–3877CrossRefPubMed
go back to reference Behrmann M, Plaut DC (2013) Distributed circuits, not circumscribed centers, mediate visual recognition. Trends Cogn Sci 17:210–219CrossRefPubMed Behrmann M, Plaut DC (2013) Distributed circuits, not circumscribed centers, mediate visual recognition. Trends Cogn Sci 17:210–219CrossRefPubMed
go back to reference Behrmann M, Plaut DC (2014) Bilateral Hemispheric Processing of Words and Faces: Evidence from Word impairments in prosopagnosia and face impairments in pure alexia. Cereb Cortex 24:1102–1118CrossRefPubMed Behrmann M, Plaut DC (2014) Bilateral Hemispheric Processing of Words and Faces: Evidence from Word impairments in prosopagnosia and face impairments in pure alexia. Cereb Cortex 24:1102–1118CrossRefPubMed
go back to reference Bolger DJ, Perfetti CA, Schneider W (2005) Cross-cultural effect on the brain revisited: universal structures plus writing system variation. Hum Brain Mapp 25:92–104CrossRefPubMedPubMedCentral Bolger DJ, Perfetti CA, Schneider W (2005) Cross-cultural effect on the brain revisited: universal structures plus writing system variation. Hum Brain Mapp 25:92–104CrossRefPubMedPubMedCentral
go back to reference Campbell R, Landis T, Regard M (1986) Face recognition and lipreading. A Neurol Dissociation Brain 109:509–521CrossRef Campbell R, Landis T, Regard M (1986) Face recognition and lipreading. A Neurol Dissociation Brain 109:509–521CrossRef
go back to reference Cao X, Jiang B, Gaspar C, Li C (2014) The overlap of neural selectivity between faces and words: evidences from the N170 adaptation effect. Exp Brain Res 232:3015–3021CrossRefPubMed Cao X, Jiang B, Gaspar C, Li C (2014) The overlap of neural selectivity between faces and words: evidences from the N170 adaptation effect. Exp Brain Res 232:3015–3021CrossRefPubMed
go back to reference Cao F, Brennan C, Booth JR (2015) The brain adapts to orthography with experience: evidence from English and Chinese. Dev Sci 18:785–798CrossRefPubMed Cao F, Brennan C, Booth JR (2015) The brain adapts to orthography with experience: evidence from English and Chinese. Dev Sci 18:785–798CrossRefPubMed
go back to reference Cheung OS, Gauthier I (2010) Selective interference on the holistic processing of faces in working memory. J Exp Psychol Hum Perception Perform 36:448–461CrossRef Cheung OS, Gauthier I (2010) Selective interference on the holistic processing of faces in working memory. J Exp Psychol Hum Perception Perform 36:448–461CrossRef
go back to reference Chung HKS, Leung JCY, Wong VMY, Hsiao JH (2018) When is the right hemisphere holistic and when is it not? The case of Chinese character recognition. Cognition 178:50–56CrossRefPubMed Chung HKS, Leung JCY, Wong VMY, Hsiao JH (2018) When is the right hemisphere holistic and when is it not? The case of Chinese character recognition. Cognition 178:50–56CrossRefPubMed
go back to reference Cohen L, Lehéricy S, Chochon F, Lemer C, Rivaud S, Dehaene S (2002) Language-specific tuning of visual cortex? Functional properties of the visual word form area. Brain 125:1054–1069CrossRefPubMed Cohen L, Lehéricy S, Chochon F, Lemer C, Rivaud S, Dehaene S (2002) Language-specific tuning of visual cortex? Functional properties of the visual word form area. Brain 125:1054–1069CrossRefPubMed
go back to reference Curby KM, Gauthier I (2014) Interference between face and non-face domains of perceptual expertise: a replication and extension. Fronti Psychol 5:955 Curby KM, Gauthier I (2014) Interference between face and non-face domains of perceptual expertise: a replication and extension. Fronti Psychol 5:955
go back to reference Curby KM, Moerel D (2019) Behind the face of holistic perception: holistic processing of gestalt stimuli and faces recruit overlapping perceptual mechanisms. Atten Percept Psychophys 81:2873–2880CrossRefPubMed Curby KM, Moerel D (2019) Behind the face of holistic perception: holistic processing of gestalt stimuli and faces recruit overlapping perceptual mechanisms. Atten Percept Psychophys 81:2873–2880CrossRefPubMed
go back to reference Davies-Thompson J, Pancaroglu R, Barton J (2014) Acquired prosopagnosia: structural basis and processing impairments. Front Biosci 6:159–174 Davies-Thompson J, Pancaroglu R, Barton J (2014) Acquired prosopagnosia: structural basis and processing impairments. Front Biosci 6:159–174
go back to reference Feizabadi M, Albonico A, Starrfelt R, Barton JJS (2021) Whole-object effects in visual word processing: parallels with and differences from face recognition. Cogn Neuropsychol 38:231–257CrossRefPubMed Feizabadi M, Albonico A, Starrfelt R, Barton JJS (2021) Whole-object effects in visual word processing: parallels with and differences from face recognition. Cogn Neuropsychol 38:231–257CrossRefPubMed
go back to reference Furubacke A, Albonico A, Barton JJS (2020) Alternating dual-task interference between visual words and faces. Brain Res 1746:147004CrossRefPubMed Furubacke A, Albonico A, Barton JJS (2020) Alternating dual-task interference between visual words and faces. Brain Res 1746:147004CrossRefPubMed
go back to reference Faul F, Erdfelder E, Lang AG, Buchner A (2007) G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 39(2):175–191 Faul F, Erdfelder E, Lang AG, Buchner A (2007) G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 39(2):175–191
go back to reference Faul F, Erdfelder E, Buchner A, Lang AG (2009) Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160 Faul F, Erdfelder E, Buchner A, Lang AG (2009) Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160
go back to reference Gauthier I, Curran T, Curby KM, Collins D (2003) Perceptual interference supports a non-modular account of face processing. Nat Neurosci 6:428–432CrossRefPubMed Gauthier I, Curran T, Curby KM, Collins D (2003) Perceptual interference supports a non-modular account of face processing. Nat Neurosci 6:428–432CrossRefPubMed
go back to reference Georgiou, H.V., 2014. Estimating the intrinsic dimension in fMRI space via dataset fractal analysis: Counting the ‘cpu cores’ of the human brain. arXiv. 1410.7100. Georgiou, H.V., 2014. Estimating the intrinsic dimension in fMRI space via dataset fractal analysis: Counting the ‘cpu cores’ of the human brain. arXiv. 1410.7100.
go back to reference Harris RJ, Rice GE, Young AW, Andrews TJ (2016) Distinct but overlapping patterns of response to words and faces in the fusiform gyrus. Cereb Cortex 26:3161–3168CrossRefPubMed Harris RJ, Rice GE, Young AW, Andrews TJ (2016) Distinct but overlapping patterns of response to words and faces in the fusiform gyrus. Cereb Cortex 26:3161–3168CrossRefPubMed
go back to reference Hayakawa S, Marian V (2019) Consequences of multilingualism for neural architecture. Behav Brain Funct 15:1–24CrossRef Hayakawa S, Marian V (2019) Consequences of multilingualism for neural architecture. Behav Brain Funct 15:1–24CrossRef
go back to reference Hills CS, Pancaroglu R, Duchaine B, Barton JJS (2015) Word and text processing in acquired prosopagnosia. Ann Neurol 78:258–271CrossRefPubMed Hills CS, Pancaroglu R, Duchaine B, Barton JJS (2015) Word and text processing in acquired prosopagnosia. Ann Neurol 78:258–271CrossRefPubMed
go back to reference Hsiao JH, Cottrell GW (2009) Not all visual expertise is holistic, but it may be leftist: the case of Chinese character recognition. Psychol Sci 20:455–463CrossRefPubMed Hsiao JH, Cottrell GW (2009) Not all visual expertise is holistic, but it may be leftist: the case of Chinese character recognition. Psychol Sci 20:455–463CrossRefPubMed
go back to reference Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–4311CrossRefPubMedPubMedCentral Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–4311CrossRefPubMedPubMedCentral
go back to reference Lay NDS (1975) Chinese language interference in written English. J Basic Writing 1:50–61CrossRef Lay NDS (1975) Chinese language interference in written English. J Basic Writing 1:50–61CrossRef
go back to reference Liu Y, Perfetti CA (2003) The time course of brain activity in reading English and Chinese: an ERP study of Chinese bilinguals. Hum Brain Mapp 18:167–175CrossRefPubMedPubMedCentral Liu Y, Perfetti CA (2003) The time course of brain activity in reading English and Chinese: an ERP study of Chinese bilinguals. Hum Brain Mapp 18:167–175CrossRefPubMedPubMedCentral
go back to reference Ma X, Cheung AKF (2020) Language interference in English-Chinese simultaneous interpreting with and without text. Babel 66:434–456CrossRef Ma X, Cheung AKF (2020) Language interference in English-Chinese simultaneous interpreting with and without text. Babel 66:434–456CrossRef
go back to reference Macizo P, Bajo T, Cruz Martín M (2010) Inhibitory processes in bilingual language comprehension: evidence from Spanish-English interlexical homographs. J Mem Lang 63:232–244CrossRef Macizo P, Bajo T, Cruz Martín M (2010) Inhibitory processes in bilingual language comprehension: evidence from Spanish-English interlexical homographs. J Mem Lang 63:232–244CrossRef
go back to reference Nan W, Liu Y, Zeng X, Yang W, Liang J, Lan Y, Fu S (2022) The spatiotemporal characteristics of N170s for faces and words: A meta-analysis study. PsyCh Journal 11:5–17CrossRefPubMed Nan W, Liu Y, Zeng X, Yang W, Liang J, Lan Y, Fu S (2022) The spatiotemporal characteristics of N170s for faces and words: A meta-analysis study. PsyCh Journal 11:5–17CrossRefPubMed
go back to reference Nestor A, Behrmann M, Plaut DC (2013) The neural basis of visual word form processing: a multivariate investigation. Cereb Cortex 23:1673–1684CrossRefPubMed Nestor A, Behrmann M, Plaut DC (2013) The neural basis of visual word form processing: a multivariate investigation. Cereb Cortex 23:1673–1684CrossRefPubMed
go back to reference Pelli DG, Farell B, Moore DC (2003) The remarkable inefficiency of word recognition. Nature 423:752–756CrossRefPubMed Pelli DG, Farell B, Moore DC (2003) The remarkable inefficiency of word recognition. Nature 423:752–756CrossRefPubMed
go back to reference Piepers DW, Robbins RA (2012) A Review and Clarification of the Terms “holistic,” “configural,” and “relational” in the Face Perception Literature. Front Psychol 3:559CrossRefPubMedPubMedCentral Piepers DW, Robbins RA (2012) A Review and Clarification of the Terms “holistic,” “configural,” and “relational” in the Face Perception Literature. Front Psychol 3:559CrossRefPubMedPubMedCentral
go back to reference Plaut DC, Behrmann M (2011) Complementary neural representations for faces and words: a computational exploration. Cogn Neuropsychol 28:251–275CrossRefPubMed Plaut DC, Behrmann M (2011) Complementary neural representations for faces and words: a computational exploration. Cogn Neuropsychol 28:251–275CrossRefPubMed
go back to reference Qiu J, Li H, Wei Y, Liu Q, Zhang Y, Zhang Q (2008) Neural mechanisms underlying the processing of Chinese and English words in a word generation task: an event-related potential study. Psychophysiology 45:970–976CrossRefPubMed Qiu J, Li H, Wei Y, Liu Q, Zhang Y, Zhang Q (2008) Neural mechanisms underlying the processing of Chinese and English words in a word generation task: an event-related potential study. Psychophysiology 45:970–976CrossRefPubMed
go back to reference Reicher GM (1969) Perceptual recognition as a function of meaningfulness of stimulus material. J Exp Psychol 81:275CrossRefPubMed Reicher GM (1969) Perceptual recognition as a function of meaningfulness of stimulus material. J Exp Psychol 81:275CrossRefPubMed
go back to reference Ren S, Shao H, He S (2021) Interaction between conscious and unconscious information-processing of faces and words. Neurosci Bullet 37(11):1583–1594CrossRef Ren S, Shao H, He S (2021) Interaction between conscious and unconscious information-processing of faces and words. Neurosci Bullet 37(11):1583–1594CrossRef
go back to reference Rubino C, Corrow SL, Duchaine B, Barton JJS (2016) Word and text processing in developmental prosopagnosia. Cogn Neuropsychol 33:315–328CrossRefPubMed Rubino C, Corrow SL, Duchaine B, Barton JJS (2016) Word and text processing in developmental prosopagnosia. Cogn Neuropsychol 33:315–328CrossRefPubMed
go back to reference Rumelhart DE, McClelland JL (1982) An interactive activation model of context effects in letter perception: II. The contextual enhancement effect and some tests and extensions of the model. Psychol Rev 89(1):60CrossRefPubMed Rumelhart DE, McClelland JL (1982) An interactive activation model of context effects in letter perception: II. The contextual enhancement effect and some tests and extensions of the model. Psychol Rev 89(1):60CrossRefPubMed
go back to reference Sigurdardottir HM, Arnardottir A, Halldorsdottir ET (2021) Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia. Sci Rep 11:23000CrossRefPubMedPubMedCentral Sigurdardottir HM, Arnardottir A, Halldorsdottir ET (2021) Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia. Sci Rep 11:23000CrossRefPubMedPubMedCentral
go back to reference Starrfelt R, Klargaard SK, Petersen A, Gerlach C (2016) Are reading and face processing related? An investigation of reading in developmental prosopagnosia, Biorxiv, p 039065 Starrfelt R, Klargaard SK, Petersen A, Gerlach C (2016) Are reading and face processing related? An investigation of reading in developmental prosopagnosia, Biorxiv, p 039065
go back to reference Streiner DL (2003) Unicorns do exist: a tutorial on “proving” the null hypothesis. Can J Psychiatry 48:756–761CrossRefPubMed Streiner DL (2003) Unicorns do exist: a tutorial on “proving” the null hypothesis. Can J Psychiatry 48:756–761CrossRefPubMed
go back to reference Susilo T, Wright V, Tree JJ, Duchaine B (2015) Acquired prosopagnosia without word recognition deficits. Cogn Neuropsychol 32:321–339CrossRefPubMed Susilo T, Wright V, Tree JJ, Duchaine B (2015) Acquired prosopagnosia without word recognition deficits. Cogn Neuropsychol 32:321–339CrossRefPubMed
go back to reference Tan LH, Spinks JA, Gao JH, Liu HL, Perfetti CA, Xiong J, Stofer KA, Pu Y, Liu Y, Fox PT (2000) Brain activation in the processing of Chinese characters and words: a functional MRI study. Hum Brain Mapp 10:16–27CrossRefPubMedPubMedCentral Tan LH, Spinks JA, Gao JH, Liu HL, Perfetti CA, Xiong J, Stofer KA, Pu Y, Liu Y, Fox PT (2000) Brain activation in the processing of Chinese characters and words: a functional MRI study. Hum Brain Mapp 10:16–27CrossRefPubMedPubMedCentral
go back to reference Tan LH, Liu H-L, Perfetti CA, Spinks JA, Fox PT, Gao J-H (2001) The neural system underlying Chinese logograph reading. Neu-Roimage 13:836–846 Tan LH, Liu H-L, Perfetti CA, Spinks JA, Fox PT, Gao J-H (2001) The neural system underlying Chinese logograph reading. Neu-Roimage 13:836–846
go back to reference Tan LH, Laird AR, Li K, Fox PT (2005) Neuroanatomical correlates of phonological processing of Chinese characters and alphabetic words: a meta-analysis. Hum Brain Mapp 25:83–91CrossRefPubMedPubMedCentral Tan LH, Laird AR, Li K, Fox PT (2005) Neuroanatomical correlates of phonological processing of Chinese characters and alphabetic words: a meta-analysis. Hum Brain Mapp 25:83–91CrossRefPubMedPubMedCentral
go back to reference Tanaka JW, Simonyi D (2016) The “parts and wholes” of face recognition: a review of the literature. Q J Exp Psychol (hove) 69:1876–1889CrossRefPubMed Tanaka JW, Simonyi D (2016) The “parts and wholes” of face recognition: a review of the literature. Q J Exp Psychol (hove) 69:1876–1889CrossRefPubMed
go back to reference Thierry G, Wu YJ (2004) Electrophysiological evidence for language interference in late bilinguals. NeuroReport 15:1555–1558CrossRefPubMed Thierry G, Wu YJ (2004) Electrophysiological evidence for language interference in late bilinguals. NeuroReport 15:1555–1558CrossRefPubMed
go back to reference Tso, R.V.-y., Au, T.K.-f., Hsiao, J.H.-w., (2014) Perceptual expertise: can sensorimotor experience change holistic processing and left-side bias? Psychol Sci 25:1757–1767CrossRef Tso, R.V.-y., Au, T.K.-f., Hsiao, J.H.-w., (2014) Perceptual expertise: can sensorimotor experience change holistic processing and left-side bias? Psychol Sci 25:1757–1767CrossRef
go back to reference Wang MY, Kuo BC, Cheng SK (2011) Chinese characters elicit face-like N170 inversion effects. Brain Cogn 77:419–431CrossRefPubMed Wang MY, Kuo BC, Cheng SK (2011) Chinese characters elicit face-like N170 inversion effects. Brain Cogn 77:419–431CrossRefPubMed
go back to reference Weiner KS, Zilles K (2016) The anatomical and functional specialization of the fusiform gyrus. Neuropsychologia 83:48–62CrossRefPubMed Weiner KS, Zilles K (2016) The anatomical and functional specialization of the fusiform gyrus. Neuropsychologia 83:48–62CrossRefPubMed
go back to reference Wong AC-N, Bukach CM, Hsiao J, Greenspon E, Ahern E, Duan Y, Lui KFH (2012) Holistic processing as a hallmark of perceptual expertise for nonface categories including Chinese characters. J vis 12:7–7CrossRefPubMed Wong AC-N, Bukach CM, Hsiao J, Greenspon E, Ahern E, Duan Y, Lui KFH (2012) Holistic processing as a hallmark of perceptual expertise for nonface categories including Chinese characters. J vis 12:7–7CrossRefPubMed
go back to reference Xu G, Jiang Y, Ma L, Yang Z, Weng X (2012) Similar spatial patterns of neural coding of category selectivity in FFA and VWFA under different attention conditions. Neuropsychologia 50:862–868CrossRefPubMed Xu G, Jiang Y, Ma L, Yang Z, Weng X (2012) Similar spatial patterns of neural coding of category selectivity in FFA and VWFA under different attention conditions. Neuropsychologia 50:862–868CrossRefPubMed
go back to reference Young AW, Hellawell D, Hay DC (1987) Configurational information in face perception. Perception 16:747–759CrossRefPubMed Young AW, Hellawell D, Hay DC (1987) Configurational information in face perception. Perception 16:747–759CrossRefPubMed
go back to reference Zhu C, Ma X, Ji L, Chen S, Cao X (2018) Sex differences in categorical adaptation for faces and Chinese characters during early perceptual processing. Front Hum Neurosci 11:656CrossRefPubMedPubMedCentral Zhu C, Ma X, Ji L, Chen S, Cao X (2018) Sex differences in categorical adaptation for faces and Chinese characters during early perceptual processing. Front Hum Neurosci 11:656CrossRefPubMedPubMedCentral
Metadata
Title
Faces, English words and Chinese characters: a study of dual-task interference in mono-and bilingual speakers
Authors
Marko Tien
Andrea Albonico
Jason J. S. Barton
Publication date
01-04-2023
Publisher
Springer Berlin Heidelberg
Published in
Experimental Brain Research / Issue 4/2023
Print ISSN: 0014-4819
Electronic ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-023-06580-2

Other articles of this Issue 4/2023

Experimental Brain Research 4/2023 Go to the issue

Advances in Alzheimer's

Alzheimer's research and care is changing rapidly. Keep up with the latest developments from key international conferences, together with expert insights on how to integrate these advances into practice.

This content is intended for healthcare professionals outside of the UK.

Supported by:
  • Lilly
Developed by: Springer Healthcare IME
Learn more