Skip to main content
Top
Published in: Experimental Brain Research 2/2013

01-04-2013 | Research Article

Evidence for a basic level in a taxonomy of everyday action sounds

Authors: Guillaume Lemaitre, Laurie M. Heller

Published in: Experimental Brain Research | Issue 2/2013

Login to get access

Abstract

We searched for evidence that the auditory organization of categories of sounds produced by actions includes a privileged or “basic” level of description. The sound events consisted of single objects (or substances) undergoing simple actions. Performance on sound events was measured in two ways: sounds were directly verified as belonging to a category, or sounds were used to create lexical priming. The category verification experiment measured the accuracy and reaction time to brief excerpts of these sounds. The lexical priming experiment measured reaction time benefits and costs caused by the presentation of these sounds prior to a lexical decision. The level of description of a sound varied in how specifically it described the physical properties of the action producing the sound. Both identification and priming effects were superior when a label described the specific interaction causing the sound (e.g. trickling) in comparison to the following: (1) more general descriptions (e.g. pour, liquid: trickling is a specific manner of pouring liquid), (2) more detailed descriptions using adverbs to provide detail regarding the manner of the action (e.g. trickling evenly). These results are consistent with neuroimaging studies showing that auditory representations of sounds produced by actions familiar to the listener activate motor representations of the gestures involved in sound production.
Appendix
Available only for authorised users
Literature
go back to reference Adams RB, Janata P (2002) A comparison of neural circuits underlying auditory and visual object categorization. Neuroimage 16:361–377PubMedCrossRef Adams RB, Janata P (2002) A comparison of neural circuits underlying auditory and visual object categorization. Neuroimage 16:361–377PubMedCrossRef
go back to reference Aglioti SM, Pazzaglia M (2010) Representing actions through their sound. Exp Brain Res 206(2):141–151PubMedCrossRef Aglioti SM, Pazzaglia M (2010) Representing actions through their sound. Exp Brain Res 206(2):141–151PubMedCrossRef
go back to reference Alaerts K, Swinnen SP, Wenderoth N (2009) Interaction of sound and sight during action perception: evidence for shared modality-dependent action representations. Neuropsychologia 47:2593–2599PubMedCrossRef Alaerts K, Swinnen SP, Wenderoth N (2009) Interaction of sound and sight during action perception: evidence for shared modality-dependent action representations. Neuropsychologia 47:2593–2599PubMedCrossRef
go back to reference Aramaki M, Marie C, Kronland-Martinet R, Ystad S, Besson M (2010) Sound categorization and conceptual priming for nonlinguistic and linguistic sounds. J Cogn Neurosci 22(11):2555–2569PubMedCrossRef Aramaki M, Marie C, Kronland-Martinet R, Ystad S, Besson M (2010) Sound categorization and conceptual priming for nonlinguistic and linguistic sounds. J Cogn Neurosci 22(11):2555–2569PubMedCrossRef
go back to reference Aziz-Zadeh L, Iacobini M, Zaidel E, Wilson S, Mazziota J (2004) Left hemisphere motor facilitation in response to manual action sounds. Eur J Neurosci 19:2609–2612PubMedCrossRef Aziz-Zadeh L, Iacobini M, Zaidel E, Wilson S, Mazziota J (2004) Left hemisphere motor facilitation in response to manual action sounds. Eur J Neurosci 19:2609–2612PubMedCrossRef
go back to reference Ballas JA (1993) Common factors in the identification of an assortment of brief everyday sounds. J Exp Psychol Hum Percept Perform 19(2):250–267PubMedCrossRef Ballas JA (1993) Common factors in the identification of an assortment of brief everyday sounds. J Exp Psychol Hum Percept Perform 19(2):250–267PubMedCrossRef
go back to reference Balota DA, Cortese MJ, Sergent-Marshall SD, Spieler DH, Yap MJ (2004) Visual word recognition of single-syllable words. J Exp Psychol Gen 133(2):283–316PubMedCrossRef Balota DA, Cortese MJ, Sergent-Marshall SD, Spieler DH, Yap MJ (2004) Visual word recognition of single-syllable words. J Exp Psychol Gen 133(2):283–316PubMedCrossRef
go back to reference Beauchamp MS, Argall D, Borduka J, Duyn JH, Martin A (2004) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7(11):1190–1992PubMedCrossRef Beauchamp MS, Argall D, Borduka J, Duyn JH, Martin A (2004) Unraveling multisensory integration: patchy organization within human STS multisensory cortex. Nat Neurosci 7(11):1190–1992PubMedCrossRef
go back to reference Bidet-Caulet A, Voisin J, Bertrand O, Fonlupt P (2005) Listening to a walking human activates the temporal biological motion area. NeuroImage 28:132–139PubMedCrossRef Bidet-Caulet A, Voisin J, Bertrand O, Fonlupt P (2005) Listening to a walking human activates the temporal biological motion area. NeuroImage 28:132–139PubMedCrossRef
go back to reference Cabe PA, Pittenger JB (2000) Human sensitivity to acoustic information from vessel filling. J Exp Psychol Hum Percept Perform 26(1):313–324PubMedCrossRef Cabe PA, Pittenger JB (2000) Human sensitivity to acoustic information from vessel filling. J Exp Psychol Hum Percept Perform 26(1):313–324PubMedCrossRef
go back to reference Carello C, Anderson KL, Kunkler-Peck AJ (1998) Perception of object length by sound. Psychol Sci 9(3):211–214CrossRef Carello C, Anderson KL, Kunkler-Peck AJ (1998) Perception of object length by sound. Psychol Sci 9(3):211–214CrossRef
go back to reference Castiello U, Giordano BL, Begliomini C, Ansuini C, Grassi M (2010) When ears drive hands: the influence of contact sound on reaching to grasp. PLoS One 5:e12240PubMedCrossRef Castiello U, Giordano BL, Begliomini C, Ansuini C, Grassi M (2010) When ears drive hands: the influence of contact sound on reaching to grasp. PLoS One 5:e12240PubMedCrossRef
go back to reference Chen JL, Penhune VB, Zatorre RJ (2008) Listening to musical rhythms recruits motor regions of the brain. Cereb Cortex 18(12):2844–2854PubMedCrossRef Chen JL, Penhune VB, Zatorre RJ (2008) Listening to musical rhythms recruits motor regions of the brain. Cereb Cortex 18(12):2844–2854PubMedCrossRef
go back to reference Chiu CYP, Schacter DL (1995) Auditory priming for nonverbal information: implicit and explicit memory for environmental sounds. Conscious Cogn 4:440–458PubMedCrossRef Chiu CYP, Schacter DL (1995) Auditory priming for nonverbal information: implicit and explicit memory for environmental sounds. Conscious Cogn 4:440–458PubMedCrossRef
go back to reference Cummings A, Ceponiene R, Katoma A, Saigin AP, Townsend J, Dick F (2006) Auditory semantic networks for words and natural sounds. Brain Res 115:92–107CrossRef Cummings A, Ceponiene R, Katoma A, Saigin AP, Townsend J, Dick F (2006) Auditory semantic networks for words and natural sounds. Brain Res 115:92–107CrossRef
go back to reference De Lucia M, Camen C, Clark S, Murray MM (2009) The role of actions in auditory object discrimination. Neuroimage 48:475–485PubMedCrossRef De Lucia M, Camen C, Clark S, Murray MM (2009) The role of actions in auditory object discrimination. Neuroimage 48:475–485PubMedCrossRef
go back to reference Fellbaum C (ed) (1998) WordNet: an electronic lexical database. MIT Press, Cambridge, MA Fellbaum C (ed) (1998) WordNet: an electronic lexical database. MIT Press, Cambridge, MA
go back to reference Galati G, Commiteri G, Spitoni G, Aprile T, Russo FD, Pitzalis S, Pizzamiglio L (2008) A selective representation of the meaning of actions in the auditory mirror system. Neuroimage 40(3):1274–1286PubMedCrossRef Galati G, Commiteri G, Spitoni G, Aprile T, Russo FD, Pitzalis S, Pizzamiglio L (2008) A selective representation of the meaning of actions in the auditory mirror system. Neuroimage 40(3):1274–1286PubMedCrossRef
go back to reference Gaver WW (1993) What do we hear in the world? An ecological approach to auditory event perception. Ecol Psychol 5(1):1–29CrossRef Gaver WW (1993) What do we hear in the world? An ecological approach to auditory event perception. Ecol Psychol 5(1):1–29CrossRef
go back to reference Gazzola V, Aziz-Zadeh L, Keysers C (2006) Empathy and the somatotopic auditory mirror system in humans. Curr Biol 16:1824–1829PubMedCrossRef Gazzola V, Aziz-Zadeh L, Keysers C (2006) Empathy and the somatotopic auditory mirror system in humans. Curr Biol 16:1824–1829PubMedCrossRef
go back to reference Giordano BL, McDonnell J, McAdams S (2010) Hearing living symbols and nonliving icons: category specificities in the cognitive processing of environmental sounds. Brain Cogn 73:7–19PubMedCrossRef Giordano BL, McDonnell J, McAdams S (2010) Hearing living symbols and nonliving icons: category specificities in the cognitive processing of environmental sounds. Brain Cogn 73:7–19PubMedCrossRef
go back to reference Grainger J (1990) Word frequency and neighborhood frequency effects in lexical decisions and naming. J Mem Lang 29:228–244CrossRef Grainger J (1990) Word frequency and neighborhood frequency effects in lexical decisions and naming. J Mem Lang 29:228–244CrossRef
go back to reference Grassi M (2005) Do we hear size or sound? Balls dropped on plates. Percept Psychophys 67(2):274–284PubMedCrossRef Grassi M (2005) Do we hear size or sound? Balls dropped on plates. Percept Psychophys 67(2):274–284PubMedCrossRef
go back to reference Grassi M, Casco C (2009) Audiovisual bounce-inducing effect: attention alone does not explain why the discs are bouncing. J Exp Psychol Hum Percept Perform 35(1):235–243 Grassi M, Casco C (2009) Audiovisual bounce-inducing effect: attention alone does not explain why the discs are bouncing. J Exp Psychol Hum Percept Perform 35(1):235–243
go back to reference Grassi M, Casco C (2010) Audiovisual bounce-inducing effect: when sound congruence affects grouping in vision. Atten Percept Psychophys 72:378–386PubMedCrossRef Grassi M, Casco C (2010) Audiovisual bounce-inducing effect: when sound congruence affects grouping in vision. Atten Percept Psychophys 72:378–386PubMedCrossRef
go back to reference Grassi M, Darwin CJ (2006) The subjective duration of ramped and damped sounds. Percept Psychophys 68(8):1382–1392PubMedCrossRef Grassi M, Darwin CJ (2006) The subjective duration of ramped and damped sounds. Percept Psychophys 68(8):1382–1392PubMedCrossRef
go back to reference Gygi B, Kidd GR, Watson CS (2004) Spectral-temporal factors in the identification of environmental sounds. J Acoust Soc Am 115(3):1252–1265PubMedCrossRef Gygi B, Kidd GR, Watson CS (2004) Spectral-temporal factors in the identification of environmental sounds. J Acoust Soc Am 115(3):1252–1265PubMedCrossRef
go back to reference Houben MMJ, Kohlrausch A, Hermes DJ (2004) Perception of the size and speed of rolling balls by sound. Speech Commun 43:331–345CrossRef Houben MMJ, Kohlrausch A, Hermes DJ (2004) Perception of the size and speed of rolling balls by sound. Speech Commun 43:331–345CrossRef
go back to reference Houix O, Lemaitre G, Misdariis N, Susini P, Urdapilleta I (2012) A lexical analysis of environmental sound categories. J Exp Psychol Appl 18(1):52–80PubMedCrossRef Houix O, Lemaitre G, Misdariis N, Susini P, Urdapilleta I (2012) A lexical analysis of environmental sound categories. J Exp Psychol Appl 18(1):52–80PubMedCrossRef
go back to reference Howell DC (2009) Statistical methods for psychology, vol 7. Wadsworth, Cengage learning Howell DC (2009) Statistical methods for psychology, vol 7. Wadsworth, Cengage learning
go back to reference Hyman R (1953) Stimulus information as a determinant of reaction time. J Exp Psychol 45(3):188–196PubMedCrossRef Hyman R (1953) Stimulus information as a determinant of reaction time. J Exp Psychol 45(3):188–196PubMedCrossRef
go back to reference Kaplan JT, Iacobani M (2007) Multimodal action representation in human left ventral premotor cortex. Cogn Process 8:103–113PubMedCrossRef Kaplan JT, Iacobani M (2007) Multimodal action representation in human left ventral premotor cortex. Cogn Process 8:103–113PubMedCrossRef
go back to reference Keller P, Stevens C (2004) Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. J Exp Psychol Appl 10(1):3–12PubMedCrossRef Keller P, Stevens C (2004) Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. J Exp Psychol Appl 10(1):3–12PubMedCrossRef
go back to reference Keysers C, Kohler E, Ulmità MA, Nanetti L, Fogassi L, Gallese V (2003) Audiovisual neurons and action recognition. Exp Brain Res 153:628–636PubMedCrossRef Keysers C, Kohler E, Ulmità MA, Nanetti L, Fogassi L, Gallese V (2003) Audiovisual neurons and action recognition. Exp Brain Res 153:628–636PubMedCrossRef
go back to reference Klatzky RL, Pai DK, Krotkov EP (2000) Perception of material from contact sounds. Presence 9(4):399–410CrossRef Klatzky RL, Pai DK, Krotkov EP (2000) Perception of material from contact sounds. Presence 9(4):399–410CrossRef
go back to reference Lakatos S, McAdams S, Caussé R (1997) The representation of auditory source characteristics: simple geometric forms. Percept Psychophys 59(8):1180–1190PubMedCrossRef Lakatos S, McAdams S, Caussé R (1997) The representation of auditory source characteristics: simple geometric forms. Percept Psychophys 59(8):1180–1190PubMedCrossRef
go back to reference Lemaitre G, Heller LM (2012) Auditory perception of material is fragile, while action is strikingly robust. J Acoust Soc Am 131(2):1337–1348 Lemaitre G, Heller LM (2012) Auditory perception of material is fragile, while action is strikingly robust. J Acoust Soc Am 131(2):1337–1348
go back to reference Lemaitre G, Houix O, Misdariis N, Susini P (2010) Listener expertise and sound identification influence the categorization of environmental sounds. J Exp Psychol Appl 16(1):16–32PubMedCrossRef Lemaitre G, Houix O, Misdariis N, Susini P (2010) Listener expertise and sound identification influence the categorization of environmental sounds. J Exp Psychol Appl 16(1):16–32PubMedCrossRef
go back to reference Lemaitre G, Dessein A, Susini P, Aura K (2011) Vocal imitations and the identification of sound events. Ecol Psychol 23:267–307CrossRef Lemaitre G, Dessein A, Susini P, Aura K (2011) Vocal imitations and the identification of sound events. Ecol Psychol 23:267–307CrossRef
go back to reference Lewis JW, Wightman FL, Brefczynski JA, Phinney RE, Binder JR, DeYoe EA (2004) Human brain regions involved in recognizing environmental sounds. Cereb Cortex 14:1008–1021PubMedCrossRef Lewis JW, Wightman FL, Brefczynski JA, Phinney RE, Binder JR, DeYoe EA (2004) Human brain regions involved in recognizing environmental sounds. Cereb Cortex 14:1008–1021PubMedCrossRef
go back to reference Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA (2005) Distinct cortical pathways for processing tools versus animal sounds. J Neurosci 25(21):5148–5158PubMedCrossRef Lewis JW, Brefczynski JA, Phinney RE, Janik JJ, DeYoe EA (2005) Distinct cortical pathways for processing tools versus animal sounds. J Neurosci 25(21):5148–5158PubMedCrossRef
go back to reference Lewis JW, Talkington WJ, Puce A, Engel LR, Frum C (2011) Cortical networks representing object categories and high-level attributes of familiar real-world action sounds. J Cogn Neurosci 23(8):2079–2101PubMedCrossRef Lewis JW, Talkington WJ, Puce A, Engel LR, Frum C (2011) Cortical networks representing object categories and high-level attributes of familiar real-world action sounds. J Cogn Neurosci 23(8):2079–2101PubMedCrossRef
go back to reference Marcell MM, Borella D, Greene M, Kerr E, Rogers S (2000) Confrontation naming of environmental sounds. J Clin Exp Neuropsychol 22(6):830–864PubMedCrossRef Marcell MM, Borella D, Greene M, Kerr E, Rogers S (2000) Confrontation naming of environmental sounds. J Clin Exp Neuropsychol 22(6):830–864PubMedCrossRef
go back to reference Marcell MM, Maltanos M, Leahy C, Comeaux C (2007) Identifying, rating and remembering environmental sound events. Behav Res Methods 39(3):561–569PubMedCrossRef Marcell MM, Maltanos M, Leahy C, Comeaux C (2007) Identifying, rating and remembering environmental sound events. Behav Res Methods 39(3):561–569PubMedCrossRef
go back to reference Miller GA (1995) Wordnet: a lexical database for English. Commun ACM 38(11):39–41CrossRef Miller GA (1995) Wordnet: a lexical database for English. Commun ACM 38(11):39–41CrossRef
go back to reference Neely JH (1991) Semantic priming effects in visual word recognition: a selective review of current findings and theories. In: Besner D, Humphreys GW (eds) Basic processes in reading: visual word recognition, Chap. 9. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 264–335 Neely JH (1991) Semantic priming effects in visual word recognition: a selective review of current findings and theories. In: Besner D, Humphreys GW (eds) Basic processes in reading: visual word recognition, Chap. 9. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 264–335
go back to reference Orgs G, Lange K, Dombrowski JH, Heil M (2006) Conceptual priming for environmental sounds: an ERP study. Brain Cogn 62:267–272PubMedCrossRef Orgs G, Lange K, Dombrowski JH, Heil M (2006) Conceptual priming for environmental sounds: an ERP study. Brain Cogn 62:267–272PubMedCrossRef
go back to reference Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S (2011) The timbre toolbox: extracting audio descriptors from musical signals. J Acoust Soc Am 130(5):2902PubMedCrossRef Peeters G, Giordano BL, Susini P, Misdariis N, McAdams S (2011) The timbre toolbox: extracting audio descriptors from musical signals. J Acoust Soc Am 130(5):2902PubMedCrossRef
go back to reference Pizzamiglio L, Aprile T, Spitoni G, Pitzalis S, Bates E, D’Amico S, Di Russo F (2005) Separate neural systems of processing action- or non-action-related sounds. Neuroimage 24:852–861PubMedCrossRef Pizzamiglio L, Aprile T, Spitoni G, Pitzalis S, Bates E, D’Amico S, Di Russo F (2005) Separate neural systems of processing action- or non-action-related sounds. Neuroimage 24:852–861PubMedCrossRef
go back to reference Rogers TT, McClelland JL (2004) Semantic cognition. A Parallel-Distributed- Processing approach. The MIT press, Cambridge, MA Rogers TT, McClelland JL (2004) Semantic cognition. A Parallel-Distributed- Processing approach. The MIT press, Cambridge, MA
go back to reference Rosch E (1978) Principles of categorization. In: Rosch E, Lloyd BB (eds) Cognition and categorization, Chap 2. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 27–48 Rosch E (1978) Principles of categorization. In: Rosch E, Lloyd BB (eds) Cognition and categorization, Chap 2. Lawrence Erlbaum Associates, Hillsdale, NJ, pp 27–48
go back to reference Rosch E, Mervis CB (1975) Family resemblances: studies in the internal structure of categories. Cogn Psychol 7:573–605CrossRef Rosch E, Mervis CB (1975) Family resemblances: studies in the internal structure of categories. Cogn Psychol 7:573–605CrossRef
go back to reference Rosch E, Mervis CB, Gray WD, Johnson DM, Boyes-Braem P (1976) Basic objects in natural categories. Cogn Psychol 8:382–439CrossRef Rosch E, Mervis CB, Gray WD, Johnson DM, Boyes-Braem P (1976) Basic objects in natural categories. Cogn Psychol 8:382–439CrossRef
go back to reference Saygın AP, Dick F, Bates E (2005) An on-line task for contrasting auditory processing in the verbal and nonverbal domains and norms for younger and older adults. Behav Res Methods 37(1):99–110PubMedCrossRef Saygın AP, Dick F, Bates E (2005) An on-line task for contrasting auditory processing in the verbal and nonverbal domains and norms for younger and older adults. Behav Res Methods 37(1):99–110PubMedCrossRef
go back to reference Schön D, Ystad S, Kronland-Martinet R, Besson M (2009) The evocative power of sounds: conceptual priming between words and nonverbal sounds. J Cogn Neurosci 22(5):1026–1035CrossRef Schön D, Ystad S, Kronland-Martinet R, Besson M (2009) The evocative power of sounds: conceptual priming between words and nonverbal sounds. J Cogn Neurosci 22(5):1026–1035CrossRef
go back to reference Sedda A, Monaco S, Bottini G, Goodale MA (2011) Integration of visual and auditory information for hand actions: preliminary evidence for the contribution of natural sounds to grasping. Exp Brain Res 209:365–374PubMedCrossRef Sedda A, Monaco S, Bottini G, Goodale MA (2011) Integration of visual and auditory information for hand actions: preliminary evidence for the contribution of natural sounds to grasping. Exp Brain Res 209:365–374PubMedCrossRef
go back to reference Stuart GP, Jones DM (1995) Priming the identification of environmental sounds. Q J Exp Psychol A Hum Exp Psychol 48(3):741–761CrossRef Stuart GP, Jones DM (1995) Priming the identification of environmental sounds. Q J Exp Psychol A Hum Exp Psychol 48(3):741–761CrossRef
go back to reference van den Doel K, Pai DK (1998) The sounds of physical shapes. Presence 7(4):382–395CrossRef van den Doel K, Pai DK (1998) The sounds of physical shapes. Presence 7(4):382–395CrossRef
go back to reference van Petten C, Rheinfelder H (1995) Conceptual relationships between spoken words and environmental sounds: event related brain potential measures. Neuropsychologia 33(4):485–508PubMedCrossRef van Petten C, Rheinfelder H (1995) Conceptual relationships between spoken words and environmental sounds: event related brain potential measures. Neuropsychologia 33(4):485–508PubMedCrossRef
go back to reference Vanderveer NJ (1979) Ecological acoustics: human perception of environmental sounds. PhD thesis, Cornell University Vanderveer NJ (1979) Ecological acoustics: human perception of environmental sounds. PhD thesis, Cornell University
go back to reference Warren WH, Verbrugge RR (1984) Auditory perception of breaking and bouncing events: a case study in ecological acoustics. J Exp Psychol Hum Percept Perform 10(5):704–712PubMedCrossRef Warren WH, Verbrugge RR (1984) Auditory perception of breaking and bouncing events: a case study in ecological acoustics. J Exp Psychol Hum Percept Perform 10(5):704–712PubMedCrossRef
Metadata
Title
Evidence for a basic level in a taxonomy of everyday action sounds
Authors
Guillaume Lemaitre
Laurie M. Heller
Publication date
01-04-2013
Publisher
Springer-Verlag
Published in
Experimental Brain Research / Issue 2/2013
Print ISSN: 0014-4819
Electronic ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-013-3430-7

Other articles of this Issue 2/2013

Experimental Brain Research 2/2013 Go to the issue