Skip to main content
Top
Published in: Experimental Brain Research 4/2005

01-12-2005 | Research Article

The role of spatial disparity and hemifields in audio-visual temporal order judgments

Authors: Mirjam Keetels, Jean Vroomen

Published in: Experimental Brain Research | Issue 4/2005

Login to get access

Abstract

We explored whether sensitivity to audio-visual temporal order judgments (TOJs) was affected by the amount of spatial separation between a sound and light, and by whether the sound and light were presented in the same or in different hemifields. Participants made TOJs about noise bursts and light flashes, and judged whether the stimuli came from the same location or not. Flashes were presented either in the left or right hemifield (at ±10° from central fixation), and sounds either came from the same location as the lights, or at small or large disparities (20 or 40° from the light, respectively), thereby crossing the hemifields or not. TOJs became more accurate (i.e., the just noticeable difference, JND, became smaller) when spatial disparity increased and when hemifields were crossed. Location discrimination of the sound and light was affected similarly. These results demonstrate that audio-visual TOJs are critically dependent on both the relative position from which stimuli are presented and on whether stimuli cross hemifields or not.
Literature
go back to reference Bald L, Berrien FK, Price JB, Sprague RO (1942) Errors in perceiving the temporal order of auditory and visual stimuli. J Appl Psychol 26:382–388CrossRef Bald L, Berrien FK, Price JB, Sprague RO (1942) Errors in perceiving the temporal order of auditory and visual stimuli. J Appl Psychol 26:382–388CrossRef
go back to reference Bertelson P, Aschersleben G (2003) Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. Int J Psychophysiol 50:147–155CrossRefPubMed Bertelson P, Aschersleben G (2003) Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. Int J Psychophysiol 50:147–155CrossRefPubMed
go back to reference Carrasco M, McElree B, Denisova K, Giordano AM (2003) Speed of visual processing increases with eccentricity. Nat Neurosci 6:699–700CrossRefPubMed Carrasco M, McElree B, Denisova K, Giordano AM (2003) Speed of visual processing increases with eccentricity. Nat Neurosci 6:699–700CrossRefPubMed
go back to reference Dinnerstein AJ, Zlotogura P (1968) Intermodal perception of temporal order and motor skills: effects of age. Percept Motor Skill 26:987–1000 Dinnerstein AJ, Zlotogura P (1968) Intermodal perception of temporal order and motor skills: effects of age. Percept Motor Skill 26:987–1000
go back to reference Godfroy M, Roumes C, Dauchy P (2003) Spatial variations of visual-auditory fusion areas. Perception 32:1233–1245CrossRefPubMed Godfroy M, Roumes C, Dauchy P (2003) Spatial variations of visual-auditory fusion areas. Perception 32:1233–1245CrossRefPubMed
go back to reference Hairston WD, Wallace MT, Vaughan JW, Stein BE, Norris JL, Schirillo JA (2003) Visual localization ability influences cross-modal bias. J Cogn Neurosci 15:20–29CrossRefPubMed Hairston WD, Wallace MT, Vaughan JW, Stein BE, Norris JL, Schirillo JA (2003) Visual localization ability influences cross-modal bias. J Cogn Neurosci 15:20–29CrossRefPubMed
go back to reference Hamlin AJ (1895) On the least observable interval between stimuli addressed to disparate senses and to different organs of the same sense. Am J Psychol 6:564–575CrossRef Hamlin AJ (1895) On the least observable interval between stimuli addressed to disparate senses and to different organs of the same sense. Am J Psychol 6:564–575CrossRef
go back to reference Jaskowski P, Jaroszyk F, Hojan-Jerierska D (1990) Temporal-order judgments and reaction time for stimuli of different modalities. Psychol Res 52:35–38CrossRefPubMed Jaskowski P, Jaroszyk F, Hojan-Jerierska D (1990) Temporal-order judgments and reaction time for stimuli of different modalities. Psychol Res 52:35–38CrossRefPubMed
go back to reference Keetels M, Vroomen J (2004) The role of space in audio-visual temporal order judgments. Poster presented at the 5th meeting of the International Multisensory Research Forum. Barcelona, Spain (June 2–5), http://www.imrf.info/2004/103 Keetels M, Vroomen J (2004) The role of space in audio-visual temporal order judgments. Poster presented at the 5th meeting of the International Multisensory Research Forum. Barcelona, Spain (June 2–5), http://​www.​imrf.​info/​2004/​103
go back to reference Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17:154–163CrossRef Morein-Zamir S, Soto-Faraco S, Kingstone A (2003) Auditory capture of vision: examining temporal ventriloquism. Cogn Brain Res 17:154–163CrossRef
go back to reference Morein-Zamir S, Li K, Kingstone A (2004) Looking at the window of perceived simultaneity: repetition, rate, and crossmodal asymmetries. Paper presented at the 5th meeting of the International Multisensory Research Forum. Barcelona, Spain (June 2–5), http://www.imrf.info/2004/131 Morein-Zamir S, Li K, Kingstone A (2004) Looking at the window of perceived simultaneity: repetition, rate, and crossmodal asymmetries. Paper presented at the 5th meeting of the International Multisensory Research Forum. Barcelona, Spain (June 2–5), http://​www.​imrf.​info/​2004/​131
go back to reference Radeau M (1994) Auditory-visual interaction and modularity. Curr Psych Cogn 13:3–51 Radeau M (1994) Auditory-visual interaction and modularity. Curr Psych Cogn 13:3–51
go back to reference Radeau M, Bertelson P (1987) Auditory-visual interaction and the timing of inputs: Thomas (1941) revisited. Psychol Res 49:17–22CrossRefPubMed Radeau M, Bertelson P (1987) Auditory-visual interaction and the timing of inputs: Thomas (1941) revisited. Psychol Res 49:17–22CrossRefPubMed
go back to reference Rutschmann R (1966) Perception of temporal order and relative visual latency. Science 152:1099–1101PubMedCrossRef Rutschmann R (1966) Perception of temporal order and relative visual latency. Science 152:1099–1101PubMedCrossRef
go back to reference Rutschmann J, Link R (1964) Perception of temporal order of stimuli differing in sense mode and simple reaction time. Percept Motor Skill 18:345–352 Rutschmann J, Link R (1964) Perception of temporal order of stimuli differing in sense mode and simple reaction time. Percept Motor Skill 18:345–352
go back to reference Smith WF (1933) The relative quickness of visual and auditory perception. J Exp Psychol 16:239–257CrossRef Smith WF (1933) The relative quickness of visual and auditory perception. J Exp Psychol 16:239–257CrossRef
go back to reference Spence C, Baddeley R, Zampini M, James R, Shore DI (2003) Multisensory temporal order judgments: when two locations are better than one. Percept Psychophys 65:318–328PubMed Spence C, Baddeley R, Zampini M, James R, Shore DI (2003) Multisensory temporal order judgments: when two locations are better than one. Percept Psychophys 65:318–328PubMed
go back to reference Teatini G, Farnè M, Verzella F, Berruecos P Jr (1976) Perception of temporal order: visual and auditory stimuli. Giorn Ital di Psicologia 3:157–164 Teatini G, Farnè M, Verzella F, Berruecos P Jr (1976) Perception of temporal order: visual and auditory stimuli. Giorn Ital di Psicologia 3:157–164
go back to reference Vroomen J, de Gelder B (2004) Temporal ventriloquism: sound modulates the flash-lag effect. J Exp Psychol Hum Percept Perform 30:513–518CrossRefPubMed Vroomen J, de Gelder B (2004) Temporal ventriloquism: sound modulates the flash-lag effect. J Exp Psychol Hum Percept Perform 30:513–518CrossRefPubMed
go back to reference Vroomen J, Keetels M, de Gelder B, Bertelson P (2004) Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cogn Brain Res 22:32–35CrossRef Vroomen J, Keetels M, de Gelder B, Bertelson P (2004) Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cogn Brain Res 22:32–35CrossRef
go back to reference Wandell BA (1995) Foundations of vision. Sinauer, Sunderland Wandell BA (1995) Foundations of vision. Sinauer, Sunderland
go back to reference Whipple GM, Sanford EC, Colgrove FW (1899) Minor studies from the psychological laboratory of dark University: on nearly simultaneous clicks and flashes: the time required for recognition: notes on mental standards of length. Am J Psychol 10:280–295CrossRef Whipple GM, Sanford EC, Colgrove FW (1899) Minor studies from the psychological laboratory of dark University: on nearly simultaneous clicks and flashes: the time required for recognition: notes on mental standards of length. Am J Psychol 10:280–295CrossRef
go back to reference Woldorff MG, Tempelmann C, Fell J, Tegeler C, Gaschler-Markefski B, Hinrichs H, Heinz HJ, Scheich H (1999) Lateralized auditory spatial perception and the contralaterality of cortical processing as studied with functional magnetic resonance imaging and magnetoencephalography. Hum Brain Mapp 7:49–66CrossRefPubMed Woldorff MG, Tempelmann C, Fell J, Tegeler C, Gaschler-Markefski B, Hinrichs H, Heinz HJ, Scheich H (1999) Lateralized auditory spatial perception and the contralaterality of cortical processing as studied with functional magnetic resonance imaging and magnetoencephalography. Hum Brain Mapp 7:49–66CrossRefPubMed
go back to reference Zampini M, Shore DI, Spence C (2003a) Audiovisual temporal order judgments. Exp Brain Res 152:198–210CrossRef Zampini M, Shore DI, Spence C (2003a) Audiovisual temporal order judgments. Exp Brain Res 152:198–210CrossRef
go back to reference Zampini M, Shore DI, Spence C (2003b) Multisensory temporal order judgments: the role of hemispheric redundancy. Int J Psychophysiol 50:165–180CrossRef Zampini M, Shore DI, Spence C (2003b) Multisensory temporal order judgments: the role of hemispheric redundancy. Int J Psychophysiol 50:165–180CrossRef
go back to reference Zampini M, Brown T, Shore DI, Maravita A, Roder B, Spence C (2005) Audiotactile temporal order judgments. Acta Psychol (in press) Zampini M, Brown T, Shore DI, Maravita A, Roder B, Spence C (2005) Audiotactile temporal order judgments. Acta Psychol (in press)
Metadata
Title
The role of spatial disparity and hemifields in audio-visual temporal order judgments
Authors
Mirjam Keetels
Jean Vroomen
Publication date
01-12-2005
Publisher
Springer-Verlag
Published in
Experimental Brain Research / Issue 4/2005
Print ISSN: 0014-4819
Electronic ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-005-0067-1

Other articles of this Issue 4/2005

Experimental Brain Research 4/2005 Go to the issue