Skip to main content
Top
Published in: Experimental Brain Research 1/2010

01-05-2010 | Research Article

Does temporal asynchrony affect multimodal curvature detection?

Authors: Sara A. Winges, Stephanie E. Eonta, John F. Soechting

Published in: Experimental Brain Research | Issue 1/2010

Login to get access

Abstract

Multiple sensory modalities gather information about our surroundings to plan appropriate movements based on the properties of the environment and the objects within it. This study was designed to examine the sensitivity of visual and haptic information alone and together for detecting curvature. When both visual and haptic information were present, temporal delays in signal onset were used to determine the effect of asynchronous sensory information on the interference of vision on the haptic estimate of curvature. Even under the largest temporal delays where visual and haptic information were clearly disparate, the presentation of visual information influenced the haptic perception of curvature. The uncertainty associated with the unimodal vision condition was smaller than that in the unimodal haptic condition, regardless of whether the haptic information was procured actively or under robot assistance for curvature detection. When both visual and haptic information were available, the uncertainty was not reduced; it was equal to that of the unimodal haptic condition. The weighting of the visual and haptic information was highly variable across subjects with some subjects making judgments based largely on haptic information, while others tended to rely on visual information equally or to a larger extent than the haptic information.
Literature
go back to reference Dassonville P (1995) Haptic localization and the internal representation of the hand in space. Exp Brain Res 106:434–448CrossRefPubMed Dassonville P (1995) Haptic localization and the internal representation of the hand in space. Exp Brain Res 106:434–448CrossRefPubMed
go back to reference Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429–433CrossRefPubMed Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429–433CrossRefPubMed
go back to reference Flanagan JR, Rao AK (1995) Trajectory adaptation to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. J Neurophysiol 74:2174–2178PubMed Flanagan JR, Rao AK (1995) Trajectory adaptation to a nonlinear visuomotor transformation: evidence of motion planning in visually perceived space. J Neurophysiol 74:2174–2178PubMed
go back to reference Goodbody SJ, Wolpert DM (1999) The effect of visuomotor displacements on arm movement paths. Exp Brain Res 127:213–223CrossRefPubMed Goodbody SJ, Wolpert DM (1999) The effect of visuomotor displacements on arm movement paths. Exp Brain Res 127:213–223CrossRefPubMed
go back to reference Gordon I, Morison V (1982) The haptic perception of curvature. Percept Psychophys 31:446–450PubMed Gordon I, Morison V (1982) The haptic perception of curvature. Percept Psychophys 31:446–450PubMed
go back to reference Hartcher-O’Brien J, Gallace A, Krings B, Koppen C, Spence C (2008) When vision ‘extinguishes’ touch in neurologically-normal people: extending the Colavita visual dominance effect. Exp Brain Res 186:643–658CrossRefPubMed Hartcher-O’Brien J, Gallace A, Krings B, Koppen C, Spence C (2008) When vision ‘extinguishes’ touch in neurologically-normal people: extending the Colavita visual dominance effect. Exp Brain Res 186:643–658CrossRefPubMed
go back to reference Hashtrudi-Zaad K, Salcudean SE (2002) Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation. IEEE Trans Robot Autom 18:108–114CrossRef Hashtrudi-Zaad K, Salcudean SE (2002) Transparency in time-delayed systems and the effect of local force feedback for transparent teleoperation. IEEE Trans Robot Autom 18:108–114CrossRef
go back to reference Henriques DY, Soechting JF (2003) Bias and sensitivity in the haptic perception of geometry. Exp Brain Res 150:95–108PubMed Henriques DY, Soechting JF (2003) Bias and sensitivity in the haptic perception of geometry. Exp Brain Res 150:95–108PubMed
go back to reference Kesten H (1958) Accelerated stochastic approximation. Ann Math Stat 29:41–59CrossRef Kesten H (1958) Accelerated stochastic approximation. Ann Math Stat 29:41–59CrossRef
go back to reference Kim T, Zimmerman PM, Wade MJ, Weiss CA 3rd (2005) The effect of delayed visual feedback on telerobotic surgery. Surg Endosc 19:683–686CrossRefPubMed Kim T, Zimmerman PM, Wade MJ, Weiss CA 3rd (2005) The effect of delayed visual feedback on telerobotic surgery. Surg Endosc 19:683–686CrossRefPubMed
go back to reference Konczak J, Li KY, Tuite PJ, Poizner H (2008) Haptic perception of object curvature in Parkinson’s disease. PLoS ONE 3:e2625CrossRefPubMed Konczak J, Li KY, Tuite PJ, Poizner H (2008) Haptic perception of object curvature in Parkinson’s disease. PLoS ONE 3:e2625CrossRefPubMed
go back to reference Lalanne C, Lorenceau J (2004) Crossmodal integration for perception and action. J Physiol Paris 98:265–279CrossRefPubMed Lalanne C, Lorenceau J (2004) Crossmodal integration for perception and action. J Physiol Paris 98:265–279CrossRefPubMed
go back to reference Lederman SJ, Thorne G, Jones B (1986) Perception of texture by vision and touch: multidimensionality and intersensory integration. J Exp Psychol Hum Percept Perform 12:169–180CrossRefPubMed Lederman SJ, Thorne G, Jones B (1986) Perception of texture by vision and touch: multidimensionality and intersensory integration. J Exp Psychol Hum Percept Perform 12:169–180CrossRefPubMed
go back to reference McFarland J, Soechting JF (2007) Factors influencing the radial-tangential illusion in haptic perception. Exp Brain Res 178:216–227CrossRefPubMed McFarland J, Soechting JF (2007) Factors influencing the radial-tangential illusion in haptic perception. Exp Brain Res 178:216–227CrossRefPubMed
go back to reference Meredith MA, Stein BE (1986) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662PubMed Meredith MA, Stein BE (1986) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662PubMed
go back to reference Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215–3229PubMed Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215–3229PubMed
go back to reference Okamura AM (2004) Methods for haptic feedback in teleoperated robot-assisted surgery. Ind Rob 31:499–508CrossRefPubMed Okamura AM (2004) Methods for haptic feedback in teleoperated robot-assisted surgery. Ind Rob 31:499–508CrossRefPubMed
go back to reference Okamura AM (2009) Haptic feedback in robot-assisted minimally invasive surgery. Curr Opin Urol 19:102–107CrossRefPubMed Okamura AM (2009) Haptic feedback in robot-assisted minimally invasive surgery. Curr Opin Urol 19:102–107CrossRefPubMed
go back to reference Pfordresher PQ, Palmer C (2002) Effects of delayed auditory feedback on timing of music performance. Psychol Res 66:71–79CrossRefPubMed Pfordresher PQ, Palmer C (2002) Effects of delayed auditory feedback on timing of music performance. Psychol Res 66:71–79CrossRefPubMed
go back to reference Pont SC, Kappers AML, Koenderink JJ (1999) Similar mechanisms underlie curvature comparison by static and dynamic touch. Percept Psychophys 61:874–894PubMed Pont SC, Kappers AML, Koenderink JJ (1999) Similar mechanisms underlie curvature comparison by static and dynamic touch. Percept Psychophys 61:874–894PubMed
go back to reference Rowland BA, Stanford TR, Stein BE (2007) A model of the neural mechanisms underlying multisensory integration in the superior colliculus. Perception 36:1431–1443CrossRefPubMed Rowland BA, Stanford TR, Stein BE (2007) A model of the neural mechanisms underlying multisensory integration in the superior colliculus. Perception 36:1431–1443CrossRefPubMed
go back to reference Schwartz AB, Moran DW, Reina GA (2004) Differential representation of perception and action in the frontal cortex. Science 303:380–383CrossRefPubMed Schwartz AB, Moran DW, Reina GA (2004) Differential representation of perception and action in the frontal cortex. Science 303:380–383CrossRefPubMed
go back to reference Stein BE (1998) Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp Brain Res 123:124–135CrossRefPubMed Stein BE (1998) Neural mechanisms for synthesizing sensory information and producing adaptive behaviors. Exp Brain Res 123:124–135CrossRefPubMed
go back to reference Stetson C, Cui X, Montague PR, Eagleman DM (2006) Motor-sensory recalibration leads to an illusory reversal of action and sensation. Neuron 51:651–659CrossRefPubMed Stetson C, Cui X, Montague PR, Eagleman DM (2006) Motor-sensory recalibration leads to an illusory reversal of action and sensation. Neuron 51:651–659CrossRefPubMed
go back to reference Treutwein B (1995) Adaptive psychophysical procedures. Vision Res 35:2503–2522PubMed Treutwein B (1995) Adaptive psychophysical procedures. Vision Res 35:2503–2522PubMed
go back to reference van Beers RJ, Sittig AC, Denier van der Gon JJ (1996) How humans combine simultaneous proprioceptive and visual position information. Exp Brain Res 111:253–261CrossRefPubMed van Beers RJ, Sittig AC, Denier van der Gon JJ (1996) How humans combine simultaneous proprioceptive and visual position information. Exp Brain Res 111:253–261CrossRefPubMed
go back to reference Westebring-van der Putten EP, Goossens RH, Jakimowicz JJ, Dankelman J (2008) Haptics in minimally invasive surgery—a review. Minim Invasive Ther Allied Technol 17:3–16CrossRefPubMed Westebring-van der Putten EP, Goossens RH, Jakimowicz JJ, Dankelman J (2008) Haptics in minimally invasive surgery—a review. Minim Invasive Ther Allied Technol 17:3–16CrossRefPubMed
go back to reference Wijntjes MWA, Sato A, Hayward V, Kappers AML (2009) Local surface orientation dominates haptic curvature discrimination. IEEE Trans Haptics 2:94–102CrossRef Wijntjes MWA, Sato A, Hayward V, Kappers AML (2009) Local surface orientation dominates haptic curvature discrimination. IEEE Trans Haptics 2:94–102CrossRef
go back to reference Wing AM (1977) Perturbations of auditory feedback delay and the timing of movement. J Exp Psychol Hum Percept Perform 3:175–186CrossRefPubMed Wing AM (1977) Perturbations of auditory feedback delay and the timing of movement. J Exp Psychol Hum Percept Perform 3:175–186CrossRefPubMed
Metadata
Title
Does temporal asynchrony affect multimodal curvature detection?
Authors
Sara A. Winges
Stephanie E. Eonta
John F. Soechting
Publication date
01-05-2010
Publisher
Springer-Verlag
Published in
Experimental Brain Research / Issue 1/2010
Print ISSN: 0014-4819
Electronic ISSN: 1432-1106
DOI
https://doi.org/10.1007/s00221-010-2200-z

Other articles of this Issue 1/2010

Experimental Brain Research 1/2010 Go to the issue