Skip to main content
Top
Published in: Brain Topography 3-4/2009

01-05-2009 | Original Paper

The Principle of Inverse Effectiveness in Multisensory Integration: Some Statistical Considerations

Author: Nicholas P. Holmes

Published in: Brain Topography | Issue 3-4/2009

Login to get access

Abstract

The principle of inverse effectiveness (PoIE) in multisensory integration states that, as the responsiveness to individual sensory stimuli decreases, the strength of multisensory integration increases. I discuss three potential problems in the analysis of multisensory data with regard to the PoIE. First, due to ‘regression towards the mean,’ the PoIE may often be observed in datasets that are analysed post-hoc (i.e., when sorting the data by the unisensory responses). The solution is to design discrete levels of stimulus intensity a priori. Second, due to neurophysiological or methodological constraints on responsiveness, the PoIE may be, in part, a consequence of ‘floor’ and ‘ceiling’ effects. The solution is to avoid analysing or interpreting data that are too close to the limits of responsiveness, enabling both enhancement and suppression to be reliably observed. Third, the choice of units of measurement may affect whether the PoIE is observed in a given dataset. Both relative (%) and absolute (raw) measurements have advantages, but the interpretation of both is affected by systematic changes in response variability with changes in response mean, an issue that may be addressed by using measures of discriminability or effect-size such as Cohen’s d. Most importantly, randomising or permuting a dataset to construct a null distribution of a test parameter may best indicate whether any observed inverse effectiveness specifically characterises multisensory integration. When these considerations are taken into account, the PoIE may disappear or even reverse in a given dataset. I conclude that caution should be exercised when interpreting data that appear to follow the PoIE.
Appendix
Available only for authorised users
Footnotes
1
Additional data and programs, a bibliography, numerous re-analyses of published datasets, and the results of numerical simulations concerning the principle of inverse effectiveness are or will shortly be freely available on the author's website, at http://​www.​neurobiography.​info.
 
2
To obtain estimates of effect-sizes, the SD for each response was estimated using the equation relating the mean and SD of responses from Fig. 2. The upper and lower 95% confidence limits for the slope and intercept of this equation were also used to estimate upper and lower confidence limits on the effect sizes (see Fig. 3d).
 
Literature
go back to reference Alvarado JC, Stanford TR, Vaughan JW, Stein BE (2007a) Cortex mediates multisensory but not unisensory integration in superior colliculus. J Neurosci 27:12775–12786PubMedCrossRef Alvarado JC, Stanford TR, Vaughan JW, Stein BE (2007a) Cortex mediates multisensory but not unisensory integration in superior colliculus. J Neurosci 27:12775–12786PubMedCrossRef
go back to reference Alvarado JC, Vaughan JW, Stanford TR, Stein BE (2007b) Multisensory versus unisensory integration: contrasting modes in the superior colliculus. J Neurophysiol 97:3193–3205PubMedCrossRef Alvarado JC, Vaughan JW, Stanford TR, Stein BE (2007b) Multisensory versus unisensory integration: contrasting modes in the superior colliculus. J Neurophysiol 97:3193–3205PubMedCrossRef
go back to reference Beauchamp MS (2005) Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics 3:93–113PubMedCrossRef Beauchamp MS (2005) Statistical criteria in fMRI studies of multisensory integration. Neuroinformatics 3:93–113PubMedCrossRef
go back to reference Diederich A, Colonius H (2008) When a high-intensity “distractor” is better then a low-intensity one: modeling the effect of an auditory or tactile nontarget stimulus on visual saccadic reaction time. Brain Res 1242:219–230PubMedCrossRef Diederich A, Colonius H (2008) When a high-intensity “distractor” is better then a low-intensity one: modeling the effect of an auditory or tactile nontarget stimulus on visual saccadic reaction time. Brain Res 1242:219–230PubMedCrossRef
go back to reference Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57:11–23PubMedCrossRef Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on ‘sensory-specific’ brain regions, neural responses, and judgments. Neuron 57:11–23PubMedCrossRef
go back to reference Gilmeister H, Eimer M (2007) Tactile enhancement of auditory detection and perceived loudness. Brain Res 1160:58–68CrossRef Gilmeister H, Eimer M (2007) Tactile enhancement of auditory detection and perceived loudness. Brain Res 1160:58–68CrossRef
go back to reference Gondan M, Niederhaus B, Rösler F (2005) Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept Psychophys 67:713–726PubMed Gondan M, Niederhaus B, Rösler F (2005) Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept Psychophys 67:713–726PubMed
go back to reference Hecht D, Reiner M, Karni A (2008) Multisensory enhancement: gains in choice and in simple response times. Exp Brain Res 189:133–143PubMedCrossRef Hecht D, Reiner M, Karni A (2008) Multisensory enhancement: gains in choice and in simple response times. Exp Brain Res 189:133–143PubMedCrossRef
go back to reference Holmes NP (2007) The law of inverse effectiveness in neurons and behaviour: multisensory integration versus normal variability. Neuropsychologia 45:3340–3345PubMedCrossRef Holmes NP (2007) The law of inverse effectiveness in neurons and behaviour: multisensory integration versus normal variability. Neuropsychologia 45:3340–3345PubMedCrossRef
go back to reference Holmes NP, Calvert GA, Spence C (2004) Extending or projecting peripersonal space with tools? Multisensory interactions highlight only the distal and proximal ends of tools. Neurosci Lett 372:62–67PubMedCrossRef Holmes NP, Calvert GA, Spence C (2004) Extending or projecting peripersonal space with tools? Multisensory interactions highlight only the distal and proximal ends of tools. Neurosci Lett 372:62–67PubMedCrossRef
go back to reference Holmes NP, Calvert GA, Spence C (2007) Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task. Exp Brain Res 183:465–476PubMedCrossRef Holmes NP, Calvert GA, Spence C (2007) Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task. Exp Brain Res 183:465–476PubMedCrossRef
go back to reference Kayser C, Petkov CI, Logothetis NK (2008) Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560–1574PubMedCrossRef Kayser C, Petkov CI, Logothetis NK (2008) Visual modulation of neurons in auditory cortex. Cereb Cortex 18:1560–1574PubMedCrossRef
go back to reference King AJ, Palmer AR (1985) Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Exp Brain Res 60:492–500PubMedCrossRef King AJ, Palmer AR (1985) Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Exp Brain Res 60:492–500PubMedCrossRef
go back to reference Lakatos P, Chen C-M, O’Connell MN, Mills A, Schroeder CE (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279–292PubMedCrossRef Lakatos P, Chen C-M, O’Connell MN, Mills A, Schroeder CE (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279–292PubMedCrossRef
go back to reference Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp Brain Res 166:289–297PubMedCrossRef Laurienti PJ, Perrault TJ, Stanford TR, Wallace MT, Stein BE (2005) On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies. Exp Brain Res 166:289–297PubMedCrossRef
go back to reference Longo MR, Cardozo S, Haggard P (2008) Visual enhancement of touch and the bodily self. Conscious Cogn 17:1181–1191PubMedCrossRef Longo MR, Cardozo S, Haggard P (2008) Visual enhancement of touch and the bodily self. Conscious Cogn 17:1181–1191PubMedCrossRef
go back to reference Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389–391PubMedCrossRef Meredith MA, Stein BE (1983) Interactions among converging sensory inputs in the superior colliculus. Science 221:389–391PubMedCrossRef
go back to reference Meredith MA, Stein BE (1986a) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365:350–354PubMedCrossRef Meredith MA, Stein BE (1986a) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365:350–354PubMedCrossRef
go back to reference Meredith MA, Stein BE (1986b) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662PubMed Meredith MA, Stein BE (1986b) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662PubMed
go back to reference Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215–3229PubMed Meredith MA, Nemitz JW, Stein BE (1987) Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 7:3215–3229PubMed
go back to reference Perrault TJ Jr, Vaughan JW, Stein BE, Wallace MT (2003) Neuron-specific response characteristics predict the magnitude of multisensory integration. J Neurophysiol 90:4022–4026PubMedCrossRef Perrault TJ Jr, Vaughan JW, Stein BE, Wallace MT (2003) Neuron-specific response characteristics predict the magnitude of multisensory integration. J Neurophysiol 90:4022–4026PubMedCrossRef
go back to reference Perrault TJ Jr, Vaughan JW, Stein BE, Wallace MT (2005) Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. J Neurophysiol 93:2575–2586PubMedCrossRef Perrault TJ Jr, Vaughan JW, Stein BE, Wallace MT (2005) Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. J Neurophysiol 93:2575–2586PubMedCrossRef
go back to reference Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ (2007) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 17:1147–1153PubMedCrossRef Ross LA, Saint-Amour D, Leavitt VM, Javitt DC, Foxe JJ (2007) Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 17:1147–1153PubMedCrossRef
go back to reference Serino A, Farnè A, Rinaldesi ML, Haggard P, Làdavas E (2007) Can vision of the body ameliorate impaired somatosensory function? Neuropsychologia 45:1101–1107PubMedCrossRef Serino A, Farnè A, Rinaldesi ML, Haggard P, Làdavas E (2007) Can vision of the body ameliorate impaired somatosensory function? Neuropsychologia 45:1101–1107PubMedCrossRef
go back to reference Skaliora I, Doubell TP, Holmes NP, Nodal FR, King AJ (2004) Functional topography of converging visual and auditory inputs to neurons in the rat superior colliculus. J Neurophysiol 92:2933–2946PubMedCrossRef Skaliora I, Doubell TP, Holmes NP, Nodal FR, King AJ (2004) Functional topography of converging visual and auditory inputs to neurons in the rat superior colliculus. J Neurophysiol 92:2933–2946PubMedCrossRef
go back to reference Stevenson RA, James TW (2009) Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. NeuroImage 44:1210–1223PubMedCrossRef Stevenson RA, James TW (2009) Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. NeuroImage 44:1210–1223PubMedCrossRef
go back to reference Stevenson RA, Kim S, James T (in press) An additive-factors design to disambiguate neuronal and areal convergence: measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Exp Brain Res. doi:10.1007/s00221-009-1783-8 Stevenson RA, Kim S, James T (in press) An additive-factors design to disambiguate neuronal and areal convergence: measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI. Exp Brain Res. doi:10.​1007/​s00221-009-1783-8
go back to reference Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26:212–215CrossRef Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26:212–215CrossRef
Metadata
Title
The Principle of Inverse Effectiveness in Multisensory Integration: Some Statistical Considerations
Author
Nicholas P. Holmes
Publication date
01-05-2009
Publisher
Springer US
Published in
Brain Topography / Issue 3-4/2009
Print ISSN: 0896-0267
Electronic ISSN: 1573-6792
DOI
https://doi.org/10.1007/s10548-009-0097-2

Other articles of this Issue 3-4/2009

Brain Topography 3-4/2009 Go to the issue