Skip to main content
Top
Published in: Journal of the Association for Research in Otolaryngology 4/2014

01-08-2014 | Research Article

Modulation Enhancement in the Electrical Signal Improves Perception of Interaural Time Differences with Bimodal Stimulation

Authors: Tom Francart, Anneke Lenssen, Jan Wouters

Published in: Journal of the Association for Research in Otolaryngology | Issue 4/2014

Login to get access

Abstract

Interaural timing cues are important for sound source localization and for binaural unmasking of speech that is spatially separated from interfering sounds. Users of a cochlear implant (CI) with residual hearing in the non-implanted ear (bimodal listeners) can only make very limited use of interaural timing cues with their clinical devices. Previous studies showed that bimodal listeners can be sensitive to interaural time differences (ITDs) for simple single- and three-channel stimuli. The modulation enhancement strategy (MEnS) was developed to improve the ITD perception of bimodal listeners. It enhances temporal modulations on all stimulated electrodes, synchronously with modulations in the acoustic signal presented to the non-implanted ear, based on measurement of the amplitude peaks occurring at the rate of the fundamental frequency in voiced phonemes. In the first experiment, ITD detection thresholds were measured using the method of constant stimuli for five bimodal listeners for an artificial vowel, processed with either the advanced combination encoder (ACE) strategy or with MEnS. With MEnS, detection thresholds were significantly lower, and for four subjects well within the physically relevant range. In the second experiment, the extent of lateralization was measured in three subjects with both strategies, and ITD sensitivity was determined using an adaptive procedure. All subjects could lateralize sounds based on ITD and sensitivity was significantly better with MEnS than with ACE. The current results indicate that ITD cues can be provided to bimodal listeners with modified sound processing.
Literature
go back to reference Akeroyd M (2003) Threshold differences for interaural time delays carried by double vowels. J Acoust Soc Am 114(4 Pt 1):2167–2177PubMedCrossRef Akeroyd M (2003) Threshold differences for interaural time delays carried by double vowels. J Acoust Soc Am 114(4 Pt 1):2167–2177PubMedCrossRef
go back to reference Akeroyd M (2006) The psychoacoustics of binaural hearing. Int J Audiol 45(Suppl 1):25–33CrossRef Akeroyd M (2006) The psychoacoustics of binaural hearing. Int J Audiol 45(Suppl 1):25–33CrossRef
go back to reference Bernstein L, Trahiotis C (2002) Enhancing sensitivity to interaural delays at high frequencies by using “transposed stimuli”. J Acoust Soc Am 112(3 Pt 1):1026–1036PubMedCrossRef Bernstein L, Trahiotis C (2002) Enhancing sensitivity to interaural delays at high frequencies by using “transposed stimuli”. J Acoust Soc Am 112(3 Pt 1):1026–1036PubMedCrossRef
go back to reference Bernstein L, Trahiotis C (2009) How sensitivity to ongoing interaural temporal disparities is affected by manipulations of temporal features of the envelopes of high-frequency stimuli. J Acoust Soc Am 125(5):3234–3242PubMedCentralPubMedCrossRef Bernstein L, Trahiotis C (2009) How sensitivity to ongoing interaural temporal disparities is affected by manipulations of temporal features of the envelopes of high-frequency stimuli. J Acoust Soc Am 125(5):3234–3242PubMedCentralPubMedCrossRef
go back to reference Bernstein L, Trahiotis C (2010) Accounting quantitatively for sensitivity to envelope-based interaural temporal disparities at high frequencies. J Acoust Soc Am 128(3):1224–1234PubMedCentralPubMedCrossRef Bernstein L, Trahiotis C (2010) Accounting quantitatively for sensitivity to envelope-based interaural temporal disparities at high frequencies. J Acoust Soc Am 128(3):1224–1234PubMedCentralPubMedCrossRef
go back to reference Boersma P, Weenink D (2001) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345 Boersma P, Weenink D (2001) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345
go back to reference Bronkhorst A (2000) The cocktail party phenomenon: a review of research on speech intelligibility in multiple-talker conditions. Act Acust 86(6):117–128 Bronkhorst A (2000) The cocktail party phenomenon: a review of research on speech intelligibility in multiple-talker conditions. Act Acust 86(6):117–128
go back to reference Buell T, Griffin S, Bernstein L (2008) Listeners’ sensitivity to “onset/offset” and “ongoing” interaural delays in high-frequency, sinusoidally amplitude-modulated tones. J Acoust Soc Am 123:279PubMedCrossRef Buell T, Griffin S, Bernstein L (2008) Listeners’ sensitivity to “onset/offset” and “ongoing” interaural delays in high-frequency, sinusoidally amplitude-modulated tones. J Acoust Soc Am 123:279PubMedCrossRef
go back to reference Ching T, van Wanrooy E, Dillon H (2007) Binaural-bimodal fitting or bilateral implantation for managing severe to profound deafness: a review. Trends Amplif 11(3):161–192PubMedCrossRef Ching T, van Wanrooy E, Dillon H (2007) Binaural-bimodal fitting or bilateral implantation for managing severe to profound deafness: a review. Trends Amplif 11(3):161–192PubMedCrossRef
go back to reference Colburn H, Shinn-Cunningham B, Kidd G, Durlach N (2006) The perceptual consequences of binaural hearing. Int J Audiol 45(Suppl 1):34–44CrossRef Colburn H, Shinn-Cunningham B, Kidd G, Durlach N (2006) The perceptual consequences of binaural hearing. Int J Audiol 45(Suppl 1):34–44CrossRef
go back to reference Domnitz R (1973) The interaural time JND as a simultaneous function of interaural time and interaural amplitude. J Acoust Soc Am 53(6):1549–1552PubMedCrossRef Domnitz R (1973) The interaural time JND as a simultaneous function of interaural time and interaural amplitude. J Acoust Soc Am 53(6):1549–1552PubMedCrossRef
go back to reference Ewert S, Dietz M, Klein-Hennig M, Hohmann V (2009) Advances in auditory physiology, psychophysics and models; the role of envelope wave form, adaptation, and attacks in binaural perception. Springer, New York Ewert S, Dietz M, Klein-Hennig M, Hohmann V (2009) Advances in auditory physiology, psychophysics and models; the role of envelope wave form, adaptation, and attacks in binaural perception. Springer, New York
go back to reference Francart T, McDermott H (2012a) Development of a loudness normalisation strategy for combined cochlear implant and acoustic stimulation. Hear Res 294(1–2):114–124PubMedCrossRef Francart T, McDermott H (2012a) Development of a loudness normalisation strategy for combined cochlear implant and acoustic stimulation. Hear Res 294(1–2):114–124PubMedCrossRef
go back to reference Francart T, McDermott H (2012b) Speech perception and localisation with SCORE bimodal: a loudness normalisation strategy for combined cochlear implant and hearing aid stimulation. Plos One 7(10) Francart T, McDermott H (2012b) Speech perception and localisation with SCORE bimodal: a loudness normalisation strategy for combined cochlear implant and hearing aid stimulation. Plos One 7(10)
go back to reference Francart T, van Wieringen A, Wouters J (2008) APEX 3: a multi-purpose test platform for auditory psychophysical experiments. J Neurosci Methods 172(2):283–293PubMedCrossRef Francart T, van Wieringen A, Wouters J (2008) APEX 3: a multi-purpose test platform for auditory psychophysical experiments. J Neurosci Methods 172(2):283–293PubMedCrossRef
go back to reference Francart T, Brokx J, Wouters J (2009) Sensitivity to interaural time differences with combined cochlear implant and acoustic stimulation. J Assoc Res Otolaryngol 10(1):131–141PubMedCentralPubMedCrossRef Francart T, Brokx J, Wouters J (2009) Sensitivity to interaural time differences with combined cochlear implant and acoustic stimulation. J Assoc Res Otolaryngol 10(1):131–141PubMedCentralPubMedCrossRef
go back to reference Francart T, Lenssen A, Wouters J (2011) Sensitivity of bimodal listeners to interaural time differences with modulated single- and multiple-channel stimuli. Audiol Neurootol 16(2):82–92PubMedCrossRef Francart T, Lenssen A, Wouters J (2011) Sensitivity of bimodal listeners to interaural time differences with modulated single- and multiple-channel stimuli. Audiol Neurootol 16(2):82–92PubMedCrossRef
go back to reference Francart T, Lenssen A, Wouters J (2012) The effect of interaural differences in envelope shape on the perceived location of sounds. J Acoust Soc Am 132(2):611–614PubMedCrossRef Francart T, Lenssen A, Wouters J (2012) The effect of interaural differences in envelope shape on the perceived location of sounds. J Acoust Soc Am 132(2):611–614PubMedCrossRef
go back to reference Freyman RL, Zurek PM, Balakrishnan U, Chiang YC (1997) Onset dominance in lateralization. J Acoust Soc Am 101(3):1649–1659PubMedCrossRef Freyman RL, Zurek PM, Balakrishnan U, Chiang YC (1997) Onset dominance in lateralization. J Acoust Soc Am 101(3):1649–1659PubMedCrossRef
go back to reference Grantham D, Ashmead D, Ricketts T, Haynes D, Labadie R (2008) Interaural time and level difference thresholds for acoustically presented signals in post-lingually deafened adults fitted with bilateral cochlear implants using cis processing. Ear Hear 29(1):33–44PubMed Grantham D, Ashmead D, Ricketts T, Haynes D, Labadie R (2008) Interaural time and level difference thresholds for acoustically presented signals in post-lingually deafened adults fitted with bilateral cochlear implants using cis processing. Ear Hear 29(1):33–44PubMed
go back to reference Green T, Faulkner A, Rosen S (2004) Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. J Acoust Soc Am 116(4 Pt 1):2298–2310PubMedCrossRef Green T, Faulkner A, Rosen S (2004) Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. J Acoust Soc Am 116(4 Pt 1):2298–2310PubMedCrossRef
go back to reference Henning G (1974) Detectability of interaural delay in high-frequency complex waveforms. J Acoust Soc Am 55(1):84–90PubMedCrossRef Henning G (1974) Detectability of interaural delay in high-frequency complex waveforms. J Acoust Soc Am 55(1):84–90PubMedCrossRef
go back to reference ISO 389-2 (1994) ISO 389-2 reference zero for the calibration of audiometric equipment—part 2: reference equivalent threshold sound pressure levels for pure tones and insert earphones ISO 389-2 (1994) ISO 389-2 reference zero for the calibration of audiometric equipment—part 2: reference equivalent threshold sound pressure levels for pure tones and insert earphones
go back to reference Klatt D (1980) Software for a cascade/parallel formant synthesizer. J Acoust Soc Am 67(3):971–995CrossRef Klatt D (1980) Software for a cascade/parallel formant synthesizer. J Acoust Soc Am 67(3):971–995CrossRef
go back to reference Kunov H, Abel S (1981) Effects of rise/decay time on the lateralization of interaurally delayed 1-khz tones. J Acoust Soc Am 69(3):769–773PubMedCrossRef Kunov H, Abel S (1981) Effects of rise/decay time on the lateralization of interaurally delayed 1-khz tones. J Acoust Soc Am 69(3):769–773PubMedCrossRef
go back to reference Laback B, Pok S, Baumgartner W, Deutsch W, Schmid K (2004) Sensitivity to interaural level and envelope time differences of two bilateral cochlear implant listeners using clinical sound processors. Ear Hear 25(5):488–500PubMedCrossRef Laback B, Pok S, Baumgartner W, Deutsch W, Schmid K (2004) Sensitivity to interaural level and envelope time differences of two bilateral cochlear implant listeners using clinical sound processors. Ear Hear 25(5):488–500PubMedCrossRef
go back to reference Laback B, Majdak P, Baumgartner W (2007) Lateralization discrimination of interaural time delays in four-pulse sequences in electric and acoustic hearing. J Acoust Soc Am 121(4):2182–2191PubMedCrossRef Laback B, Majdak P, Baumgartner W (2007) Lateralization discrimination of interaural time delays in four-pulse sequences in electric and acoustic hearing. J Acoust Soc Am 121(4):2182–2191PubMedCrossRef
go back to reference Laback B, Zimmerman I, Majdak P, Baumgartner W, Pok S (2011) Effects of envelope shape on interaural envelope delay sensitivity in acoustic and electric hearing. J Acoust Soc Am 130(3):1515–1529PubMedCrossRef Laback B, Zimmerman I, Majdak P, Baumgartner W, Pok S (2011) Effects of envelope shape on interaural envelope delay sensitivity in acoustic and electric hearing. J Acoust Soc Am 130(3):1515–1529PubMedCrossRef
go back to reference Laneau J, Wouters J, Moonen M (2006) Improved music perception with explicit pitch coding in cochlear implants. Audiol Neurotol 11(1):38–52CrossRef Laneau J, Wouters J, Moonen M (2006) Improved music perception with explicit pitch coding in cochlear implants. Audiol Neurotol 11(1):38–52CrossRef
go back to reference Lawson D, Wilson B, Zerbi M, van den Honert C, Finley C, Farmer J Jr, McElveen J Jr, Roush P (1998) Bilateral cochlear implants controlled by a single speech processor. Am J Otol 19(6):758–761PubMed Lawson D, Wilson B, Zerbi M, van den Honert C, Finley C, Farmer J Jr, McElveen J Jr, Roush P (1998) Bilateral cochlear implants controlled by a single speech processor. Am J Otol 19(6):758–761PubMed
go back to reference Lenssen A, Francart T, Brokx J, Wouters J (2011) Bimodal listeners are not sensitive to interaural time differences in unmodulated low-frequency stimuli. J Acoust Soc Am 129(6):3457–3460PubMedCrossRef Lenssen A, Francart T, Brokx J, Wouters J (2011) Bimodal listeners are not sensitive to interaural time differences in unmodulated low-frequency stimuli. J Acoust Soc Am 129(6):3457–3460PubMedCrossRef
go back to reference Litovsky R, Jones G, Agrawal S, van Hoesel R (2010) Effect of age at onset of deafness on binaural sensitivity in electric hearing in humans. J Acoust Soc Am 127(1):400–414PubMedCentralPubMedCrossRef Litovsky R, Jones G, Agrawal S, van Hoesel R (2010) Effect of age at onset of deafness on binaural sensitivity in electric hearing in humans. J Acoust Soc Am 127(1):400–414PubMedCentralPubMedCrossRef
go back to reference Litovsky R, Goupell M, Godar S, Grieco-Calub T, Garadat S, Agrawal S, van Hoesel R (2012) Studies on bilateral cochlear implants at the University of Wisconsin’s Binaural Hearing and Speech Laboratory. J Am Acad Audiol 23(1):476–494PubMedCentralPubMed Litovsky R, Goupell M, Godar S, Grieco-Calub T, Garadat S, Agrawal S, van Hoesel R (2012) Studies on bilateral cochlear implants at the University of Wisconsin’s Binaural Hearing and Speech Laboratory. J Am Acad Audiol 23(1):476–494PubMedCentralPubMed
go back to reference Long C, Eddington D, Colburn H, Rabinowitz W (2003) Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user. J Acoust Soc Am 114(3):1565–1574PubMedCrossRef Long C, Eddington D, Colburn H, Rabinowitz W (2003) Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user. J Acoust Soc Am 114(3):1565–1574PubMedCrossRef
go back to reference Majdak P, Laback B, Baumgartner W (2006) Effects of interaural time differences in fine structure and envelope on lateral discrimination in electric hearing. J Acoust Soc Am 120(4):2190–2201PubMedCrossRef Majdak P, Laback B, Baumgartner W (2006) Effects of interaural time differences in fine structure and envelope on lateral discrimination in electric hearing. J Acoust Soc Am 120(4):2190–2201PubMedCrossRef
go back to reference McDermott H, McKay C, Vandali A (1992) A new portable sound processor for the University of Melbourne/nucleus limited multielectrode cochlear implant. J Acoust Soc Am 91(6):3367–3371PubMedCrossRef McDermott H, McKay C, Vandali A (1992) A new portable sound processor for the University of Melbourne/nucleus limited multielectrode cochlear implant. J Acoust Soc Am 91(6):3367–3371PubMedCrossRef
go back to reference Milczynski M, Wouters J, van Wieringen A (2009) Improved fundamental frequency coding in cochlear implant signal processing. J Acoust Soc Am 125(4):2260–2271PubMedCrossRef Milczynski M, Wouters J, van Wieringen A (2009) Improved fundamental frequency coding in cochlear implant signal processing. J Acoust Soc Am 125(4):2260–2271PubMedCrossRef
go back to reference Milczynski M, Chang JE, Wouters J, van Wieringen A (2012) Perception of Mandarin Chinese with cochlear implants using enhanced temporal pitch cues. Hear Res 285(1–2):1–12PubMedCrossRef Milczynski M, Chang JE, Wouters J, van Wieringen A (2012) Perception of Mandarin Chinese with cochlear implants using enhanced temporal pitch cues. Hear Res 285(1–2):1–12PubMedCrossRef
go back to reference Sayers B (1964) Acoustic-image lateralization judgments with binaural tones. J Acoust Soc Am 36(5):923–926CrossRef Sayers B (1964) Acoustic-image lateralization judgments with binaural tones. J Acoust Soc Am 36(5):923–926CrossRef
go back to reference Senn P, Kompis M, Vischer M, Haeusler R (2005) Minimum audible angle, just noticeable interaural differences and speech intelligibility with bilateral cochlear implants using clinical speech processors. Audiol Neurootol 10(6):342–352PubMedCrossRef Senn P, Kompis M, Vischer M, Haeusler R (2005) Minimum audible angle, just noticeable interaural differences and speech intelligibility with bilateral cochlear implants using clinical speech processors. Audiol Neurootol 10(6):342–352PubMedCrossRef
go back to reference Swanson B (2008) Pitch perception with cochlear implants. Ph.D. thesis, The University of Melbourne Swanson B (2008) Pitch perception with cochlear implants. Ph.D. thesis, The University of Melbourne
go back to reference van Hoesel R (2004) Exploring the benefits of bilateral cochlear implants. Audiol Neurootol 9(4):234–246PubMedCrossRef van Hoesel R (2004) Exploring the benefits of bilateral cochlear implants. Audiol Neurootol 9(4):234–246PubMedCrossRef
go back to reference van Hoesel R (2007) Sensitivity to binaural timing in bilateral cochlear implant users. J Acoust Soc Am 121(4):2192–2206PubMedCrossRef van Hoesel R (2007) Sensitivity to binaural timing in bilateral cochlear implant users. J Acoust Soc Am 121(4):2192–2206PubMedCrossRef
go back to reference van Hoesel R, Tyler R (2003) Speech perception, localization, and lateralization with bilateral cochlear implants. J Acoust Soc Am 113(3):1617–1630PubMedCrossRef van Hoesel R, Tyler R (2003) Speech perception, localization, and lateralization with bilateral cochlear implants. J Acoust Soc Am 113(3):1617–1630PubMedCrossRef
go back to reference Vandali AE, van Hoesel RJ (2011) Development of a temporal fundamental frequency coding strategy for cochlear implants. J Acoust Soc Am 129(6):4023–4036PubMedCrossRef Vandali AE, van Hoesel RJ (2011) Development of a temporal fundamental frequency coding strategy for cochlear implants. J Acoust Soc Am 129(6):4023–4036PubMedCrossRef
go back to reference Vandali A, Whitford L, Plant K, Clark G (2000) Speech perception as a function of electrical stimulation rate: using the Nucleus 24 cochlear implant system. Ear Hear 21(6):608–624PubMedCrossRef Vandali A, Whitford L, Plant K, Clark G (2000) Speech perception as a function of electrical stimulation rate: using the Nucleus 24 cochlear implant system. Ear Hear 21(6):608–624PubMedCrossRef
go back to reference Vandali A, Sucher C, Tsang D, McKay C, Chew J, McDermott H (2005) Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. J Acoust Soc Am 117(5):3126–3138PubMedCrossRef Vandali A, Sucher C, Tsang D, McKay C, Chew J, McDermott H (2005) Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. J Acoust Soc Am 117(5):3126–3138PubMedCrossRef
go back to reference Wichmann F, Hill N (2001) The psychometric function: II. Bootstrap-based confidence intervals and sampling. Percept Psychophys 63(8):1314–1329PubMedCrossRef Wichmann F, Hill N (2001) The psychometric function: II. Bootstrap-based confidence intervals and sampling. Percept Psychophys 63(8):1314–1329PubMedCrossRef
Metadata
Title
Modulation Enhancement in the Electrical Signal Improves Perception of Interaural Time Differences with Bimodal Stimulation
Authors
Tom Francart
Anneke Lenssen
Jan Wouters
Publication date
01-08-2014
Publisher
Springer US
Published in
Journal of the Association for Research in Otolaryngology / Issue 4/2014
Print ISSN: 1525-3961
Electronic ISSN: 1438-7573
DOI
https://doi.org/10.1007/s10162-014-0457-9

Other articles of this Issue 4/2014

Journal of the Association for Research in Otolaryngology 4/2014 Go to the issue