Skip to main content
Top
Published in: Journal of the Association for Research in Otolaryngology 1/2007

01-03-2007

Concurrent Sound Segregation in Electric and Acoustic Hearing

Authors: Robert P. Carlyon, Christopher J. Long, John M. Deeks, Colette M. McKay

Published in: Journal of the Association for Research in Otolaryngology | Issue 1/2007

Login to get access

Abstract

We investigated potential cues to sound segregation by cochlear implant (CI) and normal-hearing (NH) listeners. In each presentation interval of experiment 1a, CI listeners heard a mixture of four pulse trains applied concurrently to separate electrodes, preceded by a “probe” applied to a single electrode. In one of these two intervals, which the subject had to identify, the probe electrode was the same as a “target” electrode in the mixture. The pulse train on the target electrode had a higher level than the others in the mixture. Additionally, it could be presented either with a 200-ms onset delay, at a lower rate, or with an asynchrony produced by delaying each pulse by about 5 ms re those on the nontarget electrodes. Neither the rate difference nor the asynchrony aided performance over and above the level difference alone, but the onset delay produced a modest improvement. Experiment 1b showed that two subjects could perform the task using the onset delay alone, with no level difference. Experiment 2 used a method similar to that of experiment 1, but investigated the onset cue using NH listeners. In one condition, the mixture consisted of harmonics 5 to 40 of a 100-Hz fundamental, with the onset of either harmonics 13 to 17 or 26 to 30 delayed re the rest. Performance was modest in this condition, but could be improved markedly by using stimuli containing a spectral gap between the target and nontarget harmonics. The results suggest that (a) CI users are unlikely to use temporal pitch differences between adjacent channels to separate concurrent sounds, and that (b) they can use onset differences between channels, but the usefulness of this cue will be compromised by the spread of excitation along the nerve-fiber array. This deleterious effect of spread-of-excitation can also impair the use of onset cues by NH listeners.
Literature
go back to reference Baumann U, Nobbe A. Pulse rate discrimination with deeply inserted electrode arrays. Hear. Res. 196:49–57, 2004.PubMedCrossRef Baumann U, Nobbe A. Pulse rate discrimination with deeply inserted electrode arrays. Hear. Res. 196:49–57, 2004.PubMedCrossRef
go back to reference Bench J, Bamford J. Speech–Hearing Tests and the Spoken Language of Hearing-Impaired Children. London, Academic, 1979. Bench J, Bamford J. Speech–Hearing Tests and the Spoken Language of Hearing-Impaired Children. London, Academic, 1979.
go back to reference Bierer JA, Middlebrooks JC. Cortical responses to cochlear implant stimulation: channel interactions. J. Assoc. Res. Otolaryngol. 5:32–48, 2004.PubMedCrossRef Bierer JA, Middlebrooks JC. Cortical responses to cochlear implant stimulation: channel interactions. J. Assoc. Res. Otolaryngol. 5:32–48, 2004.PubMedCrossRef
go back to reference Bregman AS. Auditory Scene Analysis. Cambridge, MA, M.I.T. Press, 1990. Bregman AS. Auditory Scene Analysis. Cambridge, MA, M.I.T. Press, 1990.
go back to reference Bregman AS, Pinker S. Auditory streaming and the building of timbre. Can. J. Psychol. 32:19–31, 1978.PubMed Bregman AS, Pinker S. Auditory streaming and the building of timbre. Can. J. Psychol. 32:19–31, 1978.PubMed
go back to reference Carlyon RP. Detecting mistuning in the presence of synchronous and asynchronous interfering sounds. J. Acoust. Soc. Am. 95:2622–2630, 1994.PubMedCrossRef Carlyon RP. Detecting mistuning in the presence of synchronous and asynchronous interfering sounds. J. Acoust. Soc. Am. 95:2622–2630, 1994.PubMedCrossRef
go back to reference Carlyon RP. Encoding the fundamental frequency of a complex tone in the presence of a spectrally overlapping masker. J. Acoust. Soc. Am. 99:517–524, 1996a.PubMedCrossRef Carlyon RP. Encoding the fundamental frequency of a complex tone in the presence of a spectrally overlapping masker. J. Acoust. Soc. Am. 99:517–524, 1996a.PubMedCrossRef
go back to reference Carlyon RP. Masker asynchrony impairs the fundamental-frequency discrimination of unresolved harmonics. J. Acoust. Soc. Am. 99:525–533, 1996b.PubMedCrossRef Carlyon RP. Masker asynchrony impairs the fundamental-frequency discrimination of unresolved harmonics. J. Acoust. Soc. Am. 99:525–533, 1996b.PubMedCrossRef
go back to reference Carlyon RP, Gockel H. Effects of harmonicity and regularity on the perception of sound sources. In: Yost WA (ed) Springer Handbook of Auditory Research: Auditory Perception of Sound Sources. Berlin, Springer-Verlag (in press). Carlyon RP, Gockel H. Effects of harmonicity and regularity on the perception of sound sources. In: Yost WA (ed) Springer Handbook of Auditory Research: Auditory Perception of Sound Sources. Berlin, Springer-Verlag (in press).
go back to reference Carlyon RP, van Wieringen A, Long CJ, Deeks JM, Wouters J. Temporal pitch mechanisms in acoustic and electric hearing. J. Acoust. Soc. Am. 112:621–633, 2002.PubMedCrossRef Carlyon RP, van Wieringen A, Long CJ, Deeks JM, Wouters J. Temporal pitch mechanisms in acoustic and electric hearing. J. Acoust. Soc. Am. 112:621–633, 2002.PubMedCrossRef
go back to reference Chatterjee M, Galvin JJ, Fu QJ, Shannon RV. Effects of stimulation mode, level and location on forward-masked excitation patterns in cochlear implant patients. J. Assoc. Res. Otolaryngol. 7:15–25, 2006.PubMedCrossRef Chatterjee M, Galvin JJ, Fu QJ, Shannon RV. Effects of stimulation mode, level and location on forward-masked excitation patterns in cochlear implant patients. J. Assoc. Res. Otolaryngol. 7:15–25, 2006.PubMedCrossRef
go back to reference Dannenbring GL, Bregman AS. Streaming vs. fusion of sinusoidal components of complex tones. Percept. Psychophys. 24:369–376, 1978.PubMed Dannenbring GL, Bregman AS. Streaming vs. fusion of sinusoidal components of complex tones. Percept. Psychophys. 24:369–376, 1978.PubMed
go back to reference Darwin CJ. Perceptual grouping of speech components differing in fundamental frequency and onset time. Q. J. Exp. Psychol. 33A:185–287, 1981. Darwin CJ. Perceptual grouping of speech components differing in fundamental frequency and onset time. Q. J. Exp. Psychol. 33A:185–287, 1981.
go back to reference Darwin CJ. Listening to two things at once. In: Schouten B (ed) Audition, Speech, and Language. Berlin, Mouton-De Gruyter, pp. 133–148, 1992. Darwin CJ. Listening to two things at once. In: Schouten B (ed) Audition, Speech, and Language. Berlin, Mouton-De Gruyter, pp. 133–148, 1992.
go back to reference Darwin CJ, Carlyon RP. Auditory grouping. In: Moore BCJ (ed) Hearing. Orlando, FL, Academic, pp. 387–424, 1995. Darwin CJ, Carlyon RP. Auditory grouping. In: Moore BCJ (ed) Hearing. Orlando, FL, Academic, pp. 387–424, 1995.
go back to reference Darwin CJ, Ciocca V. Grouping in pitch perception: effects of onset asynchrony and ear of presentation of a mistuned component. J. Acoust. Soc. Am. 91:3381–3390, 1992.PubMedCrossRef Darwin CJ, Ciocca V. Grouping in pitch perception: effects of onset asynchrony and ear of presentation of a mistuned component. J. Acoust. Soc. Am. 91:3381–3390, 1992.PubMedCrossRef
go back to reference Darwin CJ, Gardner RB. Mistuning a harmonic of a vowel: grouping and phase effects on vowel quality. J. Acoust. Soc. Am. 79:838–845, 1986.PubMedCrossRef Darwin CJ, Gardner RB. Mistuning a harmonic of a vowel: grouping and phase effects on vowel quality. J. Acoust. Soc. Am. 79:838–845, 1986.PubMedCrossRef
go back to reference Darwin CJ, Sutherland NS. Grouping frequency components of vowels: when is a harmonic not a harmonic? Q. J. Exp. Psychol. 36A:193–208, 1984. Darwin CJ, Sutherland NS. Grouping frequency components of vowels: when is a harmonic not a harmonic? Q. J. Exp. Psychol. 36A:193–208, 1984.
go back to reference Deeks JM, Carlyon RP. Simulations of cochlear implant hearing using filtered harmonic complexes: implications for concurrent sound segregation. J. Acoust. Soc. Am. 115:1736–1746, 2004.PubMedCrossRef Deeks JM, Carlyon RP. Simulations of cochlear implant hearing using filtered harmonic complexes: implications for concurrent sound segregation. J. Acoust. Soc. Am. 115:1736–1746, 2004.PubMedCrossRef
go back to reference Fu QJ, Nogaki G. Noise susceptibility of cochlear implant users: the role of spectral resolution and smearing. J. Assoc. Res. Otolaryngol. 6:19–27, 2005.PubMedCrossRef Fu QJ, Nogaki G. Noise susceptibility of cochlear implant users: the role of spectral resolution and smearing. J. Assoc. Res. Otolaryngol. 6:19–27, 2005.PubMedCrossRef
go back to reference Gockel H, Carlyon RP, Plack CJ. Across-frequency interference effects in fundamental frequency discrimination: questioning evidence for two pitch mechanisms. J. Acoust. Soc. Am. 116:1092–1104, 2004.PubMedCrossRef Gockel H, Carlyon RP, Plack CJ. Across-frequency interference effects in fundamental frequency discrimination: questioning evidence for two pitch mechanisms. J. Acoust. Soc. Am. 116:1092–1104, 2004.PubMedCrossRef
go back to reference Green DM. Profile Analysis. New York, Oxford University Press, 1988. Green DM. Profile Analysis. New York, Oxford University Press, 1988.
go back to reference Green T, Faulkner A, Rosen S. Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. J. Acoust. Soc. Am. 116:2298–2310, 2004.PubMedCrossRef Green T, Faulkner A, Rosen S. Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. J. Acoust. Soc. Am. 116:2298–2310, 2004.PubMedCrossRef
go back to reference Grimault N, Micheyl C, Carlyon RP, Arthaud P, Collet L. Influence of peripheral resolvability on the perceptual segregation of harmonic complex tones differing in fundamental frequency. J. Acoust. Soc. Am. 108:263–271, 2000.PubMedCrossRef Grimault N, Micheyl C, Carlyon RP, Arthaud P, Collet L. Influence of peripheral resolvability on the perceptual segregation of harmonic complex tones differing in fundamental frequency. J. Acoust. Soc. Am. 108:263–271, 2000.PubMedCrossRef
go back to reference Hartmann WM, Johnson D. Stream segregation and peripheral channeling. Music Percept. 9:155–184, 1991. Hartmann WM, Johnson D. Stream segregation and peripheral channeling. Music Percept. 9:155–184, 1991.
go back to reference Hartmann WM, McAdams S, Smith BK. Hearing a mistuned harmonic in an otherwise periodic complex tone. J. Acoust. Soc. Am. 88:1712–1724, 1990.PubMedCrossRef Hartmann WM, McAdams S, Smith BK. Hearing a mistuned harmonic in an otherwise periodic complex tone. J. Acoust. Soc. Am. 88:1712–1724, 1990.PubMedCrossRef
go back to reference Hoekstra A. Frequency discrimination and frequency analysis in hearing. Ph.D. Thesis, Institute of Audiology, University Hospital, Groningen, Netherlands, 1979. Hoekstra A. Frequency discrimination and frequency analysis in hearing. Ph.D. Thesis, Institute of Audiology, University Hospital, Groningen, Netherlands, 1979.
go back to reference Houtsma AJM, Smurzynski J. J.F. Schouten revisited: pitch of complex tones having many high-order harmonics. J. Acoust. Soc. Am. 87:304–310, 1990.CrossRef Houtsma AJM, Smurzynski J. J.F. Schouten revisited: pitch of complex tones having many high-order harmonics. J. Acoust. Soc. Am. 87:304–310, 1990.CrossRef
go back to reference Hukin RW, Darwin CJ. Comparison of the effect of onset asynchrony on auditory grouping in pitch matching and vowel identification. Percept. Psychophys. 57:191–196, 1995.PubMed Hukin RW, Darwin CJ. Comparison of the effect of onset asynchrony on auditory grouping in pitch matching and vowel identification. Percept. Psychophys. 57:191–196, 1995.PubMed
go back to reference Ketten DR, Vannier MW, Skinner MW, Gates GA, Wang G, Neely JG. In vivo measures of cochlear length and insertion depth of nucleus cochlear implant electrode arrays. Ann. Otol. Rhinol. Laryngol. 107:1–16, 1998. Ketten DR, Vannier MW, Skinner MW, Gates GA, Wang G, Neely JG. In vivo measures of cochlear length and insertion depth of nucleus cochlear implant electrode arrays. Ann. Otol. Rhinol. Laryngol. 107:1–16, 1998.
go back to reference Kim DO, Molnar CE, Matthews JW. Cochlear mechanics: nonlinear behavior in two-tone responses as reflected in cochlear-nerve-fiber responses and in ear-canal sound pressure. J. Acoust. Soc. Am. 67:1704–1721, 1980.PubMedCrossRef Kim DO, Molnar CE, Matthews JW. Cochlear mechanics: nonlinear behavior in two-tone responses as reflected in cochlear-nerve-fiber responses and in ear-canal sound pressure. J. Acoust. Soc. Am. 67:1704–1721, 1980.PubMedCrossRef
go back to reference Kwon BJ, van den Honert C. Effect of electrode configuration on psychophysical forward masking in cochlear implant listeners. 119:2994–3002, 2006. Kwon BJ, van den Honert C. Effect of electrode configuration on psychophysical forward masking in cochlear implant listeners. 119:2994–3002, 2006.
go back to reference Laneau J, Wouters J, Moonen M. Improved music perception with explicit pitch coding in cochlear implants. Audiology and Neurotology 11:38–52, 2006.PubMedCrossRef Laneau J, Wouters J, Moonen M. Improved music perception with explicit pitch coding in cochlear implants. Audiology and Neurotology 11:38–52, 2006.PubMedCrossRef
go back to reference Loeb GE. Are cochlear implant patients suffering from perceptual dissonance? Ear Hear. 26:435–450, 2005.PubMedCrossRef Loeb GE. Are cochlear implant patients suffering from perceptual dissonance? Ear Hear. 26:435–450, 2005.PubMedCrossRef
go back to reference Macmillan NA, Creelman CD. Detection Theory: A User’s Guide. Cambridge, Cambridge University Press, 1991. Macmillan NA, Creelman CD. Detection Theory: A User’s Guide. Cambridge, Cambridge University Press, 1991.
go back to reference McDermott HJ, McKay CM, Vandali AE. A new portable sound processor for the University-of-Melbourne nucleus limited multielectrode cochlear implant. J. Acoust. Soc. Am. 91:3367–3371, 1992.PubMedCrossRef McDermott HJ, McKay CM, Vandali AE. A new portable sound processor for the University-of-Melbourne nucleus limited multielectrode cochlear implant. J. Acoust. Soc. Am. 91:3367–3371, 1992.PubMedCrossRef
go back to reference McKay CM, Carlyon RP. Dual temporal pitch percepts from acoustic and electric amplitude-modulated pulse trains. J. Acoust. Soc. Am. 105:347–357, 1999.PubMedCrossRef McKay CM, Carlyon RP. Dual temporal pitch percepts from acoustic and electric amplitude-modulated pulse trains. J. Acoust. Soc. Am. 105:347–357, 1999.PubMedCrossRef
go back to reference McKay CM, Henshall KR, Farrel RJ, McDermott HJ. A practical method of predicting the loudness of complex electrical stimuli. J Acoust Soc Am 113:2054-2063, 2003. McKay CM, Henshall KR, Farrel RJ, McDermott HJ. A practical method of predicting the loudness of complex electrical stimuli. J Acoust Soc Am 113:2054-2063, 2003.
go back to reference McKay CM, McDermott HJ. Loudness perception with pulsatile electrical stimulation: the effect of interpulse intervals. J. Acoust. Soc. Am. 104:1061–1074, 1998.PubMedCrossRef McKay CM, McDermott HJ. Loudness perception with pulsatile electrical stimulation: the effect of interpulse intervals. J. Acoust. Soc. Am. 104:1061–1074, 1998.PubMedCrossRef
go back to reference McKay CM, Rennine MD, McDermott HJ. Loudness summation for pulsatile electrical stimulation of the cochlea: Effects of rate, electrode separation, level, and mode of stimulation. J Acoust Soc Am 110:1514-1526, 2001. McKay CM, Rennine MD, McDermott HJ. Loudness summation for pulsatile electrical stimulation of the cochlea: Effects of rate, electrode separation, level, and mode of stimulation. J Acoust Soc Am 110:1514-1526, 2001.
go back to reference Moore BCJ. An Introduction to the Psychology of Hearing, 2nd edn. London, Academic, 1982. Moore BCJ. An Introduction to the Psychology of Hearing, 2nd edn. London, Academic, 1982.
go back to reference Moore BCJ, Carlyon RP. Perception of pitch by people with cochlear hearing loss and by cochlear implant users. In: Plack CJ, Oxenham AJ (eds) Springer Handbook of Auditory Research: Pitch Perception. Berlin, Springer-Verlag, pp. 234–277, 2005. Moore BCJ, Carlyon RP. Perception of pitch by people with cochlear hearing loss and by cochlear implant users. In: Plack CJ, Oxenham AJ (eds) Springer Handbook of Auditory Research: Pitch Perception. Berlin, Springer-Verlag, pp. 234–277, 2005.
go back to reference Moore BCJ, Glasberg BR, Baer T. A model for the prediction of thresholds, loudness and partial loudness. J. Audio Eng. Soc. 45:224–240, 1997. Moore BCJ, Glasberg BR, Baer T. A model for the prediction of thresholds, loudness and partial loudness. J. Audio Eng. Soc. 45:224–240, 1997.
go back to reference Nelson PB, Jin SH, Carney AE, Nelson DA. Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners. J. Acoust. Soc. Am. 113:961–968, 2003.PubMedCrossRef Nelson PB, Jin SH, Carney AE, Nelson DA. Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners. J. Acoust. Soc. Am. 113:961–968, 2003.PubMedCrossRef
go back to reference Oxenham AJ, Bernstein JGW, Penagos H. Correct tonotopic representation is necessary for complex pitch perception. Proc. Natl. Acad. Sci. USA 101:1421–1425, 2004.PubMedCrossRef Oxenham AJ, Bernstein JGW, Penagos H. Correct tonotopic representation is necessary for complex pitch perception. Proc. Natl. Acad. Sci. USA 101:1421–1425, 2004.PubMedCrossRef
go back to reference Roberts B. Spectral pattern, grouping, and the pitches of complex tones and their components. Acta Acustica United Acustica 91:945–957, 2005. Roberts B. Spectral pattern, grouping, and the pitches of complex tones and their components. Acta Acustica United Acustica 91:945–957, 2005.
go back to reference Shackleton TM, Carlyon RP. The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. J. Acoust. Soc. Am. 95:3529–3540, 1994.PubMedCrossRef Shackleton TM, Carlyon RP. The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination. J. Acoust. Soc. Am. 95:3529–3540, 1994.PubMedCrossRef
go back to reference Shamma S. Speech processing in the auditory system: II. Lateral inhibition and the central processing of speech evoked activity in the auditory nerve. J. Acoust. Soc. Am. 78:1622–1632, 1985.PubMedCrossRef Shamma S. Speech processing in the auditory system: II. Lateral inhibition and the central processing of speech evoked activity in the auditory nerve. J. Acoust. Soc. Am. 78:1622–1632, 1985.PubMedCrossRef
go back to reference Shannon RV. Multichannel electrical stimulation of the auditory nerve in man. I. Basic psychophysics. Hear. Res. 11:157–189, 1983.PubMedCrossRef Shannon RV. Multichannel electrical stimulation of the auditory nerve in man. I. Basic psychophysics. Hear. Res. 11:157–189, 1983.PubMedCrossRef
go back to reference Skinner MW, Clark GM, Whitford LA, et al. Evaluation of a new spectral peak coding strategy for the Nucleus 22 channel cochlear implant system. Am. J. Otol. 15:15–27, 1994.PubMed Skinner MW, Clark GM, Whitford LA, et al. Evaluation of a new spectral peak coding strategy for the Nucleus 22 channel cochlear implant system. Am. J. Otol. 15:15–27, 1994.PubMed
go back to reference Snyder RL, Bierer JA, Middlebrooks JC. Topographic spread of inferior colliculus activation in response to acoustic and intracochlear electric stimulation. J. Assoc. Res. Otolaryngol. 5:305–322, 2004.PubMedCrossRef Snyder RL, Bierer JA, Middlebrooks JC. Topographic spread of inferior colliculus activation in response to acoustic and intracochlear electric stimulation. J. Assoc. Res. Otolaryngol. 5:305–322, 2004.PubMedCrossRef
go back to reference Stickney GS, Zeng FG, Litovsky R, Assmann P. Cochlear implant speech recognition with speech maskers. J. Acoust. Soc. Am. 116:1081–1091, 2004. Stickney GS, Zeng FG, Litovsky R, Assmann P. Cochlear implant speech recognition with speech maskers. J. Acoust. Soc. Am. 116:1081–1091, 2004.
go back to reference Tong YC, Clark GM. Absolute identification of electric pulse rates and electrode positions by cochlear implant listeners. J. Acoust. Soc. Am. 74:73–80, 1985.CrossRef Tong YC, Clark GM. Absolute identification of electric pulse rates and electrode positions by cochlear implant listeners. J. Acoust. Soc. Am. 74:73–80, 1985.CrossRef
go back to reference Townshend B, Cotter N, Compernolle DV, White RL. Pitch perception by cochlear implant subjects. J. Acoust. Soc. Am. 82:106–115, 1987.PubMedCrossRef Townshend B, Cotter N, Compernolle DV, White RL. Pitch perception by cochlear implant subjects. J. Acoust. Soc. Am. 82:106–115, 1987.PubMedCrossRef
go back to reference van Wieringen A, Carlyon RP, Long CJ, Wouters J. Pitch of amplitude-modulated irregular-rate stimuli in electric and acoustic hearing. J. Acoust. Soc. Am. 114:1516–1528, 2003.PubMedCrossRef van Wieringen A, Carlyon RP, Long CJ, Wouters J. Pitch of amplitude-modulated irregular-rate stimuli in electric and acoustic hearing. J. Acoust. Soc. Am. 114:1516–1528, 2003.PubMedCrossRef
go back to reference Vliegen J, Oxenham AJ. Sequential stream segregation in the absence of spectral cues. J. Acoust. Soc. Am. 105:339–346, 1999.PubMedCrossRef Vliegen J, Oxenham AJ. Sequential stream segregation in the absence of spectral cues. J. Acoust. Soc. Am. 105:339–346, 1999.PubMedCrossRef
go back to reference Vliegen J, Moore BCJ, Oxenham AJ. The role of spectral and periodicity cues in auditory stream segregation, measured using a temporal discrimination task. J. Acoust. Soc. Am. 106:938–945, 1999.PubMedCrossRef Vliegen J, Moore BCJ, Oxenham AJ. The role of spectral and periodicity cues in auditory stream segregation, measured using a temporal discrimination task. J. Acoust. Soc. Am. 106:938–945, 1999.PubMedCrossRef
Metadata
Title
Concurrent Sound Segregation in Electric and Acoustic Hearing
Authors
Robert P. Carlyon
Christopher J. Long
John M. Deeks
Colette M. McKay
Publication date
01-03-2007
Publisher
Springer-Verlag
Published in
Journal of the Association for Research in Otolaryngology / Issue 1/2007
Print ISSN: 1525-3961
Electronic ISSN: 1438-7573
DOI
https://doi.org/10.1007/s10162-006-0068-1

Other articles of this Issue 1/2007

Journal of the Association for Research in Otolaryngology 1/2007 Go to the issue