What you re in for. Who are cochlear implants for? The bottom line. Speech processing schemes for

Size: px
Start display at page:

Download "What you re in for. Who are cochlear implants for? The bottom line. Speech processing schemes for"

Transcription

1 What you re in for Speech processing schemes for cochlear implants Stuart Rosen Professor of Speech and Hearing Science Speech, Hearing and Phonetic Sciences Division of Psychology & Language Sciences How does an implant work? What does an implant do to speech sounds? What works well in implants? What works poorly in implants? Who are cochlear implants for? People who receive relatively little benefit from a hearing aid in the implanted ear. Implants seem to work best in adults who had a significant period of relatively good hearing before becoming profoundly deaf, and who developed good language. children who are young enough to develop language through an implant. The bottom line Cochlear implants effectively bypass the cochlea by artificially stimulating the auditory nerve fibres directly. So, you still need some residual auditory nerve although auditory brainstem implants (ABI) may be appropriate when no auditory nerve is present

2 Components of a Cochlear Implant System Speech processor Implant The implant in place Implanted radio receiver Electrode inserted in the cochlea Microphone Transmitter Electrode array 1. Sound is received by the microphone of the speech processor. 2. The sound is digitized, analyzed and transformed into coded signals. 3. Coded signals are sent to the transmitter. 4. The transmitter sends the code across the skin to the internal implant where it is converted to electric signals. 5. Electric signals are sent to the electrode array to stimulate the residual auditory nerve fibres in the cochlea Signals travel to the brain, carrying information about sound. 8

3 The electrode array Play 2 Winston videos Play electrode insertion video What are the essential purposes of a speech processor? To transduce acoustical signals into an electrical form. To extract the appropriate speech information. To convert (or code) the resulting electrical signals into a form appropriate for stimulation of the auditory nerve. What other functions can and might be implemented in a speech processor? Enhancing speech features that contribute most to speech intelligibility. Minimising the effects of background noise. The possibility of different processing schemes for different situations.

4 What should an implant do? Mimic the most important functions of the normal ear. So what does a normal ear do? frequency analysis amplitude compression preservation of temporal features Frequency analysis: Basilar membrane motion to two sinusoids of different frequency compression revealed through input/ output functions on the basilar membrane 10 khz

5 Preservation of temporal features Think of the ear, not as an organ, but as a signal processor (limits on temporal features) Joris et al frequency shaping (frequency analysis & compression) Slower features too (4 Hz modulations) a CI substitutes for all this Common elements in speech processing A microphone to transduce acoustic signals into electrical ones. Amplitude compression to address the very limited dynamic range of electrocochlear stimulation. Use of the place principle for multiple electrodes (mapping low to high frequency components onto apical to basal cochlear places). But speech processing schemes vary significantly in other ways Pulsatile vs. continuously varying ( wavey ) stimulation. Not to be confused with analogue vs. digital implementations. All electrical stimulation is analogue. Simultaneous vs. non-simultaneous presentation of currents to different electrodes. Non-simultaneous stimulation requires pulsatile stimulation

6 Multi-channel systems All contemporary systems present different waveforms to different electrodes to mimic the frequency analysis of the normal mammalian cochlea. Think of the peripheral auditory system as analogous to a filter bank. What is a filter bank? A set of bandpass filters with centre frequencies covering the desired frequency range. What does a filter bank do to a speech waveform? Narrow bands of speech at different frequencies: Individual outputs from a filter bank a 6-channel filter bank

7 The filter bank analogy Imagine each afferent auditory nerve fibre has a bandpass filter attached to its input centre frequencies decreasing from base to apex. The no-brainer cochlear implant speech processing strategy Use an electronic filter bank to substitute for the auditory filter bank (the mechanics of the basilar membrane) A simple speech processing scheme for a cochlear implant: Compressed Analogue (CA) Noise-excited vocoding as a simulation of what a CI might sound like 100Hz- 400Hz 400Hz- 1000Hz 1000Hz- 2000Hz Acoustic signal 2000Hz- 3500Hz 3500Hz- 5000Hz 5000Hz- 8000Hz Electrical signal How does a CI hear?

8 Separate channels in a 6- channel simulation

9 ... and when summed together. Children like strawberries. Never mind the quality... feel the intelligibility. Effects of channel number 1 Connected Discourse Tracking shows that an unintelligible auditory signal can nevertheless significantly improve lipreading ability lipreading alone lipreading with voice pitch

10 A much more common speech processing scheme: Continuous Interleaved Sampling (CIS) Intonation & voicing can be an important aids to lipreading from Philipos Louizou: Note similarity of CIS, noise vocoding and normal cochlear processing Continuous Interleaved Sampling 0.5 khz 1.0 khz just like CA 2.0 khz 4.0 khz

11 CIS in detail CIS stimulation pattern Necessity is the mother of invention Spectral Peak Strategy SPEAK (n of m strategies) The problem How could devices running at relatively slow rates be used for CIS, which required high rates of pulsatile stimulation? The solution Pick and present pulses only at the significant peaks in the spectrum. Acoustic signal 20 Programmable Filters 100Hz- 200Hz etc 200Hz- 350Hz 350Hz- 500Hz 500Hz- 800Hz 7500Hz- 8000Hz Spectra Peak Extractor 100Hz 8kHz (Sample of sound spectrum) Electrical signal

12 SPEAK stimulation pattern SPEAK in quiet...the ladder s near the door... Advantages of peak-picking in noise Electrodograms show advantages of peak-picking in pink noise (The clown had a funny face.) The matches lie on the shelf. 1 6 of of A B A B 6 of of 20 The car engine s running. Kendall (1998 PhD Thesis)

13 Advanced Combination Encoders ACE (a faster n of m) Stimulation Pattern - ACE Acoustic signal signal 20 Programmable Filters 100Hz- High lots spectral of Spectra Peak 200Hz content electrodes Extractor etc 200Hz- 350Hz Optimal sites 7500Hzstimulated 500Hz- 800Hz Optimal temporal content 100Hz 350Hz- 500Hz 8000Hz 8kHz (Sample of sound spectrum) Electrical signal Stimulation rate, 250Hz- 2400Hz Any of 22 channels may be stimulated, and up to 20 are chosen per spectral sweep ACE stimulation pattern Other modifications to speech processing: Current steering requires simultaneous stimulation e.g., AB HiRes 120

14 What implant users are good at Spectral dynamics are encoded in acrosschannel envelope modulations Th-ee-z d- ay - z a ch-i-ck - en-l-e-g iz a r-a- (re) d -i - sh Following relatively slow modulations in amplitude and rates up to 20 Hz or so lead to high levels of intelligibility As long as there is a reasonable degree of analysis into distinct frequency regions but not too bad (3-6 channels?) nowhere near as good as a normal ear (20+ channels) What implant users are bad at Following fast modulations in amplitude Hearing out the periodicity in speech melody What do we mean by speech melody? waveform the n ew z ea l and rug by t ea m is called the all bl a ck s s spectrogram melody

15 Why is speech melody (voice pitch) important to hear? Melody coded as periodicity in rapid within-channel patterns Th-ee-z d- ay - z a ch-i-ck - en-l-e-g iz a r-a- (re) d -i - sh Contributes to speech intelligibility in all languages A good supplement to lipread information May play an important role in separating speech from background noises Appears to play a more crucial role for the young child developing language Crucial in so-called tone languages The representation of melody can be messy! What happens when an electrode is incompletely inserted?

16 Simulations of incomplete insertions 0 mm 2.2 mm Can the deleterious effects of spectral shifting be overcome over time? Pre-training v words in sentences over 3 hours of experience using CDT Post-training v 4.3 mm 6.5 mm normal listeners in simulations: Rosen et al J Acoust Soc Am Hair cell substitution? Why is a CI not as good as normal hearing? It s a damaged auditory system, presumably with accompanying neural degeneration (e.g. dead regions) Electrodes cannot extend fully along the length of the basilar membrane (BM), so mis-matched tuning and restricted access to apical regions (where nerve survival is typically greatest) 3000 IHCs vs. a couple of dozen electrodes, hence poorer frequency selectivity Current spreads across BM, hence poorer frequency selectivity Less independence of firing across nerve fibres, appears to affect temporal coding Small dynamic ranges but intensity jnd s not correspondingly smaller, hence fewer discriminable steps in loudness But good temporal and intensity resolution from Lynne Werner:

17 Ways to improve a cochlear implant Need more independent frequency channels clever schemes for steering stimulation? better electrode design? neural regeneration? Need to signal voice melody better better transmission of so-called fine-structure or rapid envelope information in the right users, complement the CI by effective exploitation of residual hearing: a cheap solution what even poor acoustic hearing does well, the CI does poorly, and v.v. To conclude Cochlear implants have not been around for more than about 50 years with most work beginning in the 70s Outstanding progress, both in basic research and clinical implementation in that time And there s lots more to do!

Essential feature. Who are cochlear implants for? People with little or no hearing. substitute for faulty or missing inner hair

Essential feature. Who are cochlear implants for? People with little or no hearing. substitute for faulty or missing inner hair Who are cochlear implants for? Essential feature People with little or no hearing and little conductive component to the loss who receive little or no benefit from a hearing aid. Implants seem to work

More information

Who are cochlear implants for?

Who are cochlear implants for? Who are cochlear implants for? People with little or no hearing and little conductive component to the loss who receive little or no benefit from a hearing aid. Implants seem to work best in adults who

More information

Essential feature. Who are cochlear implants for? People with little or no hearing. substitute for faulty or missing inner hair

Essential feature. Who are cochlear implants for? People with little or no hearing. substitute for faulty or missing inner hair Who are cochlear implants for? Essential feature People with little or no hearing and little conductive component to the loss who receive little or no benefit from a hearing aid. Implants seem to work

More information

Prelude Envelope and temporal fine. What's all the fuss? Modulating a wave. Decomposing waveforms. The psychophysics of cochlear

Prelude Envelope and temporal fine. What's all the fuss? Modulating a wave. Decomposing waveforms. The psychophysics of cochlear The psychophysics of cochlear implants Stuart Rosen Professor of Speech and Hearing Science Speech, Hearing and Phonetic Sciences Division of Psychology & Language Sciences Prelude Envelope and temporal

More information

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Pitch & Binaural listening

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Pitch & Binaural listening AUDL GS08/GAV1 Signals, systems, acoustics and the ear Pitch & Binaural listening Review 25 20 15 10 5 0-5 100 1000 10000 25 20 15 10 5 0-5 100 1000 10000 Part I: Auditory frequency selectivity Tuning

More information

Hearing Lectures. Acoustics of Speech and Hearing. Auditory Lighthouse. Facts about Timbre. Analysis of Complex Sounds

Hearing Lectures. Acoustics of Speech and Hearing. Auditory Lighthouse. Facts about Timbre. Analysis of Complex Sounds Hearing Lectures Acoustics of Speech and Hearing Week 2-10 Hearing 3: Auditory Filtering 1. Loudness of sinusoids mainly (see Web tutorial for more) 2. Pitch of sinusoids mainly (see Web tutorial for more)

More information

Signals, systems, acoustics and the ear. Week 5. The peripheral auditory system: The ear as a signal processor

Signals, systems, acoustics and the ear. Week 5. The peripheral auditory system: The ear as a signal processor Signals, systems, acoustics and the ear Week 5 The peripheral auditory system: The ear as a signal processor Think of this set of organs 2 as a collection of systems, transforming sounds to be sent to

More information

Implementation of Spectral Maxima Sound processing for cochlear. implants by using Bark scale Frequency band partition

Implementation of Spectral Maxima Sound processing for cochlear. implants by using Bark scale Frequency band partition Implementation of Spectral Maxima Sound processing for cochlear implants by using Bark scale Frequency band partition Han xianhua 1 Nie Kaibao 1 1 Department of Information Science and Engineering, Shandong

More information

Hearing the Universal Language: Music and Cochlear Implants

Hearing the Universal Language: Music and Cochlear Implants Hearing the Universal Language: Music and Cochlear Implants Professor Hugh McDermott Deputy Director (Research) The Bionics Institute of Australia, Professorial Fellow The University of Melbourne Overview?

More information

Acoustics, signals & systems for audiology. Psychoacoustics of hearing impairment

Acoustics, signals & systems for audiology. Psychoacoustics of hearing impairment Acoustics, signals & systems for audiology Psychoacoustics of hearing impairment Three main types of hearing impairment Conductive Sound is not properly transmitted from the outer to the inner ear Sensorineural

More information

An Auditory-Model-Based Electrical Stimulation Strategy Incorporating Tonal Information for Cochlear Implant

An Auditory-Model-Based Electrical Stimulation Strategy Incorporating Tonal Information for Cochlear Implant Annual Progress Report An Auditory-Model-Based Electrical Stimulation Strategy Incorporating Tonal Information for Cochlear Implant Joint Research Centre for Biomedical Engineering Mar.7, 26 Types of Hearing

More information

The role of periodicity in the perception of masked speech with simulated and real cochlear implants

The role of periodicity in the perception of masked speech with simulated and real cochlear implants The role of periodicity in the perception of masked speech with simulated and real cochlear implants Kurt Steinmetzger and Stuart Rosen UCL Speech, Hearing and Phonetic Sciences Heidelberg, 09. November

More information

SOLUTIONS Homework #3. Introduction to Engineering in Medicine and Biology ECEN 1001 Due Tues. 9/30/03

SOLUTIONS Homework #3. Introduction to Engineering in Medicine and Biology ECEN 1001 Due Tues. 9/30/03 SOLUTIONS Homework #3 Introduction to Engineering in Medicine and Biology ECEN 1001 Due Tues. 9/30/03 Problem 1: a) Where in the cochlea would you say the process of "fourier decomposition" of the incoming

More information

Cochlear Implant The only hope for severely Deaf

Cochlear Implant The only hope for severely Deaf Cochlear Implant The only hope for severely Deaf By: Dr. M. Sohail Awan, FCPS (ENT) Aga Khan University Hospital, Karachi - Pakistan For centuries, people believed that only a miracle could restore hearing

More information

2/25/2013. Context Effect on Suprasegmental Cues. Supresegmental Cues. Pitch Contour Identification (PCI) Context Effect with Cochlear Implants

2/25/2013. Context Effect on Suprasegmental Cues. Supresegmental Cues. Pitch Contour Identification (PCI) Context Effect with Cochlear Implants Context Effect on Segmental and Supresegmental Cues Preceding context has been found to affect phoneme recognition Stop consonant recognition (Mann, 1980) A continuum from /da/ to /ga/ was preceded by

More information

Bioscience in the 21st century

Bioscience in the 21st century Bioscience in the 21st century Lecture 2: Innovations and Challenges Dr. Michael Burger Outline: Review of last lecture Organization of the nervous system (in brief) The mapping concept Bionic implants

More information

HCS 7367 Speech Perception

HCS 7367 Speech Perception Long-term spectrum of speech HCS 7367 Speech Perception Connected speech Absolute threshold Males Dr. Peter Assmann Fall 212 Females Long-term spectrum of speech Vowels Males Females 2) Absolute threshold

More information

Spectrograms (revisited)

Spectrograms (revisited) Spectrograms (revisited) We begin the lecture by reviewing the units of spectrograms, which I had only glossed over when I covered spectrograms at the end of lecture 19. We then relate the blocks of a

More information

SPHSC 462 HEARING DEVELOPMENT. Overview Review of Hearing Science Introduction

SPHSC 462 HEARING DEVELOPMENT. Overview Review of Hearing Science Introduction SPHSC 462 HEARING DEVELOPMENT Overview Review of Hearing Science Introduction 1 Overview of course and requirements Lecture/discussion; lecture notes on website http://faculty.washington.edu/lawerner/sphsc462/

More information

What is sound? Range of Human Hearing. Sound Waveforms. Speech Acoustics 5/14/2016. The Ear. Threshold of Hearing Weighting

What is sound? Range of Human Hearing. Sound Waveforms. Speech Acoustics 5/14/2016. The Ear. Threshold of Hearing Weighting Speech Acoustics Agnes A Allen Head of Service / Consultant Clinical Physicist Scottish Cochlear Implant Programme University Hospital Crosshouse What is sound? When an object vibrates it causes movement

More information

Simulation of an electro-acoustic implant (EAS) with a hybrid vocoder

Simulation of an electro-acoustic implant (EAS) with a hybrid vocoder Simulation of an electro-acoustic implant (EAS) with a hybrid vocoder Fabien Seldran a, Eric Truy b, Stéphane Gallégo a, Christian Berger-Vachon a, Lionel Collet a and Hung Thai-Van a a Univ. Lyon 1 -

More information

Required Slide. Session Objectives

Required Slide. Session Objectives Auditory Physiology Required Slide Session Objectives Auditory System: At the end of this session, students will be able to: 1. Characterize the range of normal human hearing. 2. Understand the components

More information

Design and Implementation of Speech Processing in Cochlear Implant

Design and Implementation of Speech Processing in Cochlear Implant Design and Implementation of Speech Processing in Cochlear Implant Pooja T 1, Dr. Priya E 2 P.G. Student (Embedded System Technologies), Department of Electronics and Communication Engineering, Sri Sairam

More information

Issues faced by people with a Sensorineural Hearing Loss

Issues faced by people with a Sensorineural Hearing Loss Issues faced by people with a Sensorineural Hearing Loss Issues faced by people with a Sensorineural Hearing Loss 1. Decreased Audibility 2. Decreased Dynamic Range 3. Decreased Frequency Resolution 4.

More information

PSY 214 Lecture 16 (11/09/2011) (Sound, auditory system & pitch perception) Dr. Achtman PSY 214

PSY 214 Lecture 16 (11/09/2011) (Sound, auditory system & pitch perception) Dr. Achtman PSY 214 PSY 214 Lecture 16 Topic: Sound, auditory system, & pitch perception Chapter 11, pages 268-288 Corrections: None needed Announcements: At the beginning of class, we went over some demos from the virtual

More information

Hearing. istockphoto/thinkstock

Hearing. istockphoto/thinkstock Hearing istockphoto/thinkstock Audition The sense or act of hearing The Stimulus Input: Sound Waves Sound waves are composed of changes in air pressure unfolding over time. Acoustical transduction: Conversion

More information

(Thomas Lenarz) Ok, thank you, thank you very much for inviting me to be here and speak to you, on cochlear implant technology.

(Thomas Lenarz) Ok, thank you, thank you very much for inviting me to be here and speak to you, on cochlear implant technology. (Thomas Lenarz) Ok, thank you, thank you very much for inviting me to be here and speak to you, on cochlear implant technology. I want to briefly mention what hearing loss is. And what a cochlear implant

More information

Deafness and hearing impairment

Deafness and hearing impairment Auditory Physiology Deafness and hearing impairment About one in every 10 Americans has some degree of hearing loss. The great majority develop hearing loss as they age. Hearing impairment in very early

More information

Binaural Hearing. Steve Colburn Boston University

Binaural Hearing. Steve Colburn Boston University Binaural Hearing Steve Colburn Boston University Outline Why do we (and many other animals) have two ears? What are the major advantages? What is the observed behavior? How do we accomplish this physiologically?

More information

Mechanical Properties of the Cochlea. Reading: Yost Ch. 7

Mechanical Properties of the Cochlea. Reading: Yost Ch. 7 Mechanical Properties of the Cochlea CF Reading: Yost Ch. 7 The Cochlea Inner ear contains auditory and vestibular sensory organs. Cochlea is a coiled tri-partite tube about 35 mm long. Basilar membrane,

More information

Complete Cochlear Coverage WITH MED-EL S DEEP INSERTION ELECTRODE

Complete Cochlear Coverage WITH MED-EL S DEEP INSERTION ELECTRODE Complete Cochlear Coverage WITH MED-EL S DEEP INSERTION ELECTRODE hearlife CONTENTS A Factor To Consider... 3 The Cochlea In the Normal Hearing Process... 5 The Cochlea In the Cochlear Implant Hearing

More information

University of Arkansas at Little Rock. remaining auditory neurons directly.

University of Arkansas at Little Rock.  remaining auditory neurons directly. Signal Processing for Cochlear Prosthesis: A Tutorial Review Philipos C. Loizou Department of Applied Science University of Arkansas at Little Rock Little Rock, AR 72204-1099, U.S.A. http://giles.ualr.edu/asd/cimplants/

More information

J Jeffress model, 3, 66ff

J Jeffress model, 3, 66ff Index A Absolute pitch, 102 Afferent projections, inferior colliculus, 131 132 Amplitude modulation, coincidence detector, 152ff inferior colliculus, 152ff inhibition models, 156ff models, 152ff Anatomy,

More information

Cochlear implants. Carol De Filippo Viet Nam Teacher Education Institute June 2010

Cochlear implants. Carol De Filippo Viet Nam Teacher Education Institute June 2010 Cochlear implants Carol De Filippo Viet Nam Teacher Education Institute June 2010 Controversy The CI is invasive and too risky. People get a CI because they deny their deafness. People get a CI because

More information

The Auditory Brainstem Implant. Manchester Royal Infirmary

The Auditory Brainstem Implant. Manchester Royal Infirmary The Auditory Brainstem Implant Manchester Royal Infirmary What is an auditory brainstem implant (ABI)? An auditory brainstem implant (ABI) is a device that may allow a person to hear if they have had damage

More information

Representation of sound in the auditory nerve

Representation of sound in the auditory nerve Representation of sound in the auditory nerve Eric D. Young Department of Biomedical Engineering Johns Hopkins University Young, ED. Neural representation of spectral and temporal information in speech.

More information

! Can hear whistle? ! Where are we on course map? ! What we did in lab last week. ! Psychoacoustics

! Can hear whistle? ! Where are we on course map? ! What we did in lab last week. ! Psychoacoustics 2/14/18 Can hear whistle? Lecture 5 Psychoacoustics Based on slides 2009--2018 DeHon, Koditschek Additional Material 2014 Farmer 1 2 There are sounds we cannot hear Depends on frequency Where are we on

More information

A neural network model for optimizing vowel recognition by cochlear implant listeners

A neural network model for optimizing vowel recognition by cochlear implant listeners A neural network model for optimizing vowel recognition by cochlear implant listeners Chung-Hwa Chang, Gary T. Anderson, Member IEEE, and Philipos C. Loizou, Member IEEE Abstract-- Due to the variability

More information

Frequency refers to how often something happens. Period refers to the time it takes something to happen.

Frequency refers to how often something happens. Period refers to the time it takes something to happen. Lecture 2 Properties of Waves Frequency and period are distinctly different, yet related, quantities. Frequency refers to how often something happens. Period refers to the time it takes something to happen.

More information

COM3502/4502/6502 SPEECH PROCESSING

COM3502/4502/6502 SPEECH PROCESSING COM3502/4502/6502 SPEECH PROCESSING Lecture 4 Hearing COM3502/4502/6502 Speech Processing: Lecture 4, slide 1 The Speech Chain SPEAKER Ear LISTENER Feedback Link Vocal Muscles Ear Sound Waves Taken from:

More information

A NOVEL METHOD FOR OBTAINING A BETTER QUALITY SPEECH SIGNAL FOR COCHLEAR IMPLANTS USING KALMAN WITH DRNL AND SSB TECHNIQUE

A NOVEL METHOD FOR OBTAINING A BETTER QUALITY SPEECH SIGNAL FOR COCHLEAR IMPLANTS USING KALMAN WITH DRNL AND SSB TECHNIQUE A NOVEL METHOD FOR OBTAINING A BETTER QUALITY SPEECH SIGNAL FOR COCHLEAR IMPLANTS USING KALMAN WITH DRNL AND SSB TECHNIQUE Rohini S. Hallikar 1, Uttara Kumari 2 and K Padmaraju 3 1 Department of ECE, R.V.

More information

Role of F0 differences in source segregation

Role of F0 differences in source segregation Role of F0 differences in source segregation Andrew J. Oxenham Research Laboratory of Electronics, MIT and Harvard-MIT Speech and Hearing Bioscience and Technology Program Rationale Many aspects of segregation

More information

Hearing Aids. Bernycia Askew

Hearing Aids. Bernycia Askew Hearing Aids Bernycia Askew Who they re for Hearing Aids are usually best for people who have a mildmoderate hearing loss. They are often benefit those who have contracted noise induced hearing loss with

More information

ENT 318 Artificial Organs Physiology of Ear

ENT 318 Artificial Organs Physiology of Ear ENT 318 Artificial Organs Physiology of Ear Lecturer: Ahmad Nasrul Norali The Ear The Ear Components of hearing mechanism - Outer Ear - Middle Ear - Inner Ear - Central Auditory Nervous System Major Divisions

More information

Systems Neuroscience Oct. 16, Auditory system. http:

Systems Neuroscience Oct. 16, Auditory system. http: Systems Neuroscience Oct. 16, 2018 Auditory system http: www.ini.unizh.ch/~kiper/system_neurosci.html The physics of sound Measuring sound intensity We are sensitive to an enormous range of intensities,

More information

Auditory System. Barb Rohrer (SEI )

Auditory System. Barb Rohrer (SEI ) Auditory System Barb Rohrer (SEI614 2-5086) Sounds arise from mechanical vibration (creating zones of compression and rarefaction; which ripple outwards) Transmitted through gaseous, aqueous or solid medium

More information

Comment by Delgutte and Anna. A. Dreyer (Eaton-Peabody Laboratory, Massachusetts Eye and Ear Infirmary, Boston, MA)

Comment by Delgutte and Anna. A. Dreyer (Eaton-Peabody Laboratory, Massachusetts Eye and Ear Infirmary, Boston, MA) Comments Comment by Delgutte and Anna. A. Dreyer (Eaton-Peabody Laboratory, Massachusetts Eye and Ear Infirmary, Boston, MA) Is phase locking to transposed stimuli as good as phase locking to low-frequency

More information

Lecture 3: Perception

Lecture 3: Perception ELEN E4896 MUSIC SIGNAL PROCESSING Lecture 3: Perception 1. Ear Physiology 2. Auditory Psychophysics 3. Pitch Perception 4. Music Perception Dan Ellis Dept. Electrical Engineering, Columbia University

More information

Hearing Sound. The Human Auditory System. The Outer Ear. Music 170: The Ear

Hearing Sound. The Human Auditory System. The Outer Ear. Music 170: The Ear Hearing Sound Music 170: The Ear Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) November 17, 2016 Sound interpretation in the auditory system is done by

More information

Music 170: The Ear. Tamara Smyth, Department of Music, University of California, San Diego (UCSD) November 17, 2016

Music 170: The Ear. Tamara Smyth, Department of Music, University of California, San Diego (UCSD) November 17, 2016 Music 170: The Ear Tamara Smyth, trsmyth@ucsd.edu Department of Music, University of California, San Diego (UCSD) November 17, 2016 1 Hearing Sound Sound interpretation in the auditory system is done by

More information

ABSTRACT. Møller A (ed): Cochlear and Brainstem Implants. Adv Otorhinolaryngol. Basel, Karger, 2006, vol 64, pp

ABSTRACT. Møller A (ed): Cochlear and Brainstem Implants. Adv Otorhinolaryngol. Basel, Karger, 2006, vol 64, pp Speech processing in vocoder-centric cochlear implants Philipos C. Department of Electrical Engineering Jonsson School of Engineering and Computer Science University of Texas at Dallas P.O.Box 830688 Richardson,

More information

Auditory System & Hearing

Auditory System & Hearing Auditory System & Hearing Chapters 9 part II Lecture 16 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Spring 2019 1 Phase locking: Firing locked to period of a sound wave example of a temporal

More information

whether or not the fundamental is actually present.

whether or not the fundamental is actually present. 1) Which of the following uses a computer CPU to combine various pure tones to generate interesting sounds or music? 1) _ A) MIDI standard. B) colored-noise generator, C) white-noise generator, D) digital

More information

Glossary For Parents. Atresia: closure of the ear canal or absence of an ear opening.

Glossary For Parents. Atresia: closure of the ear canal or absence of an ear opening. Glossary For Parents This is not a complete or comprehensive glossary of audiologic and medical terms. It does include many technical and often unfamiliar terms that parents may hear used in connection

More information

Brad May, PhD Johns Hopkins University

Brad May, PhD Johns Hopkins University Brad May, PhD Johns Hopkins University When the ear cannot function normally, the brain changes. Brain deafness contributes to poor speech comprehension, problems listening in noise, abnormal loudness

More information

Auditory Physiology PSY 310 Greg Francis. Lecture 30. Organ of Corti

Auditory Physiology PSY 310 Greg Francis. Lecture 30. Organ of Corti Auditory Physiology PSY 310 Greg Francis Lecture 30 Waves, waves, waves. Organ of Corti Tectorial membrane Sits on top Inner hair cells Outer hair cells The microphone for the brain 1 Hearing Perceptually,

More information

Sound and Hearing. Decibels. Frequency Coding & Localization 1. Everything is vibration. The universe is made of waves.

Sound and Hearing. Decibels. Frequency Coding & Localization 1. Everything is vibration. The universe is made of waves. Frequency Coding & Localization 1 Sound and Hearing Everything is vibration The universe is made of waves db = 2log(P1/Po) P1 = amplitude of the sound wave Po = reference pressure =.2 dynes/cm 2 Decibels

More information

Auditory System & Hearing

Auditory System & Hearing Auditory System & Hearing Chapters 9 and 10 Lecture 17 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Spring 2015 1 Cochlea: physical device tuned to frequency! place code: tuning of different

More information

FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED

FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED Francisco J. Fraga, Alan M. Marotta National Institute of Telecommunications, Santa Rita do Sapucaí - MG, Brazil Abstract A considerable

More information

REVISED. The effect of reduced dynamic range on speech understanding: Implications for patients with cochlear implants

REVISED. The effect of reduced dynamic range on speech understanding: Implications for patients with cochlear implants REVISED The effect of reduced dynamic range on speech understanding: Implications for patients with cochlear implants Philipos C. Loizou Department of Electrical Engineering University of Texas at Dallas

More information

1. Human auditory pathway.

1. Human auditory pathway. 1. Human auditory pathway. the pinna, ear channel, and eardrum (tympanic membrane). The external ear collects the sound waves and guides them to the middle ear. The eardrum or tympanic membrane transmits

More information

Manchester Adult Cochlear Implant Programme

Manchester Adult Cochlear Implant Programme Manchester Royal Infirmary Manchester Adult Cochlear Implant Programme Information for Patients and Professionals Contents Introduction 3 The normal ear 4 The cochlear implant 5 The assessment procedure

More information

Hearing. PSYCHOLOGY (8th Edition, in Modules) David Myers. Module 14. Hearing. Hearing

Hearing. PSYCHOLOGY (8th Edition, in Modules) David Myers. Module 14. Hearing. Hearing PSYCHOLOGY (8th Edition, in Modules) David Myers PowerPoint Slides Aneeq Ahmad Henderson State University Worth Publishers, 2007 1 Hearing Module 14 2 Hearing Hearing The Stimulus Input: Sound Waves The

More information

Lecture 6 Hearing 1. Raghav Rajan Bio 354 Neurobiology 2 January 28th All lecture material from the following links unless otherwise mentioned:

Lecture 6 Hearing 1. Raghav Rajan Bio 354 Neurobiology 2 January 28th All lecture material from the following links unless otherwise mentioned: Lecture 6 Hearing 1 All lecture material from the following links unless otherwise mentioned: 1. http://wws.weizmann.ac.il/neurobiology/labs/ulanovsky/sites/neurobiology.labs.ulanovsky/files/uploads/purves_ch12_ch13_hearing

More information

Restoring Communication and Mobility

Restoring Communication and Mobility Restoring Communication and Mobility What are they? Artificial devices connected to the body that substitute, restore or supplement a sensory, cognitive, or motive function of the nervous system that has

More information

Linguistic Phonetics. Basic Audition. Diagram of the inner ear removed due to copyright restrictions.

Linguistic Phonetics. Basic Audition. Diagram of the inner ear removed due to copyright restrictions. 24.963 Linguistic Phonetics Basic Audition Diagram of the inner ear removed due to copyright restrictions. 1 Reading: Keating 1985 24.963 also read Flemming 2001 Assignment 1 - basic acoustics. Due 9/22.

More information

Improving Music Percep1on With Cochlear Implants David M. Landsberger

Improving Music Percep1on With Cochlear Implants David M. Landsberger Improving Music Percep1on With Cochlear Implants David M. Landsberger Music Enjoyment With a Cochlear Implant is Low Tested music enjoyment with people with one Normal Hearing Ear and one ear with a cochlear

More information

Wheaton Journal of Neuroscience Senior Seminar Research

Wheaton Journal of Neuroscience Senior Seminar Research Wheaton Journal of Neuroscience Senior Seminar Research Issue 1, Spring 2016: "Life 2.0: Blurring the Boundary Between our Tech and Ourselves" R.L. Morris, Editor. Wheaton College, Norton Massachusetts.

More information

Cochlear Implants. What is a Cochlear Implant (CI)? Audiological Rehabilitation SPA 4321

Cochlear Implants. What is a Cochlear Implant (CI)? Audiological Rehabilitation SPA 4321 Cochlear Implants Audiological Rehabilitation SPA 4321 What is a Cochlear Implant (CI)? A device that turns signals into signals, which directly stimulate the auditory. 1 Basic Workings of the Cochlear

More information

Quick Guide - eabr with Eclipse

Quick Guide - eabr with Eclipse What is eabr? Quick Guide - eabr with Eclipse An electrical Auditory Brainstem Response (eabr) is a measurement of the ABR using an electrical stimulus. Instead of a traditional acoustic stimulus the cochlear

More information

Chapter 11: Sound, The Auditory System, and Pitch Perception

Chapter 11: Sound, The Auditory System, and Pitch Perception Chapter 11: Sound, The Auditory System, and Pitch Perception Overview of Questions What is it that makes sounds high pitched or low pitched? How do sound vibrations inside the ear lead to the perception

More information

9/29/14. Amanda M. Lauer, Dept. of Otolaryngology- HNS. From Signal Detection Theory and Psychophysics, Green & Swets (1966)

9/29/14. Amanda M. Lauer, Dept. of Otolaryngology- HNS. From Signal Detection Theory and Psychophysics, Green & Swets (1966) Amanda M. Lauer, Dept. of Otolaryngology- HNS From Signal Detection Theory and Psychophysics, Green & Swets (1966) SIGNAL D sensitivity index d =Z hit - Z fa Present Absent RESPONSE Yes HIT FALSE ALARM

More information

Innervation of the Cochlea. Reading: Yost Ch. 8

Innervation of the Cochlea. Reading: Yost Ch. 8 Innervation of the Cochlea Reading: Yost Ch. 8 Fine Structure of the Organ of Corti Auditory Nerve Auditory nerve (AN) is a branch of the VIII th cranial nerve (other branch is vestibular). AN is composed

More information

The Outer and Middle Ear PERIPHERAL AUDITORY SYSTEM HOW WE HEAR. The Ear in Action AUDITORY NEUROPATHY: A CLOSER LOOK. The 3 parts of the ear

The Outer and Middle Ear PERIPHERAL AUDITORY SYSTEM HOW WE HEAR. The Ear in Action AUDITORY NEUROPATHY: A CLOSER LOOK. The 3 parts of the ear AUDITORY NEUROPATHY: A CLOSER LOOK HOW WE HEAR The 3 parts of the ear The ear consists of three main parts: 1. The outer ear The part you see, which is called the auricle (ohr-a-kal). 2. The middle ear

More information

The development of a modified spectral ripple test

The development of a modified spectral ripple test The development of a modified spectral ripple test Justin M. Aronoff a) and David M. Landsberger Communication and Neuroscience Division, House Research Institute, 2100 West 3rd Street, Los Angeles, California

More information

research directions Cochlear implant G.M.CLARK FREQUENCY CODING ELECTRICAL RATE STIMULATION - PHYSIOLOGY AND PSYCHOPHYSICS Department ofotolaryngology

research directions Cochlear implant G.M.CLARK FREQUENCY CODING ELECTRICAL RATE STIMULATION - PHYSIOLOGY AND PSYCHOPHYSICS Department ofotolaryngology Cochlear implant research directions G.M.CLARK COl1gress of. Sydney, Auslra'ia 2-7 March 1997 Department ofotolaryngology The University ofmelbourne, Melbourne (AUS) The Bionic Ear Institute, Melbourne

More information

Cochlear anatomy, function and pathology II. Professor Dave Furness Keele University

Cochlear anatomy, function and pathology II. Professor Dave Furness Keele University Cochlear anatomy, function and pathology II Professor Dave Furness Keele University d.n.furness@keele.ac.uk Aims and objectives of this lecture Focus (2) on the biophysics of the cochlea, the dual roles

More information

Speech, Language, and Hearing Sciences. Discovery with delivery as WE BUILD OUR FUTURE

Speech, Language, and Hearing Sciences. Discovery with delivery as WE BUILD OUR FUTURE Speech, Language, and Hearing Sciences Discovery with delivery as WE BUILD OUR FUTURE It began with Dr. Mack Steer.. SLHS celebrates 75 years at Purdue since its beginning in the basement of University

More information

Twenty subjects (11 females) participated in this study. None of the subjects had

Twenty subjects (11 females) participated in this study. None of the subjects had SUPPLEMENTARY METHODS Subjects Twenty subjects (11 females) participated in this study. None of the subjects had previous exposure to a tone language. Subjects were divided into two groups based on musical

More information

PSY 215 Lecture 10 Topic: Hearing Chapter 7, pages

PSY 215 Lecture 10 Topic: Hearing Chapter 7, pages PSY 215 Lecture 10 Topic: Hearing Chapter 7, pages 189-197 Corrections: NTC 09-1, page 3, the Superior Colliculus is in the midbrain (Mesencephalon). Announcements: Movie next Monday: Case of the frozen

More information

Binaural processing of complex stimuli

Binaural processing of complex stimuli Binaural processing of complex stimuli Outline for today Binaural detection experiments and models Speech as an important waveform Experiments on understanding speech in complex environments (Cocktail

More information

A. SEK, E. SKRODZKA, E. OZIMEK and A. WICHER

A. SEK, E. SKRODZKA, E. OZIMEK and A. WICHER ARCHIVES OF ACOUSTICS 29, 1, 25 34 (2004) INTELLIGIBILITY OF SPEECH PROCESSED BY A SPECTRAL CONTRAST ENHANCEMENT PROCEDURE AND A BINAURAL PROCEDURE A. SEK, E. SKRODZKA, E. OZIMEK and A. WICHER Institute

More information

Speech (Sound) Processing

Speech (Sound) Processing 7 Speech (Sound) Processing Acoustic Human communication is achieved when thought is transformed through language into speech. The sounds of speech are initiated by activity in the central nervous system,

More information

PSY 214 Lecture # (11/9/2011) (Sound, Auditory & Speech Perception) Dr. Achtman PSY 214

PSY 214 Lecture # (11/9/2011) (Sound, Auditory & Speech Perception) Dr. Achtman PSY 214 PSY 214 Lecture 16 Topic: Sound, Auditory System & Speech Perception Chapter 11, pages 270-289 Corrections: None Announcements: CD is available outside Dr Achtman s office if you would like to see demonstrations

More information

Peter S Roland M.D. UTSouthwestern Medical Center Dallas, Texas Developments

Peter S Roland M.D. UTSouthwestern Medical Center Dallas, Texas Developments Peter S Roland M.D. UTSouthwestern Medical Center Dallas, Texas Developments New electrodes New speech processing strategies Bilateral implants Hybrid implants ABI in Kids MRI vs CT Meningitis Totally

More information

Speech, Hearing and Language: work in progress. Volume 11

Speech, Hearing and Language: work in progress. Volume 11 Speech, Hearing and Language: work in progress Volume 11 Periodicity and pitch information in simulations of cochlear implant speech processing Andrew FAULKNER, Stuart ROSEN and Clare SMITH Department

More information

The mammalian cochlea possesses two classes of afferent neurons and two classes of efferent neurons.

The mammalian cochlea possesses two classes of afferent neurons and two classes of efferent neurons. 1 2 The mammalian cochlea possesses two classes of afferent neurons and two classes of efferent neurons. Type I afferents contact single inner hair cells to provide acoustic analysis as we know it. Type

More information

ADVANCES in NATURAL and APPLIED SCIENCES

ADVANCES in NATURAL and APPLIED SCIENCES ADVANCES in NATURAL and APPLIED SCIENCES ISSN: 1995-0772 Published BYAENSI Publication EISSN: 1998-1090 http://www.aensiweb.com/anas 2016 December10(17):pages 275-280 Open Access Journal Improvements in

More information

A Consumer-friendly Recap of the HLAA 2018 Research Symposium: Listening in Noise Webinar

A Consumer-friendly Recap of the HLAA 2018 Research Symposium: Listening in Noise Webinar A Consumer-friendly Recap of the HLAA 2018 Research Symposium: Listening in Noise Webinar Perry C. Hanavan, AuD Augustana University Sioux Falls, SD August 15, 2018 Listening in Noise Cocktail Party Problem

More information

Simulations of high-frequency vocoder on Mandarin speech recognition for acoustic hearing preserved cochlear implant

Simulations of high-frequency vocoder on Mandarin speech recognition for acoustic hearing preserved cochlear implant INTERSPEECH 2017 August 20 24, 2017, Stockholm, Sweden Simulations of high-frequency vocoder on Mandarin speech recognition for acoustic hearing preserved cochlear implant Tsung-Chen Wu 1, Tai-Shih Chi

More information

Linguistic Phonetics Fall 2005

Linguistic Phonetics Fall 2005 MIT OpenCourseWare http://ocw.mit.edu 24.963 Linguistic Phonetics Fall 2005 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 24.963 Linguistic Phonetics

More information

College of Medicine Dept. of Medical physics Physics of ear and hearing /CH

College of Medicine Dept. of Medical physics Physics of ear and hearing /CH College of Medicine Dept. of Medical physics Physics of ear and hearing /CH 13 2017-2018 ***************************************************************** o Introduction : The ear is the organ that detects

More information

Coding Strategies for Cochlear Implants Under Adverse Environments

Coding Strategies for Cochlear Implants Under Adverse Environments University of Wisconsin Milwaukee UWM Digital Commons Theses and Dissertations May 2016 Coding Strategies for Cochlear Implants Under Adverse Environments Qudsia Tahmina University of Wisconsin-Milwaukee

More information

3/20/2017. D. Richard Kang, MD, FACS, FAAP Pediatric Otolaryngology Director, ENT Institute Boys Town National Research Hospital

3/20/2017. D. Richard Kang, MD, FACS, FAAP Pediatric Otolaryngology Director, ENT Institute Boys Town National Research Hospital D. Richard Kang, MD, FACS, FAAP Pediatric Otolaryngology Director, ENT Institute Boys Town National Research Hospital Pediatric providers have a reasonable chance to see a child with hearing loss in your

More information

EVALUATION OF SPEECH PERCEPTION IN PATIENTS WITH SKI SLOPE HEARING LOSS USING ARABIC CONSTANT SPEECH DISCRIMINATION LISTS

EVALUATION OF SPEECH PERCEPTION IN PATIENTS WITH SKI SLOPE HEARING LOSS USING ARABIC CONSTANT SPEECH DISCRIMINATION LISTS EVALUATION OF SPEECH PERCEPTION IN PATIENTS WITH SKI SLOPE HEARING LOSS USING ARABIC CONSTANT SPEECH DISCRIMINATION LISTS Mai El Ghazaly, Resident of Audiology Mohamed Aziz Talaat, MD,PhD Mona Mourad.

More information

Can You Hear Me Now? Learning Objectives 10/9/2013. Hearing Impairment and Deafness in the USA

Can You Hear Me Now? Learning Objectives 10/9/2013. Hearing Impairment and Deafness in the USA Can You Hear Me Now? An update on the latest technology and solutions for hearing impairment Linda S. MacConnell, PA-C ENT Specialists of AZ ASAPA Fall CME Conference ctober, 03 Learning bjectives. Differentiate

More information

Chapter 40 Effects of Peripheral Tuning on the Auditory Nerve s Representation of Speech Envelope and Temporal Fine Structure Cues

Chapter 40 Effects of Peripheral Tuning on the Auditory Nerve s Representation of Speech Envelope and Temporal Fine Structure Cues Chapter 40 Effects of Peripheral Tuning on the Auditory Nerve s Representation of Speech Envelope and Temporal Fine Structure Cues Rasha A. Ibrahim and Ian C. Bruce Abstract A number of studies have explored

More information

Acoustics Research Institute

Acoustics Research Institute Austrian Academy of Sciences Acoustics Research Institute Modeling Modelingof ofauditory AuditoryPerception Perception Bernhard BernhardLaback Labackand andpiotr PiotrMajdak Majdak http://www.kfs.oeaw.ac.at

More information

Speech conveys not only linguistic content but. Vocal Emotion Recognition by Normal-Hearing Listeners and Cochlear Implant Users

Speech conveys not only linguistic content but. Vocal Emotion Recognition by Normal-Hearing Listeners and Cochlear Implant Users Cochlear Implants Special Issue Article Vocal Emotion Recognition by Normal-Hearing Listeners and Cochlear Implant Users Trends in Amplification Volume 11 Number 4 December 2007 301-315 2007 Sage Publications

More information