Psychoacoustical Models WS 2016/17

Similar documents
Linguistic Phonetics. Basic Audition. Diagram of the inner ear removed due to copyright restrictions.

HCS 7367 Speech Perception

Acoustics, signals & systems for audiology. Psychoacoustics of hearing impairment

Linguistic Phonetics Fall 2005

Hearing Lectures. Acoustics of Speech and Hearing. Auditory Lighthouse. Facts about Timbre. Analysis of Complex Sounds

! Can hear whistle? ! Where are we on course map? ! What we did in lab last week. ! Psychoacoustics

ClaroTM Digital Perception ProcessingTM

Issues faced by people with a Sensorineural Hearing Loss

Proceedings of Meetings on Acoustics

Topics in Linguistic Theory: Laboratory Phonology Spring 2007

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Pitch & Binaural listening

9/29/14. Amanda M. Lauer, Dept. of Otolaryngology- HNS. From Signal Detection Theory and Psychophysics, Green & Swets (1966)

Thresholds for different mammals

Hearing. Juan P Bello

Lecture 3: Perception

Masker-signal relationships and sound level

BINAURAL DICHOTIC PRESENTATION FOR MODERATE BILATERAL SENSORINEURAL HEARING-IMPAIRED

Frequency refers to how often something happens. Period refers to the time it takes something to happen.

Topic 4. Pitch & Frequency

Topic 4. Pitch & Frequency. (Some slides are adapted from Zhiyao Duan s course slides on Computer Audition and Its Applications in Music)

Technical Discussion HUSHCORE Acoustical Products & Systems

BASIC NOTIONS OF HEARING AND

Masked Perception Thresholds of Low Frequency Tones Under Background Noises and Their Estimation by Loudness Model

L2: Speech production and perception Anatomy of the speech organs Models of speech production Anatomy of the ear Auditory psychophysics

Infant Hearing Development: Translating Research Findings into Clinical Practice. Auditory Development. Overview

PHYS 1240 Sound and Music Professor John Price. Cell Phones off Laptops closed Clickers on Transporter energized

Low Frequency th Conference on Low Frequency Noise

Prescribe hearing aids to:

Study of perceptual balance for binaural dichotic presentation

Effects of speaker's and listener's environments on speech intelligibili annoyance. Author(s)Kubo, Rieko; Morikawa, Daisuke; Akag

HEARING AND PSYCHOACOUSTICS

LIST OF FIGURES. Figure No. Title Page No. Fig. l. l Fig. l.2

Psychophysical Studies of Auditory Masking in Marine Mammals: Key Concepts and New Directions

The basic hearing abilities of absolute pitch possessors

An active unpleasantness control system for indoor noise based on auditory masking

Determination of filtering parameters for dichotic-listening binaural hearing aids

Effects of aural combination tones on the loudness of a pure tone masked by an inharmonic pure-tone

Hearing Lectures. Acoustics of Speech and Hearing. Subjective/Objective (recap) Loudness Overview. Sinusoids through ear. Facts about Loudness

Review of Methods for Quantifying Tonalness in Noise. Quantifying Tonalness

Tuning curves and pitch matches in a listener with a unilateral, low-frequency hearing loss Florentine, Mary; Houtsma, A.J.M.

Digital Speech and Audio Processing Spring

Prelude Envelope and temporal fine. What's all the fuss? Modulating a wave. Decomposing waveforms. The psychophysics of cochlear

Effect on car interior sound quality according to the variation of noisy components of tire-pattern noise

Acoustics Research Institute

Audiogram+: GN Resound proprietary fitting rule

Auditory System & Hearing

What Is the Difference between db HL and db SPL?

Hearing. Figure 1. The human ear (from Kessel and Kardon, 1979)

Auditory System & Hearing

Modeling individual loudness perception in cochlear implant recipients with normal contralateral hearing

Role of F0 differences in source segregation

Chapter 2 Principles of Psychoacoustics

1706 J. Acoust. Soc. Am. 113 (3), March /2003/113(3)/1706/12/$ Acoustical Society of America

Enrique A. Lopez-Poveda Alan R. Palmer Ray Meddis Editors. The Neurophysiological Bases of Auditory Perception

Characterizing individual hearing loss using narrow-band loudness compensation

PERIPHERAL AND CENTRAL AUDITORY ASSESSMENT

Slow compression for people with severe to profound hearing loss

Contents. Exercises and Questions. Answers

Computational Perception /785. Auditory Scene Analysis

Testing Digital Hearing Aids

functions grow at a higher rate than in normal{hearing subjects. In this chapter, the correlation

Effects of partial masking for vehicle sounds

Loudness. Loudness is not simply sound intensity!

New measurement methods for signal adaptive hearing aids

Auditory Perception: Sense of Sound /785 Spring 2017

HCS 7367 Speech Perception

The role of periodicity in the perception of masked speech with simulated and real cochlear implants

The Handbook of Hearing and the Effects of Noise

Power Instruments, Power sources: Trends and Drivers. Steve Armstrong September 2015

Time Varying Comb Filters to Reduce Spectral and Temporal Masking in Sensorineural Hearing Impairment

Chapter 1: Introduction to digital audio

On the Interplay Between Cochlear Gain Loss and Temporal Envelope Coding Deficits

SLHS 1301 The Physics and Biology of Spoken Language. Practice Exam 2. b) 2 32

NIH Public Access Author Manuscript J Hear Sci. Author manuscript; available in PMC 2013 December 04.

Audiogram+: The ReSound Proprietary Fitting Algorithm

SUBJECT: Physics TEACHER: Mr. S. Campbell DATE: 15/1/2017 GRADE: DURATION: 1 wk GENERAL TOPIC: The Physics Of Hearing

THE MECHANICS OF HEARING

Pitfalls in behavioral estimates of basilar-membrane compression in humans a)

FREQUENCY COMPRESSION AND FREQUENCY SHIFTING FOR THE HEARING IMPAIRED

Brad May, PhD Johns Hopkins University

Recovery from on- and off-frequency forward masking in listeners with normal and impaired hearing

How high-frequency do children hear?

Effects of Age and Hearing Loss on the Processing of Auditory Temporal Fine Structure

Auditory model for the speech audiogram from audibility to intelligibility for words (work in progress)

Hearing in the Environment

Noise Induced Hearing Loss

What you re in for. Who are cochlear implants for? The bottom line. Speech processing schemes for

Hearing Sound. The Human Auditory System. The Outer Ear. Music 170: The Ear

Music 170: The Ear. Tamara Smyth, Department of Music, University of California, San Diego (UCSD) November 17, 2016

An Effiecient Modeling Technique for Heart Sounds and Murmurs

Best Practice Protocols

Discrete Signal Processing

CHAPTER 1 INTRODUCTION

Auditory principles in speech processing do computers need silicon ears?

Healthy Organ of Corti. Loss of OHCs. How to use and interpret the TEN(HL) test for diagnosis of Dead Regions in the cochlea

Spectrograms (revisited)

Christopher J. Plack Department of Psychology, University of Essex, Wivenhoe Park, Colchester CO4 3SQ, England

Chapter 3. Sounds, Signals, and Studio Acoustics

Loudness Processing of Time-Varying Sounds: Recent advances in psychophysics and challenges for future research

Transcription:

Psychoacoustical Models WS 2016/17 related lectures: Applied and Virtual Acoustics (Winter Term) Advanced Psychoacoustics (Summer Term)

Sound Perception 2

Frequency and Level Range of Human Hearing Source: Zwicker & Fastl Psychoacoustics Facts and Models 3

level of test tone at hearing threshold in dbspl Threshold in Quiet or the Absolute Threshold frequency in Hz Figure after: Zwicker, E.; Feldtkeller, R. (1967). Das Ohr als Nachrichtenempfänger, Hirzel Verlag, Stuttgart. Source: U. Zölzer, Digital Audio Signal Processing 4

Threshold in Quiet or the Absolute Threshold Source: Zwicker & Fastl Psychoacoustics Facts and Models

Figures left: Average pure-tone audiograms in db HearingLoss Hearing Threshold and age in (a) men and (b) women grouped by their age in decades (the parameter is age group in years). The extended high-frequency range is zoomed for clarity. Figure right: Pure-tone threshold standard deviation of all participants as a function of frequency (the parameter is age in 10-year groups). Figures: Milan Jilek, Daniel Suta, and Josef Syka, Reference hearing thresholds in an extended frequency range as a function of age, J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 6

Loudness Loudness Level: Loudness N: psychological concept to describe the magnitude of an auditory sensation, the loudness of a sound (measured in sone ) loudness level LN of a sound is measured in phon LN of a sound is the sound pressure of a 1 khz tone which is as loud as the sound Fig: Fletcher, Speech and Hearing in Communication, 1953. 7

Loudness Equal-Loudness Level Contours: Equal loudness contours of pure tones in a free sound field. N=64 sone 16 The parameter is expressed in loudness level, LN, and loudness, N. Can be observed: The sensitivity of the human ear - a function of frequency The most sensitive to sounds around 2 4 khz 4 1 0.15 Links to measure the sensitivity on different frequencies: http://www.phys.unsw.edu.au/jw/hearing.html http://www.phys.unsw.edu.au/music/db/loudness.html, 2010 Fig: Suzuki et al., Precise and Full-range Determination of Two-dimensional Equal Loudness Contours, 2003. 8

Loudness 9

Loudness Loudness Scale: Fig: en.wikipedia.org/wiki/sone, 2010. 10

Sound Examples Example 1: Sensitivity of hearing as function of frequency Sweep from 0-16000 Hz (equal amplitude) Example 2: Upper limit of hearing 8 khz khz 10 khz 12 khz 14 khz 16 17 khz 18 khz 19 khz 20 khz 11

Critical Bands 12

Frequency Grouping in Human Hearing Different interpretations that produce the same segmentation Constant distance in the Cochlea By using tones under the threshold in quiet, their intensity add up in a critical band and are now audible Tones in a critical band above the threshold in quiet: their energy adds up Formula for the width of the critical bands for frequencies < 500 Hz: Constant 100Hz width for frequencies > 500 Hz: 0.2*frequency 13

Frequency Grouping Bandwidth The Critical Bands Critical bandwidth as a function of frequency, that quantifies the cochlear filter passbands. Approximations for low and high frequency ranges are indicated by broken lines. Source: Zwicker & Fastl Psychoacoustics Facts and Models 14

Excursus - Critical Bands and Loudness Spectral effects - influence of frequency separation: measure the loudness level (or level of the equally loud 1 khz tone) of 2 tones by varying the frequency separation Fig: Zwicker, Fastl Psychoacoustics - Facts and Models, 2nd Edition, 1999. 15

Excursus - Critical Bands and Loudness Spectral effects - influence of bandwidth: bandwidth of the signals plays an important role sound level also influence loudness level total sound intensity (SPL) have to be constant to measure loudness as function of bandwidth critical bandwidth Fig: Zwicker, Fastl Psychoacoustics - Facts and Models, 2nd Edition, 1999. 16

Critical Bands: Bark Scale Critical-band concept used in many models and hypothesis unit was defined leading to so-called critical-band rate scale scale ranging from 0 24, unit Bark relation between z and f is important for understanding many characteristics of human ear

Critical Bands: Bark Scale 18

Masking 19

Masking data compression exploitation of perception in critical bands with reference to the threshold in quiet is not enough Basic principle: a test signal, called a maskee is placed at the center frequency of the critical bandwidth one masking signal, called masker (equal power and distance from maskee) If the Pmaskee is weak relative to the total power of the maskers the test signal is not audible test signal is masked In order for the test signal to become audible, its power has to be raised to above a certain level masking threshold. 20

Masking of Pure Tones by Noise - Broad-Band Noise broad-band noise: white noise from 20 Hz - 20 khz figure: masking threshold for pure tones masked by broad band noise of different levels uniform masking noise (UMN) by equalization of the 10 db per decade slope Fig: Zwicker, Fastl Psychoacoustics - Facts and Models, 2nd Edition, 1999. 21

Masking of Pure Tones by Noise - Narrow-Band Noise narrow-band noise: noise with a bandwidth equal or smaller than critical bandwidth figure: threshold of pure tones masked by narrow-band noise for different centre frequencies difference between maximum of masked threshold and test tone level Fig: Zwicker, Fastl Psychoacoustics - Facts and Models, 2nd Edition, 1999. 22

Masking of Pure Tones by Noise - Narrow-Band Noise narrow-band noise: noise with a bandwidth equal or smaller than critical bandwidth figure: dependence of masked threshold on level of narrow-band noise dips at higher levels nonlinear effects (difference noise caused by interactions between test tone and noise) Fig: Zwicker, Fastl Psychoacoustics - Facts and Models, 2nd Edition, 1999. 23

Test: Narrow Band Noise Masking Tone Example 3: Narrow Band Noise at 1000 Hz, width 160 Hz; Sine tones at 600, 800, 1000, 1200, 1400, 1600 Hz at varying levels (-80 to -20 db) 24

Sound Examples: Masking with White Noise Example 4: Masking with white noise 500 Hz sinusoid tone at varying amplitude ALONE Level: -40,-35,-30,-25,-20,-15,-10 db Example 5: Masking with white noise 500 Hz tone at varying amplitude with White Noise Level: -40,-35,-30,-25,-20,-15,-10 db Noise Level: -50 db Example 6: Masking with white noise 5000 Hz tone at varying amplitude with White Noise Levels: same as Example 5 25

Masking of Pure Tones by Low-Pass or HighPass Noise Source: Zwicker & Fastl Psychoacoustics Facts and Models 26

Masking of Pure Tones by Pure Tone pure tone: single frequency figure: 1 khz masking tone with level of 80 db threshold for detection of anything difficulties: beats (hatching) masker and difference tone (stippling) Source: Zwicker & Fastl Psychoacoustics Facts and Models 27

Masking of Pure Tone by Complex Tones complex tone: fundamental tone with its harmonics figure: threshold of pure tones masked by a complex tone with 200 Hz fundamental frequency and nine harmonics Source: Zwicker & Fastl Psychoacoustics Facts and Models 28

Tonality (1) Tonality index α: noisy signal: α = 0 tonal signal: α = 1 System theory Sharp spectral lines = Signal is periodic = Signal is predictable Approximation: If the signal is predictable then it should be periodic Therefore we can use prediction to approximate if a signal is tonal (by periodicity) 29

Tonality (2) 30

Masking Spreading Function Simultaneous Masking Spreading Function Source: U. Zölzer, Digital Audio Signal Processing 31

Calculating the Masking Threshold Comparison of the signal level to Masking Threshold_ Approximation Simultaneous Masking Threshold (Power) 32

In-Band Masking (noise) 33

Masking Neighboring Bands - spread of masking due to the non-linearity of auditory filters - resulting masking threshold = sum of power of neighbouring spreading functions - here: value at intersection of neighbouring spreading functions taken 34

Sound Examples Example 7: Dynamic range Bach organ music with 16 bits per sample Example 8: Dynamic range Bach organ music with 11 bits per sample Example 9: Dynamic range Bach organ music with 6 bits per sample 35

Temporal Masking Effects (1) This is not correct! Source: Zwicker & Fastl Psychoacoustics Facts and Models 36

Temporal Masking Effects (2) Post-Masking: corresponds to decay in the effect of the masker expected Pre-Masking: appears during time before masker is switched on Quick build-up time for loud maskers Slower build-up time for faint test sounds Frequency resolution Blurring in time Frequency resolution in the ear Masking in time Because of in-ear fast processing between quiet to loud signals, we get Pre-Echoes Pre-Masking: 1-5 ms Post-Masking: ~100ms 37

Pre-Echo: Example With Pre-Echo: Example 10: Castanets original Example 11: Castanets coded with a block size of 2048 samples Source: Spanias et.al. Audio Signal Processing and Coding Without Pre-Echo: 38

next lecture: 09.11. - Quantization and Coding 39