Brain Imaging of auditory function

Similar documents
The Central Nervous System

Competing Streams at the Cocktail Party

Neural Correlates of Human Cognitive Function:

An Overview of BMIs. Luca Rossini. Workshop on Brain Machine Interfaces for Space Applications

Brain and Cognition. Cognitive Neuroscience. If the brain were simple enough to understand, we would be too stupid to understand it

Stuttering Research. Vincent Gracco, PhD Haskins Laboratories

Introduction to Brain Imaging

Laurent Itti: CS564 Brain Theory and Artificial Intelligence. Lecture 4: Experimental techniques in visual neuroscience. Reading Assignments: None!

The neurolinguistic toolbox Jonathan R. Brennan. Introduction to Neurolinguistics, LSA2017 1

Outline. Biological Psychology: Research Methods. Dr. Katherine Mickley Steinmetz

Physiological and Physical Basis of Functional Brain Imaging 6. EEG/MEG. Kâmil Uludağ, 20. November 2007

Rhythm and Rate: Perception and Physiology HST November Jennifer Melcher

Biomedical Research 2013; 24 (3): ISSN X

J Jeffress model, 3, 66ff

Neuroimaging and Assessment Methods

Methods for assessing the brain basis of developmental disorders

Neuroimaging. BIE601 Advanced Biological Engineering Dr. Boonserm Kaewkamnerdpong Biological Engineering Program, KMUTT. Human Brain Mapping

Announcements. Final Exam will be a take-home exam. Format similar to the short assignment (no multiple choice, etc.)

STRUCTURAL ORGANIZATION OF THE NERVOUS SYSTEM

The Cognitive Neuroscientist s Toolkit

MULTI-CHANNEL COMMUNICATION

Eavesdropping on the Mind. COGS 17 - Winter 2019 Andrew Shibata

Myers Psychology for AP*

Cortical Encoding of Auditory Objects at the Cocktail Party. Jonathan Z. Simon University of Maryland

BOLD signal dependence on blood flow and metabolism. Outline

Chapter 5 The Research Methods of Biopsychology

USING AUDITORY SALIENCY TO UNDERSTAND COMPLEX AUDITORY SCENES

FINE-TUNING THE AUDITORY SUBCORTEX Measuring processing dynamics along the auditory hierarchy. Christopher Slugocki (Widex ORCA) WAS 5.3.

Brain and Behavior Lecture 13

Systems Neuroscience Oct. 16, Auditory system. http:

Outline.! Neural representation of speech sounds. " Basic intro " Sounds and categories " How do we perceive sounds? " Is speech sounds special?

Atypical processing of prosodic changes in natural speech stimuli in school-age children with Asperger syndrome

Beyond fmri. Joe Kable Summer Workshop on Decision Neuroscience August 21, 2009

Neural Representations of the Cocktail Party in Human Auditory Cortex

COGNITIVE SCIENCE 17. Peeking Inside The Head. Part 1. Jaime A. Pineda, Ph.D.

Neural Representations of the Cocktail Party in Human Auditory Cortex

Primitive intelligence in the auditory cortex

Language Speech. Speech is the preferred modality for language.

Non-Invasive Techniques

Non-Invasive Techniques

Robust Neural Encoding of Speech in Human Auditory Cortex

Cognitive Neuroscience Section 4

fmri: What Does It Measure?

ASSUMPTION OF COGNITIVE UNIFORMITY

Cortical Encoding of Auditory Objects in the Cocktail Party Problem. Jonathan Z. Simon University of Maryland

Takwa Adly Gabr Assistant lecturer of Audiology

Early Occurrence Of Auditory Change Detection In The Human Brain

fmri (functional MRI)

Neurobiology of Hearing (Salamanca, 2012) Auditory Cortex (2) Prof. Xiaoqin Wang

Auditory fmri correlates of loudness perception for monaural and diotic stimulation

Chapter 1 Introduction. Welcome to Our World Thresholds and the Dawn of Psychophysics Sensory Neuroscience and the Biology of Perception

Auditory Scene Analysis

Structure and Function of the Auditory and Vestibular Systems (Fall 2014) Auditory Cortex (3) Prof. Xiaoqin Wang

Over-representation of speech in older adults originates from early response in higher order auditory cortex

SUPPLEMENTARY MATERIAL. Table. Neuroimaging studies on the premonitory urge and sensory function in patients with Tourette syndrome.

Chapter 5. Summary and Conclusions! 131

3/1/18. Overview of the Talk. Important Aspects of Neuroimaging Technology

Acetylcholine (ACh) Action potential. Agonists. Drugs that enhance the actions of neurotransmitters.

Introduction to Computational Neuroscience

Define functional MRI. Briefly describe fmri image acquisition. Discuss relative functional neuroanatomy. Review clinical applications.

Neuroimaging methods vs. lesion studies FOCUSING ON LANGUAGE

Prof. Greg Francis 1/2/19

The Biological Level of Analysis: Studying the Brain

ELECTROPHYSIOLOGY OF UNIMODAL AND AUDIOVISUAL SPEECH PERCEPTION

Fundamentals of Cognitive Psychology, 3e by Ronald T. Kellogg Chapter 2. Multiple Choice

Human cortical functions in auditory change detection evaluated with multiple brain research methods

Large, High-Dimensional Data Sets in Functional Neuroimaging

FINAL PROGRESS REPORT

P2 Visual - Perception

AUDL GS08/GAV1 Signals, systems, acoustics and the ear. Pitch & Binaural listening

PsychoBrain. 31 st January Dr Christos Pliatsikas. Lecturer in Psycholinguistics in Bi-/Multilinguals University of Reading

Methods to examine brain activity associated with emotional states and traits

Hearing in the Environment

Hemodynamics and fmri Signals

Introduction. Visual Perception Aditi Majumder, UCI. Perception is taken for granted!

Unit 3: The Biological Bases of Behaviour

The Methods of Cognitive Neuroscience. Sensory Systems and Perception: Auditory, Mechanical, and Chemical Senses 93

COGNITIVE NEUROSCIENCE

Effects of aging on temporal synchronization of speech in noise investigated in the cortex by using MEG and in the midbrain by using EEG techniques

Hearing II Perceptual Aspects

Binaural Hearing. Why two ears? Definitions

Brad May, PhD Johns Hopkins University

Ways we Study the Brain. Accidents Lesions CAT Scan PET Scan MRI Functional MRI

The Nervous System. Neuron 01/12/2011. The Synapse: The Processor

Psychology Fall Dr. Michael Diehr. Psychology Fall Dr. Michael Diehr. Contrasted Group External Empirical Criterion-keyed

Brain and Nervous System Gleitman et al. (2011), Chapter 3, Part 2

Hemodynamics and fmri Signals

CS/NEUR125 Brains, Minds, and Machines. Due: Friday, April 14

Computational Cognitive Neuroscience (CCN)

Comparing event-related and epoch analysis in blocked design fmri

Neurovascular Coupling

25/09/2012. Capgras Syndrome. Chapter 2. Capgras Syndrome - 2. The Neural Basis of Cognition

How we study the brain: a survey of methods used in neuroscience

Supporting Information

Geography of the Forehead

Spectro-temporal response fields in the inferior colliculus of awake monkey

Organization of the nervous system. The withdrawal reflex. The central nervous system. Structure of a neuron. Overview

Organization of the nervous system. [See Fig. 48.1]

Cerebral Cortex 1. Sarah Heilbronner

Transcription:

Who am I? Brain Imaging of auditory function Maria Chait I do (mostly) MEG functional brain imaging of auditory processing. Now, I am at the EAR Institute, University College London & Equipe Audition, LPP, Paris 5, ENS PhD from the University of Maryland, USA o Cognitive Neuroscience of Language Laboratory o Computational Sensory Motor Systems Laboratory Outline: Introduction to brain imaging techniques. Spatial processing Pitch and melody Attention Change detection and MMN Some Slides/Images are taken from: http://psychology.uwo.ca/fmri4newbies/ David Poeppel Colin Phillips Wikipedia Istvan Winkler Gazzaniga et al. (eds) Cognitive Neuroscience Speech Brain asymmetry 1

Outline: functional brain mapping in humans Introduction to brain imaging techniques. Subdural recording Spatial processing Pitch and melody Attention Change detection and MMN Speech Brain asymmetry functional brain mapping in humans Subdural recording Lesion study Phineas Gage, 1848 Before: responsible, well mannered, well liked, efficient worker, pious After: capricious, impulsive, irreverent, hypersexual Damage involved VMPFC 2

functional brain mapping in humans functional brain mapping in humans Subdural recording Lesion study Trans cranial magnetic stimulation (TMS) Non invasive method to study brain circuitry and connectivity. Localized neural excitation is caused by weak electric currents induced in the tissue by rapidly changing magnetic fields. Subdural recording Lesion study Trans cranial magnetic stimulation (TMS) Non invasive method to study brain circuitry and connectivity. Localized neural excitation is caused by weak electric currents induced in the tissue by rapidly changing magnetic fields. Non invasive functional brain imaging methods The First Brain Imaging Experiment E = mc 2 Angelo Mosso??? Italian physiologist (1846 1910) Active neurons release the neurotransmitter glutamate Glutamate opens NMDA receptors on other neurons which allows calcium ions in Calcium activates the production of nitric oxide Nitric oxide diffuses out and dilates smooth muscle surrounding local arterioles This allows more blood into the local capillaries More oxygen and glucose reaches the neurons [In Mosso s experiments] the subject to be observed lay on a delicately balanced table which could tip downward either at the head or at the foot if the weight of either end were increased. The moment emotional or intellectual activity began in the subject, down went the balance at the headend, in consequence of the redistribution of blood in his system. William James, Principles of Psychology (1890) From http://psychology.uwo.ca/fmri4newbies/ 3

Physiological correlates of brain electrical activity Physiological correlates of brain electrical activity Metabolic response: FDG PET Metabolic response: FDG PET Electrical activity: excitatory inhibitory soma action potential glucose consumption oxygen consumption Autoradiography Electrical activity: excitatory inhibitory soma action potential glucose consumption oxygen consumption Autoradiography Electrophysiology EEG MEG Hemodynamic response: Blood flow Blood oxygenation Blood volume H 15 2 O PET fmri NIRS Electrophysiology EEG MEG Hemodynamic response: Blood flow Blood oxygenation Blood volume H 15 2 O PET fmri NIRS Positron Emission Tomography (PET) Positron Emission Tomography (PET) The system detects coincident pairs of gamma rays emitted by annihilation of a positron emitting radioisotope, which is introduced into the body on a metabolically active molecule. 4

Positron Emission Tomography (PET) Why Temporal Resolution is important: An example from the Lexical Decision task Advantages: Good spatial resolution Silent Limitations: Moderately Invasive (requires injection of radio nuclides) high costs of radio nuclides production. Short half life of radio nuclides. Poor temporal resolution (requires block design) Required operations: Visual registration Grapheme to phoneme conversion Lexical search Remembering the task Motor response < 900 ms distributed processing in neural networks PET methodology 1. Block design Tasks are run in blocks of 30 60 seconds duration. During each block, the same experimental task must be executed for the entire block duration. The different experimental blocks are chosen to be in a hierarchical or nested relationship. 2. Paired image subtraction PET images are collected during the execution of blocks and subtracted from one another. Task a Component a Component b Component c Image a Task b Component a Component b Image b Image a MINUS Image b = difference image (pixel by pixel subtraction) Local activation in difference image is responsible for Component c From http://psychology.uwo.ca/fmri4newbies/ 5

Why Temporal Resolution is important: An example from the Lexical Decision task PET methodology 1. Block design Tasks are run in blocks of 30 60 seconds duration. During each block, the same experimental task must be executed for the entire block duration. The different experimental blocks are chosen to be in a hierarchical or nested relationship. 2. Paired image subtraction PET images are collected during the execution of blocks and subtracted from one another. Required operations: Visual registration Grapheme to phoneme conversion Lexical search Remembering the task Motor response < 900 ms distributed processing in neural networks Task a Task b Component a Component b Component c Component a Component b Image a MINUS Image b = difference image (pixel by pixel subtraction) Local activation in difference image is responsible for Component c Image a Image b Positron Emission Tomography (PET) Near infrared spectroscopy (NIRS) Advantages: Good spatial resolution Silent Limitations: Moderately Invasive (requires injection of radio nuclides) high costs of radio nuclides production. Short half life of radio nuclides. Poor temporal resolution (requires block design) 6

Near infrared spectroscopy (NIRS) Near infrared spectroscopy (NIRS) Advantages: The primary absorbers in tissue at nearinfrared wavelengths: Water oxygenated haemoglobin (HbO) deoxygenated haemoglobin (Hb) transmission and absorption of NIR light in brain tissues contains information about haemoglobin concentration changes and oxygen saturation. Non invasive can be used on infants much more portable than fmri machines Limitations: Works at only centimetre depths (cortical). Poor temporal resolution. Functional magnetic resonance imaging (fmri) A method of observing which areas of the brain are active at any given time, based on measuring the degree of magnetization of a haemoglobin in response to an applied magnetic field. the difference in magnetization between oxygenated haemoglobin and deoxygenated haemoglobin causes magnetic signal variation which is detectable with an MRI scanner. Advantages: Functional magnetic resonance imaging (fmri) Non invasive Spatial resolution in the region of 3 6 millimetres. Limitations: Very noisy. Poor temporal resolution. Block design is usually used. BOLD=Blood Oxygenation Level Dependent RESPONSE 7

Neural current Photo by Fritz Goro Electroencephalography (EEG) Event related response neurophysiologic measurement of the electrical activity of the brain by recording from electrodes placed on the scalp. The resulting represent a summation of postsynaptic potentials from a large number of neurons. An evoked potential (or "evoked response") is an electrical potential recorded following presentation of a stimulus (as opposed to spontaneous) and is computed by averaging over stimulus presentations. 8

Electroencephalography (EEG) Inverse Problem Advantages: Non invasive and passive. Excellent temporal resolution (direct measure of neural activity) Relatively cheap to set up Limitations: Poor spatial resolution (inverse problem is ambiguous) Electroencephalography (EEG) Magnetoencephalography (MEG) Advantages: Non invasive and passive. Excellent temporal resolution (direct measure of neural activity) Relatively cheap to set up Limitations: Poor spatial resolution (inverse problem is ambiguous) blind to tangential currents Visible activity only for synchronous activation of many (~10 4 ~10 6 ) neurons measure the magnetic fields produced by electrical activity in the brain via extremely sensitive devices such as superconducting quantum interference devices (SQUIDs). signals derive from the net effect of ionic currents flowing in the dendrites of neurons during synaptic transmission. SQUID detectors measure brain magnetic fields around 100 billion times weaker than earth s steady magnetic field 9

Magnetoencephalography (MEG) Advantages: Non invasive and passive. Excellent temporal resolution (direct measure of neural activity) Auditory Cortex is in the Fovea of MEG Spatialresolution betterthaneegthan EEG. Limitations: Poor spatial resolution (inverse problem is ambiguous) blind to perpendicular currents Visible activity only for synchronous activation of many (~10 4 ~10 6 ) neurons Non-invasive recording from human brain (Functional brain imaging) Hemodynamic techniques Electro-magnetic techniques Positron emission tomography (PET) Functional magnetic resonance imaging (fmri) Electroencephalography (EEG) Magnetoencephalography (MEG) Excellent spatial resolution (~1-2mm) Poor temporal resolution (~1sec) Poor spatial resolution (~1cm) Excellent temporal resolution (<1msec) Why Temporal Resolution is important: An example from the Lexical Decision task Why Temporal Resolution is important: An example from the Lexical Decision task Required operations: Visual registration Grapheme to phoneme conversion Lexical search Remembering the task Motor response < 900 ms distributed processing in neural networks Required operations: Visual registration Grapheme to phoneme conversion Lexical search Remembering the task Motor response < 900 ms distributed processing in neural networks 10

Why Temporal Resolution is important: An example from the Lexical Decision task Summary Required operations: Visual registration Grapheme to phoneme conversion Lexical search Remembering the task Motor response < 900 ms distributed processing in neural networks brain imaging techniques Summary Different functional brain imaging techniques have specific limitations (e.g. what is measured, how results should be interpreted, etc) require different experimental design Are designed to answer different questions about processing (e.g. where vs. when ) The auditory pathway 11

Activation of structures in the ascending auditory pathway with sound stimuli: Griffiths et al, 2001 From animal models: (Figure from Ratnanather et al, NeuroImage 2003, vol 20[1]) 12

MEG vs. fmri data interpretation If brain area X is the first, in a hypothesized pathway, to be activated by a stimulus feature, then it is hypothesized that this area is involved in extracting that feature. If activation in area X is modulated by change in a particular feature, then it is involved in processing that feature. MEG vs. fmri data interpretation The activation pattern, consisting of increases in activation at Stimulus onset different latencies, reflects the sequential operation of cortical 80 systems related to analyzing the 60 40 stimulus Cortical processing can be studied -20-40 by investigating which stimulus -60 features affect the latency or -80 0 200 400 600 800 1000 1200 1400 amplitude of these responses. 20 0 Example: the MEG M100 onset response MEG vs. fmri data interpretation The activation pattern, consisting of increases in activation at Stimulus onset different latencies, reflects the sequential operation of cortical 80 systems related to analyzing the 60 40 stimulus 20 Cortical processing can be studied -20-40 by investigating which stimulus -60 features affect the latency or -80 0 200 400 600 800 1000 1200 1400 amplitude of these responses. 0 13

Outline: Spatial processing Introduction to brain imaging techniques. Spatial processing Contrast between all sound conditions and silence Pitch and melody Attention Change detection and MMN Speech Brain asymmetry fmri stimuli: Silence Left ear noise bursts Right ear noise bursts Center noise bursts Moving noise bursts Spatial percept manipulated by ITD Krumbholz et al, 2005 Spatial processing Binaural difference contrast: Center minus (left+right) (all referred to silence) Binaural interaction in IC, MGB and PAC fmri stimuli: Silence Left ear noise bursts Right ear noise bursts Center noise bursts Moving noise bursts Spatial percept manipulated by ITD Krumbholz et al, 2005 (Figure from Ratnanather et al, NeuroImage 2003, vol 20[1]) 14

Spatial processing Spatial processing Motion contrast: Motion Center Hierarchical processing of binaural cues fmri stimuli: Silence Left ear noise bursts Right ear noise bursts Center noise bursts Moving noise bursts Internal representation of lateralized sounds is predominantly contralateral. fmri stimuli: Silence Centre static noise Left static noise Right static noise Leftward moving noise Rightward moving noise Krumbholz et al, 2005 Spatial percept manipulated by ITD Krumbholz et al, 2004 Spatial processing Outline: Introduction to brain imaging techniques. Right hemisphere dominance in the processing of sound movement fmri stimuli: Silence Centre static noise Left static noise Right static noise Leftward moving noise Rightward moving noise Spatial percept manipulated by ITD Krumbholz et al, 2004 Spatial processing Pitch and melody Attention Change detection and MMN Speech Brain asymmetry 15

Pitch Processing Pitch Processing Contrasts: There are a number of centers in auditory cortex (HG and PT) that Process all stimuli coming up from subcortical structures in both hemispheres, and one of these regions in lateral HG is differentially active in the presence of pitch. fmri stimuli: Silence Noise Fixed Pitch (IRN) Changing pitch (tonic) Changing pitch (random) Patterson et al, 2002 All of the regions activated by noise were activated to the same degree by sounds with pitch. Patterson et al, 2002 fmri stimuli: Silence Noise sounds with pitch produced more activation Fixed Pitch (IRN) than those without pitch only in the lateral half of Heschl s gyrus (HG). Changing pitch (tonic) Changing pitch (random) Patterson et al, 2002 MEG stimuli: Noise Pitch( IRN) Pitch (IRN) Noise a transient neuromagnetic response, which can be elicited by the transition from a noise to a tone even when there is no concurrent change in sound energy. Krumbholz et al, 2003 16

Processing of melody Processing of melody fmri stimuli: Silence Noise Fixed Pitch (IRN) Changing pitch (tonic) Changing pitch (random) Patterson et al, 2002 Both contrasts reveal differential activation to melody in STG and PP, but in this case, the activation is asymmetric (more activity in the right hemisphere) Melody produced the same level of activity as fixed pitch in HG. This suggests that HG is involved in short term rather than longer term pitch processing. Patterson et al, 2002 Outline: Introduction to brain imaging techniques. Spatial processing Pitch and melody Attention fmri stimuli: Silence Noise Hierarchy of pitch processing Fixed Pitch (IRN) in auditory cortex Changing pitch (tonic) Changing pitch (random) Patterson et al, 2002 Change detection and MMN Speech Brain asymmetry 17

Attention Attention Mechanisms of attention At which stage of processing does attention operate? Early vs. late Selection Selective vs. Bottom up driven attention Selective attention Selective attention PET stimuli: 3 concurrent streams: Left Ear, Right Ear, Visual Task: attend left ear (detect deviant tones) attend right ear attend visual fmri stimuli: Melodies and shapes. silence + blank screen Unimodal Aud passive Unimodal Aud active Unimodal Vis passive Unimodal Vis active Bimodal passive Bimodal Aud active Bimodal Vis active Alho et al, 1999 Johnson & Zatorre, 2005 18

Selective attention Selective attention fmri stimuli: Melodies and shapes. silence + blank screen Unimodal Aud passive Unimodal Aud active Unimodal Vis passive Unimodal Aud active Bimodal passive Bimodal Aud active Bimodal Vis active fmri stimuli: Melodies and shapes. silence + blank screen Unimodal Aud passive Unimodal Aud active Unimodal Vis passive Unimodal Aud active Bimodal passive Bimodal Aud active Bimodal Vis active Increased activity Decreased activity Johnson & Zatorre, 2005 Johnson & Zatorre, 2005 STG Selective attention fmri stimuli: Melodies and shapes. silence + blank screen Unimodal Aud passive Unimodal Aud active Unimodal Vis passive Unimodal Aud active Bimodal passive Bimodal Aud active Bimodal Vis active BOLD response (in two voxels of interest in STS) decreases with decreasing perceptual relevance of auditory modality. dli STS Johnson & Zatorre, 2005 19

Temporal properties of auditory attention Temporal properties of auditory attention Example from EEG: MEG stimuli: Sequences of tones in left and right ear. Task: Attend left Attend right Attention verified by measuring detectiontask performance Alain & Izenberg, 2003 Early selection mechanism for auditory attention Woldorff et al, 1993 Temporal properties of auditory attention An example from Vision: Temporal properties of auditory attention MEG stimuli: Sequences of tones in left and right ear. Task: Attend left Attend right Attention verified by measuring detectiontask performance Cortico cortical feedback MEG stimuli: Sequences of tones in left and right ear. Task: Attend left Attend right Attention verified by measuring detectiontask performance Early selection mechanism for auditory attention Woldorff Super et et al, 2001 1993 Early selection mechanism for auditory attention Woldorff et al, 1993 20

Attentional modulation of human auditory cortex Attentional modulation of human auditory cortex Maximal in STG Maximal Enhanced in contralateral hemisphere Maximal Influenced by sound frequency (tonotopic organization) Attention related activation Petkov et al, 2004 Stimulus dependent Attention related activation activation Visual attention w auditory signal minus Visual attention without auditory signals Petkov et al, 2004 Attentional modulation of human auditory cortex Attentional modulation of human auditory cortex Stimulus dependent activation Attention related activation Stimulus dependent activation Auditory attention minus Visual attention Attention related activation Petkov et al, 2004 Auditory attention does not just amplify neural responses Petkov et al, 2004 21

Selectively ignoring a stimulus Attention Enhances relevant stimuli Suppresses irrelevant stimuli A MEG stimuli: Sequences of 3 tones. Task: COMPARE: compare A and C (ignore B) PASSIVE: listen passively B C Changes how stimuli are processed. Chait et al, in prep Krumholz study here Attention Changes sound representation in auditory cortex fmri stimuli: FM sweeps. Pitch direction Two tasks: Categorization of pitch direction (rising/falling) Categorization of duration (short/long) Duration Brechman & Scheich, 2005 22

Zatorre et al (1992) Lateralization of Phonetic and Pitch Discrimination in Speech Processing Noise Baseline Condition Stimulus Required response Baseline Silence Noise Noise bursts Alternating key press Activation in the Primary Auditory cortex (+Motor sensory) Passive speech Speech syllables Alternating key press Phonetic Speech syllables Key press to same final consonant Pitch Speech syllables Key press to rising pitch Phonetic condition Passive speech Passive Speech Noise Activity largely confined to the left Hemisphere. Activity in Broca s area near the junction with the premotor cortex. Activity in the inferior parietal area Activation along the superior temporal gyrus. Area receives Input from MGN and cortico cortical connections. Involved in higher auditory processing of complex sound 23

Outline: Pitch Passive speech Introduction to brain imaging techniques. Spatial processing Pitch and melody Activity in right prefrontal cortex Attention Change detection and MMN Speech Brain asymmetry Change detection Y sound as deviant X XXXXYX XXXY X XXXXXY X XXY X X XX... X... Y sound as standard Y YYYYX Y YYYX Y YYYYYX Y Y Y X Y Y Y... MMN as a tool: Which features of sound is cortex sensitive to? Mismatch Negativity; MMN; MMF Latency: 150-250 msec. Localization: Supratemporal auditory cortex Risto Näätänen 1978 24

MMN as a tool: Which features of sound is cortex sensitive to? Relationship to attention Allows to tap internal scene organization Risto Näätänen 1978 Sams et al. 1985 Brain mechanisms involved in the detection of acoustic changes Brain mechanisms involved in the detection of acoustic changes EEG + fmri stimuli: Sequences of clicktrains of different lengths 100 ms (t (standard) d) 74 ms 52 ms 30 ms Example trial: MMN amplitudes increase with deviance magnitude EEG + fmri stimuli: Sequences of clicktrains of different lengths 100 ms (t (standard) d) 74 ms 52 ms 30 ms Example trial: Schonwiesner et al, 2007 Schonwiesner et al, 2007 25

Brain mechanisms involved in the detection of acoustic changes EEG + fmri stimuli: Sequences of clicktrains of different lengths 100 ms (t (standard) d) 74 ms 52 ms 30 ms Example trial: Hemodynamic response time course in auditory cortex but not Frontal cortex is modulated by deviant size. Schonwiesner et al, 2007 Brain mechanisms involved in the detection of acoustic changes EEG + fmri stimuli: Sequences of clicktrains of different lengths 100 ms (t (standard) d) 74 ms 52 ms 30 ms Example trial: Judgement of sufficient novelty for the allocation of attentional resources Initial detection of change Schonwiesner et al, 2007 Attention MMN as a tool: Which features of sound is cortex sensitive to? relationship to attention Allows to tap internal scene organization Risto Näätänen 1978 26

MMN to violation of randomness Tervaniemi et al, 1994 frequency variation can be extracted as an invariant feature of the acoustic environment Wolff et al, 2001 MMN to sound omission Outline: Introduction to brain imaging techniques. Spatial processing Temporal window of integration revealed by MMN to sound omission Pitch and melody Attention Change detection and MMN Speech Yabe et al, 1999 Brain asymmetry 27

Noise silence Passive speech noise Language specific phoneme representations revealed by MMN Phonetic judgement passive speech Pitch judgement passive speech signal undergoes discrete processing stages in separate neural subsystems A1 = early acoustic analysis of all signals secondary areas = higher order processing When making a phonetic judgment subjects access an articulatory representation involving neural circuits that include Broca s area. Zatorre et al, 1994 Naatanen et al, 1997 Language specific phoneme representations revealed by MMN Language specific phoneme representations revealed by MMN EEG stimuli: MMN design /e/ (standard) /ö/ /o/ /æ/ non phoneme in either language /õ/ non phoneme in Finnish only EEG stimuli: MMN design /e/ (standard) /ö/ /o/ /æ/ non phoneme in either language /õ/ non phoneme in Finnish only Naatanen et al, 1997 The native language of a listener affects auditory cortical responses to speech sounds Naatanen et al, 1997 28

Phonetic categories in auditory cortex MEG stimuli: Fixed Design Discrimination within between category category [bæ] [dæ] Acoustic variation: F2 & F3 transitions ts Percentage Labial Judgment 100 80 60 40 b-d p-t 20 0 0 10 20 30 40 50 60 Number in Continuum 20ms 40ms 60ms Grouped Design Categorization 0ms 8ms 16ms 24ms 40ms 48ms 56ms 64ms Grouped Design Acoustic Control 20ms 28ms 36ms 44ms 60ms 68ms 76ms 84ms Phillips et al, 2000 a left hemisphere only mismatch response elicited by phonological feature contrast Phillips et al, 2000 Phillips et al, 2000 29

Speech comprehension and response patterns from auditory cortex Speech comprehension and response patterns from auditory cortex Stimulus envelope power spectrum Power spectrum of PC1 Cross correlation between the two MEG stimuli: Time compressed sentences 0.75 least compressed 0.5 0.35 0.2 most compressed Ahissar et al, 2001 MEG stimuli: Time compressed sentences 0.75 least compressed 0.5 Bad intelligibility Good intelligibility 0.35 Intelligibility is correlated with the ability of auditory cortex 0.2 most compressed to follow the temporal modulations of the signal Ahissar et al, 2001 Outline: Introduction to brain imaging techniques. Spatial processing Pitch and melody Attention Change detection and MMN Speech Brain asymmetry 30

Patterson et al, 2002 Right hemisphere h dominance in Processing melody Pitch direction Right hemisphere dominance in Processing pitch direction Duration Left hemisphere dominance in processing duration Krumbholz et al, 2004 Right hemisphere dominance in Processing sound movement Brechman & Scheich, 2005 Left hemisphere dominance in processing phonemic information Right hemisphere dominance in processing pitch change information Zatorre et al, 1994 Left hemisphere dominance in processing phonological contrast information Phillips et al, 2000 31

Hemispheric specialization may result from: Domain Specificity: differential specialization for different inputs: Speech centre / music centre / etc... Anatomical asymmetries in human auditory cortex Greater volume of HG in the Left Hemisphere Nature of stored representations that signals must interface with : Lexical info for speech/ prosodic info Differential specialization for different kinds of computations: Observed difference is due to difference in physical signal properties from Zatorre et al, 2002 Spectral and temporal processing in human auditory cortex Hypothesis #1: Human auditory cortex is functionally segregated such that differences exist in the temporal and spectral resolving power between the two hemispheres Spectral and temporal processing in human auditory cortex PET stimuli: Base signal Speech requires good temporal resolution Music requires good spectral resolution Constant spectral content Changing temporal content Constant temporal content Changing spectral content Zatorre & Belin, 2001 Zatorre & Belin, 2001 32

Spectral and temporal processing in human auditory cortex Spectral and temporal processing in human auditory cortex Covariation of activation with rate of spectral change Covariation of activation with rate of temporal change Zatorre & Belin, 2001 Zatorre & Belin, 2001 Spectral and temporal processing in human auditory cortex Constant spectral content Changing temporal content Possible problem: temporal and spectral are confounded with rate of change temporal changes faster than spectral Base signal Constant temporal content Changing spectral content Asymmetric temporal sensitivity in human auditory cortices Hypothesis #2: Human auditory cortex is functionally segregated such that differences exist in the temporal resolving power betweenthethe two hemispheres Two time scales: fast (25 50 ms) slow (200 300 ms) Zatorre & Belin, 2001 Boemio et al, 2005 33

Asymmetric temporal sensitivity in human auditory cortices STG fmri stimuli: Boemio et al, 2005 STS Asymmetric temporal sensitivity in human auditory cortices STG STG a. Effect of temporal structure b. & c. STG shows sensitivity iii to signal type at short segment durations Hemispheric specialization may result from: Domain Specificity: differential specialization for different inputs: Speech centre / music centre / etc... Nature of stored representations that signals must interface with : Lexical info for speech/ prosodic info STS STS d. & e. STS shows asymmetric sensitivity to segment duration Differential specialization for different kinds of computations: Observed difference is due to difference in physical signal properties Boemio et al, 2005 34

The wave of the past Intuitive psychological phrenology The wave of the present Cognitive psychological organology Brain Asymmetry summary + homage to David Poeppel phonology syntax semantics The wave of the future Computational organology sequencing recursion constituency linearization localizing generic computational subroutines 35