Emergence of transformation tolerant representations of visual objects in rat lateral extrastriate cortex. Davide Zoccolan

Size: px
Start display at page:

Download "Emergence of transformation tolerant representations of visual objects in rat lateral extrastriate cortex. Davide Zoccolan"

Transcription

1 Emergence of transformation tolerant representations of visual objects in rat lateral extrastriate cortex Davide Zoccolan

2 Layout of the talk 1. Background Why vision? Why rats (rodents)?

3 Why to study vision? 1. Because it s an extraordinary complex cognitive function Sensation Perception

4

5 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena

6 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena

7 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena

8 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena

9 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena pixels = photoreceptors

10 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena bananas

11 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena clothes

12 Il riconoscimento visivo Identificare/classificare gli oggetti in una scena face

13 faces

14 Why to study vision? 1. Because it s an extraordinary complex cognitive function Sensation Perception

15 Why to study vision? 1. Because it s an extraordinary complex cognitive function Sensation Perception 2. Because the underlying cortical machinery is extraordinary complex

16 Why to study vision?

17 Why to study vision? DiCarlo, Zoccolan and Rust (2012)

18 Why to study vision? 1. Because it s an extraordinary complex cognitive function Sensation Perception 2. Because the underlying cortical machinery is extraordinary complex Understanding vision: understanding the brain achieving artificial intelligence

19 Layout of the talk 1. Background Why vision? Why rats (rodents)?

20 Issue with monkey studies

21 Issue with monkey studies the complexity of the primate visual system compared to the limited experimental approaches

22 Is there any more manageable model system of visual functions? 1. Simpler visual system lower number of visual areas Less intricate feedforward and feedback circuitry 1. More experimentally accessible high-throughput behavioral testing and large-scale recordings molecular and genetic manipulation In-vivo 2-photon imaging, optogenetics, etc. Rodents 2. Still embodying the core computations underlying visual object recognition and shape processing

23 Are rodents (mice and rats) suitable models to study higher-level vision? largely neglected by vision scientists (until recently)

24 Can rats/mice see objects? E.g., rats have a much poorer spatial resolution (~1cycle/deg) compared to human fovea (~60 cycles/deg) Human Rat (Fisher-Norway) Rat (Long-Evans) Rat (Sprague-Dawley) Prusky, Harker, Douglas and Whishaw (2002)

25 Since 2007 rodents are emerging as novel models of visual functions Niell and Stryker (Neuron) Adesnik et al (Nature) Wang and Burkhalter (J Comp Neurol) Niell and Stryker (J Neurosci) Marshel et al (Neuron) Anderman et al (Neuron) Bonin et al (J Neurosci) Wang et al (J Neurosci) Busse et al (J Neurosci) Histed et al (J Neurophys) Ayaz et al (Curr Biol) Scholl et al (J Neurosci) Zhao et al (J Neurosci) Bennet et al (Neuron) Saleem et al (Nat Neurosci) Mouse Physiology/imaging of lower-level visual areas Rat Psychophysics of visual perception/recognition Zoccolan et al (PNAS) Meyer et al (J Vision) Greenberg et al (Nat Neurosci) Petruno et al (Plos One) Reinagel (Plos One) Alemi et al (J Neurosci) Hengen et al (Neuron) Wallace et al (Nature) Tafazoli et al (J Neurosci) Vermaercke and Op de Beeck (Curr Biol)

26 Layout of the talk 1. Background Why vision? Why rats (rodents)? 1. What is rat vision capable of? Behavior Neurophysiology

27 Layout of the talk 1. Background Why vision? Why rats (rodents)? 1. What is rat vision capable of? Behavior Zoccolan, Oertelt, DiCarlo, Cox (2009) Tafazoli, Di Filippo, Zoccolan (2012) Alemi-Neissi, Rosselli, Zoccolan (2013) Rosselli, Alemi-Neissi, Ansuini, Zoccolan (2015) Djurdjevic, Bertolini, Ansuini, Zoccolan (in preparation) Neurophysiology

28 Layout of the talk 1. Background Why vision? Why rats (rodents)? 1. What is rat vision capable of? Behavior Zoccolan, Oertelt, DiCarlo, Cox (2009) Tafazoli, Di Filippo, Zoccolan (2012) Alemi-Neissi, Rosselli, Zoccolan (2013) Rosselli, Alemi-Neissi, Ansuini, Zoccolan (2015) Djurdjevic, Bertolini, Ansuini, Zoccolan (in preparation) Neurophysiology Tafazoli, Safaai, De Franceschi, Rosselli, Riggi, Buffolo, Panzeri, Zoccolan (2017)

29 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009) Frontal views (0º in-depth rotation) Default size (40º of visual angle) Default position (center of the screen)

30 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009)

31 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009)

32 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009)

33 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009) Default views 108 size-rotation combinations Variation axes

34 The rat in action

35 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009)

36 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009)

37 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009) 1. Rats spontaneously generalize their recognition to novel object views (Tafazoli, Di Filippo, Zoccolan, 2012) Default view perceptually similar? Visual priming paradigm 16 novel views

38 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009) 1. Rats spontaneously generalize their recognition to novel object views (Tafazoli, Di Filippo, Zoccolan, 2012) 2. Rats rely on an invariant, shape-based, multifeatural processing strategy of visual objects (Alemi-Neissi, Rosselli, Zoccolan, 2013)

39 Summary of the behavioral studies 1. Rats are capable of invariant visual object recognition (Zoccolan, Oertelt, DiCarlo, Cox, 2009) 1. Rats spontaneously generalize their recognition to novel object views (Tafazoli, Di Filippo, Zoccolan, 2012) 2. Rats rely on an invariant, shape-based, multifeatural processing strategy of visual objects (Alemi-Neissi, Rosselli, Zoccolan, 2013) Rats good models to study the neuronal basis of visual object recognition and shape processing

40 Layout of the talk 1. Background Why vision? Why rats (rodents)? 1. What is rat vision capable of? Behavior Neurophysiology

41 Does an homologous of the primate ventral stream exist in the rat brain? Monkey brain Rat brain

42 The primate ventral stream: an object processing pathway AIT PIT V1 Adapted from Rousselet et al. (2004)

43 The primate ventral stream: an object processing pathway 1 Tuning complexity AIT V1 tuning properties PIT Adapted from Rousselet et al. (2004) V1 Adapted from Kandel, Schwartz and Jessell

44 The primate ventral stream: an object processing pathway 1 Tuning complexity AIT tuning properties AIT Desimone et al. (1984) PIT V1 Adapted from Rousselet et al. (2004) Kobatake et al. (1994)

45 The primate ventral stream: an object processing pathway 1 2 Tuning complexity Latency AIT ms PIT V ms Adapted from Rousselet et al. (2004)

46 The primate ventral stream: an object processing pathway 1 Tuning complexity 2 Latency 3 RF size AIT ms 2.5º-70º PIT V ms 0.5º-1.5º Adapted from Rousselet et al. (2004)

47 The primate ventral stream: builds explicit representations of visual objects V1 representation AIT representation r 1 r 1 car r 2 r 2 r N r 4 r 3 r N r 4 r 3

48 Does an homologous of the primate ventral stream exist in the rat brain? Monkey brain Rat brain

49 Hierarchical organization of rat visual areas Anterior Adapted from Sereno & Allaman (1991) Medial Lateral AM M A Posterior P1/2 RL AL LI LL LM V1 Adapted from Coogan & Burkhalter (1993)

50 Hierarchical organization of rat visual areas the object processing pathway Anterior Adapted from Sereno & Allaman (1991) Medial Lateral AM M A Posterior P1/2 RL AL LI LL LM V1 Adapted from Coogan & Burkhalter (1993)

51 Experimental design 1. multi-electrode recordings in anesthetized rats Insertion track

52 Experimental design 2. stimulus set and presentation

53 Experimental design 2. stimulus set and presentation

54 Experimental design 2. stimulus set and presentation RSVP: Rapid Sequence Visual Presentation

55 Experimental design 3. receptive fields mapping RF size Spikes/s 5 10º long moving bars presented over a 6x11 grid

56 Results: basic properties 1. receptive field size increases from V1 to LL

57 V1 Results: basic properties 1. receptive field size increases from V1 to LL

58 Results: basic properties 1. receptive field size increases from V1 to LL V1 LM

59 Results: basic properties 1. receptive field size increases from V1 to LL V1 LM LI

60 Results: basic properties 1. receptive field size increases from V1 to LL V1 LM LI LL

61 Results: basic properties 1. receptive field size increases from V1 to LL RF size

62 Results: basic properties 1. receptive field size increases from V1 to LL RF size

63 Results: basic properties 1. receptive field size increases from V1 to LL 3. latency increases from V1 to LL RF size Latency

64 Results: basic properties 1. receptive field size increases from V1 to LL 2. latency increases from V1 to LL Processing hierarchy AM M A P1/2 RL AL LI LL LM V1

65 Results: basic properties 1. receptive field size increases from V1 to LL 2. latency increases from V1 to LL The monkey ventral stream Latency RF size AIT ms 2.5º-70º Processing hierarchy AM M A PIT P1/2 RL AL LI LL LM V1 V ms 0.5º-1.5º Adapted from Rousselet et al. (2004)

66 Results: basic properties 1. receptive field size increases from V1 to LL 2. latency increases from V1 to LL Tuning complexity Latency The monkey ventral stream RF size AIT ms 2.5º-70º PIT V ms 0.5º-1.5º Adapted from Rousselet et al. (2004)

67 Shape processing & invariant recognition V1 representation? Low-level representation LL representation? High-level representation r 1 r 1 car r 2 r 2 r N r 4 r 3 r N r 4 r 3

68 The approach: 1. mutual information between stimulus and response 2. decoding stimulus identity using machine learning Quiroga & Panzeri (2009)

69 Examples of neuronal tuning very effective object poorly effective object V1 neuron

70 Examples of neuronal tuning V1 neuron LL neuron

71 object identity object identity Examples of neuronal tuning Two sources of modulation of neuronal firing rate: 1. variation in object transformation T 2. variation in object identity O object transformation object transformation V1 neuron LL neuron

72 Probability First question: total information per neuron across visual areas How much information do neurons carry about the identity of all our object views? all object views treated as independent stimuli stimulus: vs vs vs vs response: Response (firing rate)

73 Probability First question: total information per neuron across visual areas How much information do neurons carry about the identity of all our object views? all object views treated as independent stimuli stimulus: vs vs vs vs response: Response (firing rate)

74 First question: total information per neuron across visual areas How much information do neurons carry about the identity of all our object views? Approach: Compute mutual information between stimulus and response: S = stimulus = O & T

75 Mutual information: results 1. stimulus information across visual areas

76 Mutual information: results 1. stimulus information across visual areas

77 Mutual information: conclusions 1. Mutual information between neuronal response and individual stimulus conditions decreases from V1 to LL

78 Mutual information: conclusions 1. Mutual information between neuronal response and individual stimulus conditions decreases from V1 to LL consistent with the existence of a processing hierarchy AM M A P1/2 RL AL LI LL LM V1

79 Second question: what kind of information do neurons code? lowest-level visual attributes overall luminance/contrast low luminance high luminance oriented edges & corners luminance patches curved boundaries higher-order features

80 Variation of luminous energy 1. neuronal sensitivity to object transformations 2. neuronal selectivity for object identity sensitivity to transformation could explain: object selectivity V1 neuron LL neuron

81 Effective RF luminance: the luminous energy impinged by a stimulus on a neuronal RF dot product Effective RF luminance

82 Dependence of neuronal firing on RF luminance sensitivity to transformation object selectivity V1 neuron

83 Dependence of neuronal firing on RF luminance bin #1 bin #2 bin #3 bin #4 bin #N-1 bin #N S7 S 8 S 9 S 1 S 2 S 3 S 230 S 229 Effective RF luminance Take every stimulus S i (10 objects x 23 transformations) and: 1. Compute the corresponding RF luminance value 2. Bin the resulting luminance axis in N equipopulated bins V1 neuron LL neuron

84 Dependence of neuronal firing on RF luminance bin #1 bin #2 bin #3 bin #4 bin #N-1 bin #N S7 S 8 S 9 S 1 S 2 S 3 S 230 S 229 Effective RF luminance V1 neuron

85 Dependence of neuronal firing on RF luminance LL neuron V1 neuron

86 Dependence of neuronal firing on RF luminance LL neuron V1 neuron

87 Second question: what kind of information do neurons code? What fraction of information do neurons carry about the overall luminance/contrast of visual objects? What fraction of information do neurons carry about higher-order features? higher-order = everything not accounted by luminance alone

88 Second question: what kind of information do neurons code? What fraction of information do neurons carry about the overall luminance/contrast of visual objects? What fraction of information do neurons carry about higher-order features? RF L = RF luminance S = object identity defined by higher-order features S = stimulus = S & L I(R; S) = I(R; S &L) = I(R; S L) + I(R; L)

89 Second question: what kind of information do neurons code? What fraction of information do neurons carry about the overall luminance/contrast of visual objects? What fraction of information do neurons carry about higher-order features? RF L = RF luminance S = object identity defined by higher-order features S = stimulus = S & L I(R; S) = I(R; S &L) = I(R; S L) + I(R; L) higher-order information luminance information

90 Mutual information: results 2. fraction of higher-order information I(R; S &L) = I(R; S L) + I(R; L) I(R; S &L) total information

91 Mutual information: results 2. fraction of higher-order information I(R; S &L) = I(R; S L) + I(R; L) I(R; L) luminance information I(R; S L) higher-order information

92 Mutual information: results 2. fraction of higher-order information Fraction of information about object higherorder features: f high = I(R;S' L) I(R;S'& L)

93 Mutual information: conclusions 1. Mutual information between neuronal response and individual stimulus conditions decreases from V1 to LL consistent with the existence of a processing hierarchy 2. The fraction of information carried by neurons about higher-order features increases from V1 to LL consistent with formation of higher-order representations

94 Third question: how view-invariant is object information? face (many views) rat (many views) Take a pair of objects: O = {o i,o j } Take multiple transformations per object: T = {t 1,, t 23 } Define each stimulus (object view) as: S = O & T Decompose the total stimulus information as: I(R; S) = I(R; O&T) = I(R; T O) + I(R; O) total information

95 Third question: how view-invariant is object information? face (many views) rat (many views) Take a pair of objects: O = {o i,o j } Take multiple transformations per object: T = {t 1,, t 23 } Define each stimulus (object view) as: S = O & T Decompose the total stimulus information as: I(R; S) = I(R; O&T) = I(R; T O) + I(R; O) total information view-specific information view-invariant information

96 Third question: how view-invariant is object information? I(R; S) = I(R; O&T) = I(R; T O) + I(R; O) total information view-invariant information

97 Mutual information: results 3. view-invariant object information view-invariant information fraction of viewinvariant information

98 Mutual information: results 3. view-invariant object information view-invariant information fraction of viewinvariant information

99 Mutual information: conclusions 1. Mutual information between neuronal response and individual stimulus conditions decreases from V1 to LL 2. The fraction of information carried by neurons about higher-order features increases from V1 to LL 3. The view-invariant object information per neuron increases from V1 to LL consistent with formation of invariant representations

100 The approach: 1. mutual information between stimulus and response 2. decoding stimulus identity using machine learning Quiroga & Panzeri (2009)

101 The approach: 1. mutual information between stimulus and response 2. decoding stimulus identity using machine learning Quiroga & Panzeri (2009) mutual information upper bound to how well we can reconstruct a stimulus property (e.g., object luminance or identity) from observing a neuronal response

102 The approach: 1. mutual information between stimulus and response 2. decoding stimulus identity using machine learning decoding how easily a stimulus property (e.g., object identity) can be read out from the neuronal response? Quiroga & Panzeri (2009) mutual information upper bound to how well we can reconstruct a stimulus property (e.g., object luminance or identity) from observing a neuronal response

103 Forth question: how easily readable is object identity?

104 Forth question: how easily readable is object identity?

105 Forth question: how easily readable is object identity? face (many views) rat (many views) Take a pair of objects Take multiple views of each object Key question:

106 Forth question: how easily readable is object identity? face (many views) rat (many views) Vs. Take a pair of objects Take multiple views of each object Key question: If: a decoder learns to discriminate two views of these objects then: does it generalize to any other pair of views? Goodness of a representation to support invariant recognition

107 Good vs. bad representations: how easily readable is object identity?

108 Probability Good vs. bad representations: how easily readable is object identity? Vs. Spike count

109 Probability Good vs. bad representations: how easily readable is object identity? Vs. decision boundary Spike count

110 Probability Good vs. bad representations: how easily readable is object identity? Vs. decision boundary Bad representation Spike count

111 Probability Good vs. bad representations: how easily readable is object identity? Vs. Spike count

112 Probability Good vs. bad representations: how easily readable is object identity? Vs. decision boundary Spike count

113 Probability Good vs. bad representations: how easily readable is object identity? Vs. Good representation decision boundary Spike count

114 Probability Probability Method: measure generalization of recognition performance Train the decoder Test the decoder decision boundary Test decision boundary Spike count Spike count

115 Single-cell decoding: results generalization to novel object views

116 Single-cell decoding: results generalization to novel object views

117 Single-cell decoding: results generalization to novel object views

118 Single-cell decoding: results generalization to novel object views

119 Single-cell decoding: results generalization to novel object views

120 Decoding: conclusions 1. Coding of object identity becomes more invariant to transformation from V1 to LL consistent with formation of invariant representations

121 Last question: invariant recognition at the neuronal population level Discrimination performance (bits) Discrimination performance (% correct) Can we observe macroscopic differences at the neuronal population level?

122 Last question: invariant recognition at the neuronal population level

123 Last question: invariant recognition at the neuronal population level

124 Last question: invariant recognition at the neuronal population level

125 Last question: invariant recognition at the neuronal population level

126 Last question: invariant recognition at the neuronal population level

127 Last question: invariant recognition at the neuronal population level

128 Last question: invariant recognition at the neuronal population level

129 Last question: invariant recognition at the neuronal population level

130 Last question: invariant recognition at the neuronal population level

131 Decoding: conclusions 1. Coding of object identity becomes more invariant to transformation from V1 to LL At both the single-cell and neuronal population level Consistent with formation of invariant representations

132 Perceived similarity (priming magnitude) Rats are interesting models of object vision Behavior Neurophysiology

133 Acknowledgements Sina Tafazoli Alessandro Di Filippo Alireza Alemi-Neissi Federica Rosselli Gioa De Franceschi Margherita Riggi Federica Buffolo David Cox Nadja Oertelt James DiCarlo Bold font = first authors or co-authors Houman Safaai Stefano Panzeri

134 Acknowledgements

135 Experimental design 4. identification of visual cortical areas Base: ch. 32 recording area (32 sites) Tip: ch. 1

136 Experimental design 4. identification of visual cortical areas Nasal RF maps Temporal Base: ch. 32 recording area (32 sites) RF centers Tip: ch. 1

137 Experimental design 4. identification of visual cortical areas Nasal RF maps Temporal Base: ch. 32 recording area (32 sites) RF centers Tip: ch. 1

138 Experimental design 4. identification of visual cortical areas Nasal RF maps Temporal Base: ch. 32 recording area (32 sites) RF centers Tip: ch. 1

139 Experimental design 4. identification of visual cortical areas Nasal RF maps Temporal Base: ch. 32 recording area (32 sites) RF centers Tip: ch. 1

140 Experimental design 4. identification of visual cortical areas Nasal RF maps Temporal Base: ch. 32 recording area (32 sites) RF centers Tip: ch. 1

141 The confound of luminance tuning object selectivity V1 neuron LL neuron LL neuron

142 The confound of luminance tuning V1 neuron LL neuron

143 The confound of luminance tuning V1 neuron LL neuron

144 The confound of luminance tuning V1 neuron LL neuron

145 The confound of luminance tuning V1 neuron LL neuron

146 The confound of luminance tuning apparent invariance real invariance V1 neuron LL neuron

147 Decoding: results (after matching RF luminance)

148 Decoding: results (after matching RF luminance)

149 Decoding: results (after matching RF luminance)

150 Decoding: results (after matching RF luminance) LI & LM LL & V1

151 Decoding: results (after matching RF luminance) LI LM LL V1

152 Decoding: results (after matching RF luminance) LI LM LL V1

153 Decoding: results (after matching RF luminance) LL LI LM V1

154 Decoding: results (after matching RF luminance) LL LI LM V1

155 Decoding: conclusions 1. Coding of object identity becomes more invariant to transformation from V1 to LL consistent with formation of invariant representations

156 Decoding: results 2. superficial vs. deep cortical layers

157 Decoding: results 2. superficial vs. deep cortical layers recordings from deep layers

158 Decoding: results 2. superficial vs. deep cortical layers recordings from superficial layers recordings from deep layers

159 Decoding: results 2. superficial vs. deep cortical layers

160 Decoding: results 3. individual variation axes

161 Decoding: results 3. individual variation axes

162 Decoding: results 3. individual variation axes

163 Decoding: results 4. parametric position changes

164 Decoding: conclusions 1. Mutual information between neuronal response and individual stimulus conditions decreases from V1 to LL 2. The fraction of information carried by neurons about shape attributes increases from V1 to LL 3. Coding of object identity becomes more invariant to transformation from V1 to LL consistent with formation of invariant representations

From feedforward vision to natural vision: The impact of free viewing and clutter on monkey inferior temporal object representations

From feedforward vision to natural vision: The impact of free viewing and clutter on monkey inferior temporal object representations From feedforward vision to natural vision: The impact of free viewing and clutter on monkey inferior temporal object representations James DiCarlo The McGovern Institute for Brain Research Department of

More information

Information and neural computations

Information and neural computations Information and neural computations Why quantify information? We may want to know which feature of a spike train is most informative about a particular stimulus feature. We may want to know which feature

More information

Reading Assignments: Lecture 5: Introduction to Vision. None. Brain Theory and Artificial Intelligence

Reading Assignments: Lecture 5: Introduction to Vision. None. Brain Theory and Artificial Intelligence Brain Theory and Artificial Intelligence Lecture 5:. Reading Assignments: None 1 Projection 2 Projection 3 Convention: Visual Angle Rather than reporting two numbers (size of object and distance to observer),

More information

Adventures into terra incognita

Adventures into terra incognita BEWARE: These are preliminary notes. In the future, they will become part of a textbook on Visual Object Recognition. Chapter VI. Adventures into terra incognita In primary visual cortex there are neurons

More information

Just One View: Invariances in Inferotemporal Cell Tuning

Just One View: Invariances in Inferotemporal Cell Tuning Just One View: Invariances in Inferotemporal Cell Tuning Maximilian Riesenhuber Tomaso Poggio Center for Biological and Computational Learning and Department of Brain and Cognitive Sciences Massachusetts

More information

Object recognition and hierarchical computation

Object recognition and hierarchical computation Object recognition and hierarchical computation Challenges in object recognition. Fukushima s Neocognitron View-based representations of objects Poggio s HMAX Forward and Feedback in visual hierarchy Hierarchical

More information

THE ENCODING OF PARTS AND WHOLES

THE ENCODING OF PARTS AND WHOLES THE ENCODING OF PARTS AND WHOLES IN THE VISUAL CORTICAL HIERARCHY JOHAN WAGEMANS LABORATORY OF EXPERIMENTAL PSYCHOLOGY UNIVERSITY OF LEUVEN, BELGIUM DIPARTIMENTO DI PSICOLOGIA, UNIVERSITÀ DI MILANO-BICOCCA,

More information

using deep learning models to understand visual cortex

using deep learning models to understand visual cortex using deep learning models to understand visual cortex 11-785 Introduction to Deep Learning Fall 2017 Michael Tarr Department of Psychology Center for the Neural Basis of Cognition this lecture A bit out

More information

Functional Specialization of Seven Mouse Visual Cortical Areas

Functional Specialization of Seven Mouse Visual Cortical Areas Article Functional Specialization of Seven Mouse Visual Cortical Areas James H. Marshel, 1,2,3 Marina E. Garrett, 1,2,3 Ian Nauhaus, 1 and Edward M. Callaway 1,2, * 1 Systems Neurobiology Laboratories,

More information

2/3/17. Visual System I. I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex

2/3/17. Visual System I. I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex 1 Visual System I I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex 2 1 2/3/17 Window of the Soul 3 Information Flow: From Photoreceptors

More information

Prof. Greg Francis 7/31/15

Prof. Greg Francis 7/31/15 s PSY 200 Greg Francis Lecture 06 How do you recognize your grandmother? Action potential With enough excitatory input, a cell produces an action potential that sends a signal down its axon to other cells

More information

Modeling the Deployment of Spatial Attention

Modeling the Deployment of Spatial Attention 17 Chapter 3 Modeling the Deployment of Spatial Attention 3.1 Introduction When looking at a complex scene, our visual system is confronted with a large amount of visual information that needs to be broken

More information

Chapter 7: First steps into inferior temporal cortex

Chapter 7: First steps into inferior temporal cortex BEWARE: These are preliminary notes. In the future, they will become part of a textbook on Visual Object Recognition. Chapter 7: First steps into inferior temporal cortex Inferior temporal cortex (ITC)

More information

Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition

Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Charles F. Cadieu, Ha Hong, Daniel L. K. Yamins, Nicolas Pinto, Diego Ardila, Ethan A. Solomon, Najib

More information

Retinotopy & Phase Mapping

Retinotopy & Phase Mapping Retinotopy & Phase Mapping Fani Deligianni B. A. Wandell, et al. Visual Field Maps in Human Cortex, Neuron, 56(2):366-383, 2007 Retinotopy Visual Cortex organised in visual field maps: Nearby neurons have

More information

Cue-invariant shape recognition in rats as tested with secondorder

Cue-invariant shape recognition in rats as tested with secondorder Journal of Vision (2015) 15(15):14, 1 15 1 Cue-invariant shape recognition in rats as tested with secondorder contours Laboratory of Biological Psychology, University of Leuven Roxane De Keyser* (KU Leuven),

More information

Commentary on Moran and Desimone's 'spotlight in V4

Commentary on Moran and Desimone's 'spotlight in V4 Anne B. Sereno 1 Commentary on Moran and Desimone's 'spotlight in V4 Anne B. Sereno Harvard University 1990 Anne B. Sereno 2 Commentary on Moran and Desimone's 'spotlight in V4' Moran and Desimone's article

More information

Overview of the visual cortex. Ventral pathway. Overview of the visual cortex

Overview of the visual cortex. Ventral pathway. Overview of the visual cortex Overview of the visual cortex Two streams: Ventral What : V1,V2, V4, IT, form recognition and object representation Dorsal Where : V1,V2, MT, MST, LIP, VIP, 7a: motion, location, control of eyes and arms

More information

Neuroscience Tutorial

Neuroscience Tutorial Neuroscience Tutorial Brain Organization : cortex, basal ganglia, limbic lobe : thalamus, hypothal., pituitary gland : medulla oblongata, midbrain, pons, cerebellum Cortical Organization Cortical Organization

More information

V1 (Chap 3, part II) Lecture 8. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017

V1 (Chap 3, part II) Lecture 8. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017 V1 (Chap 3, part II) Lecture 8 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017 Topography: mapping of objects in space onto the visual cortex contralateral representation

More information

Analysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014

Analysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014 Analysis of in-vivo extracellular recordings Ryan Morrill Bootcamp 9/10/2014 Goals for the lecture Be able to: Conceptually understand some of the analysis and jargon encountered in a typical (sensory)

More information

arxiv: v1 [cs.cv] 2 Oct 2018

arxiv: v1 [cs.cv] 2 Oct 2018 arxiv:1810.01193v1 [cs.cv] 2 Oct 2018 Characterization of Visual Object Representations in Rat Primary Visual Cortex Sebastiano Vascon 1,2, [0000 0002 7855 1641], Ylenia Parin 1,, Eis Annavini 3, [0000

More information

Key questions about attention

Key questions about attention Key questions about attention How does attention affect behavioral performance? Can attention affect the appearance of things? How does spatial and feature-based attention affect neuronal responses in

More information

EDGE DETECTION. Edge Detectors. ICS 280: Visual Perception

EDGE DETECTION. Edge Detectors. ICS 280: Visual Perception EDGE DETECTION Edge Detectors Slide 2 Convolution & Feature Detection Slide 3 Finds the slope First derivative Direction dependent Need many edge detectors for all orientation Second order derivatives

More information

Contextual Influences in Visual Processing

Contextual Influences in Visual Processing C Contextual Influences in Visual Processing TAI SING LEE Computer Science Department and Center for Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA Synonyms Surround influence;

More information

A Neurally-Inspired Model for Detecting and Localizing Simple Motion Patterns in Image Sequences

A Neurally-Inspired Model for Detecting and Localizing Simple Motion Patterns in Image Sequences A Neurally-Inspired Model for Detecting and Localizing Simple Motion Patterns in Image Sequences Marc Pomplun 1, Yueju Liu 2, Julio Martinez-Trujillo 2, Evgueni Simine 2, and John K. Tsotsos 2 1 Department

More information

Memory, Attention, and Decision-Making

Memory, Attention, and Decision-Making Memory, Attention, and Decision-Making A Unifying Computational Neuroscience Approach Edmund T. Rolls University of Oxford Department of Experimental Psychology Oxford England OXFORD UNIVERSITY PRESS Contents

More information

Introduction to sensory pathways. Gatsby / SWC induction week 25 September 2017

Introduction to sensory pathways. Gatsby / SWC induction week 25 September 2017 Introduction to sensory pathways Gatsby / SWC induction week 25 September 2017 Studying sensory systems: inputs and needs Stimulus Modality Robots Sensors Biological Sensors Outputs Light Vision Photodiodes

More information

Position invariant recognition in the visual system with cluttered environments

Position invariant recognition in the visual system with cluttered environments PERGAMON Neural Networks 13 (2000) 305 315 Contributed article Position invariant recognition in the visual system with cluttered environments S.M. Stringer, E.T. Rolls* Oxford University, Department of

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single

More information

Visual Categorization: How the Monkey Brain Does It

Visual Categorization: How the Monkey Brain Does It Visual Categorization: How the Monkey Brain Does It Ulf Knoblich 1, Maximilian Riesenhuber 1, David J. Freedman 2, Earl K. Miller 2, and Tomaso Poggio 1 1 Center for Biological and Computational Learning,

More information

Neural codes PSY 310 Greg Francis. Lecture 12. COC illusion

Neural codes PSY 310 Greg Francis. Lecture 12. COC illusion Neural codes PSY 310 Greg Francis Lecture 12 Is 100 billion neurons enough? COC illusion The COC illusion looks like real squares because the neural responses are similar True squares COC squares Ganglion

More information

Lateral Geniculate Nucleus (LGN)

Lateral Geniculate Nucleus (LGN) Lateral Geniculate Nucleus (LGN) What happens beyond the retina? What happens in Lateral Geniculate Nucleus (LGN)- 90% flow Visual cortex Information Flow Superior colliculus 10% flow Slide 2 Information

More information

LISC-322 Neuroscience Cortical Organization

LISC-322 Neuroscience Cortical Organization LISC-322 Neuroscience Cortical Organization THE VISUAL SYSTEM Higher Visual Processing Martin Paré Assistant Professor Physiology & Psychology Most of the cortex that covers the cerebral hemispheres is

More information

Neural basis of shape representation in the primate brain

Neural basis of shape representation in the primate brain Martinez-Conde, Macknik, Martinez, Alonso & Tse (Eds.) Progress in Brain Research, Vol. 154 ISSN 79-6123 Copyright r 26 Elsevier B.V. All rights reserved CHAPTER 16 Neural basis of shape representation

More information

Evidence that the ventral stream codes the errors used in hierarchical inference and learning Running title: Error coding in the ventral stream

Evidence that the ventral stream codes the errors used in hierarchical inference and learning Running title: Error coding in the ventral stream 1 2 3 4 5 6 7 8 9 1 11 12 13 14 15 16 17 18 19 2 21 22 23 24 25 26 27 28 29 3 31 32 33 34 35 36 37 38 39 4 41 42 43 44 45 46 47 48 49 Evidence that the ventral stream codes the errors used in hierarchical

More information

Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex

Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex 12292 The Journal of Neuroscience, November 7, 2007 27(45):12292 12307 Behavioral/Systems/Cognitive Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex Davide Zoccolan, Minjoon

More information

Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser.

Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser. Statistically optimal perception and learning: from behavior to neural representations. Fiser, Berkes, Orban & Lengyel Trends in Cognitive Sciences (2010) Spontaneous Cortical Activity Reveals Hallmarks

More information

Experimental Design. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems

Experimental Design. Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Experimental Design Thomas Wolbers Space and Aging Laboratory Centre for Cognitive and Neural Systems Overview Design of functional neuroimaging studies Categorical designs Factorial designs Parametric

More information

Cognitive Modelling Themes in Neural Computation. Tom Hartley

Cognitive Modelling Themes in Neural Computation. Tom Hartley Cognitive Modelling Themes in Neural Computation Tom Hartley t.hartley@psychology.york.ac.uk Typical Model Neuron x i w ij x j =f(σw ij x j ) w jk x k McCulloch & Pitts (1943), Rosenblatt (1957) Net input:

More information

Deconstructing the Receptive Field: Information Coding in Macaque area MST

Deconstructing the Receptive Field: Information Coding in Macaque area MST : Information Coding in Macaque area MST Bart Krekelberg, Monica Paolini Frank Bremmer, Markus Lappe, Klaus-Peter Hoffmann Ruhr University Bochum, Dept. Zoology & Neurobiology ND7/30, 44780 Bochum, Germany

More information

Single cell tuning curves vs population response. Encoding: Summary. Overview of the visual cortex. Overview of the visual cortex

Single cell tuning curves vs population response. Encoding: Summary. Overview of the visual cortex. Overview of the visual cortex Encoding: Summary Spikes are the important signals in the brain. What is still debated is the code: number of spikes, exact spike timing, temporal relationship between neurons activities? Single cell tuning

More information

Extrastriate Visual Areas February 27, 2003 A. Roe

Extrastriate Visual Areas February 27, 2003 A. Roe Extrastriate Visual Areas February 27, 2003 A. Roe How many extrastriate areas are there? LOTS!!! Macaque monkey flattened cortex Why? How do we know this? Topography Functional properties Connections

More information

PHY3111 Mid-Semester Test Study. Lecture 2: The hierarchical organisation of vision

PHY3111 Mid-Semester Test Study. Lecture 2: The hierarchical organisation of vision PHY3111 Mid-Semester Test Study Lecture 2: The hierarchical organisation of vision 1. Explain what a hierarchically organised neural system is, in terms of physiological response properties of its neurones.

More information

Explicit information for category-orthogonal object properties increases along the ventral stream

Explicit information for category-orthogonal object properties increases along the ventral stream Explicit information for category-orthogonal object properties increases along the ventral stream Ha Hong 3,5, Daniel L K Yamins,2,5, Najib J Majaj,2,4 & James J DiCarlo,2 Extensive research has revealed

More information

Lecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods )

Lecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) Lecture overview What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) 1 Lecture overview What hypothesis to test in the fly? Quantitative data collection

More information

Ch 5. Perception and Encoding

Ch 5. Perception and Encoding Ch 5. Perception and Encoding Cognitive Neuroscience: The Biology of the Mind, 2 nd Ed., M. S. Gazzaniga, R. B. Ivry, and G. R. Mangun, Norton, 2002. Summarized by Y.-J. Park, M.-H. Kim, and B.-T. Zhang

More information

Neural Coding. Computing and the Brain. How Is Information Coded in Networks of Spiking Neurons?

Neural Coding. Computing and the Brain. How Is Information Coded in Networks of Spiking Neurons? Neural Coding Computing and the Brain How Is Information Coded in Networks of Spiking Neurons? Coding in spike (AP) sequences from individual neurons Coding in activity of a population of neurons Spring

More information

Ch 5. Perception and Encoding

Ch 5. Perception and Encoding Ch 5. Perception and Encoding Cognitive Neuroscience: The Biology of the Mind, 2 nd Ed., M. S. Gazzaniga,, R. B. Ivry,, and G. R. Mangun,, Norton, 2002. Summarized by Y.-J. Park, M.-H. Kim, and B.-T. Zhang

More information

Edmund T. Rolls T. Milward Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England

Edmund T. Rolls T. Milward Oxford University, Department of Experimental Psychology, Oxford OX1 3UD, England LETTER Communicated by Laurenz Wiskott A Model of Invariant Object Recognition in the Visual System: Learning Rules, Activation Functions, Lateral Inhibition, and Information-Based Performance Measures

More information

Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load

Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load Intro Examine attention response functions Compare an attention-demanding

More information

Neural circuits PSY 310 Greg Francis. Lecture 05. Rods and cones

Neural circuits PSY 310 Greg Francis. Lecture 05. Rods and cones Neural circuits PSY 310 Greg Francis Lecture 05 Why do you need bright light to read? Rods and cones Photoreceptors are not evenly distributed across the retina 1 Rods and cones Cones are most dense in

More information

On the implementation of Visual Attention Architectures

On the implementation of Visual Attention Architectures On the implementation of Visual Attention Architectures KONSTANTINOS RAPANTZIKOS AND NICOLAS TSAPATSOULIS DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING NATIONAL TECHNICAL UNIVERSITY OF ATHENS 9, IROON

More information

Models of Attention. Models of Attention

Models of Attention. Models of Attention Models of Models of predictive: can we predict eye movements (bottom up attention)? [L. Itti and coll] pop out and saliency? [Z. Li] Readings: Maunsell & Cook, the role of attention in visual processing,

More information

CS294-6 (Fall 2004) Recognizing People, Objects and Actions Lecture: January 27, 2004 Human Visual System

CS294-6 (Fall 2004) Recognizing People, Objects and Actions Lecture: January 27, 2004 Human Visual System CS294-6 (Fall 2004) Recognizing People, Objects and Actions Lecture: January 27, 2004 Human Visual System Lecturer: Jitendra Malik Scribe: Ryan White (Slide: layout of the brain) Facts about the brain:

More information

The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes

The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes The Journal of Neuroscience, January 1, 2003 23(1):339 348 339 The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes Edmund T. Rolls, Nicholas C. Aggelopoulos, and Fashan Zheng University

More information

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns 1. Introduction Vasily Morzhakov, Alexey Redozubov morzhakovva@gmail.com, galdrd@gmail.com Abstract Cortical

More information

Cognitive Neuroscience Attention

Cognitive Neuroscience Attention Cognitive Neuroscience Attention There are many aspects to attention. It can be controlled. It can be focused on a particular sensory modality or item. It can be divided. It can set a perceptual system.

More information

Continuous transformation learning of translation invariant representations

Continuous transformation learning of translation invariant representations Exp Brain Res (21) 24:255 27 DOI 1.17/s221-1-239- RESEARCH ARTICLE Continuous transformation learning of translation invariant representations G. Perry E. T. Rolls S. M. Stringer Received: 4 February 29

More information

The Integration of Features in Visual Awareness : The Binding Problem. By Andrew Laguna, S.J.

The Integration of Features in Visual Awareness : The Binding Problem. By Andrew Laguna, S.J. The Integration of Features in Visual Awareness : The Binding Problem By Andrew Laguna, S.J. Outline I. Introduction II. The Visual System III. What is the Binding Problem? IV. Possible Theoretical Solutions

More information

OPTO 5320 VISION SCIENCE I

OPTO 5320 VISION SCIENCE I OPTO 5320 VISION SCIENCE I Monocular Sensory Processes of Vision: Color Vision Mechanisms of Color Processing . Neural Mechanisms of Color Processing A. Parallel processing - M- & P- pathways B. Second

More information

M Cells. Why parallel pathways? P Cells. Where from the retina? Cortical visual processing. Announcements. Main visual pathway from retina to V1

M Cells. Why parallel pathways? P Cells. Where from the retina? Cortical visual processing. Announcements. Main visual pathway from retina to V1 Announcements exam 1 this Thursday! review session: Wednesday, 5:00-6:30pm, Meliora 203 Bryce s office hours: Wednesday, 3:30-5:30pm, Gleason https://www.youtube.com/watch?v=zdw7pvgz0um M Cells M cells

More information

Perceptual Grouping in a Self-Organizing Map of Spiking Neurons

Perceptual Grouping in a Self-Organizing Map of Spiking Neurons Perceptual Grouping in a Self-Organizing Map of Spiking Neurons Yoonsuck Choe Department of Computer Sciences The University of Texas at Austin August 13, 2001 Perceptual Grouping Group Two! Longest Contour?

More information

Electrophysiological and firing properties of neurons: categorizing soloists and choristers in primary visual cortex

Electrophysiological and firing properties of neurons: categorizing soloists and choristers in primary visual cortex *Manuscript Click here to download Manuscript: Manuscript revised.docx Click here to view linked Referenc Electrophysiological and firing properties of neurons: categorizing soloists and choristers in

More information

Consciousness The final frontier!

Consciousness The final frontier! Consciousness The final frontier! How to Define it??? awareness perception - automatic and controlled memory - implicit and explicit ability to tell us about experiencing it attention. And the bottleneck

More information

Biological Bases of Behavior. 6: Vision

Biological Bases of Behavior. 6: Vision Biological Bases of Behavior 6: Vision Sensory Systems The brain detects events in the external environment and directs the contractions of the muscles Afferent neurons carry sensory messages to brain

More information

Motor Systems I Cortex. Reading: BCP Chapter 14

Motor Systems I Cortex. Reading: BCP Chapter 14 Motor Systems I Cortex Reading: BCP Chapter 14 Principles of Sensorimotor Function Hierarchical Organization association cortex at the highest level, muscles at the lowest signals flow between levels over

More information

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION doi:10.1038/nature14066 Supplementary discussion Gradual accumulation of evidence for or against different choices has been implicated in many types of decision-making, including value-based decisions

More information

Competing Frameworks in Perception

Competing Frameworks in Perception Competing Frameworks in Perception Lesson II: Perception module 08 Perception.08. 1 Views on perception Perception as a cascade of information processing stages From sensation to percept Template vs. feature

More information

Competing Frameworks in Perception

Competing Frameworks in Perception Competing Frameworks in Perception Lesson II: Perception module 08 Perception.08. 1 Views on perception Perception as a cascade of information processing stages From sensation to percept Template vs. feature

More information

Supplemental Material

Supplemental Material Supplemental Material Recording technique Multi-unit activity (MUA) was recorded from electrodes that were chronically implanted (Teflon-coated platinum-iridium wires) in the primary visual cortex representing

More information

Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision

Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision Guest&Lecture:&Marius&Cătălin&Iordan&& CS&131&8&Computer&Vision:&Foundations&and&Applications& 01&December&2014 1.

More information

The Visual System. Cortical Architecture Casagrande February 23, 2004

The Visual System. Cortical Architecture Casagrande February 23, 2004 The Visual System Cortical Architecture Casagrande February 23, 2004 Phone: 343-4538 Email: vivien.casagrande@mcmail.vanderbilt.edu Office: T2302 MCN Required Reading Adler s Physiology of the Eye Chapters

More information

Computational Principles of Cortical Representation and Development

Computational Principles of Cortical Representation and Development Computational Principles of Cortical Representation and Development Daniel Yamins In making sense of the world, brains actively reformat noisy and complex incoming sensory data to better serve the organism

More information

Morton-Style Factorial Coding of Color in Primary Visual Cortex

Morton-Style Factorial Coding of Color in Primary Visual Cortex Morton-Style Factorial Coding of Color in Primary Visual Cortex Javier R. Movellan Institute for Neural Computation University of California San Diego La Jolla, CA 92093-0515 movellan@inc.ucsd.edu Thomas

More information

Computer Science and Artificial Intelligence Laboratory Technical Report. July 29, 2010

Computer Science and Artificial Intelligence Laboratory Technical Report. July 29, 2010 Computer Science and Artificial Intelligence Laboratory Technical Report MIT-CSAIL-TR-2010-034 CBCL-289 July 29, 2010 Examining high level neural representations of cluttered scenes Ethan Meyers, Hamdy

More information

Using population decoding to understand neural content and coding

Using population decoding to understand neural content and coding Using population decoding to understand neural content and coding 1 Motivation We have some great theory about how the brain works We run an experiment and make neural recordings We get a bunch of data

More information

Geography of the Forehead

Geography of the Forehead 5. Brain Areas Geography of the Forehead Everyone thinks the brain is so complicated, but let s look at the facts. The frontal lobe, for example, is located in the front! And the temporal lobe is where

More information

Computational Explorations in Cognitive Neuroscience Chapter 7: Large-Scale Brain Area Functional Organization

Computational Explorations in Cognitive Neuroscience Chapter 7: Large-Scale Brain Area Functional Organization Computational Explorations in Cognitive Neuroscience Chapter 7: Large-Scale Brain Area Functional Organization 1 7.1 Overview This chapter aims to provide a framework for modeling cognitive phenomena based

More information

Chapter 5. Summary and Conclusions! 131

Chapter 5. Summary and Conclusions! 131 ! Chapter 5 Summary and Conclusions! 131 Chapter 5!!!! Summary of the main findings The present thesis investigated the sensory representation of natural sounds in the human auditory cortex. Specifically,

More information

Object recognition in cortex: Neural mechanisms, and possible roles for attention

Object recognition in cortex: Neural mechanisms, and possible roles for attention Object recognition in cortex: Neural mechanisms, and possible roles for attention Maximilian Riesenhuber Department of Neuroscience Georgetown University Medical Center Washington, DC 20007 phone: 202-687-9198

More information

eye as a camera Kandel, Schwartz & Jessel (KSJ), Fig 27-3

eye as a camera Kandel, Schwartz & Jessel (KSJ), Fig 27-3 eye as a camera Kandel, Schwartz & Jessel (KSJ), Fig 27-3 retinal specialization fovea: highest density of photoreceptors, aimed at where you are looking -> highest acuity optic disk: cell-free area, where

More information

COGS 101A: Sensation and Perception

COGS 101A: Sensation and Perception COGS 101A: Sensation and Perception 1 Virginia R. de Sa Department of Cognitive Science UCSD Lecture 6: Beyond V1 - Extrastriate cortex Chapter 4 Course Information 2 Class web page: http://cogsci.ucsd.edu/

More information

In Object Categorization: Computer and Human Vision Perspectives" edited by Sven

In Object Categorization: Computer and Human Vision Perspectives edited by Sven What has fmri Taught us About Object Recognition? Kalanit Grill-Spector Department of Psychology & Neuroscience Institute Stanford University, Stanford, CA, 94305 In Object Categorization: Computer and

More information

Neural Mechanisms Underlying Visual Object Recognition

Neural Mechanisms Underlying Visual Object Recognition Neural Mechanisms Underlying Visual Object Recognition ARASH AFRAZ, DANIEL L.K. YAMINS, AND JAMES J. DICARLO Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts

More information

Face Neurons. Chapter 4. Edmund T. Rolls. The discovery of face neurons

Face Neurons. Chapter 4. Edmund T. Rolls. The discovery of face neurons Chapter 4 Face Neurons Edmund T. Rolls The discovery of face neurons In 1976 we recorded from single neurons in the awake behaving non-human primate to investigate reward systems in the brain. We had shown

More information

Supplementary materials for: Executive control processes underlying multi- item working memory

Supplementary materials for: Executive control processes underlying multi- item working memory Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of

More information

Computations in the early visual cortex

Computations in the early visual cortex Journal of Physiology - Paris 97 (3) 121 139 www.elsevier.com/locate/jphysparis Computations in the early visual cortex Tai Sing Lee * Center for the Neural Basis of Cognition and Department of Computer

More information

Reading Assignments: Lecture 18: Visual Pre-Processing. Chapters TMB Brain Theory and Artificial Intelligence

Reading Assignments: Lecture 18: Visual Pre-Processing. Chapters TMB Brain Theory and Artificial Intelligence Brain Theory and Artificial Intelligence Lecture 18: Visual Pre-Processing. Reading Assignments: Chapters TMB2 3.3. 1 Low-Level Processing Remember: Vision as a change in representation. At the low-level,

More information

The perirhinal cortex and long-term familiarity memory

The perirhinal cortex and long-term familiarity memory THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY 2005, 58B (3/4), 234 245 The perirhinal cortex and long-term familiarity memory E. T. Rolls, L. Franco, and S. M. Stringer University of Oxford, UK To analyse

More information

Required Slide. Session Objectives

Required Slide. Session Objectives Vision: CNS 2018 Required Slide Session Objectives Visual system: CNS At the end of this session, students will be able to: 1. Understand how axons from the eyes travel through the optic nerves and tracts

More information

A quantitative theory of immediate visual recognition

A quantitative theory of immediate visual recognition A quantitative theory of immediate visual recognition Thomas Serre, Gabriel Kreiman, Minjoon Kouh, Charles Cadieu, Ulf Knoblich and Tomaso Poggio Center for Biological and Computational Learning McGovern

More information

arxiv: v1 [q-bio.nc] 12 Jun 2014

arxiv: v1 [q-bio.nc] 12 Jun 2014 1 arxiv:1406.3284v1 [q-bio.nc] 12 Jun 2014 Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Charles F. Cadieu 1,, Ha Hong 1,2, Daniel L. K. Yamins 1,

More information

Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence

Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence To understand the network paradigm also requires examining the history

More information

Visual Object Recognition Computational Models and Neurophysiological Mechanisms Neurobiology 130/230. Harvard College/GSAS 78454

Visual Object Recognition Computational Models and Neurophysiological Mechanisms Neurobiology 130/230. Harvard College/GSAS 78454 Visual Object Recognition Computational Models and Neurophysiological Mechanisms Neurobiology 130/230. Harvard College/GSAS 78454 Web site: http://tinyurl.com/visionclass (Class notes, readings, etc) Location:

More information

Orientation Specific Effects of Automatic Access to Categorical Information in Biological Motion Perception

Orientation Specific Effects of Automatic Access to Categorical Information in Biological Motion Perception Orientation Specific Effects of Automatic Access to Categorical Information in Biological Motion Perception Paul E. Hemeren (paul.hemeren@his.se) University of Skövde, School of Humanities and Informatics

More information

Pathway from the eye to the cortex

Pathway from the eye to the cortex Vision: CNS 2017 Pathway from the eye to the cortex Themes of this lecture Visual information is analyzed in more complicated ways than in the retina. One major pathway from the eye leads to the striate

More information

A Detailed Look at Scale and Translation Invariance in a Hierarchical Neural Model of Visual Object Recognition

A Detailed Look at Scale and Translation Invariance in a Hierarchical Neural Model of Visual Object Recognition @ MIT massachusetts institute of technology artificial intelligence laboratory A Detailed Look at Scale and Translation Invariance in a Hierarchical Neural Model of Visual Object Recognition Robert Schneider

More information

Plasticity of Cerebral Cortex in Development

Plasticity of Cerebral Cortex in Development Plasticity of Cerebral Cortex in Development Jessica R. Newton and Mriganka Sur Department of Brain & Cognitive Sciences Picower Center for Learning & Memory Massachusetts Institute of Technology Cambridge,

More information