Models of Attention. Models of Attention
|
|
- Quentin McDonald
- 5 years ago
- Views:
Transcription
1 Models of Models of predictive: can we predict eye movements (bottom up attention)? [L. Itti and coll] pop out and saliency? [Z. Li] Readings: Maunsell & Cook, the role of attention in visual processing, 22. Itti & Koch, Computational modeling of visual attention, Nat Rev Neurosci, 21. phenomenological : a simple unifying description? [Reynold and Heeger, 29] mechanistic : which circuits? [Z. Li, A. Compte] functional : deriving neural effects based on a computational principle? [Jaramillo and Pearlmutter] functional & Bayesian : can we think of attention as a prior? what is the role of attention in representing uncertainty? [Rao, Yu and Dayan] M. C. Escher, Balcony, 1945 Bottom-up : Saliency Maps and eye movements Itti s model and Prediction of eye movements What determines which stimuli are selected by the attentional process and which will be discarded? idea: There is a representation of a saliency map Saliency at a given location = how different this location is from its surround in color, orientation, motion, depth etc (Koch and Ullman, 1985, Itti et al. 1998) Selection in the map by Winner-Take-All mechanism. Followed by suppression of chosen location (`inhibition of return!) leading to selection of 2d highest value as next location. Alternative approaches to saliency : Bayesian surprise measure (e.g. Itti and Baldi 25 CVPR), and information-theoretic measures (e.g. Bruce and Tsotsos 26 NIPS; Najemnik and Geisler 25 Nature).
2 Itti s model and Prediction of eye movements Circuits of Bottom-up : V1 as a Saliency Map Anatomical localization of the saliency map(s)? Z. Li (22): V1 as a saliency map -- firing rates proportional to saliency. Effort to link anatomy, physiology (center-surround modulations) and psychophysics other applications: surveillance, automatic target detection, navigational aids and robotic control.&/)#12( "+$*+$(3%"4(,-(4"5/,-(4"5/,-("+$*+$' Highlighting important image locations, where translation invariance in inputs breaks down. 6(%1+%%#$(#$7"%8(7)$9(:#$%&; 1"%$)1&/(:#$&1$)"#'($9&$(<1+$'( 1"#$<$+&/()#3/+#1' )#*+$($"(,- Mechanisms of Bottom-Up P. Series et al. / Journal of Mechanisms of Bottom-Up Similarly the responses of V1 neurons are modulated by stimuli presented outside the receptive field. surround suppression, collinear facilitation, cross facilitation. Series et al, 23 The perception of an object depends on its surroundings (and its saliency) -- contextual modulations. Contour integration, segmentation, pop out. Series et al, 23
3 Mechanisms of Bottom-Up Mechanisms of Top-down : Ardid et al (27) Modeling the circuits involved in top down attention and making assumptions about top down signals Identify plausible circuit mechanisms that underlie gain modulation, scaling of tuning curve, biased competition. Ardid et al. Microcircuit Model of al Processing Series et al, 23 Long range horizontal connections in V1 are supposed to be involved. Numerous Modelling studies to relate the circuits, neural recordings, and psychophysics. Figure 2. Feature-based attention in model simulations for single motion stimulus. A, Network activity for an unattended (left) and an attended trial (right). x-axis, Time; y-axis, neurons labeled by preferred direction pref. Activity is color-coded. C, Cue period; D, delay period; T, test period. Calibration, 1 s. B, Activity of a neuron with pref S. Top, Sample membrane potential; middle,spiketrainsinseveraltrials;bottom,trial-averagedactivity(red,attended;black,unattendedtrials)(calibration:time,1s; voltage, 5 mv; rate, 4 Hz). C, Selective enhancement of MT population activity. The scheme (top) depicts how the curves (attended in red; unattended in black) were generated: for fixed test stimulus S and attended feature A, the activity of all neurons (blue arrows) were measured. D, Smoothed modulation ratio (firing rate with attention divided by that without atten- The Normalization Model of Reynolds & Heeger, 29: a single, unifying computational principle / phenomenological model of (top down) attention Aimed at reconciling seemingly contradictory claims: whether attention is a contrast gain, or response gain and whether it scales tuning curves, or changes width. Normalization model Linear weighting function Division Retinal image R(x, θ) = Rectification E(x, θ) s(x, θ) E(x, θ) + σ Firing rate Extension on previous model Reynolds, Pasternak, & Desimone, Neuron, 2 Williford & Maunsell, J Neurophysiol, 26 Other cortical cells A Firing Rate (Hz) B al modulation (%) Firing Rate (Hz) 66 C 8 33 % al Modulation al modulation (%) normalized response Heeger, Vis Neurosci, 1992 = unnormalized response unnormalized + "! responses Normalization model: responses of neurons are normalized by a signal that represents the mean activity of the local pool of neurons Explains contrast saturation, and many nonlinear suppressive effects observed in physiology.
4 Surround suppression & normalization Normalization model of attention Optimal diameter Surround diameter Response (imp/sec) l21.p Grating patch diameter (deg) Suppression CRF Surround kc Stimulus Excitatory field Excitatory drive al field X Response k s CRF Suppressive field Surround Cavanaugh, Bair & Movshon, J Neurophysiol, 22 Normalization model was extended to account for surround suppression the normalization pool creates a suppressive drive around receptive field (stimulus drive) Suppressive drive Idea: attentional field (whose size depends on subjects! strategy) modulates the excitatory field, before it is normalized. R(x, θ) = A(x, θ)e(x, θ) s(x, θ) A(x, θ)e(x, θ) + σ Small stimulus, large attention field Predominantly Contrast Gain 1 1 A Normalized Model Response al Modulation (%) c c + " " c " c + # =! c c + # / "! > 1 attentional gain affects excitatory drive and suppressive drive equally Log Contrast 15 Modulation 16
5 Large stimulus, small attention field Predominantly Response Gain 1 1 B Normalized Model Response Log Contrast al Modulation (%) c c + "c + # For c >>! " c " c + #c + $! > 1 attentional gain " For c >>! " " + # <! < 1 surround suppression Modulation Spatial attention scales tuning curve McAdams & Maunsell, J Neurosci, 1999 A B C 1. Normalized Response One stimulus within receptive field and the other contralateral..5. R(c,!) = "R(c)R(!) Normalized Response Model Separable function of contrast and orientation; change in response gain or contrast gain affects only R(c). Featural attention can sharpen tuning curves Response 4 Treue & Martinez-Trujillo, Nature, 1999 Attended Ignored Normalized Response Model Functional role of Gain Modulations: Fisher Information If adaptation is about increasing Fisher Information at the attended location, what should it do to tuning curves? Nakahara and Amari (21) Mathematical analysis -- optimization of FI with constraints : baseline activity and height of tuning curves increase together. predicts both increases and decreases of tuning curves amplitude Two stimuli moved same direction on each trial, one within receptive field, and other in opposite hemifield. Attend fixation or attend same motion in opposite hemifield. R(!) = "A(!)E(!) field Excitatory drive
6 !! Functional role of Gain Modulations: Task dependency If attention is about optimizing the task, the shape of gain modulations should vary with the task Reconstruction task (Jaramillo & Pearlmutter) Estimation Broad vs Fine Discrimination Estimation theory + constraints to derive optimal modulations. Functional role of Gain Modulations : Dependency on the Read-out s Adaptation! attention State! Population Response!! Encoder r Fixed! Decoder Decoder ŝ ( 1) P new (r s) Series et al 29 Optimization strategies and predictions for perception depend on the nature of the read-out If the read-out is unaware of the attentional modulation, the modulation is bound to produce changes in appearance (estimation) and in discrimination.
Attention March 4, 2009
Attention March 4, 29 John Maunsell Mitchell, JF, Sundberg, KA, Reynolds, JH (27) Differential attention-dependent response modulation across cell classes in macaque visual area V4. Neuron, 55:131 141.
More informationBottom-up and top-down processing in visual perception
Bottom-up and top-down processing in visual perception Thomas Serre Brown University Department of Cognitive & Linguistic Sciences Brown Institute for Brain Science Center for Vision Research The what
More informationVision Research 49 (2009) Contents lists available at ScienceDirect. Vision Research. journal homepage:
Vision Research 49 (29) 29 43 Contents lists available at ScienceDirect Vision Research journal homepage: www.elsevier.com/locate/visres A framework for describing the effects of attention on visual responses
More informationDynamic Visual Attention: Searching for coding length increments
Dynamic Visual Attention: Searching for coding length increments Xiaodi Hou 1,2 and Liqing Zhang 1 1 Department of Computer Science and Engineering, Shanghai Jiao Tong University No. 8 Dongchuan Road,
More informationOverview of the visual cortex. Ventral pathway. Overview of the visual cortex
Overview of the visual cortex Two streams: Ventral What : V1,V2, V4, IT, form recognition and object representation Dorsal Where : V1,V2, MT, MST, LIP, VIP, 7a: motion, location, control of eyes and arms
More informationReport. Attention Narrows Position Tuning of Population Responses in V1
Current Biology 19, 1356 1361, August 25, 2009 ª2009 Elsevier Ltd All rights reserved DOI 10.1016/j.cub.2009.06.059 Attention Narrows Position Tuning of Population Responses in V1 Report Jason Fischer
More informationKey questions about attention
Key questions about attention How does attention affect behavioral performance? Can attention affect the appearance of things? How does spatial and feature-based attention affect neuronal responses in
More informationSpatial and Feature-Based Attention in a Layered Cortical Microcircuit Model
Spatial and Feature-Based Attention in a Layered Cortical Microcircuit Model Nobuhiko Wagatsuma 1,2 *, Tobias C. Potjans 3,4,5, Markus Diesmann 2,4, Ko Sakai 6, Tomoki Fukai 2,4,7 1 Zanvyl Krieger Mind/Brain
More informationComputational Models of Visual Attention: Bottom-Up and Top-Down. By: Soheil Borhani
Computational Models of Visual Attention: Bottom-Up and Top-Down By: Soheil Borhani Neural Mechanisms for Visual Attention 1. Visual information enter the primary visual cortex via lateral geniculate nucleus
More informationComputational Cognitive Science
Computational Cognitive Science Lecture 15: Visual Attention Chris Lucas (Slides adapted from Frank Keller s) School of Informatics University of Edinburgh clucas2@inf.ed.ac.uk 14 November 2017 1 / 28
More informationSingle cell tuning curves vs population response. Encoding: Summary. Overview of the visual cortex. Overview of the visual cortex
Encoding: Summary Spikes are the important signals in the brain. What is still debated is the code: number of spikes, exact spike timing, temporal relationship between neurons activities? Single cell tuning
More informationOn the implementation of Visual Attention Architectures
On the implementation of Visual Attention Architectures KONSTANTINOS RAPANTZIKOS AND NICOLAS TSAPATSOULIS DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING NATIONAL TECHNICAL UNIVERSITY OF ATHENS 9, IROON
More informationComputational Cognitive Science. The Visual Processing Pipeline. The Visual Processing Pipeline. Lecture 15: Visual Attention.
Lecture 15: Visual Attention School of Informatics University of Edinburgh keller@inf.ed.ac.uk November 11, 2016 1 2 3 Reading: Itti et al. (1998). 1 2 When we view an image, we actually see this: The
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 11: Attention & Decision making Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis
More informationSpontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser.
Statistically optimal perception and learning: from behavior to neural representations. Fiser, Berkes, Orban & Lengyel Trends in Cognitive Sciences (2010) Spontaneous Cortical Activity Reveals Hallmarks
More information9.S913 SYLLABUS January Understanding Visual Attention through Computation
9.S913 SYLLABUS January 2014 Understanding Visual Attention through Computation Dept. of Brain and Cognitive Sciences Massachusetts Institute of Technology Title: Instructor: Years: Level: Prerequisites:
More informationModeling the Deployment of Spatial Attention
17 Chapter 3 Modeling the Deployment of Spatial Attention 3.1 Introduction When looking at a complex scene, our visual system is confronted with a large amount of visual information that needs to be broken
More informationATTENTIONAL MODULATION OF VISUAL PROCESSING
Annu. Rev. Neurosci. 2004. 27:611 47 doi: 10.1146/annurev.neuro.26.041002.131039 Copyright c 2004 by Annual Reviews. All rights reserved First published online as a Review in Advance on March 24, 2004
More informationOptimal Coding Predicts Attentional Modulation of Activity in Neural Systems
LETTER Communicated by Emilio Salinas Optimal Coding Predicts Attentional Modulation of Activity in Neural Systems Santiago Jaramillo sjara@ieee.org Barak A. Pearlmutter barak@cs.nuim.ie Hamilton Institute,
More informationObject detection in natural scenes by feedback
In: H.H. Būlthoff et al. (eds.), Biologically Motivated Computer Vision. Lecture Notes in Computer Science. Berlin, Heidelberg, New York: Springer Verlag, 398-407, 2002. c Springer-Verlag Object detection
More informationA Neurally-Inspired Model for Detecting and Localizing Simple Motion Patterns in Image Sequences
A Neurally-Inspired Model for Detecting and Localizing Simple Motion Patterns in Image Sequences Marc Pomplun 1, Yueju Liu 2, Julio Martinez-Trujillo 2, Evgueni Simine 2, and John K. Tsotsos 2 1 Department
More informationAttention improves performance primarily by reducing interneuronal correlations
Attention improves performance primarily by reducing interneuronal correlations Marlene R Cohen & John H R Maunsell 29 Nature America, Inc. All rights reserved. Visual attention can improve behavioral
More informationJust One View: Invariances in Inferotemporal Cell Tuning
Just One View: Invariances in Inferotemporal Cell Tuning Maximilian Riesenhuber Tomaso Poggio Center for Biological and Computational Learning and Department of Brain and Cognitive Sciences Massachusetts
More informationDendritic compartmentalization could underlie competition and attentional biasing of simultaneous visual stimuli
Dendritic compartmentalization could underlie competition and attentional biasing of simultaneous visual stimuli Kevin A. Archie Neuroscience Program University of Southern California Los Angeles, CA 90089-2520
More informationOPTO 5320 VISION SCIENCE I
OPTO 5320 VISION SCIENCE I Monocular Sensory Processes of Vision: Color Vision Mechanisms of Color Processing . Neural Mechanisms of Color Processing A. Parallel processing - M- & P- pathways B. Second
More informationContext-Dependent Changes in Functional Circuitry in Visual Area MT
Article Context-Dependent Changes in Functional Circuitry in Visual Area MT Marlene R. Cohen 1, * and William T. Newsome 1 1 Howard Hughes Medical Institute and Department of Neurobiology, Stanford University
More informationSupporting Information
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 Supporting Information Variances and biases of absolute distributions were larger in the 2-line
More informationProf. Greg Francis 7/31/15
s PSY 200 Greg Francis Lecture 06 How do you recognize your grandmother? Action potential With enough excitatory input, a cell produces an action potential that sends a signal down its axon to other cells
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single
More informationAttention and normalization circuits in macaque V1
European Journal of Neuroscience, pp. 1 16, 215 doi:1.1111/ejn.12857 Attention and normalization circuits in macaque V1 M. Sanayei, 1 J. L. Herrero, 1 C. Distler 2 and A. Thiele 1 1 Institute of Neuroscience,
More informationA coincidence detector neural network model of selective attention
A coincidence detector neural network model of selective attention Kleanthis Neokleous1 (kleneokl@cs.ucy.ac.cy) Maria Koushiou2 (maria_koushiou@yahoo.com) Marios N. Avraamides2 (mariosav@ucy.ac.cy) Christos
More informationReading Assignments: Lecture 5: Introduction to Vision. None. Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 5:. Reading Assignments: None 1 Projection 2 Projection 3 Convention: Visual Angle Rather than reporting two numbers (size of object and distance to observer),
More informationSignal detection theory. Direct comparison of perception and neural activity. ? Choice probability. Visual stimulus. Behavioral judgement
Signal detection theory yes no Visual stimulus Neurometric function Psychometric function Neuronal response? Choice probability Behavioral judgement Direct comparison oerception and neural activity Record
More informationConsciousness The final frontier!
Consciousness The final frontier! How to Define it??? awareness perception - automatic and controlled memory - implicit and explicit ability to tell us about experiencing it attention. And the bottleneck
More informationSpiking Inputs to a Winner-take-all Network
Spiking Inputs to a Winner-take-all Network Matthias Oster and Shih-Chii Liu Institute of Neuroinformatics University of Zurich and ETH Zurich Winterthurerstrasse 9 CH-857 Zurich, Switzerland {mao,shih}@ini.phys.ethz.ch
More informationLateral Geniculate Nucleus (LGN)
Lateral Geniculate Nucleus (LGN) What happens beyond the retina? What happens in Lateral Geniculate Nucleus (LGN)- 90% flow Visual cortex Information Flow Superior colliculus 10% flow Slide 2 Information
More informationA saliency map in primary visual cortex
Opinion A saliency map in primary visual cortex Zhaoping Li I propose that pre-attentive computational mechanisms in primary visual cortex create a saliency map. This map awards higher responses to more
More informationOn the role of context in probabilistic models of visual saliency
1 On the role of context in probabilistic models of visual saliency Date Neil Bruce, Pierre Kornprobst NeuroMathComp Project Team, INRIA Sophia Antipolis, ENS Paris, UNSA, LJAD 2 Overview What is saliency?
More informationVisual Nonclassical Receptive Field Effects Emerge from Sparse Coding in a Dynamical System
Visual Nonclassical Receptive Field Effects Emerge from Sparse Coding in a Dynamical System Mengchen Zhu 1, Christopher J. Rozell 2 * 1 Wallace H. Coulter Department of Biomedical Engineering, Georgia
More informationCh.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology
Ch.20 Dynamic Cue Combination in Distributional Population Code Networks Ka Yeon Kim Biopsychology Applying the coding scheme to dynamic cue combination (Experiment, Kording&Wolpert,2004) Dynamic sensorymotor
More informationNonlinear processing in LGN neurons
Nonlinear processing in LGN neurons Vincent Bonin *, Valerio Mante and Matteo Carandini Smith-Kettlewell Eye Research Institute 2318 Fillmore Street San Francisco, CA 94115, USA Institute of Neuroinformatics
More informationAn Information Theoretic Model of Saliency and Visual Search
An Information Theoretic Model of Saliency and Visual Search Neil D.B. Bruce and John K. Tsotsos Department of Computer Science and Engineering and Centre for Vision Research York University, Toronto,
More informationPre-Attentive Visual Selection
Pre-Attentive Visual Selection Li Zhaoping a, Peter Dayan b a University College London, Dept. of Psychology, UK b University College London, Gatsby Computational Neuroscience Unit, UK Correspondence to
More informationA bottom up visual saliency map in the primary visual cortex --- theory and its experimental tests.
A bottom up visual saliency map in the primary visual cortex --- theory and its experimental tests. Li Zhaoping University College London Adapted and updated from the invited presentation at COSYNE (computational
More informationContextual Influences in Visual Processing
C Contextual Influences in Visual Processing TAI SING LEE Computer Science Department and Center for Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA Synonyms Surround influence;
More informationEmanuel Todorov, Athanassios Siapas and David Somers. Dept. of Brain and Cognitive Sciences. E25-526, MIT, Cambridge, MA 02139
A Model of Recurrent Interactions in Primary Visual Cortex Emanuel Todorov, Athanassios Siapas and David Somers Dept. of Brain and Cognitive Sciences E25-526, MIT, Cambridge, MA 2139 Email: femo,thanos,somersg@ai.mit.edu
More informationAnalysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014
Analysis of in-vivo extracellular recordings Ryan Morrill Bootcamp 9/10/2014 Goals for the lecture Be able to: Conceptually understand some of the analysis and jargon encountered in a typical (sensory)
More informationPerceptual learning as improved probabilistic inference in early sensory areas
Perceptual learning as improved probabilistic inference in early sensory areas Vikranth R Bejjanki,, Jeffrey M Beck,,, Zhong-Lin Lu 3 & Alexandre Pouget Nature America, Inc. All rights reserved. Extensive
More information2/3/17. Visual System I. I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex
1 Visual System I I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex 2 1 2/3/17 Window of the Soul 3 Information Flow: From Photoreceptors
More informationTheoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück
The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:
More informationA Probabilistic Network Model of Population Responses
A Probabilistic Network Model of Population Responses Richard S. Zemel Jonathan Pillow Department of Computer Science Center for Neural Science University of Toronto New York University Toronto, ON MS
More informationIn: Connectionist Models in Cognitive Neuroscience, Proc. of the 5th Neural Computation and Psychology Workshop (NCPW'98). Hrsg. von D. Heinke, G. W.
In: Connectionist Models in Cognitive Neuroscience, Proc. of the 5th Neural Computation and Psychology Workshop (NCPW'98). Hrsg. von D. Heinke, G. W. Humphreys, A. Olson. University of Birmingham, England,
More informationNIH Public Access Author Manuscript Neural Netw. Author manuscript; available in PMC 2007 November 1.
NIH Public Access Author Manuscript Published in final edited form as: Neural Netw. 2006 November ; 19(9): 1447 1449. Models of human visual attention should consider trial-by-trial variability in preparatory
More informationKeywords- Saliency Visual Computational Model, Saliency Detection, Computer Vision, Saliency Map. Attention Bottle Neck
Volume 3, Issue 9, September 2013 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Visual Attention
More informationVIDEO SALIENCY INCORPORATING SPATIOTEMPORAL CUES AND UNCERTAINTY WEIGHTING
VIDEO SALIENCY INCORPORATING SPATIOTEMPORAL CUES AND UNCERTAINTY WEIGHTING Yuming Fang, Zhou Wang 2, Weisi Lin School of Computer Engineering, Nanyang Technological University, Singapore 2 Department of
More informationNormalization as a canonical neural computation
Normalization as a canonical neural computation Matteo Carandini 1 and David J. Heeger 2 Abstract There is increasing evidence that the brain relies on a set of canonical neural computations, repeating
More informationPerceptual Grouping in a Self-Organizing Map of Spiking Neurons
Perceptual Grouping in a Self-Organizing Map of Spiking Neurons Yoonsuck Choe Department of Computer Sciences The University of Texas at Austin August 13, 2001 Perceptual Grouping Group Two! Longest Contour?
More informationLecture overview. What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods )
Lecture overview What hypothesis to test in the fly? Quantitative data collection Visual physiology conventions ( Methods ) 1 Lecture overview What hypothesis to test in the fly? Quantitative data collection
More informationTuning Curve Shift by Attention Modulation in Cortical Neurons: a Computational Study of its Mechanisms
Cerebral Cortex June 26;16:761-778 doi:1.193/cercor/bhj21 Advance Access publication August 31, 25 Tuning Curve Shift by Attention Modulation in Cortical Neurons: a Computational Study of its Mechanisms
More informationValidating the Visual Saliency Model
Validating the Visual Saliency Model Ali Alsam and Puneet Sharma Department of Informatics & e-learning (AITeL), Sør-Trøndelag University College (HiST), Trondheim, Norway er.puneetsharma@gmail.com Abstract.
More informationM Cells. Why parallel pathways? P Cells. Where from the retina? Cortical visual processing. Announcements. Main visual pathway from retina to V1
Announcements exam 1 this Thursday! review session: Wednesday, 5:00-6:30pm, Meliora 203 Bryce s office hours: Wednesday, 3:30-5:30pm, Gleason https://www.youtube.com/watch?v=zdw7pvgz0um M Cells M cells
More informationVisual Attention and the Role of Normalization
Visual Attention and the Role of Normalization The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Accessed Citable Link
More informationSupplementary materials for: Executive control processes underlying multi- item working memory
Supplementary materials for: Executive control processes underlying multi- item working memory Antonio H. Lara & Jonathan D. Wallis Supplementary Figure 1 Supplementary Figure 1. Behavioral measures of
More informationThe Effect of Spatial Attention on Contrast Response Functions in Human Visual Cortex
The Journal of Neuroscience, January 3, 2007 27(1):93 97 93 Brief Communications The Effect of Spatial Attention on Contrast Response Functions in Human Visual Cortex Giedrius T. Buracas and Geoffrey M.
More informationArea MT Neurons Respond to Visual Motion Distant From Their Receptive Fields
J Neurophysiol 94: 4156 4167, 2005. First published August 24, 2005; doi:10.1152/jn.00505.2005. Area MT Neurons Respond to Visual Motion Distant From Their Receptive Fields Daniel Zaksas and Tatiana Pasternak
More informationThe neural code for interaural time difference in human auditory cortex
The neural code for interaural time difference in human auditory cortex Nelli H. Salminen and Hannu Tiitinen Department of Biomedical Engineering and Computational Science, Helsinki University of Technology,
More informationPosition invariant recognition in the visual system with cluttered environments
PERGAMON Neural Networks 13 (2000) 305 315 Contributed article Position invariant recognition in the visual system with cluttered environments S.M. Stringer, E.T. Rolls* Oxford University, Department of
More informationMotion direction signals in the primary visual cortex of cat and monkey
Visual Neuroscience (2001), 18, 501 516. Printed in the USA. Copyright 2001 Cambridge University Press 0952-5238001 $12.50 DOI: 10.1017.S0952523801184014 Motion direction signals in the primary visual
More informationSensory Adaptation within a Bayesian Framework for Perception
presented at: NIPS-05, Vancouver BC Canada, Dec 2005. published in: Advances in Neural Information Processing Systems eds. Y. Weiss, B. Schölkopf, and J. Platt volume 18, pages 1291-1298, May 2006 MIT
More informationNormalization as a canonical neural computation
Normalization as a canonical neural computation Matteo Carandini 1 and David J. Heeger 2 Abstract There is increasing evidence that the brain relies on a set of canonical neural computations, repeating
More informationNeuron, Volume 63 Spatial attention decorrelates intrinsic activity fluctuations in Macaque area V4.
Neuron, Volume 63 Spatial attention decorrelates intrinsic activity fluctuations in Macaque area V4. Jude F. Mitchell, Kristy A. Sundberg, and John H. Reynolds Systems Neurobiology Lab, The Salk Institute,
More informationA Model of Neuronal Responses in Visual Area MT
A Model of Neuronal Responses in Visual Area MT Eero P. Simoncelli a and David J. Heeger b a Center for Neural Science 4 Washington Place, Room 809 New York, NY 10003 b Department of Psychology Stanford
More informationSpatial Attention Modulates Center-Surround Interactions in Macaque Visual Area V4
Article Spatial Attention Modulates Center-Surround Interactions in Macaque Visual Area V4 Kristy A. Sundberg, 1 Jude F. Mitchell, 1 and John H. Reynolds 1, * 1 Systems Neurobiology Laboratory, The Salk
More informationMeasuring the attentional effect of the bottom-up saliency map of natural images
Measuring the attentional effect of the bottom-up saliency map of natural images Cheng Chen 1,3, Xilin Zhang 2,3, Yizhou Wang 1,3, and Fang Fang 2,3,4,5 1 National Engineering Lab for Video Technology
More informationThe role of perceptual load in orientation perception, visual masking and contextual integration Moritz J.K. Stolte
The role of perceptual load in orientation perception, visual masking and contextual integration Moritz J.K. Stolte Institute of Cognitive Neuroscience University College London Submitted for the degree
More informationBayesian inference and attentional modulation in the visual cortex
COGNITIVE NEUROSCIENCE AND NEUROPSYCHOLOGY Bayesian inference and attentional modulation in the visual cortex Rajesh P.N. Rao Department of Computer Science and Engineering, University of Washington, Seattle,
More informationObject recognition and hierarchical computation
Object recognition and hierarchical computation Challenges in object recognition. Fukushima s Neocognitron View-based representations of objects Poggio s HMAX Forward and Feedback in visual hierarchy Hierarchical
More informationBeyond bumps: Spiking networks that store sets of functions
Neurocomputing 38}40 (2001) 581}586 Beyond bumps: Spiking networks that store sets of functions Chris Eliasmith*, Charles H. Anderson Department of Philosophy, University of Waterloo, Waterloo, Ont, N2L
More informationSupplemental Material
Supplemental Material Recording technique Multi-unit activity (MUA) was recorded from electrodes that were chronically implanted (Teflon-coated platinum-iridium wires) in the primary visual cortex representing
More informationAttention activates winner-take-all competition among visual filters
Attention activates winnertakeall competition among visual filters D.K. Lee, L. Itti, C. Koch and J. Braun Computation and Neural Systems 139 74, California Institute of Technology, Pasadena, California
More informationAttention: Neural Mechanisms and Attentional Control Networks Attention 2
Attention: Neural Mechanisms and Attentional Control Networks Attention 2 Hillyard(1973) Dichotic Listening Task N1 component enhanced for attended stimuli Supports early selection Effects of Voluntary
More informationPhotoreceptors Rods. Cones
Photoreceptors Rods Cones 120 000 000 Dim light Prefer wavelength of 505 nm Monochromatic Mainly in periphery of the eye 6 000 000 More light Different spectral sensitivities!long-wave receptors (558 nm)
More informationGoals. Visual behavior jobs of vision. The visual system: overview of a large-scale neural architecture. kersten.org
The visual system: overview of a large-scale neural architecture Daniel Kersten Computational Vision Lab Psychology Department, U. Minnesota Goals Provide an overview of a major brain subsystem to help
More informationPsychophysical tests of the hypothesis of a bottom-up saliency map in primary visual cortex
Psychophysical tests of the hypothesis of a bottom-up saliency map in primary visual cortex In press for Public Library of Science, Computational Biology, (2007). Citation: Zhaoping L. May KA (2007) Psychophysical
More informationSpatial characteristics of the second-order visual pathway revealed by positional adaptation
articles Spatial characteristics of the second-order visual pathway revealed by positional adaptation Paul V. McGraw 1, Dennis M. Levi 2 and David Whitaker 1 1 Department of Optometry, University of Bradford,
More informationSpatial Distribution of Contextual Interactions in Primary Visual Cortex and in Visual Perception
Spatial Distribution of Contextual Interactions in Primary Visual Cortex and in Visual Perception MITESH K. KAPADIA, 1,2 GERALD WESTHEIMER, 1 AND CHARLES D. GILBERT 1 1 The Rockefeller University, New
More informationNatural Scene Statistics and Perception. W.S. Geisler
Natural Scene Statistics and Perception W.S. Geisler Some Important Visual Tasks Identification of objects and materials Navigation through the environment Estimation of motion trajectories and speeds
More informationReading Assignments: Lecture 18: Visual Pre-Processing. Chapters TMB Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 18: Visual Pre-Processing. Reading Assignments: Chapters TMB2 3.3. 1 Low-Level Processing Remember: Vision as a change in representation. At the low-level,
More informationHow does the ventral pathway contribute to spatial attention and the planning of eye movements?
R. P. Würtz and M. Lappe (Eds.) Dynamic Perception, Infix Verlag, St. Augustin, 83-88, 2002. How does the ventral pathway contribute to spatial attention and the planning of eye movements? Fred H. Hamker
More informationarxiv: v1 [cs.cv] 10 Jan 2019
Early recurrence enables figure border ownership Paria Mehrani and John K. Tsotsos arxiv:1901.03201v1 [cs.cv] 10 Jan 2019 Department of Electrical Engineering and Computer Science, York University, Toronto,
More informationOptimal information decoding from neuronal populations with specific stimulus selectivity
Optimal information decoding from neuronal populations with specific stimulus selectivity Marcelo A. Montemurro The University of Manchester Faculty of Life Sciences Moffat Building PO Box 88, Manchester
More informationExpansion of MT Neurons Excitatory Receptive Fields during Covert Attentive Tracking
The Journal of Neuroscience, October 26, 2011 31(43):15499 15510 15499 Behavioral/Systems/Cognitive Expansion of MT Neurons Excitatory Receptive Fields during Covert Attentive Tracking Robert Niebergall,
More informationJoint tuning for direction of motion and binocular disparity in macaque MT is largely separable
J Neurophysiol 11: 286 2816, 213. First published October 2, 213; doi:1.1152/jn.573.213. Joint tuning for direction of motion and binocular disparity in macaque MT is largely separable Alexandra Smolyanskaya,*
More informationVisual attention: the where, what, how and why of saliency Stefan Treue
428 Visual attention: the where, what, how and why of saliency Stefan Treue Attention influences the processing of visual information even in the earliest areas of primate visual cortex. There is converging
More informationA neural circuit model of decision making!
A neural circuit model of decision making! Xiao-Jing Wang! Department of Neurobiology & Kavli Institute for Neuroscience! Yale University School of Medicine! Three basic questions on decision computations!!
More informationAttention enhances adaptability: evidence from motion adaptation experiments
Vision Research 44 (2004) 3035 3044 www.elsevier.com/locate/visres Attention enhances adaptability: evidence from motion adaptation experiments Amy Rezec a, Bart Krekelberg b, Karen R. Dobkins a, * a Department
More informationAdding Shape to Saliency: A Computational Model of Shape Contrast
Adding Shape to Saliency: A Computational Model of Shape Contrast Yupei Chen 1, Chen-Ping Yu 2, Gregory Zelinsky 1,2 Department of Psychology 1, Department of Computer Science 2 Stony Brook University
More informationEarly Stages of Vision Might Explain Data to Information Transformation
Early Stages of Vision Might Explain Data to Information Transformation Baran Çürüklü Department of Computer Science and Engineering Mälardalen University Västerås S-721 23, Sweden Abstract. In this paper
More informationSupplementary Figure 1. ACE robotic platform. A. Overview of the rig setup showing major hardware components of ACE (Automatic single Cell
2 Supplementary Figure 1. ACE robotic platform. A. Overview of the rig setup showing major hardware components of ACE (Automatic single Cell Experimenter) including the MultiClamp 700B, Digidata 1440A,
More informationA model of encoding and decoding in V1 and MT accounts for motion perception anisotropies in the human visual system
B R A I N R E S E A R C H 1 2 9 9 ( 2 0 0 9 ) 3 1 6 a v a i l a b l e a t w w w. s c i e n c e d i r e c t. c o m w w w. e l s e v i e r. c o m / l o c a t e / b r a i n r e s Research Report A model of
More information