Perceptual Grouping in a Self-Organizing Map of Spiking Neurons
|
|
- Lynne Moore
- 5 years ago
- Views:
Transcription
1 Perceptual Grouping in a Self-Organizing Map of Spiking Neurons Yoonsuck Choe Department of Computer Sciences The University of Texas at Austin August 13, 2001
2 Perceptual Grouping Group Two! Longest Contour? What is in here? Goal: To understand the Neural Mechanisms of Perceptual Grouping.
3 Perceptual Grouping ffl How are constituents grouped together? ffl The neural mechanisms are not well understood. ffl As a first step, focus on the Low-Level.
4 Low-Level Perceptual Grouping Retina Visual Cortex Why focus on low-level? ffl Constraints on feature dimensions. ffl Abundant neuroanatomical data. ffl Bridge to high-level cognitive processes. ffl Example: Contour Integration
5 Research Questions V1 Retina Visual Cortex 1. What are the neural mechanisms? 2. How does the circuitry emerge?
6 Possible Answers RETINA CORTEX t=1 t=2 t=3 t=4 Time Retina Cortex 1. Synchronized activity represents grouping. 2. Circuitry is self-organized during development. (Unsupervised learning)
7 Basics(1): Human Visual Pathway V1 Retina ffl Receptive Fields (RF). Visual Cortex ffl Hierarchy of maps. 1: Topological organization. 2: Laterally connected.
8 Basics(2): Primary Visual Cortex V1 Retina Visual Cortex Blasdel (1992) ffl Neurons are orientation-tuned. ffl Nearby neurons prefer similar orientation. ffl Forms orientation map.
9 Basics(3): Lateral Connections Bosking et al. (1997) ffl Black dots: Lateral Connections. Connect similarly orientation-tuned neurons. ffl (Gilbert and Wiesel, 1989)
10 Synchronization RF STRONG WEAK NO Synchronization Synchronization Synchronization Eckhorn et al. (1988); Gray et al. (1989)
11 Contour Association Field Association Field D. Field et al.(1993) ffl Smaller relative orientation is preferred. ffl Edges aligned on a common path are preferred. ffl Conjecture: lateral interaction is needed.
12 Local Grouping Function Geisler et al.(2001) ffl Edge co-occurrence in natural images! Local grouping function. ffl Transitive grouping rule. Predict human contour integration performance.
13 Self-Organization Altered visual environment drastically changes the organization of the visual cortex. Input deprivation: Hubel and Wiesel (1962,1974), ffl Issa (1999), White et al. (2000,2001) Biased input: Hirsch and Spinelli (1970), ffl Blakemore and van Sluyters (1975) Visual input to auditory cortex: Sur et al. (1988), ffl Sharma et al. (2000)
14 Computational Models 1. Synchronization 2. Self-Organization ffl Coupled Oscillators von der Malsburg&Buhmann(1992) Terman and Wang (1995) Chakravarthy,Ramamurti&Ghosh(1995) ffl Leaky integrator Eckhorn et al. (1990) Reitboeck et al. (1993) ffl Integrate and fire neurons Nischwitz and Glünder (1995) ffl Orientation map von der Malsburg (1973) Obermayer et al. (1990) ffl Ocular dominance Miller et al. (1989) ffl LISSOM: SOM with lateral conn. Miikkulainen,Bednar,Choe&Sirosh(1997) 3. Contour Integration Fixed, pre-calculated lateral interaction patterns. ffl Li (1998), Yen and Finkel (1997)
15 Limitations 1. Lack temporal representation. 2. Limited to simple grouping rules such as connectedness. 3. Fixed lateral interaction: ffl No self-organization. ffl Does not explain how such patterns emerge. Does not explain hemifield differences in ffl performance.
16 Approach RETINA CORTEX t=1 t=2 t=3 t=4 Time Retina Integration of two computational principles: Cortex 1. Temporal Coding ffl Spiking neurons. 2. Self-Organization ffl Oriented RFs and patterned lateral connections.
17 Architecture: PGLISSOM 1. Spiking Neurons. 2. Afferent connections form oriented RF. 3. Excitatory and inhibitory lateral connections. Retina Cortex 4. Two layers, constituting a cortical sheet. Self-Organization ffl Grouping ffl
18 s(t) = i + s(t 1)e Spiking Neuron θ base θ abs θ rel i Input Spike S(t) ω > ω Leaky Synapse ω Σ Weighted Sum θ (t) Dynamic Threshold i Output Spike ffl Leaky Synapse ffl Dynamic Threshold (Refractory Period Term) (t) = base + fi rel (t) + abs (t)
19 ffi = g 0 B B fl X z } Afferent + flc X z } Intra Column + fle X z } Exc:Lat: fli X z } Inh:Lat: 1 C C A Activation ξ µ η E ν ζ I Retina Cortex Eim m Iim m μij οj ν ik k j m k m
20 ij(t) + ffvixj P w [wij(t) + ffvixj] j Weight Adaptation V i w ij X j Normalized Hebbian Learning: wij(t + 1) = ffl Increase weight proportional to the activities. ffl Normalize with sum of weights to limit growth.
21 Summary of Results 1. Self-organized orientation map. 2. Self-organized lateral connections. 3. Lateral connection statistics. 4. Contour integration. 5. Contour segmentation. 6. Contour completion. 7. Hemifield differences in contour integration.
22 Results(1): Orientation Map ffl Trained with elongated, oriented Gaussians as input. ffl Activate, settle, and adapt weights. ffl Smooth orientation map develops in both layers.
23 Results(2): Lateral Connections b c d (a) MAP2 (b) 85 o (c) 141 o (d) 174 o ffl MAP2 excitatory connections are shown. ffl Connects similarly orientation-tuned neurons. ffl Aligned along the axis of the source neuron s RF. ffl Synchronizes remote areas.
24 Results(3): Connection Statistics (I) RF Retina φ δ θ Measures Cortex Connections prefer ffl similar orientation. Number of Connections % of Total Boutons Matches data from ffl Bosking et al. (1997) Median Diffrence in Orientation Tuning (deg) PGLISSOM Median Diffrence in Orientation Tuning (deg) Bosking (1997)
25 Results(3): Connection Statistics (II) δ φ θ φ =90 o Relative Probability 1 Reference φ=0 o δ=27 PGLISSOM Geisler et al. (2001) ffl Connected RFs are aligned along a smooth path. ffl Matches edge co-occurrence statistics found in nature.
26 Connection Statistics(II): Zoomed φ =90 o Relative Probability φ=0 o δ=27
27 Why Co-Circular? RFs aligned on a common straight input are ffl stimulated. ffl Non-optimally aligned input can also cause activity. ffl Forms the basis for contour integration.
28 o 0 30 o Results(4): Contour Integration o o Cortex Model: Correlation Model vs. Human Data Model Data Orientation Jitter (degrees) Performance measure: ffl Correl. coeff. between Multi Unit Activities (MUAs). ffl As orientation jitter increases: correlation decreases (PGLISSOM). ffi accuracy decreases in humans(geisler et al. 2001). ffi Data: Accuracy(%)
29 Demo Contour Integration
30 Results(5): Contour Segmentation Correlation Coefficient Segmentation of 3 Contours Correl Within Across ffl Each contour is grouped by synchronized activity. Separate contours are segmented by ffl desynchronized activity.
31 Demo Contour Segmentation
32 Results(6): Contour Completion (I) ffl Illusory contours : Kanizsa square. ffl Edge-inducers around the border. ffl Contour completion may be a low-level mechanism.
33 Demo Contour Completion
34 Results(6): Contour Completion (II) Afferent Input Afferent Contribution Location (Column) Correlation Coefficient Contour Completion Both Exc Aff ffl Gap region receives small amount of afferent input. ffl However, completion is not due to afferent input alone. ffl Completion is not due to excitatory input alone either.
35 Hemifield Differences Contour and illusory contour detection performance differ: Fovea > Periphery (Hess and Dakin 1997) ffl ffl Lower > Upper Visual Hemifield (Rubin et al. 1996)
36 Results(7): Hemifield Differences(I) φ =90 o Relative Probability 1 φ =90 o Relative Probability φ=0 o φ=0 o δ=27 Lower Hemifield δ=27 Upper Hemifield ffl Input presentation frequency differed in the hemifields. ffl Resulting excitatory lateral connections are: 1. more co-circular in the lower hemifield, and 2. more collinear in the upper hemifield.
37 Hemifield Differences(I): Zoomed Lower Upper
38 Results(7): Hemifield Differences(II) Correlation Contour integration: Lower vs. Upper Hemifield Lower Upper Orientation Jitter (degrees) ffl Performance is higher in lower hemifield. Performance gap is larger for task requiring ffl co-circular lateral interactions.
39 Summary(1) What has been shown? 1. Synchrony in model accounts for human performance. 2. Synchrony is established through lateral connections. 3. The lateral connections are a result of self-organization. 4. Changes in input cause difference in structure and performance.
40 Summary(2): Predictions 1. Correlation of MUA sequences can represent perceptual grouping. 2. V1 mechanisms can account for edge-induced illusory contours. 3. Layered architecture in V1 may be due to different functional requirements: (1) self-organization and (2) grouping. 4. Input difference can cause structural changes, and result in altered performance. 5. Straight inputs can cause co-circular lateral interaction properties to emerge.
41 1. Neuroscience: Future Work Verify functional connection statistics. ffl Connections before, during, and after development. ffl Effect of disrupted neural synchrony on perception. ffl 2. Psychophysics: ffl Extend the model further for full stimulus dimensions. ffl Role of higher areas on task performance. 3. Intelligent Systems: Application to real-world images. ffl Higher module for activity interpretation. ffl Multi-modal integration. ffl
42 Conclusion ffl Model based on synchronization and self-organization. Accounts for: ffl 1. structural formation (development) and 2. functional mechanisms in contour integration tasks. Contributes to: ffl 1. understanding the neural mechanisms of P.G. 2. laying a foundation for artificial vision systems.
43 Extra Slides
44 T (t) = e t=r INF vs. Dynamic Threshold x(t): Voltage T(t): Threshold Fire! Fire! Fire! Fire! Integrate and Fire Dynamic Threshold dx = x + I R dt vs. x(t) = IR(1 e t=r )
45 Correlation in MUAs Synchronized Desynchronized MUA MUA MUA MUA time time Correlation coefficient between MUAs X and Y : = Y ) r = Cov(X; ff Y X ff pp (X i μ X )(Y i μ Y ) i ppi i μ X ) 2p Pi (Y i μ Y ) 2 (X
46 Human Contour Integration Geisler et al. (2001)
47 Overlapping RF Retina Cortex Neurons responding to mixed inputs are not ffl measured.
48 Network of Spiking Neurons Summary of spiking neuron behavior in a network: ffl Excitation with fast decay causes synchrony. ffl Inhibition with fast decay causes desynchrony. ffl Noise helps desynchrony. Refractory period helps overcome high levels of ffl noise.
Self-Organization and Segmentation with Laterally Connected Spiking Neurons
Self-Organization and Segmentation with Laterally Connected Spiking Neurons Yoonsuck Choe Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 USA Risto Miikkulainen Department
More informationPerceptual Grouping in a Self-Organizing Map of Spiking Neurons
Perceptual Grouping in a Self-Organizing Map of Spiking Neurons Yoonsuck Choe August 2001 AI01-292 Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 This document is a
More informationThe Visual System. Cortical Architecture Casagrande February 23, 2004
The Visual System Cortical Architecture Casagrande February 23, 2004 Phone: 343-4538 Email: vivien.casagrande@mcmail.vanderbilt.edu Office: T2302 MCN Required Reading Adler s Physiology of the Eye Chapters
More informationTopographic Receptive Fields and Patterned Lateral Interaction in a Self-Organizing Model of The Primary Visual Cortex
Topographic Receptive Fields and Patterned Lateral Interaction in a Self-Organizing Model of The Primary Visual Cortex Joseph Sirosh and Risto Miikkulainen Department of Computer Sciences The University
More informationLateral Geniculate Nucleus (LGN)
Lateral Geniculate Nucleus (LGN) What happens beyond the retina? What happens in Lateral Geniculate Nucleus (LGN)- 90% flow Visual cortex Information Flow Superior colliculus 10% flow Slide 2 Information
More informationReading Assignments: Lecture 5: Introduction to Vision. None. Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 5:. Reading Assignments: None 1 Projection 2 Projection 3 Convention: Visual Angle Rather than reporting two numbers (size of object and distance to observer),
More informationV1 (Chap 3, part II) Lecture 8. Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017
V1 (Chap 3, part II) Lecture 8 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Fall 2017 Topography: mapping of objects in space onto the visual cortex contralateral representation
More informationPlasticity of Cerebral Cortex in Development
Plasticity of Cerebral Cortex in Development Jessica R. Newton and Mriganka Sur Department of Brain & Cognitive Sciences Picower Center for Learning & Memory Massachusetts Institute of Technology Cambridge,
More informationM Cells. Why parallel pathways? P Cells. Where from the retina? Cortical visual processing. Announcements. Main visual pathway from retina to V1
Announcements exam 1 this Thursday! review session: Wednesday, 5:00-6:30pm, Meliora 203 Bryce s office hours: Wednesday, 3:30-5:30pm, Gleason https://www.youtube.com/watch?v=zdw7pvgz0um M Cells M cells
More information2/3/17. Visual System I. I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex
1 Visual System I I. Eye, color space, adaptation II. Receptive fields and lateral inhibition III. Thalamus and primary visual cortex 2 1 2/3/17 Window of the Soul 3 Information Flow: From Photoreceptors
More informationProf. Greg Francis 7/31/15
s PSY 200 Greg Francis Lecture 06 How do you recognize your grandmother? Action potential With enough excitatory input, a cell produces an action potential that sends a signal down its axon to other cells
More informationModeling the Primary Visual Cortex
Modeling the Primary Visual Cortex David W. McLaughlin Courant Institute & Center for Neural Science New York University http://www.cims.nyu.edu/faculty/dmac/ Ohio - MBI Oct 02 Input Layer of Primary Visual
More informationJ Jeffress model, 3, 66ff
Index A Absolute pitch, 102 Afferent projections, inferior colliculus, 131 132 Amplitude modulation, coincidence detector, 152ff inferior colliculus, 152ff inhibition models, 156ff models, 152ff Anatomy,
More informationCognitive Modelling Themes in Neural Computation. Tom Hartley
Cognitive Modelling Themes in Neural Computation Tom Hartley t.hartley@psychology.york.ac.uk Typical Model Neuron x i w ij x j =f(σw ij x j ) w jk x k McCulloch & Pitts (1943), Rosenblatt (1957) Net input:
More informationlateral organization: maps
lateral organization Lateral organization & computation cont d Why the organization? The level of abstraction? Keep similar features together for feedforward integration. Lateral computations to group
More informationTilt Aftereffects in a Self-Organizing Model of the Primary Visual Cortex
LETTER Communicated by Jack Cowan Tilt Aftereffects in a Self-Organizing Model of the Primary Visual Cortex James A. Bednar Risto Miikkulainen Department of Computer Sciences, University of Texas at Austin,
More informationMechanisms of stimulus feature selectivity in sensory systems
Mechanisms of stimulus feature selectivity in sensory systems 1. Orientation and direction selectivity in the visual cortex 2. Selectivity to sound frequency in the auditory cortex 3. Feature selectivity
More informationCS294-6 (Fall 2004) Recognizing People, Objects and Actions Lecture: January 27, 2004 Human Visual System
CS294-6 (Fall 2004) Recognizing People, Objects and Actions Lecture: January 27, 2004 Human Visual System Lecturer: Jitendra Malik Scribe: Ryan White (Slide: layout of the brain) Facts about the brain:
More informationDependence of Orientation Tuning on Recurrent Excitation and Inhibition in a Network Model of V1
Dependence of Orientation Tuning on Recurrent Excitation and Inhibition in a Network Model of V1 Klaus Wimmer 1 *, Marcel Stimberg 1 *, Robert Martin 1, Lars Schwabe 2, Jorge Mariño 3, James Schummers
More informationIntroduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 7: Network models Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single neuron
More informationModels of Attention. Models of Attention
Models of Models of predictive: can we predict eye movements (bottom up attention)? [L. Itti and coll] pop out and saliency? [Z. Li] Readings: Maunsell & Cook, the role of attention in visual processing,
More informationTilt Aftereffects in a Self-Organizing Model of the Primary Visual Cortex
Color version of Neural Computation 12(7):1721-1740, 2000. Tilt Aftereffects in a Self-Organizing Model of the Primary Visual Cortex James A. Bednar (jbednar@cs.utexas.edu) Risto Miikkulainen (risto@cs.utexas.edu)
More informationOPTO 5320 VISION SCIENCE I
OPTO 5320 VISION SCIENCE I Monocular Sensory Processes of Vision: Color Vision Mechanisms of Color Processing . Neural Mechanisms of Color Processing A. Parallel processing - M- & P- pathways B. Second
More informationHow has Computational Neuroscience been useful? Virginia R. de Sa Department of Cognitive Science UCSD
How has Computational Neuroscience been useful? 1 Virginia R. de Sa Department of Cognitive Science UCSD What is considered Computational Neuroscience? 2 What is considered Computational Neuroscience?
More informationCortical Map Plasticity. Gerald Finnerty Dept Basic and Clinical Neuroscience
Cortical Map Plasticity Gerald Finnerty Dept Basic and Clinical Neuroscience Learning Objectives Be able to: 1. Describe the characteristics of a cortical map 2. Appreciate that the term plasticity is
More informationPhotoreceptors Rods. Cones
Photoreceptors Rods Cones 120 000 000 Dim light Prefer wavelength of 505 nm Monochromatic Mainly in periphery of the eye 6 000 000 More light Different spectral sensitivities!long-wave receptors (558 nm)
More informationModels of visual neuron function. Quantitative Biology Course Lecture Dan Butts
Models of visual neuron function Quantitative Biology Course Lecture Dan Butts 1 What is the neural code"? 11 10 neurons 1,000-10,000 inputs Electrical activity: nerve impulses 2 ? How does neural activity
More informationReading Assignments: Lecture 18: Visual Pre-Processing. Chapters TMB Brain Theory and Artificial Intelligence
Brain Theory and Artificial Intelligence Lecture 18: Visual Pre-Processing. Reading Assignments: Chapters TMB2 3.3. 1 Low-Level Processing Remember: Vision as a change in representation. At the low-level,
More informationAssociative Decorrelation Dynamics: A Theory of Self-Organization and Optimization in Feedback Networks
Associative Decorrelation Dynamics: A Theory of Self-Organization and Optimization in Feedback Networks Dawei W. Dong* Lawrence Berkeley Laboratory University of California Berkeley, CA 94720 Abstract
More informationColin Ware Center for Coastal and Ocean Mapping University of New Hampshire.
Abstract Towards a Perceptual Theory of Flow Visualization Colin Ware Center for Coastal and Ocean Mapping University of New Hampshire. At present there is very little attention paid to vision science
More informationAbstract A neural network model called LISSOM for the cooperative self-organization of
Modeling Cortical Plasticity Based on Adapting Lateral Interaction Joseph Sirosh and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin, Austin, TX{78712. email: sirosh,risto@cs.utexas.edu
More informationEarly Stages of Vision Might Explain Data to Information Transformation
Early Stages of Vision Might Explain Data to Information Transformation Baran Çürüklü Department of Computer Science and Engineering Mälardalen University Västerås S-721 23, Sweden Abstract. In this paper
More informationILLUSORY CONTOUR PROCESSING IN EARLY VISUAL AREAS: A MODELING APPROACH. Min Hui. Thesis. Submitted to the Faculty of the
ILLUSORY CONTOUR PROCESSING IN EARLY VISUAL AREAS: A MODELING APPROACH By Min Hui Thesis Submitted to the Faculty of the Graduate School of Vanderbilt University in partial fulfillment of the requirements
More informationlateral connections are non-modiable and distinct from with short-range excitation and long-range inhibition.
How Lateral Interaction Develops in a Self-Organizing Feature Map Joseph Sirosh and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin, Austin, TX-771 sirosh,risto@cs.utexas.edu
More informationSupplemental Material
Supplemental Material Recording technique Multi-unit activity (MUA) was recorded from electrodes that were chronically implanted (Teflon-coated platinum-iridium wires) in the primary visual cortex representing
More informationCognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence
Cognitive Neuroscience History of Neural Networks in Artificial Intelligence The concept of neural network in artificial intelligence To understand the network paradigm also requires examining the history
More informationContour Integration by the Human Visual System: Evidence for a Local Association Field
Vision Res. Vol. 33, No. 2, pp. 173-193, 1993 Printed in Great Britain. All rights reserved 0042-6989/93 $5.00 + 0.00 Copyright 0 1993 Pergamon Press Ltd Contour Integration by the Human Visual System:
More informationLISC-322 Neuroscience Cortical Organization
LISC-322 Neuroscience Cortical Organization THE VISUAL SYSTEM Higher Visual Processing Martin Paré Assistant Professor Physiology & Psychology Most of the cortex that covers the cerebral hemispheres is
More informationClusters, Symbols and Cortical Topography
Clusters, Symbols and Cortical Topography Lee Newman Thad Polk Dept. of Psychology Dept. Electrical Engineering & Computer Science University of Michigan 26th Soar Workshop May 26, 2006 Ann Arbor, MI agenda
More informationTheta sequences are essential for internally generated hippocampal firing fields.
Theta sequences are essential for internally generated hippocampal firing fields. Yingxue Wang, Sandro Romani, Brian Lustig, Anthony Leonardo, Eva Pastalkova Supplementary Materials Supplementary Modeling
More informationUMIACS-TR August Feature Maps. Yinong Chen. University of Maryland. College Park, MD 20742
UMIACS-TR-97-56 August 1997 CS-TR-3816 A Motor Control Model Based on Self-organizing Feature Maps Yinong Chen Institute for Advanced Computer Studies Department of Computer Science University of Maryland
More informationVISUAL CORTICAL PLASTICITY
VISUAL CORTICAL PLASTICITY OCULAR DOMINANCE AND OTHER VARIETIES REVIEW OF HIPPOCAMPAL LTP 1 when an axon of cell A is near enough to excite a cell B and repeatedly and consistently takes part in firing
More informationNeural response time integration subserves. perceptual decisions - K-F Wong and X-J Wang s. reduced model
Neural response time integration subserves perceptual decisions - K-F Wong and X-J Wang s reduced model Chris Ayers and Narayanan Krishnamurthy December 15, 2008 Abstract A neural network describing the
More informationAbstract
Self-Organization, Plasticity, and Low-level Visual Phenomena in a Laterally Connected Map Model of the Primary Visual Cortex Risto Miikkulainen, James A. Bednar, Yoonsuck Choe, and Joseph Sirosh Department
More informationBeyond Vanilla LTP. Spike-timing-dependent-plasticity or STDP
Beyond Vanilla LTP Spike-timing-dependent-plasticity or STDP Hebbian learning rule asn W MN,aSN MN Δw ij = μ x j (v i - φ) learning threshold under which LTD can occur Stimulation electrode Recording electrode
More informationInvestigation of Physiological Mechanism For Linking Field Synapses
Investigation of Physiological Mechanism For Linking Field Synapses Richard B. Wells 1, Nick Garrett 2, Tom Richner 3 Microelectronics Research and Communications Institute (MRCI) BEL 316 University of
More informationAdaptive gain modulation in V1 explains contextual modifications during bisection learning
Adaptive gain modulation in V1 explains contextual modifications during bisection learning Roland Schäfer, Eleni Vasilaki, and Walter Senn Department of Physiology, University of Bern, Bühlplatz 5, 312
More informationTEMPORAL PRECISION OF SENSORY RESPONSES Berry and Meister, 1998
TEMPORAL PRECISION OF SENSORY RESPONSES Berry and Meister, 1998 Today: (1) how can we measure temporal precision? (2) what mechanisms enable/limit precision? A. 0.1 pa WHY SHOULD YOU CARE? average rod
More informationA bottom up visual saliency map in the primary visual cortex --- theory and its experimental tests.
A bottom up visual saliency map in the primary visual cortex --- theory and its experimental tests. Li Zhaoping University College London Adapted and updated from the invited presentation at COSYNE (computational
More informationPrimary Visual Pathways (I)
Primary Visual Pathways (I) Introduction to Computational and Biological Vision CS 202-1-5261 Computer Science Department, BGU Ohad Ben-Shahar Where does visual information go from the eye? Where does
More informationVision II. Steven McLoon Department of Neuroscience University of Minnesota
Vision II Steven McLoon Department of Neuroscience University of Minnesota 1 Ganglion Cells The axons of the retinal ganglion cells form the optic nerve and carry visual information into the brain. 2 Optic
More informationVisual Physiology. Perception and Attention. Graham Hole. Problems confronting the visual system: Solutions: The primary visual pathways: The eye:
Problems confronting the visual system: Visual Physiology image contains a huge amount of information which must be processed quickly. image is dim, blurry and distorted. Light levels vary enormously.
More informationEarly Vision and Visual System Development
Early Vision and Visual System Development Dr. James A. Bednar jbednar@inf.ed.ac.uk http://homepages.inf.ed.ac.uk/jbednar CNV Spring 2009: Vision background 1 Studying the visual system (1) The visual
More informationProject Report: Investigating topographic neural map development of the visual system ELEN E6002
Project Report: Investigating topographic neural map development of the visual system ELEN E6002 Daniel Clark djc2184 May 14, 2013 Overview The human visual system is the most efficient and complex information
More informationSpiking Inputs to a Winner-take-all Network
Spiking Inputs to a Winner-take-all Network Matthias Oster and Shih-Chii Liu Institute of Neuroinformatics University of Zurich and ETH Zurich Winterthurerstrasse 9 CH-857 Zurich, Switzerland {mao,shih}@ini.phys.ethz.ch
More informationLEARNING ARBITRARY FUNCTIONS WITH SPIKE-TIMING DEPENDENT PLASTICITY LEARNING RULE
LEARNING ARBITRARY FUNCTIONS WITH SPIKE-TIMING DEPENDENT PLASTICITY LEARNING RULE Yefei Peng Department of Information Science and Telecommunications University of Pittsburgh Pittsburgh, PA 15260 ypeng@mail.sis.pitt.edu
More informationAnalysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014
Analysis of in-vivo extracellular recordings Ryan Morrill Bootcamp 9/10/2014 Goals for the lecture Be able to: Conceptually understand some of the analysis and jargon encountered in a typical (sensory)
More informationThe Integration of Features in Visual Awareness : The Binding Problem. By Andrew Laguna, S.J.
The Integration of Features in Visual Awareness : The Binding Problem By Andrew Laguna, S.J. Outline I. Introduction II. The Visual System III. What is the Binding Problem? IV. Possible Theoretical Solutions
More informationActivity-Dependent Development II April 25, 2007 Mu-ming Poo
Activity-Dependent Development II April 25, 2007 Mu-ming Poo 1. The neurotrophin hypothesis 2. Maps in somatic sensory and motor cortices 3. Development of retinotopic map 4. Reorganization of cortical
More informationContinuous transformation learning of translation invariant representations
Exp Brain Res (21) 24:255 27 DOI 1.17/s221-1-239- RESEARCH ARTICLE Continuous transformation learning of translation invariant representations G. Perry E. T. Rolls S. M. Stringer Received: 4 February 29
More informationNeuronal Selectivity without Intermediate Cells
Neuronal Selectivity without Intermediate Cells Lund University, Cognitive Science, Kungshuset, Lundagård, S 223 50 Lund, Sweden Robert Pallbo E-mail: robert.pallbo@fil.lu.se Dept. of Computer Science,
More informationObject vision (Chapter 4)
Object vision (Chapter 4) Lecture 8 Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Spring 2015 1 Outline for today: Chap 3: adaptation Chap 4: intro to object vision gestalt
More informationComputational Perception /785. Auditory Scene Analysis
Computational Perception 15-485/785 Auditory Scene Analysis A framework for auditory scene analysis Auditory scene analysis involves low and high level cues Low level acoustic cues are often result in
More informationThe storage and recall of memories in the hippocampo-cortical system. Supplementary material. Edmund T Rolls
The storage and recall of memories in the hippocampo-cortical system Supplementary material Edmund T Rolls Oxford Centre for Computational Neuroscience, Oxford, England and University of Warwick, Department
More informationBeyond bumps: Spiking networks that store sets of functions
Neurocomputing 38}40 (2001) 581}586 Beyond bumps: Spiking networks that store sets of functions Chris Eliasmith*, Charles H. Anderson Department of Philosophy, University of Waterloo, Waterloo, Ont, N2L
More informationPerception & Attention
Perception & Attention Perception is effortless but its underlying mechanisms are incredibly sophisticated. Biology of the visual system Representations in primary visual cortex and Hebbian learning Object
More informationNeuromorphic computing
Neuromorphic computing Robotics M.Sc. programme in Computer Science lorenzo.vannucci@santannapisa.it April 19th, 2018 Outline 1. Introduction 2. Fundamentals of neuroscience 3. Simulating the brain 4.
More informationConsciousness The final frontier!
Consciousness The final frontier! How to Define it??? awareness perception - automatic and controlled memory - implicit and explicit ability to tell us about experiencing it attention. And the bottleneck
More informationEDGE DETECTION. Edge Detectors. ICS 280: Visual Perception
EDGE DETECTION Edge Detectors Slide 2 Convolution & Feature Detection Slide 3 Finds the slope First derivative Direction dependent Need many edge detectors for all orientation Second order derivatives
More informationSpectrograms (revisited)
Spectrograms (revisited) We begin the lecture by reviewing the units of spectrograms, which I had only glossed over when I covered spectrograms at the end of lecture 19. We then relate the blocks of a
More informationWhy is our capacity of working memory so large?
LETTER Why is our capacity of working memory so large? Thomas P. Trappenberg Faculty of Computer Science, Dalhousie University 6050 University Avenue, Halifax, Nova Scotia B3H 1W5, Canada E-mail: tt@cs.dal.ca
More informationRealization of Visual Representation Task on a Humanoid Robot
Istanbul Technical University, Robot Intelligence Course Realization of Visual Representation Task on a Humanoid Robot Emeç Erçelik May 31, 2016 1 Introduction It is thought that human brain uses a distributed
More informationExploring the Functional Significance of Dendritic Inhibition In Cortical Pyramidal Cells
Neurocomputing, 5-5:389 95, 003. Exploring the Functional Significance of Dendritic Inhibition In Cortical Pyramidal Cells M. W. Spratling and M. H. Johnson Centre for Brain and Cognitive Development,
More informationArtificial Neural Networks (Ref: Negnevitsky, M. Artificial Intelligence, Chapter 6)
Artificial Neural Networks (Ref: Negnevitsky, M. Artificial Intelligence, Chapter 6) BPNN in Practice Week 3 Lecture Notes page 1 of 1 The Hopfield Network In this network, it was designed on analogy of
More informationA Neural Network Model of Visual Tilt Aftereffects
To appear in Proceedings of the 19th Annual Conference of the Cognitive Science Society (CogSci-97, Stanford CA), 1997. A Neural Network Model of Visual Tilt Aftereffects James A. Bednar (jbednar@cs.utexas.edu)
More informationBasics of Computational Neuroscience
Basics of Computational Neuroscience 1 1) Introduction Lecture: Computational Neuroscience, The Basics A reminder: Contents 1) Brain, Maps,, Networks,, and The tough stuff: 2,3) Membrane Models 3,4) Spiking
More informationObject recognition and hierarchical computation
Object recognition and hierarchical computation Challenges in object recognition. Fukushima s Neocognitron View-based representations of objects Poggio s HMAX Forward and Feedback in visual hierarchy Hierarchical
More informationCell Responses in V4 Sparse Distributed Representation
Part 4B: Real Neurons Functions of Layers Input layer 4 from sensation or other areas 3. Neocortical Dynamics Hidden layers 2 & 3 Output layers 5 & 6 to motor systems or other areas 1 2 Hierarchical Categorical
More informationA general error-based spike-timing dependent learning rule for the Neural Engineering Framework
A general error-based spike-timing dependent learning rule for the Neural Engineering Framework Trevor Bekolay Monday, May 17, 2010 Abstract Previous attempts at integrating spike-timing dependent plasticity
More informationObject Perception Perceiving and Recognizing Objects
Object Perception Perceiving and Recognizing Objects Extrastriate cortex Outside V1 in occipital lobe Dorsal pathway Ventral pathway Modular organization of visual areas associated with object recognition
More informationInhibition: Effects of Timing, Time Scales and Gap Junctions
Inhibition: Effects of Timing, Time Scales and Gap Junctions I. Auditory brain stem neurons and subthreshold integ n. Fast, precise (feed forward) inhibition shapes ITD tuning. Facilitating effects of
More informationRolls,E.T. (2016) Cerebral Cortex: Principles of Operation. Oxford University Press.
Digital Signal Processing and the Brain Is the brain a digital signal processor? Digital vs continuous signals Digital signals involve streams of binary encoded numbers The brain uses digital, all or none,
More informationModeling of Hippocampal Behavior
Modeling of Hippocampal Behavior Diana Ponce-Morado, Venmathi Gunasekaran and Varsha Vijayan Abstract The hippocampus is identified as an important structure in the cerebral cortex of mammals for forming
More informationInternational Journal of Advanced Computer Technology (IJACT)
Abstract An Introduction to Third Generation of Neural Networks for Edge Detection Being inspired by the structure and behavior of the human visual system the spiking neural networks for edge detection
More informationIntroduction to sensory pathways. Gatsby / SWC induction week 25 September 2017
Introduction to sensory pathways Gatsby / SWC induction week 25 September 2017 Studying sensory systems: inputs and needs Stimulus Modality Robots Sensors Biological Sensors Outputs Light Vision Photodiodes
More informationEffective And Optimal Storage of Memory Patterns With Variable Coding Levels
Effective And Optimal Storage of Memory Patterns With Variable Coding Levels Gal Chechik and Isaac Meilijson School of Mathematical Sciences Tel-Aviv University Tel Aviv 69978, Israel ggal@math.tau.ac.il
More informationWhat is mid level vision? Mid Level Vision. What is mid level vision? Lightness perception as revealed by lightness illusions
What is mid level vision? Mid Level Vision March 18, 2004 Josh McDermott Perception involves inferring the structure of the world from measurements of energy generated by the world (in vision, this is
More informationTheoretical Neuroscience: The Binding Problem Jan Scholz, , University of Osnabrück
The Binding Problem This lecture is based on following articles: Adina L. Roskies: The Binding Problem; Neuron 1999 24: 7 Charles M. Gray: The Temporal Correlation Hypothesis of Visual Feature Integration:
More informationCh.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology
Ch.20 Dynamic Cue Combination in Distributional Population Code Networks Ka Yeon Kim Biopsychology Applying the coding scheme to dynamic cue combination (Experiment, Kording&Wolpert,2004) Dynamic sensorymotor
More informationVisual cortical plasticity
Visual cortical plasticity Deprivation-induced changes in representation Ocular dominance plasticity Retinal scotoma and cortical re-organization Perceptual learning-related plasticity Timing-dependent
More informationTemporal coding in the sub-millisecond range: Model of barn owl auditory pathway
Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway Richard Kempter* Institut fur Theoretische Physik Physik-Department der TU Munchen D-85748 Garching bei Munchen J. Leo van
More informationInput-speci"c adaptation in complex cells through synaptic depression
0 0 0 0 Neurocomputing }0 (00) } Input-speci"c adaptation in complex cells through synaptic depression Frances S. Chance*, L.F. Abbott Volen Center for Complex Systems and Department of Biology, Brandeis
More informationComputational Explorations in Perceptual Learning
Computational Explorations in Perceptual Learning Guillaume Hennequin E H U N I V E R S I T Y T O H F R G E D I N B U Master of Science Cognitive Science and Natural Language Processing School of Informatics
More informationContextual Influences in Visual Processing
C Contextual Influences in Visual Processing TAI SING LEE Computer Science Department and Center for Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA Synonyms Surround influence;
More informationCarlson (7e) PowerPoint Lecture Outline Chapter 6: Vision
Carlson (7e) PowerPoint Lecture Outline Chapter 6: Vision This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public performance or display,
More informationWhat do you notice? Edited from
What do you notice? Edited from https://www.youtube.com/watch?v=ffayobzdtc8&t=83s How can a one brain region increase the likelihood of eliciting a spike in another brain region? Communication through
More informationLearning the Meaning of Neural Spikes Through Sensory-Invariance Driven Action
Learning the Meaning of Neural Spikes Through Sensory-Invariance Driven Action Yoonsuck Choe and S. Kumar Bhamidipati Department of Computer Science Texas A&M University College Station, TX 77843-32 {choe,bskumar}@tamu.edu
More informationDendritic compartmentalization could underlie competition and attentional biasing of simultaneous visual stimuli
Dendritic compartmentalization could underlie competition and attentional biasing of simultaneous visual stimuli Kevin A. Archie Neuroscience Program University of Southern California Los Angeles, CA 90089-2520
More informationExploring the Structure and Function of Brain Networks
Exploring the Structure and Function of Brain Networks IAP 2006, September 20, 2006 Yoonsuck Choe Brain Networks Laboratory Department of Computer Science Texas A&M University choe@tamu.edu, http://research.cs.tamu.edu/bnl
More informationMemory, Attention, and Decision-Making
Memory, Attention, and Decision-Making A Unifying Computational Neuroscience Approach Edmund T. Rolls University of Oxford Department of Experimental Psychology Oxford England OXFORD UNIVERSITY PRESS Contents
More information