Associative Memory-I: Storing Patterns

Similar documents
Artificial Neural Networks (Ref: Negnevitsky, M. Artificial Intelligence, Chapter 6)

The storage and recall of memories in the hippocampo-cortical system. Supplementary material. Edmund T Rolls

STDP enhances synchrony in feedforward network

Modeling of Hippocampal Behavior

Cerebral Cortex. Edmund T. Rolls. Principles of Operation. Presubiculum. Subiculum F S D. Neocortex. PHG & Perirhinal. CA1 Fornix CA3 S D

Navigation: Inside the Hippocampus

ASSOCIATIVE MEMORY AND HIPPOCAMPAL PLACE CELLS

Rolls,E.T. (2016) Cerebral Cortex: Principles of Operation. Oxford University Press.

Improving Associative Memory in a Network of Spiking

Synaptic plasticity and hippocampal memory

Long-term synaptic plasticity. N500, 6 Sept., 2016

Beyond Vanilla LTP. Spike-timing-dependent-plasticity or STDP

CCEI120- Brain Development and the Effects of Early Deprivation - Handout

UNINFORMATIVE MEMORIES WILL PREVAIL

Basics of Computational Neuroscience: Neurons and Synapses to Networks

Supplementary Figure 1. Basic properties of compound EPSPs at

A model of the interaction between mood and memory

Molecular and Circuit Mechanisms for Hippocampal Learning

Synaptic Plasticity and Connectivity Requirements to Produce Stimulus-Pair Specific Responses in Recurrent Networks of Spiking Neurons

COMPUTATIONAL INTELLIGENCE Vol. I - Associative Learning - Hava T. Siegelmann, Robert Kozma

Brain & Behavior Syllabus V Instructor Mike Hawken Spring 2006

Artificial Neural Networks

Synfire chains with conductance-based neurons: internal timing and coordination with timed input

Memory: Computation, Genetics, Physiology, and Behavior. James L. McClelland Stanford University

LONG TERM MEMORY. Learning Objective Topics. Retrieval and the Brain. Retrieval Neuroscience of Memory. LTP Brain areas Consolidation Reconsolidation

Prior Knowledge and Memory Consolidation Expanding Competitive Trace Theory

Learning in neural networks

Acetylcholine again! - thought to be involved in learning and memory - thought to be involved dementia (Alzheimer's disease)

Cell Responses in V4 Sparse Distributed Representation

Evaluating the Effect of Spiking Network Parameters on Polychronization

An attractor network is a network of neurons with

Part 11: Mechanisms of Learning

Neural coding and information theory: Grandmother cells v. distributed codes

7.012 Problem Set 7. c) What % of females in this population should be red-green colorblind?

Behavioral Neurobiology

Memory retention the synaptic stability versus plasticity dilemma

Oxford Foundation for Theoretical Neuroscience and Artificial Intelligence

This Lecture: Psychology of Memory and Brain Areas Involved

Computational approach to the schizophrenia: disconnection syndrome and dynamical pharmacology

Neuroplasticity What Graduate Students Need to Know about Learning, Memory and Development

Holding Multiple Items in Short Term Memory: A Neural Mechanism

Encoding Spatial Context: A Hypothesis on the Function of the Dentate Gyrus-Hilus System

PSY 215 Lecture 13 (3/7/11) Learning & Memory Dr. Achtman PSY 215. Lecture 13 Topic: Mechanisms of Learning and Memory Chapter 13, section 13.

Free recall and recognition in a network model of the hippocampus: simulating effects of scopolamine on human memory function

Preparing More Effective Liquid State Machines Using Hebbian Learning

Computing with Spikes in Recurrent Neural Networks

Storage: Retaining Information

arxiv: v1 [cs.ne] 18 Mar 2017

Neuroplasticity:. Happens in at least 3 ways: - - -

VS : Systemische Physiologie - Animalische Physiologie für Bioinformatiker. Neuronenmodelle III. Modelle synaptischer Kurz- und Langzeitplastizität

BRAIN PLASTICITY. Neuroplasticity:. Happens in at least 3 ways: - - -

Intelligent Control Systems

LECTURE 2. C. Reason correlation and synaptic delay not enough to prove direct connection. D. Underlying mechanism behind oscillations possibilities

From spike frequency to free recall: How neural circuits perform encoding and retrieval.

Representational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex

Introduction to Physiological Psychology Learning and Memory II

Theories of memory. Memory & brain Cellular bases of learning & memory. Epileptic patient Temporal lobectomy Amnesia

Synaptic plasticity. Mark van Rossum. Institute for Adaptive and Neural Computation University of Edinburgh

35-2 The Nervous System Slide 1 of 38

SUPPLEMENTARY INFORMATION

Observational Learning Based on Models of Overlapping Pathways

CRISP: Challenging the Standard Framework of Hippocampal Memory Function

Winter 2017 PHYS 178/278 Project Topics

A neural circuit model of decision making!

COGNITIVE SCIENCE 107A. Hippocampus. Jaime A. Pineda, Ph.D.

Neurobiology and Information Processing Theory: the science behind education

arxiv: v1 [q-bio.nc] 25 Apr 2017

A general error-based spike-timing dependent learning rule for the Neural Engineering Framework

Multi-Associative Memory in flif Cell Assemblies

will examine how the network behaves under exposure of different concentrations of drugs affecting the AMPA/kainate, NMDA, and, serotonin (5-HT) recep

Elliot D. Menschik, Shih-Cheng Yen, and Leif H. Finkel

Long-term depression and recognition of parallel "bre patterns in a multi-compartmental model of a cerebellar Purkinje cell

A General Theory of the Brain Based on the Biophysics of Prediction

Learning. Learning: Problems. Chapter 6: Learning

The Ever-Changing Brain. Dr. Julie Haas Biological Sciences

Synaptic theory of gradient learning with empiric inputs. Ila Fiete Kavli Institute for Theoretical Physics. Types of learning

An attractor hypothesis of obsessive compulsive disorder

Lecture 1: Neurons. Lecture 2: Coding with spikes. To gain a basic understanding of spike based neural codes

11/2/2011. Basic circuit anatomy (the circuit is the same in all parts of the cerebellum)

The Central Auditory System

Memory Systems II How Stored: Engram and LTP. Reading: BCP Chapter 25

Nature Neuroscience: doi: /nn Supplementary Figure 1. Behavioral training.

Chapter 6: Hippocampal Function In Cognition. From Mechanisms of Memory, second edition By J. David Sweatt, Ph.D.

Associative memory properties of multiple cortical modules

Recurrently Connected Silicon Neurons with Active Dendrites for One-Shot Learning

Reversed and forward buffering of behavioral spike sequences enables retrospective and prospective retrieval in hippocampal regions CA3 and CA1

Required Text: Biological Psychology Breedlove et al. Sinauer, 2007, Fifth Edition

SUPPLEMENTARY INFORMATION. Supplementary Figure 1

Bundles of Synergy A Dynamical View of Mental Function

You submitted this quiz on Sun 19 May :32 PM IST (UTC +0530). You got a score of out of

Activity 2 The Brain and Drugs

NEURONS COMMUNICATE WITH OTHER CELLS AT SYNAPSES 34.3

Ch 8. Learning and Memory

Study of the Brain. Notes

Ch 8. Learning and Memory

Active Sites model for the B-Matrix Approach

Decision-making mechanisms in the brain

Synchrony Detection by Analogue VLSI Neurons with Bimodal STDP Synapses

Noise in attractor networks in the brain produced by graded firing rate representations

Transcription:

Printed from the Mathematica Help Browser 1 «1 of 11 Associative Memory-I: Storing Patterns Learning and recalling memories are important to animals' survival. Navigational memory is important for locating food. Odor memory is important for determining if food is safe to eat. «2 of 11

2 Printed from the Mathematica Help Browser Storing Patterns Table Projector Chairs Handouts University Classroom Students White board Some types of memories can be broken up into their constituent elements. A basic element of learning is pattern storage and retrieval. Patterns can consist of sensory, motor, or both elements. «3 of 11

Printed from the Mathematica Help Browser 3 Storing Patterns Associatively Table Projector Chairs Handouts University Classroom Students White board Memories can be stored associatively by linking the components together. Associative patterns link elements together. When parts of the pattern are presented, they recruit the other parts, recalling the whole. «4 of 11

4 Printed from the Mathematica Help Browser Association with Neurons Populations of neurons can represent the elements in a pattern. Populations of neurons represent elements. Patterns can be stored by synapses in two ways: Æchange in input synaptic strengths Æchange in recurrent synaptic strengths «5 of 11 Association with Neurons

Printed from the Mathematica Help Browser 5 Missing elements of a pattern can be recruited by the active elements. Strengthened recurrent synapses can recruit missing elements of a pattern, recalling the original. Associative memory is useful for recalling memories similar to the current situation. «6 of 11 Neurons Associate Place cells respond the same in a maze when all identifying elements are present (full cue) as when most of them are removed (partial cue) [Nakazawa et al, 2002]. After learning to navigate a maze with four identifying elements, mice perform as well when three elements are removed. This can be interpretted as the network performing associative recall. «7 of 11

6 Printed from the Mathematica Help Browser Abstract Association: The Hopfield Network The (eight-neuron) Hopfield network is characterized by all-to-all recurrent connectivity and employs a hebbian learning rule to store (eight-bit) binary patterns. The Hopfield network stores patterns by strengthening recurrent synapses among neurons that are in a pattern together. «8 of 11 The Hopfield Network-II

Printed from the Mathematica Help Browser 7 Strengthened synapses make some network states more stable than others. The network approaches these stable attractor states. «9 of 11 Neurons Associate with Recurrent Connections Place cells respond less with a partial cue compared to the full cue [Nakazawa et al, 2002]. Genetically eliminating learning at recurrent CA3 synapses (by eliminating NMDARs) damages place cell activity. After learning to navigate a maze with four identifying elements, mutuant mice perform poorly when three elements are removed. «10 of 11

8 Printed from the Mathematica Help Browser A More Biological Model-I Our network is characterized by spiking neurons that make random local recurrent connections to each other that employs STDP to store binary patterns. Like the Hopfield network, our network stores patterns by strengthening recurrent synapses among coactive neurons. «11 of 11 A More Biological Model-II Before STDP After STDP Rate(Hz) 8 6 4 2 0

Printed from the Mathematica Help Browser 9 After STDP stores a pattern, potentiated neurons recall the whole pattern when half of the neurons in the pattern are activated. The network recalls a pattern when a subset of its neurons are activated.