Associative Memory-I: Storing Patterns

Transcription

1 Printed from the Mathematica Help Browser 1 «1 of 11 Associative Memory-I: Storing Patterns Learning and recalling memories are important to animals' survival. Navigational memory is important for locating food. Odor memory is important for determining if food is safe to eat. «2 of 11

2 2 Printed from the Mathematica Help Browser Storing Patterns Table Projector Chairs Handouts University Classroom Students White board Some types of memories can be broken up into their constituent elements. A basic element of learning is pattern storage and retrieval. Patterns can consist of sensory, motor, or both elements. «3 of 11

3 Printed from the Mathematica Help Browser 3 Storing Patterns Associatively Table Projector Chairs Handouts University Classroom Students White board Memories can be stored associatively by linking the components together. Associative patterns link elements together. When parts of the pattern are presented, they recruit the other parts, recalling the whole. «4 of 11

4 4 Printed from the Mathematica Help Browser Association with Neurons Populations of neurons can represent the elements in a pattern. Populations of neurons represent elements. Patterns can be stored by synapses in two ways: Æchange in input synaptic strengths Æchange in recurrent synaptic strengths «5 of 11 Association with Neurons

5 Printed from the Mathematica Help Browser 5 Missing elements of a pattern can be recruited by the active elements. Strengthened recurrent synapses can recruit missing elements of a pattern, recalling the original. Associative memory is useful for recalling memories similar to the current situation. «6 of 11 Neurons Associate Place cells respond the same in a maze when all identifying elements are present (full cue) as when most of them are removed (partial cue) [Nakazawa et al, 2002]. After learning to navigate a maze with four identifying elements, mice perform as well when three elements are removed. This can be interpretted as the network performing associative recall. «7 of 11

6 6 Printed from the Mathematica Help Browser Abstract Association: The Hopfield Network The (eight-neuron) Hopfield network is characterized by all-to-all recurrent connectivity and employs a hebbian learning rule to store (eight-bit) binary patterns. The Hopfield network stores patterns by strengthening recurrent synapses among neurons that are in a pattern together. «8 of 11 The Hopfield Network-II

7 Printed from the Mathematica Help Browser 7 Strengthened synapses make some network states more stable than others. The network approaches these stable attractor states. «9 of 11 Neurons Associate with Recurrent Connections Place cells respond less with a partial cue compared to the full cue [Nakazawa et al, 2002]. Genetically eliminating learning at recurrent CA3 synapses (by eliminating NMDARs) damages place cell activity. After learning to navigate a maze with four identifying elements, mutuant mice perform poorly when three elements are removed. «10 of 11

8 8 Printed from the Mathematica Help Browser A More Biological Model-I Our network is characterized by spiking neurons that make random local recurrent connections to each other that employs STDP to store binary patterns. Like the Hopfield network, our network stores patterns by strengthening recurrent synapses among coactive neurons. «11 of 11 A More Biological Model-II Before STDP After STDP Rate(Hz)

9 Printed from the Mathematica Help Browser 9 After STDP stores a pattern, potentiated neurons recall the whole pattern when half of the neurons in the pattern are activated. The network recalls a pattern when a subset of its neurons are activated.