Brain Theory and Neural Networks

Transcription

1 The Handbook of Brain Theory and Neural Networks Michael A. Arbib

2

3 Preface ix II.5. Biological Neurons and Networks 4 5 How to Use This Book xiii Biological Neurons 45 Biological Networks 46 Mammalian Brain Regions 48 Part I: Background 1 II.6. Sensory Systems 5 0 How to Use Part I 3 Vision 50 I.1. Introducing the Neuron 4 Other Sensory Systems 52 Basic Properties of Neurons 4 1I.7. Plasticity in Development and Learning 5 3 Receptors and Effectors 7 Mechanisms of Neural Plasticity 53 Neural Models 8 Development and Regeneration of More Detailed Properties of Neurons 10 Neural Networks 54 References 11 Learning in Biological Systems 54 I.2. Levels and Styles of Analysis 11 II.8. Motor Control 5 5 A Historical Fragment 11 Motor Pattern Generators and Neuroethology 55 Brains, Machines, and Minds 13 Biological Motor Control 56 Levels of Analysis 14 Primate Motor Control 5 7 References Dynamics and Adaptation i n Neural Networks 17 Part III : Articles 59 Dynamic Systems 1 7 Adaptation in Dynamic Systems 20 Active Vision 6 1 References 25 Activity-Dependent Regulation of Neurona l Conductances 6 3 Adaptive Control: General Methodology 66 Adaptive Control: Neural Network Applications 6 9 Part II : Road Maps 27 The Meta-Map 29 Adaptive Filtering 74 I1.1. Connectionism : Psychology, Linguistics, and Adaptive Resonance Theory (ART) 79 Artificial Intelligence 31 Adaptive Signal Processing 8 2 Connectionist Psychology 31 Analog VLSI for Neural Networks 8 6 Connectionist Linguistics 32 Analogy-Based Reasoning 9 1 Artificial Intelligence and Neural Networks 33 Applications of Neural Networks 94 II.2. Dynamics, Self-Organization, and Artificial Intelligence and Neural Networks 98 Cooperativity 34 Associative Networks 102 Dynamic Systems and Optimization 34 Astronomy 10 7 Cooperative Phenomena 35 Auditory Cortex 11 0 Self-Organization in Neural Networks 36 Auditory Periphery and Cochlear Nucleus I.3. Learning in Artificial Neural Networks 37 Automata and Neural Networks 11 9 Learning in Artificial Neural Networks, Automatic Target Recognition 12 3 Deterministic 37 Averaging/Modular Techniques for Neural Learning in Artificial Neural Networks, Networks 126 Statistical 38 Axonal Modeling 129 Computability and Complexity 40 Backpropagation : Basics and New Developments 134 II.4. Applications and Implementations 41 Basal Ganglia 13 9 Control Theory and Robotics 41 Bayesian Methods for Supervised Neural Networks 144 Applications of Neural Networks 42 Bayesian Networks 14 9 Implementation of Neural Networks 43 BCM Theory of Visual Cortical Plasticity 153

4 Binding in the Visual System 157 Distributed Artificial Intelligence 322 Biomaterials for Intelligent Systems 159 Dynamic Clamp: Computer-Neural Hybrids 32 6 Boltzmann Machines 162 Dynamic Link Architecture 32 9 Cellular Automata 166 Dynamic Models of Neurophysiological Systems 33 2 Cerebellum and Conditioning 169 Dynamic Remapping 33 5 Cerebellum and Motor Control 172 Dynamics and Bifurcation of Neural Networks 33 9 Chains of Coupled Oscillators 178 Echolocation: Creating Computational Maps 34 4 Chaos in Axons 183 EEG Analysis 34 8 Chaos in Neural Systems 186 Electrolocation 35 2 Classical Learning Theory and Neural Networks 189 Emotion and Computational Neuroscience 35 6 Cognitive Development 193 Emotion-Cognition Interactions 36 0 Cognitive Maps 197 Energy Functions for Neural Networks 36 3 Cognitive Modeling: Psychology and Epilepsy: Network Models of Generation 36 7 Connectionism 200 Equilibrium Point Hypothesis 37 0 Collective Behavior of Coupled Oscillators 203 Evolution of the Ancestral Vertebrate Brain 37 3 Collicular Visuomotor Transformations for Expert Systems and Decision Systems Using Neural Saccades 206 Networks 37 7 Color Perception 210 Exploration in Active Learning 38 1 Command Neurons and Command Systems 215 Eye-Hand Coordination in Reaching Movements 38 5 Competitive Learning 220 Face Recognition 38 8 Compositionality in Neural Systems 223 Fault Tolerance 390 Computer Modeling Methods for Neurons 226 Figure-Ground Separation 39 5 Computing with Attractors 230 Forecasting 39 9 Concept Learning 234 Fractal Strategies for Neural Network Scaling 403 Conditioning 238 Frog Wiping Reflexes 406 Connectionist and Symbolic Representations 243 Fuzzy Logic Systems and Qualitative Knowledge 41 0 Consciousness, Theories of 247 Gabor Wavelets for Statistical Pattern Recognition 41 4 Constrained Optimization and the Elastic Net 250 Gait Transitions 42 0 Convolutional Networks for Images, Speech, and Time Gaze Coding in the Posterior Parietal Cortex 42 3 Series 255 Generalization and Regularization in Nonlinea r Cooperative Behavior in Networks of Learning Systems 426 Chaotic Elements 258 "Genotypes" for Neural Networks 43 1 Cooperative Phenomena 261 Geometrical Principles in Motor Control 434 Corollary Discharge in Visuomotor Coordination 266 Grasping Movements : Visuomotor Cortical Columns, Modules, and Hebbian Cell Transformations 43 8 Assemblies 269 Habituation 44 1 Coulomb Potential Learning 272 Half-Center Oscillators Underlying Rhythmi c Crustacean Stomatogastric System 275 Movements 444 Data Clustering and Learning 278 Handwritten Digit String Recognition 44 7 Dendritic Processing 282 Head Movements: Multidimensional Modeling 45 0 Dendritic Spines 289 Hebbian Synaptic Plasticity 45 4 Developmental Disorders 292 Hebbian Synaptic Plasticity: Comparative and Development and Regeneration of Eye-Brain Developmental Aspects 459 Maps 295 High-Energy Physics 46 4 Diffusion Models of Neuron Activity 299 Hippocampus: Spatial Models 46 8 Digital VLSI for Neural Networks 304 Human Movement: A System-Level Approach 472 Directional Selectivity in the Cortex 309 Identification and Control 47 7 Directional Selectivity in the Retina 312 Illusory Contour Formation 48 1 Disease: Neural Network Models 315 Information Theory and Visual Plasticity 484 Dissociations Between Visual Processing Modes 318 Invertebrate Models of Learning : Aplysia and Distortions in Human Memory 321 Hermissenda 487

5 Investment Management : Tactical Asset NMDA Receptors: Synaptic, Cellular, and Networ k Allocation 491 Models 644 Ion Channels: Keys to Neuronal Specialization 496 Noise Canceling and Channel Equalization 64 8 Kolmogorov's Theorem 501 Nonmonotonic Neuron Associative Memory 65 1 Language Acquisition 503 NSL: Neural Simulation Language 654 Language Change 506 Object Recognition 65 8 Language Processing 508 Ocular Dominance and Orientation Columns 66 0 Layered Computation in Neural Networks 513 Olfactory Bulb 665 Learning and Generalization : Theoretical Olfactory Cortex 669 Bounds 516 Optical Architectures for Neural Network Learning and Statistical Inference 522 Implementations 67 3 Learning as Adaptive Control of Synaptic Optical Components for Neural Networ k Matrices 527 Implementations 67 7 Learning as Hill-Climbing in Weight Space 531 Optimization Principles in Motor Control 68 2 Learning by Symbolic and Neural Methods 533 Oscillatory and Bursting Properties of Neurons 68 6 Learning Vector Quantization 537 Oscillatory Associative Memories 69 1 Lesioned Attractor Networks as Models of PAC Learning and Neural Networks 694 Neuropsychological Deficits 540 Pain Networks 69 8 Limb Geometry: Neural Control 543 Parallel Computational Models 70 2 Linguistic Morphology 546 Pattern Formation, Biological 70 5 Localized Versus Distributed Representations 549 Pattern Recognition 71 1 Locomotion, Invertebrate 553 Perception of Three-Dimensional Structure 71 5 Locust Flight : Components and Mechanisms in the Perceptrons, Adalines, and Backpropagation 71 9 Motor 556 Perceptual Grouping 72 5 Long-Term Depression in the Cerebellum 560 Perspective on Neuron Model Complexity 72 8 Markov Random Field Models in Image Phase-Plane Analysis of Neural Activity 73 2 Processing 564 Philosophical Issues in Brain Theory an d Memory-Based Reasoning 568 Connectionism 73 8 Mental Arithmetic Using Neural Networks 570 Planning, Connectionist 74 1 Minimum Description Length Analysis 572 Post-Hebbian Learning Rules 74 5 Model-Reference Adaptive Control 576 Potential Fields and Neural Networks 74 9 Modular and Hierarchical Learning Systems 579 Principal Component Analysis 75 3 Modular Neural Net Systems, Training of 582 Problem Solving, Connectionist 75 6 Motion Perception 585 Process Control 760 Motion Perception : Self-Organization 589 Programmable Neurocomputing Systems 76 4 Motivation 591 Prosthetics, Neural 768 Motoneuron Recruitment 594 Protein Structure Prediction 772 Motor Control, Biological and Theoretical 597 Pursuit Eye Movements 77 5 Motor Pattern Generation 600 Radial Basis Function Networks 779 Multiprocessor Simulation of Neural Networks 605 Reaching: Coding in Motor Cortex 78 3 Muscle Models 609 Reaching Movements: Implications of Connectionist Neocognitron: A Model for Visual Pattern Models 788 Recognition 613 Reactive Robotic Systems 79 3 Neural Optimization 617 Recurrent Networks: Supervised Learning 796 Neuroanatomy in a Computational Perspective 622 Regularization Theory and Low-Level Vision 800 Neuroethology, Computational 626 Reinforcement Learning 804 Neuromodulation in Invertebrate Nervous Reinforcement Learning in Motor Control 809 Systems 631 Respiratory Rhythm Generation 81 3 Neurosimulators 634 Retina 81 6 Neurosmithing: Improving Neural Network Robot Control 82 0 Learning 639 Routing Networks in Visual Cortex 823

6 viii Contents Saccades and Listing's Law 82 6 Schema Theory 830 Scratch Reflex 834 Selective Visual Attention 83 7 Self-Organization and the Brain 84 0 Self-Organization in the Time Domain 84 3 Self-Organizing Feature Maps : Kohonen Maps 846 Self-Reproducing Automata 85 1 Semantic Networks 85 4 Sensor Fusion 85 7 Sensorimotor Learning 860 Sensory Coding and Information Theory 864 Short-Term Memory 86 7 Silicon Neurons 87 1 Simulated Annealing 87 6 Single-Cell Models 87 9 Somatosensory System 88 4 Somatotopy: Plasticity of Sensory Maps 88 8 Sound Localization and Binaural Processing 89 1 Sparse Coding in the Primate Cortex 89 5 Sparsely Coded Neural Networks 899 Spatiotemporal Association in Neura l Networks 90 2 Speaker Identification 90 5 Speech Recognition: A Hybrid Approach 90 7 Speech Recognition: Feature Extraction 91 0 Speech Recognition: Pattern Matching 91 3 Spinal Cord of Lamprey : Generation of Locomotor Patterns 91 8 Statistical Mechanics of Generalization 92 2 Statistical Mechanics of Learning 92 5 Statistical Mechanics of Neural Networks 930 Steelmaking 934 Stereo Correspondence and Neural Networks 93 7 Stochastic Approximation and Neural Network Learning 94 1 Structural Complexity and Discrete Neural Networks 94 5 Structured Connectionist Models 94 9 Synaptic Coding of Spike Trains 95 3 Synaptic Currents, Neuromodulation, and Kinetic Models 956 Synchronization of Neuronal Responses as a Putativ e Binding Mechanism 960 Telecommunications 96 4 Temporal Pattern Processing 967 Textured Images: Modeling and Segmentation 97 1 Thalamocortical Oscillations in Sleep an d Wakefulness 97 6 Thalamus 98 1 Time Complexity of Learning 984 Time Perception: Problems of Representation and Processing 98 7 Topology-Modifying Neural Network Algorithms 99 0 Traveling Activity Waves 994 Unsupervised Learning with Global Objective Functions 99 7 Vapnik-Chervonenkis Dimension of Neura l Networks 1000 Vestibulo-Ocular Reflex: Performance an d Plasticity Vision for Robot Driving Vision: Hyperacuity 1009 Visual Coding, Redundancy, an d "Feature Detection" Visual Cortex Cell Types and Connections Visual Processing of Object Form and Environment Layout Visual Scene Perception : Neurophysiology Visual Schemas in Object Recognition and Scen e Analysis 1029 Visuomotor Coordination in Flies Visuomotor Coordination in Frogs and Toads Visuomotor Coordination in Salamanders Walking 1045 Wavelet Dynamics 1049 Wave Propagation in Cardiac Muscle and in Nerv e Networks 1054 Winner-Take-All Mechanisms Editorial Advisory Board Contributors Subject Index 1075