Synchrony-Induced Switching Behavior of Spike Pattern Attractors Created by Spike-Timing-Dependent Plasticity
|
|
- Everett Williamson
- 5 years ago
- Views:
Transcription
1 LETTER Communicated by Markus Diesmann Synchrony-Induced Switching Behavior of Spike Pattern Attractors Created by Spike-Timing-Dependent Plasticity Takaaki Aoki Graduate School of Informatics, Kyoto University, Kyoto , Japan, and CREST, JST, Kyoto , Japan Toshio Aoyagi Graduate School of Informatics, Kyoto University, Kyoto , Japan Although context-dependent spike synchronization among populations of neurons has been experimentally observed, its functional role remains controversial. In this modeling study, we demonstrate that in a network of spiking neurons organized according to spike-timing-dependent plasticity, an increase in the degree of synchrony of a uniform input can cause transitions between memorized activity patterns in the order presented during learning. Furthermore, context-dependent transitions from a single pattern to multiple patterns can be induced under appropriate learning conditions. These findings suggest one possible functional role of neuronal synchrony in controlling the flow of information by altering the dynamics of the network. 1 Introduction Although synchronous activity associated with behavior and cognition has been observed in many neuronal systems (Gray, König, Engel, & Singer, 1989; Riehle, Grün, Diesmann, & Aertsen, 1997; Fries, Reynolds, Rorie, & Desimone, 2001), its functional role remains unclear (Engel, Fries, & Singer, 2001; Salinas & Sejnowski, 2001; Shadlen & Movshon, 1999; Ermentrout & Kleinfeld, 2001). It is reasonable to assume that such generated synchronous spikes drive certain cortical networks as input signals and thereby affect their functions (Brody & Hopfield, 2003; Diesmann, Gewaltig, & Aertsen, 1999). Another related phenomenon is spike-timing-dependent plasticity (STDP) (Bi & Poo, 1998; Zhang, Tao, Holt, Harris, & Poo, 1998; Debanne, Gahwiler, & Thompson, 1998; Markram, Lübke, Frotscher, & Sakmann, 1997; Song, Miller, & Abbott, 2000; Rubin, Lee, & Sompolinsky, 2001), which allows cortical networks to learn the causality of experienced events through the coding of the temporal structures of neuronal activity. Considering that both phenomena affect the functioning of cortical neurons, it is Neural Computation 19, (2007) C 2007 Massachusetts Institute of Technology
2 Synchrony-Induced Switching Behavior 2721 natural to ask what effect synchronous inputs have on a neural network organized under STDP learning. For this purpose, let us consider the specific situation in which a model network of spiking neurons, whose synaptic connections are modified through STDP, receives an activity pattern as an external stimulus as a result of the experiencing of some external events. In general, these activity patterns possess some systematic temporal structure reflecting the causality of these external events (Hebb, 1949; Dan & Poo, 2004; Izhikevich, 2006). In this study, we demonstrate that a network organized under STDP not only is capable of memorizing the activity patterns of the external stimulus, but also exhibits a systematic transition behavior among the memorized patterns in response to uniform external synchronized spikes. First, in section 2, we describe the structure of the network model and the learning process of STDP. Next, we investigate the behavior of the network organized under STDP, for the case of asynchronous (see section 3.1) and transient synchronized spike inputs (see section 3.2). From these results, to understand the essential mechanism of switching behavior of the network, in section 3.3 we develop a stability analysis of the memorized pattern in a simplified version of the network model. In section 3.4, we also demonstrate that a context-dependent switching behavior can be achieved under some appropriate learning conditions. Finally, in section 4, we discuss the mechanism of the synchrony-induced switching behavior of the network from the point of view of dynamical systems. In relation to recent experimental findings, we discuss the putative functional rules of neuronal synchrony. 2 Model Figure 1A presents a schematic illustration of the model network we consider, in which leaky integrate-and-fire neurons are recurrently connected by excitatory synapses whose coupling strengths are modified according to the STDP rule (Song et al., 2000; van Rossum, Bi, & Turrigiano, 2000; Cateau & Fukai, 2003). Thus, if a presynaptic spike and a postsynaptic spike occur at times t pre and t post, the peak synaptic conductance g is modified by the addition of the value of the STDP window function F (t pre t post ), as shown in Figure 1B. The synaptic conductance g is restricted to lie within the range 0 to gmax E. To enforce this restriction, if the STDP rule causes g to take a value outside this range, it is reset to the appropriate limiting value. In addition, a globally uniform inhibition without modification of learning is included in an all-to-all manner (see appendix A for a full description of the simulation). We employ two types of controllable external inputs. One is a stimulus input, in which an initial stimulus pattern and a training stimulus pattern are presented during a trial and a learning session, respectively. For learning, we use a simple training stimulus pattern, as depicted in Figure 1C. This pattern is divided into three parts consisting of firing patterns, referred
3 2722 T. Aoki and T. Aoyagi Figure 1: (A) Schematic diagram depicting the structure of the network model with spike-timing-dependent plasticity (STDP). Each leaky integrate-and-fire neuron receives two external inputs. One is a stimulus input, which is a neuronspecific current used to set a given firing pattern in the network for the learning and initial stimulus. The other is an activation input, which projects to all neurons uniformly. For the activation input, there are two modes: asynchronous and synchronous. Within the network, each neuron is connected reciprocally by an excitatory synaptic coupling, whose strength is modified according to the STDP rule. In addition, all-to-all uniformly inhibitory connections are included. (B) The STDP window function. (C) The activity pattern presented by the stimulus input during learning. Each dot represents a spike presented in the corresponding stimulus input. This whole pattern consists of three basic firing patterns in the fixed order A,B,C,A,B,C. to as A, B, and C, in which each is composed of a particular set of active neurons. These neurons that are active for a given pattern fire periodically, and in each pattern, there are certain fixed phase relationships among the active neurons. During learning, these three patterns are presented as the stimulus input (see Figure 1A) in the fixed order (A,B,C,A,B,C ). This can be regarded as representing a certain external sequence of events that the network is to learn in other words, the causality of certain external events. The other type of controllable input is an activation input, which projects to all neurons uniformly. This input is introduced to examine the effect
4 Synchrony-Induced Switching Behavior 2723 of synchrony on the neuronal dynamics. This uniform background input serves to activate the entire network and allow each neuron to be in a firing state under suitable conditions. There are two modes of neuronal activity for the activation input: asynchronous and synchronous modes. In the asynchronous mode, spike trains are randomly generated by a Poisson process. During learning, the activation input is always in the asynchronous mode. In the synchronous mode, some of the neurons fire synchronously, while the other neurons remain in the asynchronous firing state. The fraction of neurons firing synchronously represents the degree of synchrony. To remove the influence of firing-rate modulation, in both modes, the average firing-rate is set to the same constant value, 25 Hz. 3 Results 3.1 Associative Memory Behavior. The main question of interest in this study is the following: After the STDP learning process described above has been completed, what activity pattern does the resultant network exhibit? To answer this question, we first examine the case in which the activation input is set in the asynchronous mode, with the level of the total current such that the neurons are in an active state in response to an appropriate stimulus input and maintain an active state through recurrent excitatory synapses organized under the STDP. In the following simulations, we use the condition that the synaptic weights are fixed after learning. This condition is reasonable under a situation in which the dynamics of the synaptic modification is much slower than that of the spiking activity. For our model under these conditions, Figure 2A illustrates some typical activity patterns displayed by the network (top), the stimulus input (middle), and the activation input (bottom) as raster plots. In each case, a stimulus input that is close to one of the learned patterns is applied for only a brief initial time interval. Apparently, in the situation considered, the activity pattern rapidly converges to the closest learned pattern. Without an input stimulus, this recalled activity pattern is sustained by the excitatory synaptic connections organized through the learning process and suppresses the other memorized patterns with all-to-all inhibitory connections. Therefore, if the wrong neurons fire accidentally, the network activity is corrected and maintained in a robust manner. Such behavior is of the same type as that typically seen in systems exhibiting associative memory dynamics, like the Hopfield model (Hopfield, 1982), except that these retrieval dynamics contain not only information regarding the firing rate but also that regarding the temporal structure of each learned pattern in the present case. 3.2 Synchrony-Induced Switching Behavior. The situation described above is that in which the system recalls one of the three learned patterns and remains in the corresponding state indefinitely. However, in the
5 2724 T. Aoki and T. Aoyagi
6 Synchrony-Induced Switching Behavior 2725 learning process, the network learned these three patterns not independently but in the particular order depicted in Figure 1C. This large-scale structure can be interpreted as reflecting the causality of some sequence of external events. Thus, because these transitions themselves are included in the training pattern, they too are encoded in the synaptic matrix (see Figure 2B). However, because during the learning process, the individual patterns A, B, and C are presented many times in succession, while the transitions between these patterns appear much less often, the network has much less experience with these transitions. Hence, the network does not learn these transitions as well as the individual patterns, and therefore the synaptic coupling corresponding to the transitions among patterns is relatively weak. In fact, we can see clearly that three diagonal blocks of major synaptic connections, which are formed by the three basic stimulus patterns (A,B,C), enable the network to retrieve each pattern in an associative manner. In addition, there are three off-diagonal blocks of weak synaptic connections arising from the less frequent transitions among the stimulus patterns as shown in Figure 1C. Because the synaptic connections for transitions are relatively weak, under ordinary conditions, each individual pattern is sufficiently stable that no transition among patterns occurs. Is there any situation in which these weak synapses arising through STDP from the pattern transitions presented in the learning process yield a substantial effect on the dynamics of the network? Interestingly, Figure 2C demonstrates that a brief period of synchrony in the uniform activation input can enhance this weak effect embedded in the synaptic matrix and thereby cause a transition from the one pattern to another. Let us describe the process depicted in that figure. First, the network exhibits pattern A, which is stable when the activation input is in the asynchronous mode. Thus, in this Figure 2: Typical effect of a uniformly synchronized spike input on the network of spiking neurons organized under the STDP learning rule. (A) Typical activity patterns (top raster plots) in the case that the activation input is in the asynchronous mode (bottom raster plots). In response to the brief presentation of the initial firing pattern of the stimulus input (middle raster plots), the network rapidly converges to the learned pattern that is most similar to this stimulus input. (B) Gray-scale plot of the normalized strengths of excitatory synapses between neurons after the STDP learning. (C) Synchrony-induced switching behavior of the network realized through the STDP learning rule. The situation here is the same as that depicted in Figure 2A, except that in this case, the mode in the activation input temporally changes from asynchrony to synchrony for the time interval indicated by the double-arrowed lines. In response to this brief synchronous activation input, the activity pattern becomes unstable and, consequently, a transition to the next pattern occurs. (D) The same kind of synchrony-induced switching behavior also occurs in the case of more general patterns.
7 2726 T. Aoki and T. Aoyagi case, the network exhibits ordinary associative memory. However, when the activation input is switched for a brief time to the synchronous mode, a transition from the pattern A to the pattern B occurs. Hence, the retrieval of a learned sequence in the presented order can be triggered by globally uniform synchronous inputs. The off-diagonal weak synaptic connections, as shown in Figure 2B, have no effect on the retrieval dynamics under ordinary conditions, as demonstrated in Figure 2A. However, the effect of these weak synapses can be enhanced by synchronous spike inputs, as showninfigure2c. Note that in the situation studied here, the sets of neurons that are active in patterns A, B, and C are mutually exclusive. This is a somewhat severe restriction. However, we have found that the qualitative nature of these results is the same in the more general case that we allow some of the individual neurons to be active in more than one of the patterns, as long as the number of such neurons is not too large. In fact, we can clearly see from Figure 2D that the same synchrony-induced switching behavior occurs in this case. The top graph shows a dot image, in which the gray level of a dot represents the average firing rate over 200 ms (black underbars). The condition that a relatively small number of neurons are active in multiple patterns is biologically reasonable, because the mean firing rate of memory patterns is usually low in biological systems (a situation referred to as sparse coding) (Willshaw, Buneman, & Longuet-Higgins, 1969). In addition, it is important to note that many types of observed synchronous activity accompanying cognition and behavior (Gray et al., 1989; Riehle et al., 1997; Fries et al., 2001) are transient, and there have been a number of theoretical studies aimed at understanding the related neuronal mechanism (Aoyagi, Takekawa, & Fukai, 2003; Tiesinga & Sejnowski, 2004). 3.3 Stability Analysis of the Retrieval State. Theoretical analysis is helpful to understand the essential mechanism of synchrony-induced switching, but a full analytical treatment of a synaptic matrix organized through STDP is very difficult. For this reason, we instead consider a simplified version of the synaptic matrix, keeping the essential properties of the original one, as given by g E ij = ge max N P P µ=1 ζ µ i ζ µ j P 1 + ɛ µ=1 ζ µ+1 i ζ µ j, { 1 (x 0) (x) = 0 (x < 0), (3.1) where P is the total number of the stored patterns, and ζ µ i represents the state in the ith neuron in the µth pattern and takes only two values: 1 (firing) and 0 (quiescent). N P (=< i ζ µ i > µ ) is the averaged number of active neurons
8 Synchrony-Induced Switching Behavior 2727 Figure 3: (A) The same synchrony-induced switching behavior can be observed in a simplified version of synapses matrix described in equation 3.1. (ɛ = 0.3) (B) Using this simplified model, we theoretically obtained the two-parameter phase diagram, showing the dependence of the stability of the learned pattern on the synaptic delay and the relative coupling strength ɛ of the two terms. The present state, one of the learned patterns, is stable if the point (, ɛ) is located below the solid curve (dashed curve) for the case of the asynchronous (synchronous) mode of the activation input. In the shaded region, the learned pattern becomes unstable in response to the switching of the mode of the activation input from asynchrony to synchrony. This leads finally to a transition to the next pattern. It is thus seen that the transition-inducing effect of the weak synaptic coupling is enhanced by the synchrony. The parameter values used in Figure 3A are indicated by the +.
9 2728 T. Aoki and T. Aoyagi over all stored patterns. This simplified matrix is constructed by summing two terms with the relative strength ɛ; the first term ensures the stable retrieval of each learned basic pattern (Hopfield, 1982; Willshaw et al., 1969; Gerstner & van Hemmen, 1992), and the second term is a small term (ɛ <1) whose effect is to cause a transition among learned patterns. This simplified matrix makes the previous model theoretically tractable, while providing a reasonable approximation of the original model. In Figure 3A, the same type of synchrony-induced switching behavior can be observed in this simplified model. Using this model, we examined the effect of changing the mode of the activation input on the stability of the current retrieval patterns (see appendix B). The result is displayed in Figure 3B. There, the dependence of the stability on the synaptic delay and the relative coupling strength ɛ of the two terms is plotted. In the shaded region, the current retrieval pattern is maintained for asynchronous mode in activation input, whereas the same pattern is unstable for synchronous mode. In other words, a change in the stability of the retrieval pattern occurs in response to a synchrony-asynchrony switching in the activation input. This stability analysis does not answer what spike pattern the network exhibits after the synchrony-asynchrony switching. However, considering the effect of the small off-diagonal term in the synaptic weight (see Equation 3.1), which tends to cause the transition among the patterns, Figure 4: (A) Context-dependent switching behavior can be realized by using the appropriate training pattern. The top and bottom raster plots represent the activity patterns in the network and the activation input, respectively. The lengths of the red double-arrowed lines indicate one period of the firing pattern A, while the red vertical lines indicate the onset times of the switching from asynchrony to synchrony in the activation input. It is thus seen how the network can be caused to make a transition from one given pattern to either of the other two patterns by appropriately controlling the onset time of the synchronous mode. (B) Timing-selective connections organized under STDP reflecting the nature of the training data. For pattern A, the neuron that fires at an early phase has a weak off-diagonal connection for a transition to pattern B, whereas the neuron that fires at a later phase has a connection for pattern C. The normalized strengths of excitatory synapses between neurons are plotted with gray scales. (C) Interpretation of the synchrony-induced switching behavior from the point of view of dynamical systems. When the network is activated by a uniformly asynchronous spike input, the system possesses some attractors formed by the STDP learning rule (left). However, a brief, uniformly synchronous input activates the paths between attractors, leading to a transition to the next pattern in the learned order (middle). Furthermore, the system can exhibit contextdependent switching behavior, in which the subsequently appearing pattern can be determined by appropriately choosing the position of the orbit at the onset time of the synchronous pattern, as demonstrated in Figure 4A (right).
10 Synchrony-Induced Switching Behavior 2729
11 2730 T. Aoki and T. Aoyagi it is likely that the state in the network moves near the next learned pattern. Consequently, when the activation input becomes asynchronous again, the network activity converges toward the next learned pattern in an associative manner. For successful transition among the learned patterns, it is required that the length of the period of synchronized spike input is appropriate. In general, the desirable value of this period ( ms in this case) depends on the model parameters. It is found that too short a period cannot trigger the transition to the next pattern, so that the network stays on the same pattern, whereas a period that is too long tends to make the transition uncontrollable. Hence, an appropriate transient synchrony of the activation input is able to activate the effect of the weak coupling and consequently induce a transition from one state to the next in the learned order. In relation to this mechanism, it has been reported that synchrony causes a similar destabilization phenomenon in the case of a winner-take-all competition (Lumer, 2000), and in the case of conventional neural networks, a change in the uniform external field can cause a transition between memorized patterns under suitable conditions (Amit, 1988). 3.4 Context-Dependent Switching Behavior. The synchrony-induced switching mechanism realized in a model with STDP has a greater ability to cause the network to encode the context-dependent association set by the training data. Figure 4A demonstrates that the network is able to make a transition from the pattern A to either pattern B or C, depending on the onset time of the synchronous mode. When the mode of the activation input changes from asynchrony to synchrony early in the period of pattern A, a transition from pattern A to pattern B occurs, whereas when this mode change takes place later in the period, a transition from pattern A to pattern C occurs. This context-dependent behavior is due to the nature of the training data, in which the transition to pattern B (C) occurs during the first (second) half of a period of firing activity of pattern A. Therefore, the difference in the temporal structure of pattern A at the time of the transition organizes a selective synaptic connection among the neurons: the neurons that fire early in pattern A tend to make excitatory connections to the neurons that fire in pattern B, while the neurons at a later phase form connections to the neurons of pattern C (see Figure 4B). Owing to this selective connection organized under STDP, which patterns (B or C) the network makes a transition to depends on the onset time of the external synchronized spikes, equivalently, the corresponding temporal structure of pattern A. In summary, for the context-dependent switching described to appear, it is necessary that the activity pattern have a temporal structure that varies in time periodically. The temporal firing pattern exhibited by the network depends on the onset time of the synchronous mode. This dependence endows the network with the ability to make a transition from a single pattern to multiple patterns in a context-dependent manner through STDP learning.
12 Synchrony-Induced Switching Behavior Conclusion We have demonstrated that a network organized under STDP is capable of exhibiting synchrony-induced switching behavior, in which a transition from one firing state to another occurs in response to brief, uniform synchronous spike inputs. In the case of uniformly random spike inputs, the firing state converges to the learned pattern that is closest to the external cue stimulus. Then a synchrony-asynchrony transition in the activation input can induce a transition from one pattern to the next in the order that the learned patterns were presented during training. From the perspective of dynamical systems, in the case of the asynchronous mode, the network possesses certain attractors acquired through STDP learning, as shown in Figure 4C (left). The weak synaptic connections formed through the influence of the transitions among training patterns have no effect on the retrieval dynamics in the asynchronous mode. However, when the network is subject to a uniformly synchronous input, the dynamical properties of the network change drastically. This brief synchronous input activates the paths corresponding to the transitions among individual patterns that were weakly encoded in the synaptic matrix during the learning process, leading to a transition between patterns in the order in which they were presented. This result suggests that synchronous spikes may act as a signal in biological systems, serving to link learned sequences of actions in response to some external stimuli (Riehle et al., 1997; Lee, 2003). Furthermore, the network has the ability to carry out more complicated tasks, as demonstrated in Figure 4A. As shown there, the attractor corresponding to the pattern appearing after the transition can be switched in a context-dependent manner by controlling the position of the orbit on the attractor at the time that the uniform synchronous input is applied (see Figure 4C). Computationally, the mechanism studied here seems to provide a sophisticated method by which a neuronal system can carry out a task in a context-dependent manner. It has been pointed out that although the amount of information encoded by correlated activity may be small, coherent neuronal activity is observed during particular cognitive and behavioral tasks (Salinas & Sejnowski, 2001; Averbeck & Lee, 2004). Our results suggest that one possible functional role of neuronal synchrony is to control the flow of information by changing the nature of the dynamical system constituted by a set of neuronal circuits. We believe that some experimental results can be more clearly reinterpreted using our results. Appendix A: Detailed Model A.1. Dynamics. In the network of spiking neurons we employ (see Figure 1A), the dynamics of each neuron are described by a leaky
13 2732 T. Aoki and T. Aoyagi integrate-and-fire model, τ m dv i (t) dt = (V i (t) V rest ) + R m ( I E i (t) + I I (t) +I Act (t) + I Stim i (t) ), (A.1) with τ m = 20 ms, V rest = 65 mv, and R m = 100 M. Whenever V i (t) reaches the threshold voltage, V th = 50 mv, a spike is generated, and V i (t) is instantaneously reset to the resting potential, V rest. The synaptic currents due to excitatory and inhibitory connections are given by Ii E (t) = N j n ge ij α(t tn j ) andi I (t) = g I N j n α(t tn j ), respectively. Here, each spike-mediated postsynaptic potential is expressed in terms of the α function, which is given by α(t) = t exp( t ) for t 0andα(t) = 0 τ 2 τ elsewhere. Here is the synaptic delay, and τ is a time constant. We set = 1msandτ = 4 ms/2 ms for excitatory/inhibitory. The values t n j (n = 1,2, ) are the spike times of the jth presynaptic neuron. The inhibitory synaptic weight is g I = 21 ns uniformly, while the excitatory one, g ij, ranges from 0 to 30 ns (= gmax E ), according to the STDP learning (see Figure 1B). We studied networks consisting of N = 1500 (see Figure 2A) and N = 1600 neurons (see Figure 2C). The stimulus current is given by Ii Stim (t) = g Stim n α(t tn i(stim) ), where the quantities t n i(stim) (n = 1,2, ) are the times at which the ith neuron receives a spike from the stimulus input. The uniform current from the activation input is given by I Act (t) = gact N k Act n α(t tn k(act) ), where tn k(act) (n = 1,2, ) are the spike times of the kth spike train in the activation input. The parameter values g Stim = 1000 ns and g Act /N Act = 5.1 ns are used. The total number of spike trains in the activation input is In asynchronous mode, each spike train from the activation input is generated by a Poisson process with frequency 25 Hz. In the synchronous mode, some of the neurons fire synchronously, while the other neurons remain in the asynchronous firing state. The fraction of neurons firing synchronously represents the degree of synchrony (the ratio of synchronized neurons ρ = 0.6). In addition, these synchronized neurons are not completely synchronized, but exhibit some fluctuation in time, which is generated by a gaussian distribution with σ = 3 ms. In the case of the simplified model (see Figure 3A), we use the same values for the model parameters, except that we use ratio ρ = 0.3 for the degree of synchrony, gmax E = 4.5 µs for the synaptic weight of excitatory, and τ = 4 ms for the synaptic time constant of both excitatory and inhibitory neurons. A.2. STDP Learning. For each pair of pre- and postsynaptic spikes, the corresponding synaptic conductance is modified by g
14 Synchrony-Induced Switching Behavior 2733 g + F (t pre t post ). The STDP window function F (t pre t post ) is then given by F (t pre t post ) = { A+ exp( t τ ) ( t 0) A exp( t τ ) ( t > 0), (A.2) where τ is the time constant of the exponential decay, which determines the effective time range of the STDP window function. The synaptic weights are updated by the STDP update rule every time a postsynaptic neuron receives a spike. When the axonal synaptic delay is taken into account, the effective time difference to be used in the update rule is modified to be t = t pre + t post. To avoid unlimited synaptic growth, the ratio of the negative and positive area of the STDP window function, A /A +,must be a sightly larger than 1 (we set A /A + = 1.05) (Song et al., 2000). In addition, the synaptic conductance is restricted to the range 0 to g E max.we also examine a multiplicative type of STDP rule (Gutig, Aharonov, Rotter, & Sompolinsky, 2003), which is given by F (t pre t post ) = { A+ (1 w) µ exp( t τ ) ( t 0) A w µ exp( t τ ) ( t > 0), (A.3) where w = g is the normalized synaptic weight and µ is a parameter controlling the weight dependency of synaptic growth. When µ = 0, this STDP gmax E rule equals the additive type of STDP rule in equation A.2. In the case of µ = 0.05, 0.2, and 1.0, the obtained synaptic weight matrices are very similar to the synaptic matrix in Figure 2B. We confirmed that the synchronyinduced switching behavior can also be observed in these synaptic matrices (data not shown). In STDP learning, a stimulus input is used to present some training stimulus patterns. The training stimulus pattern consists of three patterns (A, B, C in Figure 1C), in which the neurons belonging to a pattern fire with a period of 200 ms, keeping certain phase relationships among the firing times of these neurons. In the preliminary learning process, each stimulus pattern is presented for 1200 ms in the fixed order shown in Figure 1C. This order can be regarded as reflecting the causality of experienced external events. It is expected that after this procedure, the network is able to maintain each learned pattern without persistent stimulus input, but further learning is required to facilitate transitions between the learned patterns. For this purpose, in the main learning process, each stimulus pattern is presented for 200 ms in the fixed order A,B,C,A,B,C,A. Between the presentations of each stimulus pattern, there is a quiescent interval period. The duration of each quiescent interval is selected randomly from [100 ms, 300 ms]. The use of various interval times is necessary to ensure that the transition is not
15 2734 T. Aoki and T. Aoyagi associated specifically with a particular interval time, because it is desirable for the network to have the property that the transition can occur at any time within some suitable interval. Typically, this main learning process is repeated several times. In the case depicted in Figure 4A, the learning process is the same, except that the period of each quiescent interval between two stimulus patterns depends on the next pattern (80 ms for A B, 180 ms for A C), and the stimulus presentation order is A,B,A,C,A,B,A,C.This ensures that the transition property depends on the specific timing of the period in activation pattern A. During learning, the activation input is always set in the asynchronous mode. A.3. Dot Image Plotting of the Firing Pattern of Neurons. In Figures 2D and 3A, describing the numerical simulations, the active firing pattern of the network is a dot image in which neurons are arranged on grid points, and the gray level of the dots indicates the average firing rate over 200 ms (see Figure 2D) and 100 ms (see Figure 3A), normalized with respect to the maximum firing rate. Appendix B: Stability Analysis in the Retrieval State We derived the stability condition for the retrieval state in the simplified model with nonoverlapping learned patterns. In particular, we examine the difference of the stability in the two situations that the mode of the activation input is asynchronous and synchronous. Using the rescaled membrane potential v(t) = V(t) V rest, the dynamics of each neuron can be rewritten by τ m dv i (t) dt = v i (t) + R m ( I E i (t) + I I (t) + I Act (t) ). (B.1) In the limit of the number of the spike train N Act, the synaptic current produced by the activation input can be simplified, I Act (t) = g Act T Act (1 ρ)g Act (asynchronous) T Act + ρg Act n α(t + ntact ) (n : integer) (synchronous), (B.2) where T Act is the period of the synchronized spike in the activation input. In this analysis, the degree of synchrony is controlled by changing the ratio of the synchronized neurons ρ (0 ρ 1). In other words, ρ N Act spike trains are completely synchronized with no jitter, and (1 ρ)n Act spike trains are generated randomly with Poisson process. The synaptic currents of the
16 Synchrony-Induced Switching Behavior 2735 recurrent connections I E i (t), I I (t) aregivenby I E i (t) = N gij E α(t tn j ), I N I (t) = g I α(t t n j ), j n j n g I = gi c N g E ij = ge max N P P µ=1 ζ µ i ζ µ j P 1 + ɛ µ=1 ζ µ+1 i ζ µ j, (B.3) { 1 (x 0) (x) = 0 (x < 0), (B.4) where N P (=< i ζ µ i > µ ) is the averaged number of active neurons over all stored patterns. To evaluate these currents, we have to determine the spike time t n j for the active neurons. From typical results of our numerical simulation for the asynchronous mode, these active neurons tend to fire in a certain period T with independently random phases. In contrast, in the synchronous mode, the neurons tend to fire with a fixed delay θ to the incoming synchronized spikes. Assuming the above conditions, we can simplify the currents Ii E (t) andi I (t) in the limit of N P, N.On substituting these equations into equation B.1, we obtain τ m dv i (t) dt ( (g E v i (t) + R max gc I) ) m + I Act (t) = ( T v i (t) + R m (g E max gc I) n α(t T Act (n + θ)) +I Act (t) ) (synchronous) (asynchronous), (B.5) where T and θ are unknown parameters to be solved later. In order to determine these unknown parameters, by integrating equation B.5 over a spike period of the active neurons, we can derive a self-consistent equation, T = τ m log V th V rest R m ( g Act /T Act + ( g E max gi c) /T g Act /T Act + (g E max gi c ) /T V th V rest R m ) (asynchronous) τ m = (1 ρ)τ m(1 e TAct/τm )g Act T Act + (g E max gi c )K T Act ( ) + ρg Act K TAct (θt Act ) (synchronous), (B.6)
17 2736 T. Aoki and T. Aoyagi T K T (s) e T/τm e s/τm α(u + s + nt)du. 0 n (B.7) If the self-consistent values of T and θ are within physically meaningful ranges, we can determine a solution of equation B.6 for active neurons. In addition to the above analysis for the active neurons, one more necessary condition for inactive neurons is required: the inactive neuron must not fire when synaptic current is received from the active neurons. In fact, we numerically found that irregular firing in the inactive neuron could perturb the current retrieval state and cause instability. Therefore, we need to check that the membrane potential of the inactive neurons stays below the threshold voltage of the neuronal spike. Among the inactive neurons, the neurons that should fire in the next learned pattern have a higher membrane potential, owing to the excitatory connections from the current active neurons, that is, the second term in equation B.4. From this consideration, it is sufficient that we check only the membrane potential of these neurons, which is described by τ m dv i (t) dt ( (ɛg E v i (t) + R max gc I) ) m + I Act (t) (asynchronous) T = ( v i (t) + R m (ɛg E max gc I ) n α(t T Act (n + θ)). +I Act (t) ) (synchronous) (B.8) To evaluate the maximum of the membrane potential, it is useful to derive a return map of v i (t), which is calculated by integrating over one spike period of the active neurons. The convergent value of the return map is given by v (t ) ( ɛg E R max g I ) c m + gact (asynchronous) T T Act TAct/τm = (1 ρ)(1 e )gact + (ɛge max gi c ) K TAct ((t θ)t Act ) + ρgact K TAct (θt Act ), R T Act τ m τ m m 1 e T Act /τm (synchronous) (B.9) where t takes from 0 to 1. Finally, the condition for the membrane potential of the inactive neuron is given by V th > V rest + max v (t ). t [0,1) (B.10) The result of Figure 3B is obtained by calculating equations B.6 and B.10.
18 Synchrony-Induced Switching Behavior 2737 Acknowledgments This work was supported by CREST (Core Research for Evolutional Science and Technology) of Japan Science and Technology Corporation (JST) and by Grant-in-Aid for Scientific Research from the Ministry of Education, Science, Sports, and Culture of Japan: Grant number ; and References Amit, D. J. (1988). Neural networks counting chimes. Proc. Natl. Acad. Sci. USA, 85, Aoyagi, T., Takekawa, T., & Fukai, T. (2003). Gamma rhythmic bursts: Coherence control in networks of cortical pyramidal neurons.neural Comput., 15, Averbeck, B. B., & Lee, D. (2004). Coding and transmission of information by neural ensembles. Trends in Neurosci., 27, Bi, G. Q., & Poo, M. M. (1998). Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci., 18, Brody, C. D., & Hopfield, J. J. (2003). Simple networks for spike-timing-based computation, with application to olfactory processing. Neuron, 37, Cateau, H., & Fukai, T. (2003). A stochastic method to predict the consequence of arbitrary forms of spike-timing-dependent plasticity.neural Comput., 15, Dan, Y., & Poo, M. M. (2004). Spike timing-dependent plasticity of neural circuits. Neuron, 44, Debanne, D., Gahwiler, B. H., & Thompson, S. M. (1998). Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J. Physiol., 507, Diesmann, M., Gewaltig, M. O., & Aertsen, A. (1999). Stable propagation of synchronous spiking in cortical neural networks. Nature, 402, Engel, A. K., Fries, P., & Singer, W. (2001). Dynamic predictions: Oscillations and synchrony in top-down processing. Nat. Rev. Neurosci., 2, Ermentrout, G. B., & Kleinfeld, D. (2001). Traveling electrical waves in cortex: Insights from phase dynamics and speculation on a computational role. Neuron, 29, Fries, P., Reynolds, J. H., Rorie, A. E., & Desimone, R. (2001). Modulation of oscillatory neuronal synchronization by selective visual attention. Science, 291, Gerstner, W., & van Hemmen, J. L. (1992). Associative memory in a network of spiking neurons. Network: Comput. Neural Syst., 3, Gray,C.M.,König, P., Engel, A. K., & Singer, W. (1989). Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature, 338, Gutig, R., Aharonov, R., Rotter, S., & Sompolinsky, H. (2003). Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci., 23, Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. New York: Wiley.
19 2738 T. Aoki and T. Aoyagi Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA, 79, Izhikevich, E. M. (2006). Polychronization: Computation with spikes. Neural Comput., 18, Lee, D. (2003). Coherent oscillations in neuronal activity of the supplementary motor area during a visuomotor task. J. Neurosci., 23, Lumer, E. D. (2000). Effects of spike timing on winner-take-all competition in model cortical circuits. Neural Comput., 12, Markram, H., Lübke, J., Frotscher, M., & Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APS and EPSPs. Science, 275, Riehle, A., Grün, S., Diesmann, M., & Aertsen, A. (1997). Spike synchronization and rate modulation differentially involved in motor cortical function. Science, 278, Rubin, J., Lee, D. D., & Sompolinsky, H. (2001). Equilibrium properties of temporally asymmetric Hebbian plasticity. Phys.Rev.Lett.,86, Salinas, E., & Sejnowski, T. J. (2001). Correlated neuronal activity and the flow of neural information. Nat. Rev. Neurosci., 2, Shadlen, M. N., & Movshon, J. A. (1999). Synchrony unbound: A critical evaluation of the temporal binding hypothesis. Neuron, 24, Song, S., Miller, K. D., & Abbott, L. F. (2000). Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci., 3, Tiesinga, P. H., & Sejnowski, T. J. (2004). Rapid temporal modulation of synchrony by competition in cortical interneuron networks. Neural Comput., 16, van Rossum, M. C., Bi, G. Q., & Turrigiano, G. G. (2000). Stable Hebbian learning from spike timing-dependent plasticity. J. Neurosci., 20, Willshaw, D. J., Buneman, O. P., & Longuet-Higgins, H. C. (1969). Non-holographic associative memory. Nature, 222, Zhang, L. I., Tao, H. W., Holt, C. E., Harris, W. A., & Poo, M. (1998). A critical window for cooperation and competition among developing retinotectal synapses. Nature, 395, Received April 16, 2006; accepted September 2, 2006.
Temporally asymmetric Hebbian learning and neuronal response variability
Neurocomputing 32}33 (2000) 523}528 Temporally asymmetric Hebbian learning and neuronal response variability Sen Song*, L.F. Abbott Volen Center for Complex Systems and Department of Biology, Brandeis
Spike-timing-dependent synaptic plasticity can form zero lag links for cortical oscillations.
Neurocomputing 58 6 (24) 85 9 www.elsevier.com/locate/neucom Spike-timing-dependent synaptic plasticity can form zero lag links for cortical oscillations. Andreas Knoblauch a;, Friedrich T. Sommer b a
Beyond Vanilla LTP. Spike-timing-dependent-plasticity or STDP
Beyond Vanilla LTP Spike-timing-dependent-plasticity or STDP Hebbian learning rule asn W MN,aSN MN Δw ij = μ x j (v i - φ) learning threshold under which LTD can occur Stimulation electrode Recording electrode
Temporally Asymmetric Hebbian Learning, Spike Timing and Neuronal Response Variability
Temporally Asymmetric Hebbian Learning, Spike Timing and Neuronal Response Variability L.F. Abbott and Sen Song Volen Center and Department of Biology Brandeis University Waltham MA 02454 Abstract Recent
arxiv: v1 [q-bio.nc] 13 Jan 2008
Recurrent infomax generates cell assemblies, avalanches, and simple cell-like selectivity Takuma Tanaka 1, Takeshi Kaneko 1,2 & Toshio Aoyagi 2,3 1 Department of Morphological Brain Science, Graduate School
STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns
LETTER Communicated by Markus Diesmann STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns Ryosuke Hosaka hosaka@nls.ics.saitama-u.ac.jp Graduate School of Science
VS : Systemische Physiologie - Animalische Physiologie für Bioinformatiker. Neuronenmodelle III. Modelle synaptischer Kurz- und Langzeitplastizität
Bachelor Program Bioinformatics, FU Berlin VS : Systemische Physiologie - Animalische Physiologie für Bioinformatiker Synaptische Übertragung Neuronenmodelle III Modelle synaptischer Kurz- und Langzeitplastizität
Evaluating the Effect of Spiking Network Parameters on Polychronization
Evaluating the Effect of Spiking Network Parameters on Polychronization Panagiotis Ioannou, Matthew Casey and André Grüning Department of Computing, University of Surrey, Guildford, Surrey, GU2 7XH, UK
Different inhibitory effects by dopaminergic modulation and global suppression of activity
Different inhibitory effects by dopaminergic modulation and global suppression of activity Takuji Hayashi Department of Applied Physics Tokyo University of Science Osamu Araki Department of Applied Physics
Signal detection in networks of spiking neurons with dynamical synapses
Published in AIP Proceedings 887, 83-88, 7. Signal detection in networks of spiking neurons with dynamical synapses Jorge F. Mejías and Joaquín J. Torres Dept. of Electromagnetism and Physics of the Matter
Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses
The Journal of Neuroscience, 2000, Vol. 20 RC50 1of5 Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses Misha Tsodyks, Asher Uziel, and Henry Markram Department of Neurobiology,
Computational cognitive neuroscience: 2. Neuron. Lubica Beňušková Centre for Cognitive Science, FMFI Comenius University in Bratislava
1 Computational cognitive neuroscience: 2. Neuron Lubica Beňušková Centre for Cognitive Science, FMFI Comenius University in Bratislava 2 Neurons communicate via electric signals In neurons it is important
Basics of Computational Neuroscience: Neurons and Synapses to Networks
Basics of Computational Neuroscience: Neurons and Synapses to Networks Bruce Graham Mathematics School of Natural Sciences University of Stirling Scotland, U.K. Useful Book Authors: David Sterratt, Bruce
Realization of Visual Representation Task on a Humanoid Robot
Istanbul Technical University, Robot Intelligence Course Realization of Visual Representation Task on a Humanoid Robot Emeç Erçelik May 31, 2016 1 Introduction It is thought that human brain uses a distributed
Modulators of Spike Timing-Dependent Plasticity
Modulators of Spike Timing-Dependent Plasticity 1 2 3 4 5 Francisco Madamba Department of Biology University of California, San Diego La Jolla, California fmadamba@ucsd.edu 6 7 8 9 10 11 12 13 14 15 16
Distributed Synchrony of Spiking Neurons in a Hebbian Cell Assembly
Distributed Synchrony of Spiking Neurons in a Hebbian Cell Assembly David Horn Nir Levy School of Physics and Astronomy, Raymond and Beverly Sackler Faculty of Exact Sciences, Tel Aviv University, Tel
The firing rates of cortical neurons carry information about
Feedback stabilizes propagation of synchronous spiking in cortical neural networks Samat Moldakarimov a,b, Maxim Bazhenov a,c, and Terrence J. Sejnowski a,b,d, a Howard Hughes Medical Institute, Salk Institute
Input-speci"c adaptation in complex cells through synaptic depression
0 0 0 0 Neurocomputing }0 (00) } Input-speci"c adaptation in complex cells through synaptic depression Frances S. Chance*, L.F. Abbott Volen Center for Complex Systems and Department of Biology, Brandeis
Neuromorphic computing
Neuromorphic computing Robotics M.Sc. programme in Computer Science lorenzo.vannucci@santannapisa.it April 19th, 2018 Outline 1. Introduction 2. Fundamentals of neuroscience 3. Simulating the brain 4.
A general error-based spike-timing dependent learning rule for the Neural Engineering Framework
A general error-based spike-timing dependent learning rule for the Neural Engineering Framework Trevor Bekolay Monday, May 17, 2010 Abstract Previous attempts at integrating spike-timing dependent plasticity
Resonant synchronization of heterogeneous inhibitory networks
Cerebellar oscillations: Anesthetized rats Transgenic animals Recurrent model Review of literature: γ Network resonance Life simulations Resonance frequency Conclusion Resonant synchronization of heterogeneous
A SUPERVISED LEARNING
R E S E A R C H R E P O R T I D I A P A SUPERVISED LEARNING APPROACH BASED ON STDP AND POLYCHRONIZATION IN SPIKING NEURON NETWORKS Hélène Paugam-Moisy 1,2, Régis Martinez 1 and Samy Bengio 2 IDIAP RR 6-54
Effects of Inhibitory Synaptic Current Parameters on Thalamocortical Oscillations
Effects of Inhibitory Synaptic Current Parameters on Thalamocortical Oscillations 1 2 3 4 5 Scott Cole Richard Gao Neurosciences Graduate Program Department of Cognitive Science University of California,
Computing with Spikes in Recurrent Neural Networks
Computing with Spikes in Recurrent Neural Networks Dezhe Jin Department of Physics The Pennsylvania State University Presented at ICS Seminar Course, Penn State Jan 9, 2006 Outline Introduction Neurons,
Active Control of Spike-Timing Dependent Synaptic Plasticity in an Electrosensory System
Active Control of Spike-Timing Dependent Synaptic Plasticity in an Electrosensory System Patrick D. Roberts and Curtis C. Bell Neurological Sciences Institute, OHSU 505 N.W. 185 th Avenue, Beaverton, OR
Dynamic Stochastic Synapses as Computational Units
Dynamic Stochastic Synapses as Computational Units Wolfgang Maass Institute for Theoretical Computer Science Technische Universitat Graz A-B01O Graz Austria. email: maass@igi.tu-graz.ac.at Anthony M. Zador
The storage and recall of memories in the hippocampo-cortical system. Supplementary material. Edmund T Rolls
The storage and recall of memories in the hippocampo-cortical system Supplementary material Edmund T Rolls Oxford Centre for Computational Neuroscience, Oxford, England and University of Warwick, Department
Stable Hebbian Learning from Spike Timing-Dependent Plasticity
The Journal of Neuroscience, December 1, 2000, 20(23):8812 8821 Stable Hebbian Learning from Spike Timing-Dependent Plasticity M. C. W. van Rossum, 1 G. Q. Bi, 2 and G. G. Turrigiano 1 1 Brandeis University,
LEARNING ARBITRARY FUNCTIONS WITH SPIKE-TIMING DEPENDENT PLASTICITY LEARNING RULE
LEARNING ARBITRARY FUNCTIONS WITH SPIKE-TIMING DEPENDENT PLASTICITY LEARNING RULE Yefei Peng Department of Information Science and Telecommunications University of Pittsburgh Pittsburgh, PA 15260 ypeng@mail.sis.pitt.edu
Rolls,E.T. (2016) Cerebral Cortex: Principles of Operation. Oxford University Press.
Digital Signal Processing and the Brain Is the brain a digital signal processor? Digital vs continuous signals Digital signals involve streams of binary encoded numbers The brain uses digital, all or none,
Reading Neuronal Synchrony with Depressing Synapses
NOTE Communicated by Laurence Abbott Reading Neuronal Synchrony with Depressing Synapses W. Senn Department of Neurobiology, Hebrew University, Jerusalem 4, Israel, Department of Physiology, University
Synfire chains with conductance-based neurons: internal timing and coordination with timed input
Neurocomputing 5 (5) 9 5 www.elsevier.com/locate/neucom Synfire chains with conductance-based neurons: internal timing and coordination with timed input Friedrich T. Sommer a,, Thomas Wennekers b a Redwood
What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. Abstract
What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. J. J. Hopfield Department of Molecular Biology Princeton University, Princeton NJ 08544-1014 Carlos D. Brody
Heterogeneous networks of spiking neurons: self-sustained activity and excitability
Heterogeneous networks of spiking neurons: self-sustained activity and excitability Cristina Savin 1,2, Iosif Ignat 1, Raul C. Mureşan 2,3 1 Technical University of Cluj Napoca, Faculty of Automation and
Efficient Emulation of Large-Scale Neuronal Networks
Efficient Emulation of Large-Scale Neuronal Networks BENG/BGGN 260 Neurodynamics University of California, San Diego Week 6 BENG/BGGN 260 Neurodynamics (UCSD) Efficient Emulation of Large-Scale Neuronal
Synchrony Detection by Analogue VLSI Neurons with Bimodal STDP Synapses
Synchrony Detection by Analogue VLSI Neurons with Bimodal STDP Synapses Adria Bofill-i-Petit The University of Edinburgh Edinburgh, EH9 JL Scotland adria.bofill@ee.ed.ac.uk Alan F. Murray The University
What do you notice? Edited from
What do you notice? Edited from https://www.youtube.com/watch?v=ffayobzdtc8&t=83s How can a one brain region increase the likelihood of eliciting a spike in another brain region? Communication through
Representational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex
Representational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex Yuichi Katori 1,2 *, Kazuhiro Sakamoto 3, Naohiro Saito 4, Jun Tanji 4, Hajime
A model of the interaction between mood and memory
INSTITUTE OF PHYSICS PUBLISHING NETWORK: COMPUTATION IN NEURAL SYSTEMS Network: Comput. Neural Syst. 12 (2001) 89 109 www.iop.org/journals/ne PII: S0954-898X(01)22487-7 A model of the interaction between
Pairwise Analysis Can Account for Network Structures Arising from Spike-Timing Dependent Plasticity
Pairwise Analysis Can Account for Network Structures Arising from Spike-Timing Dependent Plasticity Baktash Babadi 1,2 *, L. F. Abbott 1 1 Center for Theoretical Neuroscience, Department of Neuroscience,
Investigation of Physiological Mechanism For Linking Field Synapses
Investigation of Physiological Mechanism For Linking Field Synapses Richard B. Wells 1, Nick Garrett 2, Tom Richner 3 Microelectronics Research and Communications Institute (MRCI) BEL 316 University of
Inhibition: Effects of Timing, Time Scales and Gap Junctions
Inhibition: Effects of Timing, Time Scales and Gap Junctions I. Auditory brain stem neurons and subthreshold integ n. Fast, precise (feed forward) inhibition shapes ITD tuning. Facilitating effects of
Self-Organization and Segmentation with Laterally Connected Spiking Neurons
Self-Organization and Segmentation with Laterally Connected Spiking Neurons Yoonsuck Choe Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 USA Risto Miikkulainen Department
STDP enhances synchrony in feedforward network
1 1 of 10 STDP enhances synchrony in feedforward network STDP strengthens/weakens synapses driving late/early-spiking cells [Laurent07] Olfactory neurons' spikes phase-lock (~2ms) to a 20Hz rhythm. STDP
Supplementary Figure 1. Basic properties of compound EPSPs at
Supplementary Figure 1. Basic properties of compound EPSPs at hippocampal CA3 CA3 cell synapses. (a) EPSPs were evoked by extracellular stimulation of the recurrent collaterals and pharmacologically isolated
Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway
Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway Richard Kempter* Institut fur Theoretische Physik Physik-Department der TU Munchen D-85748 Garching bei Munchen J. Leo van
Shadowing and Blocking as Learning Interference Models
Shadowing and Blocking as Learning Interference Models Espoir Kyubwa Dilip Sunder Raj Department of Bioengineering Department of Neuroscience University of California San Diego University of California
Delay Learning and Polychronization for Reservoir Computing
Delay Learning and Polychronization for Reservoir Computing Hélène Paugam-Moisy a, Régis Martinez a and Samy Bengio b a LIRIS, UMR CNRS 525, Université Lyon 2, France b Google, 16 Amphitheatre Pkwy, B135-138B,
A developmental learning rule for coincidence. tuning in the barn owl auditory system. Wulfram Gerstner, Richard Kempter J.
A developmental learning rule for coincidence tuning in the barn owl auditory system Wulfram Gerstner, Richard Kempter J.Leo van Hemmen Institut fur Theoretische Physik, Physik-Department der TU Munchen
SUPPLEMENTARY INFORMATION
doi:10.1038/nature10776 Supplementary Information 1: Influence of inhibition among blns on STDP of KC-bLN synapses (simulations and schematics). Unconstrained STDP drives network activity to saturation
Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells
INSTITUTE OF PHYSICS PUBLISHING Network: Comput. Neural Syst. 13 (2002) 217 242 NETWORK: COMPUTATION IN NEURAL SYSTEMS PII: S0954-898X(02)36091-3 Self-organizing continuous attractor networks and path
A Model of Spike-Timing Dependent Plasticity: One or Two Coincidence Detectors?
RAPID COMMUNICATION J Neurophysiol 88: 507 513, 2002; 10.1152/jn.00909.2001. A Model of Spike-Timing Dependent Plasticity: One or Two Coincidence Detectors? UMA R. KARMARKAR AND DEAN V. BUONOMANO Departments
Part 11: Mechanisms of Learning
Neurophysiology and Information: Theory of Brain Function Christopher Fiorillo BiS 527, Spring 2012 042 350 4326, fiorillo@kaist.ac.kr Part 11: Mechanisms of Learning Reading: Bear, Connors, and Paradiso,
A computational account for the ontogeny of mirror neurons via Hebbian learning
A computational account for the ontogeny of mirror neurons via Hebbian learning Graduation Project Bachelor Artificial Intelligence Credits: 18 EC Author Lotte Weerts 10423303 University of Amsterdam Faculty
Neural Networks. Nice books to start reading:
Neural Networks Overview: - Anatomy of Neuronal Networks - Formal Neural Networks - Are they realistic? - Oscillations and Phase locking - Mapping problem: Kohonen Networks Nice books to start reading:
Spiking Inputs to a Winner-take-all Network
Spiking Inputs to a Winner-take-all Network Matthias Oster and Shih-Chii Liu Institute of Neuroinformatics University of Zurich and ETH Zurich Winterthurerstrasse 9 CH-857 Zurich, Switzerland {mao,shih}@ini.phys.ethz.ch
Theta sequences are essential for internally generated hippocampal firing fields.
Theta sequences are essential for internally generated hippocampal firing fields. Yingxue Wang, Sandro Romani, Brian Lustig, Anthony Leonardo, Eva Pastalkova Supplementary Materials Supplementary Modeling
PLEASE SCROLL DOWN FOR ARTICLE
This article was downloaded by:[new York University] On: 26 July 28 Access Details: [subscription number 79434316] Publisher: Informa Healthcare Informa Ltd Registered in England and Wales Registered Number:
Effective And Optimal Storage of Memory Patterns With Variable Coding Levels
Effective And Optimal Storage of Memory Patterns With Variable Coding Levels Gal Chechik and Isaac Meilijson School of Mathematical Sciences Tel-Aviv University Tel Aviv 69978, Israel ggal@math.tau.ac.il
arxiv: v1 [q-bio.nc] 25 Apr 2017
Neurogenesis and multiple plasticity mechanisms enhance associative memory retrieval in a spiking network model of the hippocampus arxiv:1704.07526v1 [q-bio.nc] 25 Apr 2017 Yansong, Chua and Cheston, Tan
Temporal asymmetry in spike timing-dependent synaptic plasticity
Physiology & Behavior 77 (2002) 551 555 Temporal asymmetry in spike timing-dependent synaptic plasticity Guo-Qiang Bi*, Huai-Xing Wang Department of Neurobiology, University of Pittsburgh School of Medicine,
Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons
10786 The Journal of Neuroscience, November 16, 2005 25(46):10786 10795 Behavioral/Systems/Cognitive Signal Propagation and Logic Gating in Networks of Integrate-and-Fire Neurons Tim P. Vogels and L. F.
Modeling of Hippocampal Behavior
Modeling of Hippocampal Behavior Diana Ponce-Morado, Venmathi Gunasekaran and Varsha Vijayan Abstract The hippocampus is identified as an important structure in the cerebral cortex of mammals for forming
Inhibitory synchrony as a mechanism for attentional gain modulation q
Journal of Physiology - Paris 98 (24) 296 314 www.elsevier.com/locate/jphysparis Inhibitory synchrony as a mechanism for attentional gain modulation q Paul H. Tiesinga a, *, Jean-Marc Fellous b,c,1, Emilio
Neurons tune to the earliest spikes through STDP
Neurons tune to the earliest spikes through STDP Rudy Guyonneau 1,2 Rufin VanRullen 1 Simon J. Thorpe 1,2 1 Centre de Recherche Cerveau et Cognition, Toulouse, France 2 Spikenet Technology, Revel, France
Network model of spontaneous activity exhibiting synchronous transitions between up and down states
Network model of spontaneous activity exhibiting synchronous transitions between up and down states Néstor Parga a and Larry F. Abbott Center for Neurobiology and Behavior, Kolb Research Annex, College
Tiesinga Stimulus competition by inhibitory interference 1
Stimulus competition by inhibitory interference Paul H.E. Tiesinga Department of Physics & Astronomy University of North Carolina at Chapel Hill Chapel Hill, North Carolina 27599 Phone: 919 962 7199 Fax:
Dynamics of Hodgkin and Huxley Model with Conductance based Synaptic Input
Proceedings of International Joint Conference on Neural Networks, Dallas, Texas, USA, August 4-9, 2013 Dynamics of Hodgkin and Huxley Model with Conductance based Synaptic Input Priyanka Bajaj and Akhil
Multi compartment model of synaptic plasticity
Multi compartment model of synaptic plasticity E. Paxon Frady We introduce a biophysical model of a neuronal network that can accurately replicate many classical plasticity experiments. The model uses
Decoupling through Synchrony in Neuronal Circuits with Propagation Delays
Article in Neuronal Circuits with Propagation Delays Evgueniy V. Lubenov 1 and Athanassios G. Siapas 1, * 1 Division of Biology, Division of Engineering and Applied Science, California Institute of Technology,
Memory Retrieval Based on Cortical Interaction
Memory Retrieval Based on Cortical Interaction O. Hoshino Oita Univ. 700, Dannoharu, Oita, 870-1192, Japan email: hoshino@cc.oita-u.ac.jp K. Kuroiwa Oita Univ. 700, Dannoharu, Oita, 870-1192, Japan email:
File name: Supplementary Information Description: Supplementary Figures, Supplementary Table and Supplementary References
File name: Supplementary Information Description: Supplementary Figures, Supplementary Table and Supplementary References File name: Supplementary Data 1 Description: Summary datasheets showing the spatial
Cerebral Cortex. Edmund T. Rolls. Principles of Operation. Presubiculum. Subiculum F S D. Neocortex. PHG & Perirhinal. CA1 Fornix CA3 S D
Cerebral Cortex Principles of Operation Edmund T. Rolls F S D Neocortex S D PHG & Perirhinal 2 3 5 pp Ento rhinal DG Subiculum Presubiculum mf CA3 CA1 Fornix Appendix 4 Simulation software for neuronal
Multi-Associative Memory in flif Cell Assemblies
Multi-Associative Memory in flif Cell Assemblies Christian R. Huyck (c.huyck@mdx.ac.uk) Kailash Nadh (k.nadh@mdx.ac.uk) School of Engineering and Information Sciences Middlesex University London, UK Abstract
Neuron Phase Response
BioE332A Lab 4, 2007 1 Lab 4 February 2, 2007 Neuron Phase Response In this lab, we study the effect of one neuron s spikes on another s, combined synapse and neuron behavior. In Lab 2, we characterized
Implementing Spike-Timing-Dependent Plasticity on SpiNNaker Neuromorphic Hardware
Implementing Spike-Timing-Dependent Plasticity on SpiNNaker Neuromorphic Hardware Xin Jin, Alexander Rast, Francesco Galluppi, Sergio Davies, and Steve Furber Abstract This paper presents an efficient
STDP between a Pair of Recurrently Connected Neurons with Asynchronous and Synchronous Stimulation AZADEH HASSANNEJAD NAZIR
STDP between a Pair of Recurrently Connected Neurons with Asynchronous and Synchronous Stimulation AZADEH HASSANNEJAD NAZIR Master of Science Thesis Stockholm, Sweden 2012 STDP between a Pair of Recurrently
Modeling Depolarization Induced Suppression of Inhibition in Pyramidal Neurons
Modeling Depolarization Induced Suppression of Inhibition in Pyramidal Neurons Peter Osseward, Uri Magaram Department of Neuroscience University of California, San Diego La Jolla, CA 92092 possewar@ucsd.edu
Relationships between Spike Train Spatiotemporal Structure and Cortical Synchronization
Relationships between Spike Train Spatiotemporal Structure and Cortical Synchronization Jason M. Samonds 1, Heather A. Brown 1, A.B. Bonds 1,2 Vanderbilt University, Nashville TN, USA 37235 1 Department
Spike-timing Dynamics of Neuronal Groups
Spike-timing Dynamics of Neuronal Groups Eugene M. Izhikevich, Joseph A. Gally and Gerald M. Edelman The Neurosciences Institute, 10640 John Jay Hopkins Drive, San Diego, CA, 92121, USA A neuronal network
Consciousness as representation formation from a neural Darwinian perspective *
Consciousness as representation formation from a neural Darwinian perspective * Anna Kocsis, mag.phil. Institute of Philosophy Zagreb, Croatia Vjeran Kerić, mag.phil. Department of Psychology and Cognitive
Transitions between dierent synchronous ring modes using synaptic depression
Neurocomputing 44 46 (2002) 61 67 www.elsevier.com/locate/neucom Transitions between dierent synchronous ring modes using synaptic depression Victoria Booth, Amitabha Bose Department of Mathematical Sciences,
Model neurons!!!!synapses!
Model neurons ynapses uggested reading: Chapter 5.8 in Dayan,. & Abbott, L., Theoretical Neuroscience, MIT ress, 200. Model neurons: ynapse Contents: ynapses ynaptic input into the RC-circuit pike-rate
A computational framework for cortical learning
Research Collection Journal Article A computational framework for cortical learning Author(s): Suri, Roland E. Publication Date: 2004 Permanent Link: https://doi.org/10.3929/ethz-a-007584827 Originally
Hearing Thinking. Keywords: Cortical Neurons, Granular Synthesis, Synaptic Plasticity
Hearing Thinking Jane Grant, John Matthias, Tim Hodgson and Eduardo Miranda Interdisciplinary Centre for Computer Music Research (ICCMR) Faculty of Arts and Faculty of Technology, University of Plymouth,
Introduction to Computational Neuroscience
Introduction to Computational Neuroscience Lecture 7: Network models Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single neuron
Neural response time integration subserves. perceptual decisions - K-F Wong and X-J Wang s. reduced model
Neural response time integration subserves perceptual decisions - K-F Wong and X-J Wang s reduced model Chris Ayers and Narayanan Krishnamurthy December 15, 2008 Abstract A neural network describing the
Spiking neural network simulator: User s Guide
Spiking neural network simulator: User s Guide Version 0.55: December 7 2004 Leslie S. Smith, Department of Computing Science and Mathematics University of Stirling, Stirling FK9 4LA, Scotland lss@cs.stir.ac.uk
Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification and Spike-Shifting
(Accepted for publication in Neural Computation) Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification and Spike-Shifting Filip Ponulak 1,2, Andrzej Kasiński 1 1
Recognition of English Characters Using Spiking Neural Networks
Recognition of English Characters Using Spiking Neural Networks Amjad J. Humaidi #1, Thaer M. Kadhim *2 Control and System Engineering, University of Technology, Iraq, Baghdad 1 601116@uotechnology.edu.iq
Cell Responses in V4 Sparse Distributed Representation
Part 4B: Real Neurons Functions of Layers Input layer 4 from sensation or other areas 3. Neocortical Dynamics Hidden layers 2 & 3 Output layers 5 & 6 to motor systems or other areas 1 2 Hierarchical Categorical
Theory of correlation transfer and correlation structure in recurrent networks
Theory of correlation transfer and correlation structure in recurrent networks Ruben Moreno-Bote Foundation Sant Joan de Déu, Barcelona Moritz Helias Research Center Jülich Theory of correlation transfer
Bursting dynamics in the brain. Jaeseung Jeong, Department of Biosystems, KAIST
Bursting dynamics in the brain Jaeseung Jeong, Department of Biosystems, KAIST Tonic and phasic activity A neuron is said to exhibit a tonic activity when it fires a series of single action potentials
A neural circuit model of decision making!
A neural circuit model of decision making! Xiao-Jing Wang! Department of Neurobiology & Kavli Institute for Neuroscience! Yale University School of Medicine! Three basic questions on decision computations!!
Analysis of State-Dependent Transitions in Frequency and Long-Distance Coordination in a Model Oscillatory Cortical Circuit
Journal of Computational Neuroscience 15, 283 298, 2003 c 2003 Kluwer Academic Publishers. Manufactured in The Netherlands. Analysis of State-Dependent Transitions in Frequency and Long-Distance Coordination
Synapses throughout the brain are bidirectionally modifiable.
A unified model of NMDA receptor-dependent bidirectional synaptic plasticity Harel Z. Shouval*, Mark F. Bear*, and Leon N Cooper* *Institute for Brain and Neural Systems, Departments of Physics and Neuroscience,
Active Sites model for the B-Matrix Approach
Active Sites model for the B-Matrix Approach Krishna Chaithanya Lingashetty Abstract : This paper continues on the work of the B-Matrix approach in hebbian learning proposed by Dr. Kak. It reports the
Analog Circuit Model of Stimulus- Dependent Synchronization of Visual Responses Kimberly Reinhold Advanced Biophysics Lab Class, 2011 Introduction
Analog Circuit Model of Stimulus- Dependent Synchronization of Visual Responses Kimberly Reinhold Advanced Biophysics Lab Class, 2 Introduction The gamma frequency oscillation (3-8 Hz) in visual cortex
Part 3. Synaptic models
Part 3 Synaptic models Purpose of synap/c modeling To capture the following facts: 1. Some neurons have stronger and more las/ng influences over a given neuron than others 2. Some of these influences are
Task 1: Machine Learning with Spike-Timing-Dependent Plasticity (STDP)
DARPA Report Task1 for Year 1 (Q1-Q4) Task 1: Machine Learning with Spike-Timing-Dependent Plasticity (STDP) 1. Shortcomings of the deep learning approach to artificial intelligence It has been established