The field of the invention is that of neuromorphic chips with artificial neuron networks that make use of resistive memory synapses. The invention more particularly relates to the learning carried out directly on a chip of such a network of neurons.
A nerve cell, or neuron, can be broken down into several parts:
According to the excitation or inhibition signals received on the dendrites, ions transit through the cell membrane. The imbalance in charges between the inside and the outside of the cell induces a difference in voltage on either side of the membrane. This is then referred to as membrane voltage at the terminals of a membrane capacitance. When this membrane voltage exceeds a certain level, i.e. when the cell is sufficiently excited, the neuron experiences a brutal exchange of ions. This results in a significant variation in the membrane voltage. This variation, called “action potential” or “spike”, propagates along the axon, to the synaptic buttons which form the outputs of the neuron. Seen from outside the cell, these “spikes” form the electrical activity of the neuron.
In a network of biological neurons, each neuron is connected to several thousand others via as many synapses. The term synapse designates the connection between the axon terminal of so-called presynaptic neuron and a dendrite of a so-called postsynaptic neuron. The influence of the presynaptic neuron on the postsynaptic neuron is weighted by the weight of the synapse which can be excitatory or inhibitory. In the first case, a presynaptic spike charges the membrane voltage of the postsynaptic neuron and precipitates the generating of a postsynaptic spike. In the second case, a presynaptic spike has for effect to depolarise the postsynaptic membrane and to delay the appearance of a postsynaptic spike.
Artificial neuron networks are used in various fields of signal processing (visual, audio or other) such as for example in the field of data classification, image recognition or decision making. They are inspired by the networks of biological neurons of which they imitate the operation and are substantially comprised of artificial neurons that are connected together by synapses, which are conventionally implemented by digital memories, but which can also be implemented by resistive components of which the conductance varies according to the voltage applied at the terminals thereof.
Before being functional, such a neuron network must go through a learning phase that consists in adjusting the weight of the synapses according to the inputs of the network so that the network associates the desired outputs with it. A possible learning strategy is a strategy carried out by the network itself (this is referred to as “on-chip” learning) and is carried out in an unsupervised manner in that the inputs sent to the network are not labelled, with the network itself determining to which class which input belongs to in order to associate a neuron of the output layer with each class.
A conventional implementation of unsupervised learning is based on pulse neurons (also called “action potential neuron” or “spiking neuron”). The simplest model of a spiking neuron is of the “Integrate and Fire” type: it integrates its inputs, compares the result of this integration with a threshold and emits a spike when this threshold is crossed while still discharging the membrane voltage.
A possible learning law is a law referred to “Spike Timing Dependent Plasticity” (STDP law) according to which each synapse adjusts its weight according to the relative occurrences between the pre- and postsynaptic spikes. If a presynaptic spike is followed by a postsynaptic spike, the law assumes a causal link to be maintained and reinforces the synapse by increasing its weight. On the contrary, if a postsynaptic spike appears shortly before a post presynaptic, the synaptic weight must be decreased. In both cases, the shorter the time is between the pre- and postsynaptic spikes, the larger the modification in the weight is.
Another possible learning law is the one referred to as “Spike-Driven Synaptic Plasticity” law (SDSP law) which has the interest of not having to monitor a time difference per synapse as is the case for the STDP law. According to the SDSP law, at each presynaptic spike received, each synapse polls the state of the postsynaptic neuron and adapts its weigh in consequence. If the membrane voltage of this postsynaptic neuron is close to the threshold, it is deduced that the presynaptic spike has a good chance of triggering the emission of a spike and therefore that the presynaptic neuron that emitted this spike has a substantial effect on the postsynaptic neuron. The synaptic connection is then reinforced by increasing the weight of the synapse (this is referred to as LTP for “Long Term Potentiation”). Otherwise, i.e. if the postsynaptic membrane voltage is close to zero, the weight is decreased (“Long Term Depression”, or LTD).
In order to prevent the synaptic weights from being modified at every presynaptic spike, a second rule limits the learning. The average activity of each neuron is estimated thanks to a variable, the concentration in calcium ions. This concentration increases when the neuron emits a spike and decreases otherwise. The potentiation or the depression of a synapse is then carried out or not according to the level of calcium of the postsynaptic neuron thereof.
Finally, the synapses used for SDSP learning are bistable synapses that can have several values, but of which only two of its values are stable, PMIN and PMAX. This instability results in the following behaviour. Any synaptic weight less than a value Pm located between PMIN and PMAX sees its weight slowly decrease to PMIN and, inversely, any synaptic weight greater than Pm undergoes a gradual potentiation. At the end of learning, all of the synaptic weights are therefore either PMIN or PMAX.
Through their high density and their non-volatile nature, memristors or RRAM are ideal candidates for the implementation of synapses. The variable resistance of these devices can be increased (operation referred to as Reset) or decreased (Set operation) if relatively high electrical magnitudes (voltage and/or current) are applied thereto. If it is simply desired to read the value of their resistance without modifying it (Read operation), relatively low electrical magnitudes must be applied.
The integration of resistive synapses often takes the form of a memory plane, that is named a “synaptic plane”, in which the synapses are arranged in a network with transversal lines and columns. Each synapse has an activation terminal of the synapse and a propagation terminal of the synaptic signal. The activation terminals of the synapses of the same line are connected together by the intermediary of a Word-Line, and the propagation terminals of the synapses of the same column are connected together and connected to a synaptic integration circuit (an artificial neuron of the integrate and fire type) by the intermediary of a Bit-Line. A Word-Line is used to inject a voltage spike into the synapses of the corresponding line and the Bit-Lines are the outputs of these synapses. In the presence of a presynaptic activation on a Word-Line, each Bit-Line propagates a current weighted by the value of the corresponding resistive memory.
Such a synaptic plane thus makes it possible to connect an input layer of neurons (the presynaptic neurons) and an output layer of neurons (the postsynaptic neurons). An input neuron stimulates a line of synapses during the emission of a presynaptic spike via a Word-Line, and each one of the output neurons integrates the synaptic stimulation weighted by the value of the resistive memory to which it is connected via a Bit-Line.
As shown in
As shown in
A solution is known in document WO 2016/067139 A1 for carrying out a learning of the STDP type. This solution however requires densifying the structure of each one of the resistive memory synapses and complicates the synaptic plane by requiring that each postsynaptic neuron be connected to the synapses of a column not only by a Bit-Line connected to the propagation terminals of the synapses but also by an additional Bit-Line connected to a third access terminal of the synapses in addition to the activation and propagation terminals.
The invention has for objective to propose a less complex solution for carrying out the learning of the synapses that connect two successive layers of neurons. It proposes for this a synaptic integration circuit for a neuromorphic chip comprising a resistive memory synapse which has an activation terminal to receive a presynaptic action signal and a propagation terminal intended to be connected to said circuit for transmitting a synaptic output signal which depends on the resistance of said memory. The circuit comprises an accumulator of the synaptic output signal, a comparator configured to emit a postsynaptic spike in case of the crossing of a threshold by the accumulated output signal. This circuit further comprises a control unit configured, when a presynaptic action signal is applied on the activation terminal, to impose a conductance modification voltage on the synapse by controlling the application of a postsynaptic action signal on the propagation terminal.
Certain preferred but not limiting aspects of this circuit are the following:
Other aspects, purposes, advantages and characteristics of the invention shall appear better when reading the following detailed description of preferred embodiments of the latter, given as a non-limiting example, and in reference to the drawings wherein, in addition to
The invention has for framework a synaptic plane such as described hereinabove wherein the presynaptic spikes are injected one after the other on the corresponding Word-Line thereof. At each presynaptic spike of a neuron of the input layer, a complete line of synapses is activated and all of the neurons of the output layer are stimulated via the corresponding Bit-Line thereof according to the weight of the synapse that corresponds to them and which corresponds to the activated Word-Line.
During the learning, preferentially but not exclusively of the SDSP type, the weight of each synapse can be updated. With a learning of the SDSP type, such an update (i.e. a potentiation or a depression) is or is not produced according to solely the state of the postsynaptic neuron (its membrane voltage and its level of calcium).
Within the framework of the invention, the synapses are resistive memory synapses of the 1T1R or 1S1R type. In a possible implementation, the memories of the synapses are unipolar, multivalue and cumulative write RRAM memories. This means that the voltages and currents required for the various actions (Set, Reset, Read) are applied with the same polarity, that the resistance of the memories can have a complete range of values and that successive writes of the same type (Set or Reset) progressively shift the resistance of the memory in the desired direction. An example of such a memory is PCM (Phase Change Memory). Note that PCM memory is subjected to an offset effect such that a memory that has a substantial resistance value sees the latter increased and that, to a lesser degree, a memory that has a low resistance value sees the latter decrease.
The invention is not however limited to such memories, and thus extends to synapses that do not make use of multivalue memory but are comprised of several binary memories in parallel. Write accesses (Set, Reset) to the synapse impose in this case a voltage on the memories that forms the synapse such that certain memories change state and others do not. The invention also extends to synapses that make use of bipolar memories and in such a case a voltage is provided on the Source-Line (or on a Word-Line in the case of 1S1R cells) in the middle of the voltage range and voltages on the Bit-Lines that can be greater than or less than the aforementioned voltage.
The example is taken in what follows of PCM memories for which a voltage Vread makes it possible to make a read without modifying the resistance, a voltage Vset makes it possible to reduce the value of the resistance and a voltage Vreset makes it possible to increase the value of the resistance. By way of example, a supply voltage VDD=1.8 V can be provided, and the following access voltages to a resistive memory: Vset=1.6 V, Vreset=1.2 V and Vread=0.4 V.
With the synaptic plane described hereinabove, the propagation terminal of each synapse is connected to its postsynaptic neuron via a Bit-Line. Thus, during the processing of a presynaptic spike, the synapse is taken between a voltage common to all of the synapses of the line (the voltage of the Source-Line in the case of a 1T1R cell, the voltage of the Word-Line for a 1S1R cell) and a voltage that is proper to its column, therefore to its postsynaptic neuron. Taking the example of
The invention thus makes it possible to carry out a learning continuously of the integration of the synaptic weights and this at the same time for all of the synapses of the activated line. This learning is furthermore applied on the synaptic plane by being managed locally by the neurons, not by the synapses which are much more numerous.
In reference to
In
In
The synaptic integration circuit 10, 20, 30, 40 comprises an accumulator Cm of the synaptic output signal and a comparator Comp configured to emit a postsynaptic spike So in case of the crossing of a threshold Vs by the accumulated output signal Vm which represents the membrane voltage of the neuron. The accumulator Cm is symbolised in the figures by a simple capacitor, but it can have a more complex form.
The circuit according to the invention is furthermore configured, when a presynaptic action signal is applied on the activation terminal BA of the synapse S1, to impose a conductance modification voltage on the synapse S1 by applying a postsynaptic action signal on the propagation terminal BP of the synapse S1 via the Bit-Line BL. The postsynaptic action can be one of a potentiation signal and a depression signal, with the circuit being configured to adjust the voltage on the Bit-Line to:
The circuit according to the invention has a control unit (not shown) configured to control the application of the postsynaptic action signal on the propagation terminal in accordance with a learning logic. According to this logic, the control unit can also be configured, when a presynaptic action signal is applied on the activation terminal BA of the synapse S1, to impose on the propagation terminal BP of the synapse S1 via the Bit-Line BL a neutral signal that does not induce any modification in the conductance of the synapse. The learning logic can be of the STDP type, in such a way that the postsynaptic action signal is or is not applied according to the relative occurrences of the presynaptic spike and of a postsynaptic spike. The learning logic is preferably of the SDSP type, the control unit then only evaluates the state of the neuron, and more particularly its membrane voltage Vm (which is already evaluated in order to determine whether or not the neuron has to emit a spike) and its concentration in calcium ions (which can be evaluated via a simple counting of the number of spikes emitted), in order to decide whether or not to modify the conductance of the synapse.
It was seen hereinabove that the presynaptic action signal Sa1, Sa2, Sa3, Sa4 is applied on the Word-Line WL1 following the emission of a presynaptic spike by the input neuron associated with this Word-Line.
In a first embodiment shown in
In
This same connector Sread can furthermore be switched via the read command Cmdread to disconnect the accumulator from the propagation terminal when the write pulse of the presynaptic action signal is applied on the activation terminal.
And when this write pulse of the presynaptic action signal is applied on the activation terminal, a conductance modification voltage is imposed on the synapse S1 by applying a postsynaptic action signal on the propagation terminal. According to the type of operation that has to be carried out in the framework of the learning (Set, Reset or no modification of the conductance), the Bit-Line BL is imposed with (by means of a connector Sset, Sreset or Snope which can be switched via a command Cmdset, Cmdreset or Cmdnope applied by the control unit), a postsynaptic action signal which has one of the voltages from among the voltage VBL
In the
In the
In the
In another embodiment shown in
The circuit 30 includes an operational amplifier AOP mounted as a follower in order to adjust the voltage of the Bit-Line by selectively generating the postsynaptic read signal or the postsynaptic action signal. The inverting input of the amplifier AOP is at one of the voltages VBL
The current It that passes through the synapse S1 depends on the value of the resistor R as well as on the voltage on the Bit-Line. This current therefore depends on the type of Set, Reset or Read operation. In order to be able to integrate the synaptic current in the accumulator Cm although a write operation is implemented, the circuit 40 comprises a current step-down device MC that is inserted between the propagation terminal and the accumulator Cm and which is activated when the circuit imposes a conductance modification voltage on the synapse. As shown in
In the circuit of
It is moreover possible to have recourse to a transistor N between the current step-down device MC and the accumulator Cm. Different gate polarisations Vajust_read, Vajust_set, Vajust_reset can be selectively applied to this transistor N in order to counterbalance differences in polarisation at the level of the current step-down device MC according to the access carried out and thus render the current Im even more independent of the type of access.
The invention is not limited to the circuit described hereinabove, but extends to a neuromorphic chip comprising a plurality of resistive memory synapses arranged in a network with transversal lines and columns. Each synapse is for example of the 1T1R cell or 1S1R cell type. Each synapse has an activation terminal and a propagation terminal, with the activation terminals of the synapses of the same line being connected together, with the propagation terminals of the synapses of the same column being connected together and connected to a synaptic integration circuit such as described hereinabove.
Number | Date | Country | Kind |
---|---|---|---|
1871944 | Nov 2018 | FR | national |