The invention relates to a stimulus generator, a neuroprosthetic apparatus and a stimulation method.
Electrical stimulation of neural tissue has been used to restore function to visually impaired people and people with hearing loss via the implantation of bionic devices. Neuroprosthetic and neuromodulation devices are also used for rehabilitation and treatment of neurological disorders such as epilepsy and Parkinson's disease. In current devices, a significant amount of time is spent on optimizing stimulation parameters post-operatively.
Neural signals have been used for command control and feedback in some medical applications but without resulting in techniques with wide application. For example, feedback protocols are used in paraplegic subjects, to control functionality of artificial limbs, for pain control stimulation and to control peristalsis. Functional electrical stimulation is also available as a clinical tool in muscle activation used for picking up objects, for standing and walking, for controlling bladder emptying, and for breathing. While feedback for functional electrical stimulation has been used in such techniques, to date, such techniques do not have wide application. For example, there is still a need to develop feedback protocols for neuroprosthetic stimulation in auditory and visual prostheses, and the suppression of collective synchrony of neurons in epilepsy and Parkinson's patients.
Accordingly, there is a need for further neuroprosthetic stimulation techniques.
In one form, the invention provides a stimulus generator arranged to generate an electrical stimulus to be applied by one or more electrodes to stimulate one or more neurons, wherein in order to generate the stimulus, the stimulus generator:
In an embodiment, the neural model is based on a spike triggered average response of neurons to stimulus and incorporates a spike history response.
In an embodiment an output of the neural model depends on at least one response of one or more neurons in a time period preceding a time period in which the current stimulus is being generated.
In an embodiment, the output of the neural model depends on a stimulus applied in a time period preceding a time period in which the current stimulus is being generated.
In an embodiment, the stimulus generator comprises a reference signal generator arranged to generate a reference signal to be employed in generating the stimulus.
In an embodiment, a neural modelling component of the stimulus generator implements the neural model defining estimated dynamic behaviour of the one or more neurons, and the reference signal generator also implements a neural model defining estimated dynamic behaviour of the one or more neurons in response to sensory stimulus.
In an embodiment, the sensory stimulus is a visual stimulus.
In an embodiment, the neural model is based on a spike-triggered average response of neurons to stimulus.
In an embodiment, a neural modelling component of the stimulus generator implements the neural model defining estimated dynamic behaviour of the one or more neurons, and the reference signal generator implements a different type of neural model to generate the reference signal.
In an embodiment, a neural modelling component of the stimulus generator implements the neural model defining estimated dynamic behaviour of the one or more neurons, and the reference signal generator implements a different type of neural model to generate the reference signal.
In an embodiment, the estimated dynamic behaviour is based on estimated dynamic behaviour of normally functioning neurons.
In an embodiment, the stimulus generator comprises a reference signal generator arranged to generate a reference signal to be employed in generating the stimulus, the reference signal corresponding to the expected response of normally functioning neurons.
In an embodiment, a reference signal is calculated for each electrode.
In an embodiment, the stimulus generator comprises a static observer that provides an estimate of the internal state of the model on the basis of the stimulus and measured response of one or more neurons.
In an embodiment, the stimulus generator comprises a dynamic observer that provides an estimate of the internal state of the model on the basis of the stimulus and measured response of one or more neurons.
In an embodiment, the feedback signal is based on at least one prior response of at least one of the one or more neurons to a previously applied stimulus.
In an embodiment, the feedback signal is based on at least one prior response of one or more related neurons to a previously applied stimulus.
In another form, the invention provides a neuroprosthetic apparatus comprising the stimulus generator as described above and a plurality of electrodes for applying the generated stimulus and measuring the response of one or more neurons.
In an embodiment, the plurality of electrodes comprise separate stimulation and measurement electrodes.
In an embodiment, the neuroprosthetic apparatus comprises at least one input device for obtaining an external stimulus.
In another form, the invention provides a stimulus generator arranged to generate an electrical stimulus to be applied by one or more electrodes to stimulate one or more neurons, the stimulus generator comprising:
In an embodiment, the stimulus generator comprises an observer that receives and processes the modelled response and the generated electrical stimulus in order to generate the feedback signal.
In another form, the invention provides a stimulation method for generating an electrical stimulus to be applied in order to stimulate one or more neurons, the method comprising implementing a neural response model defining estimated dynamics of one or more neurons, and adjusting the stimulus to be applied based on a feedback signal indicative of at least one prior response of the one or more neurons to at least one previously applied stimulus.
In another form, the invention provides a stimulation method for generating an electrical stimulus to be applied by one or more electrodes, to stimulate one or more neurons, the method comprising:
In another form, the invention provides computer program code for implementing one or both of the above methods.
In another form, the invention provides a tangible computer readable medium comprising the computer program code.
Thus, it will be appreciated that embodiments of the invention allow stimulation parameters to be adjusted dynamically, based on the response of neural tissue. That is, embodiments employ advanced engineering techniques, such as feedback control, that allow constant monitoring of the response of neural tissue and optimization of stimulation parameters on-line based on the acquired data. It will also be appreciated that embodiments of the invention enable the provision of a customizable controller in a bionic device thereby providing both scalability and flexibility in manipulating the specific patient-based neural response.
Embodiments of the invention will now be described by way of example with reference to the accompanying drawings in which:
Embodiments of the invention provide a stimulus generator arranged to determine an electrical stimulus to be applied to one or more neurons. In some embodiments, the stimulus generator is provided in a prosthetic apparatus such as a prosthetic device. In other embodiments, the invention is employed as a method in a prosthetic apparatus, for example by program code executed by a processor of a prosthetic device.
As shown in the block-diagram of
In other embodiments, a stimulus generator 200 is provided by a controller 230 attempting to achieve a target response based on a neuron model 220 that generates a reference signal corresponding to the expected behaviour of healthy neurons. As shown in
Employing a feedback system in a stimulus generator 100, 200, as shown in
An embodiment of a stimulus generator 320 in a neuroprosthetic apparatus 300 for visual stimulus is shown in
A schematic diagram of an example of an electrode array for a prototype visual prosthesis is shown in
Cell density is assumed to be uniform. In healthy human retina, an average density of retinal ganglion cells is 2395/mm. (See Harman A., Abrahams B., Moore S., Hoskins R. Neuronal density in the human retinal ganglion cell layer from 16-77 years. The Anat. Record, 260: 124-131, 2000.) While the cell density depends on eccentricity, and 2395 cells/mm2 is for peripheral retina, and centrally there are more than 105 cells/mm2, the lower density number is employed to simplify the model. According to Medeiros N. F., Curcio. C. A. Preservation of ganglion cell layer neurons in age-related macular degeneration. Invest. Ophthalmol. Vis. Sci., 42: 795-803, 2001, 53% of Retinal Ganglion Cells (RGCs) survive in a retina of a person with Age-related Macular Degeneration (AMD). Therefore, the embodiment assumes that density of RGCs in degenerative retina is 1269 cells/mm2 (317 cells in 0.5 mm2 tissue). In order to have a rectangular grid of cells, this value is rounded to 324 corresponding to an 18×18 array of electrodes. In the description that follows, n is a number of neurons and m is the number of electrodes, as they may vary. In other embodiments, cell density may vary.
The array is assumed to be h=60 μm from the tissue. A distance Hi,j from every electrode (i=1, 16) to every cell (j=1, 324) is given in the matrix H. It is calculated as follows:
H
i,j=(h2+|xj−xi|2+|yj−yi|2)1/2, (1)
where (xi, yi, h) are the coordinates of the electrode i and (xj, yj, 0) are the coordinates of the cell j. The distance Hi,j from the highlighted electrode Ei to the cell Cj is shown in
The influence of individual electrodes i onto individual cells j is calculated according to:
The influence of all electrodes onto the cell j is calculated as follows:
The influence of the electrode is scaled by the cubed distance between the electrode and the cell. {circumflex over (V)} is an intracellular voltage potential, êi is a current applied at an electrode i. Hats above variables describe Fourier transform in time. Cm=10−14 Fμm2, τPS=1.1 ms, b=0.5 μm. Bold j is an imaginary unit. Not bold j defines the subindex. Cm is the membrane capacitance constant, τPS is the membrane time constant, b is the outer radius surrounding the intracellular part of the cell.
The membrane voltage of equation (3) is then converted into neural spiking rate using a firing-rate model:
R=f(Vm) (5)
where Vm is the intracellular membrane potential, that can be found using the inverse Fourier transform of (3) above.
The output measurements of a neural population spike rates measured at the electrode i are calculated as follows:
where t is time.
In one example of how the influence of an electrode current on a neuron can be estimated, a neural spike rate can be estimated by employing a spike-triggered average (STA) method described in: Chichilnisky E. J. A simple white noise analysis of neuronal light responses. J. Comput. Neural Syst., 2001, vol. 12, pp. 199-213; Dayan P., Abbott L. F. Neural encoding I: firing rate and spike statistics. MIT Press, Cambridge, 2001; and Klein D., Depireux D., Simon J., Shamma S. Spectro-temporal methods in primary auditory cortex. Publications of Center for Auditory and Acoustic Research.
The STA is the average stimulus preceding a neuron's spike. The STA method characterizes the response properties of a neuron using the spikes emitted in response to a time-varying stimulus. This method describes spatial, temporal and spectral response properties of spiking neurons. The method is relatively robust to fluctuations in response, avoids adaptation to strong and prolonged stimuli and is well-suited to simultaneous measurements from multiple neurons as described in Chichilnisky E. J. A simple white noise analysis of neuronal light responses. J. Comput. Neural Syst., 2001, vol. 12, pp. 199-213.
The STA method is based on Gaussian white noise stimulation to obtain parameters of the STA and nonlinearity of neural response. For white-noise visual stimulation, STA is a vector with values of an intensity of light from the whole spectrum. To compute the STA, the stimulus in the time window preceding each spike is extracted, and the resulting (spike-triggered) stimuli are averaged at each point in time, an image of an intensity drawn from a Gaussian distribution is presented. Then, the stimulation vector is a collection of intensities, s(t), that were presented in a time window prior to prediction time. For example, if a time window corresponds to five stimulation points, to predict response of a neuron at the time t11, a vector (s(t6), s(t7), s(t8), s(t9), s(t10) is used.
For Gaussian white noise electrical stimulation, an amplitude of a bi-phasic pulse is drawn from a Gaussian distribution with zero mean and variance of one. An example of a bi-phasic pulse train is given in
An example of Gaussian white noise pulse stimulation is given in
The time-varying firing rate of a neuron is estimated as in the following:
R
s(t)=Gs({right arrow over (g)}s·{right arrow over (s)}), (6)
R
e(t)=Ge({right arrow over (g)}e·{right arrow over (e)}), (7)
where Rs, Re are the firing rates of a neuron in response to sensory and electrical stimulations, respectively, Gs, Ge are the nonlinearities for sensory and electrical stimulations (generator functions), {right arrow over (g)}s, {right arrow over (g)}e are the STAs for sensory and electrical stimulations, {right arrow over (s)}, {right arrow over (e)} are the sensory and electrical stimuli, and • is a dot product.
When firing rate of a neuron is plotted as a function of a convolution of the STA and the applied stimulus for a particular experiment, it is possible to obtain nonlinearity Gs (and Ge) and predict Rs(t) (and Re(t)) for any stimulus. A spike train is then generated from a Poisson process.
While nonlinearities for both sensory and electrical stimuli have saturation levels, Gs can be fitted by a sigmoidal function, while Ge is a two-sided function because a cathodic first or anodic first pulse may both cause spikes.
In embodiments where it is intended to stimulate neurons in response to sensory stimulation, the response of neurons to sensory stimulation, Rs, is used as a reference signal. The reference is application dependent. In this example, the reference is the response to a visual stimulus according to the neuron model Response of neurons to electrical stimulation, Re, is used for controller design.
In another embodiment, the inventors propose an alternative method for estimating the neural response. In this spike history model, the spike rate at time t depends not only on the stimulus in a short time window preceding the time t, but also on the response of a neuron in a time window preceding the time t.
To incorporate spike history memory into the model, the time-varying firing rate of a neuron, as set out in equation (7), is modified as follows:
R(t)=G(ae[t−1]+|e[t−1]|+h·{right arrow over (r)}[t-t
where {right arrow over (h)} is a kernel for the recent neural response. In other words, response of a neuron at time t depends on a spike history during [t−t1, t−1], where t1−1 is the dimension of {right arrow over (r)}. Note, subindexes s,e in R,G for the light and electrical stimulations are dropped. Unless overwise stated, the derivations are true for both light and electrical stimulations. The parameter a is optimised as described below.
To find G and h, it is assumed that G can be approximated by a hyperbolic tangent:
and h is approximated by a double exponential function:
h(t)=A1e−t/τ
Then the probability of a spike at each time step, t, is calculated as follows:
The log-likelihood of observing the same spike train as experimentally recorded, is calculated as follows:
where Tend is a number of sample points in an experiment.
Parameters a, c, d, A1, τ1, A2, τ2 are then optimized to maximize the log-likelihood of L.
It will be appreciated that the above models of neural response are examples only and other models of neural dynamics may be used.
Below is one embodiment of a controller design. Other controller designs may be used. To assist in the design of the controller, the nonlinearity of equation (5) is initially disregarded and the system is modeled using equations (3) and (4) only. Subsequently, a nonlinear block is added that takes into account the nonlinearity.
Without loss of generality, the following substitutions can be done for each electrode in equation (3):
For an array of electrodes, this results in the following matrix form:
Then equation (3) can be written in the following state-space representation:
The output measurements in state-space representation are defined as follows:
Then the full state-space representation of the system is as follows:
In the above, vector x represents a collection of n neurons, the elements of vector y are the measurements at each of m electrodes and vector u represents the stimulation amplitude at each electrode. The system of equations (10) is detectable but not completely observable. In order to draw conclusions about the system's detectable and observable subspace states, a Kalman decomposition of equation (10) is used that converts equation (10) into the controllable/observable (c,o), the not controllable/observable (
Using Kalman decomposition, we transform (A,B,C,D) into (Ā,
Ā=T
−1
AT,
−1
B,
where T is a suitable n×n invertible matrix and z(t) is the new state of the system. Using (11) we have Ā,
Then, the full state-space representation of the transformed system is:
The upper right and lower left blocks of Ā (that correspond to the not controllable/observable, and not observable/controllable parts of the system) lower block of
In the following description only the controllable and observable part of the system is considered for the feedback controller gain and observer designs, i.e.:
and zx correspond to the controllable and observable part of the state in the Kalman decomposition form.
Kalman decomposition 800 of a general system of linear equations is shown in
To control the system 1000 in one embodiment illustrated in
u(t)=−Kzr(t).
The technique is based on minimizing the quadratic cost function J in
J=(xTQx+uTRu)dt,
R>0 and Q≧0 are found by solving the continuous time Riccati equation:
A
T
P+PA−PBR
−1
B
T
P=−Q.
The following R and Q, that satisfy conditions above, were employed:
where ri=10, qi=10−8, i=1 . . . m. In order to minimize a metric of the tracking error, a feedforward controller with gain Kc was included in the system 1000 of
The resulting controller has the following form:
u=K
c
r−Kz
r,
where r is a reference.
In the original system of equations (10) there are m inputs, which correspond to the applied current amplitude at each of m electrodes. However, when an image or a video is used as a reference, a number corresponding to each pixel of an image (video frame) is given, this number corresponds to n neurons, n>m. The transformation of the old reference into the new reference signal is based on the following:
r=Cr
x
r≅x,
where rx is a new reference signal and r is an old reference, since
A diagram of an embodiment of the feedback system 1200 with the new reference signal is shown in
In a further embodiment, the reference signal is calculated according to equation (6) depending on the light intensity at each point in space and is updated dynamically on-line. In some embodiments, the reference signal will be different for each electrode or may represent other than light intensity.
In order to test the embodiments by simulations, two types of references were used.
Firstly, the reference was taken as an average of in-vitro recordings of a spike rate of eight individual retinal ganglion cells of a primate in response to natural optical stimuli in laboratory environment were employed as described in H., Ruttiger L, Sun H., Lee B. B. Processing on natural temporal stimuli by macaque retinal ganglion cells. J. Neurosci, 15: 9945-9960, 2002.
Secondly, the reference was taken as a spike rate that was proportional to an average light intensity around each electrode in a movie frame.
According to equation (3), all electrodes have an effect on cell j. In reality, only electrodes in close enough proximity to the cell j may influence its membrane potential. This more realistic physiological condition was imposed by assuming that only neurons within a radius a around the electrode i can be affected by this electrode. In other words,
if (Hei,j>a)Ci,j≡0. (15)
Another way this can be thought is if Hi,j>a) in (3)Ie≡0. This allows a further embodiment of the feedback system that employs a filter as per equation (15) and as illustrated schematically in
Observer Design
In order to implement a static observer, only the controllable and observable parts of the system (10) are considered, i.e. the equations (14). The output of the controllable and observable part of the system (14) has the following form:
ti y=
When the matrix
z
r(t)=
A system 2600 with a static observer is shown in
In order to implement a dynamic observer, only the controllable and observable parts of the system (10) are considered, i.e. the equations (14). The matrixes Ār,
The observer gain L is chosen such that the observer error converges to zero asymptotically. The observer error satisfies the following equation:
ė(t)=Ār−L
The eigenvalues of the matrix (Ār−L
A diagram of the dynamic observer 2800 is given in
It will be appreciated from the above that, while many stimulation strategy algorithms in a bionic device have been shown being successful using feedforward techniques, the outcome differs from patient to patient. The feedback stimulation technique described above can address this variability by enabling tailoring stimulation strategy according to the measured response in a neuroprosthetic apparatus.
Additional benefits of using feedback in neuroprosthetic stimulation include:
While the embodiments described above relate to apparatus such as visual prosthetic devices, they can similarly be applied to auditory implants which are designed to provide stimulation in response to auditory input in an analogous way to the above embodiments. The techniques described above also have potential wider application to provide improvements in for example seizure suppression, faster modulation of neural synchrony in patients with Parkinson's disease. For example, Parkinsonian resting tremor is caused by a population of pacemaker-like neurons firing synchronously. In healthy subjects, this population of neurons fire in an uncorrelated and non-periodic way. At present, a strategy to stop neuronal synchronization (and, therefore, tremor) is to apply electrical stimulation (usually at 130 Hz) to a pathological neural population continuously. This continuous stimulation may lead to some undesirable effects, such as neural adaptation and potential for damage of stimulated neural tissue.
It is envisaged that it will be possible to employ a feedback stimulation strategy for patients with Parkinson's disease as illustrated in
Such strategies have many advantages compared to the currently used continuous stimulation, including (i)-(iv) above and the fact that it allows the strategy to mimic healthy neural dynamics.
Similarly, epilepsy is a neurological disorder where seizures occur randomly, normally caused by over-excitation of populations of neurons. While drugs and surgery can be used to control epileptic seizures, 25% of people suffering from epilepsy cannot be treated sufficiently by currently available therapies. A part of this population is suitable for treatment of seizures by electrical stimulation. Currently, neural response is used only for seizure detection or prediction and not for optimization of stimulation parameters. The amplitude or frequency of stimulation is often drawn from a white noise or Poisson distribution and is not based on dynamics of a healthy neural population.
Similar to the stimulation strategy for patients with Parkinson's disease, we propose to use an output of a model of healthy neural population as a reference to a controller. Electrical stimulation is adjusted dynamically based on the recent neural response, Re(t), to the stimulation. Electrical stimulation is optimized in a way so that neural response, Re(t), closely approximates the reference, i.e. the output of the model of a healthy neural population.
Experimental Data
To validate parameters in the models (5), (7), (8), the following exemplary experimental set up 2500 (shown schematically in
Tissue preparation: a piece of inferior retina 2505 obtained from a NZ white rabbit eye was placed flat, ganglion cell 2510 side up, in a perfusion chamber.
Recording electrodes: a Tungsten microelectrode pair 2520 was used for differential extracellular recording.
Stimulating electrodes: Seven platinum disk electrodes 2530 arranged hexagonally were used for epiretinal electrical stimulation. Electrode diameter and centre-to-centre spacing were 125 μm and 325 μm, respectively.
Stimulation and recording protocol: Recording microelectrodes were lowered onto the retinal surface to record action potentials from a ganglion cells. Stimulating electrodes were placed on the retinal surface between the recording electrodes and the optic nerve, along the inferred axonal path.
A PC 2550 running LabVIEW software available from National Instruments of Austin, Tex., USA was used to control electrical stimulation and data acquisition.
Electrical stimulation: A train of 5000 biphasic current pulses with 100 us phase duration was used for stimulation. Stimulus frequencies were 25, 50, 100, 200,500 and 1000 Hz. Square bipolar voltage pulses were delivered by LabVIEW DAQ device 2540 and fed into a constant current, stimulus isolation unit. Stimulus amplitudes varied between 0 and 100 μA.
Data acquisition: a LabVIEW DAQ device 2540 was used for recording. The analog input of the DAQ device consisted of two signals recorded simultaneously at 20 kHz: the stimulus pulse train (AI1) and the cell responses (AI2). AI2 is the output of the amplifier, where the recorded cell responses were amplified 10,000 times and band-pass filtered between 300 Hz and 3 kHz.
Evoked ganglion cell responses were all-or-none and are shown in
It should be noted that the observed latencies of several milliseconds are due to the time required for the action potential to travel along the axon and arrive at the recording site. Both the stimulating and the recording electrodes were fixed in place during stimulation of this cell and therefore any changes in the relative latencies are most likely caused by the stimulus parameters. In other words, the absolute latencies are not intrinsic properties of the cell responses but the relative changes in the latencies are.
Neural Response Model Based on Reverse-Correlation Analysis
The results in this section are for electrical stimulation. The results are based on collected experimental data.
The linear impulse response kernal of the model, {right arrow over (g)}, probability of a spike to the nth pulse (a static non-linearity, G) and stochastically predicted spike train based on the reverse-correlation analysis, are given in
Based on the analysis above, we found that using reverse correlation method we were able to reproduce the experimentally recorded spike train with good accuracy, however unable to reproduce an effect of spike clamping.
Spike History Model
The results in this section are for electrical stimulation. The results are based on collected experimental data.
A state-space representation 2000 of the feedback system is shown in
As observed in
Y≅Yz≅Yr,
where y is the output 3110 of the original system (10), yz is the output 3120 of the system in Kalman decomposition form (12) and yr is the output 3130 of the reduced system (14). Therefore, we can conclude that the state of the system in Kalman decomposition form approximates the state of the original system with good approximation. The state evolutions of the original system 2410 and the system in Kalman decomposition form 2412 are given in
In the above description certain steps are described as being carried out by a processor, it will be appreciated that such steps will often require a number of sub-steps to be carried out for the steps to be implemented electronically, for example due to hardware or programming limitations.
In some embodiments, the method may be embodied in program code. The program code could be supplied in a number of ways, for example on a tangible computer readable storage medium, such as a disc or a memory device, e.g. an EEPROM, (for example, that could replace part of a memory of a prosthetic apparatus) or as a data signal (for example, by downloading it into a memory of the stimulus generator from a server). Further different parts of the program code can be executed by different parts of the apparatus and hence by different processors.
Herein the term “processor” is used to refer generically to any device that can generate and process digital signals. However, typical embodiments will use a digital signal processor optimized for the needs of digital signal processing. Persons skilled in the art, will appreciate that program code provides a series of instructions executable by a processor.
It will be understood to persons skilled in the art of the invention that many modifications maybe made without departing from the spirit and scope of the invention, in particular it will be apparent that certain features of embodiments of the invention can be employed to form further embodiments.
It is to be understood that, if any prior art is referred to herein, such reference does not constitute an admission that the prior art forms a part of the common general knowledge in the art in any country.
In the claims that follow and in the preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, the word “comprise” or variations such as “comprises” or “comprising” is used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention.
Number | Date | Country | Kind |
---|---|---|---|
2012902675 | Jun 2012 | AU | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/AU2013/000678 | 6/25/2013 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61664809 | Jun 2012 | US |