This invention relates to precise phosphene generation through non-invasive cutaneous electrical stimulation. Such localized phosphenes and phosphene patterns can be used to create a device to convey spatial or other information to a user through phosphenes. This would be useful, for example, to a person who has impaired vision.
Phosphenes refer to any visual images that are caused by any stimuli other than light. The most common stimulation of phosphenes are caused by mechanical means, such as when one rubs ones closed eyelids, which results in the perception of various star-like patterns. The most reproducible method for generating phosphenes is through electrical stimulation.
Gall et al., “Noninvasive transorbital alternating current stimulation improves subjective visual functioning and vision-related quality of life in optic neuropathy”, Brain Stimulation 175-188 (2011) proposes that the rate of phosphene perception is proportional to the frequency of the alternating current that is being applied. The stimulation was done by applying a square-wave current waveform bi-laterally across the eyeballs. Most people experience electrically induced phosphenes as spread-out yet localized flashes of light. The time of phosphene perception lines up with the rising and falling edges of the applied square wave. As the stimulation frequency goes up, the phosphenes start to fuse together due to the concept of persistence of vision—i.e. if a phosphene is induced by a current for 20 ms, the brain will perceive the phosphene for greater than 20 ms—and if multiple similar phosphenes are generated quickly and sequentially, the brain will start to perceive one persistent phosphene.
Sehic et al., “Electrical Stimulation as Means for Improving Vision”, American Journal of Psychology 186 (2016) suggests that applied current intensities of 300-900 μA are required to induce Phosphenes.
U.S. Pat. No. 9,254,385 by Greenberg et al. suggests the placement of an electrode array onto the retina to produce localized phosphenes. Even though this approach can produce excellent localized phosphenes, it involves surgical intervention and is highly invasive. Zalevsky et al., “Electromechanical tactile stimulation system for sensory vision substitution”, Optical Engineering 52 (2013) suggested the use of corneal electrode arrays for achieving highly resolved phosphenes. However, they did not account for the comfort and convenience of their intended users.
U.S. Pat. No. 2,703,344 by Anderson describes the use of cutaneous electrode arrays and various voltage waveforms to convey visual and auditory intelligence to the user. However, the invention utilizes vacuum tube technology, high voltages, and bulky magnetics. Similarly, U.S. Pat. No. 4,254,776 and 4,305,402 by Tanie et al. and Katims used cutaneous electrodes in combination with old technology (that cannot be made into a wearable device) and did induce phosphenes. Zeng et al., “Human Sensation of Transcranial Electric Stimulation” Scientific Reports 15247 (2019) used cutaneous electrodes to induce phosphenes and then attempted to spatially map their locations within the visual field. Their approach involved placing the electrodes on the scalp, which requires shaving patches of hair.
U.S. Pat. Nos. 4,664,117 and 4,979,508 by Beck propose the use of two electrodes to convey phosphenes to the user, for entertainment and aiding the visually impaired. His method for creating discriminable phosphenes was by moving the phosphenes within the visual field by manipulating waveform parameters such as amplitude, frequency, and duty-cycle. While he mentions the use of “four or more” electrodes, he only elaborates on the use of four or two electrodes. The microcontroller design from these patents uses dual in-line packaging that is not suited for implementation in wearables, due to its bulkiness.
Lastly, WO2013117800A1 by Vetek et al. suggests a digital approach to using phosphenes as a tool for conveying information to the user's visual field. This application uses analog means (i.e. transistors and op-amps) to generate the stimulation signals.
Pain and uncomfortable sensations may be caused by cutaneous electrical stimulation, which is undesirable. This concern can be relieved by at least six known mitigation strategies: (1) minimizing stimulation current (generally, the lower the better); (2) using two high frequency stimulation waveforms to form beats, as suggested by Oster et al. “Phosphenes,” Scientific American 83-87 (February 1970); (3) using pulse-width-modulation at a higher frequency, as the stimulation waveform, suggested by Gerasimenko et al. “Initiation and modulation of locomotor circuitry output with multi-site transcutaneous electrical stimulation of the spinal cord in non-injured humans,” Physiology-Heart and Circulatory Physiology 113 (February 2015); (4) strictly using bi-phasic pulses in order to leave no stray charges across the skin, suggested by Shinoda et al. “Transcutaneous electrical retinal stimulation therapy for age-related macular degeneration,” The open ophthalmology journal 2 (August 2008); (5) by minimizing the active pulse width to further reduce the applied dose; and (6) by using mild anesthetic agents at the sites of stimulation for creating a more comfortable experience.
This application discloses that by running a voltage waveform through electrodes in pairs on specific locations on the skin of the face or body, phosphene patterns can be predictably produced in specific locations in a person's field of vision. Similarly, running voltage waveforms through electrodes in a monopolar configuration in specific facial locations will also produce phosphenes in predictable locations in the field of vision.
This insight can be used to create a device that uses phosphene patterns to communicate information (for example, spatial information about the wearer's surroundings) to the wearer. This device is non-invasive (i.e. it does not require surgery or connections directly to the optical nerve, brain or retina). This can be useful, for example, for a person who has a visual disability. General devices are described, but also specific embodiments are described that combine safety and practical effectiveness. It is also described how the pain associated with cutaneous stimulation of phosphenes can be reduced by limiting the pulse width, limiting the voltage waveform, and strictly controlling the waveform shape.
In accordance with the present invention, there is provided a system comprising: one to eight pairs of electrodes for cutaneous connection to a person, where the one to eight pairs of electrodes when connected to the person are located at a location selected from the group consisting of: the right temple of the person's head and the left temple of the person's head; or the left temple of the person's head and the left side of the person's head bilaterally across the nose bridge beneath the eyes; or the right temple of the person's head and the right side of the person's head bilaterally across the nose bridge beneath the eyes; or the right side of the person's head on the right cheekbone beneath the eyes to the right side of the nose bridge and the left side of the person's head on the left cheekbone beneath the eyes to the left side of the nose bridge; or the right side medially on the person's head and the left side medially on the person's head; or the left side medially on the person's head and the left side of the person's head on the left cheekbone beneath the eyes to the left side of the nose bridge; or the right side medially on the person's head and the right side of the person's head on the right cheekbone beneath the eyes to the right side of the nose bridge; or the right side laterally on the person's head and the left side distally on the person's head; each of one to eight pairs of electrodes being connected to a waveform generator; the waveform generators being connected to a first control device configured to activate a voltage waveform between the one to eight pairs of electrodes; and the system being connected to a power source.
In a first aspect of the invention, the one to eight pairs of electrodes are two to eight pairs of electrodes. In another aspect of the invention, the first control device being configured to receive input data and convert the data to a pattern of activation for the two to eight pairs of electrodes. In another aspect, the voltage waveform is a biphasic square signal of 1 to 30 Hertz and 10-500 μA. In another aspect of the invention, the voltage waveform is between 1 and 20 volts. In another aspect, the voltage waveform is between 10 and 15 Volts. In another aspect of the invention, the two to eight pairs of-electrodes and the waveform generators are part of a mask. In a further aspect, the first control device is part of the mask. In another aspect, the mask further comprises a sensor, the sensor being configured to send input data to the first control device. In another aspect, the sensor is a spatial sensor and the input data is spatial data and the first control device converts the spatial data into a phosphene pattern that, when the two to eight electrodes are connected to the person, communicates information about the person's spatial surroundings to the person.
In another aspect of the invention, the first control device is a digital computation device. In another aspect, the first control device comprises a graphics processor or a microcontroller or a single board computer. In still another aspect, the first control device limits the voltage waveform in each electrode pair bipolarly. In another aspect the first control device relays the signal across different electrode pairs through demultiplexing. In another aspect of the invention, each waveform generator comprises: a ripple rejector; a first half-bridge and a second half bridge together making a full bridge with a middle terminal; a bipolar current limiter connected in series with the first half-bridge, and the electrode attached to the waveform generator via the second half bridge. In another aspect of the present invention, the bipolar current limiter comprises two unipolar current limiters set in anti-parallel. In another aspect, the bipolar current limiter comprises a unipolar current limiter caged between the DC terminals of a full bridge rectifier. In another aspect of the invention, the system further comprises at least one additional pair of electrodes, the at least one additional pair of electrodes being connected to the waveform generator, and the first control device configured to activate a voltage waveform between the at least one additional pair of electrodes. In yet another aspect of this invention, the pattern of activation comprises activating at least two pairs of electrodes so as to produce centroids in the perception of a person who is connected cutaneously to the electrodes.
In accordance with the present invention, there is provided a system comprising: one to sixteen electrodes, where the one to sixteen electrodes when connected to a person are located at a location selected from the group consisting of: the left temple of the head; or the right temple of the head; or under the left eye at an interior position; or under the left eye at a middle position; or under the left eye at an exterior position; or under the right eye at an interior position; or under the right eye at a middle position; or under the right eye at an exterior position; or above the left eye at an interior position; or above the left eye at a middle position; or above the left eye at an exterior position; or above the right eye at an interior position; or above the right eye at a middle position; or above the right eye at an exterior position; or above the nose to the right side; or above the nose to the left side; where each of the one to sixteen electrodes form a unipolar pair with a seventeenth electrode, where the seventeenth electrode can be cutaneously connected to the person; each of the one to sixteen electrode pairs being connected to a waveform generator; the waveform generators being connected to a first control device configured to activate a voltage waveform between the each of the one to sixteen electrodes and the seventeenth electrode; and the system being connected to a power source.
In an aspect of this invention, the first control device is configured to receive input data and convert the data to a pattern of activation for the one to sixteen electrodes. In another aspect, the voltage waveform biphasic square signal of 1 to 30 Hertz and 10-500 μA. In another aspect, the voltage waveform is between 1 and 20 Volts. In another aspect, the voltage waveform is between 10 and 15 Volts. In yet another aspect, the one to sixteen electrodes and the seventeenth electrode and the waveform generators are part of a mask. In another aspect, the first control device is part of the mask. In still another aspect, the mask further comprises a sensor, the sensor being configured to send input data to the first control device. In still another aspect, sensor is a spatial sensor and the input data is spatial data and the first control device converts the spatial data into a phosphene pattern that, when the one to sixteen electrodes and the seventeenth electrode are connected to the person, communicates information about the person's spatial surroundings to the person. In another aspect, the first control device is a digital computation device. In another aspect of the present invention, the first control device comprises a graphics processor or a microcontroller or a single board computer. In another aspect of the invention, the pattern of activation comprises activating at least two pairs of electrodes so as to produce centroids in the perception of a person who is connected cutaneously to the electrodes.
In accordance with the present invention, there is provided a method of generating phosphenes in a person, comprising: cutaneously attaching one to eight pairs of electrodes to a person, where the one to eight pairs of electrodes whose locations are selected from the group consisting of: the right temple of the person's head and the left temple of the person's head; or the left temple of the person's head and the left side of the person's head bilaterally across the nose bridge beneath the eyes; or the right temple of the person's head and the right side of the person's head bilaterally across the nose bridge beneath the eyes; or the right side of the person's head on the right cheekbone beneath the eyes to the right side of the nose bridge and the left side of the person's head on the left cheekbone beneath the eyes to the left side of the nose bridge; or the right side medially on the person's head and the left side medially on the person's head; or the left side medially on the person's head and the left side of the person's head on the left cheekbone beneath the eyes to the left side of the nose bridge; or the right side medially on the person's head and the right side of the person's head on the right cheekbone beneath the eyes to the right side of the nose bridge; or the right side laterally on the person's head and the left side distally on the person's head; where each of the one to eight pairs of electrodes is connected to a waveform generator; and the waveform generators are connected to a first control device configured to activate a voltage waveform between the one to eight pairs of electrodes; and sending input data to the first control device, the first control device converting the input data to a pattern of activation for the one to eight pairs of electrodes, and so activating the one to eight pairs of electrodes to generate a phosphene pattern in the person.
In a first aspect of this invention, the one to eight electrode pairs are two to eight electrode pairs. In another aspect of this invention, the voltage waveform is a biphasic square signal of 1 to 30 Hertz and 10-500 μA. In another aspect, the voltage waveform is between 1 and 20 Volts. In another aspect if the invention, the voltage waveform is between 10 and 15 Volts. In another aspect, the two to eight pairs of electrodes and the waveform generators are part of a mask and the mask is worn by the person. In another aspect the first control device is part of the mask. In still another aspect, the mask further comprises a sensor, the sensor being configured to send input data to the first control device. In another aspect, the sensor is a spatial sensor and the input data is spatial data and the phosphene pattern communicates information about the person's spatial surroundings to the person. In another aspect, the first control device is a digital computation device. In another aspect, the first control device comprises a graphics processor or a microcontroller or a single board computer. In still another aspect, the first control device limits the voltage waveform in each electrode pair bipolarly. In still another aspect, the first control device relays the signal across different electrode pairs through demultiplexing. In another aspect, each waveform generator comprises: a ripple rejector; a first half-bridge and a second half bridge together making a full bridge with a middle terminal; a bipolar current limiter connected in series with the first half-bridge, and the electrode attached to the waveform generator via the middle terminal. In another aspect the bipolar current limiter comprises two unipolar current limiters set in anti-parallel. In another aspect, the bipolar current limiter comprises a unipolar current limiter caged between the DC terminals of a full bridge rectifier. In another aspect of the invention, the pattern of activation comprises activating the one to eight pairs of electrodes so as to produce centroids in the perception of a person who is connected cutaneously to the electrodes.
In accordance with the present invention, there is provided a method of generating phosphenes in a person, comprising: cutaneously connecting one to sixteen electrodes to a person, where the one to sixteen electrodes whose locations are selected from the group consisting of: the left temple of the head; or the right temple of the head; or under the left eye at an interior position; or under the left eye at a middle position; or under the left eye at an exterior position; or under the right eye at an interior position; or under the right eye at a middle position; or under the right eye at an exterior position; or above the left eye at an interior position; or above the left eye at a middle position; or above the left eye at an exterior position; or above the right eye at an interior position; or above the right eye at a middle position; or above the right eye at an exterior position; or above the nose to the right side; or above the nose to the left side; where each of the one to sixteen electrodes form a unipolar pair with a seventeenth electrode, where the seventeenth electrode is cutaneously connected to the person; and each of the one to sixteen electrodes is connected to a waveform generator; the waveform generators being connected to a first control device configured to activate a voltage waveform between the each of the one to sixteen electrodes and the seventeenth electrode; and sending input data to the first control device, the first control device converting the input data to a pattern of activation for the one to sixteen electrodes, and so activating one to sixteen electrodes to generate a phosphene pattern in the person.
In another aspect of the present invention, the voltage waveform is a biphasic square signal of 1 to 30 Hertz and 10-500 μA. In another aspect, the voltage waveform is between 1 and 20 Volts. In another aspect, the voltage waveform is between 10 and 15 Volts. In another aspect, the one to sixteen electrodes and the waveform generators are part of a mask and the mask is worn by the person. In yet another aspect, the first control device is part of the mask. In still another aspect, the mask further comprises a sensor, the sensor being configured to send input data to the first control device. In another aspect, the sensor is a spatial sensor and the input data is spatial data and the phosphene pattern communicates information about the person's spatial surroundings to the person. In another aspect of the invention, the pattern of activation comprises activating the one to sixteen electrodes so as to produce centroids in the perception of a person who is connected cutaneously to the electrodes.
In accordance with the present invention, there is provided a method of generating centroids in a person, comprising activating two or more pairs of electrodes cutaneously attached to the person, and varying the intensity of the activated two or more pairs of electrodes to locate the centroid in the person's visual field.
The invention is illustrated in the figures of the accompanying drawings which are meant to be exemplary and not limiting, in which like references are intended to refer to like or corresponding parts, and in which:
Subject matter will now be described more fully hereinafter with reference to the accompanying drawings, which form a part hereof, and which show, by way of illustration, exemplary embodiments in which the invention may be practiced. Subject matter may, however, be embodied in a variety of different forms and, therefore, covered or claimed subject matter is intended to be construed as not being limited to any example embodiments set forth herein; example embodiments are provided merely to be illustrative. Those of skill in the art understand that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention. Likewise, a reasonably broad scope for claimed or covered subject matter is intended. The following detailed description is, therefore, not intended to be taken in a limiting sense.
Throughout the specification and claims, terms may have nuanced meanings suggested or implied in context beyond an explicitly stated meaning. Likewise, the phrase “in one embodiment” as used herein does not necessarily refer to the same embodiment and the phrase “in another embodiment” as used herein does not necessarily refer to a different embodiment. It is intended, for example, that claimed subject matter include combinations of example embodiments in whole or in part.
This invention stimulates phosphenes within the visual field of a person through the use of electrical stimulation on the skin, as means of providing artificial vision. The electrical stimulation takes place on the face, using two or more cutaneous surface electrodes. In a preferred embodiment, described below, eight cutaneous surface electrodes are used, where the electrodes are activated in bi-polar pairs. In another embodiment described below, 16 cutaneous surface electrodes are used, which are each tied to a single opposite pole and can each by activated individually as mono-poles. In all cases, a mask or visor can be used to place and hold the electrodes to the skin.
To minimize pain associated with the activation of the electrodes, a biphasic square signal of 1 to 30 Hertz is used. As noted below, it is preferred that the voltage waveform be between 0 and 20 Volts, and in a more preferred embodiment between 10 and 15 Volts. The Voltage Waveform should be between 10-500 μA. Experiments have shown that to minimize pain, it is important that the signal be biphasic and a strict square signal. To the inventor's knowledge, previous investigations have used sinusoidal-wave, triangular wave or monophasic signals resulting in higher levels of user pain.
Activating specific electrode pairs (whether bi-polar pairs or mono-polar pairs) will generate phosphenes in predictable positions in the user's field of vision. By selecting which pairs to activate, information can be passed to the user through the generation of phosphenes.
Generally, any information can be passed to the user through phosphenes—for example, a user working in a dangerous environment could receive information about danger or safety levels as determined by a third party observer. In one potential application, the information is spatial information about a user's immediate surroundings, which is of particular usefulness if the user is blind or has a vision impairment.
Generally, whatever information that needs to be passed to the user needs to be translated into a pattern of electrode pair activations (which can also be called pattern generation). This translation or pattern generation can be accomplished through various types of circuitry and/or software. In a preferred embodiment, this pattern generation is accomplished by using a graphics processor with multiple parallel processors, allowing translation/pattern creation in real time. The user will also have to understand the meaning of the generated phosphenes: in some cases the meaning may be intuitive (such as indicating spatial barriers), but in other cases specific meanings may be associated with specific phosphenes.
In a first embodiment, this invention uses facial cutaneous electrode pair locations that, when a voltage waveform is applied across the locations (i.e. they are a bipolar pair), creates a phosphene in a reproducible location in a person's field of vision. The response time between the application of the voltage waveform and the appearance of the phosphene is on the scale of 200 milliseconds. While in principle any number of two or more electrodes may be used to create a plurality of potential electrode pairs, it is considered that eight electrodes provides a desirable range of phosphene generation. By locating eight electrodes on the face in specific different locations, the loci of the stimulation can be changed by multiplexing a voltage waveform across different electrodes to create a desired phosphene pattern.
The eight electrodes are wired to eight digital signal generators, as depicted in
The phosphenes that result from cutaneous electrical stimulation have perceptive properties such as: shape, size, intensity (brightness), location within the visual field, and flicker frequency. The mapping between the electrode location and phosphene properties is consistent among the tested population. The observed electrode location versus phosphene visual field location is outlined in
A multiplicity of such phosphenes can be induced in a quick bursting action, to draw primitive images onto the visual field, due to persistence of vision. This can be referred to as a compound phosphene. The user can be trained to: 1) identify and discriminate various phosphenes and compound phosphenes 2) associate each with information, such as a warning of danger or an implicit notion of navigation/spatial perception, and 3) if necessary, to act upon such information.
The controller (which in a preferred embodiment is a graphics processor) should be able to processes the sensor data or other input data and output stimulation pulses to create phosphene patterns in real-time. In a preferred embodiment, a graphics processor is used that possesses many processing cores, allowing for parallel processing, resulting in very-low latency processing.
As noted above, to minimize pain the signals or voltage waveform, between the electrodes should be a biphasic square signal of 1 to 30 Hertz. It is preferred that the voltage waveform be between 0 and 20 Volts. In a more preferred embodiment, the voltage waveform is between 10 and 15 Volts. The voltage waveform intensities should be kept to a minimum, between 10-500 μA. It is assumed that the threshold voltage waveform in μA to generate phosphenes can vary in a population. A standardized method can be used to identify this threshold for each individual: initially, a stimulation waveform is applied at 10 μA peak, and the intensity is slowly raised until the user perceives vivid phosphenes. However, the voltage waveform intensity should always kept below 500 μA. It is not recommended that Individuals who fail to see phosphenes at 500 μA use the invention as described herein, since higher voltage waveform intensities might be dangerous in the long run. The setups of the first and second embodiments minimize the voltage waveform path length in the body, thereby reducing the applied EM dose. However, proper low-frequency EM dose calculations should be tracked to keep the voltage waveform dose within safe limits. This is particularly important when phosphene stimulation is to be applied for long time spans.
These skin electrodes are connected to waveform generators 3a, 3b, 3c, 3d, 3e, 3f, 3g and 3h that are wired their respective skin electrodes. Each waveform generator is associated with cathode 1a, 1b, 1c, 1d, 1e, 1f, 1g and 1h and anode 2a, 2b, 2c, 2d, 2e, 2f, 2g or 2h. Specifically, waveform generator 3a is wired differentially across E1 and E2; waveform generator 3b is wired differentially (i.e. no common grounding point) across E3 and E6; waveform generator 3c is wired differentially across E4 and E7; waveform generator 3d is wired differentially across E5 and E8; waveform generator 3e is wired differentially across E1 and E7; waveform generator 3f is wired differentially across E2 and E8; waveform generator 3g is wired differentially across E4 and E5; and waveform generator 3h is wired differentially across E7 and E8. Electrodes E1 through E8 can be any form of cutaneous electrode.
In one embodiment, the waveform generators 3a through 3h are current-limited four-quadrant digital waveform generators.
As known to person skilled in the art, the skin electrodes may be adhered to the skin using any suitable electrode gel such as Ten20™ EEG electrode gel, in order to lower the skin impedance.
By activating a voltage waveform between pairs of the electrodes E1 through E8, phosphenes may be reliably generated in the visual field of the person connected to the electrodes.
As seen in box B in
As seen in box C in
As seen in box D in
As seen in box E in
As seen in box F in
As seen in box G in
As seen in box H in
In
A sensor 54 may optionally be located somewhere on the mask 50. In one embodiment, the sensor can sense spatial surroundings. In one embodiment, the sensor 54 is a camera, and in a preferred embodiment is similar to the cameras used in smartphones. In the embodiment of
As illustrated, mask 50 does not have any holes for eyes or ears. Such eyeholes or earholes may optionally be included in mask 50.
Ideally, feedback step 70 is used in a training period to adjust the device, but once this training is performed the device will need minimal adjustment.
A waveform generator is included in
This wave-form generator can be used to create a sharp square signal, and can create a bi-phasic signal in accord with this invention. Persons skilled in the art will understand that other forms of circuitry and/or software can be used to similar effect.
A second approach to phosphene stimulation uses mono-polar electrodes as compared to the previous embodiments which used bi-polar or paired electrodes. In this approach, all of the stimulation signals (or, equivalently, each electrode) shares a common ground node. The ground node can be placed onto any part of the body.
One embodiment of a mono-polar system is illustrated in
More specifically, location/electrode 150 is located on the left temple of the head, and location/electrode 159 is located on the right temple of the head. Location/electrodes 163, 164 and 165 are located under the left eye at an interior position 163, middle position 164 and exterior position 165. Location/electrodes 162, 161 and 160 are located under the right eye at an interior position 162, middle position 161 and exterior position 160. Location/electrode 155 is located above the nose to the right side, and location/electrode 154 is located above the nose to the right side. Location/electrodes 156, 157 and 158 are located above the right eye at interior position 156, middle position 157 and exterior position 158. Location/electrodes 153, 152 and 151 are located above the left eye at interior position 153, middle position 152 and exterior position 151.
Each of the electrodes 150 to 165 will, when activated, produce a phosphene in a specific location in the field of vision. Two phosphenes will appear if two electrodes are activated simultaneously, although this may be perceived by the wearer as one phosphene.
The mono-polar electrode embodiment described above may be implemented using a mask to control the location of the electrodes on the face, similar to the mask described above. One advantage of the mono-polar electrode approach is that the corresponding wave-form generators will be less bulky than in the bi-polar case, largely because there is no need to galvanically isolate the electrodes. As a result, a mono-polar mask that includes the associated circuitry can be much less bulky than a mask for use with a bi-polar system, or equivalently many more mono-polar electrodes can be placed within a similarly bulky mask.
Whether using mono-polar electrodes or bi-bolar (pairs of) electrodes, the activation of more than one pair, either simultaneously or close in time, and with varying current intensities, can be used to create and control the location of phosphenes across the entire visual field, which may be called integrated phosphene stimulated perception.
This can be achieved through the stimulation of two or more pairs of electrodes, as illustrated in
The above example assumes that the stimulation by electrode pairs A and B have identical electrical stimulation intensity. (Intensity means power per area) Increasing the intensity applied by one electrode pair relative to the other electrode pair produces a spatially offset centroid that is proportionally closer to the location of the phosphene generated by the higher intensity electrode pair when the higher intensity electrode pair is activated alone. To exemplify the second approach, assume that the stimulation of a first pair of electrodes A alone produces a phosphene at location X, and the stimulation of a second pair of electrodes B alone produces a phosphene at location Y. Simultaneously activating electrode pairs A and B, while having electrode pair A administered at twice the intensity of electrode pair B, results in a centroid perception that is proportionately closer to X than Y.
By using the approaches in the preceding paragraphs, centroids/phosphenes can be reliably and predictably generated across the entire visual field. As a result, more complex and detailed imaging through phosphenes can be perceived across the entire visual field using the convenient apparatus already described.
Phosphenes are an experienced phenomenon and are hard to measure or even register externally. Therefore, subjects must introspectively experience and perceive phosphenes and then describe their experience through an oral description or drawings.
The perception of phosphenes is represented on a binocular perimetry target, which we will refer to as a perimetry target. Turning to
Turning to
Our study was designed in two phases: a pilot study and a feasibility study on human healthy volunteers.
The purpose of the pilot study was to find an optimal set of electrical stimulation parameters namely the stimulation waveform shape, peak current intensity, and electrode size to reproducibly stimulate phosphenes at no skin irritation or pain. In this pilot study, a square pulse generator was wired across the temple of two healthy volunteers and an ammeter was placed in series with the associated circuit. Such a set up was optimized to observe the effectiveness of the stimulation to induce phosphenes reliably at absence of uncomfortable feeling.
Through a series of trial-and-error attempts, it was found that the electrical stimulation parameters outlined in
Turning to
In a pilot study, the induced phosphenes demonstrated an associated spatial component according to subjective reporting from the subjects. The spatial component was reported to be in accordance with the location of the electrodes on the facial skin. For instance, the phosphenes that are stimulated by electrically stimulation of the skin regions om the right side of the face light up the right-most half of the visual field. Similarly, stimulating the left side of the face, generates phosphenes that light up the left side of the visual field.
In order to have a data-driven approach to scientifically tackle such subjective observations, a human study was initiated where subjects would receive electrical stimulation across various pre-selected facial regions through numerous trial events, while they were to draw their percepts upon every electrical stimulation cycle. In order to run the human healthy volunteer study, a set of controlled and independent variables were defined. The control variables included an optimal set of electrical stimulation parameters namely the stimulation waveform shape, peak current intensity, and electrode size were determined. Through a series of trial-and-error attempts, it was found that the electrical stimulation parameters outlined in
In the human study, each participant received the electrode dressing illustrated in
These skin electrodes are connected to stimulation channels CH1, CH2, CH3, CH4, CHS, CH6, Ch7 that are wired their respective skin electrodes. Specifically, channel CH1 has active electrodes 1 and 2 (the templar location); channel CH2 has active electrodes 3 and 6 (the distal forehead location); channel CH3 has active electrodes 4 and 7 (the right transorbital location); channel CH4 has active electrodes 5 and 8 (the left transorbital location); channel CH5 has active electrodes 1 and 7 (the right infraorbital location); channel CH6 has active electrodes 2 and 8 (the left infraorbital location); and channel CH7 has active electrodes 7 and 8 (the transnasal location).
The stimulation current waveform used is illustrated in
Study on human healthy volunteers was designed as a feasibility study conducted with 8 healthy individuals in order to map the phosphene location and shape across a healthy population as foundational research for future models. Eight participants were collected. Each participant signed a consent form and was then taken to a dimly lit room. Turning to
A preliminary step was performed, where the phosphene stimulation threshold was set for each participant before the remainder of the experiment. In this step, the templar electrode channel (CH1) stimulation was repeatedly applied whilst the stimulation current intensity was gradually raised. The participant was asked to report seeing a phosphene, which would signal the halting of raising of the stimulation current. The current level was always hardware restricted below 500 μA which is considered as safe for human involving research of head and brain. Once found, the stimulation intensity was kept constant for the remainder of the experiment. In our observations, the phosphene stimulations have not demonstrated fading effects requiring increasing the current.
After this preliminary stage, the data collection was initiated. During the data collection, stimulation sites, referred to as the stimulation channels (CH1, CH2, CH3, CH4, CH5, CH6, CH7 and CH8) were applied in a pseudorandomized fashion. To pseudo-randomize the stimulation channel sequencing, a MATLAB script was developed where numbers between 1 to 8 were pseudo-randomly organized and through a few conditional statements, it was made sure that each number was repeated for exactly 8 times, within the sequence. Such a sequence was hard coded into the stimulus administrator; therefore, the exact same sequence was used for each participant. Such a procedure made sure that the stimulation sequence would seem random to the participant, but its log was recorded.
Each channel was applied a total of 8 times, resulting in a total of 64 stimulation events. After each stimulation event, the participant 814 was asked to draw the contours of the phosphene they saw for that particular channel, from memory, on the smartboard 812 (
To limit the degrees of freedom, the only stimulation parameter that was varied was the electrode location. To administer the stimulation, a circuit was designed. A simple H-bridge circuit was constructed for the generation of the charge-neural waveform illustrated in
For each individual, each of the eight channels were energized eight times in a pseudo-randomized manner through 64 energization events lasting 200 milliseconds each whilst the smartboard displayed a binocular perimetry target. A perimetry target (
The order of the channel energization events was pseudo-randomized, and each photograph was traced to its associated channel for the experiment conductors, even though to each participant the activation order of the electrodes was seemingly random and irregular in pattern for robust and unbiased data collection.
After the human trials, each participant produced 64 photographs with 512 photographs in total after the study for analysis.
The initial data was a photograph as per
In the following step 920, the phosphene drawings were isolated from their perimetry target background (step 921) and thereafter thresholded mid-scale (labelled 922) to get a binary mask 923 that represents the phosphene bodies that the participants perceived. So far, these steps were taken to pre-process the images from drawing photographs into illustrations that depict the phosphene percept bodies in the visual field. These steps were performed in Photoshop™ (Version 21.1.1, Adobe™, USA). Individual phosphene maps were generated by summing the phosphene drawings labelled under the same stimulation channel (labelled 924). A set of eight individual phosphene maps were generated for each participant. ROC analysis was applied to each individual phosphene map (labelled 925). Binary masks proposed in
A further step was taken by summing the individual phosphene maps belong to the same stimulation channel together (labelled 926), which resulted in the population phosphene maps 927. ROC analysis was applied to the population phosphene maps. Centroid analysis was applied to channels 2, and 7 (labelled 928). Centroid analysis was used to compare the difference of up (CH2) and down (CH7) population phosphene maps. As well, ROC analysis was applied to the population phosphene maps (labelled 929). Two compound phosphenes were generated by summing channels 3 and 5 (right) and channels 4 and 6 (left) channels. At this stage, right and left compound phosphene maps are generated and compared using ROC and mass centroid analysis (labelled 930). The up (CH2) and down (CH7) population phosphene maps were also compared using mass centroid analysis (labelled 928). The mass centroid analysis was done to compare phosphene maps that are used to implicitly encode up, down, right, and left directions to the participant.
A full summation of all of the phosphene drawings is computed, to see where the facial cutaneously stimulated phosphenes are spatially oriented (labelled 931). The entirety of steps involving individual, population, and compound phosphene map generation, as well as ROC and mass centroid analysis were done in MATLAB™ (Version R2020a, MathWorks™, USA).
For the analysis of the individual and collective phosphene maps, various metrics were needed to assess the proximity of the activated electrodes to the electrically-stimulated phosphene percept location. To achieve this, a ground truth mapping was developed, allowing the identification of the phosphene “visual” field (VF) regions in close proximity to their corresponding active electrodes through the consideration of the remainder background as false.
Sensitivity, a metric capable of measuring the ability of systems to detect a % of true positives, and specificity, a metric capable of measuring the ability of systems to detect a % of true negatives were used for the process. Both metrics (ROC and Mass Centroids) were computed through the two data sets of experimental results presented in the table (Human Study's Individual and Population Sensitivity and Specificity Values) in
For the finalization of results, the phosphene marked regions 1010 in
Eq. 7 was used to assess the efficacy of each channel in inducing phosphenes. This equation can also be used to assess the efficacy of the control channel. A low percentage on the efficacy of the control channel would suggest the control the false positive immunity of our methodology to induce phosphenes. In Eq.7 the “I” term represents the individual phosphene maps particular to a stimulation channel. The “Max_Score” term is 8, since that's the maximum score possible for each individual phosphene map. Lastly, the “N” term is the population size, which is 8. The “i” term is the iterator that looks through the members of the population.
The secondary analysis that was used to assess the discriminability of phosphene maps is mass centroid analysis 1030. Specifically, such an analysis was used to assess the discriminability of left and right encoding phosphenes, as well as the up and down encoding phosphenes. Eq. 8 and Eq. 9 were used to compute the vertical 1032 and horizontal 1034 coordinates of the spatial mass centroid of population phosphene maps during centroid analysis. The term “I(x, y)” 1036 is the phosphene map 2D array. The terms “x” and “y” represent the x and y coordinates within the 2D cartesian array.
The computation method of the mass centroid of the phosphene map pixels is very similar to that of in physics. Each pixel is assumed to have a point mass to that of its grey value and a two-dimensional cartesian coordinate equal to that of its x and y indices in the array. The x-centroid of the pixel array can be found by first computing the 2D summation of the product of each pixel's grey value and its corresponding x-coordinate. Diving the resultant by the summation of all grey values within the array, will yield the x-centroid. The y-centroid can be found in a similar manner, with the difference in the initial term, where the grey values are multiplied by their corresponding y-coordinate instead.
In order to compare the outcomes of the mass centroid analysis, Euclidean distance is used to assess the discriminability between the phosphenes. It is assumed that phosphenes that possess farther centroids are more spatially discriminable. Eq. 10 illustrates the equation expressing Euclidean distance. The “Δy” term is the difference of the y-coordinates of the two centroids and the “Δx” term is the difference of the x-coordinates of the two centroids. The term “D” represents the magnitude of the Euclidean distance.
D=√{square root over ((Δy)2+(Δx)2)} Eq.10
When ranking the performance of each population phosphene map, the numerical figure that was used to sort the rankings was assumed to be the sum of sensitivity and specificity figures for each channel. Eq. 11 illustrates the approach to such a metric.
Ranking Score=Sensitivity+Specificity Eq. 11
Lastly, Due to the similarities of the hypothesized ground truths of channels CH3 and CH5, as well as CH4 and CH6, a set of compound phosphenes maps were generated, where a right encoding compound phosphene map was generated by following Eq. 12 and a left encoding compound phosphene map was generated by following Eq. 13. The phosphene maps used to generate such phosphene maps were the population phosphene maps. ROC and centroid analyses was used on both of such compound phosphene maps, to compare the performances of the two against themselves, as well as against the up (CH2) and down (CH7) population phosphene maps.
Right Compound Phosphene Map=I(x, y)CH3+I(x, y)CH5 Eq. 12
Left Compound Phosphene Map=I(x, y)CH4+I(x, y)CH6 Eq. 13
In the compound phosphene map ROC analyses, the ground truth (GT) map of CH3 was used to assess the tight encoding compound phosphene map and the CH4 ground truth map from
Lastly, to compute the total sum of phosphenes to depict the overall manifestations of the phosphenes generated by our proposed apparatus, Eq. 14 is used to compute such a sum.
Total sum=Σn=1,2,3, . . . , 8 I(x, y)CH
The waveforms shown in
The ability of each phosphene map to stay true to its hypothesized outcome according to
Overall (turning to the table in
The population phosphene maps are illustrated in
The ability of each phosphene map to stay true to its hypothesized outcome according to
Overall (turning to the table in
In terms of channel-based ROC analysis, channels 3 and 4 had the highest ROC score, while channels 8 and 6 came in third and fourth place respectively. Channels 3 and 4 displayed the highest sensitivity/specificity (84.4%/75% (CH3) and 100%/81.3% (CH4)), Channels 6 and 7 displayed less sensitivity/specificity, while channels 1, 5, and then 2 followed the remainder of the ROC performance ranking from higher to lower. The table in
Such combinations were implemented through summing the CH3/CH5 (right) and CH4/CH6 (left) phosphene maps which gives 75.8%/76.6% sensitivity/specificity for the right encoded compound channels, versus the 69.5%/81.3% sensitivity/specificity of the left encoded compound phosphene map.
This can be interpreted as the up/down phosphene map pairs sensitivity and specificity is lower than the right/left phosphene map pair and we can speculate that up/down phosphene map pairs are less discriminable comparing the left/right phosphene coding at the used location of the electrodes.
The mass centroid analysis suggests the same outcome. Turning to
After summing the entirety of the population phosphene maps into a cumulative phosphene map, it was found that phosphenes stimulated through our method have a tendency to appear in the peripheral visual field similar to what can be
b are conceptual illustrations allowing for an explanation of the present invention. Those of skill in the art should understand that various aspects of the embodiments of the present invention could be implemented using different materials and minor design modifications. Notably, the figures and examples above are not meant to limit the scope of the present invention to a single embodiment, as other embodiments are possible by way of interchange of some of the described or illustrated elements. Moreover, where certain elements of the present invention can be partially or fully implemented using known components, only those portions of such known components that are necessary for an understanding of the present invention are described, and detailed descriptions of other portions of such known components are omitted so as not to obscure the invention.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CA2021/050557 | 4/23/2021 | WO |
Number | Date | Country | |
---|---|---|---|
63014616 | Apr 2020 | US |