Patent Application
20170035317
This patent document relates to systems, devices, and processes that use brain machine interface (BMI) technologies.
Electroencephalography (EEG) is the recording of electrical activity exhibited by the brain using electrodes positioned on a subject's scalp, forming a spectral content of neural signal oscillations that comprise an EEG data set. For example, the electrical activity of the brain that is detected by EEG techniques can include voltage fluctuations, e.g., resulting from ionic current flows within the neurons of the brain. In some contexts, EEG refers to the recording of the brain's spontaneous electrical activity over a short period of time, e.g., less than an hour. EEG can be used in clinical diagnostic applications including epilepsy, coma, encephalopathies, brain death, and other diseases and defects, as well as in studies of sleep and sleep disorders. In some instances, EEG has been used for the diagnosis of tumors, stroke and other focal brain disorders
Disclosed are electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects. In some aspects, the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display, demonstrating ability to assess potential visual field deficits, e.g., in conditions such as glaucoma.
In one aspect, a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
In one aspect, a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials (mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
In one aspect, a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user's visual field; and an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
The subject matter described in this patent document can be implemented in specific ways that provide one or more of the following features. For example, by removing the subjectivity inherent to standard perimetry, the disclosed portable platform for assessing functional loss can facilitate detection and monitoring of visual field loss in glaucoma, the leading cause of blindness in the world. The disclosed portable platform uses high-density EEG recording and mfSSVEP that can provide improved signal-to-noise ratios, increasing reproducibility and diagnostic accuracy, e.g., as compared to existing EEG-based methods for objective perimetry, such as mfVEP. As a portable platform that could be used for testing in unconstrained situations, the disclosed methods can allow for much broader and more frequent testing of patients, e.g., as compared to existing perimetric approaches. For example, this could reduce the number of office visits necessary for patients at risk or diagnosed with glaucoma, significantly decreasing the economic burden of the disease. In addition, by allowing more frequent testing, the disclosed methods can facilitate the discrimination of true deterioration from test-retest variability, e.g., resulting in earlier diagnosis and detection of progression. The disclosed portably-implemented and objective methods for visual field assessment can also allow screening for visual loss in underserved populations. The disclosed technology is non-invasive and can be implemented without direct physical contact with an eye of the individual subject being assessed, and thereby avoid causing any discomfort or risk of injury through inadvertent application of force or transfer of harmful chemical or biological material to the eye.
Those and other features are described in greater detail in the drawings, the description and the claims.
Optic neuropathy refers to optic nerve damage that can result in significant and irreversible loss of visual function and disability. One example is glaucoma. Glaucoma is associated with a progressive degeneration of retinal ganglion cells (RGCs) and their axons, resulting in a characteristic appearance of the optic disc and a concomitant pattern of visual field loss. Loss of visual function in glaucoma is generally irreversible, and without adequate treatment the disease can progress to disability and blindness. The disease can remain relatively asymptomatic until late stages and, therefore, early detection and monitoring of functional damage is paramount to prevent functional impairment and blindness.
It is estimated that glaucoma affects more than 70 million individuals worldwide with approximately 10% being bilaterally blind, which makes it the leading cause of irreversible blindness in the world. However, as the disease can remain asymptomatic until it is severe, the number of affected individuals is likely to be much larger than the number known to have it. Population-level survey data indicate that only 10% to 50% of the individuals are aware they have glaucoma.
Visual dysfunction appears to be a strong predictor of cognitive dysfunction in subject in a number of clinical neuroscience disorders. For example, the functional deficits of glaucoma and Alzheimer's Disease include loss in low spatial frequency ranges in contrast sensitivity, and are similar in both diseases. Pattern masking has been found to be a good predictor of cognitive performance in numerous standard cognitive tests. Some tests found to correlate with pattern masking include Gollin, Stroop-Work, WAIS-PA, Stroop-Color, Geo-Complex Copy, Stroop-Mixed and RCPM, for example. Losses in contrast sensitivity at the lowest spatial frequency also was predictive of cognitive losses in the seven tests. For example, AD subjects have abnormal word reading thresholds corresponding to their severity of cognitive impairment and reduced contrast sensitivity in all spatial frequencies as compared to normal subjects.
Assessment of functional loss in the disease has traditionally been made using standard automated perimetry (SAP). SAP is the current standard for assessment of visual field loss. Visual field assessment with SAP requires considerable subjective input from the patient, and for some patients it is very difficult, or even impossible, to obtain reliable visual field measures. SAP is also limited by large test-retest variability and a large number of tests are usually necessary in order to discriminate true disease progression from noise, even for reliable test-takers. For example, SAP testing is limited by subjectivity of patient responses and large variability, frequently requiring a large number of tests for effective detection of change over time. These tests are generally conducted in clinic-based settings and, due to limited patient availability and health care resources, an insufficient number of tests are frequently acquired over time, resulting in delayed diagnosis and detection of disease progression. The requirements for highly trained technicians, cost, complexity, and lack of portability of SAP testing also preclude its use for screening of visual field loss in underserved populations. For example, because SAP, testing is generally performed in a clinic-based setting and requires highly trained technicians, this limits the availability of this testing resource, which frequently results in patients not undergoing the necessary number of tests to allow detection of disease progression over time, and thereby resulting in late diagnosis or delayed detection of progression. Perimeters are also usually expensive and not easily transportable, which has largely impeded the use of the SAP technique for screening or assessment of visual field loss in remote settings and in underserved populations. Neurological disorders, e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and tumor, can be diagnosed and tracked by SAP.
Objective assessment of visual field damage in glaucoma has been attempted with the use of visual evoked potential (VEP) and multifocal VEP techniques. However, these VEP techniques have been limited by relatively low signal to noise ratio and have shown limited potential to assess visual field losses in the disease. For example, the conventional pattern VEP is predominantly generated by cortical elements receiving projections from the central retina, where the central 2° of visual field contributes 65% of the response. Therefore, conventional VEP possesses a limited ability to reflect field loss in non-central areas, such as those that can occur with glaucoma. While multifocal VEP techniques cab allow many areas of the retina to be stimulated simultaneously and separate responses from each part of the visual field to be obtained, individual differences in the anatomy of the visual cortex lead to considerable inter-individual variability of responses in normal subjects, making it difficult the identification of mfVEP abnormalities in diseased patients. Further, existing mfVEP recording techniques can only be performed with non-portable devices in clinic- or laboratory-based settings, requiring cumbersome setup for placement of electrodes (e.g., data collection requires skin preparation and gel application to ensure good electrical conductivity between sensor and skin), and such procedures are time consuming and uncomfortable for the patient.
The present technology includes methods, systems, and devices that acquire, process, and/or utilize steady-state visually evoked potentials (SSVEP) for monitoring, tracking, and/or diagnosing various paradigms in cognitive function (e.g., visual attention, binocular rivalry, working memory, and brain rhythms) and clinical neuroscience (e.g., aging, neurodegenerative disorders, schizophrenia, ophthalmic pathologies, migraine, autism, depression, anxiety, stress, and epilepsy), particularly for SSVEPs generated by optical stimuli.
Disclosed are electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects. In some aspects, the disclosed techniques integrate mfSSVEPs into a portable platform using wireless EEG and a head mounted display capable of assessing potential visual field deficits. In some implementations, for example, the disclosed technology can be applied to diagnose and track neurological disorders, e.g., such as macular degeneration, diabetic retinopathy, optic neuritis, papilledema, anterior ischemic optic neuropathy, and/or tumors.
For example, in contrast to the transient event-related potentials elicited during a conventional VEP or mfVEP examination, the present technology utilizes rapid flickering stimulation to produce a brain response characterized by a “quasi-sinusoidal” waveform whose frequency components are constant in amplitude and phase, e.g., the so-called steady-state response. In some embodiments, for example, the portable platform integrates a wearable, wireless, high-density dry EEG system and a head-mounted display allowing users to routinely monitor the electrical brain activity associated with visual field stimulation. The present technology includes brain-computer interfaces using dry EEG sensor arrays, wearable/wireless data acquisition and signal processing hardware and software. These interfaces can monitor and record non-invasive, high spatiotemporal resolution brain activity of unconstrained, actively engaged human subjects.
For example, the disclosed technology can be applied for ophthalmologic diagnosis of neurological complications, in particular that of major ocular pathologies including glaucoma, retinal anomalies and of sight, retinal degeneration of the retinal structure and macular degeneration, diabetic retinopathy, optic neuritis, optical neuroma, or degenerative diseases, e.g., such as Parkinson's disease, Alzheimer's disease, non-Alzheimer's dementia, multiple sclerosis, ALS, head trauma, diabetes, or other cognitive disorders, e.g., such as dyslexia. More broadly, the present technology can be used to characterize inappropriate responses to contrast sensitivity patterns, and disorders affecting the optical nerve and the visual cortex.
Similarly, the disclosed technology can be used for multiple sclerosis (MS). It is known that MS affects neurons and that the effect comes and goes with time. There is apparent recovery of the cells at least in early stages of the disease. One would therefore expect the diagnosed areas of loss in the visual field to move around the visual field over time, and perhaps to recovery temporarily. As the disease progresses to the point where there is a lot of loss on the retina, the areas of loss will remain lost and will not show temporary recovery. The retina and brain do parallel processing to determine relative position of adjacent objects. In the case of dyslexia, for example, this processing somehow gets reversed and the subject mixes up the order of letters in words or even the order of entire words. This too could show up as an apparent ganglion cell loss. Again, the apparent loss could be from the ganglion cells or from the feedback to the lateral geniculate nucleus. The disclosed technology includes portable platforms that can be used for accurate and convenient screening of many neuro-degenerative diseases, e.g., including Alzheimer's, non-Alzheimer's dementia, Parkinson's, multiple sclerosis, macular degeneration, ALS, diabetes, dyslexia, head trauma, and others.
The present technology utilizes electroencephalogram (EEG)-based brain sensing methods, systems, and devices for visual-field examination by using high-density EEG to associate the dynamics of multifocal steady-state visual-evoked potentials (mfSSVEP) with visual field defects, in which the use of rapid flickering stimulation can produce a brain response characterized by a “quasi-sinusoidal” waveform whose frequency components are constant in amplitude and phase, the so-called steady-state response. Steady-state VEPs have desirable properties for use in the assessment of the integrity of the visual system. For example, the disclosed techniques are faster than mfVEP, less susceptible to artifacts produced by blinks and eye movements, to electromyographic noise contamination and may present better signal to noise (SNR) ratio. mfSSVEP is a form of steady-state visual-evoked potentials which reflect a frequency-tagged oscillatory EEG activity modulated by the frequency of periodic visual simulation higher than 6 Hz. Different from the ordinary SSVEP, the mfSSVEP is a signal of multi-frequency tagged SSVEP, e.g., which can be elicited by simultaneously presenting multiple continuous, repetitive black/white reversing visual patches flickering at different frequencies. Based on the nature of mfSSVEP, a flicker sector(s) corresponding to a visual field deficit(s) will be less perceivable or unperceivable and thereby will elicit a weaker SSVEP, e.g., as compared to the brain responses to other visual stimuli presented at normal visual spots.
The disclosed methods, systems, and devices for visual-field examination using mfSSVEP data includes the formation of a spatial visual stimulus display having multiple regions or sectors at different spatial locations, where for each region, the particular region includes an optical effect (e.g., light flickering) that changes at a unique frequency with respect to at least a proximate region or any other region of the visual stimulus display. For example, the visual stimulus display can include twenty regions each presenting its respective optical effect at a different frequency between 8.0 Hz and 11.8 Hz (e.g., 8.0 in sector 1, 8.2 in sector 2, 8.4 in sector 3, . . . , 11.8 in sector 20). For example, the optical effect can be a light modulating between an ON and OFF state at the designated frequency for the particular region. The brain response to the visual stimuli, e.g., as measured by at least one electrode placed on or near the head or multiple electrodes arranged in an arrangement to improve spatiotemporal resolution of the EEG signals, are acquired and processed to produce and evaluate mfSSVEP data with respect to a frequency spectrum including the designated frequencies mapped to the spatial regions of the visual stimulus display. The processing includes comparing the mfSSVEP signal at the particular frequencies to a predetermined threshold, or in relation to other mfSSVEP signals, to determine if the signal falls below the predetermined threshold or is substantially lower with respect to a comparative mfSSVEP signal. Determination of a mfSSVEP signal below the threshold or substantially lower than a standard at that particular frequency corresponds to a visual field deficiency to the spatial location on the visual stimulus display to which that frequency is mapped, and indicative of a visual field defect of the user in that specific region.
In some implementations, for example, the disclosed techniques include using SSVEP and brain-computer interfaces (BCIs) to bridge the human brain with computers or external devices. By detecting the SSVEP frequencies from the non-invasively recorded EEG, the users of SSVEP-based brain-computer interface can interact with or control external devices and/or environments through gazing at distinct frequency-coded targets. For example, the SSVEP-based BCI can provide a promising communication carrier for patients with disabilities due to its high signal-to-noise ratio over the visual cortex, which can be measured by EEG at the parieto-occipital region noninvasively. Methods, devices and systems of the disclosed technology can implement wireless SSVEP data acquisition and processing. Methods, devices and systems of the disclosed technology can include a noninvasive platform for continuously monitoring high temporal resolution brain dynamics without requiring conductive gels applied to the scalp. An exemplary system can employ dry microelectromechanical system EEG sensors, low-power signal acquisition, amplification and digitization, wireless telemetry, and real-time processing. In addition, the present technology can include analytical techniques, such as independent component analysis, which can improve detectability of SSVEP signals.
Exemplary implementations of the disclosed multifocal techniques to SSVEP (mfSSVEP) are described in this patent document. The exemplary results of such implementations demonstrate detection of localized and peripheral field losses, as well as show successful implementations of a portable objective method of assessment of visual field loss in opto-neurological diseases, e.g., such as glaucoma, amblyopia, age-related macular degeneration, and optic neuritis.
Diagnosis and detection of progression of neurological disorders remain challenging tasks. For example, a validated portable objective method for assessment of visual field loss would have numerous advantages compared to currently existing methods to assess functional loss in the disease. An objective EEG-based test would remove the subjectivity and decision-making involved when performing perimetry, potentially improving reliability of the test. A portable and objective test could be done quickly at home under unconstrained situations, decreasing the required number of office visits and the economic burden of the disease. In addition, a much larger number of tests could be obtained over time. This would greatly enhance the ability of separating true deterioration from measurement variability, potentially allowing more accurate and earlier detection of progression. In addition, more precise estimates of rates of progression could be obtained. Even if the spatial resolution of mfSSVEP does not provide a higher resolution than SAP techniques, the increased number of tests available for analysis over time can still provide more reliable assessment of visual field defects. The exemplary visual field assessment methods can be used for screening in remote locations or for monitoring patients with the disease in underserved areas, as well as for use in the assessment of visual field deficits in other conditions.
There are few if any currently available reliable and effective portable methods for assessment of functional loss in such disorders. The disclosed technology includes a portable platform that integrates a wearable, wireless EEG dry system and a head-mounted display system that allows users to routinely and continuously monitor the electrical brain activity associated with visual field in their living environments, e.g., representing a transformative way of monitoring disease progression, e.g., such as in glaucoma. In addition, such devices provide an innovative and potentially useful way of screening for the disease. The disclosed technology includes portable brain-computer interfaces and methods for sophisticated analysis of EEG data, e.g., including capabilities for diagnosis and detection of disease progression. For example, the disclosed methods, systems, and devices can be implemented to improve screening, diagnosis and detection of disease progression and also enhance understanding of how the disease affects the visual pathways.
The visual display unit 112 can include an output unit that can include various types of display, speaker, and/or printing interfaces, e.g., which can be used to implement a visual stimulus technique. For example, the output unit can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen, among other visual displays, as a visual display. In some examples, the output unit can include various types of audio signal transducer apparatuses or other sensory inducing apparatuses to implement the sensory stimuli.
The data processing unit 120 can include a processor 121 that can be in communication with an input/output (I/O) unit 122, an output unit 123, and a memory unit 124. The data processing unit 120 can be implemented as one of various data processing systems, such as a personal computer (PC), laptop, and mobile communication device. In some implementations, the data processing unit 120 can be included in the device structure that includes the wearable EEG sensor unit 111. To support various functions of the data processing unit 120, the processor 121 can be included to interface with and control operations of other components of the data processing unit 120, such as the I/O unit 122, the output unit 123, and the memory unit 124.
The memory unit 124 can store information and data, e.g., such as instructions, software, values, images, and other data processed or referenced by the processor 121. Various types of Random Access Memory (RAM) devices, Read Only Memory (ROM) devices, Flash Memory devices, and other suitable storage media can be used to implement storage functions of the memory unit 124. The memory unit 124 can store data and information, which can include subject stimulus and response data, and information about other units of the system, e.g., including the EEG sensor unit 111 and the visual display unit 112, such as device system parameters and hardware constraints. The memory unit 124 can store data and information that can be used to implement the portable EEG-based system 100.
The I/O unit 122 can be connected to an external interface, source of data storage, or display device. Various types of wired or wireless interfaces compatible with typical data communication standards can be used in communications of the data processing unit 120 with the EEG sensor unit 111 and the visual display unit 112 and/or other units of the system, e.g., including, but not limited to, Universal Serial Bus (USB), IEEE 1394 (FireWire), Bluetooth, IEEE 802.111, Wireless Local Area Network (WLAN), Wireless Personal Area Network (WPAN), Wireless Wide Area Network (WWAN), WiMAX, IEEE 802.16 (Worldwide Interoperability for Microwave Access (WiMAX)), 3G/4G/LTE cellular communication methods, and parallel interfaces, can be used to implement the I/O unit 122. The I/O unit 122 can interface with an external interface, source of data storage, or display device to retrieve and transfer data and information that can be processed by the processor 121, stored in the memory unit 124, or exhibited on the output unit 123.
In some implementations of the system 100, the data processing unit 120 can include an output unit 123 that can be used to exhibit data implemented by the data processing unit 120. The output unit 123 can include various types of display, speaker, or printing interfaces to implement the output unit 123. For example, the output unit 123 can include cathode ray tube (CRT), light emitting diode (LED), or liquid crystal display (LCD) monitor or screen as a visual display to implement the output unit 123. In other examples, the output unit 123 can include toner, liquid inkjet, solid ink, dye sublimation, inkless (e.g., such as thermal or UV) printing apparatuses to implement the output unit 123; the output unit 123 can include various types of audio signal transducer apparatuses to implement the output unit 123. The output unit 123 can exhibit data and information, such as the system data in a completely processed or partially processed form. The output unit 123 can store data and information used to implement the disclosed techniques.
In some implementations of the method 180, for example, the quantitative assessment produced by the process 188 can provide an indication if there is a presence of a visual field defect in the user's visual field. In some implementations, for example, the process 188 can include a process to determine the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold. In some implementations, for example, the visual stimuli presented by the process 182 can include multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
In some implementations of the method 180, for example, as shown in
In some implementations of the method 180, for example, as shown in
In some implementations of the method 180, for example, as shown in
Exemplary Implementations of mfSSVEP Techniques for Assessment of Visual Field Loss
Exemplary implementations were performed using an exemplary mfSSVEP technique for assessment of visual field loss.
Five healthy participants (e.g., 4 males and 1 female) with normal or corrected-to-normal vision participated in the exemplary implementations. The EEG data were recorded using a 128-channel BioSemi ActiveTwo EEG system (e.g., from Biosemi, Inc.) according to a modified 10-20 international system, as depicted in the images of
In these exemplary implementations, a layout of visual stimuli was designed to include 20 sectors in three concentric rings (e.g., subtending 6°, 15°, and 25° of the visual field). All sectors flickered concurrently at different frequencies ranging from 8 to 11.8 Hz with a frequency resolution of 0.2 Hz. To test the exemplary mfSSVEP visual field loss analysis technique, a visual field loss (DEFICIT) condition was mimicked by replacing the 9 Hz sector (e.g., the 0-45° patch in the middle ring as shown in the diagram of
The exemplary dataset for each participant contained 100 5-s DEFICIT and CONTROL trials (e.g., 10 trials×2 conditions×5 sessions) for analysis.
These exemplary results demonstrated that visual field deficits mimicked by disabling the 9 Hz sector did result in a significant SSVEP attenuation at the corresponding frequency. The exemplary results of these implementations suggest that the dynamics of mfSSVEP amplitude is capable of serving as an objective biomarker to assess potential visual field deficits.
Exemplary Embodiments and Implementations of a Portable, Objective mfSSVEP-Based Visual Field Assessment Platform of the Disclosed Technology
As shown in the block diagram of
The exemplary platform can quantitate the integrity of monocular visual fields by the characterization of mfSSVEP signal data. For example, by integrating a lightweight, wearable, and wireless multi-channel EEG system and a head-mounted display, the disclosed portable platform can allow assessment of visual field integrity in unconstrained situations and outside clinic environment.
In exemplary implementations using the exemplary portable system platform, the following methods were performed. An exemplary wearable, wireless high-density EEG unit of the portable system platform was employed, e.g., featuring dry and non-prep electrodes and wireless telemetry to sample EEG signals at 250 Hz, as depicted in
An exemplary head-mounted display unit of the portable system platform utilized an Oculus Rift goggle (Oculus VR, Inc.) to deliver the mfSSVEP stimulation, as depicted in
The example portable system can be used for acquisition of mfSSVEP signals to obtain such data. For example, exemplary techniques such as independent component analysis (ICA) and differential canonical correlation analysis can be implemented successfully for blind source separation and to enhance detectability of SSVEP signals.
Exemplary EOG-Guided Methods to Assess Eye-Gaze During Testing with the Exemplary Portable Platform
Electrooculogram (EOG) methods of the disclosed technology can be utilized to successfully identify fixation losses and allow identification of unreliable mfSSVEP signals to be removed from further analyses. For example, from the earlier implementations of an mfSSVEP technique for assessment of visual field loss, the strength of mfSSVEP in one of the five participates failed to accurately reflect the mimicked visual deficit, as depicted previously in
In some embodiments, for example, the disclosed portable mfSSVEP systems can include an EOG unit. In one example embodiment, the EOG unit can include two or more dry and soft electrodes to be placed proximate the outer canthus of a subject's eyes (e.g., one or more electrodes per eye) to measure corneo-retinal standing potentials, and are in communication with a signal processing and wireless communication unit of the EOG unit to process the acquired signals from the electrodes and relay the processed signals as data to the data processing unit 120 of the portable system 100. In some implementations, the electrodes of the EOG unit can be in communication with the EEG unit 111 or visual display unit 112 to transfer the acquired signals from the outer canthus-placed electrodes of the EOG unit to the data processing unit 120.
For example, in order to remove unreliable EEG signals occurring from fixation losses, the disclosed techniques can concurrently monitor subjects' electrooculogram (EOG) signals to evaluate the gaze fixation. By placing the dry and soft electrodes of the EOG unit to the outer canthus of the eyes, the electric field changes associated with eye movements, e.g., such as blinks and saccades, can be monitored. There is a linear relationship between horizontal and vertical EOG signals and the angle of eye rotation within a limited range (e.g., approximately 30°). This relationship can be used in determining the exact coordinates of eye fixations on a visual display. In some implementations, a calibration sequence can be used at the start of recording to determine the transformation equations. Accordingly, for example, an EOG-guided mfSSVEP analysis can be implemented to automatically exclude the EEG segments where the subjects do not gaze at the center of the stimulation. To record EOG signals, four prefrontal electrodes can be switched to record the EOG signals, e.g., since mfSSVEP signals are presumably weak in the prefrontal regions. In one example in which the EOG unit includes four electrodes, two electrodes can be placed below and above the right eye and another two will be placed at the left and right outer canthus. The EOG unit can be used to assess the accuracy of the portable mfSSVEP system by identifying potentially unreliable EEG signals induced by loss of fixation. For example, the data processing unit 120 can process the acquired signals from the EOG unit electrodes with the EEG data acquired from the EEG unit 111 to identify unreliable signals, which can then be removed from the analysis of visual field integrity. For example, the data processing unit 120 can execute analytical techniques to provide signal source separation. Additionally, or alternatively, for example, the disclosed portable mfSSVEP systems can include an eye tracking unit to monitor losses of fixation, e.g., and can further provide a reference standard. For example, the eye tracking unit can be included, integrated, and/or incorporated into the visual display unit 112 (e.g., exemplary head-mounted display), for example.
Exemplary Implementations to Evaluate the Reproducibility of Measurements Obtained with the Exemplary Portable Platform
Exemplary implementations can be performed to evaluate the reproducibility of measurements obtained with the exemplary portable platform in evaluating its ability to detect visual field loss in patients with glaucoma compared to healthy control subjects. The disclosed portable systems can provide reproducible intra- and inter-visit mfSSVEP signals. mfSSVEP signals in patients with glaucomatous visual field loss will be significantly different than those in healthy control subjects. For example, to have clinical applicability, measurements obtained with portable systems need to be reproducible and be able to detect visual field losses in patients with glaucoma. Good reproducibility is a fundamental requirement in order to allow detection of change over time. If a test is to be used for screening, diagnosis, and/or detection of glaucoma progression, an initial step is demonstrating that a portable system is able to distinguish patients with glaucomatous field loss from healthy individuals.
Exemplary implementations were conducted to demonstrate the reproducibility and diagnostic accuracy studies. Such implementations included participation of a group of 10 healthy and 10 glaucomatous subjects. These subjects had not been tested previously with the system. The subjects underwent five sessions of testing per visit for five different visits, spaced at intervals of approximately 1 week apart. Reproducibility measures were obtained, e.g., including coefficients of variation and intraclass correlation coefficients for the relevant measurements obtained by the portable system. For diagnostic accuracy evaluation, for example, tests of an additional sample of 20 healthy and 20 glaucomatous subjects were performed, e.g., totaling 30 subjects in each group. Glaucomatous subjects were shown to have repeatable abnormal visual field defects on SAP (SITA 24-2). For example, assessment of diagnostic accuracy was performed using receiver operating characteristic (ROC) curves.
The sample size for this experiment provided 83% power to detect a minimum difference of 0.25 in ROC curve area compared to chance.
The following examples are illustrative of several embodiments of the present technology. Other exemplary embodiments of the present technology may be presented prior to the following listed examples, or after the following listed examples.
In an example of the present technology (example 1), a system for monitoring brain activity associated with visual field of a user includes a sensor unit to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; visual display unit including a display screen to present visual stimuli to the user in a plurality of sectors of a visual field, in which the presented visual stimuli includes an optical flickering effect at a selected frequency mapped to each sector of the visual field, the visual stimuli configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the sensor unit; and a data processing unit in communication with the sensor unit and the visual display unit to analyze the acquired EEG signals and produce an assessment of the user's visual field.
Example 2 includes the system as in example 1, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
Example 3 includes the system as in example 1, in which the one or more electrodes of the sensor unit include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
Example 4 includes the system as in example 1, in which the one or more electrodes includes a single electrode channel Oz.
Example 5 includes the system as in example 1, in which the one or more electrodes include a plurality of the electrodes that are arranged at particular locations on the head of the subject according to the international 10-20 system.
Example 6 includes the system as in example 1, in which the system is portable to enable the user to operate the system in the user's living environment and on a routine or continuous basis.
Example 7 includes the system as in example 1, in which the selected frequency of the optical flickering effect for a particular sector is at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
Example 8 includes the system as in example 7, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user.
Example 9 includes the system as in example 7, in which the visual stimuli is presented in 20 sectors in three concentric rings including subtending 6°, 15°, and 25° of the visual field.
Example 10 includes the system as in example 7, in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
Example 11 includes the system as in example 1, further including an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
Example 12 includes the system as in example 1, in which the visual display unit is configured to be wearable over the user's eyes for the user to view the presented visual stimuli on the display screen.
Example 13 includes the system as in example 12, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
In an example of the present technology (example 14), a method for examining a visual field of a subject includes presenting, to a subject, visual stimuli in a plurality of sectors of a visual field of a subject, in which for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency; acquiring electroencephalogram (EEG) signals from one or more electrodes in contact with the head of the subject; processing the acquired EEG signals to extract multifocal steady-state visual-evoked potentials (mfSSVEP) data associated with the subject's EEG signal response to the presented visual stimuli; and producing a quantitative assessment of the visual field of the subject based on the MfSSVEP data.
Example 15 includes the method as in example 14, in which the quantitative assessment provides an indication if there is a presence of a visual field defect in the user's visual field.
Example 16 includes the method as in example 15, in which the producing the quantitative assessment includes determining the presence of the visual field defect in a sector having a mfSSVEP signal below a predetermined threshold.
Example 17 includes the method as in example 14, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the subject.
Example 18 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head and include a single electrode channel Oz positioned over the occipital region of the head of the subject when the sensor unit is worn by the user.
Example 19 includes the method as in example 14, in which the one or more electrodes are included in a sensor unit wearable on the subject's head such that the electrodes are arranged at particular locations on the sensing unit to be positioned on the head of the subject when the sensor unit is worn by the user.
Example 20 includes the method as in example 14, in which the one or more electrodes include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the subject.
Example 21 includes the method as in example 14, further including monitoring movements of the user's eyes to determine instances associated with the user gazing away from the center of the visual field.
Example 22 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an electrooculogram (EOG) unit including one or more electrodes placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals.
Example 23 includes the method as in example 14, in which the monitoring the movements of the user's eyes includes using an eye tracking system.
Example 24 includes the method as in example 14, in which the selected frequency of the optical flickering effect for a particular sector is presented at a different frequency with respect to the optical flickering effect at a proximate sector or with respect to the optical flickering effects in the other sectors of the visual field.
Example 25 includes the method as in example 14, further including forming a spatial visual stimulus display having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
Example 26 includes the method as in example 14, in which the producing the quantitative assessment includes analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
In an example of the present technology (example 27), a portable system for monitoring brain activity associated with visual field of a user includes a brain signal sensor device to acquire electroencephalogram (EEG) signals including one or more electrodes attached to a casing wearable on the head of a user; a wearable visual display unit to present visual stimuli to the user and structured to include a display screen and a casing able to secure to the head of the user, in which the wearable visual display is operable to present the visual stimuli in a plurality of sectors of the user's visual field, such that for each sector the presented visual stimuli includes an optical flickering effect at a selected frequency, and in which the visual stimuli are configured to evoke multifocal steady-state visual-evoked potentials (mfSSVEP) in the EEG signals exhibited by the user acquired by the brain signal sensor device; a data processing unit in communication with the brain signal sensor device and the wearable visual display unit to provide the visual stimuli to the wearable visual display unit and to analyze the acquired EEG signals and produce an assessment of the user's visual field; and an electrooculogram (EOG) unit including one or more electrodes to be placed proximate the outer canthus of each of the user's eyes to measure corneo-retinal standing potential (CRSP) signals, in which the one or more electrodes of the EOG unit are in communication with the data processing unit to process the acquired CRSP signals from the one or more electrodes to determine movements of the user's eyes.
Example 28 includes the system as in example 27, in which the data processing unit is included in a computing device including a laptop or desktop computer; a mobile communication device including a smartphone, a tablet, or a wearable computing device; or a network computer system.
Example 29 includes the system as in example 27, in which the produced assessment of the user's visual field is a quantitative assessment that indicates if there is a presence of a visual field defect in the user's visual field.
Example 30 includes the system as in example 27, in which the one or more electrodes of the brain signal sensor device include dry electrodes operable to acquire the EEG signals without a conductive gel interfaced between the electrodes and the user.
Example 31 includes the system as in example 27, in which the one or more electrodes includes a single electrode channel Oz.
Example 32 includes the system as in example 27, further including an eye tracking device including a camera employed in the wearable visual display unit and in communication with the data processing unit, in which the camera is operable to record images of the user's eyes.
Example 33 includes the system as in example 27, in which the visual stimuli includes multiple and repetitive optical effects flickering at the selected frequency in the corresponding sector of the visual field of the user, and in which the selected frequencies of the flickerings of the visual stimuli are greater than 6 Hz.
Example 34 includes the system as in example 27, in which the wearable visual display unit is operable to form a spatial visual stimulus display on the display screen having the plurality of the sectors at different spatial locations on the spatial visual stimulus display, in which, for each sector, the sector includes the optical flickering effect that changes at a designated frequency with respect to at least a proximate sector or the other sectors of the visual stimulus display.
Example 35 includes the system as in example 34, in which the data processing unit is operable to produce the quantitative assessment by analyzing the mfSSVEP data with respect to the designated frequencies that are mapped to the sectors at the different spatial locations on the spatial visual stimulus display, in which the analyzing includes quantitatively comparing an mfSSVEP signal value at a particular frequency of the designated frequencies to a threshold value, and determining the presence of a visual field defect in the sector to which the particular frequency is mapped if the mfSSVEP signal value is less than the threshold value.
Implementations of the subject matter and the functional operations described in this patent document can be implemented in various systems, digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of the subject matter described in this specification can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible and non-transitory computer readable medium for execution by, or to control the operation of, data processing apparatus. The computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them. The term “data processing apparatus” encompasses all apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers. The apparatus can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.
A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
While this patent document contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this patent document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Moreover, the separation of various system components in the embodiments described in this patent document should not be understood as requiring such separation in all embodiments.
Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in this patent document.
This patent document claims the benefits and priority of U.S. Provisional Patent Application No. 61/981,145, entitled “PORTABLE BRAIN ACTIVITY SENSING PLATFORM FOR ASSESSMENT OF VISUAL FIELD DEFICITS”, filed on Apr. 17, 2014. The entire content of the aforementioned patent application is incorporated by reference as part of the disclosure of this application.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US15/26543 | 4/17/2015 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 61981145 | Apr 2014 | US |
