Field of the Invention
This invention relates to portable devices for implementing mobile monitoring systems and methods for using such portable devices.
Discussion of Related Art
Brain-machine interface systems allow people with severe disabilities (e.g. paralysis) to partially or fully restore lost functions that may have been the result, for example, of injuries or diseases. However, people with severe disabilities have been limited to using brain-machine interface systems within controlled and stationary environments or research settings. For example, people using brain machine interface systems usually lie in hospital beds or are restricted within the bounds of their home, where large and elaborate systems can implement the brain-machine interfaces. The computational complexity of translating neural signals into device control commands has prevented this technology from becoming mobile because of the complexity and time required to complete the brain-model based calculations.
However, it is highly desirable to provide people with additional mobility and still enable them to benefit from brain-machine interface systems in their everyday lives. Therefore, there is a need for implementing portable brain-machine interface systems that can handle the complex and heavy computation requirements of sensing and decoding neural signals, and translating the neural signals into actionable commands that can be executed by monitoring systems.
It is also desirable to combine information from sources other than the brain, for example, from heart rate sensors, temperature sensors, or respiratory effort sensors, to implement a whole-body monitoring system that can generate actionable commands. Prior art whole-body monitoring systems constrain the people within controlled environments and limit their mobility.
According to aspects of the disclosure, whole-body monitoring systems can receive and process information from different sources sensing vital signals from different body parts and the brain, and translate the signals into commands, without severely constraining the system user's mobility and activities. The disclosed systems and methods can be implemented on portable devices that can communicate with different interfaces and can process information from various sources.
The portable monitoring devices of the present invention can provide real-time control of mobile machines and other devices such as wheelchairs or functional electrical stimulators in a mobile setting. As a result, the disclosed systems and methods can enable people to use these technologies to aid in everyday activities. The portable device may be an external device with a removable power source or it may be implanted with a rechargeable battery that chat can be charged via wireless power transfer from outside the body.
According to aspects of the disclosure, a portable monitoring device for whole body monitoring can include a receiver configured to receive wireless signals representing real-time neural activity from a neural sensor configured to sample neural signals from a person and process the wireless signals into corresponding digital signals. The portable monitoring device can also include a first processor configured to receive the digital signals from the receiver, process the digital signals to generate processed digital signals, and generate a mapping of the neural activity into at least one of a person's behavior, a person's mood, a person's health condition, a person's memory, and a person's intentions. The portable monitoring device can also include a second processor coupled to the first processor configured to receive the digital signals and the processed digital signals data from the first processor, and prepare at least one of the digital signals and the processed digital signals data for transmission to at least one peripheral device coupled to the portable monitoring device.
According to aspects of the disclosure a method for whole body monitoring using a portable monitoring device can include the steps of receiving, by a receiver of the portable monitoring device, wireless signals representing real-time neural activity from a neural sensor configured to sample neural signals from a person and processing, by the receiver, the wireless signals into corresponding digital signals. The method can also include the steps of receiving, by a first processor of the portable monitoring device, the digital signals from the receiver, processing, by the first processor, the digital signals to generate processed digital signals; generating, by the first processor, a mapping of the neural activity into at least one of a person's behavior, a person's mood, a person's health condition, a person's memory, and a person's intentions. The method can also include the steps of receiving, by a second processor of the portable monitoring device coupled to the first processor, the digital signals and the processed digital signals data from the first processor and preparing, by the second processor, at least one of the digital signals and the processed digital signals data for transmission to at least one peripheral device coupled to the portable monitoring device. The method can also include the steps of receiving peripheral device signals from the at least one peripheral device, sending the received peripheral device signals to the first processor for processing, receiving, from the first processor, the processed peripheral device signals, and preparing the processed peripheral device signals for transmission to the at least one peripheral device.
For a more complete understanding of various embodiments of the present invention, reference is now made to the following descriptions taken in connection with the accompanying drawings, in which:
According to aspects of the disclosure, the portable monitoring device 302 can be reconfigurable. Configuration data for the portable monitoring device 302 can be sent through the server 506 as well by a clinician 510 when accessing the server 506 remotely. The portable monitoring device 302 can also host an HTML webpage 514 for the purpose of local access for system configuration. To ensure data security, all wireless communication can be encrypted. Additional security measures such as the use of biometrics or security keys, for example, radio frequency identification keys, during the configuration of the portable monitoring device 302 can also be used.
According to aspects of the disclosure, the disclosed systems and methods can accept wired and/or wireless digital or analog data from a variety of medical sensors and/or environmental sensors, and can interface with different systems using modular interfaces. For example, the medical sensor can be a heart rate sensor, a body temperature sensor, an oxygen blood sensor, a patient position sensor, an airflow sensor, an electrocardiogram sensor, a galvanic skin response sensor, a blood chemical sensor, an intracranial pressure sensor, a glucose sensor, and a respiratory effort sensor. For example, the environmental sensor can be a temperature sensor, an imaging sensor, a microphone, and a location sensor.
The disclosed system implements a real-time high-speed data processing architecture, which can be configurable and scalable. For example, the system can be implemented using field programmable gate arrays (FPGAs), which can be reprogramed to execute algorithms in hardware. Modern FPGAs are well-suited for portable devices, because they can consume low power, and therefore can be suitable for portable devices. In addition, FPGAs can be attached to data buses for expansion. Therefore, they can provide scalability and customizable computational capabilities. Specifically, the data processing architecture capabilities of the system can be expandable through the attachment of “daughter-cards” that can connect additional FPGAs to the system.
According to aspects of the disclosure, the whole-body monitoring system can be implemented in portable/wearable (“pocketable”) devices. The disclosed devices have a small packaging footprint and can be battery-powered. The disclosed devices can monitor their power usage and battery life, can monitor for failures, and can provide time estimates for battery recharging or replacement. Additionally, the portable devices can accept two separate batteries thereby allowing one battery to be replaced without the system powering off.
As illustrated in
According to aspects of the disclosure, the processor subsystem 704 can be a programmable processor or a general-purpose processor. According to aspects of the disclosure, the processor subsystem 704 and the re-configurable subsystem 706 can be on the same integrated circuit or on separate integrated circuits.
According to other aspects of the disclosure, the SoC 702 can also include a transmitter configured to transmit data to the neural implant and/or other body sensor 710. The SoC 702 can process the received data and can communicate any processed data or results to other systems, for example, through a serial interface 712, such as USB or USB on-the go, or through Ethernet link 714, for example one or two gigabit Ethernet ports. The SoC 702 can also communicate any processed data or results wirelessly, for example, using IEEE 802.11 or Bluetooth.
The portable monitoring device can include memory 716, for example, a DDR3 SDRAM or a low power DDR3L-RS. The SoC 702 can communicate with the memory 716, which can host a real-time operating system, such as QNX, that can run on the processor subsystem 704 and can also operate as a data buffer. The portable monitoring device can also include non-volatile memory (NVM) 718, for example, NAND flash memory. Memory 716 can be used for running applications that can require high-speed memory transfers, while the NVM can be used for power-aware applications that can run using low-speed memory transfers.
The whole-body monitoring system can have a power management/monitoring system 702 that can be either integrated within the SoC 702 or can be implemented using discreet integrated circuits that can control the power to the SoC 702. The SoC 702 can also communicate with an HTTP/HTTPS server 722, which can be an interface for the user or their clinician to interact with the portable monitoring device. The SoC 702 can also be connected to various devices and interfaces 724, such as prosthetic arm, an assistive robot, a PC cursor or other controllable target devices. For example, the SoC 702 can send commands for controlling the devices/interfaces 724 according to signals received from the Neural Implant/Sensor 710. The SoC 702 can also be configured to interface with removable and/or stackable daughter cards that can add modular functionality to the whole-body monitoring system.
According to aspects of the disclosure, the processor subsystem 704 can receive peripheral device signals from peripheral devices, can send the received peripheral device signals to the re-configurable subsystem 706 for processing, receive, from the re-configurable subsystem 706, the processed peripheral device signals, and prepare the processed peripheral device signals for transmission to the at least one peripheral device.
The disclosed systems can act as data handling hub capable of broadcasting or storing raw or processed data. For example, it can broadcast data over the network, e.g., LANs or the Internet, or can store the data locally, e.g., in hard drives or USB drives.
A person of ordinary skill would understand that the portable monitoring device can generate commands and can interface with different target devices, for example, pacemakers, neural/muscle stimulators, amputee prosthetic devices, a functional electrical stimulator, a wheelchair, a computer, a smartphone, a tablet, a watch, a treadmill, a door, a car, a cochlear implant devices, and visual prosthetic devices, such as a retinal implant.
In addition, the portable monitoring device can transmit feedback or commands to the sensors, for example, to disable, wake up, or configure the operation mode of the sensors. For example, configuration options for the implant of the neural sensor can include, recording, stimulation, impedance, spectroscopy, low-power stand by. The disclosed portable monitoring device can provide an interface to the person to control the sensors, for example, through a touchscreen of a smartphone.
As explained above, the disclosed systems and methods are implemented on portable devices that have computation capacity to process in real-time the received signals and translate them into actionable control commands. Alternatively, the processing of the signals generated by the various sensors can be off-loaded to a server for processing. For example, the sensor data can be wirelessly transmitted to the server and when the data is processed at the server, it can be transmitted to the portable device for generating the control instructions.
The portable monitoring device can transmit to a remote location or store locally the unprocessed sensor data and/or the processed data for remote monitoring by a clinician or technician. For example, the system can allow a clinician to remotely monitor system user status, for example, heart rate, body temperature, respiratory rate, blood chemical concentrations, medicine dosages and delivery times, current medical device configurations. The data communications can be encrypted to ensure system user data privacy and security. The unprocessed and/or processed data can also be used for training the system to map the received unprocessed data to actionable commands for the target devices. The training of the model can utilize machine learning methods which generate a machine learning computational model given a set of training data.
As discussed above, the disclosed portable monitoring device can be implemented by a reconfigurable data processing architecture. The system can be reconfigured in real-time. The system can enable adjusting the data processing algorithms for a particular application or enable the implementation of an algorithm for new and different applications. For example, researchers and/or developers can configure the portable monitoring device at the system-level and implement custom algorithms for different applications.
According to aspects of the disclosure, the disclosed portable monitoring device can have a display to provide a visual interface to a user. If the portable monitoring device does not have a display, a secure HTTPS server communicating with the portable monitoring device can provide an interface to monitor or control the device, for example, through a website. For example, the website can allow clinicians and/or system users to configure the current algorithm, for example, change parameters, update the algorithm, for example, add, remove, or update the entire algorithm, view or download system user data, and monitor device power levels. All communication between the portable device and the server can be encrypted to prevent unauthorized persons from intercepting data or interacting with the device.
The disclosed portable monitoring device can be used in a variety of applications and can be trained to generate different actionable commands in response to different identified patterned behaviors or applications. The portable monitoring device can be used, as discussed above, to help people suffering from particular diseases or injuries. However, healthy individuals can also use the system for general health monitoring purposes. The following discussion of the different applications is only exemplary of the capabilities of the disclosed system. A person of ordinary skill would understand that the portable monitoring device can be used for additional purposes and other application spaces.
Real-Time Epilepsy Detection and Suppression
The mobile and real-time aspects of the portable monitoring device can allow a person suffering from seizures to receive warnings for potential imminent seizures during the day and while performing normal everyday activities. For example, neural activity that is indicative of upcoming seizures can be decoded by the portable monitoring device and mapped to a particular pattern or condition, e.g., imminent seizure. In this case, for example, an appropriate control actionable command can be to issue a warning signal to the system user. Alternatively, the portable monitoring device can control a medical device connected to the system user to administer a drug dosage to the system user to prevent the seizure or ease its effects on the system user. The system can dispense an appropriate amount of medication automatically, either directly into a person or by communicating the appropriate dosage to an external medicine dispensing device. In addition, the system can also contact a medical emergency team or a doctor.
Such actionable commands can be particularly useful when the person is performing a task that could become catastrophic or cause serious effect, if a seizure were to occur. For example, if the system user received a warning about an imminent seizure while driving a car, the system user could pull off the road before the seizure started. The system could incorporate real-time weather reports to provide other types of recommendations, e.g. find shelter as soon as possible, or location information to identify the nearest hospital, where the system user could drive to.
As described above, the portable monitoring device can also provide neural stimulation to the brain, for example, by electrical, optical, and/or pharmacological means. In some cases this would allow the portable monitoring device to activate such stimulation to suppress seizures when possible.
According to aspects of the disclosure, the portable monitoring device can provide neural and/or muscular stimulation to control and/or mediate movement disorders, such as seizure suppressions. The portable monitoring device can provide information to a system user about past, present, and future states of their disorder, for example, to provide warnings of an impending seizure. The portable monitoring device can also allow remote monitoring of a system user's condition by clinician, and recommend scheduling a session with clinician depending on system user's current health status.
People with spinal cord injuries can benefit from the disclosed portable monitoring device. When an individual suffers a spinal cord injury, locomotion can be affected or, for a total transection, rendered entirely impossible. So long as the viability of the portion of the spinal cord below the transection has not been compromised, the portable monitoring device can restore control of the lower limbs. This can happen, for example, by circumventing the injured portion of the spine altogether, linking motor cortex activity directly to a spinal stimulator, for example, an implantable pulse generator (IPG) on the lower spine, where locomotor control is already hard-wired into the spine.
Raw neural data received by the portable monitoring device can be mapped and translated into control commands for a spinal stimulator. The portable monitoring device can implement algorithms that can estimate the phase of walking and can communicate, for example, via Wi-Fi or Bluetooth, appropriate stimulation parameters to the spinal simulator. This can cause the spinal cord stimulator to correct a disabled gait allowing for unimpeded walking.
The decoding algorithm can utilize machine learning techniques that can tune the algorithm's parameters based on training data. This training data can consist of the raw neural data, which constitute the machine learning features, and the corresponding phase in a subject's gait cycle, which constitutes the machine learning targets, measured using electromyography (EMG) sensors that can be placed on the subject. Once the parameters for the algorithm have been generated from training data, they can be dynamically loaded to the reconfigurable subsystem of the portable processing system, which can configure the algorithm into hardware in real-time.
People suffering from movement disorders, for example, Parkinson's disease or as a result of a stroke can receive improved treatment using a portable monitoring device. For example, the portable monitoring device can infer the level of undesired movement by recording and decoding, in real time, the brain's errant dynamics in the motor cortex. By monitoring the system user's neural activity, the portable monitoring device can provide targeted brain stimulation, for example, by electrical means that could inhibit undesired movement, for example, as shaking or trembling. This targeted brain stimulation can be adjusted in real-time. For example, the system user can receive a proper amount of neural stimulation at any given time to keep their side-effects suppressed. Using feedback control, the system can adjust the amount of neural stimulation and therefore can self-correct. The utilization of additional sensors, for example, inertial measurements sensors and other biomarkers, could further improve the portable monitoring device's ability to provide the optimal treatment, tailored to individual people.
In addition to Parkinson's disease, a person of ordinary skill would understand that the portable monitoring device can detect other moving disorders, such as, essential tremor, epileptic seizures, multiple sclerosis, and amyotrophic lateral sclerosis (ALS), and can provide insight to a system user and/or clinician about the disease state and its progression, or, in some instances, can treat the disease via neural stimulation, such as transcranial magnetic stimulation.
Under alternative embodiments, the portable monitoring device can monitor a person's depression. The portable monitoring device can provide both the system user and their clinician with a real-time description of the person's mental state as expressed through neural, physiological, and behavioral activity, for example, travel data collected via GPS or body movement via inertial measurement sensors.
When the portable monitoring device detects activity that indicates that the person is experiencing abnormal or severe depression, an appropriate actionable command could be to alert the appropriate authorities, if, for example, the person is located near a high-risk location, like a bridge. The portable monitoring device could locate the patent and understand the person's surroundings, for example, by utilizing its GPS capabilities.
The portable monitoring device can combine spatial information, for example, location of the person, as well as temporal information, for example, moving behavior, to make more accurate determinations of the users situation and intents. For example, a severely depressed person standing near a bridge for a long period of time could alert the authorities of a potential suicide risk with high probability. As discussed above, the portable monitoring device can incorporate real-time weather information or alerts to also provide other types of recommendations, for example identify a nearby shelter.
In addition to depression, a person of ordinary skill would understand that the portable monitoring device can detect other mood disorders, such as, schizophrenia, obsessive-compulsive disorder, and Tourette syndrome.
A person's anxiety could be monitored constantly via neural recordings using the portable monitoring device providing both the system user and their clinician with a real-time description of the person's current anxiety level. Different situations can cause anxiety to a person, for example, being lost or in a new and unfamiliar location. The portable monitoring device can detect these situations and generate appropriate actionable commands. For example, when the portable monitoring device detects abnormal or high anxiety levels and also detects that the user is located in a location that is not among their usual locations, e.g., home or work, the portable monitoring device can alert a family member or display a link to a map with directions for the person how to return to their home. The portable monitoring device can contain a list of frequented locations to cross-reference person's current location to determine whether the person is lost or in an unfamiliar location.
A person of ordinary skill would understand that the system can be modified and trained to generate other commands that better fit the person's idiosyncrasy or habits. For example, the system can call a taxi service or dial an emergency number, for example, of a family member that the system user can talk to.
According to aspects of the disclosure, the portable monitoring device can provide a system user with the ability to control one or more prosthetic devices, a computer or smartphone, a wheelchair, various household appliances, a car, a functional electrical stimulator (artificial spinal cord), or an exoskeleton orthosis device. The portable monitoring device can send sensory information to the system user, for example, via physical transducers such as vibration mechanisms, or neural stimulation, such as a bi-directional brain-machine interface.
According to aspects of the disclosure, the portable monitoring device can provide a system user with live updates on a physical therapy progress. For example, the portable monitoring device can allow clinicians to monitor a system user's progress remotely. The portable monitoring device can inform a system user and/or clinician, for example, for medical issues and can also schedule an emergency medical session. The portable monitoring device can also provide means, such as an emergency button, to request for help if, for example, an injury occurs during therapy.
According to aspects of the disclosure, the portable monitoring device can provide a system user with daily updates on specific aspects of their personal health, such as body temperature, heart rate, blood pressure, breathing rate, pulse, and blood chemical composition. In addition, the portable monitoring device can allow clinician to monitor system user's status remotely, can inform a system user to schedule session with a clinician, if any health indicator falls below a certain level, and can administer drugs either automatically or manually depending on current health state.
According to aspects of the disclosure, the portable monitoring device can provide a system user with a breakdown of current mental state and can offer medication reminders and real-time medication adjustments. The portable monitoring device can also suggest scheduling an appointment with a clinician when necessary. In addition, the portable monitoring device can treat mood disorders with neural and/or muscular stimulation, for example, electrical, optical, and/or acoustic stimulation.
According to aspects of the disclosure, the portable monitoring device can provide intercommunication and data integration and processing capabilities to a system user with multiple medical implants and/or devices, such as an implanted EMG system and/or a neural system. The portable monitoring device can allow the implants/devices to operate more effectively and efficiently. For example, the portable monitoring device can synchronize pulmonary and cardiovascular implants to ensure optimal transfer of nutrients from the pulmonary system to the cardiovascular system. As another example, the portable monitoring device can increase the respiratory rate of an artificial lung implant to cause an increase in the volume of blood moved by an artificial heart. The portable monitoring device can manage various implant devices, such as a pulmonary implant, a cardiovascular implant, a drug delivery implant, a neural stimulator implant, a pacemaker, an intra-uterine device, a penile implant, an orthopedic implant, a defibrillator, a neural prosthesis, an insulin pump, an intrathecal pump, a visual prosthesis, a spinal prosthesis, an intracranial implant, and a cochlear implant
According to aspects of the disclosure, the portable monitoring device can generate and send stimulating signals back to the body, for example, to different muscles, and the brain of the system user, for example through deep brain stimulation via an optical stimulator or a chemical stimulator.
This application claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application No. 61/979,127, entitled “Systems and Methods for Mobile Medical Monitoring,” filed Apr. 14, 2014, the entire contents of which are incorporated by reference herein. This application is also related to: U.S. Provisional Application No. 61/810,950, entitled “OPTOELECTRONIC DEVICE TO WRITE-IN AND READ-OUT ACTIVITY IN BRAIN CIRCUITS,” filed on Apr. 11,2013; and U.S. application Ser. No. 14/028,178, entitled “IMPLANTABLE WIRELESS NEURAL DEVICE,” filed on Sep. 16, 2013, the contents of which are incorporated herein by reference in their entirety.
This invention was made with government support under R01 EB740101 awarded by National Institutes of Health. The government has certain rights in the invention.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US15/25595 | 4/13/2015 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61979127 | Apr 2014 | US |