The present invention relates to a system and method for monitoring and enhancing human performance, comprising a set of sensors and tracking devices for measuring physiological and biomechanical signals, motion sensors, and human pose tracking technology for providing feedback and if an anomaly is detected, the system alerts both the user and their doctor, and provides warnings.
The system described as a tool for monitoring and enhancing human performance with a sensors and tracking devices that measure various physiological and biomechanical signals, motion sensors, and human pose tracking technology. The systems and methods that uses information to provide feedback to the user, monitoring of human activity using a combination of different sensors available for the user and enhancing human performance via biological feedback, are known.
U.S. Ser. No. 10/258,259 (B1)—2019 Apr. 16, Multimodal sensory feedback system and method for treatment and assessment of disequilibrium, balance and motion disorders. This invention is a system and method for measuring the biomechanical state of a subject using sensors and providing visual exercises for rehabilitation and assessment of balance and motion disorders. The biomechanical state is measured while the subject performs a predetermined task, and any variance exceeding threshold triggers feedback to the subject in the form of visual, vibrotactile, or auditory feedback. Integrates information collected from different sensors, therefore multimodal. However, it is focused on monitoring specific defects (motion distorters); next to other sensors, uses a depth sensor, designed to provide feedback related to poor posture, detection of good or bad state is based on threshold value, applied to statistical features.
US2006282003 (A1)—2006 Dec. 14, Breath biofeedback system and method. A system providing target breathing patterns and displaying images based on thoracic volume data to encourage a subject to modify respiration. It includes a thoracic volume input module, a pattern module, and a display generator. The display generator produces displayable images with a first object at a first position determined by the thoracic volume data, and a second object at a second position determined by the target breathing pattern and thoracic volume data, encouraging the subject to modify respiration. Here a specific set of signals is measured, the result is presented only through the display. Measured parameters (specific). However, there is no: universality, adaptation to other sensors, other measured parameters, etc.; no danger monitoring and user warning; doctor does not participate in the decision-making process.
US2006253052 (A1)—2006 Nov. 9, Electromyographic (EMG) feedback during AMES treatment of individuals with severe neuromuscular deficits. Method of rehabilitating a patient suffering from partial or total loss of motor control involves providing feedback in the form of a signal related to EMG activity while attempting to move the affected joint. This feedback is intended to assist the patient in developing overt movement at the joint and ultimately improve functionality. Only specific sensor identified in this patent is EMG and feedback is provided by a special device that can move the limb.
WO2022146271 (A1)—2022 Jul. 7, A participation assessment system based on multimodal evaluation of user responses for upper limb rehabilitation. This invention relates to a system that uses a multimodal sensor fusion method to evaluate a patient's participation and performance during upper extremity rehabilitation exercises and adjusts the difficulty of the exercises according to the patient's performance. The system is low-cost and can be applied to any kind of rehabilitation exercises, as well as conventional therapy and sports exercises. It also evaluates patient tiredness and slacking, which can affect therapy performance. Although it has signs of universality, it is independent of the type of devices used, in this patent, movements are evaluated by calculated angles between joints.
WO2019086997 (A2)—2019 May 9, Wearable biofeedback system. A biofeedback system with an insole and a sensory output device; insole has sensing and processing units; sensing unit monitors person's movement; processing unit performs gait analysis and determines when to provide feedback; communication unit sends indication of feedback via short range wireless communication; sensory output device outputs the feedback. The uniqueness of this patent is the use of a specific sensor in the insole. An insole sensor is used.
WO2016028220 (A1)—2016 Feb. 25, Method and apparatus for assisting movement rehabilitation. A method and apparatus for providing tele-rehabilitation with remote supervision via wireless telecommunication is disclosed. Sensors are used to motion-sense a user's body to be exercised and a second part not intended to be moved. Real-time biofeedback alerts the user of undesirable movements sensed. Data is wirelessly transmitted, processed and stored for visual representation of the exercise. Video recordings are captured for therapist review. Video conferencing allows real-time guidance. Data of multiple users can be transmitted to a therapist simultaneously. A warning is given to the user about the specific monitored situation.
The difference between described invention and the previous examples is that our system is focused on one-dimensional, time-series sensor signals, the type of feedback is not limited in advance. The decision is made by machine learning models selected from a specially prepared set, pre-trained. The size of the set can be expanded, the models are updated as the system is improved, the selection of a specific machine model for application is made taking into account what data was collected from the sensors (taking into account what sensors were used and what parameters/characteristics were calculated from them). Universality, adaptation to other sensors, other measured parameters, etc., here is danger monitoring and user warning, also the doctor participate in the decision-making process.
In our system, greater versatility is achieved by introducing a unified structure for collecting additional information. For example, this patent additionally attempts to evaluate aspects of the psychological state by measuring Heart Rate, skin conductance. In our solution, these would simply be additional digital twins that would associate these parameters with a likely psychological state, her estimate. However, our system can be supplemented with additional digital twins if it becomes possible to measure state with other sensors, such as EEG sensors, and to develop a digital twin model that relates EEG signals to an estimate of psychological state.
Our system may contain more parameters (they are not specifically evaluated), for example, it can be measured the amplitude of the movement, the range of angle values, its change, compared to historical data, register the movement of individual joints (decide whether the movement was compensated or not by not calculating the angle, but by evaluating the joint change of coordinates, because it is not always easy to calculate the angle in an uncalibrated system, when data is received from mutually uncalibrated sensors).
Also, our system includes a block/functionality for automatic sensor calibration (signal interpretation) using machine learning models, which avoids tuning the system before measurement.
This invention is a system and method designed to monitor and enhance the physical performance of user. It includes sensors and tracking devices that measure physiological and biomechanical signals such as EEG, EMG and ECG signals. Motion sensors and human pose tracking technology are also integrated to provide detailed information about the user's body movements and posture. The system uses this data to provide feedback to the user in the form of auditory, visual, or tactile stimuli to help them improve their performance. The system also uses machine learning algorithms to calibrate the sensors, enabling it to monitor the users' vitals more accurately. If an anomaly is detected, the system alerts both the user and their doctor, and provides visual warnings to the user if necessary.
The present invention includes a universal system that combines:
Example of use: the system shown in
The scheme shown in
The scheme shown in
The scheme
This scheme
The system can be used for a wide range of applications, including sports training, rehabilitation, and more. For example, the system could be used to help athletes improve their performance by providing feedback on their physiological and biomechanical signals. The system could also be used in rehabilitation settings to help patients recover from injuries or conditions that affect their movement and function.