The present invention relates to a device, system and method for providing bio-feedback to a user.
The short term habituation to recently experienced stimuli disrupts brain homeostasis. Maintaining attentional capacity then requires more energy. Normally sleep promotes dishabituation and the restoration of brain homeostasis, but the plethora of information the society offered to its inhabitants these days causes the disruption of homeostasis to occur at a time of the day where sleep is not an option.
There is a need for way that enables a user to restore brain homeostasis in a simple and efficient manner and to provide bio-feedback to the user, particularly regarding the restoration.
US 2014/0288401 A1 discloses a mental balance or imbalance estimation system and a method for estimating a level of mental balance or imbalance of a user. The system comprises a skin conductance sensor for sensing the skin conductance of the user, the skin conductance over time forming a skin conductance trace. The system further comprises a processing unit for receiving and processing the skin conductance trace, the processing unit configured to determine at least one stimulus response in the skin conductance trace, to determine an estimated cortisol level trace of the user based on the determined at least one stimulus response and to determine the estimated level of mental balance or imbalance of the user based on the estimated cortisol level trace.
It is an object of the present invention to provide a device, system and method that enable a user to restore brain homeostasis and that provide bio-feedback to the user.
In a first aspect of the present invention a device for providing bio-feedback to a user is presented comprising
an interface configured to obtain skin conductance measurements of a user and to output user instructions and bio-feedback information; and
a processing unit configured to
In a further aspect of the present invention a system for providing bio-feedback to a user is presented comprising
In yet further aspects of the present invention, there are provided a corresponding method, a computer program which comprises program code means for causing a computer to perform the steps of the method disclosed herein when said computer program is carried out on a computer as well as a non-transitory computer-readable recording medium that stores therein a computer program product, which, when executed by a processor, causes the method disclosed herein to be performed.
Preferred embodiments of the invention are defined in the dependent claims. It shall be understood that the claimed method, system, computer program and medium have similar and/or identical preferred embodiments as the claimed system, in particular as defined in the dependent claims and as disclosed herein.
The present invention is based on the idea enable or at least facilitate dishabituation and restoration of attentional capacity based on meditation, preferably based on the Zen meditation technique. Using skin conductance slow wave patterns caused by sympathetic nervous system (SNS) activity are used to coach the person into a meditative state known, e.g. in yoga for millennia, as the clear mind state, and described already in the ancient Indian document called Aphorisms of Patanjali. Thus, the attentional capacity is restored without the need for slow wave sleep. Further, bio-feedback information is generated based on the skin conductance measurements and provided to the user, e.g. to inform the user of the achievement of the clear mind state or the level of the achieved clear mind state.
In an embodiment the processing unit is configured to generate a meditation depth information indicating if at least one GSR storm followed by a latency has been identified as bio-feedback information. This helps the user to understand if a clear mind state has been achieved.
The processing unit is configured to identify a GSR storm in the skin conductance trace by detecting peaks in the skin conductance trace, in particular based on number of peaks and/or the peak frequency in a time period. This provides for a simple but reliable detection of a GSR storm. Preferably, the rising edge of peaks is detected. Rising edges composed of two overlapping peaks having only one top can be detected.
A GSR storm in the skin conductance trace may for instance be identified by detecting if the peak frequency of the peaks in the skin conductance trace exceeds a predetermined frequency threshold in the time period. A frequency in the range of 0.05 Hz to 1 Hz, in particular in the range of 0.1 Hz to 0.3 Hz, may hereby be used as predetermined frequency threshold.
A GSR storm in the skin conductance trace may, alternatively or additionally, be identified by detecting if the number of peaks in the skin conductance trace exceeds a predetermined threshold number in the time period. A number in the range of 3 to 60, in particular in the range of 6 to 18, may hereby be used as predetermined threshold number for a time period of one minute.
In another embodiment a duration in the range of 2 to 10 minutes, in particular in the range of 3 to 6 minutes, may be used as time period. Further, in an embodiment a minimum number of subsequent peaks may set to be shown in the skin conductance trace to qualify as GSR storm.
In a practical exemplary embodiment a threshold number may be set at 3 peaks/minute and a minimum number of 45 subsequent peaks may be shown in the skin conductance trace to qualify as a GSR storm.
The processing unit is further be configured to use a duration in the range of 2 to 10 minutes, in particular in the range of 3 to 6 minutes, as latency. This period may be set a as kind of waiting time after the end of a GSR storm before the bio -feedback information is output, e.g. signalling to the user that a clear mind state has reached.
In an embodiment user instructions may be generated that indicate one or more meditation actions to follow by the user. For instance, instructions how to sit, stand, lie, move, etc. may be issued as user instruction.
In another embodiment a meditation depth score may be generated based on the detection of peaks in the skin conductance trace, the meditation depth score indicating a meditation state of the user. The meditation depth score may e.g. indicate how deep and/or long the state of meditation is and/or how well and/or whether a clear mind state has been achieved and/or a brain homeostasis has been restored.
The system may be implemented as a wearable device, e.g. in the form of a wrist worn device or a body-mounted sensor. In an embodiment the sensing unit is a wearable skin conductance sensor, that measures at the upper side of the wrist (or any other skin part).
In another embodiment the user interface may comprise one or more of a display screen and/or a loudspeaker and/or a communication unit configured to communicate the user instructions and/or the bio-feedback information to another device, e.g. the user's smartphone, laptop or tablet. For instance, the user interface may be configured to convey the meditation depth score to the user or to an application or device that utilizes meditation depth information. More subtle information may be communicated using e.g. a built in buzzer. For instance, a buzz may indicate the presence of a GSR storm and three buzzes may indicate the clear mind state. Zen Buddhists use a bell for such signals, three for the start, one for intermediate signals and two as the end signal.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. In the following drawings
In the digital age information and communication overload are commonplace. The individual is exposed to an increasing amount of information and communication. The brain perceives this as stimuli. Analogous to the homeostasis of the body the brain has mechanisms to maintain homeostasis when exposed to external influences. Information and communication stimuli cause effects in the brain which are recently linked to GluAl-dependent synaptic plasticity, and ultimately lower a person's attentional capability.
With time sleep pressure increases, the metabolic load to process new stimuli and information increases and the attentional capability decreases. Sleep, and more specifically slow wave sleep restores these negative effects. Slow wave sleep, also known as deep sleep or stage IV sleep, is characterized by delta range brain frequencies during which parts of the brain stop all neural activity. Sleep slow oscillations potentiate synapses that were depressed due to persistent activities during the previous day.
The information and communication overload linked to social media and other digital sources, such as computer games and online movies and videos, causes the negative effects to occur earlier in the day compared to the pre-digital age. The recovery of action potential of synapses that are impacted by these stimuli by something other than slow wave sleep would be very beneficial. During a Zen meditation parts of the brain turn silent. As will be shown below, similar skin conductance patterns can indeed be measured during slow wave sleep and during Zen meditation.
Emotions cause the activation sympathetic outflow of the autonomous nervous system. This activates among others the eccrine sweat glands. An apparatus that measures the conductance of the skin can be used to monitor emotions of a human being. The emotions cause skin conductance responses, which may be small peaks with a width of a few seconds. There are also skin conductance responses which cannot be linked to emotions, called non-specific skin conductance responses, which make up the GSR storms. Skin conductance (SC) is often referred to as electrodermal activity (EDA). For instance the polygraph is an apparatus that monitors emotions linked to lying using among others this principle.
Slow wave sleep causes a phenomenon in the skin conductance trace known as GSR storms. The intensity and duration of the GSR is generally higher when the previous day was more emotionally intense. This is in line with the brain homeostasis hypothesis discussed above. Hence, slow-wave sleep can be linked to sympathetic nervous system activity visible in the skin conductance trace. When skin conductance is measured at the wrist this is even more pronounced compared to skin conductance measured with traditional methods.
In Error! Reference source not found.
The delta brain wave frequency during slow wave sleep is just slow enough to may become visible as separate peaks in the fluctuations of the skin conductivity caused by the activity of the sympathetic nervous system. Whether there is a direct link between delta brain wave activity and the GSR storms is not proven yet. There is a coincidence of the two phenomena. Other sleep stages are linked to faster brain wave frequencies and thus cannot become visible in the skin conductivity fluctuations, since they fluctuate too fast. Apparently the skin conductance acts as a low pass filter, blocking all frequencies over e.g. 0.5 or 1 Hz, making it an excellent detector of slow (delta range) brain waves.
Fatigue caused by continuous information and communication processing can be relieved without the need for slow wave sleep. The diminished attentional capacity of a person can be restored without the need for slow wave sleep.
The device 10 comprises an interface 11 for obtaining (i.e. receiving or retrieving from the sensor 20 or a memory (not shown)) the skin conductance measurements 21 of the user and for outputting the user instructions 34 and bio-feedback information 35 to the user interface 30. The device further comprises a processing unit 12 for processing the skin conductance measurements 21. The processing of the device and the corresponding method will be explained below in more detail.
The processing unit 12 can be any type of suitable processing unit or processor, such as for example a microprocessor/microcontroller, or embedded microcontroller but not limited thereto that is adapted accordingly. The interface 11 can be any kind of interface from obtaining data from the sensing unit 20 or a memory, e.g. a wireless or wired data interface or signal line. It will be understood that the sensing unit 20 and the device 10 can be part of the same device (e.g. wearable device or wristband) or can be implemented as or in separate devices.
It will be understood that the user interface 30 and the device 10 can be part of the same device (e.g. wearable device or wristband) or can be implemented as or in separate devices. For example, the user interface 30 of the system 100 may be implemented by means of a smartphone or other information processing entity at the same or a remote location. Correspondingly, the processing unit 12 can also be implemented by means of a smartphone that is adapted to perform the afore-mentioned functionality for example by running a corresponding application or another suitable computing device running the corresponding software.
The system 100 may further comprise a memory 13 for storing skin conductance measurements, user instructions and/or bio-feedback used earlier. The memory 13 can be part of the device 10 or can be an external memory. The memory can be any suitable memory such as for example a memory register or RAM (random access memory). It will be understood that the memory 13 and the processing unit 12 can be part of the same device (e.g. wearable device or wristband) or can be implemented as or in separate devices.
The wearable device 50 can comprise the proposed system 100 for bio-feedback to a user. In this way a corresponding system 100 can be provided in an unobtrusive and wearable format. Alternatively, the wearable device 50 may only comprise the sensing unit 20, in this embodiment a skin conductance sensor 20. The device 10 of the system 100 may be located at the remote location or implemented in a remote device (e.g. a remote computer, smartphone or patient monitor).
The sensor 20 in this embodiment comprises a first and a second skin conductance electrode 51, 52 in combination with a skin conductance measuring unit (not shown). In the embodiment of
The skin conductance sensor 20 is adapted to measure the skin conductance of the user 2 between the skin conductance electrodes 51, 52. For this purpose, the skin conductance measuring sensor may comprise a voltage generator for applying a voltage between the at least two skin conductance electrodes, a sensing unit for sensing a current between the at least two electrodes, and/or a calculating unit for calculating the skin conductance based on the sensed current. The measured skin conductance over time forms, in this embodiment, the skin conductance trace (or data). The skin conductance trace (or data) may for example be stored in a memory of the wearable device 50, or may be transmitted (wirelessly or through a wire or signal line) to an external unit.
The skin conductance measuring sensor 20 and/or the device 10 (as shown in
In a first step 201 user instructions 34 indicating one or more actions to follow by the user are generated. For instance, the user may be instructed by displaying a certain text and/or graphic on the display screen 31 or by issuing corresponding audible instructions via a loudspeaker of the user interface 30 to take a certain position, hold the hands in a certain position and to breath in a certain rhythm and/or at a certain type of breathing (in which the belly is expanded when inhaling air) for a certain period. Subsequently, one or more further instructions may be provided, as e.g. done in a conventional Zen meditation session.
In a second step 202 skin conductance measurements 21 of a user are obtained, e.g. from the sensing unit 20, which acquired these measurements while the user followed the instructions given in the first step 201.
In a third step 203 one or more GSR storms are identified in the skin conductance trace of the obtained skin conductance measurements. For identifying a GSR storm various options exist, as will be explained below in more detail.
In a fourth step 204 a latency of a predetermined duration (in which the mind disturbances settle down and no further GSR storm shows) is identified after the end of an identified GSR storm, as will be explained below as well.
In a fifth step 205, if at least one GSR storm followed by a latency has been identified, bio-feedback information is generated providing bio-feedback related to the one or more actions followed by the user. Said bio-feedback may e.g. be meditation depth information and/or a meditation depth score.
In a sixth step 206 the generated bio-feedback information 35 is output to the user, e.g. in text form or in any other subtle form that can be percepted by the user and that does not disturb the state.
The GSR storm patterns in skin conductance traces of sleep can also be found in skin conductance traces measured during a Zen meditation. In
In the example of
The time and relative height or steepness of the individual GSR storm peaks can e.g. be calculated by taking the difference of logarithmic values of skin conductance measurement i and measurement i+1. Optionally, the value can be multiplied with the sampling:
steepnessnormalized,log=(10log(SCi)−10log(SCi+1))·f
wherein SC, denotes a sample value of the skin conductance signal trace at sample i; SCi+1 denotes a sample value of the skin conductance signal trace at a subsequent sample i+1; and f denotes the sampling frequency. The sampling frequency is optional in the aforementioned formulae. For such a log-calculation, all negative values can be set to zero, leaving only the rising edges of the skin conductance trace. Instead of steepness, it can also be called the first time derivative. Optionally, a normalized maximum rising edge slope of each of a plurality of respective skin conductance peaks can be identified and used for further processing.
In another embodiment, aside from a minimum rising edge duration criterion required for identifying a rising edge (i.e. the rising edge must be given for a minimum duration), zero crossings of the first derivative of the skin conductance signal may be used to detect a peak.
From the peak times the peak occurrence frequency can be obtained. Various criteria for identifying a GSR storm may be used. One criterion is that the peak frequency exceeds 0.2 Hz for the entire duration of the GSR storm, more generally if the peak frequency of the peaks in the skin conductance trace exceeds a predetermined frequency threshold in the time period. A frequency in the range of 0.05 Hz to 1 Hz, in particular in the range of 0.1 Hz to 0.3 Hz, may hereby be used as predetermined frequency threshold.
Another criterion for detecting a GSR storm may be the if number of peaks in the skin conductance trace exceeds a predetermined threshold number in the time period. A number in the range of 3 to 60, in particular in the range of 6 to 18, may hereby be used as predetermined threshold number for a time period of one minute.
The duration of the GSR storm shall be in the range of 2 to 10 minutes, in particular in the range of 3 to 6 minutes. Further, a minimum number of subsequent peaks may be provided in the skin conductance trace to qualify as a GSR storm.
In a practical implementation the criterion may be used that there shall be at least 3 peaks/minute and a minimum number of 45 subsequent peaks to qualify as a GSR storm.
In a practical embodiment the disclosed method may be implemented on a smartphone which is usually the device that conveys information and communication to the user. A dedicated application (“app”) can monitor the amount of information and communication to which the user has been exposed. The wearable skin conductance sensor is capable to calculate a stress level that can be linked to the contextual information from the smartphone. When a preset limit of for example 3 hours of exposure or a cumulative stress exposure of for instance 1 hour of level 3 or higher is exceeded the slow brain wave induction app can be offered to restore attentional capacity (recovery of action potential of synapses). The app may use known Zen meditation techniques. The user can wear the Philips DTI-5 skin conductance sensor, follow the instructions from the smartphone, conveyed via earphones, and obtain feedback of failure or success by means of a suitable discreet audio signal generated by the GSR storm detection software. At least one GSR storm is needed to achieve the clear mind status. The end of the slow brain wave induction app may signaled when the preset latency of 3 to 5 minutes after the last GSR storm is reached. This end signal can again be conveyed as an audio signal via earphones connected to the smartphone.
The present invention may be used in the context of lifestyle coaching, smartwatches, attentional capacity recovery coaching, and/or meditation coaching.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single element or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
A computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Any reference signs in the claims should not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
18211570.9 | Dec 2018 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/084133 | 12/9/2019 | WO | 00 |