The present invention relates to a sleep state estimation device, and more particularly, to a sleep state estimation device that estimates the state of an object person.
A device has been proposed which estimates the state of an object person during sleep to estimate the quality of sleep of the object person, such as a person with sleep apnea syndrome. According to the device, it is possible to perform various kinds of processes for the object person according to the quality of sleep of the object person. For example, Patent Literature 1 discloses a device including a staying-in-bed determination unit which determines staying in bed when the number of heart beats of the sleeping person is greater than a threshold value for determining whether a person stays in bed and determines leaving a bed when the number of heart beats is less than the threshold value for determining whether a person stays in bed. The determination result of whether the person stays in bed or leaves a bed is stored in a memory. A determination error detection unit determines that there is an error in the determination by the staying-in-bed determination unit when the kurtosis Kw of the frequency distribution of the number of heart beats is greater than a predetermined value in a section in which the staying-in-bed determination unit determines staying in bed, or when the kurtosis Kw of the frequency distribution of the number of heart beats is equal to or less than the predetermined value in a section in which the staying-in-bed determination section determines leaving a bed.
[Patent Literature 1] Japanese Unexamined Patent Application Publication No. 2010-88725
However, the above-mentioned technique cannot accurately estimate the staying or leaving of a person in or from the bed. In the above-mentioned technique, it is determined whether a person stays in or leaves the bed with reference to a database using the kurtosis of the frequency distribution of the number of heart beats, which is a statistical value, in a given section. However, the above-mentioned technique cannot determine a body motion in a short time from the statistical value. For example, the above-mentioned technique does not distinguish an involuntary body motion from a voluntary body motion. In addition, the above-mentioned technique cannot specify the kind of body motion. For example, the above-mentioned technique does not distinguish intentional breathing such as breathing during a conversation or a deep breath. Furthermore, in the above-mentioned technique, a body motion being continuously made, for example, the unconscious shaking motion of the object person, is not distinguished from a normal body motion.
The invention has been made in view of the above-mentioned problems and an object of the invention is to provide a sleep state estimation device which can easily classify the body motions of an object person in detail and easily improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion.
According to an aspect of the invention, a sleep state estimation device includes a state estimation unit that estimates a state of an object person on the basis of identity of each cycle of a breathing waveform of the object person as a feature amount of the breathing waveform.
Since a change in a heart beat is dominated by the autonomic nerve which originates in the brain stem, it is difficult for the object person to control the heart beat at his or her own will. Therefore, frequency analysis, such as fine fluctuation analysis, is needed in order to estimate the body motion of the object person and the technique is not suitable for instant processing. In contrast, according to this structure, the state estimation unit estimates the state of the object person on the basis of the identity of each cycle of the breathing waveform of the object person as the feature amount of the breathing waveform. The object person can control a change in breathing at his or her own will. Therefore, when the state of the object person is estimated on the basis of the identity of each cycle of the breathing waveform of the object person, it is possible to easily classify the body motions of the object person in detail and easily improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion.
In this case, the state estimation unit may estimate the state of the object person on the basis of at least one of reproducibility, which is a fluctuation in a minimum value in each cycle of the breathing waveform, and autocorrelation, which is identity between a waveform which is shifted from the breathing waveform by an arbitrary period of time and the original breathing waveform as the identity of each cycle of the breathing waveform of the object person.
According to this structure, the state estimation unit estimates the state of the object person on the basis of at least one of the reproducibility, which is a fluctuation in the minimum value in each cycle of the breathing waveform, and the autocorrelation, which is the identity between the waveform which is shifted from the breathing waveform by an arbitrary period of time and the original breathing waveform as the identity of each cycle of the breathing waveform of the object person. Therefore, it is possible to improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion, with a simple process.
In this case, the state estimation unit may estimate the state of the object person on the basis of a cycle, an amplitude, the autocorrelation, and the reproducibility of the breathing waveform as the feature amount of the breathing waveform of the object person.
According to this structure, the state estimation unit estimates the state of the object person on the basis of the cycle, the amplitude, the autocorrelation, and the reproducibility of the breathing waveform as the feature amount of the breathing waveform of the object person. Therefore, since four indexes, such as the cycle, amplitude, autocorrelation, and reproducibility of the breathing waveform, are combined with each other to estimate the state of the object person, it is possible to further improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion.
In this case, the state estimation unit may presume that the object person is reseated when it is detected that the amplitude, the autocorrelation, and the reproducibility of the breathing waveform are changed as compared to those in a normal state of the object person.
According to this structure, when it is detected that the amplitude, autocorrelation, and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, the state estimation unit presumes that the object person is reseated. The inventors found that, when the object person was reseated, the amplitude, autocorrelation, and reproducibility of the breathing waveform of the object person were changed. Therefore, when it is detected that the amplitude, autocorrelation, and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, it is presumed that the object person is reseated. As a result, it is possible to accurately presume that the object person is reseated.
In addition, the state estimation unit may presume that the object person stretches hands upward when it is detected that the amplitude and the reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person.
According to this structure, the state estimation unit presumes that the object person stretches hands upward when it is detected that the amplitude and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person. The inventors found that, when the object person stretched the hands upward, the amplitude and reproducibility of the breathing waveform of the object person were changed. Therefore, when it is detected that the amplitude and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, it is presumed that the object person stretches the hands upward. As a result, it is possible to accurately presume that the object person stretches the hands upward.
The state estimation unit may presume that the object person has a conversation when it is detected that the autocorrelation and the reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person.
When it is detected that the autocorrelation and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, the state estimation unit presumes that the object person has a conversation. The inventors found that, when the object person had a conversation, the autocorrelation and reproducibility of the breathing waveform of the object person were changed. Therefore, when it is detected that the autocorrelation and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, it is presumed that the object person has a conversation. As a result, it is possible to accurately presume that the object person has a conversation.
The state estimation unit may presume that the object person takes a deep breath when it is detected that the cycle and the amplitude of the breathing waveform are changed as compared to those in the normal state of the object person.
According to this structure, when it is detected that the cycle and amplitude of the breathing waveform are changed as compared to those in the normal state of the object person, the state estimation unit presumes that the object person takes a deep breath. The inventors found that, when the object person took a deep breath, the cycle and amplitude of the breathing waveform of the object person were changed. Therefore, when it is detected that the cycle and amplitude of the breathing waveform are changed as compared to those in the normal state of the object person, it is presumed that the object person takes a deep breath. As a result, it is possible to accurately presume that the object person takes a deep breath.
The state estimation unit may compare the feature amount of the breathing waveform with a threshold value which is set to each feature amount to estimate the state of the object person.
According to this structure, the state estimation unit compares the feature amounts of the breathing waveform with the threshold value which is set to each feature amount to estimate the state of the object person. Therefore, it is possible to estimate the state of the object person, such as the depth of sleep or a body motion, with a simple process.
In this case, the state estimation unit may set the threshold value to each feature amount of each object person.
According to this structure, the state estimation unit sets the threshold value to each feature amount of each object person. Therefore, it is possible to estimate the state of the object person according to the physical constitution or taste of each object person.
The state estimation unit may estimate the state of the object person in a vehicle and estimate the state of the object person while discriminating between a behavior of the vehicle and a body motion of the object person on the basis of acceleration of the vehicle.
According to this structure, the state estimation unit estimates the state of the object person in the vehicle and estimates the state of the object person while discriminating between the behavior of the vehicle and the body motion of the object person on the basis of the acceleration of the vehicle. Therefore, it is possible to accurately estimate the state of the object person in the vehicle while discriminating between the behavior of the vehicle and the body motion of the object person.
The state estimation unit may determine whether the breathing type of the object person is abdominal breathing or chest breathing from the breathing waveform of the object person to estimate the depth of sleep of the object person.
According to this structure, the state estimation unit determines whether the breathing type of the object person is abdominal breathing or chest breathing from the breathing waveform of the object person to estimate the depth of sleep of the object person. Therefore, since whether the breathing type is abdominal breathing or chest breathing is closely related with the depth of sleep of the object person, it is possible to improve the accuracy of estimating the depth of sleep.
According to the sleep state estimation device of the invention, it is possible to easily classify the body motions of the object person in detail and easily improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion.
Hereinafter, a sleep state estimation device according to an embodiment of the invention will be described with reference to the accompanying drawings. The sleep state estimation device according to this embodiment is provided in, for example, a vehicle, estimates the sleep state of an object person, such as the depth of sleep or a body motion, and responds to situations using various application programs. As shown in
The breathing sensor 12 is a sensor which measures the breathing of an object person M in a non-invasive manner. Specifically, as shown in
As shown in
Returning to
The values detected by the breathing sensor 12 and the acceleration sensor 14 are processed by the arithmetic unit 30 through the I/F 20. The arithmetic unit 30 estimates the sleep state of the object person M with reference to the DB 40 in which data for each object person M is recorded. The sleep state includes the depth of sleep of the object person M and information indicating whether body motions, such as the deep breathing of the object person M, conversation, reseating, the stretching of both hands in the upward direction, and the moving-up of one of the hips, are made.
Next, the operation of the sleep state estimation device 1 according to this embodiment will be described. First, the outline of the operation will be described. As shown in
When the feature amount of the breathing waveform is normal (S01), the arithmetic unit 30 determines whether the object person M is in a deep sleep state or in states other than the deep sleep state (S04). When it is determined that the object person M is in the deep sleep state, the arithmetic unit 30 outputs information indicating that the object person M is in the deep sleep state (S04 and S05). When the feature amount of the breathing waveform is abnormal (S01) and the abnormal feature amount of the breathing waveform is caused by the body motion of the object person M (S02), or when the feature amount of the breathing waveform is normal (S01) and the object person M is in a state other than the deep sleep state (S04), the arithmetic unit 30 determines whether the object person M is in an awakening state or a shallow sleep state (S06). The arithmetic unit 30 outputs the determination result of whether the object person M is in the awakening state or in the shallow sleep state (S06 to S08). In Steps S04 to S08, the arithmetic unit 30 estimates the sleep state of the object person M with reference to learning data stored in the DB 40 or while storing new learning data in the DB 40.
In this embodiment, in Step S04, the arithmetic unit 30 may determine whether the object person M is awake or asleep. In this case, when it is determined that the object person M is asleep (S04), the arithmetic unit outputs the operation result indicating that the object person M is asleep in Step S05. When the feature amount of the breathing waveform is normal (S01) and the object person M is awake (S04), or when the feature amount of the breathing waveform is abnormal (S01) and the abnormal feature amount of the breathing waveform is caused by the body motion of the object person M (S02), the arithmetic unit 30 outputs the operation result indicating that the object person M is awake.
Next, the operation of the sleep state estimation device 1 according to this embodiment will be described in detail. As shown in
The arithmetic unit 30 determines whether an X component (in the front-rear direction of the vehicle) of acceleration is greater than a threshold value of, for example, 1.0 m/s2 using the value detected by the acceleration sensor 14 (S102). The arithmetic unit 30 determines whether a Y component (the left-right direction of the vehicle) of the acceleration is greater than a threshold value of, for example, 1.0 m/s2 using the value detected by the acceleration sensor 14 (S103).
When either of the X component and the Y component of the acceleration is greater than a threshold value of, for example, 1.0 m/s2 (S102 and S103), the arithmetic unit 30 estimates the value detected by the breathing sensor 12 as vehicle noise (S104). When neither of the X component nor the Y component of the acceleration is greater than a threshold value of, for example, 1.0 m/s2 (S102 and S103), the arithmetic unit 30 calculates reproducibility as the feature amount from the value detected by the breathing sensor 12 (S105).
The reproducibility means a fluctuation in the minimum value in each cycle of the breathing waveform. Assuming that the breathing sensor 12 detects the breathing waveform shown in
Returning to
When the reproducibility F is equal to or less than the threshold value a (S106), the arithmetic unit 30 calculates an amplitude as the feature amount from the value detected by the breathing sensor 12 (S107). As shown in
Returning to
When the reproducibility F is equal to or less than the threshold value a (S108), the arithmetic unit 30 calculates a cycle as the feature amount from the value detected by the breathing sensor 12 (S109). The arithmetic unit 30 determines whether the cycle is greater than the threshold value c (S110). When the cycle is greater than the threshold value c (S110), the arithmetic unit 30 presumes that the object person M is awake and recognizes the body motion of the object person M as described below (S113).
When the cycle is equal to or less than the threshold value c (S110), the arithmetic unit 30 calculates autocorrelation as the feature amount (S111). The term “autocorrelation” means the identity between a waveform which is shifted from the breathing waveform by an arbitrary period of time and the original breathing waveform. For example, as shown in
Returning to
Next, a method of recognizing the body motion of the object person M will be described. The inventors found that the use of combinations of the amplitude, cycle, autocorrelation, and reproducibility of the breathing waveform of the object person M made it possible to estimate the body motion of the object person M with high probability. For example, as can be seen from
Therefore, in this embodiment, the body motion of the object person M is estimated by the combinations of the amplitude, cycle, autocorrelation, and reproducibility of the breathing waveform of the object person M. As shown in
A change in the feature amounts of the breathing waveform when the object person M takes three deep breaths will be described with reference to
Similarly, a change in the feature amounts of the breathing waveform when the object person M is reseated two times will be described with reference to
In this embodiment, in addition to the breathing waveform of the object person M and the feature amounts thereof, the value detected by the acceleration sensor 14 is used to remove noise. In this way, the accuracy of detecting the state of the object person M is improved. For example, as shown in
Alternatively, even when the arithmetic unit 30 serving as an estimator outputs the wrong estimation result indicating that the depth of sleep of the object person M is large even though the depth of sleep of the object person M is small in practice, the behavior of the vehicle is estimated by the breathing waveform. However, when the behavior of the vehicle is detected by the acceleration sensor 14, it is possible to determine that the reliability of the estimation result based on the breathing waveform which indicates that the depth of sleep is large is low, and the behavior of the vehicle detected by the acceleration sensor can be used to verify the reason for the wrong estimation result. When the body motion of the object person M or the behavior of the vehicle cannot be detected by the breathing waveform or the acceleration sensor 14, it may be difficult to correct the wrong estimation result. However, when the body motion of the object person M or the behavior of the vehicle is constantly detected, it is possible to correct the estimation result and improve the accuracy of estimation.
In this embodiment, a primary filter using the detection positions of a plurality of breathing sensors 12 provided in the seat 10 is provided to classify the sleep states mainly into a deep sleep state and a shallow sleep state. As shown in
The breathing types are mainly classified into chest breathing and abdominal breathing. In many cases, elements of the two breathing types are mixed with each other in an unconscious state. In general, the emotional state of the object person M is strongly related to breathing. When a person is strained physically and mentally, breathing is shallow and short. That is, when there is a sense of tension or a sense of unease, a person is likely to breathe from the chest in the unconscious state. On the contrary, during sleep, the tension of a person is reduced and the person is in a relaxed state. Therefore, in the deep sleep state, abdominal breathing is dominant. The amount of air inhaled and exhaled in an abdominal breath is several times more than that of air inhaled and exhaled in a chest breath. For example, while the amount of air in the chest breathing is 500 ml, the amount of air in the abdominal breathing is a maximum of 2000 ml. When the above is considered, it is proved that the frequency of breathing, which is one of the observable physiological indexes, in the deep sleep state is lower than that in an active state or in the shallow sleep state.
In this embodiment, as shown in
Next, the relationship between a change in the sleep stage and the breathing type will be described.
As such, it is ascertained that a change in the sleep stage is correlated with a change in the breathing type in the previous and next sections. However, when the difference in the value detected by the breathing sensor 12 is used to calculate the change, it is expected that the value will not be stable due to, for example, a change in the breathing sensor 12 or a change in output gain. Therefore, in this embodiment, the ratio is used to respond to the change. For example, as can be seen from
Here, the section shown in
As a trend for every 30 seconds from
A statistically-significant difference test is performed for the ratio (a(P1/P2)) of the section P1 to the section P2 in abdominal breathing in a case in which the sleep stage changes from the shallow sleep state to the deep sleep state and a case in which the sleep stage changes from the deep sleep state to the shallow sleep state. As shown in
As can be seen from the above, in this embodiment, it is possible to simply estimate the sleep stage from a change in abdominal breathing and chest breathing. A change in a breathing method, for example, the ratio (abdominal breathing/chest breathing) of abdominal breathing to chest breathing is used to check whether the sleep stage is a deep sleep state or the other states. In addition, the variance (standard deviation) of the ratio (abdominal breathing/chest breathing) of abdominal breathing to chest breathing is used to improve the accuracy of separation between an awakening state and a sleep state in the sleep stage.
Since a change in a heart beat is dominated by the autonomic nerve which originates in the brain stem, it is difficult for the object person to control the heart beat at his or her own will. Therefore, frequency analysis, such as fine fluctuation analysis, is needed in order to estimate the body motion of the object person and is not suitable for instant processing. In contrast, according to this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 estimates the state of the object person on the basis of the identity of each cycle of the breathing waveform of the object person M as the feature amount of the breathing waveform. The object person M can control a change in breathing at his or her own will. Therefore, when the state of the object person M is estimated on the basis of the identity of each cycle of the breathing waveform of the object person M, it is possible to easily classify the body motions of the object person M in detail and easily improve the accuracy of estimating the state of the object person M, such as the depth of sleep or a body motion.
According to this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 estimates the state of the object person M on the basis of at least one of the reproducibility, which is a fluctuation in the minimum value in each cycle of the breathing waveform, and the autocorrelation, which is the identity between the waveform shifted from the breathing waveform by an arbitrary period of time and the original breathing waveform as the identity of each cycle of the breathing waveform of the object person M. Therefore, it is possible to improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion, with a simple process.
According to this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 estimates the state of the object person M on the basis of the cycle, amplitude, autocorrelation, and reproducibility of the breathing waveform as the feature amounts of the breathing waveform of the object person M. Therefore, since four indexes, such as the cycle, amplitude, autocorrelation, and reproducibility of the breathing waveform, are combined with each other to estimate the state of the object person M, it is possible to further improve the accuracy of estimating the state of the object person M, such as the depth of sleep or a body motion.
According to this embodiment, when it is detected that the amplitude, autocorrelation, and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person M, the arithmetic unit 30 of the sleep state estimation device 1 presumes that the object person M is reseated. The inventors found that, when the object person M was reseated, the amplitude, autocorrelation, and reproducibility of the breathing waveform of the object person M were changed. Therefore, when it is detected that the amplitude, autocorrelation, and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person M, the arithmetic unit 30 presumes that the object person M is reseated. As a result, it is possible to accurately presume that the object person M is reseated.
When it is detected that the amplitude and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person, the arithmetic unit 30 of the sleep state estimation device 1 presumes that the object person M stretches the hands upward. The inventors found that, when the object person M stretched the hands upward, the amplitude and reproducibility of the breathing waveform of the object person M were changed. Therefore, when it is detected that the amplitude and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person M, it is presumed that the object person M stretches the hands upward. As a result, it is possible to accurately presume that the object person M stretches the hands upward.
When it is detected that the autocorrelation and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person M, the arithmetic unit 30 of the sleep state estimation device 1 presumes that the object person M has a conversation. The inventors found that, when the object person M had a conversation, the autocorrelation and reproducibility of the breathing waveform of the object person M were changed. Therefore, when it is detected that the autocorrelation and reproducibility of the breathing waveform are changed as compared to those in the normal state of the object person M, it is presumed that the object person M has a conversation. As a result, it is possible to accurately presume that the object person M has a conversation.
According to this embodiment, when it is detected that the cycle and amplitude of the breathing waveform are changed as compared to those in the normal state of the object person M, the arithmetic unit 30 of the sleep state estimation device 1 presumes that the object person M takes a deep breath. The inventors found that, when the object person M took a deep breath, the cycle and amplitude of the breathing waveform of the object person M were changed. Therefore, when it is detected that the cycle and amplitude of the breathing waveform M are changed as compared to those in the normal state of the object person M, it is presumed that the object person M takes a deep breath. As a result, it is possible to accurately presume that the object person M takes a deep breath.
In this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 compares the feature amounts of the breathing waveform and the threshold values set to each feature amount to estimate the state of the object person M. Therefore, it is possible to estimate the state of the object person M, such as the depth of sleep or a body motion, with a simple process.
In this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 sets the threshold values to each feature amount of each object person M. Therefore, it is possible to estimate the state of the object person M according to the physical constitution or taste of each object person M.
In this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 estimates the state of the object person M in the vehicle, and estimates the state of the object person M while discriminating between the behavior of the vehicle and the body motion of the object person M on the basis of the acceleration of the vehicle. Therefore, it is possible to accurately estimate the state of the object person M in the vehicle while discriminating between the behavior of the vehicle and the body motion of the object person.
In this embodiment, the arithmetic unit 30 of the sleep state estimation device 1 determines whether the breathing type of the object person M is abdominal breathing or chest breathing from the breathing waveform of the object person M and estimates the depth of sleep of the object person M. Since whether the breathing type is abdominal breathing or chest breathing is closely related to the depth of sleep of the object person M, it is possible to improve the accuracy of estimating the depth of sleep.
The embodiment of the invention has been described above, but the invention is not limited to the above-described embodiment. Various modifications of the invention can be made.
According to the sleep state estimation device of the invention, it is possible to easily classify the body motions of the object person in detail and easily improve the accuracy of estimating the state of the object person, such as the depth of sleep or a body motion. Therefore, it is possible to execute various application programs for the object person according to, for example, the depth of sleep or the type of body motion of the object person which is estimated in detail, which makes it easy to lead the object person to a comfortable state.
1: SLEEP STATE ESTIMATION DEVICE
10: SEAT
12: BREATHING SENSOR
13
a,
13
b,
13
c: PRESSURE SENSOR
14: ACCELERATION SENSOR
16, 18: BREATHING BAND
20: I/F
30: ARITHMETIC UNIT
40: DB
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2010/069847 | 11/8/2010 | WO | 00 | 5/8/2013 |