The present invention relates to an awakening-degree determining device, or the like.
As the technique for measuring the sleepiness or the degree of awakening of the subject without imposing loads on the subject, there is a frequency analysis technology that uses a heartbeat signal, or the like, of the subject. For example, there is a conventional technology in which the frequency at the peak of the fluctuation of a heartbeat signal and the power spectral density are used as the feature values and the degree of awakening of the subject is determined on the basis of the movement of the feature values.
Patent Literature 1: International Publication Pamphlet No. WO 2008/065724
However, the above-described conventional technology has a problem in that it is difficult to accurately determine the degree of awakening of the subject.
For example, if the subject feels sleepy but struggles against sleepiness, the degree of awakening that is determined on the basis of the feature value in the conventional technology is sometimes different from the actual degree of awakening of the subject.
According to an aspect of the embodiment of the invention, an awakening-degree determining device includes a memory and a processor coupled to the memory, wherein the processor executes a process including: calculating a heartbeat interval by using a heartbeat signal of a subject; calculating a power spectral density of each frequency by performing a frequency analysis on the heartbeat interval; extracting a combination of a maximum point of the power spectral density and a frequency that corresponds to the maximum point and a combination of a minimum point of the power spectral density and a frequency that corresponds to the minimum point; and determining a degree of awakening of the subject by using a combination of the maximum point and the frequency that corresponds to the maximum point and the combination of the minimum point and the frequency that corresponds to the minimum point.
The object and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the claims.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention.
A detailed explanation is given below, with reference to the drawings, of an embodiment of an awakening-degree determining device, an awakening-degree determination program, and an awakening-degree determination method according to the present invention. The present invention is not limited to the embodiment.
An explanation is given of an awakening-degree determining device according to a first embodiment.
The heartbeat detecting unit 101 is a unit that detects a heartbeat signal of the subject. The heartbeat detecting unit 101, for example, acquires a heartbeat signal of the subject by using the potential difference of the electrodes that are in contact with the subject. For instance, the electrodes are provided on the steering wheel of a vehicle, or the like, and, while the subject is driving, a heartbeat signal may be detected from the subject. Furthermore, for example, a pulse signal may be acquired and detected by an ear-clip type photoplethysmographic sensor.
The heartbeat interval calculating unit 102 is a processing unit that detects the timing of each amplitude peak of a heartbeat signal on the basis of the heartbeat signal data and that detects the interval of the timings of the amplitude peaks.
The heartbeat interval calculating unit 102 detects, as the amplitude peak, the point where the amplitude of a heartbeat signal is equal to or more than a threshold. In the example illustrated in
The heartbeat interval calculating unit 102 sequentially detects the heartbeat interval and outputs, to the spectrum calculating unit 103, data on the detected heartbeat interval. In the following explanation, data on a heartbeat interval is referred to as heartbeat interval data. Furthermore, the method for detecting the amplitude peak is not limited to the above-described method, and it is possible to use, for example, a method for detecting a peak by performing pattern matching on the basis of an amplitude waveform, a method of using the largest value of the differential coefficient of a pulse signal, or the like.
The spectrum calculating unit 103 is a processing unit that calculates the power spectral density with respect to the variation of the heartbeat interval on the basis of the heartbeat interval data. Here, a detailed explanation is given of an operation of the spectrum calculating unit 103. First, the spectrum calculating unit 103 uses the heartbeat interval data to generate data on a heartbeat interval that varies due to the time passage. Data on a heartbeat interval that varies due to the time passage is referred to as heartbeat interval variation data.
The spectrum calculating unit 103 calculates the power spectral density that corresponds to each frequency on the basis of the heartbeat interval variation data.
Furthermore, the method used by the spectrum calculating unit 103 to calculate the power spectral density data may be any method. For example, the spectrum calculating unit 103 may calculate the power spectral density data by performing Fourier transform.
Furthermore, the spectrum calculating unit 103 is capable of calculating the power spectral density by using, for example, the AR (Autoregressive) model. As disclosed in Non Patent Literature (Shunsuke Sato, Sho Kikkawa, and Toru Kiryu, Introduction to Biosignal Processing, CORONA publishing Co., Ltd.), or the like, the AR model is the model for representing the state at a certain time by using the linear sum of previous time-series data, and it has a feature in that the clear maximum point can be obtained by using a small volume of data compared to Fourier transform.
The p-order AR model of the time series x(s) can be represented by using Equation (1) that uses the AR coefficient a(m) that is a weight to a previous value and the error term e(s). In an ideal state, e(s) that is included in Equation (1) corresponds to white noise.
Power spectral density PAR(f) can be represented by using Equation (2).
In Equation (2), p indicates the identification order, fs indicates the sampling frequency, and εp indicates the identification error. Furthermore, the following mark indicates the k-order AR coefficient.
â
p(k)
The spectrum calculating unit 103 may calculate the power spectral density data on the basis of Equation (2) and the heartbeat interval variation data.
The extracting unit 104 uses the power spectral density data to specify the maximum point and the minimum point of the power spectral density. In the following explanation, the maximum point is referred to as a peak, and the minimum point is referred to as a bottom. An operation of the extracting unit 104 is explained by using
In the example illustrated in
The extracting unit 104 represents the bottom B by using Bf and Bd. Bf corresponds to the value that is obtained by subtracting the frequency of the bottom B from the frequency of the reference point O. Bd corresponds to the value that is obtained by subtracting the power spectral density of the bottom B from the power spectral density of the reference point O. Data on Bf, Bd of the bottom B is referred to as B (Bf, Bd) as appropriate.
The extracting unit 104 outputs P (Pf, Pd) and B (Bf, Bd) to the determining unit 105. Each time the extracting unit 104 acquires the power spectral density data from the spectrum calculating unit 103, it specifies P (Pf, Pd), B (Bf, Bd) and outputs them to the determining unit 105.
Furthermore, the extracting unit 104 may specify the reference point O in any way. For example, the extracting unit 104 specifies, as the reference point O, the middle point of a line segment that connects the bottom B and the peak P. Moreover, the extracting unit 104 may specify, as the reference point O, the center of gravity of the area that includes the bottom B and the peak P.
The determining unit 105 is a processing unit that determines the degree of awakening of the subject on the basis of P (Pf, Pd), B (Bf, Bd). An explanation is given of an operation performed when the determining unit 105 calculates the degree of awakening.
The determining unit 105 uses P (Pf, Pd), B (Bf, Bd) to calculate state index data. The state index data contains a parameter f and a parameter PSD. The determining unit 105 adds Pf and Bf to calculate the parameter f. The determining unit 105 adds Pd and Bd to calculate the parameter PSD. The state index data is referred to as state index S (f, PSD) below as appropriate.
The determining unit 105 determines the degree of awakening of the subject by using the position of the state index S (f, PSD) that is defined by the parameter f and the parameter PSD and that is on an awakening-degree determination graph.
The determining unit 105 determines the degree of awakening depending on which area of the awakening-degree determination graph includes the state index S (f, PSD). For example, as illustrated in
Furthermore, the determining unit 105 sequentially acquires P (Pf, Pd) and B (Bf, Bd) from the extracting unit 104 and sequentially calculates the state index S (f, PSD). The determining unit 105 may use the moving direction of the state index S (f, PSD) on the awakening-degree determination graph to determine whether the subject is becoming sleepy or the subject is not becoming sleepy. If the state index S (f, PSD) moves from Level 1 toward Level 5 on the awakening-degree determination graph illustrated in
The output unit 106 is a processing unit that outputs various types of information in accordance with a determination result of the determining unit 105. For example, the output unit 106 acquires the degree of awakening of the subject from the determining unit 105 and, if the degree of awakening is included in Level 3 to 5, outputs a warning. Furthermore, the output unit 106 may output a warning if the subject is becoming sleepy. Moreover, the output unit 106 may display, on a display device, the position of the state index S (f, PSD) on the awakening-degree determination graph in real time.
Next, an explanation is given of the steps of an operation of the awakening-degree determining device 100 according to the first embodiment.
As illustrated in
The awakening-degree determining device 100 calculates the peak P and the bottom B (Step S104). The awakening-degree determining device 100 uses the peak P and the bottom B to calculate the state index (Step S105).
The awakening-degree determining device 100 plots the movement of the state index on the awakening-degree determination graph (Step 5106) and determines the degree of awakening of the subject by using the position of the state index (Step S107). The awakening-degree determining device 100 outputs a determination result (Step S108).
Next, an explanation is given of an advantage of the awakening-degree determining device 100 according to the first embodiment. The awakening-degree determining device 100 performs a frequency analysis on heartbeat signal data to generate power spectral density data in which a frequency and a power spectral density are related to each other. Then, the awakening-degree determining device 100 uses the power spectral density data to specify the peak P and the bottom B and determines the degree of awakening of the subject by using the peak P and the bottom B that are specified. Therefore, with the awakening-degree determining device 100, it is possible to accurately determine the degree of awakening of the subject.
With reference to
Furthermore, the awakening-degree determining device 100 sets the reference point, sets the peak P and the bottom B on the basis of the distance from the reference point, and determines the degree of awakening on the basis of the peak P and the bottom B; therefore, the degree of awakening of the subject can be determined more accurately by using the relative change between the peak P and the bottom B with the reference point as a reference. Furthermore, the awakening-degree determining device 100 sets the reference value each time on the basis of the peak P and the bottom B; therefore, it is possible to dynamically respond to the physical condition of the subject and to determine the degree of awakening accurately even if the physical condition is different from the usual one.
Although the embodiment of the present invention has been described heretofore, the present invention may be implemented by using various different configurations other than the above-described first embodiment. An explanation is given below of another embodiment that is included in the present invention as a second embodiment.
(1) With Regard to a Reference Point
In the above-described first embodiment, the extracting unit 104 sets the reference point O by using the peak P and the bottom B; however, this is not a limitation. For example, the extracting unit 104 may previously set the specific reference point O for each subject or may adjust the position of the reference point O depending on a subject. As described above, the reference point O is set for each subject, whereby it is possible to accurately determine the specific degree of awakening of each subject.
Furthermore, the determining unit 105 may determine the degree of awakening of the subject by comparing the reference point O with the peak P and the bottom B. For example, if the peak P has a lower power spectral density or frequency than the reference point O, the determining unit 105 may determine that the degree of awakening of the subject decreases. Furthermore, if the bottom B has a higher power spectral density or frequency than the reference point O, the determining unit 105 may determine that the degree of awakening of the subject decreases.
Furthermore, the determining unit 105 may perform an operation by using, in a combined manner, a determination result 1 of the degree of awakening on the basis of the awakening-degree determination graph and the state index S and a determination result 2 on the basis of the comparison of the reference point O with the peak P and the bottom B. If the degree of awakening has a decreasing tendency according to the determination result 1 and the degree of awakening of the subject decreases according to the determination result 2, the determining unit 105 may determine that there is a “high” possibility that the subject falls asleep and may give a warning in louder sound than that of a usual warning.
Conversely, if the degree of awakening has an increasing tendency according to the determination result 1 but the degree of awakening of the subject decreases according to the determination result 2, it may be determined that the reference point O is improperly set, and the reference point O may be set again. For example, the determining unit 105 may calculate the middle point of the line segment between the peak P and the bottom B again and correct the reference point O.
(2) Predictive Detection Based on the Ratio of the Peak P to the Bottom B
Pd of the peak P is the index that indicates the state where the rhythm of heartbeat is constant and successive. Furthermore, Pf is the index that is proportional to the amount of activity of the subject. Furthermore, Bd, Bf of the bottom B both indicate the disturbance degree of the rhythm of heartbeat, and it is particularly considered that they are the indexes that indicate the sympathetic activity.
It is considered that unbalance between the above-described sympathetic and the parasympathetic is related to sleepiness and awakening. Therefore, a decrease in the degree of awakening can be previously predicted by focusing on a change in the ratio of the peak P to the bottom B.
The determining unit 105 sequentially calculates the struggle degree F=Pd/Bd. If the amount of change in the struggle degree F. is equal to or more than a threshold, the determining unit 105 determines that a decrease in the degree of awakening is predicted. If the determining unit 105 determines that a decrease in the degree of awakening is predicted, it may give a warning to the subject. As the determining unit 105 performs the above operation, it is possible to prevent a decrease in the degree of awakening before it occurs.
(3) Configuration of a System, and the Like
Among the operations described in the present embodiment, all or some of the operations that are automatically performed as described above may be performed manually, or all or some of the operations that are manually performed as described above may be performed automatically by using a known method. Furthermore, the operation procedures, the control procedures, the specific names, and the information including various types of data and parameters as described in the above specifications and the drawings may be arbitrarily changed except as otherwise noted.
Furthermore, the components of the awakening-degree determining device 100 that is described in the embodiment are functionally conceptual and do not always need to be physically configured as illustrated in the drawings. Specifically, specific forms of separation and combination of each unit are not limited to those depicted in the drawings, and a configuration may be such that all or some of the units are functionally or physically separated or combined in an arbitrary unit depending on various types of loads or usages. Furthermore, all or any of various processing functions performed by each unit may be implemented by a CPU or a program that is analyzed and executed by the CPU, or it may be implemented as hardware by a wired logic.
The hard disk device 208 includes, for example, a spectrum calculation program 208a, an extraction program 208b, and a determination program 208c. The CPU 201 reads the programs 208a to 208c and loads them into the RAM 207.
The spectrum calculation program 208a functions as a spectrum calculation process 207a. The extraction program 208b functions as an extraction process 207b. The determination program 208c functions as a determination process 207c.
For example, the spectrum calculation process 207a corresponds to the spectrum calculating unit 103. The extraction process 207b corresponds to the extracting unit 104. The determination process 207c corresponds to the determining unit 105.
The programs 208a to 208c do not always need to be initially stored in the hard disk device 208. For example, the programs are stored in a “portable physical medium”, such as a flexible disk (FD), CD-ROM, DVD disk, magnet-optical disk, or IC card, which is inserted into the computer 200. The computer 200 reads the programs 208a to 208c from the above and executes them.
The disclosed awakening-degree determining device produces an advantage such that the degree of awakening of the subject can be accurately determined.
All examples and conditional language provided herein are intended for the pedagogical purposes of aiding the reader in understanding the invention and the concepts contributed by the inventor to further the art, and are not to be construed as limitations to such specifically recited examples and conditions, nor does the organization of such examples in the specification relate to a showing of the superiority and inferiority of the invention. Although one or more embodiments of the present invention have been described in detail, it should be understood that the various changes, substitutions, and alterations could be made hereto without departing from the spirit and scope of the invention.
This application is a continuation application of International Application PCT/JP2012/057071, filed on Mar. 19, 2012, and designating the U.S., the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2012/057071 | Mar 2012 | US |
Child | 14480821 | US |