The present invention relates to a pulse rate estimation method and apparatus and a program for determining a pulse rate from a detected pulse wave.
For measurement of variations in a pulse wave over a long period of time, pulse wave diagnostic devices that optically detect a pulse wave are used (see Patent Literature 1). The pulse wave diagnostic device of Patent Literature 1 receives transmitted light that has been transmitted through an artery or scattered light that has been scattered by an artery to detect a pulse wave, calculates a pulse wave amplitude for each pulse of the detected pulse wave, and calculates a point of pulse wave amplitude on a rectangular coordinate plane formed by two pulse wave amplitudes that were consecutively calculated as a Poincare coordinate for each single pulse. This technique enables detection of variations in a pulse wave over a long time period because it does not involve electrodes to be attached on skin surface.
Patent Literature 1: Japanese Patent No. 5160586.
The aforementioned technique, however, has a disadvantage of being unable to determine an accurate pulse rate when components originating from body motion are present in the detected signal because it presupposes that variations in a detected signal (pulse wave) are pulse wave components alone.
Embodiments of the present invention have been made in order to solve such a disadvantage and has an object of enabling more accurate determination of a pulse rate from a detected pulse wave.
A pulse rate estimation method according to embodiments of the present invention includes: a first step of chronologically detecting a pulse wave; a second step of performing time-frequency analysis on the detected pulse wave to determine a power spectrum for each time; a third step of determining local maximum points in each one of the power spectra determined for respective times; a fourth step of extracting, for each one of the power spectra determined for the respective times, a certain number of largest values of the determined local maximum points as pulse rate candidates for that time; and a fifth step of comparing a pulse rate candidate with a pulse rate candidate for a preceding time to determine a difference in frequency between them, and eliminating pulse rates for which the determined difference in frequency is equal to or greater than a preset reference value from the candidates.
The pulse rate estimation method may further include a sixth step of determining, after the fifth step, a candidate having a highest local maximum at each time as an actual pulse rate.
The pulse rate estimation method may further include a seventh step of reducing noise in the pulse wave detected in the first step, and in the second step, the pulse wave with reduced noise may be subjected to time-frequency analysis.
A program according to embodiments of the present invention is a program for causing a computer to execute the pulse rate estimation method set forth above.
A pulse rate estimation apparatus according to embodiments of the present invention includes: a detection unit that chronologically detects a pulse wave by receiving transmitted light that has been transmitted through an artery or scattered light that has been scattered by an artery; a first processing unit that performs time-frequency analysis on the pulse wave detected by the detection unit to determine a power spectrum for each time; a second processing unit that determines local maximum points in each one of the power spectra determined by the first processing unit for respective times; a third processing unit that extracts, for each one of the power spectra determined for the respective times, a certain number of largest values of the local maximum points determined by the second processing unit as pulse rate candidates for that time; and a fourth processing unit that compares a pulse rate candidate extracted by the third processing unit with a pulse rate candidate for a preceding time to determine a difference in frequency between them, and eliminates pulse rates for which the determined difference in frequency is equal to or greater than a preset reference value from the candidates.
The pulse rate estimation apparatus may further include a fifth processing unit that determines, after processing at the fourth processing unit, a candidate having a highest local maximum at each time as an actual pulse rate.
The pulse rate estimation apparatus may further include a filter unit that reduces noise in the pulse wave detected by the detection unit, and the first processing unit may perform time-frequency analysis on the pulse wave with noise reduced by the filter unit.
With the foregoing, embodiments of the present invention provide an advantageous effect of being able to determine a pulse rate more accurately from an optically detected pulse wave.
A pulse rate estimation method in an embodiment of the present invention is now described with reference to
Then in step S103, local maximum points are determined for each one of the power spectra determined for the respective times (a third step). Next, in step S104, for each one of the power spectra determined for the respective times, a certain number of largest values of the determined local maximum points are extracted as pulse rate candidates for that time (a fourth step).
Then, in step S105, a pulse rate candidate is compared with a pulse rate candidate for the preceding time to determine a difference in frequency between them, and pulse rates for which the determined difference in frequency is equal to or greater than a preset reference value are eliminated from the candidates (a fifth step).
In this embodiment, in step S106 following step S105, the candidate having the highest local maximum at each time is also determined as the actual pulse rate (a sixth step). Optionally, noise may be reduced in the pulse wave detected in step S101 (a seventh step), after which the pulse wave with reduced noise may be subjected to time-frequency analysis in step S102.
A pulse rate estimation apparatus in an embodiment of the present invention is now described. The pulse rate estimation apparatus includes a detection unit 101, a first processing unit 102, a second processing unit 103, a third processing unit 104, a fourth processing unit 105, a fifth processing unit 106, a storage unit 107, and a display unit 108.
The detection unit 101 chronologically detects a pulse wave. For example, the detection unit 101 detects the pulse wave by receiving transmitted light that has been transmitted through an artery or scattered light that has been scattered by an artery. The first processing unit 102 performs time-frequency analysis on the pulse wave detected by the detection unit 101 to determine a power spectrum for each time. The second processing unit 103 determines local maximum points in each one of the power spectra determined by the first processing unit 102 for the respective times.
The third processing unit 104 extracts, for each one of the power spectra determined for the respective times, a certain number of largest values of the local maximum points determined by the second processing unit 103 as pulse rate candidates for that time. The pulse rate candidates are stored in the storage unit 107, for example. The fourth processing unit 105 compares a pulse rate candidate extracted by the third processing unit 104 with a pulse rate candidate for the preceding time to determine a difference in frequency between them, and eliminates pulse rates for which the determined difference in frequency is equal to or greater than a preset reference value from the candidates.
After processing at the fourth processing unit 105, the fifth processing unit 106 determines the candidate having the highest local maximum at each time as the actual pulse rate, and displays the pulse rate on the display unit 108, for example. Optionally, a filter unit (not shown) that reduces noise in the pulse wave detected by the detection unit 101 may be included. In that case, the first processing unit 102 may perform time-frequency analysis on the pulse wave with noise reduced by the filter unit.
The pulse rate estimation apparatus in the above embodiment is a computer device including a CPU (Central Processing Unit) 201, a main storage device 202, an external storage device 203, and a network connection device 204 as shown in
More detailed descriptions are provided below. For example, as shown in
The light emission unit 301 is composed of a light emitting element, e.g., light emitting diode or semiconductor laser, and radiates light of a predetermined wavelength (infrared) to a site of measurement 351 under the control of the light emission control unit 302. The light emission unit 301 may be composed of one or more light emitting elements. The light emitted by the light emission unit 301 is transmitted through skin at the site of measurement 351 to irradiate blood in peripheral arteries.
The light that has been radiated by the light emission unit 301 and returned from the site of measurement 351 is received by the light reception unit 303 and goes through photoelectric conversion. The light reception unit 303 corresponds to the detection unit described above. The light reception unit 303 is composed of one or more light reception elements such as photodiodes, receives light that has been incident on the site of measurement 351 and has been transmitted through an artery and light scatted by an artery, and converts it to an analog signal.
The analog signal resulting from the photoelectric conversion at the light reception unit 303 is amplified by the amplification unit 304 to a predetermined signal level suited for signal processing, and particular frequency components are extracted from it at the filter unit 305. The filter unit 305 passes signal components of frequency bands in a range in which a heart rate (pulse rate) varies, e.g., 0.7 Hz to 4.0 Hz.
The analog signal with the particular frequency components extracted at the filter unit 305 is converted to a digital signal at the A-D conversion unit 306. The signal processing unit 307 estimates the pulse rate from this digital signal. The signal processing unit 307 corresponds to the first processing unit 102, the second processing unit 103, the third processing unit 104, the fourth processing unit 105, and the fifth processing unit 106 described above, being composed of a CPU and other components as mentioned earlier.
The signal processing unit 307 performs processing in accordance with a pulse rate estimation algorithm program, thus calculating the pulse rate of an observed person based on an observation signal acquired from the light reception unit 303. The signal processing unit 307 processes the digital signal in accordance with a stored program, saves the calculated pulse rate in the storage unit 308 and reads it therefrom. The storage unit 308 has a data saving area and a program saving area formed from non-volatile memory, a working area formed from volatile memory and the like, for example.
The signal processing unit 307 also outputs data such as the calculated pulse rate to the transmission and reception unit 309 for wireless communication. Here, the pulse rate estimation apparatus 300 has an appearance in the shape of an earphone for attachment to an ear 352 of a subject person, as illustrated in
While the above description showed an arrangement for observing a photoplethysmographic pulse wave via the light emission unit 301 and the light reception unit 303, embodiments of the present invention are not limited to a photoplethysmographic pulse wave approach but observation signals may be acquired with a pressure pulse wave approach or an electrocardiographic heart rate approach.
Referring now to
Specifically, upon the start, a particular light emitting element of the light emission unit 301 is caused to emit light at a predetermined light emission intensity through control by the light emission control unit 302 to irradiate the site of measurement 351. The incident light is scatted by arteriole near the site of measurement 351 to exit the skin surface at the site of measurement 351 and received by the light reception element(s) of the light reception unit 303. An analog signal corresponding to the amount of light thus received by the light reception unit 303 is output. The output signal is then amplified by the amplification unit 304 and is output to the signal processing unit 307 as an observation signal via the filter unit 305 and the A-D conversion unit 306.
Then, in step S303, the signal processing unit 307 performs time-frequency expansion such as short-time Fourier transform and wavelet transform based on chronological data for the observation signal (spectrogram acquisition).
Then, in step S304, the signal processing unit 307 obtains the power spectrum at a certain time Th, determines local maximums in it by performing peak search on the obtained power spectrum, and records the intensity and frequency values of the local maximums. Specifically, a certain width is established on frequency axis with respect to a function of the obtained spectrum and local maximums are determined within the established width. Local maximums are determined while shifting the width and the intensity and frequency values of all the local maximums are recorded.
Then, in step S305, the signal processing unit 307 sorts the recorded local maximums according to the power value to rearrange them in descending order. Then, in step S306, the signal processing unit 307 extracts local maximums up to the Xth local maximum and records their frequency values f1˜X. Here, the set of f1˜X is represented as F, where F={fX|X being a natural number}. These frequency values are candidates for the pulse rate.
Then, in step S307, the signal processing unit 307 creates a set M of values that fall within a range of a certain number of steps ±y for the values m1˜n that have been saved in the memory. Here, M={mn±y×S|n being a natural number equal to or smaller than X, and y being an integer equal to or greater than 0 and having a maximum greater than 0}. The step interval S is determined by parameters for time-frequency expansion. The values m1˜n being used are the initial value m1=0 or the value that was saved in the memory at time Th−1 immediately preceding time Th as described later. This set M represents a set of allowable pulse rate values at the times from Th−1 to Th.
Then, in step S308, the signal processing unit 307 obtains a common set F∩M of the set F and the set M. The elements of this common set represent pulse rate candidates that fall within the range of allowable pulse rates. If F∩M=0 (yes in step S309), the elements of F are saved in working memories m1 to mx (step S310); if n(F∩M)≥1 (no in step S309), the elements of F∩M are saved in the working memories m1 to mx (step S311).
Particularly, if n(F∩M)=1 (yes in step S312), the frequencies of the elements of F∩M are converted to pulse rates (step S313), which are output to the transmission and reception unit 309 or recorded into the data saving memory, for example. For conversion of a frequency (Hz) into a pulse rate (bpm), the value of the frequency is multiplied by 60. Finally, it is determined whether measurement is to end (step S314), and a loop is performed.
An example of actual measurement is now described using
Next, another algorithm for determining the pulse rate from frequency components with a spectrogram (pulse rate estimation method) is described with reference to
Specifically, upon the start, a particular light emitting element of the light emission unit 301 is caused to emit light at a predetermined light emission intensity through control by the light emission control unit 302 to irradiate the site of measurement 351. The incident light is scatted by arteriole near the site of measurement 351 to exit the skin surface at the site of measurement 351 and received by the light reception element(s) of the light reception unit 303. An analog signal corresponding to the amount of light thus received by the light reception unit 303 is output. The output signal is then amplified by the amplification unit 304 and is output to the signal processing unit 307 as an observation signal via the filter unit 305 and the A-D conversion unit 306.
Then, in step S303, the signal processing unit 307 performs time-frequency expansion such as short-time Fourier transform and wavelet transform based on chronological data for the observation signal (spectrogram acquisition).
Then, in step S304, the signal processing unit 307 obtains the power spectrum at a certain time Th, determines its local maximums by performing peak search on the obtained power spectrum, and records the intensity and frequency values of the local maximums. Specifically, a certain width is established on the frequency axis with respect to a function of the obtained spectrum and local maximums are determined within the established width. The local maximums are determined while shifting the width and the intensity and frequency values of all the local maximums are recorded.
Then, in step S305, the signal processing unit 307 sorts the recorded local maximums according to the power value to rearrange them in descending order. Then, in step S306, the signal processing unit 307 extracts up to the Xth local maximum and records their frequency values f1˜X. Here, the set of f1˜X is represented as F, where F={fX|X being a natural number}. These frequency values are candidates for the pulse rate.
Then, in step S307, the signal processing unit 307 creates a set M of values that fall within a range of a certain number of steps ±y for the values m1˜n that have been saved in the memory. Here, M={mn±y×S|n being a natural number equal to or smaller than X, and y being an integer equal to or greater than 0 and having a maximum greater than 0}. The step interval S is determined by parameters for time-frequency expansion. The values m1˜n being used are the initial value m1=0 or the value that was saved in the memory at time Th−1 immediately preceding time Th as described later. This set M represents a set of allowable pulse rate values at the times from Th−1 to Th.
Then, in step S308, the signal processing unit 307 obtains a common set F∩M of the set F and the set M. The elements of this common set represent pulse rate candidates that fall within the range of allowable pulse rates. If F∩M=0 (yes in step S309), the elements of F are saved in working memories m1 to mx (step S310), the element with the highest intensity among the elements saved in the working memories is selected (step S315), and the frequency of the selected element is converted to a pulse rate, which is output to the transmission and reception unit 309, for example (step S313). If n(F∩M)≥1 (no in step S309), the elements of F∩M are saved in working memories m1 to mx (step S311).
Particularly, if n(F∩M)=1 (yes in step S312), the frequencies of the elements of F∩M are converted to pulse rates (step S313). If n(F∩M)=1 does not hold (no in step S312), the element with the highest intensity among the elements saved in the working memories are selected (step S315), and the frequency of the selected element is converted to a pulse rate, which is output to the transmission and reception unit 309, for example (step S313). Finally, it is determined whether measurement is to end (step S314), and a loop is performed.
As described above, embodiments of the present invention perform time-frequency analysis on a detected pulse wave to determine a power spectrum for each time, determines local maximum points in each one of the power spectra determined for the respective times, and for each one of the power spectra determined for the respective times, extracts a certain number of largest values of the determined local maximum points as pulse rate candidates for that time. Embodiments of the present invention then compare a pulse rate candidate with a pulse rate candidate for the preceding time to determine a difference in frequency between them, and eliminate pulse rates for which the determined difference in frequency is equal to or greater than a preset reference value from the candidates. As a result, embodiments of the present invention can determine the pulse rate more accurately from the detected pulse wave.
Embodiments of the present invention employ time-frequency analysis for the estimation of the pulse wave. A feature of embodiments of the present invention is that it uses difference in spectrum between a pulse and body motion. The pulse rate is a periodical function and thus its spectrum contains peaks in the frequency domain, whereas body motion is nonperiodic noise and thus its spectrum tends to spread on the frequency axis. Accordingly, even during body motion, the pulse rate exhibits peaks in the frequency domain without being buried in the body motion. By determining such peaks, pulse rate candidates are determined.
A second feature of embodiments of the present invention is use of the constancy of the pulse rate. The pulse rate changes continuously because it acts to maintain constancy. By contrast, body motion exhibits an intermittent change because it occurs intermittently. These facts enable the pulse rate to be estimated even during motion by determining peaks that continuously vary on a spectrogram.
Embodiments of the present invention also use frequency components and intensity components in a spectrogram for the estimation of the pulse rate. By using frequency components and intensity components, embodiments of the present invention allow the pulse rate to be estimated at an earlier time, particularly in resting state. In resting state, spectral peaks are emphasized because there is little body motion. Thus, the frequency component of the local maximum having the highest spectral intensity can be estimated to be the pulse rate. Once the pulse rate has been estimated, the pulse rate can be determined by tracking the change in the frequency components, which thus enables the pulse rate to be determined even during motion. As embodiments of the present invention thus determine a single candidate for the pulse rate using frequency components and intensity components, it provides improved real-timeliness.
It is noted that the present invention is not limited to the above described embodiments but it is apparent that many variants and combinations are may be implemented by ordinary skilled persons in the art without departing from the technical scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2018-072200 | Apr 2018 | JP | national |
This application is a national phase entry based PCT Application No. PCT/JP2019/013180, filed on Mar. 27, 2019 which claims priority to Japanese Application No. 2018-072200, filed on Apr. 4, 2018, which applications are hereby incorporated herein by reference.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2019/013180 | 3/27/2019 | WO | 00 |