Patent Grant
11883210
The present disclosure relates to a method for estimating a physical condition, a physical condition estimation apparatus, and a non-transitory computer-readable recording medium storing a program.
In Japanese Unexamined Patent Application Publication No. 2002-272708, a technique for determining a person's physical condition, such as stress, fatigue, sleepiness, or an arousal level, on the basis of a pulse wave signal obtained by measuring a pulse wave caused by blood circulation is disclosed.
In one general aspect, the techniques disclosed here feature a method for estimating a physical condition used by a computer. The method includes simultaneously measuring blood flow volumes of at least two body parts of a person and estimating a person's physical condition on the basis of the blood flow volumes of the at least two body parts measured in the simultaneously measuring.
With the method for estimating a physical condition in the present disclosure, a person's physical condition can be estimated without preliminary calibration.
It should be noted that general or specific embodiments may be implemented as a system, a method, an integrated circuit, a computer program, a computer-readable recording medium such as a compact disc read-only memory (CD-ROM), or any selective combination thereof.
Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
Pulse pressure varies between individuals. In the technique disclosed Japanese Unexamined Patent Application Publication No. 2002-2727708, therefore, calibration (adjustment) in which the pulse pressure of a subject is set needs to be performed beforehand, that is, before the subject's physical condition is determined.
One non-limiting and exemplary embodiment provides a method for estimating a physical condition without preliminary calibration and the like.
A method for estimating a physical condition according to an aspect of the present disclosure is a method for estimating a physical condition used by a computer. The method includes simultaneously measuring blood flow volumes of at least two body parts of a person and estimating a person's physical condition on the basis of the blood firm volumes of the at least two body parts measured it be simultaneously measuring.
According to the above aspect, the person's physical condition can be estimated without preliminary calibration even if the computer estimates the person's physical condition by measuring blood flow volumes that vary between individuals.
In addition, for example, in the simultaneously measuring, blood flow volumes of a first body part, whose blood flow volume hardly varies depending on the person's physical condition, and a second body part, whose blood flow volume varies depending on the person's physical condition, may be measured as the blood flow volumes of the at least two body parts.
Here, for example, the first body part may be the person's forehead. The second body part may be at least one of the person's nose, the person's lips, one of the person's hands or feet, the person's neck, and portions under the person's eyes.
In addition, for example, in the simultaneously measuring, a blood flow volume of the person's forehead and a blood flow volume of portions under the person's eyes may be measured as the blood flow volumes of the at least two body parts, in the estimating the person's physical condition, hours of sleep of the person may be estimated as the person's physical condition.
In addition, for example, in the simultaneously measuring, a blood flow volume of the person's forehead and a blood flow volume of at least one of the person's nose, the person's lips, and one of the person's hands or feet may be measured as the blood flow volumes of the at least two body parts. In the estimating the person's physical condition, a sense of warmth and coldness of the person may be estimated as the person's physical condition.
In addition, for example, in the simultaneously measuring, a blood flow volume of the person's forehead and a blood flow volume of the person's neck may be measured as the blood flow volumes of the at least two body parts. In the estimating the person's physical condition, whether the person's shoulders are stiff may be estimated as the person's physical condition.
Furthermore, for example, the method may further include estimating the person's emotion on the basis of a physiological value of the person and correcting the person's physical condition estimated in the estimating the person's physical condition on the basis of the person's emotion estimated in the estimating the person's emotion.
Here, for example, the physiological value of the person may be one of the blood flow volumes of the at least two body parts.
In addition, for example, the physiological value of the person may be a blood flow volume of a body part different from the at least two body parts.
In addition, for example, the physiological value of the person may be at east one of complexion, a heartrate, venation in the heartrate, a ratio of a low frequency component to a high frequency component of the venation in the heartrate, R-R intervals, a pulse wave, variation in the pulse wave, a brain wave, a respiratory rate, respiratory volume, blood flow, variation in the blood flow, blood pressure, variation in the blood pressure, oxygen saturation, movement of a body part, movement of a body muscle, movement of a facial muscle, body temperature, skin temperature, skin conductance, skin resistance, the amount of sweat, and a sweating rate.
In addition, for example, in the simultaneously measuring, the blood flow volumes of the at least two body parts may be measured in a noncontact manner by radiating light having a certain wavelength onto the at least two body parts and receiving light having wavelengths different from each other.
Here, for example, in the simultaneously measuring, the blood flow volumes of the at least two body parts may be measured using a camera. For example, at least one of the simultaneously measuring and the estimating may be performed by a processor.
In addition, a physical condition estimation apparatus includes a blood flow measurer that simultaneously measures blood flow volumes of at least two body parts of a person and a physical condition estimator that estimates the person's physical condition on the basis of the blood flow volumes of the at least two body parts measured by the blood flow measurer. For example, at least one of the blood flow measurer and the physical condition estimator may include a processor.
It should be noted that these genera or specific aspects may be implemented as a system, a method, an integrated circuit, a computer program, a computer-readable recording medium such as a CD-ROM, or any selective combination thereof.
The method for estimating a physical condition according to the aspect of the present disclosure and the like will be specifically described hereinafter with reference to the drawings. Embodiments that will be described hereinafter are specific examples of the present disclosure. Values, shapes, materials, components, arrangement positions of the components, and the like described in the following embodiments are examples, and do not limit the present disclosure. Among the components described in the following embodiments, ones not described in the independent claims, which define broadest concepts, will be described as arbitrary components.
As illustrated in
As illustrated in
More specifically, the camera section 111 is a laser speckle camera, a laser Doppler blood-flowmeter, or the like. The camera section 111 radiates light having a certain wavelength onto the at least two body parts and receives light having wavelengths different from each other. The blood flow volume measurement processing section 112 measures the blood flow volumes of the at least two body parts in a noncontact manner on the basis of the light received by the camera section 111 having wavelengths different from each other.
The camera section 111 may be a camera or may be a device different from a camera, such as a milliwave sensor or a pulse oximeter, insofar as the camera section 111 is capable of simultaneously measuring the blood flow volumes of the at least two body parts.
As illustrated in
More specifically, the blood flow volume obtaining section 121 obtains the blood flow volumes of the at least two body parts measured by the blood flow measuring unit 11. The physical condition estimation processing section 122 estimates the person's physical condition on the basis of the blood flow volumes of the at least two body parts obtained by the blood flow volume obtaining section 121.
Here, it is preferable to measure blood flow volumes of the first body whose blood flow volume hardly varies depending on the person's physical condition, and the second body part, whose blood flow volume varies depending on the person's physical condition, as the blood flow volumes of the at least two body parts. As described above, for example, the first body part is the person's forehead, and the second body part is the person's nose, the person's lips, one of the person's hands or feet, or the person's neck, or the portions under the person's eyes. As a result, the physical condition estimation unit 12 can estimate the person's physical condition, without preliminary calibration, on the basis of the blood flow volume of the second body part relative to the blood flow volume of the first body part.
In the present embodiment, a person's physical condition refers to the person's condition other than emotions defined by Russell's circumplex model, which is a two-dimensional model illustrated in
If the blood flow measuring unit 11 measures blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts, for example, the physical condition estimation unit 12 may estimate the hours of sleep of the person as the person's physical condition. Since a person develops dark rings under the eyes and the blood flow volume of the portions under the person's eyes decreases when the hours of sleep are short, the hours of sleep of the person of the day can be estimated from the blood flow volume of the portions under the person's eyes.
If the blood flow measuring unit 11 measures a blood flow volume of the person's forehead and a blood flow volume of at least one of the person's nose, the person's lips, and one of the person's hands or feet as the blood flow volumes of the at least two body parts, for example, the physical condition estimation unit 12 may estimate the sense of warmth and coldness of the person as the person's physical condition. Since the temperature of the person's nose becomes high relative to the temperature of the person's forehead in a hot environment and the temperature of a person's nose becomes low relative to the temperature of the person's forehead in a cold environment, the sensor of warmth and coldness of the person can be estimated from the blood flow volumes.
If the blood flow measuring unit 11 measures blood flow volumes of the person's forehead and neck as the blood flow volumes of the at least two body parts, for example, the physical condition estimation unit 12 may estimate, as the person's physical condition, whether the person's shoulders are stiff. Since a person's shoulders are (can become) stiff when the blood flow volume of the person's neck is low relative to the blood flow volume of the person's forehead, whether the person's shoulders are stiff can be estimated from the blood flow volumes. Here, a headache may be estimated as the person's physical condition instead of stiffness in the shoulders. Since a headache is likely to occur when the blood flow volume of a person's neck s low relative to the blood flow volume of the person's forehead, whether the person has a headache can be estimated from the blood flow volumes.
Although the first body part is the forehead here, the first body part may be another body part. The first body part may be any body part whose blood flow volume hardly varies depending on a person's physical condition, such as the mouth or an eyeball.
The blood flow measuring unit 11 may measure a blood flow volume of a person's face every day. In this case, the physical condition estimation unit 12 can estimate, as the person's physical condition on the basis of day-to-day variation in the blood flow volume, that a spot is likely to be formed on a part of the person's face in which the blood flow volume has decreased.
The output control unit 13 performs output control according to a person's physical condition estimated by the physical condition estimation unit 12.
The output control performed by the physical condition estimation apparatus 10 (output control unit 13) is not limited to the example illustrated in
The output control unit 13 may predict when a person will become sleepy, for example, on the basis of the person's hours of sleep estimated by the physical condition estimation unit 12 as the person's physical condition. If the physical condition estimation apparatus 10 is installed in a vehicle, the output control unit 13 may, when the time has come, display a message urging the person to take a break on a screen of a car navigation system or a mobile terminal of the person. If the physical condition estimation apparatus 10 is installed in a space where the person stays, the output control unit 13 may, when the time has come, arouse the person by turning up lighting.
If the output control unit 13 determines that the person's accumulated hours of sleep estimated by the physical condition estimation unit 12 are short, the output control unit 13 may notify a company for which the person is working that the person needs rest.
The output control unit 13 may notify, using a mobile terminal such as a smartphone, the person of the person's hours of seep estimated by the physical condition estimation unit 12 as the person's concentration or productivity of the day.
The output control unit 13 may determine, as the hours of sleep, information that takes into consideration hours of sleep of a plurality of days including the day estimated by the physical condition estimation unit 12, not just the hours of sleep of the day.
The output control unit 13 may set an insurance fee for the person on the basis of the person's hours of sleep of a plurality of days estimated by the physical condition estimation unit 12 and notify the person of the insurance fee. The insurance fee herein refers to a fee for life insurance, automobile insurance, or the like. Because a person is more likely to fall asleep at the wheel or contract a lifestyle-related disease when the person's hours of sleep are shorter than a certain value, an insurance fee of a person whose hours of sleep are relatively short may be set high and the person may be notified of the insurance fee.
The output control unit 13 may control the air volume, the air temperature, or a wind direction of an air conditioner installed in a space where the person stays in accordance with a sense of warmth and coldness estimated by the physical condition estimation unit 12 as the person's physical condition.
If the physical condition estimation apparatus 10 is installed in a vehicle and the physical condition estimation unit 12 estimates, as a person's physical condition, that the person's shoulders are stiff, the output control unit 13 may control a seat heater included in the vehicle in such a way as to heat the person's shoulders in order to prevent or reduce the stiffness in the person's shoulders.
The output control unit 13 may notify, through a mobile terminal such as a smartphone, a person of the stiffness in the person's shoulders estimated by the physical condition estimation unit 12 as the person's concentration or productivity of the day. Furthermore, if the stiffness estimated by the physical condition estimation unit 12 is high or if the person's shoulders are often stiff, the output control unit 13 may suggest, through the mobile terminal such as a smartphone, that the person get a massage or go to a clinic, or may propose a method for reducing the stiffness. The output control unit 13 may propose another means for reducing the stiffness in the person's shoulders.
If the physical condition estimation unit 12 estimates, as a person's physical condition, that a spot is likely to appear on the person's face, the output control unit 13 may suggest, through a mobile terminal such as a smartphone, that the person get a massage, or may propose a method for reducing the likelihood of a spot. The output control unit 13 may propose another means for reducing the likelihood of a spot.
Next, the operation of the physical condition estimation apparatus 10 will be described with reference to
First, the physical condition estimation apparatus 10 simultaneously measures the blood flow volumes of at least two body parts of a person (S11) Next the physical condition estimation apparatus 10 estimates the person's physical condition on the basis of the blood flow volumes of the at least two body parts (S12). The physical condition estimation apparatus 10 then performs output control according to the estimated physical condition (S13).
As described above, with the method for estimating a physical condition according to the present embodiment and the like, a person's physical condition can be estimated without preliminary calibration even when a computer estimates the person's physical condition by measuring a blood flow volume that varies between individuals.
More specifically, in the method for estimating a physical condition and the physical condition estimation apparatus according to the present embodiment, the blood flow volumes of at least two body parts of a person, namely, for example, a body part whose blood flow volume hardly varies depending on the person's physical condition and a body part whose blood flow volume varies depending on the person's physical condition, are simultaneously measured. As a result, the person's physical condition can be estimated, without preliminary calibration, on the basis of the measured blood flow volumes of the at least two body parts.
Although a person's physical condition can be the hours of sleep, the sense of warmth and coldness, stiffness in the shoulders, a spot on the face, or dryness of the skin in the present embodiment, a person's physical condition is not limited to these. A person's physical condition may be a level of urgency at which the person wants to go to a toilet, a level of carsickness, a risk of heat shock, a risk of a vascular disorder caused by an increase in blood pressure during defecation, a level of intoxication, driving skills, a hunger level, a fatigue level, a depression level, or the like, instead. These examples will be described hereinafter as first to ninth examples.
In the first example, a case will be described in which the level of urgency at which a person wants to go to a toilet is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the level of urgency at which the person wants to go to a toilet as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. When a person wants to go to a toilet and becomes tense, the blood flow volume of the portions under the person's eyes becomes low relative to the blood flow volume of the person's forehead. The level of urgency at which the person wants to go to a toilet, therefore, can be estimated.
If the physical condition estimation apparatus 10 in the present example is installed in a vehicle and estimates that the level of urgency at which the person wants to go to a toilet is equal to or higher than a threshold, the physical condition estimation apparatus 10 in the present example may display a public toilet 71 on a screen 70 of a car navigation system as illustrated in
As illustrated in
As described above, the physical condition estimation apparatus 10 may use a different guiding method depending on the estimated level of urgency at which the person wants to go to a toilet.
The method for estimating the level of urgency at which a person wants to go to a toilet as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. The level of urgency at which a person wants to go to a toilet may be estimated on the basis of variation in the person's heartrate or blood pressure or the person's facial expression, instead. Since a person's heartrate and blood pressure increase and the person's facial expression changes (e.g., clenches the teeth) when the person wants to go to a toilet, the level of urgency at which the person wants to go to a toilet can be estimated. One, some, or all of the heartrate, the blood pressure, and the facial expression may be used to estimate the level of urgency at which a person wants to go to a toilet.
In the second example, a case will be described in which the level of carsickness of a person is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the level of carsickness of the person as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since a person gets a carsick and becomes tense, the blood flow volume of the portions under the person's eyes becomes low relative to the blood flow volume of the person's forehead. The physical condition estimation apparatus 10, therefore, can estimate the level of carsickness of the person.
If the physical condition estimation apparatus 10 is installed in a vehicle and estimates that the level of carsickness of a person is equal to or higher than a threshold, the physical condition estimation apparatus 10 may display a parking area 72 for taking a break on a screen 70 of a car navigation system to guide a driver to the parking area 72 as illustrated in
As illustrated in
As a result, the sensitivity of the accelerator or the brakes can be reduced in order to suppress a sudden start or stop and reduce the level of carsickness of the person, or the active suspension can be made softer in order to reduce vibration applied to the person's body. By controlling a device in this manner, the person can be prevented from throwing up in the vehicle or an increase in the level of carsickness can be suppressed, even if the person is a child or hesitates to tell the driver that he/she is carsick. If the vehicle is a taxi, the driver can allow the person to get out before the person throws up, or decline to pick up the person.
The method for estimating the level of carsickness of a person as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. The level of carsickness may be estimated on the basis of a person's facial expression, heartrate, or blood pressure. Since a person's face becomes pale or looks unwell or a temporal correlation (ρmax) between the person's heartrate and blood pressure decreases when the person is carsick, the level of carsickness of the person can be estimated. The level of carsickness of the person may be estimated using ρmax and/or the facial expression.
In the third example, a case will be described in which the risk of heat shock of a person is estimated as the person's physical condition. Heat shock herein refers to a vascular disorder such as a faint, a myocardial infarction, or a cerebral infarction caused by a sudden change in blood pressure. Heat shock often occurs when a person undresses in a cold changing room before bathing and the blood pressure suddenly increases or when a person takes a hot bath and the blood pressure suddenly increases.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the risk of heat shock of the person as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since the blood flow volume of the portions under a person's eyes is low relative to the blood flow volume of the person's forehead in a cold environment and the blood flow volume of the portions under the person's eyes is high relative to the blood flow volume of the person's forehead in a hot environment, the risk of heat shock of the person can be estimated.
As illustrated in
As a result, a sudden change in the person's blood pressure can be suppressed, and heat shock can be prevented.
The output control method used by the physical condition estimation apparatus 10 when the estimated risk of heat shock of the person is equal to or higher than the threshold is not limited to this. If the person is in a changing room or a toilet, for example, the person may be notified of the risk and urged to use a heater. If the estimated risk of heat shock of the person is equal to or higher than the threshold when the person takes a bath, for example, the physical condition estimation apparatus 10 may output a device control signal including an instruction to add water to the bath. As a result, the temperature of the bath can be decreased, thereby suppressing a sudden change in the person's blood pressure.
The method for estimating the risk of heat shock of a person as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. The risk of heat shock of a person may be estimated on the basis of the person's blood pressure, instead. If the person's blood pressure can be constantly measured and has become equal to or higher than a certain value, for example, the physical condition estimation apparatus 10 can estimate that the risk of heat shock is high.
Here, a plurality of thresholds may be provided instead of the certain value, and the risk of heat shock may be estimated stepwise. The threshold(s) of blood pressure used to determine the risk of heat shock may be adjusted on the basis of a degree of arteriosclerosis. The degree of arteriosclerosis can be estimated from pulse pressure (highest blood pressure and lowest blood pressure) or a pulse wave propagation time. Any other method may be used.
The threshold(s) of blood pressure may be adjusted on the basis of age or a water content level inside the body, instead of the degree of arteriosclerosis. This is because when the water content level inside the body is small, the blood pressure sharply changes, which can lead to heat shock. Another method may be used to adjust the threshold(s) of blood pressure, insofar as the risk of heat shock can be estimated.
The degree of arteriosclerosis may be manually input on the basis of a result of a medical examination, instead of being detected in a noncontact manner. The age, too, may be manually input.
If the blood pressure can be constantly measured, a warning or a notification may be issued in accordance with the degree of arteriosclerosis or the water content level. Changes in the person's blood pressure may be displayed to the person.
In the fourth example, a case will be described in which a person's risk of a vascular disorder caused by an increase in blood pressure during defecation is estimated as the person's physical condition. During defecation, a person pushes down hard, and the person's blood pressure increases. This might cause a vascular disorder such as a faint, a myocardial infarction, or a cerebral infarction.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the risk of a vascular disorder caused by an increase in the blood pressure during defecation as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since the blood flow volume of the portions under a person's eyes becomes high relative to the blood flow volume of the person's forehead during defecation, the risk of a vascular disorder caused by an increase in the blood pressure during defecation can be estimated.
If estimating that the risk of a vascular disorder caused by an increase in the blood pressure during defecation is equal to or higher than a certain value, the physical condition estimation apparatus 10 in the present example may notify the person of the result of the estimation to urge the person not to push down very hard or may control a shower toilet in such a way as to spray water around the person's anus to allow the person not to push down very hard.
As a result, a sudden change in the person's blood pressure can be suppressed, and a vascular disorder can be prevented.
The method for estimating the risk of a vascular disorder caused by an increase in the blood pressure during defecation as a person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. The risk of a vascular disorder caused by an increase in the blood pressure during defecation may be estimated from a person's blood pressure, instead. If the person's blood pressure can be constantly measured and has become equal to higher than a certain value, for example, the physical condition estimation apparatus 10 can estimate that the risk of a vascular disorder caused by an increase in the blood pressure during defecation is high.
Here, a plurality of thresholds may be provided instead of the certain value, and the risk of a vascular disorder caused by an increase in the blood pressure during defecation may be estimated stepwise. The threshold(s) of blood pressure used to determine the risk of caused by an increase in the blood pressure during defecation may be adjusted on the basis of the degree of arteriosclerosis. The degree of arteriosclerosis can be estimated from pulse pressure (highest blood pressure and lowest blood pressure) or a pulse wave propagation time. Any other method may be used.
The threshold(s) of blood pressure may be adjusted on the basis of the age or the water content level inside the body, instead of the degree of arteriosclerosis. This is because when the water content level inside the body is low, the blood pressure sharply changes, which can lead to a vascular disorder. Another method may be used to adjust the threshold(s) of blood pressure, insofar as the risk of a vascular disorder caused by an increase in the blood pressure during defecation can be estimated.
The degree of arteriosclerosis may be manually input on the basis of a result of a medical examination, instead of being detected in a noncontact manner. The age, too, may be manually input.
If the blood pressure can be constantly measured, a warning or a notification may be issued in accordance with the degree of arteriosclerosis or the water content level. Changes in the person's blood pressure may be displayed to the person.
In the fifth example, a case will be described in which the level of intoxication of a person is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the level of intoxication of the person as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes Since the blood flow volume of the portions under a person's eyes becomes high relative to the blood flow volume of the person's forehead when the person is intoxicated and the blood flow volume of the portions under the person's eyes becomes low relative to the blood flow volume of the person's forehead when the person is sick due to intoxication, the level of intoxication of the person can be estimated.
If the physical condition estimation apparatus 10 in the present example is installed in a vehicle and estimates that the level of intoxication of the person is equal to or higher than a certain value, that is, if the person is intoxicated, the physical condition estimation apparatus 10 may control an engine of the vehicle such that the engine does not start (device control). As a result, an intoxicated person is prevented from driving the vehicle.
If the physical condition estimation apparatus 10 in the present example estimates that the level of the intoxication of the person is equal to or higher than the certain value, that is, if the person has drunk too much, the physical condition estimation apparatus 10 may notify the person of the result of the estimation or display the level of intoxication of the person to the person. As a resist, the person can understand the level of intoxication thereof and it becomes possible to prevent the person from drinking too much again.
The method for estimating the level of intoxication of a person as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. The level of intoxication of person may be estimated on the basis of the person's facial expression, heartrate, blood pressure, blood flow, or exhaled air, instead. Since, when a person gets intoxicated, the person's line of sight becomes unstable, the person's circulation of the blood improves and the person's heartrate increases, the person's face turns red, the person becomes relaxed and the person's blood pressure decreases, and the alcohol concentration of the person's exhaled air increases, the level of intoxication of the person can be estimated. One, some, or all of these pieces at information may be used to estimate the lever of intoxication of a person.
In the sixth example, a case will be described in which a person's driving skills are estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the person's driving skills as the person's physical condition on the basis of the measured blood flow is of the person's forehead and the portions under the person's eyes. Since a person does not become tense and the blood flow volume of the portions under the person's eyes becomes high relative to the blood flow volume of the person's forehead when the person's driving skills are high and a person becomes tense and the blood flow volume of the portions under the person's eyes becomes low relative to the blood flow volume of the person's forehead when the person's driving skins are low, the person's driving skins can be estimated.
If the physical condition estimation apparatus 10 in the present example estimates that the person's driving skills are lower than a certain value, that is, if the person is tense during driving, the physical condition estimation apparatus 10 may increase the sensitivity of brakes to keep a distance to a vehicle ahead or may decrease the sensitivity of an accelerator to keep the speed of the vehicle low. As a result, the person becomes relaxed during driving even if the person's driving skins are low and the person has been tense.
The method for estimating a person's driving skins as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. A person's driving skills may be estimated from the person's facial expression or variation in the person's heartrate. Since whether a person is relaxed can be estimated from the person's facial expression and variation in the person's heartrate becomes small when the person is tense during driving and large when the person is relaxed, the person's driving skills can be estimated. One, some, or all of these pieces of information may be used to estimate a person's driving skills.
If the physical condition estimation apparatus 10 in the present example is installed in a vehicle and estimates a person's physical condition on the basis of the person's facial expression, the physical condition estimation apparatus 10 may estimate a person's fear as the person's physical condition. For example, the physical condition estimation apparatus 10 in the present example estimates, on the basis of a person's facial expression, whether the person, who is inside the vehicle, is afraid during automated driving. If the physical condition estimation apparatus 10 estimates that the person is afraid, that is, if the person is tense (does not trust the automated driving), the physical condition estimation apparatus 10 may control a vehicle device such that a distance to a vehicle ahead increases and the speed of the vehicle decreases. As a result, the person in the vehicle feels safe.
If the physical condition estimation apparatus 10 in the present example detects, on the basis of a person's facial expression, that the person is looking out over scenery, the physical condition estimation apparatus 10 may control a vehicle device such that the speed of the vehicle decreases. As a result, the person can enjoy the scenery.
In the seventh example, a case will be described in which a person's hunger level is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the person's hunger level as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since the blood flow volume of the portions under a person's eyes becomes low relative to the blood flow volume of the person's forehead when the person's hunger level is high and the person is stressed, the person's hunger level can be estimated.
If the physical condition estimation apparatus 10 in the present example is installed in an office and estimates that a person's hunger level is equal to or higher than a certain value, that is, that the person is hungry, the physical condition estimation apparatus 10 may control lighting such that a blue component included in the light increases (device control). This is because a person becomes less hungry when seeing blue light.
If the physical condition estimation apparatus 10 in the present example is installed in a vehicle and estimates that a person's hunger level is equal to or higher than the certain value, that is, that the person is hungry, the physical condition estimation apparatus 10 in the present example may display a nearby restaurant on a screen of a car navigation system and guide the person to the restaurant.
The method for estimating a person's hunger level as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. A person's hunger level may be estimated from the person's blood sugar level or exhaled air or sound from the person's abdomen, instead. Since, when the person is hungry, a person's blood sugar level decreases, the amount of acetone included in the person's exhaled air increases, and the person's gastrointestinal activity increases, the person's hunger level can be estimated. One, some, or all of these pieces of information may be used to estimate a person's hunger level.
In the eighth example, a case will be described in which a person's fatigue level is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the person's fatigue level as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since the blood flow volume of the portions under the person's eyes becomes low relative to the blood flow volume of the person's forehead when the person is fatigued and stressed, the person's fatigue level can be estimated.
If the physical condition estimation apparatus 10 in the present example is installed in a vehicle and estimates that a person's fatigue level is equal to or higher than a certain value, the physical condition estimation apparatus 10 may control a vehicle device in such a way as to urge the person to take a break or switch to automated driving in order to suppress the fatigue of the person, who is a driver.
The method for estimating a person's fatigue level as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. A person's fatigue level may be estimated from the person's facial expression or oxygen saturation or lactic acid concentration in blood flow, instead. Since, when a person is fatigued, the oxygen saturation in blood flow decreases, the lactic acid concentration in the blood flow increases and the person's face looks fatigued, the person's fatigue level can be estimated. One, some, or all of these pieces of information may be used to estimate a person's fatigue level.
In the ninth example, a case will be described in which a person's depression level is estimated as the person's physical condition.
In the present example, for example, the physical condition estimation apparatus 10 measures the blood flow volumes of the person's forehead and the portions under the person's eyes as the blood flow volumes of the at least two body parts. The physical condition estimation apparatus 10 then estimates the person's depression level as the person's physical condition on the basis of the measured blood flow volumes of the person's forehead and the portions under the person's eyes. Since the blood flow volume of the portions under a person's eyes becomes low relative to the blood flow volume of the person's forehead when the person is depressed and stressed, the person's depression level can be estimated.
If the physical condition estimation apparatus 10 in the present example estimates that a person's depression level is equal to or higher than a certain value, that is, that the person is depressed, the physical condition estimation apparatus 10 may control lighting in a room. By controlling the lighting in the room such that, for example, the lighting becomes bright in the morning and dim at night, the person's circadian rhythm can be adjusted and the person becomes less depressed. If the physical condition estimation apparatus 10 in the present example estimates that a person's depression level is equal to or higher than the certain value, that is, that the person is depressed, the physical condition estimation apparatus 10 may control an audio system such that the audio system plays back encouraging songs in the morning and relaxing songs at night.
The method for estimating a person's depression level as the person's physical condition is not limited to the one based on the blood flow volumes of at least two body parts. A person's depression level may be estimated from the person's facial expression or heartrate, instead. Since a period of time for which a person's parasympathetic nervous system remains active in a day decreases when the person is depressed, and since the period of time for which the person's parasympathetic nervous system remains active can be identified by checking temporal variation in the person's heartrate, the person's depression level can be estimated. In addition, it is known that when a person is depressed, facial expressions unique to a depressed person (e.g., a vacuous expression) are observed. Whether a person is depressed, therefore, can be estimated from the person's facial expression at a certain timing such as rising or a change in the person's facial expression at a time when a certain image is displayed. One, some, or all of these pieces of information may be used to estimate a person's depression level.
Although a person's physical condition is estimated on the basis of physiological values such as the blood flow volumes of at least two body parts of the person in the first embodiment, the method for estimating a person's physical condition is not limited to this. A person's physical condition may be estimated on the basis of the person's physiological values and then corrected on the basis of the person's emotion at a time when the physiological values are obtained. This case will be described hereinafter as a second embodiment.
As illustrated in
The emotion estimation unit 24 estimates a person's emotion on the basis of the person's physiological value. More specifically, the emotion estimation unit 24 estimates a person's emotion using Russell's circumplex model illustrated in
That is, the emotion estimation unit 24 may estimate a person's emotion, such as an arousal level of the person, on the basis of one of the blood flow volumes of the at least two body parts measured by the blood flow measuring unit 11 as the person's physiological value. Alternatively, the emotion estimation unit 24 may estimate a person's emotion, such as the arousal level of the person, on the basis of a blood flow volume of a body part different from the blood flow volumes of the at least two body parts measured by the blood flow measuring unit 11 as the person's physiological value. Alternatively, the emotion estimation unit 24 may estimate, as a person's physiological value, the person's emotion on the basis of, for example, a physiological value such as facial expression, the heartrate, respiration, the pulse wave, the blood pressure, or any combination thereof.
Alternatively, the emotion estimation unit 24 may estimate a person's emotion by determining a position along a pleasure axis on the basis of the person's facial expression and a position along an arousal axis on the basis of person's physiological value such as the blood flow, heartbeats, the respiration, the pulse wave, or the blood pressure using Russell's circumplex model illustrated in
As illustrated in
A person experiences various emotions such as pleasure and astonishment. In Russell's circumplex model illustrated in
The storage section 244 stores, for example, data corresponding to Russel s circumplex model illustrated in
The camera section 241 captures an image of the entirety of a person's face. The facial expression estimation section 242 estimates the person's facial expression on the basis of the image of the person's face captured by the camera section 241.
The emotion estimation processing section 243 refers, for example, to the data corresponding to Russel's circumplex model illustrated in
Although a case in which an emotion is estimated using Russell's circumplex model has been described, another model may be used, instead. In Schlosberg's conic model illustrated in
As illustrated in
More specifically, the estimated emotion obtaining section 223 obtains a person's emotion estimated by the emotion estimation unit 24. The correction section 224 corrects the person's physical condition estimated by the physical condition estimation processing section 122 on the basis of the person's emotion estimated by the emotion estimation unit 24.
A case will be described in which, for example, the blood flow volume measurement processing section 112 has estimated a certain level of stiffness in the shoulders as a person's physical condition and the emotion estimation unit 24 has estimated “excited” as the person's emotion. Because “excited” contributes to increasing the blood flow volume of the person and reducing the stiffness in the shoulders, the correction section 224 corrects the person's physical condition to a level of stiffness in the shoulders lower than the certain level. The physical condition estimation unit 22 can thus obtain a result of estimation by correcting a person's physical condition on the basis of the person's emotion.
Next, the operation of the physical condition estimation apparatus 20 will be described with reference to
First, the physical condition estimation apparatus 20 simultaneously measures the blood flow volumes of at least two body parts of a person (S21). Next, the physical condition estimation apparatus 20 estimates the person's physical condition on the basis of the measured blood flow volumes of the at least two body parts (S22). Next, the physical condition estimation apparatus 20 estimates the person's emotion on the basis of a blood flow volume of at least one body part (S23). The blood flow volume of the at least one body part for estimating the person's emotion may be the blood flow volume of at least one of the at least two body parts measured to estimate the person's physical condition or may be another body part. Next, the physical condition estimation apparatus 20 corrects the person's physical condition estimated in 322 on the basis of the person's emotion estimated in S23 (S24). The physical condition estimation apparatus 20 then performs output control according to the resultant physical condition (S25).
As described above, with the method for estimating a physical condition according to the present embodiment and the like, a person's physical condition can be estimated without preliminary calibration even when a computer estimates the person's physical condition by measuring a blood flow volume that varies between individuals. Furthermore, with the method for estimating a physical condition according to the present embodiment and the like, the estimated physical condition can be corrected on the basis of the person's emotion. The person's physical condition that takes into consideration the person's emotion, therefore, can be estimated.
A case will be described hereinafter, as an example, in which a physical condition to be estimated is a level of stiffness in the shoulders and an emotion to be estimated is a level of excitement.
In the present example, for example, a blood flow measuring unit 11A measures a blood flow volume A of a forehead of the person 50, a blood flow volume B of a neck B of the person 50, and a blood flow volume C of a nose C of the person 50 as the blood flow volumes of the at least two body parts. An emotion estimation unit 24A estimates the level of excitement of the person 50 as the emotion of the person 60 on the basis of the measured blood flow volume C of the nose C.
First, the physical condition estimation unit 22 estimates the level of stiffness in the shoulders of the person 50 as the physical condition of the person 50 on the basis of the blood Plow volume A of the forehead A and the blood flow volume B of the neck B. The physical condition estimation unit 22 then corrects the estimated level of stiffness in the shoulders of the person 50 on the basis of the level of excitement of the person 50 estimated by the emotion estimation unit 24A.
An output control unit 13A then displays, as the output control according to the estimated physical condition of the person 50, the corrected level of stiffness in the shoulders on a screen 62 of the mobile terminal 60 owned by the person such as a smartphone.
Although an estimated physical condition of a person is corrected n the basis of the person's emotion in the present embodiment and example, the operation performed is not limited to this. An estimated emotion of a person may be corrected on the basis of an estimated physical condition of the person, instead. This case will be described hereinafter as first and second modifications.
A case will be described hereinafter, as the first modification, in which a physical condition to be estimated is hours of sleep of the day and an emotion to be estimated is a level of sleepiness.
In the present modification, for example, a blood flow measuring unit 11B measures the blood flow volume A of the forehead A of the person 50, the blood flow volume B of portions B under the eyes of the person 50, and the blood flow volume C of a nose C of the person 50 as the blood flow volumes of the at least two body parts. First, the physical condition estimation unit 22 estimates the hours of sleep of the day of the person 50 as the physical condition of the person 50 on the basis of the blood flow volume A of the forehead A and the blood flow volume B of the portions B under the eyes.
An emotion estimation unit 24B estimates the level of sleepiness of the person 50 as the emotion of the person 50 on the basis of the hours of sleep of the day of the person 50 estimated by the physical condition estimation unit 22 and the blood flow volume C of the nose C measured by the blood flow measuring unit 11B. More specifically, first, since the skin temperature of a person' nose increases when the person is sleepy, the emotion estimation unit 24B can estimates the level of sleepiness (arousal level) on the basis of the blood flow volume C measured by the blood flow measuring unit 11B. Next, the emotion estimation unit 24B may correct the level of sleepiness estimated on the basis of the blood flow volume C to a higher level of sleepiness if the hours of sleep of the day of the person 50 estimated by the physical condition estimation unit 22 is short (e.g., shorter than average hours of sleep of the person 50).
An output control unit 13B may, as output control, display the resultant level of sleepiness on a screen 63 of the mobile terminal 60, such as a smartphone, of the person 50.
The physical condition estimation apparatus 20B may thus correct estimated emotion on the basis of an estimated physical condition.
The physical condition to be estimated may be the sense of warmth and coldness instead of the hours of sleep of the day, if estimating, as the physical condition of the person 50, that the person 50 is feeling cold, for example, the physical condition estimation apparatus 20B may reduce the level of sleepiness estimated as the emotion of the person 50. The physical condition to be estimated may be whether the shoulders of the person 50 are stiff and the emotion to be estimated may be the comfort of the person 50. If estimating, as the physical condition of the person 50, that the shoulders of the person 50 are stiff, for example, the physical condition estimation apparatus 20B may reduce the comfort of the person 50 estimated as the emotion of the person 50.
Although a case in which the emotion of the person 60 is estimated from the blood flow volume of the nose of the person 50 has been described in the first modification, the emotion of the person 50 need not be estimated on the basis of the blood flow volume of the nose of the person 50. As described above, the emotion of the person 50 may be estimated on the basis of an image of the face of the person 50 captured by the camera section 241, instead. This case will be described hereinafter as the second modification. In the present modification, the physical condition to be estimated is the sense of warmth and coldness, and the emotion to be estimated is the level of sleepiness.
In the present modification, for example, the blood flow measuring unit 11 measures the blood flow volume A of the forehead A of the person 50 and the blood flow volume B of the portions B under the eyes of the person 50 as the blood flow volumes of the at least two body parts. First, the physical condition estimation unit 22 estimates the sense of warmth and coldness of the person 50 as the physical condition of the person 50 on the basis of the blood flow volume A of the forehead A and the blood flow volume B of the portions B under the eyes.
The emotion estimation unit 24 estimates the level of sleepiness of the person 50 as the emotion of the person 50 on the basis of the sense of warmth and coldness of the person 50 estimated by the physical condition estimation unit 22 and an image of the entirety of the face of the person 50 captured by the emotion estimation unit 24.
More specifically, first, the emotion estimation unit 24 captures an image of the entirety of the face of the person 50. The emotion estimation unit 24 then estimates a heartrate of the person 50 from slight variation in the complexion of the person 50 and determines a position along the arousal axis illustrated in
An output control unit 13C may display, as output control, the resultant level of sleepiness on a screen 63C of the mobile terminal 60, such as a smart hone, of the person 50.
The physical condition estimation apparatus 20C may thus correct an estimated emotion on the basis of an estimated physical condition.
Although the processes in the present disclosure has been described with reference to the first and second embodiments, a person or an apparatus that dorms each process is not particularly limited.
As described above, the physical condition estimation apparatus may include the blood flow measuring unit, the physical condition estimation unit, and the output control unit, for example, but may include only the physical condition estimation unit or only the physical condition estimation unit and the output control unit. Alternatively, The physical condition estimation unit and the output control unit may be achieved by a cloud server provided in a place different from a place where the local apparatus is provided, in this case, the cloud server and the local apparatus may share processing or control. For example, the cloud server may perform heavy processing or control, and the local apparatus may perform light processing or control. The cloud server and the local apparatus may together be referred to as a “physical condition estimation apparatus”.
The physical condition estimation apparatus may be implemented as a processor or the like incorporated into a particular locally provided apparatus (described hereinafter).
The present disclosure may be the computer program or the digital signal transmitted through an electrical communication line, a wireless or wired communication line, a network typified by the Internet, datacasting, or the like.
The present disclosure may be a computer system including a microprocessor and a memory. The memory may store the computer program, and the microprocessor may operate in accordance with the computer program.
The present disclosure may be implemented as an independent computer system by recording the computer program or the digital signal on one of the computer-readable recording media and transporting the computer-readable recording medium or by transporting the computer program or the digital signal through the network or the like.
A method for estimating an epileptic seizure as a person's physical condition and an output at a time when an epileptic seizure has been estimated will be described.
The occurrence of an epileptic seizure can be estimated (detected) from a person's line of sight or respiration or the diameter of the person's pupils. This is because it is known that a person's line of sight is fixed, the person's respiration becomes irregular, and light reflex from the person's pupils disappears due to an epileptic seizure. An epileptic seizure, therefore, can be estimated (detected) as a person's physical condition by measuring the persons light of sight or respiration or the diameter of the person's pupils.
As illustrated in
Next, if it is estimated that an epileptic seizure has not occurred to the person (NO in S32), the process returns to S31. On the other hand, if it is estimated that an epileptic seizure has occurred to the person (YES in S32) and the person is inside a vehicle, a device control signal for controlling a device such as brakes, an accelerator, or an active suspension of the vehicle is output (S33).
Furthermore, if the person is inside an automobile in an automated driving mode, the automobile automatically parks in a safe place or goes to a closest hospital (S34). In S34, the automobile may call a closest ambulance or security center.
Next, a method for estimating Meniere's syndrome or dizziness as a person's physical condition and an output at a time when Meniere's syndrome or dizziness has been estimated will be described.
By detecting a person's line of sight, whether Meniere's syndrome or dizziness has occurred to the person can be estimated (detected). This is because it is known that a person's line of sight runs in circles when dizziness or Meniere's syndrome has occurred to the person.
If it is estimated (detected) that Meniere's syndrome or dizziness has occurred to a person end the person is inside an automobile in an automated driving mode, a device such as brakes, an accelerator, or an active suspension of the vehicle may be controlled in such a way as to automatically park the automobile in a safe place. Needless to say, the automobile may immediately call a closest ambulance or security center or may go to a closest hospital through automated driving.
Alternatively, one of the following diseases may be estimated (detected) as a person's physical condition from a constituent or a secretion of exhaled air.
If the amount of ammonia included in a person's exhaled air is large, for example, a decrease in a kidney or liver function of the person, deterioration of an intestinal environment, or gout can be detected. If the amount of nitric oxide included in a person's exhaled air is large, for example, bronchial asthma or sleepiness of the person can be detected. If the amount of hydrogen sulfide included in a person's exhaled air is large, for example, a gastrointestinal disorder of the person can be detected. If the amount of 3-methyl-3-sulfanyl-hexan-1-ol included in a person's exhaled air is large, for example, it can be estimated that the person is psychologically stressed.
For example, a sensor capable of detecting one of the above-mentioned chemical substances may be provided on a desk or a mouse in a persons office, and if one of the above-mentioned disorders is detected as the person's physical condition, the person or a medical department may be notified of the detection. As a result, the person can be protected from various diseases.
The deep body temperature of e person may be estimated as the person's physical condition.
By detecting the body surface temperature of a person, the deep body temperature of the person can be estimated. The temperature of the forehead, for example, is known to be close to the deep body temperature. By detecting the temperature of the forehead or the like using a thermal camera, the deep body temperature can be estimated. If ambient temperature is also measured and the body surface temperature is corrected, the deep body temperature can be estimated more accurately. The deep body temperature may be estimated more accurately by also measuring the temperature of a body part such as an eyeball.
An example of output control when the deep body temperature is estimated (detected) will be described hereinafter.
As illustrated in
That is as illustrated in
In S42, if the deep body temperature of the patient 51 is equal to or higher than 38° C., for example, a door A of a waiting room A automatically opens (S43). If the deep body temperature of the patient 51 is higher than 37° C. but lower than 38° C., a door B of a waiting room B automatically opens (S44). If the deep body temperature of the patient 51 is equal to or lower than 37° C., a door C of a waiting room C automatically opens (S45).
As a result, a patient 51 having a high fever enters a room different from one in which a patient 51 whose temperature is normal is waiting, and the patient 51 whose temperature is normal does not get infected from the patient 51 having a high fever.
The thresholds of deep body temperature may be different, from those illustrated in
A taxi may implement this estimation method. In this case, a driver of the taxi can, as necessary, decline to pick up a patient having a high fever, and a secondary infection to the driver can be prevented. In addition, in a public transportation system such as a train, different cars may be provided for people whose temperatures are high and people whose temperatures are low in this case, the prevalence of a disease can be suppressed in the public transportation system.
The method for estimating deep body temperature and the output control are not limited to these examples.
For example, the deep body temperature at a time of rising may be measured (estimated) daily. In this case, a woman's menstrual period can be estimated. When the woman's skin tends to be dry during the estimated menstrual period, a humidifier or an air conditioner may be automatically adjusted to prevent the woman's skin from becoming dry. When the woman tends to get irritated, an audio system may automatically select relaxing songs.
The timing at which the deep body temperature is measured daily is not limited to the time of rising. The deep body temperature may be measured at any timing insofar as the measurement can be performed under the same condition. For example, the deep body temperature may be measured at a washstand in the morning.
For example, the deep body temperature may be measured when a person arrives at his/her office. By measuring the deep body temperature when the person holds a card out toward a reader at an entrance of the office, for example, the person and the deep body temperature can be associated with each other, and a worker having a fever can be identified. A boss who has been informed that the worker has a fever can adjust a work schedule or urge the worker to go home, in order to maintain the worker's health and prevent infection to other workers.
A dryness level of a person's skin may be estimated as the person's physical condition.
This is because the dryness level of a person's skin can be estimated by measuring a water content level of the person's skin. If the dryness level is equal to or lower than a certain value, that is, if the water content level of the person's skin is equal to or lower than a certain value, a humidifier in a room where the person stays may be operated to humidify the room for esthetic purposes.
A person's metabolic rate may be estimated as the person's physical condition.
By measuring the temperature of a person's collarbone using a thermal camera, a radiation thermometer, or the like, the person's metabolic rate can be estimated. It is known that when there is brown fat, the metabolic rate increases. The brown fat is located around the collarbone and generates heat. By measuring the temperature of the person's collarbone, therefore, the person's metabolic rate can be estimated.
If a calorie intake of a person is larger than an estimated metabolic rate, for example, a warning may be issued to the person. In this case, the person can prevented from getting overweight.
How a person is seated on a chair may be estimated (detected) as the person's physical condition.
By providing a sensor for measuring the distribution of pressure in a seat of a chair, how a person is seated on the chair can be detected. A body part likely to ache may be estimated from the detected information and heated to prevent the pain.
Alternatively, shortness of breath of a person may be estimated (detected) as the person's physical condition.
Shortness of breath a person can be detected from a respiratory rate or the oxygen saturation of the person. If shortness of breath is detected, the person may be notified the rhythm of respiration as a sound or the like. As a result, the rhythm of the respiration of the person can be adjusted. By notifying the person of a rhythm of respiration slightly slower than the actual rhythm of respiration of the person and gradually slowing down the rhythm of respiration, the respiration of the person can be adjusted.
Alternatively, palpitations of a person due to tension or the like may be estimated (detected) as the person's physical condition by measuring the person's heartrate.
If palpitations of a person due to tension or the like are detected, a sound whose rhythm is slightly slower than the actual heartrate may be output to the person. As a result, the person's heartrate can be decreased to relax the person. If the person is going to play a match and needs to be tense, a sound whose rhythm is slightly faster than that of an actual heartrate when the person is at rest may be output to the person. As a result, an ideal tension may be achieved.
An insurance fee of life insurance or medical insurance may be adjusted in accordance with a detected type of physical condition, a degree of the physical condition, and a time at which the physical condition has been detected. As a result, an insurance fee for a health person can be decreased, and an insurance fee for a sick person can be increased, which is fair to all insured persons.
If a sick person is detected in a movie theater or the like, a clerk may be notified of the detection. For example, the clerk may help the person leave the movie theater or the like. As a result, it becomes possible to prevent the person from interrupting screening.
Although the methods for estimating a person's physical condition other than those according to the first and second embodiments have been described, the methods used are not limited to these examples. A person's emotion may be estimated using methods other than that according to the second embodiment. Such methods will be described hereinafter while taking examples.
A level of irritation of a person, for example, may be estimated (detected) as the person's emotion.
The level of irritation can be estimated from a person's facial expression or blood flow volume. This is because it is known that a person's facial expression reflects irritation. This is also because it is known that when a person is irritated, a sympathetic nervous system becomes active and peripheral blood flow decreases. Here, the level of irritation of a person may be estimated from both the person's facial expression and blood flow volume or either the person's facial expression or the person's blood flow volume.
If the level of irritation of a person is estimated and the person is driving, the sound of an engine of the person's automobile may be output inside the automobile to make the person feel that the automobile is running faster than an actual speed. As a result, it becomes possible to prevent the person from driving too fast. Needless to say, if irritation of the person is estimated, the sensitivity of an accelerator of the automobile may be reduced to prevent a sudden start or the sensitivity of brakes of the automobile may be reduced to prevent a sudden stop, instead.
A level of sleepiness of a person, for example, may be estimated (detected) as the person's emotion.
This is because it is known that a person's facial expression reflects sleepiness. This is also because it is known that when a person is sleepy, a parasympathetic nervous system becomes active and a heartrate becomes irregular, peripheral blood flow increases and the temperature of the peripheral skin increases, and blood pressure decreases due to expansion of blood vessels. It is also known that when a respiratory rate decreases, oxygen concentration decreases, and a person becomes sleepy.
The level of sleepiness of a person may thus be estimated from the person's facial expression, heartrate, respiration, blood pressure, blood flow volume, or skin temperature.
Here, the level of sleepiness of a person may be estimated from one, some, or all of the person's facial expression, heartrate, respiration, blood pressure, blood flow volume, and skin temperature.
Alternatively, a combination of these pieces of information with which estimation accuracy becomes highest may be learned, and a different combination may be used for each person.
This is because some persons' facial expression clearly reflects sleepiness whereas other person's facial expression hardly reflects sleepiness. When a person's facial expression clearly reflects sleepiness, the person's facial expression may be used to estimate the level of sleepiness. By detecting the level of sleepiness while combination the person's facial expression with another physiological value, needless to say, the level of sleepiness can be accurately estimated. A combination used may be changed for each level of sleepiness to be detected. In addition, some persons' blood pressure significantly decreases when the persons begin to become sleepy, whereas other persons' blood pressure does not. When a person fails into the former case, blood pressure may be used to estimate the level of sleepiness at an early timing.
These are examples, and another physiological index may be used to estimate the level of sleepiness as necessary, in this case, the level of sleepiness can be accurately estimated. The same holds when a high level of sleepiness is estimated. Any physiological index may be used. As a result, an optimal physiological index can be learned and used in accordance with the level of sleepiness to be detected, thereby achieving accurate estimation of the level of sleepiness.
If it is detected (estimated) that a person is sleepy and the person is driving, the vehicle may be ventilated to increase oxygen concentration inside the vehicle. In doing so, the level of sleepiness of the person can be reduced. Alternatively, the person's sense of speed may be increased and an arousal level of the person may be increased by opening a partition between an engine room and the drivers seat to let the sound of an engine be heard by the person. Furthermore, the arousal level of the person may be increased by changing the rigidness of a suspension of the vehicle and transmitting vibration to the person.
A method for detecting each physiological value will be described hereinafter.
The heartrate can be detected by detecting slight variation in the skin color of a face whose image has been captured by a camera. This is because especially a green component of the skin color of the face varies depending on the heartrate.
Alternatively, the heartrate may be detected by detecting variation in the temperature of a temperature range corresponding to the skin of the face whose image has been captured by a thermal camera. This is because the temperature of the face whose image has been captured by the thermal camera varies depending on the heartrate and the heartrate can be detected by detecting variation in the temperature of the temperature range corresponding to the skin.
Alternatively, infrared light may be radiated onto an ear robe, a finger, or the lice and the heartrate may be detected from variation in reflected infrared light. Alternatively, vibration caused by heartbeats may be detected using a sheet sensor or the like, and the heartrate may be detected from a waveform of the heartbeats. Any other method may be used.
The blood pressure can be obtained from a pulse wave propagation time. The pulse wave propagation time is a time taken for blood in the heart to reach a certain peripheral part.
When blood pressure drops, the pulse wave propagation time increases, and when blood pressure rises, the pulse wave propagation time decreases. The pulse wave propagation time can be obtained from a difference between a time of a peak of a pulse wave obtained from an image of the face captured by a camera and a time of a peak of the pulse wave obtained from an image of a body part other than the face (the neck, a hand, or the like). The pulse wave propagation time may be obtained from a difference between times of peaks of a pulse wave at two facial parts (e.g., the jaw and the forehead), instead of the face and a body pert other than the face.
Alternatively, the vibration of the heart may be obtained from a milliwave sensor or the like, and a pulse wave in the face may be detected from slight variation in the color of an image of the face captured by a camera. The pulse wave propagation time may then obtained from a difference between a peak of the vibration of the heart and a peak of the pulse wave in the face, and the blood pressure may be obtained by estimating variation in the blood pressure.
A skin moisture level can be measured by radiating near-infrared light having an absorption wavelength of water (960 nm) onto the skin and detecting the amount of returning light. This is because when the skin moisture level is high, the radiated near infrared light is absorbed and the amount of returning light decreases.
A water content level (skin moisture level) may be estimated from the hardness of the skin by radiating ultrasonic waves or air and detecting variation at the time using a milliwave sensor or the like. This is because it is known that the skin hardens when the skin moisture level decreases.
A blood sugar level can be obtained by radiating infrared light onto an eyeball and detecting the amount of returning light. This is because the spectrum of a part of the eyeball (aqueous humor) includes an absorption wavelength of sugar (around 1,650 nm), and the amount of returning light decreases when the blood sugar level is high.
The blood sugar level may be estimated from optical rotation of the part of the eyeball (aqueous humor). This is because the optical rotation increases as the blood sugar level becomes higher. Any other method may be used to estimate the blood sugar level.
A constituent of exhaled air can be detected on the basis of the amount of absorption at an absorption wavelength of the constituent to be detected (e.g., around 225 nm in the case of nitric oxide).
A constituent of exhaled air can be detected by radiating light having an absorption wavelength of the constituent and detecting the amount of light that has passed through the exhaled air. A spectrum may be detected, needless to say, using chromatography. Any other method may be used.
Respiration can be detected by, in a camera image, radiating infrared light having a rectangular pattern onto a subject and detecting a wavelength of the respiration from variation in the pattern.
The respiration may be detected using visible light instead of infrared light, and the pattern to be radiated need not be a rectangular pattern. A milliwave may be radiated, and the respiration may be detected from a Doppler shift in a reflected wave, instead. Alternatively, the respiration may be detected using a time-of-flight (TOF) sensor.
It is known that the temperature of the portion under the nostrils decreases during inhalation and increases during exhalation. A waveform of respiration, therefore, may be detected from variation in the temperature of the portion under the nostrils using a thermal image.
The present disclosure can be applied to a method for estimating a physical condition, a physical condition estimation apparatus, and a program that estimate a person's physical condition. The present disclosure can be applied especially to a method for estimating a physical condition, a physical condition estimation apparatus, and a recording medium storing a program that is incorporated into devices in vehicles, offices, and living spaces and device applications that control such devices.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2016-101969 | May 2016 | JP | national |
This is a continuation application of U.S. patent application Ser. No. 15/350,161, filed Nov. 14, 2016, which claims the benefit of U.S. Provisional Pat. Appl. No. 62/261,457, filed Dec. 1, 2015, and priority to Japanese Pat. Appl. No. 2016-101969, filed May 20, 2016. The disclosure of each of the above-identified applications is herein incorporated by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5309916 | Hatschek | May 1994 | A |
| 20050278093 | Kameyama | Dec 2005 | A1 |
| 20070213877 | Hart | Sep 2007 | A1 |
| 20140046192 | Mullin | Feb 2014 | A1 |
| 20140313309 | Matsuo | Oct 2014 | A1 |
| 20150204556 | Kusukame et al. | Jul 2015 | A1 |
| 20150233598 | Shikii et al. | Aug 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 2002-272708 | Sep 2002 | JP |
| 2007-050144 | Mar 2007 | JP |
| 2008-186263 | Aug 2008 | JP |
| 2008-284165 | Nov 2008 | JP |
| 2009-153609 | Jul 2009 | JP |
| 2011-167398 | Sep 2011 | JP |
| 2013-085895 | May 2013 | JP |
| 2013-085896 | May 2013 | JP |
| 2015-164844 | Sep 2015 | JP |
| 2015-178953 | Oct 2015 | JP |
| 10-2013-0010207 | Jan 2013 | KR |
| 2014054293 | Apr 2014 | WO |
| Entry |
|---|
| The Extended European Search Report dated Apr. 5, 2017 for the related European Patent Application No. 16198407.5. |
| John Allen et al: “Microvascular imaging: techniques and opportunities for clinical physiological measurements”, Physiological Measurement, Institute of Physics Publishing, Bristol, GB, vol. 35, No. 7, Jun. 9, 2014 (Jun. 9, 2014), XP020267006. |
| Yuhei Ikeda, et al., “Estimate Emotion Method to Use Facial Expressions and Biological Information”, Proceedings of Multimedia, Distributed, Cooperative, and Mobile Symposium 2016 (DICOMO 2016), Japan, published on Jul. 6, 2016, 2016, p. 149-161, together with a partial English translation thereof. |
| Hiroyasu Sakamoto, et al., “A Method for Measuring Comfortableness/Uncomfortableness of Human by Analyzing Facial Images”, IPSJ SIG Notes, CVIM, Japan, published on Sep. 6, 2006, 2006, 93, p. 135-142, together with a partial English translation thereof. |
| Communication pursuant to Article 94(3) EPC dated Sep. 28, 2020 for the related European Patent Application No. 16198407.5. |
| Tsiamyrtzis P et al: “Imaging Facial Physiology for the Detection of Deceit”, International Journal of Computer Vision, Kluwer Academic Publishers, BO, vol. 71, No. 2, Jun. 1, 2006 (Jun. 1, 2006), pp. 197-214, XP019410113. |
| Number | Date | Country | |
|---|---|---|---|
| 20210369212 A1 | Dec 2021 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62261457 | Dec 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15350161 | Nov 2016 | US |
| Child | 17402083 | US |
