The embodiment disclosed herein generally relates to an electronic device, a method, and a computer program product.
Electronic devices such as a wearable device in a form of a wristband include a terminal that detects, by use of an accelerometer, body movement amount of a user who wears the wearable device, and performs sleep analysis by use of the detected amount of body movement to acquire first information relating to the body, for example, in which sleep stages, wakefulness, light sleep, or deep sleep, the body is. When determining that the body is in a light sleep stage, the wearable device can execute a first operation, such as an alarm function that causes rumbling to wake the user up, that may cause disturbance to the first information.
However, the rumbling of the alarm function affects the detection result of the accelerometer in some cases, thereby lowering the accuracy of the sleep analysis performed by the wearable device.
A general architecture that implements the various features of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate an embodiment of the invention and not to limit the scope of the invention.
In general, according to an embodiment, an electronic device includes an indicator, a sensor, and circuitry. The indicator is configured to notify a user by using at least one of a sound and vibration. The sensor is configured to detect first information regarding a body of a user, the first information possibly subject to disturbance during notifying by the indicator. The circuitry is configured to replace the first information during notifying by the indicator with second information different from the first information.
The following describes a body information acquisition system employing the electronic device, a method, and a computer program product according to the present embodiment with reference to the accompanying drawings.
The wearable device 1 (an example of the electronic device) includes a housing 10 that can be worn by a user on a part of the user's body. The wearable device 1 includes a display screen 11 configured with, for example, a liquid crystal display (LCD) or an organic electro luminescence (EL) display, and configured to display various kinds of information such as time. The wearable device 1 transmits, to the host device 2, various kinds of information such as body information of the user, operation history of the user, alarm information, and time required for the user to wake up.
The body information is information relating to the body of a user who wears the wearable device 1, and is an example of first information that may be subject to disturbance while alarm to be described later is being executed. The body information includes, for example, data on acceleration (hereinafter referred to as acceleration data) detected by an accelerometer 12 provided in the housing 10, an amount of body movement of the user acquired on the basis of the acceleration data, results of sleep analysis based on the amount of body movement, and results of analysis on activity information (for example, the number of steps the user has taken, the user is walking, at rest, moving by bicycle, or moving by train) based on the amount of body movement. The results of the sleep analysis include sleep time at which the user fell asleep, wake time at which the user woke up, an amount of sleep time from the time at which the user fell asleep to the time at which the user woke up, light-sleep time that is the sum of amounts of time of light sleep, and deep-sleep time that is the sum of amounts of time of deep sleep.
The alarm information is information relating to alarm that is an operation for notifying the user and is an example of the first operation causing disturbance to the body information, and the alarm information is such as alarm set time (an example of a certain first timing) at which alarm (in the present embodiment, vibration and sound, that is, rumbling) is executed, a target number of steps (another example of the certain first timing) set in advance at which the alarm is executed, and setting or cancelation of the alarm. The time required for the user to wake up is information relating to a time period from the time at which the alarm is executed to the time at which the wearable device 1 acquires wakefulness as the sleep stage on the basis of the body information.
The wearable device 1 receives, from the host device 2, various kinds of information such as display information displayed on the display screen 11, notification information (for example, the arrival of a mail, a phone call, and an emergency call at the host device 2) to the user who wears the wearable device 1, advice information relating to advice for the user obtained from the analysis of the body information.
The host device 2 is configured with a smartphone or a tablet device, and receives various kinds of information such as the body information, the operation history, the alarm information, and the time required for the user to wake up from the wearable device 1. The host device 2 transmits various kinds of information such as the body information, the operation history, the alarm information, and the time required for the user to wake up received from the wearable device 1 to the server 3. The host device 2 receives various kinds of information such as the display information, the notification information, and the advice information from the server 3. The host device 2 transmits various kinds of information such as the display information, the notification information, and the advice information received from the server 3 to the wearable device 1.
The server 3 includes a storage module 31 that can store various kinds of information received from the host device 2. The storage module 31 includes a healthcare database 310 that can store such as the body information, the operation history, the alarm information, and the time required for the user to wake up received from the host device 2.
Described next is a functional configuration of the wearable device 1 according to the present embodiment with reference to
As illustrated in
The accelerometer 12 is provided in the housing 10 and is configured to detect (acquire), as an example of the body information, acceleration data of the housing 10 worn by the user. The accelerometer 12 is an example of the sensor that may be subject to disturbance affecting the acceleration data while the alarm is being executed. The body movement amount calculation module 15 is configured to calculate (acquire) an amount of body movement of the user as an example of the body information on the basis of the acceleration data detected by the accelerometer 12. The body movement amount calculation module 15 is an example of the sensor that may be subject to disturbance affecting the amount of body movement while the alarm is being executed.
The analysis module 17 acquires the body information on the basis of the amount of body movement calculated by the body movement amount calculation module 15 or the acceleration data detected by the accelerometer 12. In the present embodiment, the analysis module 17 includes a sleep analysis module 171 and an activity analysis module 172. The sleep analysis module 171 is configured to acquire information relating to sleep stages of the user as an example of the body information on the basis of the amount of body movement calculated by the body movement amount calculation module 15. The sleep analysis module 171 is an example of the sensor that may be subject to disturbance affecting the sleep stages while the alarm is being executed. In the present embodiment, the sleep analysis module 171 acquires a sleep stage of the user (wakefulness, light sleep, or deep sleep) on the basis of an amount of body movement calculated by the body movement amount calculation module 15. The activity analysis module 172 is configured to estimate (acquire) activity information of the user (for example, the number of steps the user has taken, the user is walking, at rest, moving by bicycle, or moving by train) as an example of the body information on the basis of the acceleration data detected by the accelerometer 12. The activity analysis module 172 is an example of the sensor that may be subject to disturbance affecting the activity information while the alarm is being executed.
The vibrator 13 is an example of the indicator configured to execute the alarm (vibration) as the first operation for notifying the user. In the present embodiment, the vibrator 13 can execute the alarm causing disturbance that may affect the body information (in the present embodiment, acceleration data, an amount of body movement, the sleep stages, and the activity information) at the first timing such as the alarm set time set by the alarm setting module 19 to be described later, and a timing at which the number of steps acquired by the activity analysis module 172 reaches the target number of steps. The vibrator 13 can also execute the alarm (vibration) when the wearable device 1 receives the notification information from the host device 2. The speaker 700 is an example of the indicator configured to execute the alarm (output of sound) as the first operation for notifying the user. The speaker 700 can execute the alarm (output of sound) causing disturbance that may affect the body information (in the present embodiment, acceleration data, an amount of body movement, the sleep stages, and the activity information) at the first timing such as the alarm set time set by the alarm setting module 19 to be described later, and a timing at which the number of steps acquired by the activity analysis module 172 reaches the target number of steps. The speaker 700 can also execute the alarm (output of sound) when the wearable device 1 receives the notification information from the host device 2. The button 14 can execute vibration on a user's operation as an example of the first operation.
The analysis controller 16 controls acquisition of body information by the analysis module 17. In the present embodiment, the analysis controller 16 is an example of the processor that replaces the sleep stage acquired by the sleep analysis module 171 when the vibrator 13 and the speaker 700 is executing the alarm with a certain sleep stage (in the present embodiment, light sleep) that is an example of the second information different from the acquired sleep stage. This configuration can prevent disturbance caused by the vibrator 13 and the speaker 700 from being included in the sleep stages acquired by the sleep analysis module 171, thereby improving accuracy of the sleep stages acquired by the sleep analysis module 171. This configuration can also prevent disturbance from being included in the sleep stages acquired by the sleep analysis module 171 even when the vibrator 13 and the speaker 700 are disposed near the accelerometer 12 in the housing 10. Accordingly, the accelerometer 12, the vibrator 13, and the speaker 700 can be disposed more freely. The configuration described above does not require processing for eliminating disturbance from the sleep stages acquired by the sleep analysis module 171, the acceleration data detected by the accelerometer 12, or the amount of body movement calculated by the body movement amount calculation module 15, so that energy consumption of the wearable device 1 is reduced and the battery can supply power for a longer time.
The alarm setting module 19 sets the alarm set time and the target number of steps in accordance with a user's operation on the button 14 or the alarm information received from the host device 2 via the communication module 21 to be described later. The alarm controller 18 causes the vibrator 13 and the speaker 700 to execute the alarm at the first timing such as the alarm set time or a timing at which the number of steps acquired by the activity analysis module 172 reaches the target number of steps. In the present embodiment, when the sleep analysis module 171 is acquiring the sleep stages of the user, the first timing is the earlier timing of the two timings, the alarm set time set by the alarm setting module 19 and a timing at which the sleep analysis module 171 acquires light sleep as the sleep stage of the user for the first time in a certain time period prior to the alarm set time. Although, in the present embodiment, the alarm controller 18 causes the vibrator 13 to execute vibration and the speaker 700 to execute output of sound as the alarm, the embodiment is not limited to this. For example, the alarm controller 18 may cause the vibrator 13 to execute vibration, or the speaker 700 to execute output of sound as the alarm.
The acquisition module 20 is an example of the processor that acquires, as time information required for the user to wake up, information relating to a time period from the execution of alarm by the vibrator 13 to a timing at which the sleep analysis module 171 acquires wakefulness as the sleep stage of the user. The acquisition module 20 outputs the acquired time information to the host device 2 via the communication module 21.
The communication module 21 transmits various kinds of information such as the body information, the operation history, the alarm information, and the time required for the user to wake up to the host device 2. The communication module 21 receives various kinds of information such as the display information, the notification information, the advice information, and the alarm information from the host device 2.
The host device 2 includes a display screen 200 that can display various kinds of information such as the body information, the operation history, the alarm information, and the time required for the user to wake up that are received from the wearable device 1. With this configuration, the host device 2 can show the user how much time was required to wake up, thereby helping the user recognize the user's current lifestyle to improve it.
Next, described in detail is the acquisition processing for acquiring the body information by the wearable device 1 according to the present embodiment with reference to
When the wearable device 1 is powered on, the analysis controller 16 causes the accelerometer 12 to start detecting acceleration data. The body movement amount calculation module 15 calculates the magnitude of acceleration on the basis of the acceleration data detected by the accelerometer 12 (S301). In the present embodiment, when the accelerometer 12 is a three-axis accelerometer, the body movement amount calculation module 15 calculates magnitude of acceleration Acc_Norm[n] by use of an expression (1) below on the basis of x-axis acceleration data x[n], y-axis acceleration data y[n], and z-axis acceleration data z[n].
Acc_Norm[n]=√{square root over (x[n]2+y[n]2+z[n]2)} (1)
The body movement amount calculation module 15 also calculates time variation of the calculated magnitude of acceleration (S302). In the present embodiment, the body movement amount calculation module 15 calculates diff_Acc_Norm[n] representing the time variation of the magnitude of acceleration by use of an expression (2) below.
diff_Acc_Norm[n]=Acc_Norm[n]−1.0 (2)
The body movement amount calculation module 15 performs filtering processing for removing noise (for example, time variation of the magnitude of acceleration of the housing 10 caused by external force other than body movement) contained in the calculated time variation of the magnitude of acceleration (S303). The body movement amount calculation module 15 calculates, on the basis of the calculated time variation of the magnitude of acceleration, the number of times the time variation of the magnitude of acceleration exceeds a certain threshold per unit time (for example, one minute) as an amount of body movement of the user (S304). The certain threshold is the lower limit of the magnitude of acceleration determined as a body movement of the user.
After the body movement amount calculation module 15 calculates an amount of body movement, the analysis controller 16 controls the activity analysis module 172 to start acquiring activity information that is an example of the body information. As illustrated in
The analysis controller 16 calculates a range S[f] of the amount of body movement in each sleep stage used for determining the sleep stage on the basis of the calculation history of amounts of body movement calculated by the body movement amount calculation module 15 by use of a sleep estimation determination algorithm such as the Cole's algorithm represented by an expression (3) below or an AW2 algorithm represented by an expression (4) below (S305).
In the present embodiment, the analysis controller 16 calculates a range of a first body movement amount by which the user is determined to be awake, a range of a second body movement amount by which the user is determined to be in a stage of light sleep and that is smaller than the first body movement amount, and a range of a third body movement amount by which the user is determined to be in a stage of deep sleep and that is smaller than the second body movement amount.
When the user operates the button 14 to input going to sleep, the sleep analysis module 171 detects that the user has fallen asleep. Alternatively, as illustrated in
When the user operates the button 14 to input a first setting (in the present embodiment, bed time at which the user presses and holds the button 14 when the sleep analysis module 171 is not acquiring the sleep stages) indicating acquisition of the sleep stages that are an example of the body information, the sleep analysis module 171 detects that the user has fallen asleep on the basis of the timing at which the bed time is input. As illustrated in
In the present embodiment, when the user does not input the bed time, the sleep analysis module 171 does not acquire the sleep stages of the user even when the sleep analysis module 171 detects that the user has fallen asleep.
As illustrated in
While the vibrator 13 and the speaker 700 are executing the alarm, the alarm controller 18 displays, on the display screen 11, the display information relating to the reason why the alarm is being executed. Specifically, the alarm controller 18 displays the display information indicating, for example, that the first timing has come, or that the notification information such as incoming call or emergency call is received from the host device 2.
When the alarm is being executed because the first timing has come, the alarm controller 18 can control the vibrator 13 and the speaker 700 to execute a snooze function that repeats the alarm certain times or for a certain time period set in advance as illustrated in
When the vibrator 13 and the speaker 700 are executing the alarm, the acceleration data detected by the accelerometer 12 contains disturbance caused by the alarm executed by the vibrator 13 and the speaker 700. Thus, as illustrated in
In the present embodiment, the analysis controller 16 replaces the sleep stage acquired by the sleep analysis module 171 while the vibrator 13 and the speaker 700 are executing the alarm with a certain sleep stage (for example, light sleep) (S308). When an amount of body movement is acquired as an example of the body information, the analysis controller 16 replaces the amount of body movement calculated by the body movement amount calculation module 15 while the vibrator 13 and the speaker 700 are executing the alarm with a certain amount of body movement that is an example of a certain second information different from the calculated amount of body movement. The certain amount of body movement described above is an amount of body movement calculated by the body movement amount calculation module 15 a first certain amount of time before the execution of the alarm by the vibrator 13 and the speaker 700.
When acceleration data is acquired as an example of the body information, the analysis controller 16 replaces the acceleration data detected by the accelerometer 12 while the vibrator 13 and the speaker 700 are executing the alarm with certain acceleration data that is an example of the certain second information different from the detected acceleration data. The certain acceleration data described above is acceleration data detected by the accelerometer 12 the first certain amount of time before the execution of the alarm by the vibrator 13 and the speaker 700.
After stopping (canceling) the alarm executed by the vibrator 13 and the speaker 700 depending on indication input from the button 14, when the acquired sleep stage is not wakefulness yet, the analysis controller 16 makes the sleep analysis module 171 continue to acquire the sleep stages until the sleep analysis module 171 acquires wakefulness. The acquisition module 20 acquires information relating to the time from the execution of the alarm by the vibrator 13 and the speaker 700 (that is, the first timing) to the time at which the sleep analysis module 171 acquires wakefulness as the sleep stage of the user as time information required for the user to wake up.
The communication module 21 transmits body information including the acceleration data detected by the accelerometer 12, the amount of body movement calculated by the body movement amount calculation module 15, and results of the sleep analysis to the host device 2 (S309). The results of the sleep analysis include the bed time, the sleep stage per unit time acquired by the sleep analysis module 171, the timing at which the alarm was executed (that is, the first timing), the sleep time at which the sleep analysis module 171 detected that the user had fallen asleep after the bed time was input, the wake time at which the user pressed and held the button 14 after the sleep analysis module 171 started acquiring the sleep stages, the sleep time that is the sum of an amount of time during which light sleep was acquired and an amount of time during which deep sleep was acquired, light-sleep time in which the sleep analysis module 171 acquired light sleep, deep-sleep time in which the sleep analysis module 171 acquired deep sleep, and the time information required for the user to wake up.
The host device 2 transmits the results of the sleep analysis received from the communication module 21 to the server 3. The server 3 analyzes the results of the sleep analysis received from the host device 2 and transmits results of the analysis back to the host device 2. The host device 2 displays the results of the analysis received from the server 3 on the display screen 200.
Described next is a display example of the results of the analysis displayed on the host device 2 with reference to
In the present embodiment, as illustrated in
Alternatively, in the present embodiment, as illustrated in
As illustrated in
The wearable device 1 according to the present embodiment can prevent disturbance caused by the alarm executed by the vibrator 13 and the speaker 700 from being included in the sleep stages acquired by the sleep analysis module 171, thereby improving accuracy of the sleep stages acquired by the wearable device 1.
Although, in the above description, the wearable device 1 according to the present embodiment replaces the body information (acceleration data, an amount of body movement, sleep stages, activity information) acquired by the accelerometer 12, the body movement amount calculation module 15, and the analysis module 17 with a certain second information, the wearable device 1 can replace other types of body information with a certain second information.
As illustrated in
Meanwhile, as illustrated in
Although, in the present embodiment, when the first setting (in the present embodiment, the bed time) indicating the acquisition of the sleep stages that are an example of the body information is not input through the button 14, the analysis controller 16 causes the sleep analysis module 171 not to acquire the sleep stages of the user, the embodiment is not limited to this.
When the number of steps based on the acceleration data detected by the accelerometer 12 is acquired as an example of the body information, the analysis controller 16 causes the activity analysis module 172 to start acquiring the number of steps on the basis of a timing at which the user inputs the first setting indicating the acquisition of the number of steps that is an example of the body information through the button 14. As illustrated in
Although, in the present embodiment, the analysis controller 16 replaces the acceleration data detected by the accelerometer 12 while the alarm is being executed by the vibrator 13 with certain acceleration data different from the detected acceleration data, the embodiment is not limited to this. The analysis controller 16 may perform, for example, processing (what is called noise cancelling processing) for eliminating, from the acceleration data detected by the accelerometer 12 while the alarm is being executed by the vibrator 13, the disturbance caused by the alarm.
The analysis controller 16 does not necessarily perform the noise cancelling processing on all the acceleration data detected by the accelerometer 12 while the user is sleeping or walking. The analysis controller 16 may start the noise cancelling processing on the acceleration data detected by the accelerometer 12 the second certain amount of time before the alarm set time illustrated in
Moreover, the various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.
While a certain embodiment has been described, the embodiment has been presented by way of example only, and is not intended to limit the scope of the invention. Indeed, the novel embodiment described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions, and changes in the form of the embodiment described herein may be made without departing from the spirit of the invention. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the invention.
This application claims the benefit of U.S. Provisional Patent Application No. 62/013,151, filed Jun. 17, 2014, the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
62013151 | Jun 2014 | US |