Patent Grant
10891362
This disclosure generally relates to a wearable device and, more particularly, to a wearable device and a controlling method thereof capable of detecting a contact status with a skin surface.
Wearable devices, such as smart watches, are getting more and more popular. Wearable devices can provide various convenient functions, such as schedule management, emails, heartbeat measurement, and mobile payment. Some functions require authentication before execution because the wearable device must ensure the current user is the owner of the wearable device in order to protect the privacy or the interest of the owner.
However, authentication before execution is not secure enough in some scenarios. For example, an owner of a wearable device passes the authentication, and then the owner controls the wearable device to execute an important function such as schedule management, and then something unusual distracts the owner from the function, and then the owner puts down the wearable device and walks away. In this case, since the wearable device is still in the authenticated state, another user can pick up the wearable device and look at the owner's private schedule, even temper with the owner's private schedule.
The present disclosure is related to a wearable device and a skin sensor that can make some important functions more secure after user authentication.
The present disclosure provides a wearable device including a skin sensor and a processor. The processor is configured to receive an authentication data for authenticating a user when a wearing state of the wearable device determined according to a detecting result of the skin sensor is adjacent to a skin surface of the user, execute a predetermined function in response to a request when the authentication data matches a pre-stored data and the wearing state of the wearable device is determined not leaving the skin surface after the authentication data is received, and reject or ignore the request when the wearing state of the wearable device is determined being leaving the skin surface before the predetermined function is finished.
The present disclosure provides a wearable device including a photoplethysmography (PPG) sensor and a processor. The PPG sensor is configured to detect a PPG signal. The processor is configured to receive an authentication data for authenticating the user when the wearable device is determined to be in contact with the skin surface according to the PPG signal, execute a predetermined function for the user in response to a request when the authentication data matches a pre-stored data and the wearable device is determined to be still in contact with the skin surface according to the PPG signal, and reject or ignore the request when the wearable device is determined to be no longer in contact with the skin surface according to the PPG signal after the authentication data is received and before the predetermined function is finished.
The present disclosure provides a skin sensor equipped on a side of a wearable device configured to be attached to a skin surface of a user. The skin sensor includes a plurality of sub-sensors and a processor. Each sub-sensor is configured to configured to use a different sensing method to detect the skin surface and output a notification signal. The processor is coupled to the sub-sensors, and configured to determine whether the wearable device leaves the skin surface by checking whether each notification signal from the sub-sensors is received or not.
Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. The separate embodiments in the present disclosure below may be combined together to achieve superimposed functions.
The skin sensor 110 is equipped on a side (e.g., back side) of the wearable device 100 close to a skin surface of a user when the wearable device 100 is worn on the user. The skin sensor 110 is configured to detect the skin surface and further in some cases to detect whether the wearable device 100 leaves the skin surface of the user. The input device 140 is configured to receive user input for the wearable device 100. The output device 150 is configured to output data and/or information to the user and is also configured to display graphical user interfaces of the operating system and the applications of the wearable device 100. The wireless communication device 160 is configured to transmit and receive data and signals between the wearable device 100 and external electronic devices through wireless communication. The wireless communication device 160 uses low power wireless technology, such as Near Field Communication (NFC) technology, Bluetooth technology, Wi-Fi technology, wireless local area network (WLAN) technology, or cellular network technology for transmitting and receiving data and signals. The processor 130 is the main processor, the microcontroller unit (MCU) or the central processing unit (CPU) of the wearable device 100. The processor 130 is configured to control or cooperate with the skin sensor 110, the input device 140, the output device 150, and the wireless communication device 160 to execute various functions and applications of the wearable device 100.
At step 302, the skin sensor 110 determines a wearing state of the wearable device 100 according to (e.g., collecting and comparing) at least one of the detecting results of the sub-sensors of the skin sensor 110. The wearing state of the wearable device 100 is either “adjacent or attached to the skin surface of the user” or “not adjacent or attached to the skin surface of the user”. The correspondence between the wearing state and the detecting result of each sub-sensor is described below.
The capacitive sensor 210 includes at least one electrode 213. The at least one electrode 213 is selected to be positioned on an external surface of the housing of the wearable device 100. Alternatively, the at least one electrode 213 is selected to be exposed outside the external surface of the housing of the wearable device 100. Alternatively, the at least one electrode 213 is selected to be embedded in the housing of the wearable device 100 or positioned in an internal space enclosed by the housing of the wearable device 100. The capacitive sensor 210 measures the capacitance value of the at least one electrode 213 and outputs a corresponding capacitance value as the detecting result of the capacitive sensor 210. The capacitance value output by the capacitive sensor 210 is the capacitance value of the at least one electrode 213, or a voltage value or a length of charging/discharging time indicating the capacitance value of the at least one electrode 213. Since the skin of the user is an electrical conductor, approaching or leaving the skin surface of the user results in a distortion of the electrostatic field generated by the at least one electrode 213, and the capacitance value of the at least one electrode 213 changes according to the distortion of the electrostatic field. Therefore, the skin sensor 110 can determine the wearing state of the wearable device 100 according to the capacitance value output by the capacitive sensor 210.
In an embodiment, the capacitance value output by the capacitive sensor 210 increases when the wearable device 100 approaches the skin surface of the user and the capacitance value output by the capacitive sensor 210 decreases when the wearable device 100 leaves the skin surface of the user. The capacitance value output by the capacitive sensor 210 indicates that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when the capacitance value is higher than or increases more than a threshold value, while the capacitance value output by the capacitive sensor 210 indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user when the capacitance value is lower than or decreases more than the threshold value.
In another embodiment, the capacitance value output by the capacitive sensor 210 decreases when the wearable device 100 approaches the skin surface of the user and the capacitance value output by the capacitive sensor 210 increases when the wearable device 100 leaves the skin surface of the user. The capacitance value output by the capacitive sensor 210 indicates that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when the capacitance value is lower than or decreases more than a threshold value, while the capacitance value output by the capacitive sensor 210 indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user when the capacitance value is higher than or increases more than the threshold value.
The threshold value can be a constant value or a variable value adapted to real-time detection. For example, the threshold value can be calculated by adding a predetermined value to or subtracting a predetermined value from a previous capacitance value output by the capacitive sensor 210.
The inductive sensor 220 includes a transmitter (TX) coil 223 and a receiver (RX) coil 225. The inductive sensor 220 is configured to provide a current to the transmitter coil 223. When the inductive sensor 220 is energized, an electromagnetic field is formed between the TX coil 223 and the RX coil 225. A metal object moving relative to the inductive sensor 220 disrupts the electromagnetic field and changes an induced current on the RX coil 225. The inductive sensor 220 is configured to detect and output a magnitude variation of the induced current in the RX coil 225 as the detecting result of the inductive sensor 220. When the magnitude variation exceeds (becomes higher or lower than) a threshold value, then a metal object is identified as leaving or approaching the wearable device 100. The metal object affects detecting results of both the capacitive sensor 210 and the inductive sensor 220.
The inductive sensor 220 can detect a metal object but cannot detect the skin surface of the user. However, since a metal object is also an electrical conductor, the inductive sensor 220 can cooperate with the capacitive sensor 210 to differentiate between a metal object and the skin surface of the user so that the detection of the skin sensor 110 is not misled by the metal object. For example, when the detecting results of both the capacitive sensor 210 and the inductive sensor 220 indicate that an electrical conductor is adjacent to the wearable device 100, the skin sensor 110 is able to know that the wearable device 100 is adjacent to a metal object instead of the skin surface of the user, and therefore the skin sensor 110 can determine that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user.
The optical sensor 230 includes a light source 233 and a light sensor 235. The light source 233 is configured to emit light of a single dominant wavelength or a plurality of different dominant wavelengths. For example, in an embodiment, the light source 233 emits visible light and infrared light. The light sensor 235 is configured to detect the intensity of the light emitted by the light source 233 and then reflected by or penetrated through an external object, such as the skin surface of the user. The aforementioned detecting result output by the optical sensor 230 is the light intensity detected by the light sensor 235.
In an embodiment, the light intensity of the light source 233 is higher than the light intensity of the ambient environment. Therefore, the light intensity output by the optical sensor 230 increases when the wearable device 100 approaches the skin surface of the user and the light intensity output by the optical sensor 230 decreases when the wearable device 100 leaves the skin surface of the user.
In another embodiment, the light intensity of the light source 233 is lower than the light intensity of the ambient environment, or the optical sensor 230 does not include the light source 233. Therefore, the light intensity output by the optical sensor 230 decreases when the wearable device 100 approaches the skin surface of the user and the light intensity output by the optical sensor 230 increases when the wearable device 100 leaves the skin surface of the user.
The skin sensor 110 can determine the wearing state of the wearable device 100 by comparing the light intensity or a variation thereof output by the optical sensor 230 with a threshold value. The comparing and the threshold value are similar to those of the capacitive sensor 210.
The PPG sensor 240 includes a light source 243 and a light sensor 245. The light source 243 is configured to emit light of a single dominant wavelength or a plurality of different dominant wavelengths to illuminate the skin of the user. For example, in an embodiment, the light source 243 emits visible light and infrared light. The light sensor 245 is configured to measure the absorption of the light by the skin of the user to detect blood volume changes in capillaries in the skin of the user caused by the blood pulse of each cardiac cycle of the user. Based on the blood volume changes, the PPG sensor 240 is configured to detect a PPG signal including information representing at least one of the heart rate, heartbeats, and cardiac cycles of the user. The aforementioned detecting result output by the PPG sensor 240 is the PPG signal.
In an embodiment, the PPG signal indicates that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when the PPG signal includes the heartbeat waveform of at least one complete cardiac cycle of the user, while the PPG signal indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user when the PPG signal does not include any heartbeat waveform of the user. This is a slower method for determining the wearing state of the wearable device 100 because the PPG sensor 240 needs approximately one second to output the heartbeat waveform of one complete cardiac cycle.
It is also possible to determine the wearing state of the wearable device 100 by calculating a signal-to-noise ratio or comparing amplitudes of the PPG signal with a threshold value. In an exemplary embodiment, the PPG signal indicates that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when a signal-to-noise ratio or an amplitude of the PPG signal is higher than or becomes higher than a threshold value, while the PPG signal indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user when the signal-to-noise ratio or the amplitude of the PPG signal is lower than or becomes lower than the threshold value. This is also a slower method for determining the wearing state of the wearable device 100 because the signal-to-noise ratio and the amplitude need the heartbeat waveform of at least one complete cardiac cycle to calculate.
It is also possible to determine the wearing state of the wearable device 100 by comparing signal values or magnitudes of the PPG signal with a threshold value. In an exemplary embodiment, the PPG signal indicates that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when a signal value or a magnitude of the PPG signal is higher than or becomes higher than a threshold value, while the PPG signal indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface of the user when the signal value or the magnitude of the PPG signal is lower than or becomes lower than the threshold value. This is a much faster method for determining the wearing state of the wearable device 100 because the skin sensor 110 only needs to obtain an instant signal value or an instant magnitude of the PPG signal to determine the wearing state.
In one non-limiting embodiment, the optical sensor 230 is replaced by the PPG sensor 240. That is, the wearable device 100 does not include the optical sensor 230, and the PPG sensor 240 detects and outputs both the light intensity and the PPG signal mentioned above as the detecting result.
In an embodiment, the output device 150 includes a display configured to display the information of the PPG signal so that the user can view at least one of his/her heart rate, heartbeats and cardiac cycles as well as whether the wearable device 100 is adjacent to or leaving from the skin surface of the user indicated by each of the sub-sensors. In addition, the wireless communication device 160 is configured to transmit the PPG signal to an external electronic device for display, analysis, processing, or storage.
The temperature sensor 250 includes a thermocouple or a resistance temperature detector configured to detect and output a temperature value corresponding to the temperature of the skin surface of the user as the detecting result of the temperature sensor 250. The temperature value indicates that the wearing state of the wearable device 100 is adjacent to the skin surface when the difference value between the temperature value and a pre-stored skin temperature is smaller than or becomes smaller than a threshold value, while the temperature value indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface when the difference value between the temperature value and the pre-stored skin temperature is larger than or becomes larger than the threshold value. In another aspect, when a detected temperature value is larger than a predetermined threshold value, it means that the wearable device 100 is in an adjacent state (adjacent to the skin surface of the user); otherwise, the wearable device 100 is in a non-adjacent state (not adjacent to the skin surface of the user).
In an embodiment, the skin sensor 110 includes only one sub-sensor, or the skin sensor 110 is replaced by the only one sub-sensor. For example, the only one sub-sensor is the capacitive sensor 210, the optical sensor 230, the PPG sensor 240, or the temperature sensor 250. The skin sensor 110 is configured to determine the wearing state of the wearable device 100 according to the detecting result output by the only one sub-sensor.
In another embodiment, the skin sensor 110 includes a plurality of sub-sensors. For example, each sub-sensor is the capacitive sensor 210, the inductive sensor 220, the optical sensor 230, the PPG sensor 240, or the temperature sensor 250. The skin sensor 110 is configured to determine that the wearing state of the wearable device 100 is adjacent to the skin surface of the user when all of the detecting results of the sub-sensors indicate that the wearing state of the wearable device 100 is adjacent to the skin surface. The skin sensor 110 is further configured to determine that the wearing state of the wearable device 100 is not adjacent to the skin surface when at least one or a predetermined number of the detecting results of the sub-sensors indicates that the wearing state of the wearable device 100 is not adjacent to the skin surface.
Each single sub-sensor can be affected by interferences in the ambient environment. For example, the capacitive sensor 210 and the inductive sensor 220 can be affected by electrical conductors nearby. The optical sensor 230 and the PPG sensor 240 can be affected by external light sources and ambient brightness. The temperature sensor 250 can be affected by ambient temperatures. Multiple sub-sensors in the skin sensor 110 can make the detection of the skin sensor 110 more reliable by covering each other's weakness.
In another embodiment, the skin sensor 110 does not determine the wearing state of the wearable device 100. Instead, the skin sensor 110 transmits the detecting results of the sub-sensors to the processor 130, and the processor 130 determines the wearing state of the wearable device 100 according to the detecting results in the same way as the skin sensor 110 determines the wearing state in the previous embodiments.
In one non-limiting embodiment, the PPG sensor 240 is not included in the skin sensor 110. Instead, the PPG sensor 240 is a part of the wearable device 100 outside the skin sensor 110. The detection rate of the skin sensor 110 is faster than the detection rate of the PPG sensor 240. The skin sensor 110 does not determine the wearing state of the wearable device 100. Instead, the PPG sensor 240 determines the wearing state of the wearable device 100 according to the PPG signal. More specifically, the PPG sensor 240 determines whether the wearable device 100 is worn on the user (step 302) with a slower (compared with the skin sensor 110) detecting rate; whereas, the skin sensor 110 determines whether the wearable device 100 leaves (step 308) from the skin surface, after the adjacent state is confirmed, with a higher (compared with the PPG sensor 240) detecting rate.
In another embodiment, the PPG sensor 240 is a part of the wearable device 100 outside the skin sensor 110. The wearing state of the wearable device 100 is not determined by the skin sensor 110 or the PPG sensor 240. Instead, the PPG sensor 240 transmits the PPG signal to the processor 130, and the processor 130 determines the wearing state of the wearable device 100 according to the PPG signal in the same way as the PPG sensor 240 determines the wearing state in the previous embodiment.
The flow in
Next, at step 304, the processor 130 controls the input device 140 of the wearable device 100 to receive an authentication data generated by operations and/or physiological characteristics of the user. The authentication data is for user authentication before executing the predetermined function of the wearable device 100. The predetermined function is an important function exclusive to the owner of the wearable device 100. Therefore, user authentication is necessary to ensure that the current user is the owner of the wearable device 100. For example, the predetermined function is mobile payment, accessing restricted data, or performing restricted electronic transmission with an external electronic device.
For example, the input device 140 includes a keypad, a keyboard, or a touch panel for the user to input a password and the authentication data includes the password.
For example, the input device 140 includes a touch panel. The user can move a finger or a stylus on the touch panel to input a sliding track. The authentication data includes the sliding track.
For example, the input device 140 includes a camera. The user can perform at least one gesture with a part of his/her body (such as a palm or a hand) or his/her entire body. The camera is configured to take at least one image of the at least one gesture. The authentication data includes the at least one image of the at least one gesture. Alternatively, the input device 140 can extract image features from the at least one image of the at least one gesture and the authentication data includes the image features.
For example, the input device 140 includes a biometric sensor or a camera for obtaining a biometric data of the user based on physiological characteristics of the user, such as voiceprint, fingerprint, palm print, palm veins pattern, hand geometry, iris pattern, retina pattern, and/or facial geometry. The authentication data includes the biometric data.
For example, the input device 140 includes at least one of the aforementioned keypad, keyboard, touch panel, camera, and biometric sensor, and the authentication data includes at least one of the aforementioned password, sliding track, image of gesture, image features of image of gesture, and biometric data.
Next, at step 306, the processor 130 performs the aforementioned user authentication by determining whether the authentication data matches with a pre-stored data. The pre-stored data is associated with the identity of the owner of the wearable device 100. For example, the pre-stored data is a password or a digital signature set by the owner or a biometric data based on physiological characteristics of the owner. When the authentication data does not match with the pre-stored data, the user authentication fails and the flow returns to step 302. When the authentication data matches with the pre-stored data, the user passes the authentication successfully and the flow proceeds to step 308.
In an embodiment, the pre-stored data is stored in the wearable device 100. The processor 130 compares the authentication data with the pre-stored data and determines whether the authentication data matches with the pre-stored data according to the result of the comparison.
In another embodiment, the pre-stored data is stored in an external electronic device. The processor 130 obtains the pre-stored data from the external electronic device through the wireless communication device 160, compares the authentication data with the pre-stored data, and determines whether the authentication data matches with the pre-stored data according to the result of the comparison.
In another embodiment, the pre-stored data is stored in an external electronic device. The processor 130 transmits the authentication data to the external electronic device through the wireless communication device 160. The external electronic device compares the authentication data with the pre-stored data and transmits the result of the comparison to the wearable device 100. The processor 130 determines whether the authentication data matches with the pre-stored data according to the result of the comparison.
At step 308, the skin sensor 110 determines whether the wearable device 100 leaves the skin surface of the user regularly or before the predetermined function is executed. The skin sensor 110 can determine a current wearing state of the wearable device 100 according to the current detecting result output by at least one of the sub-sensors of the skin sensor 110. When the current detecting result includes the PPG signal output by the PPG sensor 240, the skin sensor 110 determines the current wearing state according to the signal value or the magnitude of the PPG signal instead of complete cardiac cycles in the PPG signal because the leaving of the wearable device 100 from the skin surface must be detected as soon as possible for security reasons (more details later). When the skin sensor 110 determines that the current wearing state is still adjacent to the skin surface (since step 302), that means the wearable device 100 does not leave the skin surface. When the skin sensor 110 determines that the current wearing state is no longer adjacent to the skin surface, that means the wearing state changes from adjacent to the skin surface (at step 302) to not adjacent to the skin surface (at step 308). In response, the skin sensor 110 determines that the wearable device 100 leaves the skin surface.
In another embodiment, when the detecting result output by a sub-sensor of the skin sensor 110 indicates that the wearing state of the wearable device 100 is still adjacent to the skin surface (since step 302), the detecting result of that sub-sensor indicates that the wearable device 100 does not leave the skin surface. When the detecting result output by a sub-sensor of the skin sensor 110 indicates that the wearing state of the wearable device 100 is no longer adjacent to the skin surface, the detecting result of that sub-sensor indicates that the wearable device 100 leaves the skin surface. The skin sensor 110 is configured to determine that the wearable device 100 does not leave the skin surface when all of the detecting results of the sub-sensors indicate that the wearable device 100 does not leave the skin surface. The skin sensor 110 is further configured to determine that the wearable device 100 leaves the skin surface when at least one of the detecting results of the sub-sensors indicates that the wearable device 100 leaves the skin surface or when at least two of the detecting results of the sub-sensors cannot indicate whether or not the wearable device 100 leaves the skin surface.
In a non-limiting embodiment, the sub-sensors in the skin sensor 110 can be classified into a main sub-sensor and one or more auxiliary sub-sensors. The skin sensor 110 can determine whether the wearable device 100 leaves the skin surface according to the detecting results output by the main sub-sensor and at least one auxiliary sub-sensor. The skin sensor 110 checks the detecting result of the main sub-sensor first and then check the detecting results of the auxiliary sub-sensors. For example, the capacitive sensor 210 is the main sub-sensor and the other sub-sensors are the auxiliary sub-sensors. The skin sensor 110 can check the detecting results of all of the sub-sensors one by one according to a preset order.
When the skin sensor 110 determines that the wearable device 100 leaves the skin surface, the skin sensor 110 sets a notification to notify the processor 130 that the wearable device 100 leaves the skin surface. In an embodiment, the skin sensor 110 includes a register 260 readable by the processor 130. The skin sensor 110 sets the notification by changing the value stored in the register 260 from a first value to a second value. The processor 130 can keep reading the value stored in the register 260 to know whether the wearable device 100 leaves the skin surface of the user. When the value read from the register 260 is the first value, that means the wearable device 100 does not leave the skin surface of the user. When the value read from the register 260 is the second value, that means the wearable device 100 leaves the skin surface of the user.
When the wearable device 100 leaves the skin surface and then approaches the skin surface between steps 302 and 308, the skin sensor 110 does not change the value stored in the register 260 back to the first value. Instead, the skin sensor 110 keeps the second value in the register 260 to ignore the approaching of the wearable device 100 to the skin surface after the leaving from the skin surface so that the wearable device 100 will be determined to leave the skin surface at step 308.
In another embodiment, the register 260 is not implemented. The skin sensor 110 sets the notification by transmitting a notification signal to the processor 130. The processor 130 can know whether the wearable device 100 leaves the skin surface of the user by checking the notification signal. When the processor 130 does not receive the notification signal, that means the wearable device 100 does not leave the skin surface of the user. When the processor 130 receives the notification signal, that means the wearable device 100 leaves the skin surface of the user.
When the wearable device 100 leaves the skin surface and then approaches the skin surface between steps 302 and 308, the skin sensor 110 does not withdraw the notification signal, thus the skin sensor 110 ignores the approaching of the wearable device 100 to the skin surface after the leaving from the skin surface so that the wearable device 100 will be determined to leave the skin surface at step 308.
In another embodiment, the skin sensor 110 does not determine whether the wearable device 100 leaves the skin surface. Instead, the skin sensor 110 transmits the detecting results of the sub-sensors to the processor 130, and the processor 130 determines whether the wearable device 100 leaves the skin surface according to the detecting results in the same way as the skin sensor 110 determines whether the wearable device 100 leaves the skin surface in the previous embodiments. When the wearable device 100 leaves the skin surface and then approaches the skin surface between steps 302 and 308, the processor 130 ignores the approaching of the wearable device 100 to the skin surface after the leaving from the skin surface. In other words, the processor 130 still considers the wearable device 100 as away from the skin surface and the wearable device 100 will be determined to leave the skin surface at step 308.
When the skin sensor 110 or the processor 130 determines that the wearable device 100 leaves the skin surface at step 308, that means the wearable device 100 is taken off from the user and the situation is no longer secure to execute the predetermined function. In response, the flow returns to step 302. When the skin sensor 110 or the processor 130 determines that the wearable device 100 does not leave the skin surface at step 308, that means the user still wears the wearable device 100 and the situation is secure to execute the predetermined function. The flow proceeds to step 310.
At step 310, the processor 130 checks whether a request for executing a predetermined function of the wearable device 100 is generated. The request can be generated by an external electronic device, such as an NFC terminal for mobile payment, and the wearable device 100 can receive the request through the wireless communication device 160. Alternatively, the request can be generated by the user through a command or an operation on the wearable device 100. When the request is not generated, the flow returns to step 308. When the request is generated, the processor 130 receives the request in step 310, and then the processor 130 executes the predetermined function in response to the request at step 312. The processor 130 rejects or ignores the request when the skin sensor 110 or the processor 130 determines that the wearable device 100 leaves the skin surface after the authentication data is received and before the predetermined function is executed.
For example, the predetermined function is mobile payment. The request is generated by an NFC terminal participating in the mobile payment. When the wearable device 100 approaches the NFC terminal, the wearable device 100 receives the request. In response to the request, the wearable device 100 cooperates with the NFC terminal to execute the mobile payment.
In an embodiment, the skin sensor 110 or the processor 130 determines whether the wearable device 100 leaves the skin surface at a fixed detection period (at a fixed detection frequency) during steps 304 to 312. In another embodiment, in addition to the determination at the fixed detection period, there is an additional determination of whether the wearable device 100 leaves the skin surface performed within the fixed detection period right before the execution of the predetermined function at step 312. This additional determination can be inserted between steps 310 and 312 in
In an embodiment, during the executing of the predetermined function at step 312, the processor 130 continuously checks whether the wearable device 100 leaves the skin surface of the user. As mentioned above, the skin sensor 110 or the processor 130 can determine whether the wearable device 100 leaves the skin surface according to the detecting results of the sub-sensors in the skin sensor 110. When it is the skin sensor 110 that determines whether the wearable device 100 leaves the skin surface, the skin sensor 110 notifies the processor 130 when the wearable device 100 leaves the skin surface. Therefore, the processor 130 can respond quickly to the leaving from the skin surface. When the skin sensor 110 or the processor 130 determines that the wearable device 100 leaves the skin surface during the executing of the predetermined function at step 312, the processor 130 aborts the predetermined function at step 314 by interrupting the execution of the predetermined function immediately regardless of the state and the progress of the execution of the predetermined function. After step 314, the flow returns to step 302.
The flow of the method in
Therefore, the processor 130 executes the predetermined function only in a secure state wherein the user successfully passes the authentication and the user keeps wearing the wearable device 100. The sub-sensors in the skin sensor 110 can detect whether the wearable device 100 leaves the skin surface at a high frequency (for example, in a range from 1 KHz to 10 KHz) so that the processor 130 can reject the request or abort the predetermined function immediately after the wearable device 100 is taken off from the authenticated user and an unauthenticated user cannot continue the execution of the predetermined function under the identity of the authenticated user.
In an embodiment, the output device 150 includes a display configured to display user interfaces. The output device 150 displays a first user interface when steps 304 and 306 corresponding to the user authentication are executed and displays a second user interface when step 312 corresponding to the predetermined function is executed. At step 314, the processor 130 aborts the predetermined function by interrupting the execution of the predetermined function immediately and switching the output device 150 from displaying the second user interface to displaying the first user interface or another different user interface. In other words, the predetermined function becomes inaccessible and all information displayed by the predetermined function disappears from the display of the output device 150 after the wearable device 100 is taken off from the authenticated user. In this way, the wearable device 100 can reliably protect the predetermined function and the information associated with the predetermined function from being used or viewed by an unauthenticated user.
For example, the predetermined function is mobile payment. The user passes the authentication, and then the user generates the request for the mobile payment through a command or an operation on the wearable device 100, and then the output device 150 displays a user interface for the mobile payment at step 312. The user interface displays a quick response code (QR code) representing the user so that a seller can scan the QR code to receive the payment from the user. When the wearable device 100 is taken off from the authenticated user before the seller scans the QR code, at step 314 the processor 130 aborts the mobile payment by interrupting the mobile payment immediately and switching the output device 150 to display another interface so that an unauthenticated user cannot continue the payment and cannot see or scan the QR code of the authenticated user.
For another example, the predetermined function is accessing restricted data, such as reading a message, an email, or an important document of the owner of the wearable device 100. The user passes the authentication, and then the user generates the request for accessing restricted data through a command or an operation on the wearable device 100, and then the output device 150 displays a user interface for displaying the message, the email, or the document at step 312. When the wearable device 100 is taken off from the authenticated user, at step 314 the processor 130 aborts the data access by immediately switching the output device 150 to display another interface so that an unauthenticated user cannot see the restricted data.
For another example, the predetermined function is performing restricted electronic transmission, such as performing a data access transaction with an external database. The user passes the authentication, and then the user generates the request for the data access transaction through a command or an operation on the wearable device 100, and then the output device 150 displays a user interface for accessing the data in the external database at step 312. When the wearable device 100 is taken off from the authenticated user, at step 314 the processor 130 aborts the data access transaction by rolling back the data access transaction and terminating the electronic connection between the wearable device 100 and the external database. The rolling back means restoring all data modified in the data access transaction to their original values before the data access transaction. In addition, the processor 130 switches the output device 150 to display another interface so that an unauthenticated user cannot see the data in the external database.
In an alternative embodiment, the term “the wearing state of the wearable device 100 is adjacent to the skin surface of the user” can be replaced by the term “the wearable device 100 is adjacent to the skin surface of the user”, and the term “the wearing state of the wearable device 100 is not adjacent to the skin surface of the user” can be replaced by the term “the wearable device 100 is not adjacent to the skin surface of the user”.
As mentioned above, the skin sensor 110, the PPG sensor 240 or the processor 130 can determine whether the wearing state of the wearable device 100 is adjacent to the skin surface of the user according to the detecting results output by the stand-alone PPG sensor 240 or the sub-sensors in the skin sensor 110. The term “adjacent to” means the wearable device 100 is within a preset distance, such as one millimeter or two millimeters, from the skin surface. In another embodiment, the preset distance can be zero, which means the skin sensor 110, the PPG sensor 240 or the processor 130 is configured to determine whether the wearable device 100 is attached to or in contact with the skin surface of the user. Therefore, the term “adjacent to” in the previous embodiments can be replaced with the term “attached to” or the term “in contact with”, and the term “not adjacent to” in the previous embodiments can be replaced with the term “not attached to”, the term “not in contact with” or the term “leave”.
In brief, the wearable device detects an attached status with a user to determine whether the wearable device is properly worn by a user to improve confidence of the detected result. Many technologies can be applied to perform this function. Such as by using a pressure sensor to detect the tension of a belt for fixing the wearable device on the user's body, or to detect the pressure on the user's skin when the wearable device is wear tightly. Or, by using a capacitive sensor to detect the proximity between the wearable device and the user's skin, the attached status is confirmable. Or, by using a humidity sensor to detect the slight sweat between the wearable device and user's skin, the attached status is confirmable. Or, by using a thermal sensor to detect the temperature change between the wearable device and user's skin, the attached status is confirmable.
In order to determine whether the attached status is good or not, a processor of the wearable device, e.g., a digital processing unit (DSP) or an application specific integrated circuit (ASIC), compares the detected result (e.g., including pressure, capacitance change, humidity or temperature) of the above sensors with a predetermined threshold, which is previously determined corresponding to a type of sensor. When a variation of the detected result exceeds the predetermined threshold, the attached status is determined to have a change between an attached state and a lift up state.
In other aspects, the wearable device confirms the attached status by analyzing intensity of light passing through different polarizers and detected by a detection module, by analyzing intensity of different light wavelengths detected by the detection module, by analyzing intensity distribution of an image frame detected by the detection module, and by calculating a time-of-flight according to signals (e.g., avalanche current) detected by a single photon avalanche photodiode (SPAD).
When the user removes the wearable device from his/her body, the wearable device can then detect the status change, and stops generating a confirmed signal if a lift up state is confirmed. The confirmed signal is to indicate a correct user ID being authenticated.
In the above embodiments, the wearable device is arranged to identify a user ID according to the biometric characteristic of the user. In an alternatively embodiment, the wearable device is arranged to identify the user ID according to a user input which includes a password, a gesture, knocks and/or a speech sentence. That is, the biometric characteristic being detected by the wearable device is replaced by the user input.
In an aspect that uses the password as a user input, the wearable device includes a keyboard or a touch panel to receive a set of password inputted by a current user. The wearable device then compares the inputted password with a set of pre-stored password to confirm the user ID of the current user. The pre-stored password is preferably set or selected by the same user in a setting procedure and stored in a memory of the wearable device.
In an aspect that uses the gesture as a user input, the wearable device includes a touch panel or an optical gesture detector to detect a gesture inputted by a current user, e.g., using his or her finger(s). For the touch panel, the current user draws the gesture on the touch panel; whereas for the optical gesture detector, the user draws the gesture (e.g., moving finger) in the space in front of the optical gesture detector. The wearable device then compares the inputted gesture with a pre-stored gesture to confirm the user ID of the current user. The pre-stored gesture is preferably set or performed by the same user in a setting procedure and stored in a memory of the wearable device.
In an aspect that uses the knocks as a user input, the wearable device includes a gyro or a 2D or 3D acceleration sensor to detect knocking signals inputted by a current user. The wearable device then compares the inputted knocking signals with pre-stored knocking signals to confirm the user ID of the current user. The pre-stored knocking signals have a predetermined pattern. As long as the inputted knocking signals have a same pattern with the predetermined pattern, the wearable device confirms the user ID. The pre-stored knocking signals (or predetermined pattern) is preferably inputted or performed by the same user in a setting procedure and stored in a memory of the wearable device.
In an aspect that uses the speech sentence as a user input, the wearable device includes a microphone to receive a speech sentence said by a current user. The wearable device then compares the said speech sentence (including numbers and/or words) with a pre-stored speech sentence to confirm the user ID of the current user. The pre-stored speech sentence is preferably inputted or recorded by the same user in a setting procedure and stored in a memory of the wearable device. That is, the wearable device has the language processing function to process the speech sentence inputted via the microphone and identifies whether the inputted speech sentence matches a predetermined speech sentence, like an audio password, to identify the user ID.
In another embodiment, the continuously detected heartbeat is expanded to include continuously detected attached status. The attached status is detected by detecting at least one of a heartbeat, capacitance using a capacitive sensor, light intensity using an optical sensor, a temperature using a thermal sensor, sweat using a humidity sensor. More specifically, the heartbeat being continuously detected is used as one example to refer that the wearable accessary is continuously being worn by a user. Other methods for confirming the wearable accessary being continuously worn may be used. The change of the attached status from contact to non-contact is detectable by detecting a value change of the above parameters, including with/without heartbeat, capacitance variation, light intensity variation, capacitance variation, temperature variation, humidity variation or the like. The parameter variation is compared with a predetermined parameter to confirm the change of attached status.
Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed.
| Number | Date | Country | Kind |
|---|---|---|---|
| 103123544 A | Jul 2014 | TW | national |
The present application is a continuation application of U.S. patent application Ser. No. 16/563,931 filed on, Sep. 9, 2019, which is a continuation-in-part application of U.S. patent application Ser. No. 16/519,197 filed on, Jul. 23, 2019, which is a continuation-in-part application of U.S. patent application Ser. No. 16/360,605 filed on, Mar. 21, 2019, which is a continuation-in-part application of U.S. patent application Ser. No. 16/117,334 filed on, Aug. 30, 2018, which is a continuation-in-part application of U.S. patent application Ser. No. 15/964,718 filed on, Apr. 27, 2018, which is a continuation-in-part application of U.S. patent application Ser. No. 15/722,435 filed on, Oct. 2, 2017, which is a continuation-in-part application of U.S. patent application Ser. No. 15/343,509 filed on, Nov. 4, 2016, which is a continuation-in-part application of U.S. patent application Ser. No. 14/684,648 filed on, Apr. 13, 2015, and claims priority to Taiwanese Application Number 103123544, filed Jul. 8, 2014, the disclosures of which are hereby incorporated by reference herein in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 10698996 | Gu | Jun 2020 | B2 |
| 20160154952 | Venkatraman | Jun 2016 | A1 |
| 20180374564 | Kusuma et al. | Dec 2018 | A1 |
| 20190150854 | Chung | May 2019 | A1 |
| 20190332141 | Guo | Oct 2019 | A1 |
| Entry |
|---|
| U.S. Appl. No. 16/878,225, Office Action dated Oct. 5, 2020. |
| Number | Date | Country | |
|---|---|---|---|
| 20200242226 A1 | Jul 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16563931 | Sep 2019 | US |
| Child | 16850753 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16519197 | Jul 2019 | US |
| Child | 16563931 | US | |
| Parent | 16360605 | Mar 2019 | US |
| Child | 16519197 | US | |
| Parent | 16117334 | Aug 2018 | US |
| Child | 16360605 | US | |
| Parent | 15964718 | Apr 2018 | US |
| Child | 16117334 | US | |
| Parent | 15722435 | Oct 2017 | US |
| Child | 15964718 | US | |
| Parent | 15343509 | Nov 2016 | US |
| Child | 15722435 | US | |
| Parent | 14684648 | Apr 2015 | US |
| Child | 15343509 | US |
