The embodiments herein relate to a wearable ring-shaped electronic device and methods of the electronic ring-shaped device. A corresponding computer program and a computer program carrier are also disclosed.
Today's smartwatches have a touchscreen and typically one or multiple buttons. Interaction with the watch is either done by using fingers from the other hand, voice control, or some gesture-based simplistic control such as showing display content when the hand holding the watch is raised towards the user.
A problem with the typical user interfaces (UIs) for smart watches is that they typically require both hands to be involved. Exceptions are very basic gestures, such as raising the arm to light up the touchscreen, and voice control. The latter being difficult to use in many circumstances and limited in usefulness for many applications.
There are many situations where the second arm or hand, i.e., not the arm of the watch, is busy and cannot be used. This may be when carrying a bag, controlling equipment, or because of other inabilities to use both arms such as injury and/or disability.
Other electronic devices, such as TVs and computers may be remotely controlled by ring-shaped electronic devices with built-in sensors such as inertial measurement units, (IMU). For example, some ring devices are used to make gesture input to other devices such as computers or smartphones. The controlled device may then in turn have a large display and a content being shown on the display, e.g., presentations or games, may be controlled by gestures from the finger or hand carrying the ring.
The ring devices typically use wireless connectivity such as Bluetooth to communicate with the remote device they control.
The ring devices based on IMU's being capable of detecting certain gestures typically work better when the complete hand can be moved, which is the case when you control an external screen or device but not the case when controlling a watch being carried by the same arm that should be as still as possible when looking at it. This severely limits the usability of such ring devices to control smart watches.
Furthermore, there is a substantially higher risk for false positives when a gesture should be detected by an IMU or accelerometer in the ring device if only the relative movement of the finger vs. the arm is significant, and the arm must be relatively still but is still subject to some movements due to the user's action e.g., walking, running, sailing, etc.
Another proposed way of controlling a remote device with a ring device is by integrating a touchpad with the ring device. These ring devices are proposed to be used as an input device to the remote device.
A problem with existing electronic ring-shaped devices that have in-built touchpads is that they are very clumsy to wear, in that they have a big surface that acts like a touch pad of a laptop but in a smaller shape. The ring becomes difficult to make good-looking and might be awkward to use.
An object of embodiments herein may be to obviate some of the problems related to controlling wearable electronic devices, or at least reduce the impact of them.
According to an aspect, the object is achieved by method, performed by a wearable electronic ring-shaped device. The electronic ring-shaped device comprises a plurality of outer touch sensitive areas arranged on an outer face of the electronic ring-shaped device.
The method comprises sensing a touch pattern of the electronic ring-shaped device with at least a first outer touch sensitive area of the plurality of outer touch sensitive areas.
The method further comprises activating the electronic ring-shaped device to sense a gesture with one or more of the plurality of outer touch sensitive areas in response to sensing the touch pattern.
According to a further aspect, the object is achieved by a wearable electronic ring-shaped device. The wearable electronic ring-shaped device comprises a plurality of outer touch sensitive areas arranged on an outer face of the electronic ring-shaped device. The electronic ring-shaped device is configured to:
According to a further aspect, the object is achieved by a computer program comprising instructions, which when executed by a processor, causes the processor to perform actions according to any of the aspects above.
According to a further aspect, the object is achieved by a carrier comprising the computer program of the aspect above, wherein the carrier is one of an electronic signal, an optical signal, an electromagnetic signal, a magnetic signal, an electric signal, a radio signal, a microwave signal, or a computer-readable storage medium.
Since the electronic ring-shaped device activates the electronic ring-shaped device to sense the gesture with the one or more of the plurality of outer touch sensitive areas in response to sensing the touch pattern the electronic ring-shaped device saves power and minimises false positives.
A further advantage of embodiments herein is that they are compatible with one-handed operation of the electronic ring-shaped device and also with one-handed operation of a further wearable electronic device which the electronic ring-shaped device may control.
A further advantage of embodiments herein is that the touch sensitive areas may be implemented as capacitive touch sensitive areas which have a fairly low complexity and enable a small size overhead yet enable a usage which has a sufficient number of distinguishable gestures for a rich user interface and is robust in its opportunities to minimize the number of false positives. For example, limitations to finger movements relative the movement of the hand are reduced.
In the figures, features that appear in some embodiments are indicated by dashed lines.
The various aspects of embodiments disclosed herein, including particular features and advantages thereof, will be readily understood from the following detailed description and the accompanying drawings, in which:
As mentioned above, an object of embodiments herein is to provide a robust solution for one-handed operation of a wearable electronic device such as a smart watch.
Embodiments herein relate to wearable electronic devices.
The wearable electronic device 110 may be any of a smart watch, a mobile phone, a headset, electronic clothing and an electronic eyewear or any combination of the smart watch, the mobile phone, the headset, electronic clothing and the electronic eyewear. The wearable electronic device 110 may also be an electronic wrist band or an electronic fitness band.
In
In some embodiments herein the wearable electronic device 110 comprises a motion sensor 114, such as an inertial measurement unit. The motion sensor 114 may provide data about the motion of the wearable electronic device 110.
The wearable electronic device 110 may further comprise one or more physical buttons which are not illustrated in
As mentioned above, it may be of importance in some scenarios to be able to operate the wearable electronic device 110 with one hand, specifically the hand which the wearable electronic device 110 is attached to. Therefore, embodiments herein may be implemented in a wearable electronic ring-shaped device 120 which may be configured to control the wearable electronic ring-shaped device 120 as well as the wearable electronic device 110.
The outer face 210 may be an outer face of the mechanical structure 200. The plurality of outer touch sensitive areas 201-208 may also be referred to as touch sensors, such as capacitive touch sensors. An object interacting with a capacitive touch sensor influences a capacitance of the touch sensor. The influence may be measured for example by measuring the capacitance of the capacitive touch sensor or other related parameters.
As illustrated in
As illustrated in
Since a scenario in which embodiments herein may be implemented is that the wearable device 110 is arranged on a same limb as the electronic ring-shaped device 120 the communication power may be kept low. For example, the communication may be done through a body area network, e.g., with in-body communication (IBC), or a low-power radio, such as Bluetooth Low Energy (BLE). IBC may also be referred to as human-body communication (HBC).
Further, any wiring comprised in the electronic ring-shaped device 120 and needed for the operation of the electronic ring-shaped device 120 may be isolated from any other wiring and from other metal parts of the electronic ring-shaped device 120. A dielectric material may provide the isolation.
In other embodiments the ring-shaped mechanical structure 200 is made from a non-conductive material, such as plastic.
The activating circuit 242 may be configured to sense a touch pattern with the touch sensitive area 201-208 and based on the sensed touch pattern activate or trigger the electronic ring-shaped device 120 to sense one or more gestures with the outer touch sensitive area 201-208. The sensed gestures may be used to control another electronic device such as the wearable electronic device 110. For example, the activating circuit 242 may activate a touch circuit 244 electrically connected to each outer touch sensitive area 201-208 and configured to sense the gesture, such as a gesture to control the wearable electronic device 110.
In other words, the activating circuit 242 may trigger the touch circuit 244 if a specific triggering touch pattern has been sensed.
In some embodiments herein sensing the touch pattern which activates the gesture sensing is based on a resistance measurement between two outer touch sensitive areas, such as between the first outer touch sensitive area 201 and the second outer touch sensitive area 202 and/or between the first outer touch sensitive area 201 and the fifth outer touch sensitive area 205, out of the plurality of outer touch sensitive areas 201-208. The resistance measurement may be made between more than two outer touch sensitive areas 201, 202 out of the plurality of outer touch sensitive areas 201-208. This will be explained in more detail below when describing action 301.
As mentioned above, the electronic ring-shaped device 120 may further comprise the touch circuit 244 electrically connected to each outer touch sensitive area 201-208 and configured to sense the gesture when activated e.g., by the activating circuit 242. The touch circuit 244 may be implemented as a touch IC. The touch circuit 244 reads sensor data and interprets the sensor data from the touch sensitive area 201-208 in order to determine a gesture based on the sensor data. For example, the touch circuit 244 may sense the gesture by detecting changes in a measure related to a capacitance of a respective one of the plurality of outer touch sensitive areas 201-208. In other words, a capacitive touch IC may be used to be able to sense different combinations of capacitive changes and interpret them so that different gestures on the ring may be determined.
The touch circuit 244 may further control power of the touch sensitive area 201-208.
The touch circuit 244 may be electrically connected to the activating circuit 242 such that it can be activated by the activating circuit 242.
In some embodiments herein the touch circuit 244 comprises the activating circuit 242. Thus, the activating circuit 242 may be a low power feature of the touch circuit 244.
In some embodiments herein the electronic ring-shaped device 120 further comprises an interface communication unit (IF CU) 246. The IF CU 246 may be a hardware component that gets the gesture data from the touch circuit 244 and communicates the gesture data, e.g., through the communication electrode 224, to other devices, such as the wearable electronic device 110, worn by the user.
The communication technology used by the IF CU 246 may be any communication technology. However as mentioned above, in the scenario where the electronic ring-shaped device 120 controls the wearable device 110 which is in proximity of the electronic ring-shaped device 120 then the communication may be done through IBC or low-power radio in order to reduce the power consumption. For example, the IF CU 246 may be connected with a radio antenna 248, comprised in the electronic ring-shaped device 120, which communicate wirelessly with other radio antennas.
The electronic components of the electronic ring-shaped device 120 may operate based on electrical power from a battery comprised in the electronic ring-shaped device 120. The electronic ring-shaped device 120 may further include electrical wires to electrically connect the electrical components of the electronic ring-shaped device 120 for power transfer and communication. In some other embodiments the electrical power and/or the communication is implemented wirelessly.
The wearable device 110 may further comprise a communication electrode 264, such as an ICE, for communication with the electronic ring-shaped device 120. The communication electrode 264 may be arranged on a face of the wearable device 110 that is arranged for touching the skin of the user. For example, the communication electrode 264 may be arranged on the backside of the wearable device 110.
The wearable device 110 may be implemented with the same communication technology as the electronic ring-shaped device 120. Thus, the IF CU 256 and the communication electrode 264 may also use IBC. In some other embodiments the IF CU 256 use low-power radio, such as BLE. For example, the IF CU 256 may be connected with a radio antenna 274, comprised in the wearable electronic device 110, which communicate wirelessly with other radio antennas, such as the radio antenna 248 of the electronic ring-shaped device 120.
Embodiments herein will now be described in relation to a scenario where the electronic ring-shaped device 120 is configured to control the wearable device 110 by sensing touch and gestures with the touch sensitive areas 201-208. The electronic ring-shaped device 120 is configured to trigger gesture sensing, such as touch-gesture sensing, with the electronic ring-shaped device 120. The sensed gestures may be communicated to the wearable device 110 and the wearable device 110 may use the sensed gesture to control itself, e.g., to control the GUI presented on the display 115 of the wearable device 110. Triggering of the gesture sensing by a pre-determined touch pattern reduces the risk of unwillingly controlling the wearable device 110.
Such a system also provides a power efficient interface to control a smart watch 110 or a smart band 110 with the ring-shaped device 120, e.g., by use of capacitive sensing.
In embodiments herein the control of the wearable device 110 at least partly by the ring-shaped device 120 may also be referred to as a ring UI mode.
Exemplifying embodiments herein will now be described with reference to
One or more of the following actions presented in
The ring-shaped device 120 senses a touch pattern of the electronic ring-shaped device 120 with at least the first outer touch sensitive area 201 of the plurality of outer touch sensitive areas 201-208 arranged on the outer face 210 of the electronic ring-shaped device 120. In some embodiments herein, the ring-shaped device 120 senses the touch pattern of the electronic ring-shaped device 120 with at least two outer touch sensitive areas, such as the first outer touch sensitive area 201 and the second outer touch sensitive area 202, of the plurality of outer touch sensitive areas 201-208 arranged on the outer face 210 of the electronic ring-shaped device 120. Sensing the touch pattern may also be referred to as detecting the touch pattern or determining the touch pattern or determining whether or not the touch pattern has been applied to at least the first outer touch sensitive area 201.
Since the electronic ring-shaped device 120 may rotate freely around the finger there may be more than one configuration of the touch pattern that triggers the gesture sensing depending on the ring design.
Thus, in
Thus, in
In some embodiments herein the electronic ring-shaped device 120 keeps track of a respective signal from the outer touch sensitive areas 201-208 and will not trigger activation of gesture sensing if similar signals from the outer touch sensitive areas 201-208 are received from the two sides of the ring.
Once the electronic ring-shaped device 120 senses a third touch in proximity to either side of the outer touch sensitive areas 201-208 that already sense a touch, the electronic ring-shaped device 120 will trigger the electronic ring-shaped device 120 to sense gestures with the outer touch sensitive areas 201-208.
For example, if the activating circuit 242 senses a third touch in proximity to either side of the outer touch sensitive areas 201-208 that already sense a touch the activating circuit 244 will trigger the touch circuit 244 to wake up.
This method enables the electronic ring-shaped device 120 to be worn in any rotation as the third finger 273 may identify how the electronic ring-shaped device 120 is rotated. For example, if it is assumed that the third finger 273 is the thumb on the same hand then the knowledge of an anatomy of the hand and which finger the electronic ring-shaped device 120 is worn on may be used to identify how the electronic ring-shaped device 120 is rotated.
Once the ring orientation is found the outer touch sensitive areas 201-208 on the top of the electronic ring-shaped device 120 may be de-activated since the electronic ring-shaped device 120 may expect a touch from the inside of the palm of the hand on which the electronic ring-shaped device 120 is arranged on. The bottom of the electronic ring-shaped device 120 may be defined as a half part of the electronic ring-shaped device 120 which is closer to the palm than the other half part. The top of the ring may thus be defined as a half part of the electronic ring-shaped device 120 which is furthest away from the palm than the other half part.
The embodiments described in relation to
Based on the above example scenarios further embodiments may be defined according to the following text.
In some embodiments herein the touch pattern comprises at least two simultaneous separate touches. That is, the touch pattern may comprise a respective touch on at least two touch sensitive areas 201, 202. The two touches may be due to touch by two fingers, e.g., a first touch with the first adjacent finger 271 and a second touch with the third finger 273.
Sensing the touch pattern may further comprise sensing a touch from two or more consecutive outer touch sensitive areas, such as the first outer touch sensitive area 201 and the second outer touch sensitive area 202. That is, the consecutive outer touch sensitive areas 201, 202 may be adjacent outer touch sensitive areas meaning that the consecutive touch areas 201, 202 are arranged adjacently on the outer face 210 of the electronic ring-shaped device 120.
In some embodiments sensing the touch pattern comprises sensing an asymmetric response with the plurality of outer touch sensitive areas 201-208, wherein the asymmetric response comprises sensing touch with two or more outer touch sensitive areas 201, 202, 203 which are asymmetrically distributed on the outer face 210 of the electronic ring-shaped device 120.
In some embodiments herein sensing the touch pattern is based on a resistance measurement between two outer touch sensitive areas 201, 202 out of the plurality of outer touch sensitive areas 201-208. The resistance measurements may be made between more than two outer touch sensitive areas 201, 202 out of the plurality of outer touch sensitive areas 201-208. With the ring orientation of
With the ring orientation of
Sensing the touch pattern may be performed by the activating circuit 242.
Since the activating circuit 242 may be implemented as a low-power circuit the sensing of the touch pattern may be made with low power consumption.
In some embodiments the electronic ring-shaped device 120 provides an indication that it has sensed the touch pattern to the wearable electronic device 110. That is, the electronic ring-shaped device 120 may provide an indication of its intention to activate gesture sensing, for example to support the ring UI mode.
In response to sensing the touch pattern the electronic ring-shaped device 120 activates the electronic ring-shaped device 120 to sense a gesture with one or more of the plurality of outer touch sensitive areas 201-208.
In some embodiments wherein the electronic ring-shaped device 120 comprises the touch circuit 244, activating the electronic ring-shaped device 120 to sense the gesture comprises activating the touch circuit 244 to sense the gesture.
For example, the touch circuit 244 may charge and discharge the touch sensitive areas 201-208 and may then measure a time to charge and discharge. A touch on the touch sensitive areas 201-208 changes the time to charge and discharge. The time may be measured to obtain a measure of the touch.
The activating circuit 242 may activate the electronic ring-shaped device 120 to sense the gesture.
In some embodiments herein the activating circuit 242 activates the touch circuit 244, in response to sensing the touch pattern, to sense the gesture.
By activating the electronic ring-shaped device 120 to sense a gesture the number of false positives may be reduced. That is, triggering of the gesture sensing by a pre-determined touch pattern reduces the risk of unwillingly controlling the wearable device 110 by detecting a gesture and communicating it to the host device as a command for a case where the user did not intend to perform that command.
Activating the electronic ring-shaped device 120 to sense the gesture may further be based on an indication of a confirmation of the activation received from the wearable electronic device 110. The confirmation may be in response to the provided indication of the intention to activate gesture sensing. For example, if the electronic ring-shaped device 120 has provided the indication of the intention to activate gesture sensing (e.g. two quick vibrations), the wearable electronic device 110 may need to detect an additional gesture of the user to confirm the ring UI mode. The additional gesture may be a rapid tilt of the arm or hand back-and-forth. When the additional gesture has been detected by the wearable device 110 it may communicate another notification to the electronic ring-shaped device 120 as confirmation (e.g. one quick vibration).
Activating the electronic ring-shaped device 120 to sense the gesture may further be based on data from the motion sensor 114 comprised in the wearable electronic device 110 or a motion sensor comprised in the electronic ring-shaped device 120. The motion sensor may be an IMU or an accelerometer or a magnetometer.
Activating the electronic ring-shaped device 120 to sense the gesture may further be based on an indication that the display 115 of the wearable electronic device 110 is active. The indication that the display 115 of the wearable electronic device 110 is active is received from the wearable electronic device 110. For example, the start trigger may only be enabled when the user interface of the wearable electronic device 110 is activated.
Activating the electronic ring-shaped device 120 to sense the gesture may further be based on touch data from the touch sensitive area 222 arranged on the inner face 220 of the electronic ring-shaped device 120.
In other words, inner touch sensitive areas 222 on the inner face 220 of the electronic ring-shaped device 120 may also be used in combination with the one or more outer touch sensitive areas 201-208 for activating the electronic ring-shaped device 120 to sense gestures with one or more of the plurality of outer touch sensitive areas 201-208 on the outer face 210.
The electronic ring-shaped device 120 may update settings of the activation function, such as pressure thresholds, by training on real touch patterns and receiving feedback from the wearable electronic device 110 or the user. In that way accidental triggering of the gesture sensing is reduced. For example, a closed fist may activate a different set of outer touch sensitive areas 201-208 than only the touch sensitive areas 201-208 required for triggering the gesture sensing and thus the control of the wearable electronic device 110.
In some embodiments the electronic ring-shaped device 120 provides an indication of activating the electronic ring-shaped device 120 to sense the gesture to the wearable electronic device 110.
The electronic ring-shaped device 120 may then sense the gesture with one or more of the plurality of outer touch sensitive areas 201-208. Sensing the gesture may also be referred to as detecting the gesture or determining that the gesture has occurred.
As mentioned above, the plurality of outer touch sensitive areas 201-208 may be capacitive touch sensitive areas. Then sensing the gesture may comprise sensing a change in a measure related to a capacitance of a respective one of the one or more of the plurality of outer touch sensitive areas 201-208. The measure related to the capacitance may be a change in time to charge and/or discharge the plurality of outer touch sensitive areas 201-208. For example, the touch circuit 244 may be configured to sense the gesture by sensing a change in the measure related to the capacitance.
In some embodiments herein the electronic ring-shaped device 120 senses the gesture with a second outer touch sensitive area 202 out of the plurality of outer touch sensitive areas 201-208. The second outer touch sensitive area 202 is arranged on the electronic ring-shaped device 120 within a fraction of a circumference of the electronic ring-shaped device 120 from the at least first outer touch sensitive area 201. The fraction may be a quarter or a third of the circumference of the electronic ring-shaped device 120. The fraction may be in both a clockwise direction and an anti-clockwise direction.
If multiple first outer touch sensitive areas 201, 202 are used to sense the touch pattern which triggers the gesture sensing, then the second outer touch sensitive area 202 may be arranged within the fraction of the circumference from any of the at least first outer touch sensitive areas 201, 202.
Specifically, the second outer touch sensitive area 202 may be arranged within the fraction of the circumference from the outer touch sensitive area 202 that sensed the third touch described above in relation to action 301.
The second outer touch sensitive area 202 may be arranged on a palm side of the electronic ring-shaped device 120. Thus, in some embodiments herein the second outer touch sensitive area 202 is arranged on the palm side of the electronic ring-shaped device 120 within the fraction of the circumference from any of the at least first outer touch sensitive areas 201, 202. In some further embodiments herein, the second outer touch sensitive area 202 is arranged on the palm side of the electronic ring-shaped device 120 within the fraction of the circumference from one of the at least first outer touch sensitive areas 201, 202 which is located on the palm side of the of the electronic ring-shaped device 120.
In some embodiments herein the electronic ring-shaped device 120 senses the gesture with multiple outer touch sensitive areas 202, 203 out of the plurality of outer touch sensitive areas 201-208. Then the multiple outer touch sensitive areas 202, 203 may be arranged on the electronic ring-shaped device 120 within the fraction of the circumference from the at least first outer touch sensitive area 201.
A description of how to select which outer touch sensitive areas that may be configured for gesture sensing is further described below in action 414.
The gesture calculation may be performed by the electronic ring-shaped device 120, for example by the touch circuit 244. Then the electronic ring-shaped device 120 may send a gesture identity to the wearable electronic device 110. This reduces the power consumption of the electronic ring-shaped device 120 and the wearable electronic device 110 since very little data needs to be transferred from the electronic ring-shaped device 120 to the wearable electronic device 110.
In some embodiments herein the electronic ring-shaped device 120 provides an indication of the gesture to the wearable electronic device 110. The indication may identify the gesture. For example, a gesture identity (gesture ID) may be sent to the IF CU 256 of the wearable electronic device 110. This is done to keep the bit rate down and lower the power consumption. One example of a 3-bit gesture i.e., 8 different gestures may be identified, transfer scheme is the following:
Other bit lengths may also be used, such as 2 bits or 4 bits. The short press gesture (2. press) may be comparable with a tap. A double-tap may also be detected and potentially sent as one command to the smart watch.
Since a scenario in which embodiments herein may be implemented is that the wearable device 110 is arranged on a same limb as the electronic ring-shaped device 120 the communication power may be kept low. For example, the communication may be done through a body area network, e.g., with IBC, or a low-power radio, such as BLE.
As mentioned above the electronic ring-shaped device 120 may comprise the ICE 224 on the inner face 220 of the electronic ring-shaped device 120. Then the ICE 224 may be used to communicate with the wearable electronic device 110 via in-body communication, IBC.
The electronic ring-shaped device 120 may de-activate the electronic ring-shaped device 120 to sense the gesture in response to not sensing the gesture during a time period.
Further embodiments will now be described with respect to flow charts in
The electronic ring-shaped device 120 may be turned on once the electronic ring-shaped device 120 is put on the finger.
Further, a pairing procedure to pair the electronic ring-shaped device 120 with another electronic device, such as the wearable electronic device 110 may be performed when the ring-shaped device 120 is put on the finger. The paring may be performed either by IBC, or any other low-power interface that could be used. Pairing using IBC is effective since both devices are positioned on the same arm and in close proximity and this may be done automatically. If there is no response from the host the pairing will be aborted. The wearable electronic device 110 may be the host.
If the electronic ring-shaped device 120 is removed from the finger, or if the wearable electronic device 110, such as a smart watch, is removed from the arm, the pairing may be ended.
The calibration process may comprise the pairing procedure described above.
Calibration may be needed if some time has elapsed since last usage, or if the ring-shaped device 120 has rotated since the last calibration.
After pairing gesture sensing is enabled. For example, the touch circuit 244 powers up in normal mode wherein it may sense gestures with one or more touch sensitive areas 201-208.
In some embodiments herein the electronic ring-shaped device 120 senses touch with some or all outer touch sensitive areas 201-208 in order to be able to calibrate the rotation. In other words, depending on the rotation of the electronic ring-shaped device 120, the electronic ring-shaped device 120 may scan some or all of the outer touch sensitive areas 201-208 for detecting touch in an activation mode. In one example method of calibrating the rotation of the electronic ring-shaped device 120, the electronic ring-shaped device 120 behaves like a state machine.
In an example illustrated in
A next state is to check what side is towards the palm. This is illustrated in
Then when the electronic ring-shaped device 120 has determined what part is towards the palm that may then trigger the touch circuit 244 to activate the outer touch sensitive areas towards the palm, such as the second outer touch sensitive area 202, the third outer touch sensitive area 203 and the fourth outer touch sensitive area 204 for gesture recognition. This is related to the description of
Then the calibration process may determine the rotation of the electronic ring-shaped device 120 on the finger to determine what configuration the activating circuit 242 should be set to. The determination of the rotation configuration may be based on the measurements of touch performed in action 403 above. A couple of example rotation configurations have been described above. For example, the electronic ring-shaped device 120 arranged according to
In some embodiments the electronic ring-shaped device 120 checks whether the rotation position is valid. For example, if the distribution of the outer touch sensitive areas 201-208 with respect to the first and second adjacent fingers 271, 272 is asymmetric, then the rotation position may be invalid. An invalid rotation position may lead to that touch from the first and second adjacent fingers 271, 272 is not sensed as a symmetric touch pattern.
The electronic ring-shaped device 120 may notify the wearable electronic device 110 about the invalid rotation position such that the wearable electronic device 110 may notify the user about the invalid rotation position. The user may then adjust the rotation of the electronic ring-shaped device 120.
When the wearable electronic device 110 has been notified of the invalid rotation position the electronic ring-shaped device 120 waits for confirmation from the wearable electronic device 110. The confirmation may comprise an indication that the wearable electronic device 110 is paired and is ready to be controlled. The confirmation may be based on user input.
If no confirmation is received from the wearable electronic device 110 the electronic ring-shaped device 120 may be turned off.
A process flow of controlling the wearable electronic device 110 based on sensed gestures by the electronic ring-shaped device 120 is shown in
The electronic ring-shaped device 120 may calibrate the rotation as described above in relation to
After a successful calibration process the electronic ring-shaped device 120 is put in a low power state and waits for the activating circuit 242 to trigger gesture sensing. Setting the electronic ring-shaped device 120 in the low-power state may comprise setting any of the outer touch sensitive areas 201-208, the touch circuit 244 and the IF CU 246 in a low-power state.
As mentioned above when describing action 301, sensing the touch pattern may be based on the resistance measurement between two or more outer touch sensitive areas 201, 202 out of the plurality of outer touch sensitive areas 201-208.
For example, at certain intervals the activating circuit 242 may evaluate if there is a short circuit between two outer touch sensitive areas 201, 202. Thus, a measurement is performed to check if there is a connection between two or three outer touch sensitive areas 201, 202 through the conductivity of the touching object, such as the skin of the user.
However, there are many situations where the fingers are close to each other without the intention to control another device. This may happen when the hand is in a resting state, a closed fist, or when gripping something. Then the electronic ring-shaped device 120 may register a false positive. That is, the electronic ring-shaped device 120 may trigger the gesture sensing when the user did not intend to do so. The following embodiments will present different solutions to this problem. Generally, the above described trigger to start sensing gestures based on the sensed touch pattern may be combined with other triggers to provide a more robust start trigger.
In one embodiment, a start trigger is detected by the electronic ring-shaped device 120 as described above. The start trigger may be combined with a gesture of the arm, e.g. a rapid tilt back-and-forth. Such a distinct gesture may be detected by either the above-mentioned motion sensor, such as an IMU or accelerometer, of the wearable electronic device 110 or the electronic ring-shaped device 120.
In one embodiment, the start trigger is only enabled when the display 115 of the wearable electronic device 110 is activated. The display 115 may be triggered by an arm movement making the display 115 viewable to the user. The reception of a message or any other system notification, or a call may also enable the start trigger.
In one embodiment, a system comprising the electronic ring-shaped device 120 and the wearable electronic device 110 has learned typical other hand positions or gestures than the ones that should trigger the gesture sensing from how they activate the touch sensitive areas 201-208, 222 on the electronic ring-shaped device 120. For example, a closed fist would likely activate a different set of touch sensitive areas 201-208, 222 than only the ones used for starting one-handed operation, both on the outside but also by the pressure of different touch sensitive areas on the inside of the electronic ring-shaped device 120. By learning such gestures or hand positions that are not meant to trigger the gesture sensing, those gestures may be filtered out from the starting trigger of the one-handed operation.
In one embodiment, the trigger of the gesture sensing, which may be part of a ring UI mode, is notified in the wearable electronic device 110, e.g. by two quick vibrations. This makes the user aware that the gesture sensing has triggered, either as an intentional activation or involuntary. In the latter case, this allows the user to rapidly turn off the ring UI mode and use the sensor input data for the learning process.
In one embodiment, when the wearable electronic device 110 has notified the user, such as with two quick vibrations, the user may need to do an additional gesture to confirm the ring UI mode. The additional gesture may be sensed by the wearable electronic device 110. This additional gesture may be a rapid tilt of the arm or hand back-and-forth, which may be followed by another notification from the wearable electronic device 110 as confirmation, such as one quick vibration. The absence of such a confirmation gesture within a certain amount of time, such as 1 second, implies that the ring UI mode is not activated. Then, at involuntary activation of the trigger event, the user simply avoids the confirmation gesture. Thus, if the electronic ring-shaped device 120 does not receive a confirmation from the wearable electronic device 110 the electronic ring-shaped device 120 does not trigger gesture sensing although the electronic ring-shaped device 120 sensed the triggering touch pattern.
The wearable electronic device 110 and/or the electronic ring-shaped device 120 may turn off the ring UI mode based on sensing a similar gesture as the one that turns on the mode. However, the gesture that turns off the ring UI mode may also differ from the gesture that turns on the mode.
It should be noted that above examples of confirmation gestures or notifications are only examples, and other methods may be used.
Once enough touch sensitive areas are covered the activating circuit 242 triggers gesture sensing and the touch circuit 244 powers up in normal mode.
In some embodiments herein the touch circuit 244 sense all the touch sensitive areas at the same side as the activating circuit 242 was triggered to determine if any gesture is performed. For example, if the third finger 273 triggers the activation of the touch circuit 244 by touching the second touch sensitive area 202 arranged on the palm side of the electronic ring-shaped device 120, then the touch circuit 244 may be configured to sense gestures with the outer touch sensitive areas on the palm side, such as any one or more of the first to the fifth outer touch sensitive areas 201-205.
The electronic ring-shaped device 120 may check if a gesture is performed. If no gesture is detected within a certain amount of time (for example in the range of a fraction of a second) the touch circuit 244 may revert to low power mode and the activating circuit 242 may be operational again to sense the touch pattern in order to trigger activation of the touch circuit 244.
Once a gesture is performed and registered the electronic ring-shaped device 120 may determine what gesture it was and send a corresponding bit stream over the interface to the paired electronic device, such as the wearable electronic device 110. The touch circuit 244 may determine what gesture it was and send the corresponding bit stream.
In some embodiments herein the touch circuit 244 is reset and is ready to sense a new gesture.
If no gesture is detected within a certain amount of time (for example in the range of milliseconds) the touch circuit 244 may revert to low power mode and the activating circuit 242 may be operational again to sense a new touch pattern in order to trigger activation of the touch circuit 244.
In summary, various embodiments above disclose techniques for controlling a smart watch or a smart wrist band. The communication technology used between the electronic ring-shaped device 120 and the wearable electronic device 110 may be suitable for short range and low power. Further, use of in-body communication is less prone to pairing difficulties or interference, since the electronic ring-shaped device 120 and the smart watch are placed on the same arm. The disclosed embodiments avoid the problems of limited relative finger movements if the user should look at the smart watch on the arm at the same time, and is substantially more robust in that they do not rely on determining gestures from the motion of the finger or arm simultaneously as the user is in action.
Compared to prior-art ring devices based on small touch pads, the proposed embodiments of the electronic ring-shaped device 120 may be made much smaller. This enables many more ring designs and is far less clumsy.
Furthermore, in some of the proposed embodiments only the code of the identified gesture is sent to the smart watch or other host device which minimizes the traffic and bandwidth needs, thus reduces power consumption of the system.
The proposed approaches for minimizing the number of false positives without reducing the sensitivity to detect gestures leads to a robust solution for one-handed input.
The electronic ring-shaped device 120 may comprise a processing module 501 for performing the above method actions. The processing module 501 may comprise a sensing module 510 to, e.g. sense the touch pattern.
The processing module 501 may comprise an activating module 520 to, e.g. activate gesture sensing.
The processing module 501 may comprise a providing module 530 to, e.g. provide notifications of trigger signals and/or indications of gestures.
The processing module 501 may comprise a de-activating module 540 to, e.g. de-activate the gesture sensing.
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the sensing module 510, sense the touch pattern of the electronic ring-shaped device 120 with at least the first outer touch sensitive area 201 of the plurality of outer touch sensitive areas 201-208.
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the activating module 520, activate the electronic ring-shaped device 120 to sense a gesture with the one or more of the plurality of outer touch sensitive areas 201-208 in response to sensing the touch pattern.
In some embodiments the electronic ring-shaped device 120 further comprises the activating circuit 242 electrically connected to each outer touch sensitive area 201-208 and configured to sense the touch pattern and activate the electronic ring-shaped device 120 to sense the gesture.
In some embodiments the wearable electronic ring-shaped device 120 further comprises the touch circuit 244 electrically connected to each outer touch sensitive area 201-208. Then the touch circuit 242 is configured to sense the gesture.
The activating circuit 242 may be configured to activate the touch circuit 244, in response to the sensed touch pattern, to sense the gesture. That is, in response to the sensed touch pattern, the activating circuit 242 may activate the touch circuit 244 to sense the gesture.
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the activating module 520, sensing the touch pattern is based on a resistance measurement between two outer touch sensitive areas 201, 202 out of the plurality of outer touch sensitive areas 201-208.
In some embodiments the electronic ring-shaped device 120 is further configured to, e.g. by means of the activating module 520, sense the touch pattern by sensing an asymmetric response with the plurality of outer touch sensitive areas 201-208. The asymmetric response comprises sensing touch with two or more outer touch sensitive areas 201, 202, 203 which are asymmetrically distributed on the outer face 210 of the electronic ring-shaped device 110.
In some other embodiments the electronic ring-shaped device 120 is further configured to, e.g. by means of the activating module 520, sense the touch pattern by sensing a touch from two or more consecutive outer touch sensitive areas 201, 202.
The touch pattern may comprise at least two simultaneous separate touches.
In some embodiments wherein the plurality of outer touch sensitive areas 201-208 are capacitive touch sensitive areas the electronic ring-shaped device 120 is further configured to, e.g. by means of the activating module 520, sense the gesture by sensing a change in the measure related to the capacitance of the respective one of the one or more of the plurality of outer touch sensitive areas 201-208.
In some embodiments herein the electronic ring-shaped device 120 is further configured to, e.g. by means of the activating module 520, sense the gesture with the second outer touch sensitive area 202 out of the plurality of outer touch sensitive areas 201-208. The second outer touch sensitive area 204 is arranged on the electronic ring-shaped device 120 within a fraction of the circumference of the electronic ring-shaped device 120 from the at least first outer touch sensitive area 201.
In some embodiments herein the electronic ring-shaped device 120 is further configured to, e.g. by means of the activating module 520, activate the electronic ring-shaped device 120 to sense the gesture further based on any of:
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the providing module 530, provide the indication of activating the electronic ring-shaped device 120 to sense the gesture to the wearable electronic device 110, and provide the indication of the gesture to the wearable electronic device 110.
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the communication electrode 224, communicate with a wearable electronic device 110 via IBC.
The electronic ring-shaped device 120 may further be configured to, e.g. by means of the de-activating module 540, de-activate the electronic ring-shaped device 120 to sense the gesture in response to not sensing the gesture during a time period.
The embodiments herein may be implemented through a processing circuit 504, e.g. comprising one or more processors, in the electronic ring-shaped device 120 depicted in
The processing circuit 504 may comprise the activating circuit 242 and/or the touch circuit 244.
The program code mentioned above may also be provided as a computer program product, for instance in the form of a data carrier carrying computer program code for performing the embodiments herein when being loaded into the electronic ring-shaped device 120. One such carrier may be in the form of a CD ROM disc. It is however feasible with other data carriers such as a memory stick. The computer program code may furthermore be provided as pure program code on a server and downloaded to the electronic ring-shaped device 120.
The electronic ring-shaped device 120 may further comprise a memory 502 comprising one or more memory units. The memory 502 comprises instructions executable by the processing circuit in the electronic ring-shaped device 120. The memory 502 is arranged to be used to store e.g. information, indications, data, configurations, and applications to perform the methods herein when being executed in the electronic ring-shaped device 120. The memory 502 may be a non-volatile memory e.g., NAND, from which the electronic ring-shaped device 120 may load its program and relevant data. Updates of the software may be transferred via a wireless connection.
In some embodiments, a computer program 503 comprises instructions, which when executed by the processing circuit 504, cause the processing circuit 504 of the electronic ring-shaped device 120 to perform any of the method actions above.
In some embodiments, a carrier 505 comprises the respective computer program 503, wherein the carrier 505 is one of an electronic signal, an optical signal, an electromagnetic signal, a magnetic signal, an electric signal, a radio signal, a microwave signal, or a computer-readable storage medium.
To perform the method actions above, the electronic ring-shaped device 120 may comprise an Input and Output (I/O) unit 506. The I/O unit 506 may comprise or be configured to communicate with e.g., the IF CU 246.
Those skilled in the art will appreciate that the modules and/or units in the electronic ring-shaped device 120 described above may refer to a combination of analog and digital circuits, and/or one or more processors configured with software and/or firmware, e.g., stored in the electronic ring-shaped device 120, that when executed by, e.g., the processing circuit 501, above causes the electronic device to perform the method actions above. The processing circuit 501, which may comprise the activating circuit 242 and/or the touch circuit 244, as well as other digital hardware, may be included in a single hardwired logic such as an Application-Specific Integrated Circuitry (ASIC), or several processors and various digital hardware may be distributed among several separate components, whether individually packaged or assembled into a system-on-a-chip (SoC).
As used herein, the term “module” may refer to one or more functional modules, each of which may be implemented as one or more hardware modules and/or one or more software modules and/or a combined software/hardware module. In some examples, the module may represent a functional unit realized as software and/or hardware.
As used herein, the term “computer program carrier”, “program carrier”, or “carrier”, may refer to one of an electronic signal, an optical signal, a radio signal, and a computer readable medium. In some examples, the computer program carrier may exclude transitory, propagating signals, such as the electronic, optical and/or radio signal. Thus, in these examples, the computer program carrier may be a non-transitory carrier, such as a non-transitory computer readable medium.
As used herein, the term “processing module” may include one or more hardware modules, one or more software modules or a combination thereof. Any such module, be it a hardware, software or a combined hardware-software module, may be a sensing means, an activating means, providing means, de-activating means or the like as disclosed herein. As an example, the expression “means” may be a module corresponding to the modules listed above in conjunction with the figures.
As used herein, the term “software module” may refer to a software application, a Dynamic Link Library (DLL), a software component, a software object, an object according to Component Object Model (COM), a software component, a software function, a software engine, an executable binary software file or the like.
The terms “processing module” or “processing circuit” may herein encompass a processing unit, comprising e.g. one or more processors, an Application Specific integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or the like. The processing circuit or the like may comprise one or more processor kernels.
As used herein, the expression “configured to/for” may mean that a processing circuit is configured to, such as adapted to or operative to, by means of software configuration and/or hardware configuration, perform one or more of the actions described herein.
As used herein, the term “action” may refer to an action, a step, an operation, a response, a reaction, an activity or the like. It shall be noted that an action herein may be split into two or more sub-actions as applicable. Moreover, also as applicable, it shall be noted that two or more of the actions described herein may be merged into a single action.
As used herein, the term “memory” may refer to a hard disk, a magnetic storage medium, a portable computer diskette or disc, flash memory, Random Access Memory (RAM) or the like. Furthermore, the term “memory” may refer to an internal register memory of a processor or the like.
As used herein, the term “computer readable medium” may be a Universal Serial Bus (USB) memory, a DVD-disc, a Blu-ray disc, a software module that is received as a stream of data, a Flash memory, a hard drive, a memory card, such as a MemoryStick, a Multimedia Card (MMC), Secure Digital (SD) card, etc. One or more of the aforementioned examples of computer readable medium may be provided as one or more computer program products.
As used herein, the term “computer readable code units” may be text of a computer program, parts of or an entire binary file representing a computer program in a compiled format or anything there between.
As used herein, the terms “number” and/or “value” may be any kind of number, such as binary, real, imaginary or rational number or the like. Moreover, “number” and/or “value” may be one or more characters, such as a letter or a string of letters. “Number” and/or “value” may also be represented by a string of bits, i.e. zeros and/or ones.
As used herein, the expression “in some embodiments” has been used to indicate that the features of the embodiment described may be combined with any other embodiment disclosed herein.
Even though embodiments of the various aspects have been described, many different alterations, modifications and the like thereof will become apparent for those skilled in the art. The described embodiments are therefore not intended to limit the scope of the present disclosure.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2021/062357 | 5/10/2021 | WO |