The present application relates to an electronic device controlling method and a user registration method, and particularly relates to an electronic device controlling method for controlling an electronic device according to identify information of a user and a user registration method that can register to an electronic device via simple steps.
A user always utilizes a control command (e.g., voice, a gesture, a head turning) to control an electronic device. However, the electronic device can only perform user independent operations according to the control command.
Therefore, one objective of the present application is to provide an electronic device controlling method to control a target device to perform a user dependent operation.
Another objective of the present application is to provide a user registration method such that a user can register to a target device via simple steps.
One embodiment of the present application discloses an electronic device controlling method for controlling a target device, which comprises: (a) receiving a first control command from a first user; (b) detecting identity information of the first user; (c) determining if the first user is registered via comparing the identity information of the first user with one or more registered identity models; (d) retrieving a first user profile corresponding to the first user if the first user is determined to be registered; and (e) controlling the target device to perform a first predetermined operation according to the first user profile.
Another embodiment of the present application discloses an electronic device controlling method, which comprises: receiving a first control command and a second control command performed by different users simultaneously or separately, wherein the first and the second control commands are identical; in response to the first control command, performing a first predetermined operation based on an identity of a user performing the first control command; and in response to the second control command, performing a second predetermined operation based on an identity of a user performing the second control command.
Still another embodiment of the present application discloses a user registration method for registering a user to a target device, which comprises: (a) obtaining at least one candidate identity information from a sensor; (b) finding a target identity information of the user from the candidate identity information; (c) building a user registered identity model of the user according to the target identity information; and (d) setting a relationship between the registered identity model of the user and a user profile for the user.
In view of above-mentioned embodiments, a user can control the target device to perform user dependent operations according to the control method. Additionally, the user can register to a target device via simple steps.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Several embodiments are provided as below to explain how to reach the actions depicted in
Please refer to
The target device may identify the user performing the gesture after the gesture has been detected. Alternatively, the target device may identify each user in a predetermined range of the target device before detecting any gesture, and in this examples, the user identity of each user in front of or near the target device may be determined only according to the face region(s) acquired in the step 303 but not according to the gesture region G. That is, the step 305 is optional in this case.
In the step 307, the target device obtains the facial data from the selected face region F1. In the step 309, the facial data is compared with the face models (e.g., the face models 1to 3) stored in the target device to determine the identity of the user. If the user has registered to the target device, the user profile corresponding to the user can be acquired from the database. For example, assuming that the user is Peter and has already registered to the target device. Peter's user profile will be acquired by the target device once the user is determined to be Peter according to the facial data, as shown in the step 309. The user profile comprises various user information. For example, the user profile comprises the relationship between the control commands and the predetermined operations. In one example, in Peter's user profile, a “thumbs up” gesture is associated with an operation of switching the TV channel to channel 52, but in Alice's user profile, the identical “thumbs up” gesture is associated with an operation of switching the TV channel to channel 30.
Besides the user profile, the database may further comprise the device profiles for different client devices (e.g., Device Profile 1, Device Profile 2, Device Profile 3 in
After the user's user profile is acquired, the target device performs a predetermined operation according to the user profile. The predetermined operation may simply relate to the target device. Alternatively, the predetermined operation may relate to the target device as well as one or more other devices. However, the type of the predetermined operation is not limited thereto.
For example, the predetermined operation may include displaying predetermined content on the target device. The operation of displaying predetermined content on the target device can be, for example, displaying video or audio data.
In one example, if the target device is a TV, information filtering function such as “Parent control” can be performed via above-mentioned embodiments. For example, if a channel switching command is received, the displayed selectable channels are different corresponding to different users. In another example, if a turning on command, an unlock command or a launching application command is received, the content (e.g., the arrangement of icons, buttons and software input panel) for the user interface changes corresponding to different users.
In another example, if several users are watching TV and one of the user's mobile phone receive a call, the TV will display a message to tell the users whose mobile phone is receiving a call. If the owner of the mobile phone receiving the call performs a predetermined gesture, the owner can answer the call via the TV. In such example, only the owner can answer the call via performing the predetermined gesture. Other users cannot answer the call even if they perform the same gesture.
In another example, when the user desires to read or send a message via the TV, he can only read or send the message by his account since he must be identified first. By this way, the security for each person's message is raised.
Alternatively, the predetermined operation may include performing a function of a social network such as a community website, a shopping network, or any online service via the first user's account. The operation of performing a function of a community website via the first user's account can be, for example, clicking “like” to an article via the user's account for the community website.
In another embodiment, the target device may perform a predetermined operation such as sharing data with a client device. The client device can be the user's client device, which is connected to the target device (such as Peter's client device M in the step 311). The client device which the target device shares data with can be assigned when the user registers to the target device. For example, the device profile in the step 309, which indicates the relation between the user and the client device, is acquired when the target device shares data with a client device. The client device can be any electronic device, for example, a mobile phone or a laptop.
However, please note the target device is not limited to share data with a particular user's client device. The target device can share data with any client device. For example, the user can perform a gesture to trigger the sharing operation and then select a client device in a predetermined range of the target device such that the target device can share data with the selected client device. More specifically, the target device may act as a data sharing center. One user may share images from his mobile phone (i.e., the client device) to the target device, and the other user may uses gesture to download the image to his mobile phone from the target device. In another example, if a TV (the target device) takes a picture of the user, and the user can control the target device to share his image with other client devices, after the user is identified by the target device. In yet another example, when the target device detects a specific gesture performed by a registered user, the target device takes a snapshot of a screen and consults the device profile corresponding to the registered user, so as to transmit the snapshot to the client device of the user.
Other methods can be applied to determine who the user performing the gesture is. As shown in
Please note the scope of the present application is not limited to the embodiments depicted in
Additionally, in the foregoing embodiments, the facial data of the user can be replaced by other identity information. For example, the identity information can be biometric information such as: a fingerprint, a palm print, iris data, a skeleton structure, a voice print or a combination thereof. Alternatively, the identity information can be obtained by a username and password authentication, an identification card or a signature. Accordingly, the above-mentioned face model also changes to another identity model corresponding to the identity information. For example, if the identity information is a fingerprint, the identity model is a fingerprint model rather than a face model. Similarly, if the identity information is a skeleton structure, the identity model is a skeleton model rather than a face model.
In view of above-mentioned description, an electronic device controlling method can be acquired according to the embodiments depicted in
Step 501
Receive a first control command (e.g., a hand gesture) from a first user.
Step 503
Detect identity information (e.g., facial data) of the first user.
Step 505
Determine if the first user is registered via comparing the identity information of the first user with one or more registered identity models (e.g., a face model).
In one embodiment, if the first user is determined to be unregistered, the target device performs a default operation which is user-independent. Alternatively, the target device may request the first user to register through a registration method, as will be described later.
As above-mentioned, the registered identity models may be pre-stored in the target device. However, the registered identity models may be pre-stored in a client device such as the registered user's device, or in a cloud storage, and will be acquired by the target device when necessary.
Step 507
Retrieve a first user profile corresponding to the first user if the first user is determined to be registered.
In one embodiment, the corresponding device profile is also retrieved in the step 507, thereby the first user can control the target device to share data with the client device based on the device profile.
Step 509
Control the target device to perform a first predetermined operation (e.g., share data with a client device) according to the first user profile.
Please note the embodiments depicted in
In one embodiment, it is assumed that three users are registered with a target device and the user profiles of the three users all indicate that the predetermined operation corresponding to a specific hand gesture is to send a snapshot of the screen of the target device to the corresponding client device. Once the target device receives the specific hand gestures at the same time from these three users, the target device sends the snapshot to the client device of each user accordingly.
In the following, several examples are provided to explain how a user and/or a client device register for a target device, and how the face model, the user profile are acquired.
In the step 601 of
After the face model is stored in the target device T, the target device T may online update the face model and send back the new face model NFM to the client device M, as illustrated in the step 607. Via such step, the face model can be more complete. However, the step 607 is only optional and can be removed.
In the step 807, the client device M_2 transmits the user profile PF to the target device T. As above-mentioned, the client device M_2 may transmit it's device profile to the target device T as well. By this way, the user can easily register to a target device which he or she has not registered before, and the target device T can automatically inform a user that he or she has not registered yet. The step 809 is the same as the step 607, thus is omitted for brevity here.
Please note, although a confirm button CB is provided for the user to confirm. Other mechanisms can be applied for the user to confirm. For example, the user can use a voice command or a gesture command to confirm. Additionally, the step 801 can be replaced by: while a certain gesture is detected and the identity of the user NU performing the gesture cannot be recognized, the target device captures the image of the user NU for subsequent registration process. Similar variation should all fall in the scope of the present application.
For example, the target device searches the face of the user NU in telephone directories stored in the nearby client devices. Or, in another example, the target device searches the face of the user NU in the friend list of an instant messenger installed in the nearby client devices. The step 903 can be regarded as a step of searching a target face (the face of the user NU).
After the target face is found, in the step 905, the client device M comprising the contact list having the target face updates the user profile PF of the user NU to the target device T. For example, if Peter is a non-registered user for a target device, and the target device finds Peter's face in Jean's telephone directory, the user profile for Peter is updated from Jeans' client device (if it is already stored in Jean's client device). Besides, the client device M may transmit it's device profile to the target device T as well. In such embodiment, the face model can be online updated as above-mentioned, but not illustrated here. However, please note such embodiment is not limited to search the face of the user NU in other client device's contact list, the face of the user NU can also be searched in other data region (e.g., an image folder file).
In the step 1005, the user profile is updated according to the information for the user NU input from the client device RM_1, RM_2, or RM_3. In this embodiment, the face model is sent to the target device along with the user profile. Alternatively, the face model may be online updated as above-mentioned. Besides, the client device receiving the information of the user NU may transmit it's device profile to the target device as well.
Please note the facial data of the user can be replaced by other identity information in the embodiments of
Besides the advantage that the user can easily register to a target device, other advantages can be provided based on the embodiments illustrated in
Furthermore, the command provided by the user can connect to the client device. For example, if John prefers a “thumb up” gesture, he can set his user profile such that the target device will control his client device while John performing the “thumb up” gesture. Similarly, if Jean prefers a “V” gesture, she can set her user profile such that the target device will control her client device while Jean performing the “V” gesture.
In view of above-mentioned description, a user registration method can be acquired according to the embodiments depicted in
Step 1101
Obtain at least one candidate identity information from a sensor. For example, capture an image comprising at least one candidate face via an image sensor, such as the step 601, 701, 801, 901 and 1001 in the foregoing embodiments. If the candidate identity information is other information besides the facial data, the sensor can be a corresponding sensor such as a finger print sensor, palm line sensor, or a voice recorder.
Step 1103
Find target identity information of the user from the candidate identity information. For example, find a target face such as the steps 603, 703, 803, 903 and 1003 in the foregoing embodiments.
Step 1105
Build a user registered identity model of the user according to the target identity information. For example, build a face model according to the target face such as the steps 603, 703, 803, 903 and 1003 in the foregoing embodiments.
Step 1107
Set a relationship between the registered identity model of the user and a user profile for the user. For example, in the steps 605, 707, 807, 905, and 1005, the user profile is transmitted from the client device to the target device T, and then the relationship between the user profile and the face model are set. Please note the user profile is not limited to be transmitted from the client device to the target device, the user profile may reside on the target device and may be transmitted from the target device to the client device in other embodiments.
Other detail steps can be acquired according to above-mentioned description, thus are omitted for brevity here.
Please note the target device is applied as an example to explain an electronic device that can perform the methods provided by the present application. However, the structures depicted in
In view of above-mentioned embodiments, a user can control the target device to perform user dependent operations according to the control method. Additionally, the user can register to a target device via simple steps.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2014/079611 | 6/10/2014 | WO | 00 |