Patent Application
20170257660
The present disclosure relates to a field of image recognition and television (TV) control, and more particularly relates to an interactive control system and method for smart TV based on image recognition.
TV has already and universally accessed to millions of households as a popular leisure appliances. With the development of the economy and the progress of the society, especially with the application and promotion of cable television (CATV) and digital TV technology, the ordinary families are able to receive dozens of or even hundreds of channels. Therefore, the audiences need to remember the number of the channel usually being watched in many channels, and then input the corresponding digital number to switch a target channel by the key of the remote control. When the audiences forgets the channel number, it is very time-consuming to sequentially switch channel until the target program channel is selected by the upper channel button and the next channel button of the remote control. Therefore, it is a problem to be solved that how to select TV channel usually being watched from many TV channels.
At present, the commonest solution is to take advantage of the favorite channel configuration, i.e. configuring the personal favorite channel to a favorite channel list in advance, and then calling out the favorite channel list by the button of the remote control, and lastly selecting the channel from the favorite channel list.
However, the above solution can only configure one or more person's favorite channels to the same favorite channel list. When there are multiple users, the number of channels in the favorite channel list may be accordingly increased, thereby it is very cumbersome and time-consuming to control channel, and it is unable to achieve the function of searching the program quickly.
Therefore, it is necessary to provide an interactive control system and method for smart TV based on image recognition for different user to select channel quickly and simply and to search program.
An interactive control system for smart TV based on image recognition includes:
an image acquisition module configured to acquire a card image;
a gesture recognition module configured to recognize a gesture of a user holding the card and output a gesture recognition result, wherein the gesture recognition result is a channel switching, a program selecting or a content searching;
a card recognition module configured to recognize a content of the card image and output a card recognition result; and
an interactive control module configured to perform related interactive operation according to the gesture recognition result and the card recognition result
An interactive control method for smart TV based on image recognition includes:
acquiring a card image;
recognizing a gesture of the user holding the card and outputting a gesture recognition result, wherein the gesture recognition result is a channel switching, a program selecting or a content searching;
recognizing the content of the card image and outputting a card recognition result; and
performing related interactive operation according to the gesture recognition result and the card recognition result.
In the foregoing interactive control system and method for smart TV based on the image recognition, the card image is acquired by the image acquisition module, the gesture of the user holding the card is recognized, and the gesture recognition result is output by the gesture recognition module. The card recognition module recognizes the content of the card image and output the card recognition result. The interactive control module can perform corresponding interactive operation (e.g., the channel switching, the program selecting, the content searching and so on) according to the gesture recognition result and the card recognition result. Therefore it is not necessary to select a channel by pressing a button of a remote control, such that even multiple users can quickly and easily select the channel, as well as searching the program.
To illustrate the technical solutions according to the embodiments of the present disclosure or in the prior art more clearly, the accompanying drawings for describing the embodiments or the prior art are introduced briefly in the following. Apparently, the accompanying drawings in the following description are only some embodiments of the present invention, and persons of ordinary skill in the art can derive other drawings from the accompanying drawings without creative efforts.
Referring to
The image acquisition module 110 is a special camera configured to acquire a card image or a face image. The card image can be a TV Logo, a text or a QR code. In alternative embodiments, the card image can also be a cartoon, an animal, a fruit or other images.
For example, if the current user would like to switch a TV channel to CNBC, the user only need to hold the card printed with four letters “CNBC” as shown in
The gesture recognition module 120 is configured to recognize a gesture of a user holding the card and output a gesture recognition result, which can be a channel switching, a program selecting or a content searching. Specifically, when the user has different needs, he will hold the card and make a corresponding gesture within a visible range of the image acquisition 110. When the user holding the card is present within a visible range of the image acquisition module 110, the gesture recognition module 120 will automatically adjust the visible range of the image acquisition module 110 to a range which is most suitable for acquiring the content of the card (e.g. focusing the card for zooming), at the same time the gesture recognition. 120 will output the gesture recognition result.
In the illustrated embodiment, the system further includes a gesture template configuration module configured to customize a gesture template as a preset gesture template. If the user holding the card makes a gesture as shown in
The card recognition module 130 is configured to recognize a content of the card image and output a card recognition result. No matter the card image is a TV Logo, a text or a QR code, the card recognition module 130 can recognize the content of the card image. The content of the card image as shown in
The interactive control module 140 is configured to perform related interactive operation according to the gesture recognition result and the card recognition result. The interactive control module 140 can also switch the current application to user's favorite application according to the favorite application information output by the personal application management module 160.
Specifically, if the gesture of the user holding the card and the card image is shown as in
Similarly, if the user knows that there is a channel playing a program named “THE VOICE OF CHINA”, but forgets which channel it is, the user can hold the card written with “THE VOICE OF CHINA” and make the gesture of holding the card as shown in
If the gesture of the user holding the card and the card image is shown as in
It should be understood that, if the gesture of the user holding the card is shown as in
The face recognition module 150 is configured to recognize the face image and output a corresponding prestored user information. In the illustrated embodiment, the face recognition module 150 includes a detecting unit and a storing unit.
The detecting unit is configured to detect whether the prestored user information corresponding to the face image exits, if yes, the corresponding prestored user information is output, or else new user information is registered by the personal application management module 160.
In general, if a current user is a family member, there will be corresponding prestored user information for him. However, if there is a guest paying a visit and using the television for the first time, the face recognition module 150 will not output the corresponding prestored information. Then the new user information will be registered by the detecting unit via the personal application managing module 160.
The storing unit is configured to store the new user information as the prestored user information.
The personal application management module 160 is configured to obtain favorite application information of the user according to the corresponding prestored user information and output the favorite application information to the interactive control module 140, then the interactive control module 140 will directly switch the current application to user's favorite application. In one embodiment, the application includes a channel, a program, a game, a learning, and so on.
In the illustrated embodiment, the personal application management module 160 includes a registration unit and an automatic update unit.
The registration unit is configured to register the new user information as the prestored user information. When the user uses the TV at the first time, the new user information can be registered by the registration unit, and the new user information will be stored in the storing unit of the face recognition module 150 as the prestored user information.
The automatic update unit is configured to count the number of times or length of time of the user watching the application, and update the favorite application information of the user automatically according to the number of times or length of time of the user watching the application. For example, assuming an initial favorite TV channel of the user is a Sports channel, but later he begins to like to see a Entertainment Channel, and he has manually switched the Sports channel into the Entertainment channel for many times or the time of watching the Entertainment channel is longer than before, therefore the automatic update unit will count the number of times or length of time of the user watching the channel, and when the number of times or length of time reaches a certain threshold value, the user's favorite application information will be updated automatically. If the user use the TV at the first time, the application with the longest watching time will be the user's default favorite application.
In the illustrated embodiment, the threshold value of the number of times is configured to 3 and the threshold value of length of time is configured to 2 hours. In other words, when the user has manually switched the Sports Channel to the Entertainment Channel for three times in series or has watched the Entertainment Channel more than two hours at a time, the automatic update unit will update the user's favorite channel from the Sports Channel to the Entertainment Channel the next time the user uses the TV.
In alternative embodiments, it should be understood that the threshold value of the number of the times and the threshold value of length of time can be configured to be other values. For example, the threshold value of the number of the times is configured to 5 and the threshold value of length of time is configured to 3 hours, there is no restriction.
An interactive control method for smart TV based on image recognition includes:
In step S110, a card image is acquired.
In the illustrated embodiment, the card image is a TV Logo, a text or a QR code.
In step S120, a gesture of the user holding the card is recognized and a gesture recognition result is output.
In the illustrated embodiment, the gesture recognition result is a channel switching, a program selecting or a content searching.
In step S130, the content of the card image is recognized and a card recognition result is output.
In step S140, the related interactive operation is performed according to the gesture recognition result and the card recognition result.
In alternative embodiments, it should be understood that the step S120 and the step S130 may also be performed in an exchange order or at the same time.
In one embodiment, the step S120 also includes the prior step of customizing the configuration gesture template as the preset gesture template, wherein the preset gesture template is configured to be compared with the gesture of the user to output the gesture recognition result.
Referring to
The interactive control method for smart TV based on image recognition includes:
In step 210, a face image is acquired.
In step 220, the face image is recognized and a corresponding prestored information of the user is output.
Specifically, in the illustrated embodiment, this step includes:
Whether the prestored user information corresponding to the face image exits is detected, if yes, the corresponding prestored user information is output, or else the new user information is registered.
The new user information is storied as the prestored user information.
In step 230, the favorite application information of the user is obtained according to the corresponding prestored information.
Specifically, in the illustrated embodiment, this step includes:
The number of times or length of time of the user watching the application is counted and the favorite application information of the user is updated automatically according to the number of times or length of time of the user watching the application.
The updated favorite application information is obtained.
In step 240, the corresponding application is switched according to the favorite application information.
In the foregoing interactive control system and method for smart TV based on the image recognition, the card image is acquired by the image acquisition module, the gesture of the user holding the card is recognized, and the gesture recognition result is output by the gesture recognition module. The card recognition module recognizes the content of the card image and output the card recognition result. The interactive control module can perform corresponding interactive operation (e.g., the channel switching, the program selecting, the content searching and so on) according to the gesture recognition result and the card recognition result. Therefore it is not necessary to select a channel by pressing a button of a remote control, such that even multiple users can quickly and easily select the channel, as well as searching the program.
The foregoing implementations are merely specific embodiments of the present disclosure, but are not intended to limit the protection scope of the present disclosure. It should be noted that any variation or replacement readily figured out by persons skilled in the art within the technical scope disclosed in the present disclosure shall all fall within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201410439329.8 | Aug 2014 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2015/085736 | 7/31/2015 | WO | 00 |
