Patent Application
20190156111
This disclosure generally relates to an interactive system and, more particularly, to a user recognition and confirmation device and method, and a central control system for vehicles using the same.
Presently the biological recognition technology has been widely applied to the ID recognition. Generally biological information includes the information of, for example, face, voice print, finger print and pupil, wherein in the face recognition as a user does not need to take any corresponding action, it is the most convenient technology for operation.
For example, World Patent No. WO2011/121688 discloses a face recognition device which includes an image capture unit, a region detection unit, a feature value extraction unit, a distance estimation unit and a feature value update unit. The region detection unit is for detecting a predetermined region in the image captured by the image capture unit. The feature value extraction unit is for extracting a feature value of the predetermined region. The distance estimation unit is for estimating a distance between the image capture unit and the predetermined region. The feature value update unit is for updating the feature value according to the distance. As a result, it is able to realize high recognition accuracy.
The expression recognition technology is a new technology in development that is able to detect different facial expressions in different moods, such as anger, terror, dislike, happiness, expressionless, sadness, surprise and so on. For example, U.S. Patent Pub. No. 2012169895 discloses a method and apparatus for capturing facial expressions that employ a recognizer implemented by using a Hierarchical Temporal Memory (MTM) recognizer. The method recognizes a target image so as to obtain an expression status and can be applied to the image capturing devices such as a digital camera, Web Cam, IP Cam or Monitor camera.
Accordingly, the present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize a user ID at first by using a face recognition unit and then confirm the accuracy of the user ID through an expression recognition unit. In this manner, the user may accomplish the recognition and the confirmation procedures without using body motion.
The present disclosure provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may recognize the user ID using face recognition technology and confirm the user ID using expression recognition technology.
The present disclosure further provides a user recognition and confirmation device and method, and a central control system for vehicles using the same that may be applied to automatic settings of various electronic devices for vehicles.
The present disclosure provides a user recognition and confirmation method including the steps of: capturing, by an image sensing unit, a first image frame; recognizing a user ID according to the first image frame; showing ID information, which is previously stored in a storage unit, of the recognized user ID on a screen of a display unit; capturing, by the image sensing unit, a second image frame; generating a confirm signal when a happiness expression is recognized by calculating an expression feature in the second image frame and comparing the recognized expression feature with stored expression data associated with a predetermined happiness expression to confirm whether the recognized user ID is correct or not according to the second image frame captured after the ID information is shown by the display unit; and controlling a steering wheel height according to the confirm signal.
The present disclosure further provides a user recognition and confirmation method including the steps of: capturing, by an image sensing unit, a first image frame; recognizing a user ID according to the first image frame; showing ID information, which is previously stored in a storage unit, of the recognized user ID on a screen of a display unit; capturing, by the image sensing unit, a second image frame; generating a confirm signal when a happiness expression is recognized by calculating an expression feature in the second image frame and comparing the recognized expression feature with stored expression data associated with a predetermined happiness expression to confirm whether the recognized user ID is correct or not according to the second image frame captured after the ID information is shown by the display unit; and controlling a light setting according to the confirm signal.
In one aspect, the face recognition unit may be further configured to identify whether there is a user existing in the first image frame and/or identify a user to be recognized within a plurality of users in the first image frame.
In one aspect, the user recognition and confirmation device further includes a storage unit configured to save ID information of at least one user, expression data associated with the user expression and setting information.
In one aspect, the display unit may show the ID information via screen and/or sound.
In one aspect, the user recognition and confirmation method further includes the steps of: capturing a third image frame with the image sensing unit; confirming a user expression according to the third image frame and generating a saving signal; and updating setting information of the at least one electronic device according to the saving signal.
In the user recognition and confirmation device and method, and the central control system for vehicles of the present disclosure, the user ID may be automatically confirmed through a user expression not through body motion of the user. In addition, when the user desires to update the setting information, the updating may also be implemented through the expression recognition.
Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
Referring to
The user recognition and confirmation device 1 according to the embodiment of the present disclosure is configured to recognize a user ID at first and then confirm whether the user ID is correct or not according to a user expression so as to accordingly control at least one electronic device 17. In one embodiment, the user recognition and confirmation device 1 may be applied to a central control system for vehicles so as to perform corresponding driver settings according to the use habit of every driver, wherein the driver settings may include a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS (global positioning system) setting, but not limited to. However, the user recognition and confirmation device 1 according to the embodiment of the present disclosure in not limited to be applied to the central control system for vehicles. It may be applied to any human-machine interface system that may perform the confirmation of the recognized user ID according to the facial expression of the user.
The image sensing unit 11 may be a CCD image sensor, a CMOS image senor or the like. The image sensing unit 11 is configured to capture a first image frame F1 and a second image frame F2, wherein the image sensing unit 11 may capture images at a fixed capturing frequency. For example in
The face recognition unit 12 is configured to recognize a user ID according to the first image frame F1, wherein after the face feature(s) is calculated using algorithm, the face recognition unit 12 searches the corresponding user ID in the storage unit 13 and transmits the searched user ID to the display unit 14 for displaying. It is appreciated that the face recognition unit 12 may start to recognize the user ID only when the first image frame F1 includes a face image.
The display unit 14 may be, for example, a liquid crystal display and has a display screen 141 and/or a speaker 142 as shown in
The expression recognition unit 15 is configured to confirm a user expression according to the second image frame F2 and output a confirm signal Sc, wherein after the expression feature(s) is calculated using algorithm, the expression recognition unit 15 searches the expression data associated with the user expression in the storage unit 13 for comparison. In other words, the storage unit 13 may previously save ID information of at least one user and the expression data associated with the user expression. In the embodiment of the present disclosure, said user expression is preferably a happiness expression, but not limited to. The user expression may be set according to different users, e.g. anger, terror, dislike, surprise, sadness or expressionless.
The control unit 16 may control a setting of at least one electronic device 17 according to the confirm signal Sc, wherein the setting is associated with the user ID and may be set by the related user himself or herself. The setting may be the operational setting of the electronic device 17, e.g. operational strength, operational interval and/or operational directivity, and previously saved in the storage unit 13, wherein the setting may be different according to different electronic devices 17.
As mentioned above, as the second image frame F2 is for the confirmation of a user ID of the user 8, the image sensing unit 11 may capture the second image frame F2 after the display unit 14 has shown the ID information. However, the present disclosure is not limited that the image sensing unit 11 stops its operation in a time interval after the image sensing unit 11 capturing the first image frame F1 and before the display unit 14 showing the ID information. According to different applications the image sensing unit 11 may continuously operate or be disabled after the first image frame F1 is captured till the expression recognition unit 15 recognizes the user expression.
In one embodiment, the image sensing unit 11 starts to operate to continuously capture the first image frame F1 after the starting procedure of the user recognition and confirmation device 1 is accomplished. Therefore, preferably the face recognition unit 12 may be further configured to identify whether there is a user 8 existing in the first image frame F1. When there is no user image in the first image frame F1, a new first image frame F1 is captured. When there is a user image existing in the first image frame F1, the face recognition unit 12 starts to recognize a user ID according to the first image frame F1.
In one embodiment, the face recognition unit 12 may be further configured to identify a user to be recognized within a plurality of users in the first image frame F1. For example, when a plurality of user images are existing in the first image frame F1 simultaneously, the face recognition unit 12 may select a closest user as the user to be recognized, wherein said closest may be identified according to the size, contrast and clearness of the user image. In addition, the user to be recognized may also be identified according to other ways, e.g. the position of the user image. After the user to be recognized is identified, the face recognition unit 12 starts to perform the user ID recognition. In addition, the user recognition unit 12 may also perform the user ID recognition on all of the plurality of users and show the recognized results on the display unit 14 simultaneously. Then, the user 8 may confirm the ID information of a user to be recognized via the expression recognition unit 15.
For example, when the user recognition and confirmation device 1 is applied to a central control system for vehicles as shown in
Referring to
In addition, the user recognition and confirmation device 1 of the present disclosure may also be able to update the setting information of at least one electronic device according to the user expression. A central control system for vehicles is still used as an example herein, for example the image sensing unit 11 may capture a third image frame and the expression recognition unit 15 may confirm a user expression according to the third image frame and generate a saving signal to the control unit 16. The control unit 16 then saves the current setting information of the at least one electronic device into the storage unit 13 according to the saving signal so as to update the setting information, e.g. updating at least one of a seat position, a mirror angle, an air conditioner temperature, an audio setting, a steering wheel height, a light setting and a GPS setting. It is appreciated that the step of updating the setting information may be performed when a data update mode is entered, and the data update mode may be entered according to an instruction from the user or directly entered after the expression recognition unit 15 finishes the confirmation of the ID information without any limitation.
Referring to
Referring to
Referring to
Referring to
As mentioned above, the conventional face recognition technology and the expression recognition technology use different algorithms and have different applications. Therefore, the present disclosure further provides a user recognition and confirmation device (
Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed.
| Number | Date | Country | Kind |
|---|---|---|---|
| 101138995 | Oct 2012 | TW | national |
This application is a divisional application of U.S. application Ser. No. 14/047,682, filed on Oct. 7, 2013, which claims the priority benefit of Taiwan Patent Application Serial Number 101138995, filed on Oct. 22, 2012, the full disclosure of which is incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14047682 | Oct 2013 | US |
| Child | 16252769 | US |
