This application claims the priority benefit of Chinese application serial no. 201710342816.6, filed on May 16, 2017. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
The disclosure relates to a facial feature recognition technique, and particularly relates to an eyebrow shape guide device based on recognition of various parts of a face and a method thereof.
The love of beauty is woman's nature, and many women will add facial features through makeup, for example, to put on makeup on lips, eyes, eyebrows, etc. to adjust appearances thereof. However, the skill of makeup is not innate, and a makeup effect can be improved after a number of cosmetic practises.
If someone wants to learn a makeup kill, the learner may learn it from images on the Internet. However, the makeup skill learned through images and/or videos may have a deviation in practice. Therefore, how to learn the makeup skill through modern equipment is a technical issue concerned by manufacturers.
The disclosure is directed to an eyebrow shape guide device and an eyebrow shape guide method, where a better eyebrow shape guide block is presented according to a face image of a user, such that the user is able to shape eyebrows or put on makeup on the eyebrows according to a prompt provided by the eyebrow shape guide device, so as to provide convenient interactive makeup teaching.
The disclosure provides an eyebrow shape guide device including an image capturing unit, a processor and a display unit. The image capturing unit captures a face image of a user, where the face image at least includes a nose portion, an eye portion and an eyebrow portion of the user. The processor receives the face image, and acquires at least one nose feature point, at least one eye feature point and at least one eyebrow feature point according to the face image, and the processor performs calculation according to the at least one nose feature point, the at least one eye feature point and the at least one eyebrow feature point to obtain an eyebrow guide block. The display unit displays the face image and the corresponding eyebrow guide block, and guides the user to put on makeup according to the eyebrow guide block.
The disclosure provides an eyebrow shape guide method including following steps. A face image of a user is captured, where the face image at least includes a nose portion, an eye portion and an eyebrow portion of the user. At least one nose feature point, at least one eye feature point and at least one eyebrow feature point are acquired according to the face image, and calculation is performed according to the at least one nose feature point, the at least one eye feature point and the at least one eyebrow feature point to obtain an eyebrow guide block. The face image and the corresponding eyebrow guide block are displayed to guide the user to put on makeup according to the eyebrow guide block.
According to the above description, the eyebrow shape guide device and the eyebrow shape guide method of the disclosure calculate and display the eyebrow guide block according to positions of the nose, the eyes and the eyebrows in the face image of the user, such that the user learns a region of the eyebrow required to be shaped or emphasized, so as to accurately adjust the eyebrow shape. In this way, even the user is not familiar with the makeup, the user may still shape the eyebrows or put on makeup on the eyebrows according to the prompt provided by the eyebrow shape guide device, so as to provide convenient interactive makeup teaching.
In order to make the aforementioned and other features and advantages of the disclosure comprehensible, several exemplary embodiments accompanied with figures are described in detail below.
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
The image capturing unit 110 is used for capturing a face image of a user. In the present embodiment, an ideal position of an eyebrow shape is calculated according to positions of a nose portion, an eye portion and an eyebrow portion in the face image of the user, so that the face image of the user requires to include the nose portion, the eye portion and the eyebrow portion of a left half face or a right half face, so as to calculate a preferred relative position of the left side eyebrow or the right side eyebrow. The image capturing unit 110 is, for example, an embedded video camera, a camera, or a mobile phone, a camera, etc. connected in an external manner, which is not limited by the disclosure.
The display unit 120 may display multimedia information and the face image of the user in real-time. For example, the display unit 120 displays the face image of the user and provides options of a plurality of eyebrow shapes and eyebrow colors for the user to select. In the present exemplary embodiment, the display unit 120 can be a display disposed behind a material with a high reflectivity (for example, a mirror) and combined with organic light-emitting diodes (OLED). In this way, the user may view her own face through the mirror, and the display unit 120 may display related information on the mirror for the user to view and for touch selection, though the disclosure is not limited thereto. The eyebrow shape guide device 100 of the present embodiment can be a device disposed on a makeup table, and a screen of the eyebrow shape guide device 100 can be disposed behind the mirror, and a text or an image displayed thereon may pass through the mirror for the user to view. In other embodiments, the eyebrow shape guide device 100 can also be a consumable electronic product such as a smart phone, a tablet PC, etc., or a portable mirror box combined with a portable mirror.
The processor 130 performs a calculation according to the face image of the user captured by the image capturing unit 110, so as to obtain a plurality of face feature points of the user related to the face of the user, for example, at least one nose feature point, at least one eye feature point and at least eyebrow feature point. Moreover, the processor 130 performs calculation according to the aforementioned feature points to obtain an eyebrow guide block, and displays the face image of the user and the eyebrow guide block through the display unit 120, so as to guide the user to put on makeup according to the eyebrow guide block. For example, in an implementation of the present exemplary embodiment, the processor 130 can be a central processing unit (CPU), a microprocessor, an application specific integrated circuits (ASIC), a programmable logic device (PLD) or other similar devices. The processor 130 is configured to run various necessary software programs and/or instruction sets for providing eyebrow guide blocks. In the present exemplary embodiment, the processor 130 runs a face detection system using a Dlib face landmark to detect and analyze 194 face feature points of the user's face. These face feature points respectively represent various portions of the user face, for example, eyes, eyebrows, a nose, lips, a chin contour, etc. In other cases, the face feature points of the user can be acquired by only analyzing 119 face feature points of the user's face or using other face feature point algorithms for detecting the face feature points of the user.
In the present embodiment, when the user faces the mirror to put on a makeup, the display unit 120 may display the face image of the user, and analyze the face feature points in the face image in real-time. In order to provide convenience to interact with the eyebrow shape guide device, in the disclosure, the eyebrow guide block used for guiding the makeup is further calculated based on positions of nosewings located at two sides of the user's nose, the eyes and the eyebrows, etc., and the eyebrow guide block is displayed on the display unit 120 corresponding to the face image of the user, so as to prompt a position of the eyebrow required to be shaped or put on makeup to the user. Moreover, the user may adjust a thickness, a position, a shape of the eyebrow guide block through the display interface shown in
Referring to
In step S330, the processor 130 performs calculation according to the at least one nose feature point, the at least one eye feature point and the at least one eyebrow feature point obtained in the step S320 to obtain an eyebrow guide block.
In
The processor 130 obtains a first reference point NR1 according to an intersection of a first extending line L1 passing through the first feature point NF1 (a nosewing endpoint of the nose NE1) and a second feature point NF2 (an endpoint of the first eye E1 located the farthest away from one side of the nose NE1) and a second horizontal line L2 of the third feature point NF3 (a tip endpoint of the first eyebrow ER1). The first reference point NR1 serves as a tail indication point of the eyebrow guide block.
The processor 130 obtains a second reference point NR2 according to an intersection of a third vertical line L3 of the first feature point NF1 (the nosewing endpoint of the nose NE1) and the second horizontal line L2 of the third feature point NF3 (the tip endpoint of the first eyebrow ER1). The second reference point NR2 serves as a tip indication point of the eyebrow guide block.
After the tip indication point and the tail indication point of the eyebrow guide block are obtained according to the above calculation method, a peak indication point of the eyebrow guide block is required to be found. Referring to
The eyebrow shape guide method of the disclosure may adjust a pattern of the eyebrow guide block according to user's selection, for example, eyebrow shapes such as a “-”-shape eyebrow, a hill-shape eyebrow, a willow leaf-shape eyebrow, a bright eyes eyebrow, etc. Alternatively, the user may also select a color and a shape of the eyebrow through the display interface of the display unit 120 shown in
In summary, the eyebrow shape guide device and the eyebrow shape guide method of the disclosure may calculate and display the eyebrow guide blocks according to positions of the nose, the eyes and the eyebrows in the face image of the user, such that the user learns a region of the eyebrow required to be shaped or emphasized, so as to accurately adjust the eyebrow shape. In this way, even the user is not familiar with makeup, the user may still shape the eyebrows or put on makeup on the eyebrows according to the prompt provided by the eyebrow shape guide device, so as to provide convenient interactive makeup teaching.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure cover modifications and variations of this disclosure provided they fall within the scope of the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2017 1 0342816 | May 2017 | CN | national |
Number | Name | Date | Kind |
---|---|---|---|
9204702 | Soare | Dec 2015 | B2 |
20150262403 | Yamanashi | Sep 2015 | A1 |
20170169285 | Chen | Jun 2017 | A1 |
Entry |
---|
“Search Report of Europe Counterpart Application”, dated Feb. 28, 2018, p. 1-p. 7, in which the listed references were cited. |
Number | Date | Country | |
---|---|---|---|
20180332950 A1 | Nov 2018 | US |