Patent Application
20170177927
The present invention relates to an impression analysis device, a game device, a health management device, an advertising support device, an impression analysis system, an impression analysis method, a program, and a program recording medium.
Recently, with a rapid improvement of facial image recognition technique, a technique for estimating attribute information such as age, gender and the like, is utilized in vending machines and digital signages (Patent Literature 1, for example). The facial image recognition technique is widely applicable for marketing, security and the like, and becoming an important technique to deploy services adjusted for individuals.
[PTL 1] JP 2011-18125 A
However, an example utilizing the facial image recognition technique for a face impression analysis has not existed before. On the other hand, an impression evaluation of a face of a person to be evaluated by other people is a matter of interest. However, the problems are, it is not easy to ask other people about the impression evaluation of the face of the person to be evaluated, and an objective evaluation cannot be acquired easily.
Accordingly, an exemplary object of the present invention is to provide an impression analysis device, a game device, a health management device, an advertising support device, an impression analysis system, an impression analysis method, a program, and a program recording medium, that can easily acquire an impression evaluation about the face of a person to be evaluated.
To achieve the exemplary object, an impression analysis device according to the present invention includes: a storage unit that stores, as impression information, a preliminarily acquired facial image and an impression evaluation with respect to the facial image by an impression evaluator, to be stored in such a manner that the facial image is associated with the impression evaluation; a learning unit that extracts a feature point from the facial image and generates an evaluation criterion by referring to the impression information; and an impression analysis result generation unit that generates an impression evaluation result from a facial image of a person to be evaluated, based on the evaluation criterion generated by the learning unit.
To achieve the exemplary object, a game device according to the present invention includes the impression analysis device of the present invention.
To achieve the exemplary object, a health management device according to the present invention includes the impression analysis device of the present invention.
To achieve the exemplary object, an advertising support device according to the present invention includes the impression analysis device of the present invention.
To achieve the exemplary object, an impression analysis system according to the present invention includes: a server including the impression analysis device according to the present invention; an input terminal; and an output terminal. The input terminal and the output terminal are connected to the server via a communication line network; the input terminal includes at least one of a unit that inputs the specific impression evaluation and a unit that captures a facial image of the person to be evaluated; and the output terminal includes at least one of a unit that displays the detected impression evaluation and a means that displays at least one from the group consisting of the impression analysis result generated by the impression analysis result generation unit, the impression analysis result image, the advertisement information, and the impression comparison result.
To achieve the exemplary object, an impression analysis method according to the present invention includes: storing, as impression information, a preliminarily acquired facial image and an impression evaluation with respect to the facial image by an impression evaluator, to be stored in such a manner that the facial image is associated with the impression evaluation; extracting a feature point from the facial image and generating an evaluation criterion by referring to the impression information; and generating an impression analysis result based on a facial image of a person to be evaluated, using the evaluation criterion.
To achieve the exemplary object, a program according to the present invention is for causing a computer to perform the above impression analysis method of the present invention.
To achieve the exemplary object, a program recording medium according to the present invention is a computer-readable recording medium that records the above program.
The present invention can provide an impression analysis device, a game device, a health management device, an advertising support device, impression analysis system, an impression analysis method, a program, and a program recording medium, that can easily acquire an impression evaluation about the face of a person to be evaluated.
The present invention is described by way of example. However, the scope of the present invention is not limited by the following description. From
The input terminal and the output terminal 1 may be a same terminal, or individual terminals.
The input terminal 1A includes at least one of a unit that inputs a specific impression evaluation and a unit that captures a facial image of a person to be evaluated. The output terminal 1B includes at least one of a unit that displays impression information detected by an impression information detection unit, and a unit that displays at least one from the group consisting of an impression analysis result generated by an impression analysis result generation unit 13, an impression analysis result image, advertising information, and an impression comparison result. The examples of the unit that inputs a specific impression evaluation include a general text input unit or a speech input unit and the like. An image capturing unit includes a CCD (Charge Coupled Device) camera, a CMOS (Complementary Metal Oxide Semiconductor) camera, or a scanner and the like. The input terminal and the output terminal 1 is not particularly limited. For example, The input terminal and the output terminal 1 includes a mobile phone, a smartphone, a personal computer (PC), a tablet terminal and the like, preferably a mobile phone, a smartphone or a tablet terminal. The output terminal 1B may further include a unit that displays the facial image to be evaluated when inputting the impression evaluation.
As described below, the impression analysis device 2 of the present exemplary embodiment may include the input terminal 1A and the output terminal 1B as an input unit and an output unit respectively. In this case, the impression analysis device 2 is connected directly to the server 3 as the input unit and output unit, without connected to the communication line network 4.
The storage unit 11 stores, as impression information, a preliminarily acquired facial image and an impression evaluation with respect to the facial image by an impression evaluator, to be stored in such a manner that the facial image is associated with the impression evaluation. The storage unit 11, for example, may store a facial image of the person to be evaluated. The learning unit 12 generates an evaluation criterion by extracting a feature point from the stored facial image and referring to the impression information. The impression analysis result generation unit 13 generates an impression analysis result from the facial image of the person to be evaluated, based on the evaluation criterion generated by the learning unit 12. For example, in the case that the facial image of the person to be evaluated is stored in the storage unit 11, the impression analysis result generation unit 13 generates the impression analysis result from the facial image of the person to be evaluated stored in the storage device 11.
The impression analysis result image generation unit 14 generates an impression analysis result image based on the impression analysis result generated by the impression analysis result generation unit. The impression comparison information generation unit 15 generates an impression comparison result by comparing the impression analysis results of each of the facial images generated by the impression analysis result generation unit 13. The advertisement selection unit 16 selects an advertisement according to the impression analysis result of the person to be evaluated. The impression analysis result image generation unit 14, impression comparison information generation unit 15 and the advertisement selection unit 16 are arbitrary components. The impression analysis device 2 may include at least one of these.
The storage unit 11 is not limited. The storage unit 11 includes, for example, a database or a server, a random access memory (RAM), a read-only memory (ROM), a hard disk (HD), an optical disk, a floppy (trademark) disk (FD) and the like. The storage unit 11 may be, for example, a built-in type or an external type such as external storage device.
Also, each component of the first exemplary embodiment may include, for each component respectively, hardware configuration shown in
The present exemplary embodiment and the present invention explained with each exemplary embodiment described below as an example may be configured by a non-volatile storage medium such as compact disc and the like that stores the program therein. The program stored in the storage medium may be, for example, read out by a drive device.
A communication executed by the impression analysis device 2 is realized by, for example, an application program controlling the communication interface utilizing a function provided by an OS (Operating System).
The impression analysis device 2 may be configured by two or more physically separate devices connected with or without wires.
The example of the hardware configuration shown in
In the present exemplary embodiment, the facial image is not limited and, for example, may be an image from front, side, oblique above or from below. Also, the facial image may include hair or accessories such as pierced earrings or earrings.
In the present exemplary embodiment, the impression evaluators are not limited, and may be an unspecified number of persons, a specified number of persons, or only the users themselves. Also, the impression evaluators may be fixed, or may be changed from time to time. In the case that the impression evaluators are composed of an unspecified number of people, the impression analysis result of the face of the user by the general public can be known. Hence, for example, the knowledge of how to enhance the charming feature of the users can be acquired.
In the case that the impression evaluators are composed only of the users themselves, the preliminarily acquired facial images can be sorted and selected according to the viewpoint of the person to be evaluated. The group of a specified number of persons is, without limitation, a group of people composed of persons belonging to at least one of the group consisting of a specific business type, job type, and attribute, for example. The specific business types include, for example, the service industry, banking industry, health industry, beauty salon business and the like. The examples of the job types include sales position, a human resources division of a company that conducts interviews and the like. Job types include, preferably, professionals such as doctors and the like, or well-known specialist of beauty or health and the like. Examples of attributes include gender, age, a target demographic of a specific product and the like, and may be a combination of these. Examples of the combined attribute include, specifically, a demographic of elderly males, male company employees in the forties and the like.
By limiting the impression evaluators to a specified number of persons, the person to be evaluated can acquire an objective and accurate evaluation of his impression. Specifically, for example, in the case that the impression evaluators are composed of interviewers belonging to a human resource division, the user of the impression analysis system can learn the good impression for the interviewers. Further, for example, in the case the impression evaluators are composed of beauty specialists, the person to be evaluated in the impression analysis system can acquire a more objective and accurate impression analysis result about the facial image of the person to be evaluated himself.
Moreover, for example, when the impression evaluators are composed of an elderly demographic, the impression analysis system user can learn the appropriate impression at Buddhist memorial services and the like. Moreover, for example, a case is considered in which the impression analysis system user is a dealer of a specific product, and the impression evaluators are composed of the target demographic of the specific product. In this case, the user can learn the point of view by the target demographic about the employees (target persons to be evaluated), so the user can improve their services for customers.
In the present exemplary embodiment, impression elements in the impression evaluation is not limited, and may be fixed or may be changed appropriately by addition, deletion and the like. The impression elements include, specifically, cheerfulness, freshness, cuteness, goodness of the look as a businessman, tenderness, healthiness, coquettishness, chicness, elegance, dandiness, wildness and the like. Examples of impression elements also include the impression of the facial expression at the time of such as a bad mood, anger, irritation, fatigue, and the like.
The impression evaluation may be, without limitation, any evaluation of the impression elements; however, an impression evaluation according to a specific situation is preferable. Examples of impression evaluations according to a specific situation include whether the impression elements are appropriate or inappropriate in ceremonial occasions such as a wedding ceremony or a Buddhist memorial ceremony, a meeting of PTA (Parent-Teacher Association) or a party, whether the makeup is matched or not matched, whether the impression elements meet the standard of a specific company or not, and the like. Hence, the person to be evaluated can learn, in a specific situation, if his appearance is appropriate or not for the scene, and can handle the situation properly. Also, an impression evaluation according to a specific situation may be an impression evaluation of an appearance of a stranger who is affected by a specific product or a service. Specific examples thereof include whether a person is satisfied or feels bored in a situation that he is watching a specific movie at a theater, whether a person is interested or bored at a business negotiation, and the like. Thus, the user of the impression analysis system can acquire the information about whether the person to be evaluated is interested or not and the like, and the user of the impression analysis system can change the response accordingly. Specifically, in a specified situation of a business negotiation, with the impression evaluation against the facial image of the person to be evaluated, it will become easier to make a projection if he will close the deal or not. Also, an impression evaluation according to a specific situation may be an impression evaluation of an appearance of a stranger whose body and mental conditions are reflected. Specifically, the examples include a person who is likely to suicide himself at a railway platform, a suspicious individual or a shoplifter at a convenience store, or a drunk person at a sobriety checkpoint and the like. Thus, for example, the evaluation helps preliminarily detecting the behavior of the person to be evaluated, and is useful for preventing crimes, accidents and the like.
The impression analysis result may be quantified as follows: for example, the degree of beauty is 70 points, makeup trend is 91 points, the degree of brightness and freshness is 85 points, cuteness is 72 points, and so on. Also, impression analysis result may include an acceptance criterion, and acceptance judgements include an acceptance judgment of a smile face and the like. Thus, for example, since a customer-facing employee can check his own smile every day, the impression analysis device can be utilized as a service training tool. In addition, for example, the impression analysis device can be installed at a career center of a collage or a public employment security office (for example, “Hello Work” in Japan) and is able to be utilized as a training support device of a job interview. Also, it can be utilized as a training support device for people who appear in the public, for example, at a lecture meeting or teachers.
An impression analysis result is, for example, an estimation result of an impression evaluation given by an impression evaluator. Moreover, in addition to the estimation result, the impression analysis result includes at least one of an advice based on the purpose of use and a recommendation, preferably. The advice may be, without limitation, for example, a recommendation of makeup, glasses or hairstyle that matches the facial features of the facial image, an improvement of the makeup or the facial expression such as a smile of the facial image and the like. The recommendation may be products such as a suitable makeup product, glasses, a wig and the like for improving the impression of the facial expression, or a shop selling such products. Also, the recommendation may be, for example, an advertisement of a service and the like that instructs a makeup and the like suitable for a specific occasion such as ceremonial occasion and the like.
In the present exemplary embodiment, examples of feature points include, without limitation, a part of the face, a hairstyle, an accessory such as an earring or a pierced earing, glasses, a makeup product and the like. Examples of the parts of the face include an outer corner of an eyebrow, an inner corner of an eyebrow, an outer corner of an eye, an inner corner of an eye, corners of a mouth, an upper lip, a chin, a pupil of an eye and the like. The makeup products include a colored contact lens, a fake eyelash, a lipstick, a blusher, an eyeshadow and the like.
In the present exemplary embodiment, examples of the impression analysis result images include, without limitation, a graph such as a radar chart quantifying a plurality of impression analysis results per each impression element and the like. The impression analysis result image further includes, preferably, a processed facial image of the person to be evaluated, based on the impression analysis result. Examples of the processed facial images include, without limitation, a face with an improved makeup based on the advice, a face after a plastic surgery and the like.
In the present exemplary embodiment, examples of the impression comparison results include, without limitation, specifically, an impression comparison result between before and after applying a makeup, before and after wearing glasses, or before and after changing a hairstyle, an impression comparison result between before and after applying a plastic surgery or an aesthetic treatment, an impression comparison result between before and after training at a gym, and the like. Moreover, the impression comparison result can be displayed in the form of a graph such as a radar chart quantifying the impression analysis result of each impression element.
In the present exemplary embodiment, the advertisements include, without limitation, a general product or a service, a shop and the like. An advertisement can be, specifically, for example, according to an impression of a facial image, or a desired impression specified by a person to be evaluated, a suitable product such as a makeup product, glasses, wig and the like or a shop selling such products. Also, advertisements include, specifically, a service and the like that provides advice for a suitable makeup and the like for a specific occasion such as a ceremonial occasion and the like.
The impression analysis device 2 may further include an input unit and an output unit. In this case, the input unit includes at least one of a unit for inputting a specific impression evaluation, and a unit for capturing a facial image of a person to be evaluated. Moreover, the output unit includes at least one of a unit for displaying a detected impression information and a unit for displaying at least one from the group consisting of an impression analysis result generated by the impression analysis result generation unit, an impression analysis result image, advertisement information, and an impression comparison result. The output unit may include a unit for displaying a facial image for evaluation when an impression evaluation is inputted.
The impression analysis device 2 can be suitably used for a wide range of fields and industries. Specifically, the examples include, cosmetics (field) industry, wedding or job placement industry, gaming field (industry), health field (industry), advertising field (industry) and the like.
The impression analysis system 10 may be utilized in the form of cloud computing. Hence a system adjusted for timely trend can be supplied. Specifically, for example, an impression analysis of a makeup following the seasonal trend can be supplied.
An impression analysis method of the current exemplary embodiment is described with reference to
Firstly, before executing the impression analysis method of the present exemplary embodiment, a plurality of facial images are prepared, and an impression evaluation by an impression evaluator for each facial image is acquired. Specifically, as one example of acquiring an impression evaluation, for example, the impression evaluator inputs an impression evaluation for the facial image, against the facial image displayed on a terminal by an output unit. Secondly, the facial image and the impression evaluation against the facial image by the impression evaluator are associated and stored in a database (the storage unit 11) as impression information. Then, the learning unit 12 extracts a feature point from each facial image, and generates an evaluation criterion with reference to the impression information.
An execution of the impression analysis method of the present exemplary embodiment is described below with reference to block diagrams shown in
The impression analysis method of the present exemplary embodiment is described above, while an application of the impression analysis system to the cosmetic industry is described below.
Firstly, the person to be evaluated (female) launches an impression evaluation tool on her smartphone (input terminal). Then, the person to be evaluated uploads her facial image stored on the smartphone or captured using a camera mounted on the smartphone, to the impression analysis result tool. Then, as shown in status (A) of
In status (B) of
Although not shown in status (B) of
In status (C) of
In the above example, a case that the makeup simulation is carried out automatically is described. However, the person to be evaluated may capture and compare her facial images before and after applying a makeup respectively. Specifically, as shown in status (D) of
In the above example, the person to be evaluated is exemplified as a female; however, the person to be evaluated can be a male, and an application for male cosmetics is possible. Application examples include an evaluation of favorable impression of a businessman observed by a client (a stranger) and the like.
An impression analysis system of the present exemplary embodiment is identical to the impression analysis system in the first exemplary embodiment, except that an impression analysis device 2A includes an impression information registration unit and an impression information detection unit.
Examples of the identification information include, without limitation, for example, a name of the person to be evaluated, an attribute such as age or gender and the like, occupation, income, hometown, education, area of specialty, hobby, address, phone number, e-mail address and the like.
The execution of the impression analysis method of the present exemplary embodiment is described below with reference to the block diagram shown in
Firstly, a registration method of impression information of a person to be evaluated is described with reference to the flowchart of
Then, an impression information detection method is described with reference to the flowchart of
The impression analysis method of the present exemplary embodiment is described above, while an application of the impression analysis system in the marriage support industry is described specifically below.
Firstly, a user (female) launches an impression analysis tool on her smartphone (input terminal). Then, the user, as shown in status (A) of
Then, the female user, as shown in status (C) of
The above example is exemplified as a marriage system without limitation, and it can suitably be utilized for setting a matchmaking party, a spouse hunting party and the like.
Also, as another example, specifically, the impression analysis system can be utilized suitably at an application document selection process of an interview examination in which certain impressions are specified and applicants are selected accordingly. Examples of specific impressions include, motivated, cheerful, clean and the like.
In the present exemplary embodiment, a game device that includes the impression analysis device in the first exemplary embodiment is described. A game device may be, for example, only the impression analysis device, or a combination of the impression analysis device and an existing game device or instrument including an image capture unit. As a game device, in the case the impression analysis device is utilized independently, by displaying a degree of handsomeness, beauty, sexual attractiveness and the like as the impression analysis result, the impression analysis device may be utilized at a male or female beauty pageant or the like. Also, an impression analysis device may be, for example, installed for household use, or at a video game arcade, or at a theme park such as an amusement park, as a game device for comparing an impression with that of a celebrity, a friend, or a previous person to be evaluated. On the other hand, in the case the impression analysis device is combined with an existing game device or instrument, examples of the existing game devices include, specifically, a photo booth such as Print Club (trademark) and the like. Also, in the case of a game device in which the impression analysis device is combined with Print Club (trademark), for example, as shown in
In the present exemplary embodiment, a health management device including the impression analysis device 2 or 2A in the first exemplary embodiment is described. A health management device can be, for example, only the impression analysis device 2 or 2A, or a combination of the impression analysis device and an existing health management device. In the case the impression analysis device 2 or 2A is utilized independently, for example, as shown in
In the present exemplary embodiment, an advertising support device including the impression analysis device in the first exemplary embodiment is described. An advertising support device may be, for example, only the impression analysis device, or a combination of the impression analysis device and an existing advertisement device. Specific examples of advertisement devices include a digital signage and the like. In this case, by acquiring an impression analysis result by the public by making an unspecified number of public persons watching the digital signage the persons to be evaluated, a status of the watchers such as interested, likely to buy can be comprehended.
A program of the present exemplary embodiment is a program that is able to execute the impression analysis method of the first exemplary embodiment on a computer. The program of the present exemplary embodiment can be recorded on a storage media. Examples of storage medium include, without limitation, a Read Only Memory (ROM), a hard disk (HD), an optical disk, floppy (trademark) disk (FD) and the like.
The present invention has been described above by referring to the exemplary embodiments. However, the present invention is not intended to be limited by the above exemplary embodiments. It is possible to make various modifications those skilled in the art can understand to the configuration and the details of the present invention within the scope of the present invention.
The present invention has been described with the above-described exemplary embodiments as ideal examples. However, the present invention is not limited by the above-described exemplary embodiments. Thus, within the scope of the present invention, it is possible to apply various aspects that those skilled in the art can understand to the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2014-027981 | Feb 2014 | JP | national |
This application is a National Stage Entry of PCT/JP2015/000671 filed on Feb. 13, 2015, which is based on and claims the benefit of Japanese Patent Application No. 2014-027981 filed on Feb. 17, 2014, and the entire disclosures of the above application are incorporated herein by reference.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2015/000671 | 2/13/2015 | WO | 00 |
