The present invention relates to an information processing device, an information processing method, and a recording medium, and more particularly relates to an information processing device, an information processing method, and a recording medium that execute search processing based on a search condition.
PTL 1 describes an information search method of searching for an image that matches a search condition using one or more input keywords as a search condition. In PTL 1, for each image obtained as a result of a search, one search condition (that is, one keyword) satisfied by the image is presented. Therefore, the user can easily know on which search condition the image has been obtained.
In the information search method described in PTL 1, when a search using a plurality of search conditions is executed, a user cannot know a target that satisfies two or more search conditions that are all or a part of the plurality of search conditions.
An object of the present invention is to assist in knowing a target that satisfies a plurality of search conditions.
An information processing device according to an aspect of the present invention includes a search means configured to search for a target that satisfies at least one of one or more search conditions that have been input, and a presentation means configured to present, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions, based on a result of the search by the search means.
An information processing method according to an aspect of the present invention includes searching for a target that satisfies at least one of one or more search conditions that have been input, and presenting, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions, based on a result of the search.
A recording medium according to an aspect of the present invention stores a program for causing a computer to execute searching for a target that satisfies at least one of one or more search conditions that have been input, and presenting, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions, based on a result of the search.
According to the present invention, it is possible to assist in knowing a target that satisfies a plurality of search conditions.
A configuration of an information processing device 1 according to a present first example embodiment will be described with reference to
(Information Processing Device 1)
The search unit 10 searches for a target that satisfies at least one of one or more search conditions that have been input. The search unit 10 is an example of a search means.
Specifically, the search unit 10 uses one or more keywords, images, or the like that have been input by the user as search conditions to search a database (not illustrated), for a target that satisfies each search condition. For example, when the search target is image data of a person, the search condition may be a keyword representing one or more attributes (sex, age, length of hair, color of hair, type of clothes, belongings, and the like) of the person.
The search unit 10 presents a search screen and receives an input of a search condition from the user. For example, when the user inputs one or more keywords on the search screen using an input device such as a keyboard and a mouse, the search unit 10 acquires the one or more input keywords as one or more search conditions.
Using the acquired one or more search conditions, the search unit 10 acquires one or a plurality of pieces of image data that matches each search condition from the database. In the present first example embodiment, the image data stored in the database is a target of the search by the search unit 10. A result of the search by the search unit 10 includes one or a plurality of pieces of image data that satisfies at least one of the one or more input search conditions. The information processing device 1 may include a database or may be connected to the database via a network.
The search unit 10 transmits the above-described result of the search to the presentation unit 20. The result of the search at least includes one or a plurality of pieces of image data that satisfies at least one of the one or more input search conditions and information for specifying each target. For example, when the search target is image data stored in a database, the result of the search includes an image identification (ID) added to each piece of image data in the database.
The presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions on the basis of the result of the search by the search unit 10. The presentation unit 20 is an example of a presentation means.
Specifically, the presentation unit 20 receives the result of the search from the search unit 10. On the basis of the result of the search received from the search unit 10, the presentation unit 20 generates a list indicating which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions. The presentation unit 20 presents the list thus generated by outputting the list to a display, which is not illustrated, or the like. The presentation unit 20 may present the list by any method.
For example, the presentation unit 20 presents the list by using a bar graph assigned to each of the search conditions. Alternatively, the presentation unit 20 presents a two-dimensional graph in which one axis is related to the search condition and the other axis is related to the search target on the display. In this graph, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions are indicated by a number, a symbol, a character, a figure, or a picture.
Some examples of presentation by the presentation unit 20 will be described later.
(Operation Flow of Information Processing Device 1)
A flow of operation of the information processing device 1 according to the present first example embodiment will be described with reference to
As illustrated in
The presentation unit 20 receives the result of the search from the search unit 10. On the basis of the result of the search received from the search unit 10, the presentation unit 20 presents, in a list, which search condition or conditions each target satisfies and which search condition or conditions each target does not satisfy (S2). For example, the presentation unit 20 presents the list by using a bar graph assigned to each of the search conditions.
Thus, the operation of the information processing device 1 ends.
(Example of Search Screen)
A search screen on which the search unit 10 receives an input of a search condition from the user will be described with reference to
In
The search unit 10 executes what is called OR search. That is, the search unit 10 searches the database for each piece of the image data of the person classified into the attribute indicated by one of the three keywords “male”, “black hair”, and “blue shirt” illustrated in
The search unit 10 may use supervised learning or unsupervised learning to search for the image data of a person classified into the attribute indicated by the keywords.
Specifically, the search unit 10 first specifies feature data related to the input keywords. For example, the search unit 10 specifies the feature data related to the input keywords by referring to a table, which is not illustrated, in which the keywords and the feature data are associated with each other.
Alternatively, the search unit 10 collects sample images tagged with the input keywords from a server on any network. Then, the search unit 10 extracts the feature data from the collected sample image. The feature data includes, for example, a feature vector. The search unit 10 associates the feature data extracted from the sample image with the input keyword.
Next, the search unit 10 extracts the feature data from the image data on the database. Alternatively, the search unit 10 may extract the feature data in advance from the image data on the database. The search unit 10 calculates a similarity between the feature data extracted from the image data on the database and the feature data related to the keyword. The similarity may be based on, for example, a distance between feature vectors included in the feature data.
The search unit 10 extracts, from all the image data on the calculation database, image data of which calculated similarity exceeds a threshold or several (2 or 3) pieces of high-ranking image data in descending order of similarity. The search unit 10 outputs the image data thus extracted as the result of the search.
Alternatively, the image data of the person in the database may be classified or clustered in advance for each attribute of the person. For example, information indicating an attribute of a person is associated with each piece of the image data of the person in the database.
The search unit 10 specifies an attribute related to the input keyword by referring to a table, which is not illustrated, in which the keyword and the attribute of the person are associated with each other. The search unit 10 compares the information indicating the attribute of the person indicated by the input keyword with the information indicating the attribute of the person associated with the image data of the person. Then, the search unit 10 searches the database for the image data of the person classified into the same attribute as the attribute of the person indicated by the keyword.
The presentation unit 20 presents a list of image data of persons obtained as results of the search. For example, the presentation unit 20 presents a list of image data of persons obtained as the results of the search on a display, which is not illustrated.
Here, the “attribute” of a person is an appearance feature of the person. In
As described above, on the basis of the results of the search, the presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions. Hereinafter, some examples of the presentation of the list by the presentation unit 20 will be described.
In the bar graphs illustrated in
For example, in the uppermost bar graph illustrated in
In
In
On the other hand, in
The positions, shapes, and sizes of the six charts correspond to the positions, shapes, and sizes of the six targets on the search screen illustrated in
In
The search unit 10 searches for a target that satisfies one or more search conditions that have been input, and the presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions on the basis of a result of the search by the search unit 10. In a case where a plurality of search conditions is input, the user can check the presented list and understand a target that satisfies two or more search conditions that are all or a part of the plurality of search conditions. Therefore, it is possible to assist in knowing a target that satisfies a plurality of search conditions.
A present second example embodiment will be described with reference to
(Information Processing Device 2)
The certainty factor determination unit 30 determines a lower limit value of the certainty factor that is a value representing likelihood of a result of a search. The certainty factor determination unit 30 is an example of a certainty factor determination means. The lower limit value of the certainty factor is a criterion when the search unit 10 executes the search.
In the first example embodiment, the lower limit value of the certainty factor is a fixed value that is set in advance. On the other hand, in the present second example embodiment, the lower limit value of the certainty factor is determined on the basis of a user operation. In the present second example embodiment, an initial value of the lower limit value of the certainty factor is set in advance. However, the lower limit value of the certainty factor is variable.
A specific example of enabling the user to perform an operation (user operation) for changing the lower limit value of the certainty factor from the search screen will be described later. The certainty factor determination unit 30 transmits information on the lower limit value of the certainty factor determined on the basis of the user operation to the search unit 10.
The search unit 10 executes a search for the target using the lower limit value of the certainty factor. More specifically, the search unit 10 searches for a target for which a value representing likelihood of satisfying the search condition necessarily exceeds the lower limit value of the certainty factor. For example, in a case where the search condition is “male” and the lower limit value of the certainty factor is 80%, only a target for which the probability that the attribute of the target is “male” exceeds 80% is included in results of the search by the search unit 10.
The certainty factor determination unit 30 presents the lower limit value of the certainty factor determined for each search condition. For example, the certainty factor determination unit 30 presents the lower limit value of the certainty factor determined for each search condition on a slide bar.
The certainty factor determination unit 30 receives a user operation for changing the lower limit value of the current certainty factor for each search condition. For example, the certainty factor determination unit 30 receives a user operation of moving a slider on the slide bar. In this case, the certainty factor determination unit 30 determines the lower limit value of the certainty factor on the basis of the position of the slider on the slide bar. An example of presentation of the lower limit value of the certainty factor by the certainty factor determination unit 30 will be described later.
(Operation Flow of Information Processing Device 2)
A flow of operation of the information processing device 2 according to the present first example embodiment will be described with reference to
As illustrated in
The search unit 10 receives the information of the lower limit value of the certainty factor from the certainty factor determination unit 30. The search unit 10 searches for a target that satisfies at least one of one or more search conditions using the lower limit value of the certainty factor (S102). The search unit 10 transmits a result of the search to the presentation unit 20.
As described in the first example embodiment, the result of the search at least includes one or a plurality of pieces of image data that satisfies at least one of one or more search conditions that have been input and information for specifying each target.
The presentation unit 20 receives the result of the search from the search unit 10. The presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy (S103). For example, as described in the first example embodiment, the presentation unit 20 displays a chart including bar graphs assigned one-to-one to the search conditions on the display (see, for example,
The certainty factor determination unit 30 determines whether the user operation for changing the lower limit value of the certainty factor has been performed (S104).
In a case where the user operation for changing the lower limit value of the certainty factor has not been performed (No in S104), the operation of the information processing device 2 ends.
On the other hand, in a case where the user operation for changing the lower limit value of the certainty factor has been performed (Yes in S104), the flow returns to step S101. In step S101, the certainty factor determination unit 30 adjusts the lower limit value of the certainty factor on the basis of the user operation. Thereafter, the flow proceeds to step S102 described above.
(Presentation of Lower Limit Value of Certainty Factor; Example of Search Screen)
An example of presentation of the lower limit value of the certainty factor by the certainty factor determination unit 30 will be described with reference to
A slide bar is displayed below the numerical value representing the lower limit value of the current certainty factor. The left end of the slide bar is related to the lowest certainty factor (0%) and the right end of the slide bar is related to the highest certainty factor (100%). The user performs the user operation for changing the lower limit value of the certainty factor. Specifically, the user changes the lower limit value of the certainty factor by moving a slider on the slide bar. In
The certainty factor determination unit 30 determines the lower limit value of the current certainty factor in accordance with the amount of movement of the slider. In
When the information of the lower limit value of the certainty factor determined by the certainty factor determination unit 30 is received or when the search key is pressed or clicked, the search unit 10 re-searches for the target using the lower limit value of the certainty factor determined by the certainty factor determination unit 30.
According to the configuration of the present embodiment, the search unit 10 searches for a target that satisfies one or more search conditions that have been input, and the presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions, on the basis of a result of the search by the search unit 10. In a case where a plurality of search conditions is input, the user can check the presented list and understand a target that satisfies two or more search conditions that are all or a part of the plurality of search conditions. Therefore, it is possible to assist in knowing a target that satisfies a plurality of search conditions.
Further, the certainty factor determination unit 30 determines a lower limit value of the certainty factor that is a value representing likelihood of the result of the search. The search unit 10 executes a search for the target using the lower limit value of the certainty factor. Therefore, it is possible to obtain, as the result of the search, a target for which a value representing the likelihood of satisfying the search condition exceeds the lower limit value of the certainty factor.
A present third example embodiment will be described with reference to
(Information Processing Device 3)
The recommendation unit 40 recommends another search condition for further narrowing targets included in results of the search. The recommendation unit 40 is an example of a recommendation means.
Specifically, the recommendation unit 40 receives, from the search unit 10, results of the search using one or a plurality of candidates for other search conditions (hereinafter, may be referred to as second search conditions) different from one or more search conditions that have been input (hereinafter, may be referred to as first search conditions). The results of the search include information indicating whether the target satisfies or does not satisfy the candidates for the other search conditions (second search conditions). The results of the search include information for specifying the targets included in the results of the search.
The recommendation unit 40 selects another search condition that is recommended (hereinafter, may be referred to as a third search condition) from among the one or the plurality of candidates for the other search conditions (second search conditions) on the basis of the received results of the search.
Specifically, the recommendation unit 40 preferably selects, as the another search condition that is recommended (third search condition), a candidate for the other search conditions (second search conditions) by which the targets are divided as equal as possible.
That is, the recommendation unit 40 preferably determines the another search condition that is recommended (third search condition) by which the targets that satisfy the one or more input search conditions (first search conditions) are divided into about 50% that satisfies the another search condition and about 50% that does not satisfy the another search condition, or the targets are as close as possible to the ratio of 50%:50%. One of the reasons is to reduce, when examination of the targets is shared by two or more users, deviation between a cost for examining all targets that satisfy the another search condition (user's labor) and a cost for examining all targets that do not satisfy the another search condition.
The recommendation unit 40 recommends the another search condition determined in this manner to the user. For example, the recommendation unit 40 presents a message or the like prompting addition of the another search condition.
In addition, the recommendation unit 40 presents a result of the search in a case where the search for the target is performed using the another search condition. For example, the recommendation unit 40 presents the result of the search in a circular graph in a case where the another search condition is used. An example of presentation by the recommendation unit 40 will be described later.
(Operation Flow of Information Processing Device 3)
The flow of the operation of the information processing device 3 according to the present third example embodiment will be described with reference to
As illustrated in
The search unit 10 transmits the result of the search using the first search condition to the presentation unit 20. As described in the first example embodiment, the result of the search includes information indicating which search condition each target satisfies or does not satisfy, and information for specifying each target.
The presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions of the target on the basis of the result of the search by the search unit 10 (S202). For example, as in the first example embodiment, the presentation unit 20 displays a chart including bar graphs assigned one-to-one to the search conditions on the display (see
The recommendation unit 40 acquires a result of the search using the one or the plurality of candidates for the other search conditions (second search conditions) from the search unit 10 (S203).
The recommendation unit 40 determines the another search condition (third search condition) that is recommended on the basis of the result of the search using the one or the plurality of candidates for the other search conditions (second search conditions) (S204). As described above, the recommendation unit 40 preferably selects, as the another search condition, a candidate for the other search conditions (second search conditions) by which the targets are divided as equal as possible.
The recommendation unit 40 presents a result of the search by the selected another search condition (S205).
Thus, the operation of the information processing device 3 ends. The steps S201 and S202 and the steps S203 to S205 may be performed in any order. That is, the steps S203 to S205 may be executed before the steps S201 and S202.
(Recommendation of Another Search Condition)
According to
According to the configuration of the present embodiment, the search unit 10 searches for a target that satisfies one or more search conditions that have been input, and the presentation unit 20 presents, in a list, which search condition or conditions the target satisfies and which search condition or conditions the target does not satisfy among the one or more search conditions, on the basis of a result of the search by the search unit 10. In a case where a plurality of search conditions is input, the user can check the presented list and understand a target that satisfies two or more search conditions that are all or a part of the plurality of search conditions. Therefore, it is possible to assist in knowing a target that satisfies a plurality of search conditions.
Further, the recommendation unit 40 recommends another search condition for further narrowing the targets included in the result of the search. Accordingly, the user can further narrow the targets included in the result of the search by combining the plurality of search conditions with another search condition.
A fourth example embodiment will be described below with reference to
(Regarding Hardware Configuration)
Each component of the information processing device described in the first to third example embodiments indicates a block of a functional unit. A part or all of these components are implemented by an information processing device 900 as illustrated in
As illustrated in
Each component of the information processing device described in the first to third example embodiments is achieved by the CPU 901 reading and executing a program 904 for achieving these functions. The program 904 for achieving the function of each component is stored in the storage device 905 or the ROM 902 in advance, for example, and the CPU 901 loads the program into the RAM 903 and executes the program as necessary. The program 904 may be supplied to the CPU 901 via the communication network 909 or may be stored in the recording medium 906 in advance, and the program may be read and supplied to the CPU 901 by the drive device 907.
According to the configurations of the present example embodiments, the information processing device described in the above example embodiments is achieved as hardware. Therefore, effects similar to the effects described in the above example embodiments can be exhibited.
The present invention has been described using the above-described example embodiments as exemplary examples. However, the present invention is not limited to the example embodiments described above. That is, the present embodiment described above can be applied in a variety of modes that can be understood by those skilled in the art within the scope of the present invention.
The present application is a continuation application of U.S. patent application Ser. No. 17/618,244 filed on Dec. 10, 2021, which is a National Stage Entry of international application PCT/JP2019/024343 filed on Jun. 19, 2019, the disclosures of all of which are incorporated in their entirety by reference herein.
Number | Date | Country | |
---|---|---|---|
Parent | 17618244 | Dec 2021 | US |
Child | 18238834 | US |