The present invention relates to a technique for providing information on the smell or taste of an object.
Smell is known to exert various effects on humans by acting on the cerebral limbic system that controls human emotion, behavior, and storage. For example, Patent Document 1 describes that a subject who smells a smell is asked questions about a mental event recalled by sniffing the smell, and the answer is acquired as a numerical value.
Patent document 1: JP 2016-180830
Incidentally, it is not so easy to accurately express what kind of smell a certain smell is and what kind of smell the user himself/herself prefers, and to convey it to others. This is probably due to the fact that most people have little chance to express the smell, so they have little vocabulary to express the smell, and they have not been able to accurately recognize the correspondence between the smell and the expression of the smell. Such a situation is not limited to the smell of the object, and the same applies to the taste of the object.
Therefore, the present invention provides a mechanism capable of grasping the relationship between the smell or taste of an object and the expression of the smell or taste, and grasping what smell or taste the user himself/herself likes.
According to one aspect of the invention, there is provided an information processing device including: an identifying means that identifies an object selected by the user among a plurality of objects that stimulate the user's sense of smell or taste; a display control means that displays a group of expressions relating to the sense of smell or taste stimulated by the identified object; a switching means that switches between the first display mode and the second display mode, wherein the display control means is configured: to display, in the first display mode, the expression group relating to one object identified by the identifying means, and to display, in the second display mode, the expression group relating to each of the plurality of objects identified by the identifying means, in addition to the expression common to the plurality of objects among the expression group so as to be distinguishable from the expression not common to the plurality of objects.
The display control means may be configured to display, in the first display mode, the expression group relating to one object identified by the identifying means, and to display a relationship image, which is an image indicating a relationship between the selected expression and other object corresponding to the sense of smell or taste associated with the expression, in a case that any one of the displayed expression groups is selected by the user.
A plurality of objects corresponding to the sense of smell or taste may be placed on the user interface device. The identifying means may be configured to identify an object selected by the user among a plurality of objects that stimulate the user's sense of smell or taste. The display control means may be configured to control to: display, in the first display mode, the expression group relating to one object identified by the identifying means, around the predetermined position where the object is placed, display on the user interface device, an image indicating the relationship between the selected expression and another object corresponding to the sense of smell or taste associated with the expression, which is an image corresponding to the position where the other object is placed, in a case that any one of the displayed expression groups is selected by the user.
According to another aspect of the invention, there is provided a program to implement functions to a computer, the functions including: an identifying means that identifies an object selected by the user among a plurality of objects that stimulate the user's sense of smell or taste;
a display control means that displays a group of expressions relating to the sense of smell or taste stimulated by the identified object; a switching means that switches between the first display mode and the second display mode, wherein the display control means is configured to control to: display, in the first display mode, the expression group relating to one object identified by the identifying means, and display, in the second display mode, the expression group relating to each of the plurality of objects identified by the identifying means, in addition to the expression common to the plurality of objects among the expression group so as to be distinguishable from the expression not common to the plurality of objects.
According to yet another aspect of the invention, there is provided an information providing system including: a user interface device; and an information processing device including: an identifying means that identifies an object selected by the user among a plurality of objects that stimulate the user's sense of smell or taste; a display control means that displays a group of expressions relating to the sense of smell or taste stimulated by the identified object; a switching means that switches between the first display mode and the second display mode, wherein the display control means is configured: to display, in the first display mode, the expression group relating to one object identified by the identifying means, and to display, in the second display mode, the expression group relating to each of the plurality of objects identified by the identifying means, in addition to the expression common to the plurality of objects among the expression group so as to be distinguishable from the expression not common to the plurality of objects.
The information provision system may further include: an object tag, which is a tag provided in each of the objects and storing identification information, a tray tag which is a tag provided on a tray on which the object is placed and which stores identification information, wherein the identifying means is configured to identify the objects by the identifying means reading the object tag provided on the object to identify the object in a case that any of the plurality of objects is placed at a predetermined position of the user interface device, and identify, in a case that the tray is placed in a predetermined position of the user interface device, the switching means reads the tray tag provided in the tray to switch between the first display mode and the second display mode.
According to the present invention, the relationship between the smell or taste of an object and the expression of the smell or taste can be grasped, and the user himself/herself can grasp what smell or taste he/she prefers.
First, an overall configuration of information providing system 1 according to an embodiment of the present invention will be described. Information providing system 1 is a system which enables a user to visually grasp the relationship between smell of an object and an expression of the smell, and to provide information for grasping what kind of smell the user himself/herself prefers. As shown in
Each of plural samples 60 is an object that emits a smell that stimulates the user's sense of smell. For example, sample 60 may be a smelled natural product (e.g., a plant itself such as a lavender) or an artificial product containing its smell (e.g., a volatile liquid from which the smell of a lavender has been extracted, a sheet impregnated with the liquid, or the like) In this embodiment, as sample 60, a cylindrical small bottle with a lid containing a liquid called an aroma oil containing a smell extracted from a natural product emitting a smell is used. Each sample 60 is provided with a seal or tag bearing the name or ID of the sample (e.g., the plant name “Lavender” or the number “1”). The user can visually identify each sample by referring to this name or ID.
First tray 50a and second tray 50b function as an operating tool for switching the display mode of display device 20. Both first tray 50a and second tray 50b have a size and a shape that allow sample 60 to be placed thereon. Both first tray 50a and second tray 50b have a size and shape so as to be superposed on each other.
Sample 60 is provided with a tag 61 (object tag) which is a storage medium storing identification information (referred to as a sample ID) for identifying each sample. When sample 60 is placed on the sensing surface, sensor device 40 identifies the placed sample 60 by reading the sample ID stored in the tag 61 of sample 60.
Display device 20 also functions as a so-called touch screen, and detects a touched position on the display surface if, for example, a user touches the display surface with his/her finger or a predetermined device. The position touched by the user is expressed as X and Y coordinates in a two-dimensional coordinate plane with a certain position of the display surface as the origin.
CPU101 is a processor that performs various operations. ROM102 is, for example, a non-volatile memory that stores a program and data used for starting information processing device 10. RAM103 is a volatile memory that functions as a work area while CPU101 executes a program. The secondary storage device 104 is a nonvolatile storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores programs and data used in information processing device 10. CPU101 executes this program to implement the functions described later, and also executes the operations described later. The communication IF105 is an interface for performing communication according to a predetermined communication standard. The communication standard may be a standard of wired communication or a standard of wireless communication. In addition to the configuration illustrated in
The auxiliary storage device 104 stores an expression database (hereinafter, the term “database” is referred to as a DB) as shown in
Further, the expression DB includes information of an appearance for displaying each expression. The appearance includes, for example, a position where the expression is displayed, a color with which the expression is displayed, a size of the displayed expression, a font of the expression, a modification for displaying the expression, a time when the expression is displayed, a time to display an expression, a time period when the expression is displayed, a motion (including a spatial or temporal change in an expression) of the expression, a language used for the expression, and the like.
This appearance changes depending on the relationship between sample 60 and the expression. The relationship between sample 60 and the expression is the intensity or amount of the smell (more strictly, the component contained in the smell of the sample) represented by the expression thereof in sample 60, or the abstraction degree of the expression thereof with respect to the smell, and the like. For example, for sample 60 having strong sweet smell, the expression “sweet” is displayed near sample 60, with a large font or a conspicuous color, or with a motion in which the expression is vibrating. These are examples of the appearance that varies depending on the relationship between sample 60 and the expression changes. In addition, for example, for a sample having a strong smell of “sweet” and a weak smell of “fruity”, an expression of “sweet” is displayed near the sample and the expression of “fruity” is displayed far from the sample. This is another example of an appearance which changes in accordance with the relationship between sample 60 and the expression. Further, in the case where a direct expression and an indirect expression are associated with a certain sample, the distance between sample 60 and the expression changes in accordance with the abstraction of the expression, for example, a direct expression is displayed near the sample and an indirect expression is displayed far from the sample. This is yet another example of an appearance which changes in accordance with the relationship between sample 60 and the expression. In short, the expression is displayed with an appearance such that the content of the relationship between sample 60 and the expression (specifically, the strength and weakness of the relationship and the manner of the relationship) can be visually recognized.
In
If sample 60 selected by the user is placed on the sensing surface of sensor device 40, sample identifying means 11 specifics which sample 60 is placed on the sensing surface based on the sample ID stored in the tag 61 of sample 60 and read by the sensor device 40.
If first tray 50a or second tray 50b is placed on the sensing surface of sensor device 40, switching means 12 mutually switches the single-sample display mode and the multi-sample display mode on the basis of the tray ID stored in tag 51a of first tray 50a or tag 51b of second tray 50b and read by the sensor device 40.
In the single-sample display mode and the multi-sample display mode, display control means 14 controls display device 20 to display a group of expressions relating to the olfactory sense stimulated by sample 60 specific by sample identifying means 11 in the display region corresponding to the periphery of the position where sample 60 is placed, i.e., the sensing surface, in the user interface device 30. At this time, display control means 14 displays the expression with an appearance corresponding to sample 60 specific by sample identifying means 11 in the expression DB (
In the single-sample display mode, if the user selects one of the expressions in the displayed expression group, display control means 14 displays a relationship image, which is an image indicating the relationship between the selected expression and other samples 60 corresponding to the sense of smell associated with the expression. In addition, in the multi-sample display mode, display control means 14 controls to display, for each of plural samples 60 identified by sample identifying means 11, a group of expressions relating to the sense of smell stimulated by each of the samples 60, and to display the expression common to plural samples 60 among the group of expressions so as to be distinguishable from the expression common to plural samples 60. The display control by display control means 14 will be described in detail later with reference to
Next, the operation of the present embodiment will be described with reference to the flowchart shown in
If first tray 50a is placed on the sensing surface SA as shown in
The user may select any of the samples 60a-60i to smell the smell and place sample 60 of the smell he or she prefers on first tray 50a on the sensing surface SA. Sample identifying means 11 of information processing device 10 identifies (in step S13) which sample 60 is placed on the sensing surface, based on the reading result (in step S13) of the sample ID by sensor device 40.
In step S14, display control means 14 searches (in step S14) the expression DB for an expression corresponding to the sample ID using the identified sample ID as a key. In step S15, display control means 14 determines whether the display mode is the single-sample display mode or the multi-sample display mode and the display mode corresponding to each of the searched expressions with reference to the expression DB. Then, display control means 14 controls display device 20, the display area around the sensing surface SA, the expression retrieved in step S14, and displays (in step S16) the display mode determined in step S15.
For example, if sample 60a is placed on first tray 50a, as shown in
Further, if there is any expression of the smell which the user is concerned about in the displayed expression group, the user selects the expression by performing an operation of touching the expression. If such a touch operation is performed, display control means 14 identifies the expression selected by the user based on the position at which the touch operation is performed and the display position of each expression. In this case, the expression is surrounded by some graphic image, the background of the expression is displayed in a specific color, or the expression is highlighted so that the user can know which expression selection is accepted.
Then, display control means 14 searches the expression DB for the sample ID associated with the selected expression. As a result of the search, if there is a sample ID associated with the selected expression, display device 20 is controlled to display a relationship image in step S16. The relational image is, for example, an image showing the relationship between the expression selected by the user in the user interface plane and other sample 60 corresponding to the retrieved sample ID, and is an image corresponding to the position where sample 60 is placed.
For example, as illustrated in
The appearance such as the color, thickness, size, and motion of the relationship image may correspond to the relation between the expression selected by the user and other samples represented by the expression. For example, if the relationship between the expression selected by the user and the other samples represented by the expression is strong, the display mode includes a color, a thickness, a size, a motion, or the like in which the relationship image becomes more conspicuous, and if the relationship is weak, the appearance becomes the opposite.
If the user wants to know more about the expression, by performing an operation of touching the expression, the process described above is then performed for another expression.
Here, from the state of
Thus, as shown in
In addition, from the state of
As a result, as shown in
Next, the user lays second tray 50b on first tray 50a on the sensing surface SA. Switching means 12 of information processing device 10 determines that first tray 50a and second tray 50b are placed on the basis of the reading result (in step S11) of the tray ID by sensor device 40, and switches (in step S12) the display mode to the plurality of sample display modes.
Next, the user places the selected samples 60a, 60b, and 60g as a sample of the smell that they prefer in the single-sample display mode over first tray 50a and second tray 50b on the sensing surface SA. Sample identifying means 11 of information processing device 10, based on the reading result (in step S11) of the sample ID by sensor device 40, sample 60a, 60b, to identify (in step S13) that 60g is placed on the sensing surface.
In step S14, display control means 14 searches the expression DB for the expression corresponding to the sample ID by using the identified sample IDs of the samples 60a, 60b, and 60g as keys. In step S15, display control means 14 determines whether the display mode is the single-sample display mode or the multi-sample display mode and the display mode corresponding to each of the searched expressions with reference to the expression DB. In step S16, display control means 14 controls display device 20 to display the expression retrieved in step S14 for each of the samples 60a, 60b, and 60g in the display area around the sensing surface SA in the display mode determined in step S15. Further, at this time, display control means 14 controls display device 20 to display a expression common to the samples 60a, 60b, and 60g so as to be distinguishable from a expression not common to the samples 60a, 60b, and 60g. For example, as illustrated in
According to the embodiment described above, the user can visually grasp the relationship between the smell of the object and the expression of the smell. In addition, users can visually understand what kind of smell they prefer.
The present invention is not limited to the embodiments described above. The embodiment described above may be modified as follows. Further, the following two or more modified examples may be implemented in combination.
The present invention is applicable not only to the smell sense but also to the taste sense (e.g., wine, sake, spice, seasoning, etc.). That is, the present invention may be implemented by replacing the “smell” in the embodiment with the “taste”.
The appearance to display each expression may correspond to the relationship between the expression and the user who sees the display of the expression. The relationship between the expression and the user includes, for example, the degree of agreement between the smell of the smell expression by the expression and the user's preference related to the smell, and a history in which the user uses the expression as an expression of the smell. For example, for a user who prefers a “sweet” smell, an example may be considered in which the expression “sweet” is displayed near sample 60 placed on the sensing surface of sensor device 40, the expression “sweet” is displayed in a large or noticeable color, or the expression “sweet” is displayed so as to be noticeable by moving in a vibrating manner. In this case, the user's preferences related to smell is stored in advance collected and database in the auxiliary storage device 104 or the like, display control means 14 shall refer to it.
Further, for example, for a user who has used the expression “sweet” in many cases in the past, there may be considered an example in which the expression “sweet” is displayed near sample 60 placed on the sensing surface of sensor device 40, the expression “sweet” is displayed in a large or conspicuous color, or the expression “sweet” is displayed so as to be conspicuous by moving so as to vibrate. In this case, the history of the expression used by the user for the smell is stored in advance in the auxiliary storage device 104 and the like is collected and stored in a database, display control means 14 shall refer to it.
The appearance at the time of displaying each expression may correspond to the attribute of the smell expression by the expression. Attributes of the smell include, for example, whether it is a top note, a middle note, or a last note, intensity/weakness of stimulus of the smell, attractiveness, peculiarity, or scarcity of the smell. The top note, middle note, and initial note are the first perceived smell in time, the next perceived smell, and the next perceived smell as the smell changes. For example, examples of displaying expressions corresponding to top notes, middle notes, and last notes in order from near to far of sample 60 placed on the sensing surface of sensor device 40, and examples of switching the display of expressions corresponding to top notes, middle notes, and last notes in chronological order are conceivable. In addition, examples of expressions relating to a smell with a strong stimulus or a rare smell may be displayed in a specific color, font, or motion.
The appearance at the time of displaying each expression may correspond to the attribute of the expression. The expression attributes include, for example, an image to be received from an expression, an expression of a part of speech, a type of character to be used for expression (hiragana, katakana, kanji, alphabet, etc.), the number of characters/the number of words to be used in the expression, and the like. For example, an example in which the expression “sweet” is displayed in a warm color is conceivable.
If displaying the above-mentioned related image (see
Display control means 14 may display expressions having good compatibility in a display manner such that expressions having good compatibility can be identified by color, motion, or the like when displaying expressions for each of plural samples 60. For example, with respect to sample 60 corresponding to the expression “sweet” and sample 60 corresponding to the expression “marana”, on the assumption that “sweet” and “marana” are compatible, the expressions “sweet” and “marana” are displayed in the same color, and the expressions having no good relationship with each other are displayed in different colors. Similarly, display control means 14 may display expressions that are incompatible with each other in a display manner that can be identified by color or motion. For example, with respect to sample 60 corresponding to the expression “sweet” and sample 60 corresponding to the expression “bitter”, on the assumption that “sweet” and “bitter” are incompatible with each other, an example may be considered in which the expressions “sweet” and “bitter” are displayed in the same violent movement, and the expression having no incompatible relationship is displayed without movement. In this manner, display control means 14 may display the expression having a predetermined relationship among the expression relating to the first object and the expression relating to the second object in a display manner distinguishable from the expression not having the predetermined relationship. The expression in which a plurality of expressions are in a predetermined relationship referred to herein may be, in addition to the relationship of good/bad compatibility as described above, an example in which any of the plurality of expressions matches/does not match the preference of the user or belongs/does not belong to the expression group of similar smells. In this case, the user's preferences and similar smell expression group about the smell is stored in advance in the collection and database in the auxiliary storage device 104 or the like, display control means 14 shall refer to it.
In the above embodiment, switching means 12 switches to the “single-sample display mode” if first tray 50a is placed on the sensing surface, and switches to the “multi-sample display mode” if first tray 50a and second tray 50b are placed on the sensing surface. The method of using the tray as the operation tool for switching the display mode is not limited to the example of the above embodiment. For example, only one tray provided with a tag storing a tray ID may be prepared, and switching means 12 may switch to the “single-sample display mode” if the tray is not placed on the sensing surface, and may switch to the “multi-sample display mode” if the tray is placed on the sensing surface. Conversely, switching means 12 may switch to the “single-sample display mode” if the tray is placed on the sensing surface, and switch to the “multi-sample display mode” if the tray is not placed on the sensing surface. As described above, if the tray is placed at a predetermined position of the user interface device 30, switching means 12 reads a tag provided in the tray, and switches between the first display mode called a single-sample display mode and the second display mode called a multi-sample display mode.
The display device and the operation device is not limited to display device 20 and sensor device 40 illustrated in FIG. For example, the display device may project an image onto a certain display surface. Further, the display device may be intended to display an image on the wall surface (including the case of projecting an image on the wall surface or the wall itself is a display device). The display device may also be a display device that realizes so-called augmented reality. Specifically, if sample 60 is imaged by an imaging device of a smart phone, tablet, or glass type wearable device, a corresponding expression group may be displayed around sample 60 in the imaged image. The operation device may be a device that detects a user's operation using an image recognition technique.
In the embodiment, the expression relating to sample 60 is displayed if sample 60 is placed on the sensing surface of sensor device 40, but the expression relating to sample 60 may be displayed if the user opens the lid of the capped vial containing aroma oil corresponding to sample 60, for example. Similarly, for example, a transparent cover may be put on a dish with a natural object itself, and if the user removes the transparent cover, a expression relating to the smell of the natural object may be displayed. Such user actions can be detected, for example, using well-known image recognition techniques.
The display form of the expression may be a two-dimensional display or a three-dimensional display. The displayed “expression” is not limited to characters, and may be a color, an abstract image, an image such as a person/scene, or the like.
The present invention may be provided as an information processing method including steps of processing performed in information processing device 10. The present invention may also be provided as a program executed in information processing device 10. Such a program can be provided in the form of being recorded on a recording medium such as an optical disk, or in the form of being downloaded to a computer via a network such as the Internet and installed and made available.
While the present invention has been described in detail above, it is apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention may be practiced as modifications and modifies without departing from the spirit and scope of the invention as defined by the appended claims. Accordingly, the description herein is for illustrative purposes and does not have any limiting meaning on the present invention.
1 . . . Information-providing systems, 20. display devices, 30. user-interface devices, 40. sensor devices, 50a. first tray, 51a. tag, 50b. second tray, 51b. tag, 60, 60a-60i. sample, 61. tag, 101 . . . CPU, 102 . . . ROM, 103 . . . RAM, 104. secondary storage device, 105. communication IF, 11. sample identifying means, 12. switching means, 13. expression DB storage unit, 14. display control means.
Number | Date | Country | Kind |
---|---|---|---|
2019-225720 | Dec 2019 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/044639 | 12/1/2020 | WO |