The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2017-251806, filed on Dec. 27, 2017. Each of the above application(s) is hereby expressly incorporated by reference, in its entirety, into the present application.
The present invention relates to an image print proposal device, method, and program, and more particularly, to a technique for proposing an image print suitable to be decorated in a room to a user.
In the related art, a product sales device which enables purchasing a product while checking an atmosphere or harmony at the time of placing a purchase consideration product in an actual room or checking whether or not the product is fitted to a size of the room has been proposed (JP2004-318359A).
This product sales device combines a product image obtained by imaging a product with a room image obtained by imaging a room of the user, and guides and outputs a combination image to a customer. In particular, in a case where the product sales device combines the product image with the room image, the product sales device adjusts an image size according to a ratio of the size of the room in which the product is installed to a size of the product and rotates the product image according to an imaging direction in which the room is imaged, so that an orientation of the product image is adjusted in the imaging direction of the room image and the product image is combined and arranged in the room image.
Accordingly, the user can purchase the product while checking the atmosphere or harmony in a case where the purchase consideration product is placed in the actual room or checking whether or not the product is fitted to the size of the room.
Similarly, a product purchase assistance system described in JP2007-193554A combines an image of a scheduled purchase product that a user desires to purchase with an installation area in a room image provided by the user or a room image selected from a number of types of room models prepared in advance, and displays a resultant image, thereby facilitating selection of a product optimal to the installation place.
Further, in an order curtain sales system described in JP2007-047946A, in a case where a user selects a type or fabric of a curtain, a window frame (curtain) is measured from an image of a room in which the curtain is placed, the image of the room and an image of the curtain are combined and displayed on a terminal of the user, and an order is received from the user in a case where the user likes the curtain.
The product sales device described in JP2004-318359A displays a list of groups of product images, acquires an image of the room of the user in which the purchase consideration product is to be placed in a case where the user selects and designates the purchase consideration product from among the product images in the groups, and combines and arranges the product image of the purchase consideration product with and in the room image. The product sales device itself does not propose a product suitable for the room of the user.
Similarly, in the product purchase assistance system described in JP2007-193554A and the order curtain sales system described in JP2007-047946A, the curtain and other scheduled purchase items are selected by the user, and the system does not automatically select a product and propose the product to the user.
The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image print proposal device, method, and program capable of proposing an image print suitable to be decorated in a wall of a room to a user.
In order to achieve the above object, an image print proposal device according to an aspect of the present invention includes an image acquisition unit that acquires an image of a room captured by a user; a selection unit that selects an image corresponding to an image print suitable for an image print to be decorated in the room from among images in a group registered in advance or images in a group possessed by the user on the basis of the acquired image of the room; and a proposal unit that proposes the selected image to the user as the image corresponding to the image print to be decorated in the room.
According to an aspect of the present invention, the image corresponding to the image print suitable for the image print to be decorated in the room is automatically selected on the basis of the image of the room captured by the user, and the selected image is proposed (presented) to the user. By presenting the selected “image”, the “image print” corresponding to the selected image is proposed. Accordingly, in a case where the user desires to decorate a photograph (image print) on the wall of the room, the user can easily select an image print suitable for the room even in a case where the user does not know what type of image print is harmonized with, for example, an atmosphere of the room.
In the image print proposal device according to another aspect of the present invention, it is preferable for the selection unit to include a room parameter acquisition unit that analyzes the acquired image of the room and acquires a room parameter indicating a feature of the room; and an image extraction unit that extracts an image corresponding to an image print suitable for an image print to be decorated on a wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired room parameter.
According to another aspect of the present invention, the room parameter indicating the feature of the room is acquired from the room image. The room parameter includes a type of room, a size of the room (a wall), an orientation of the room, a shape of the room, a color of the room, and brightness of the room. The image extraction unit extracts the image corresponding to an image print suitable for an image print to be decorated on the wall of the room on the basis of the acquired room parameter from among the images in the group.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the room parameter acquisition unit to be a first machine learning unit caused to learn acquisition of the room parameter on the basis of an image group of a room for learning and a room parameter group for a teacher indicating the feature of the group of images of the room, and to acquire the room parameter indicating the feature of the room from the first machine learning unit on the basis of the acquired image of the room. The room parameter acquisition unit acquires the corresponding room parameter from the first machine learning unit on the basis of the acquired room image.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to include a storage unit that stores a relationship between a room parameter group indicating a feature of a room and an image parameter group indicating a feature of an image print group suitable for the image print to be decorated on the wall of the room, and for the image extraction unit to acquire the image parameter corresponding to the room parameter from the storage unit on the basis of the room parameter acquired by the room parameter acquisition unit, and to extract an image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired image parameter. The image extraction unit can acquire the image parameter corresponding to the room parameter from the storage unit on the basis of the acquired room parameter and extract the image corresponding to the image print suitable for the image print to decorated on the wall of the room from among the images in the group on the basis of the acquired image parameter. As the image parameter, an image size, number of frames, a frame design, a type of content, a type of user image, and the like are conceivable, in addition to various feature quantities obtained by analyzing an image.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the image extraction unit to include a second machine learning unit caused to learn acquisition of an image parameter indicating the feature of the image print suitable for an image print to be decorated on the wall of the room on the basis of the room parameter group for learning indicating the feature of the room and the image parameter group for a teacher indicating the feature of the image print group, and to acquire the image parameter corresponding to the room parameter from the second machine learning unit on the basis of the room parameter acquired by the room parameter acquisition unit, and extracts an image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired image parameter. The image extraction unit can acquire the image parameter corresponding to the room parameter from the second machine learning unit and extract the image corresponding to the image print suitable for the image print to decorated on the wall of the room from among the images in the group on the basis of the acquired image parameter.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to include a third machine learning unit caused to learn acquisition of an image parameter indicating the feature of the image print suitable for an image print to be decorated on a wall of the room on the basis of the image group of the room for learning and the image parameter group for a teacher indicating the feature of the image print group, and to acquire the image parameter indicating the feature of the image print suitable for the image print to be decorated on the room from the third machine learning unit on the basis of the acquired image of the room, and selects an image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired image parameter. The selection unit can acquire the image parameter indicating the feature of the image print suitable for the image print to be decorated on the room from the third machine learning unit and select the image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group on the basis of the acquired image parameter.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to include a fourth machine learning unit caused to learn acquisition of an image corresponding to the image print suitable for the image parameter on the basis of the image group for a teacher and the image parameter group for learning indicating a feature of the image group for the teacher, and it is preferable for the fourth machine learning unit to select an image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired image parameter. The fourth machine learning unit can select the image corresponding to an image print suitable for an image print to be decorated on the wall of the room from among the images in the group on the basis of the acquired image parameter.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to include a fifth machine learning unit caused to learn acquisition of the image corresponding to the image print suitable for the image print to be decorated on the wall of the room on the basis of an image group of the room for learning and the image group for a teacher, and it is preferable for the fifth machine learning unit to select an image corresponding to the image print suitable for an image print to be decorated on the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired image of the room. According to this, the fifth machine learning unit can select the image corresponding to the image print suitable for an image print to be decorated on the room from among the images on the basis of the acquired image of the room.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to select a plurality of images corresponding to a plurality of higher-ranked image prints with a higher degree of fitness among image prints suitable for image prints to be decorated in the room from among the images in the group registered in advance or the images in the group possessed by the user, and for the proposal unit to propose the plurality of selected images to the user. Accordingly, the user can select a desired image from among the plurality of proposed images.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the proposal unit to combine the selected image with a wall region in the acquired image of the room and presents a combination image to the user. Accordingly, the user can check an atmosphere or harmony of the room in a case where the proposed image print is decorated on a wall of an actual room.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to further select a picture frame suitable for the selected image from among picture frames in the group registered in advance, and for the proposal unit to propose the selected image and the picture frame to the user.
In the image print proposal device according to still another aspect of the present invention, it is preferable for the selection unit to further select content suitable for the selected image from among contents in a group registered in advance, and for the proposal unit to propose the selected image and the content to the user. For example, it is conceivable that, in a case where an image of the sea is proposed, the selection unit selects content (for example, Hawaiian miscellaneous goods) placed together with an image print of the sea, and the proposal unit presents an image corresponding to the Hawaiian miscellaneous goods together with the image of the sea.
In the image print proposal device according to still another aspect of the present invention, it is preferable that, in a case where the selection unit selects an image corresponding to an image print suitable for an image print to be decorated in the room from among images in a group possessed by the user, the selection unit further select an image of which imaging position information is close from among the images in the group registered in advance on the basis of imaging position information of the selected image, and the proposal unit combine the selected image possessed by the user with the selected image of which the imaging position information is close, and propose a combination image to the user. Accordingly, it is possible to combine and propose an image of a user and an image of which an imaging position is close to that of the image of the user (for example, an image captured by a professional photographer).
In the image print proposal device according to still another aspect of the present invention, it is preferable for the image print proposal device to further include an order reception unit that receives an order of an image print corresponding to the image proposed by the proposal unit from the user.
An image print proposal method according to still another aspect of the present invention includes acquiring an image of a room captured by a user; selecting an image corresponding to an image print suitable for an image print to be decorated in the room from among images in a group registered in advance or images in a group possessed by the user on the basis of the acquired image of the room; and proposing the selected image to the user as an image corresponding to the image print to be decorated in the room.
In the image print proposal method according to still another aspect of the present invention, it is preferable for the selecting to include analyzing the acquired image of the room and acquiring a room parameter indicating a feature of the room; and extracting an image corresponding to an image print suitable for an image print to be decorated on a wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired room parameter.
In the image print proposal method according to still another aspect of the present invention, it is preferable for the proposing to include combining the selected image with a wall region in the acquired image of the room and presenting a combination image to the user.
An image print proposal program according to still another aspect of the present invention causes a computer to execute functions of: acquiring an image of a room captured by a user; selecting an image corresponding to an image print suitable for an image print to be decorated in the room from among images in a group registered in advance or images in a group possessed by the user on the basis of the acquired image of the room; and proposing the selected image to the user as an image corresponding to the image print to be decorated in the room.
In the image print proposal program according to still another aspect of the present invention, it is preferable for the selecting function to include functions of: analyzing the acquired image of the room and acquiring a room parameter indicating a feature of the room; and extracting an image corresponding to an image print suitable for an image print to be decorated on a wall of the room from among the images in the group registered in advance or the images in the group possessed by the user on the basis of the acquired room parameter.
In the image print proposal program according to still another aspect of the present invention, it is preferable for the proposing function to include combining the selected image with a wall region in the acquired image of the room and presenting a combination image to the user.
According to the present invention, it is possible to propose an image print suitable to be decorated on the wall of the room of the user to the user.
Hereinafter, preferred embodiments of an image print proposal device, method and program according to the present invention will be described with reference to the accompanying drawings.
[First Embodiment of Image Print Proposal Device]
An image print proposal device 1-1 illustrated in
A hardware structure executing various controls of the image print proposal device 1-1 is various processors of a computer as follows. Various processors include, for example, a central processing unit (CPU) that is a general-purpose processor that execute software (including programs (including an image print proposal program)) and functions various control units, a programmable logic device (PLD) that is a processor of which a circuit configuration can be changed after manufacture, such as a field programmable gate array (FPGA), and a dedicated electric circuit that is a processor having a circuit configuration designed to be dedicated to execution of a specific process, such as an application specific integrated circuit (ASIC).
One processing unit may be configured of one of the various processors or may be configured of the same type or different types of two or more of processors (for example, a plurality of FPGAs or a combination of a CPU and an FPGA). Further, a plurality of control units may be configured of one processor. A first example in which the plurality of control units is configured of one processor is a form in which one processor is configured of a combination of one or more CPUs and software to be represented by a computer such as a client or a server, and this processor functions as the plurality of control units. A second example is a form in which a processor realizing a function of an entire system including the plurality of control units using one integrated circuit (IC) chip to be represented by a system-on-chip (SoC) or the like is used. Thus, various control units have a hardware structure and are configured of one or more of processors.
The image acquisition unit 10 is a unit that is connected to a user terminal with a camera (for example, a smartphone) or a recording medium such as a universal serial bus (USB) memory, or a memory card (for example, an SD card) used for a digital camera via a communication interface and acquires an image of a room (hereinafter referred to as a “room image”) imaged by a user from the user terminal or the recording medium.
A user using the image print proposal device 1-1 images his or her room (a room decorated with the image print) using a smartphone or the like, and inputs a captured room image to the image print proposal device 1-1 via the image acquisition unit 10.
In the content DB 18, a large number of images (a group of images) for image print decorated on the wall of the room are registered in advance. The group of images registered herein is, for example, a group of images captured by a professional photographer.
In the user image DB 20, a group of images captured by each user and possessed by the user is registered and managed for each user. Further, a group of images possessed by the user can be registered in the user image DB 20 from the user terminal or the recording medium via the image acquisition unit 10.
The content DB 18 and the user image DB 20 are not limited to those embedded into the image print proposal device 1-1, and may be connected by a local area network (LAN) or the like and accessed appropriately.
The selection unit 12 functions as an image selection unit that selects an image corresponding to an image print suitable for the image print to be decorated in a room from among the images in the group registered in the content DB 18 or the group of images registered in the user image DB 20 on the basis of the room image acquired by the image acquisition unit 10.
The image processing unit 14 and the display 16 function as a proposal unit that proposes the image selected by the selection unit 12 to the user as an image corresponding to the image print to be decorated in the room.
The image processing unit 14 is a unit that processes the image selected by the selection unit 12, and functions as a display control unit that generates an image to be displayed on the display 16 (an image for a display) from the selected image. In addition, the image processing unit 14 has a function of combining the selected image with a wall region within the room image acquired by the image acquisition unit 10 and generating a combination image (a combination image) as the image for a display, and a function of performing image processing for image print (a process of adjusting brightness or color tone) on the selected image.
The display 16 includes a liquid crystal display, an organic electroluminescence display, or the like. The display 16 receives the image for a display and displays an image for an image print and other information on a display screen.
The order reception unit 22 is a unit that receives an order of image print on the basis of a user manipulation in the manipulation unit 24. In a case where the user sees and likes the image for an image print displayed on the display 16, the user can purchase the image print proposed as an image print to be decorated on a wall of a room of the user. Moreover, a proposer can promote sales of the image prints.
The manipulation unit 24 includes a mouse, a pointing device including, for example, a touch panel in a case where the display 16 includes the touch panel, and a keyboard. The manipulation unit 24 functions an input unit that enables the user to manipulate a pointer or an icon in an on-screen interactive manner while viewing a screen of the display 16 or input order information or other information to the order reception unit 22.
An image 3 selected from among the images in the group registered in the content DB 18 and the user image DB 20 by the selection unit 12, which is an image 3 corresponding to an image print suitable for an image print to be decorated in the room, on the basis of the room image, is displayed on the display screen 16A of the display 16 illustrated in
The selection unit 12 can select a plurality of images corresponding to a plurality of higher-ranked image prints with a higher degree of fitness among image prints suitable for image prints to be decorated in the room from among the images in the group. The display 16 functioning as a proposal unit can display a plurality of images.
In the example illustrated in
Further, an icon “To order screen” is displayed on the display screen 16A of the display 16. By clicking on this icon, the user makes a transition to a screen for ordering a photograph print corresponding to the image enlarged and displayed on the display screen 16A.
Accordingly, the image print proposal device 1-1 can propose, to the user, an image print suitable to be decorated on the wall of the room of the user, and the user can easily select an image print suitable for a room decorated with the image print.
In the example illustrated in
<Selection Unit of First Embodiment>
The selection unit 12-1 of the first embodiment illustrated in
The room parameter acquisition unit 30 analyzes the room image 2 acquired by the image acquisition unit 10 and acquires a room parameter indicating a feature of the room that can be ascertained from the room image 2. The room parameter includes a type of room (living, dining, bedroom, study, entrance, or the like), a size (cm2) of the room (a wall), an orientation of the room (the wall), a shape (rectangle, square, or the like) of the room, color of the room, and brightness (lux) of the room, and the like.
The type of room can be estimated, for example, by extracting objects in the room image. In a case where there is a TV or a sofa in the room, the room can be estimated to be a living room. In a case where there is a dining table or a cupboard in the room, the room can be estimated to be a dining room. In a case where there is a bed in the room, the room can be estimated to be a bedroom.
The size of the room (the wall) can be estimated on the basis of a size of a door in the room, a size of a chair, and the like. The orientation of the wall (an orientation of a wall surface) can be acquired from header information of an image file in which the room image is recorded.
For example, in a case where the room image is captured by a smartphone having a compass function, orientation information indicating an orientation at the time of imaging is recorded in a header of an image file as incidental information of the image. Therefore, by reading the orientation information recorded in the header of the image file, it is possible to know the orientation of the wall (an orientation to which the wall is directed). For example, in a case where the room image is captured while facing the wall and orientation information indicating north is recorded as incidental information of the room image, a surface face of the wall is directed to the south. In addition, in a case where a shadow of an object is reflected in the room image due to the sun, the orientation of the wall surface can be detected from a direction of the shadow and an imaging time.
The brightness of the room can be obtained from brightness of the room image and imaging conditions (a shutter speed and an F-number recorded as the incidental information in the header).
On the basis of the room parameter acquired by the room parameter acquisition unit 30, the image extraction unit 32-1 extracts the image 3 corresponding to the image print suitable for the image print to be decorated on the wall of the room from the images in the group registered in the content DB 18 or the user image DB 20. According to this, it is possible to extract an image harmonized with, for example, an atmosphere of the room
Next, a case where acquisition of the above room parameter is performed using artificial intelligence (AI) will be described.
A machine learning device is known as a scheme for realizing artificial intelligence. In recent years, a convolutional neural network (CNN) that calculates feature quantities from images through learning and performs an image recognition process has attracted attention as the machine learning device.
As illustrated in
A room image that is a recognition process target is input to the input layer 31A.
An intermediate layer 31B includes a plurality of sets each including a convolution layer and a pooling layer, and an entire combination layer, and extracts features from the image input from the input layer 31A. The convolution layer performs a filtering process on a nearby node in a previous layer (performs a convolution calculation using a filter) to acquire a “feature map”. The pooling layer reduces the feature map output from the convolution layer to obtain a new feature map. The “convolution layer” serves to perform feature extraction such as edge extraction from an image, and “pooling layer” serves to give robustness so that the extracted feature is not influenced by parallel movement or the like.
The intermediate layer 31B is not limited to a case where the convolution layer and the pooling layer are formed as one set, but a case where the convolution layer is continuous or a normalization layer is also included. In addition, a “weight” and a “bias” of a filter to be used in each convolution layer are learned automatically using a large number of pieces of learning data in advance.
The first machine learning unit 31 configured as the room parameter acquisition unit of the example is a unit caused to learn acquisition of the room parameters on the basis of the image group of the room for learning and the room parameter group for a teacher indicating the features of the images group of the room. In a case where the room image is input to the input layer 31A, room parameters indicating the features of the room indicated by the room image are output from the output layer 31C through the process in the intermediate layer 31B. According to this, it is possible to acquire the room parameter indicating the feature of the room easily and accurately
The first machine learning unit is not limited to a case where all of a plurality of room parameters are acquired, but a case where some of the plurality of room parameters are acquired is included.
<Selection Unit of Second Embodiment>
The selection unit 12-2 of the second embodiment illustrated in
The first machine learning unit 31 is configured as a room parameter acquisition unit as described with reference to
The parameter DB 34 functions a storage unit defining (stores) a relationship between the room parameter indicating the feature of the room and the image parameter indicating the feature of the image print suitable for an image print to be decorated on the wall of the room.
Here, as the image parameter, an image size, number of frames, a frame design, a type of content, a type of user image, and the like are conceivable, in addition to various feature quantities obtained by analyzing an image (a room image). The feature quantities of the room image correspond to feature quantities obtained by obtaining, as a feature, an arrangement rule of basic elements constituting a texture of the room image, feature quantities obtained by obtaining, as a feature, a statistical quantity indicating nature of the image such as uniformity of a density of pixels of the room image or a change in contrast from the density, or the like.
Further, an association between the room parameter indicating the feature of the room and the image parameter indicating the feature of the image print can be performed, for example, by associating the room image with an image print suitable for decoration of the wall of the room indicated by the room image (an image print selected by a designer or the like).
On the basis of the room parameter input from the first machine learning unit 31, the image extraction unit 32-2 first acquires the image parameter corresponding to the room parameter from the parameter DB 34. In a case where the same room parameter as the acquired room parameter is not stored in the parameter DB 34, the image extraction unit 32-2 extracts a room parameter most approximate to the acquired room parameter from among the room parameters registered in the parameter DB 34, and acquires the image parameter registered in association with the room parameter from the parameter DB 34.
Subsequently, on the basis of the image parameter acquired from the parameter DB 34, the image extraction unit 32-2 extracts the image 3 corresponding to an image print suitable for the image print to be decorated on the wall of the room from among the images in the group registered in the content DB 18 or the user image DB 20. In this case, the image extraction unit 32-2 compares the acquired image parameter with an individual image parameter of the images in the group registered in the content DB 18 or the user image DB 20. In a case where an image having the matching image parameter is registered, the image extraction unit 32-2 extracts the image, and in a case where the image having the matching image parameter is not registered, the image extraction unit 32-2 extracts an image having the most approximate image parameter. It is preferable for the image parameter of the registered image to be registered in association with the image in the content DB 18 or the user image DB 20.
<Selection Unit of Third Embodiment>
The selection unit 12-3 of the third embodiment illustrated in
The second machine learning unit 36 is a unit caused to learn acquisition of the image parameter indicating the feature of the image print suitable for an image print to be decorated on the wall of the room on the basis of the room parameter group for learning indicating the feature of the room and the image parameter group for a teacher indicating the feature of the image print group. The second machine learning unit 36 can be configured similarly to the CNN model illustrated in
In a case where the room parameter acquired by the first machine learning unit 31 is received, the second machine learning unit 36 that has completed the learning calculates an image parameter corresponding to the input room parameter and outputs the calculated image parameter to the image extraction unit 32-3.
On the basis of the image parameter acquired from the second machine learning unit 36, the image extraction unit 32-3 extracts the image 3 corresponding to the image print suitable for the image print to be decorated on the wall of the room from the images in the group registered in the content DB 18 or the user image DB 20. The image extraction unit 32-2 illustrated in
<Selection Unit of Fourth Embodiment>
The selection unit 12-4 of the fourth embodiment illustrated in
That is, the third machine learning unit 38 illustrated in
In a case where the third machine learning unit 38 receives the room image 2, the third machine learning unit 38 outputs an image parameter indicating the feature of the image print suitable for an image print to be decorated on the wall of the room indicated by the room image 2. That is, the third machine learning unit 38 can output the image parameter indicating the feature of the image print suitable for the image print to be decorated on the wall of the room indicated by the room image 2 without acquiring the room parameter on the basis of the room image 2. Further, the third machine learning unit 38 can be configured similarly to the CNN model illustrated in
<Selection Unit of Fifth Embodiment>
The selection unit 12-5 of the fifth embodiment illustrated in
The fourth machine learning unit 40 is a unit caused to learn acquisition of an image corresponding to the image print suitable for the image parameter on the basis of the image parameter group for learning indicating a feature of the image group for a teacher and the image group for a teacher.
Therefore, in a case where the fourth machine learning unit 40 receives the image parameter from the second machine learning unit 36 (or the third machine learning unit 38 illustrated in
Further, the fourth machine learning unit 40 can be configured similarly to the CNN model illustrated in
<Selection Unit of Sixth Embodiment>
The selection unit 12-6 of the sixth embodiment illustrated in
The fifth machine learning unit 42 is caused to learn acquisition of the image corresponding to the image print suitable for the image print to be decorated on the wall of the room on the basis of an image group of the room for learning and the image group for a teacher. In a case where the room image 2 is input, the fifth machine learning unit 42 selects an image 3 corresponding to the image print suitable for an image print to be decorated on the wall of the room from among the images in the group registered in the content DB 18 or the user image DB 20, and outputs the selected image 3.
Further, the fifth machine learning unit 42 can be configured similarly to the CNN model illustrated in
Although the first machine learning unit 31, the second machine learning unit 36, the third machine learning unit 38, the fourth machine learning unit 40, and the fifth machine learning unit 42 of the second embodiment are configured of the CNN model, the present invention is not limited thereto and various machine learning units configured of a support vector machine, a tree structure model, a simple Bayes, or the like may be used or different types of machine learning units may be appropriately combined and used.
Further, although the user can select a desired image from a plurality of images corresponding to a plurality of (three) image prints in the example illustrated in
It can be detected whether or not an image print has already been decorated in the room, and in a case where the image print has been decorated, the image print can be used as a determination material in a case where an image to be proposed is extracted.
Further, in a case where the image is selected from among the images in the group registered in the content DB 18 or the user image DB 20, it is preferable for an image analysis unit (not illustrated) to classify images into a group of images suitable for image prints and a group of images not suitable for image prints in advance and for the selection unit 12 to select an image from the images in the group suitable for image prints, so that an image not suitable for the image print (an image that is out of focus or an image with a small image size) is not selected.
<Proposal Unit>
The image processing unit 14 and the display 16 functioning as a proposal unit that proposes the image 3 selected by the selection unit 12 to the user can present an image (combination image) 3-1 obtained by combining the selected image 3 with the room image 2 (
In a case where a combination image 3-1 is presented to the user, the image processing unit 14 combines the selected image 3 with a wall region in the room image 2, and generates a combination image 3-1. In this case, the image processing unit 14 adjusts a size of the image 3 to be combined with the wall region of the room according to an area of the wall among the room parameters and a size of the image print of the selected image (A3, 8×10 inches, or the like) and combines the image 3 with the wall region. Further, in a case where imaging is not performed while facing the wall, the wall becomes in a trapezoidal shape. In this case, it is preferable for the image 3 which is combined with the room image 2 to be deformed into a trapezoidal shape. Further, such a shape of the wall can be obtained by performing image processing on the room image 2.
Further, in a case where a position of a light source, a direction of the light source, a type of the light source, and the like is detected as the room parameters, it is preferable for an effect of the light source to be applied to the image to be proposed in a case where the image to be proposed is combined with the wall region of the room image. Accordingly, it is possible to more accurately confirm an atmosphere or harmony in a case where a photograph print is placed in the actual room.
Further, the selection unit 12 may further select a picture frame from among picture frames in a group registered in the content DB 18 in advance, and the image processing unit 14 and the display 16 functioning as a proposal unit may propose the selected image and picture frame to the user.
The picture frame refers to a process of complementing an image print with a frame, a mat board, a pedestal, or the like. In the case of a picture frame using a frame or a mat board, picture frames with different type of frames or the like are different picture frames, and in the case of a picture frame of a processing method which does not use a frame or a mat board, picture frames using the frame or the mat board are different picture frames.
On the basis of the selected image, the selection unit 12 can select a picture frame suitable for the image (the image print) from among the frames in the group.
In a case where the image processing unit 14 and the display 16 functioning as a proposal unit propose the selected image and picture frame to the user, the image processing unit 14 combines an image indicating the selected picture frame with the selected image, and the display 16 displays a combination image (a framed image). Further, the framed image may be combined with the wall region in the room image 2 and a combination image may be displayed.
<Other Proposals>
The selection unit 12 further selects content from among contents in the group registered in the content DB 18 in advance, which are contents in a group other than photograph prints and picture frames. The image processing unit 14 and the display 16 functioning as a proposal unit may propose the selected image and content to the user. On the basis of the selected image, the selection unit 12 can select content suitable for the image (the image print) from among the contents in the group.
For example, it is conceivable that, in a case where an image of the sea is proposed, the selection unit 12 selects content (for example, Hawaiian miscellaneous goods) to be placed together with an image print of the sea, and the image processing unit 14 and the display 16 functioning as a proposal unit present an image corresponding to the Hawaiian miscellaneous goods together with the image of the sea.
In addition, the image processing unit 14 combines the image of the sun with the wall region in the room image 2 and combines the image corresponding to the Hawaiian miscellaneous goods with an appropriate place in the room image 2, and the display 16 may display a combination image.
Further, it is conceivable to extract positiveness of the user from a use situation of other services and reflect the positiveness in extraction conditions of the image corresponding to the image print to be decorated on the wall of the room. For example, a user ordering only a photograph print with a size L or a user entrusting selection and layout of images to be used for an album to an album creating device at the time of ordering a year album is determined to be conservative, and a user selecting a layout by himself or herself is determined is positive. It is conceivable to propose a simple and small image print to users determined to be conservative and propose a large image print or a combination of a large number of image prints to users determined to be positive.
Further, as illustrated in
Further, in a case where the image processing unit 14 proposes the image 3-3 captured by the professional photographer, the image processing unit 14 may adjust the image 3-3 in a direction approximate to the brightness or color tone of the user image 3-2, combine the user image 3-2 with the adjusted image 3-3A, and propose a combination image, thereby giving a sense of unity. It should be noted that the image processing unit 14 may adjust the user image 3-2 in a direction approximate to the brightness or color tone of the image 3-3 imaged by the professional photographer or may adjust both of the images.
[Second Embodiment of Image Print Proposal Device]
The image print proposal system illustrated in
As illustrated in
The image print proposal device 1-2 of the second embodiment is different from the image print proposal device 1-1 of the first embodiment illustrated in
Application software for using the image print proposal device 1-2, for example, is installed in the smartphone 100, the personal computer 102, and the store terminal 104. The smartphone 100 or the like can receive a service provided by the image print proposal device 1-2 (proposal of an image print suitable for decoration of the wall of the room) by executing this application software.
Hereinafter, a case where the user uses the smartphone 100 will be described.
The user executes an application software installed in the smartphone 100 and uploads the room image captured by the smartphone 100 to the image print proposal device 1-2 via the network 110.
The room image transmitted from the smartphone 100 is received via the communication unit 26 of the image print proposal device 1-2. Therefore, the communication unit 26 functions as an image acquisition unit that acquires the room image of the user.
The image corresponding to the image print to be decorated in the room selected by the selection unit 12 of the image print proposal device 1-2 is displayed on a display of the smartphone 100 of the user via the communication unit 26 and the network 110. Here, a function of the image print proposal device 1-2 that causes an image to be displayed on the display of the smartphone 100 corresponds to a proposal unit that proposes the image selected by the selection unit 12 to the user.
In a case where the user likes the image displayed on the display of the smartphone 100, the user can order the image print by touching an icon such as “To order screen” displayed on the display of the smartphone 100.
Further, the user can receive the provision of the service that is the same as above using the personal computer 102 or the store terminal 104. In this case, it is necessary for a room image captured by a digital camera or the like to be input to the personal computer 102 or the store terminal 104 via a recording medium of the digital camera.
[Image Print Proposal Method]
In
On the basis of the room image acquired by the image acquisition unit 10, the selection unit 12 selects an image corresponding to an image print suitable for an image print to be decorated in a room indicated by the room image from among the images in the group registered in the content DB 18 and the user image DB 20 select from the group (step S20).
The display 16 functioning as a proposal unit displays the image selected by the selection unit 12 on the display screen and proposes the image to the user as an image corresponding to the image print to be decorated in the room of the user (step S30).
Accordingly, the user can easily select an image print suitable for the room to be decorated with the image print.
In
Subsequently, the image extraction unit 32-1 extracts an image corresponding to the image print suitable for an image print to be decorated on the wall of the room of the user from among the images in the group registered in the content DB 18 and the user image DB 20 on the basis of the acquired room parameter (step S24).
In
In a case where the instruction input for a display of the combination image 3-1 is received (“Yes”), the image processing unit 14 combines the image 3 selected in step S20 with the wall region in the room image 2, generates the combination image 3-1 (step S34), and causes the generated combination image 3-1 to be displayed on the display 16 (step S36).
On the other hand, in a case where the instruction input for a display of the display form of the display screen 16A illustrated in
The combination image 3-1 displayed in step S36 is an image suitable in a case where an atmosphere or harmony of the room in a case where the image print is decorated on the wall region of the room is confirmed, and the image 3 displayed in step S38 is suitable in a case where details of the image print decorated in the wall region of the room are confirmed since the image 3 is displayed in a large size on the display screen of the display 16.
[Others]
Although the image print proposal device selects the image corresponding to the image print suitable for the image print to be decorated in the room of the user from among the images in the group registered in advance or the images in the group owed by the user in the embodiment on the basis of the room image obtained by imaging the room of the user, the user may be able to designate whether the image print proposal device selects the image corresponding to the image print from among images in a group captured by the professional photographer or the image print proposal device selects the image corresponding to the image print from among images in the group possessed by the user. Further, the user may be able to designate a category (for example, landscape, animal, plant, or person) of the group of images to be selected.
Further, the present invention is not limited to the above-described embodiments, and it is obvious that various modifications can be performed without departing from the spirit of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2017-251806 | Dec 2017 | JP | national |