1. Field of the Invention
The present invention relates to an image processing apparatus, an image processing method, and a non-transitory storage medium storing an image processing program.
2. Description of the Related Art
Various suggestions regarding techniques for presenting assist information to assist in photographic actions have been made. For example, an image photography system for giving guidance on a photographic technique has been suggested in Jpn. Pat. Appln. KOKAI Publication No. 2007-235508. This image photography system presents a sample image (reference image) corresponding to an input keyword to a user together with photographic conditions and the photographic technique. The user sets photographic conditions in accordance with the presented photographic conditions, and performs photography in accordance with the presented photographic technique, and can thereby acquire an image similar to the sample image.
In the suggestion according to Jpn. Pat. Appln. KOKAI Publication No. 2007-235508, when the state of a subject which the user is attempting to photograph is the same as the state of the subject at the time of the photography of the sample image, photography is performed in accordance with the presented photographic conditions and a photographic technique, so that a photograph imaged by the user is taken. However, in actuality, the state of the subject which the user is attempting to photograph is not always the same as the state of the subject in the sample image. When the states of the subject are not the same, it is difficult to take a photograph as imaged even if the photographic conditions are adjusted. Here, if the user knows the photographic process of the sample image, the user may be able to know, from this photographic process, photographic conditions and a photographic technique for taking a photograph having an image similar to that of the sample image.
The present invention has been made in view of the above-mentioned circumstances, and is intended to provide an image processing apparatus, an image processing method, and a non-transitory storage medium storing an image processing program which can present information that permits a photograph imaged by a user to be taken.
An image processing apparatus according to a first aspect of the invention comprises: a subject information acquiring unit which acquires subject information from input photographic image data; a reference image acquiring unit which acquires a reference image corresponding to the subject information acquired by the subject information acquiring unit; a photographic process information acquiring unit which acquires photographic process information including photographic process images that correspond to the reference image acquired by the reference image acquiring unit and that have been acquired at the time of the photography of the reference image; and a presenting unit which displays the photographic process information or the reference image acquired by the photographic process information acquiring unit.
An image processing method according to a second aspect of the invention comprises: acquiring subject information in input image data; acquiring a reference image corresponding to the subject information; acquiring photographic process information including photographic process images that correspond to the acquired reference image and that have been acquired at the time of the photography of the reference image and operational information corresponding to each of the photographic process images; and displaying the photographic process information or the reference image that has been acquired.
A non-transitory computer-readable storage medium according to a third aspect of the invention, stores an image processing program which allows a computer to: acquire subject information from input image data; acquire a reference image corresponding to the subject information; acquire photographic process information including photographic process images that correspond to the acquired reference image and that have been acquired at the time of the photography of the reference image and operational information corresponding to each of the photographic process images; and display the photographic process information or the reference image that has been acquired.
Advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The advantages of the invention may be realized and obtained by means of the instrumentalities and combinations particularly pointed out hereinafter.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the general description given above and the detailed description of the embodiments given below, serve to explain the principles of the invention.
An image processing apparatus according to a first embodiment of the present invention is described below with reference to the drawings.
The configuration of the photographic process information is shown in
The operation of the imaging device according to the first embodiment is described below. From now on, the explanation is given on the assumption that the subject is a white flower. Meanwhile, when the white flower is displayed in a through-image as shown in
First, a subject kind as an example of the subject information in the subject information acquiring unit 110 is acquired. A configuration example of the subject information acquiring unit 110 is shown in
An acquisition example of the reference image is shown in
As an example of presenting the operation state of the photographic process information to the user, one photographic process image and operational information corresponding to this photographic process image may be displayed in a time-series order as shown in
The photographer operation value and the camera automatic set value are described with reference to
Each photographic condition can be allocated to any of the photographer operation value and the camera automatic set value. For example, in the first embodiment, if an aperture value is determined, another photographic condition is determined, and in a photography mode in which exposure is determined by the determination of the other photographic condition, that is, in an A-mode (aperture priority automatic mode), the photographic conditions classified into the photographer operation value are an aperture value and a focal distance. The camera automatic set values in the A-mode are, for example, ISO sensitivity and a shutter speed (SS). In contrast, in a mode other than the A-mode, for example, a manual mode (M-mode) in which the user determines many photographic conditions, most of the photographic conditions are classified into the photographer operation values.
A photography example in which the user acquires a photographic technique by the image processing apparatus 100 is shown in
As described above, the reference image which is a photography example of the subject and the photographic process information for guiding the photographic process to perform photography as in the reference image are presented to the user by the image processing apparatus 100 according to the first embodiment of the present invention. The photographic process information includes multiple photographic process images acquired in the process of taking the reference image, and operational information which are associated with each of the photographic process images and which shows the photographic conditions of the photographic process images. Such photographic process information is presented to the user, so that the user can more easily photograph an image as imaged. Further, the operational information is classified into the photographer operation value which is a photographic condition set by the photographer at the time of the acquisition of the photographic process image, and the camera automatic set value which is a photographic condition automatically set in the imaging device. The photographer operation value and the camera automatic set value are separately presented, so that the user can know the intention of the photographer of the reference image by comparing the photographic process image with the operational information, and more easily photograph an image as imaged.
Next, a second embodiment is described with reference to
Next, a third embodiment is described with reference to
Next, a fourth embodiment is described. In the example described above, the photographic process image is acquired when an operation to change the photographic condition is performed by the photographer. In contrast, the photographic process image according to the fourth embodiment is image data acquired by the photographer of the reference image performing a release operation. That is, an image for which the release operation has been performed is only presented to the user as a photographic process image, so that the user can acquire photographic know-how for photographing the subject more than one time to the finish.
Next, a fifth embodiment of the present invention is described. In the fifth embodiment, the later-described scene kind is used as subject information. The configuration of the image processing apparatus 100 and the presentation to the presenting unit 140 are the same as those in the first embodiment, and explanations of these are omitted.
In the fifth embodiment, the reference image and the photographic process information are not only associated with the subject kind but also associated with the scene kind. The scene kind is the kind of scene which the user is to photograph. Here, in the fifth embodiment, the impression of a photograph that does not apply to the subject kind is referred to as a scene. The scene kind is defined by, for example, a sensitivity word or an impression word. The sensitivity word is, for example, warm, cold, neat, or pretty. The impression word is, for example, bright, dark, red, or blue. The scene kind is identified, for example, from the image characteristic amount. Thus, the reference image and the photographic process information corresponding to the scene kind are acquired. It goes without saying that not only the image data acquired by the image processing apparatus 100 but also externally acquired image data can be classified in terms of scene kind.
In the fifth embodiment, by using both the identification of the subject kind and the identification of the scene kind, it is possible to reduce the situations in which identification is based solely on the subject kind.
Next, a sixth embodiment of the present invention is described without drawings. In the sixth embodiment, positional information and azimuthal information are presented to the user. The description of the configuration of the image processing apparatus 100 according to the sixth embodiment that is similar to the configuration according to the first embodiment is omitted.
The image processing apparatus 100 according to the sixth embodiment further includes a position sensor such as a GPS which detects latitudinal information and longitudinal information regarding the image processing apparatus 100, and an azimuth sensor such as an electronic compass which detects the direction of the image processing apparatus 100 from terrestrial magnetism.
In the photographic process information according to the sixth embodiment, latitudinal information, longitudinal information, and directional information regarding each photographic process image at the time of photography are stored in addition to the photographic process image and the operational information described in the first embodiment.
The subject recognizing unit 113 according to the sixth embodiment not only identifies the subject kind by the image characteristic but also identifies the subject kind by referring to the positional information or the azimuthal information regarding the image processing apparatus 100 and the positional information or the azimuthal information regarding each piece of photographic process information stored in the subject DB 115. The subject kind is more accurately identified by the use of both the identification of the subject kind by the image characteristic amount in the first embodiment and the identification of the subject kind by the positional information or the azimuthal information. Alternatively, the subject information may be the positional information or the azimuthal information. The reference image DB 130 further has a reference image, and positional information associated with the reference image. The reference image acquiring unit may search the reference image DB 130 on the basis of the positional information or the azimuthal information regarding the subject to acquire the reference image regarding the subject which the user is to photograph. When image data is externally acquired, the image processing apparatus 100 may identify the subject by referring to positional information included in the image data if the positional information is included in the image data.
Although the image processing apparatus 100 acquires the positional information by using the internal position sensor, the image processing apparatus 100 may acquire the positional information from an external device. In the sixth embodiment, the presenting unit 140 may present, to the user, the positional information stored in the photographic process information, and the positional information and the azimuthal information regarding the image processing apparatus 100 detected by the GPS and the electronic compass. The user can thus easily know the position and direction to photograph from the reference image.
A seventh embodiment of the present invention is described with reference to
In the first guide example, the presenting unit 140 displays an imaging device image that shows an operational component for changing the photographer operation values, together with the photographic process image and the operational information. The imaging device image may be an image that shows the image processing apparatus 100 as the imaging device, or may be an image of the imaging device different from the image processing apparatus 100. A modification of the configuration of the image processing apparatus 100 in the first guide example is shown in
Next, the second guide example is shown in
The third guide example is shown in
Next, an eighth embodiment of the present invention is described. In the eighth embodiment, a given photographic process image is selected and displayed from among multiple photographic process images in the photographic process information.
The photographic process information in the eighth embodiment includes photographic process images taken and acquired at a predetermined frame rate (e.g. 60 fps), and operational information corresponding to each of the photographic process images. When the photographic process images which have been acquired at 60 fps and which are adjacent in a time series recorded in the operational information are read and presented, the user frequently recognizes the change of the operational information, and may therefore be bothered by the recognition of the multiple photographic process images. Thus, to only present photographic process information necessary for taking a photograph imaged by the user from among the images acquired at 60 fps, the photographic process information acquiring unit 150 selects some of all the photographic process information. The photographic process information acquiring unit 150 acquires the photographic process images selected at regular intervals in a time series from the photographic process images saved in the reference image DB 130. Alternatively, the presented information processing unit 160 described in the seventh embodiment may be used to select the photographic process images at regular intervals in a time series from among the photographic process images included in the photographic process information acquired by the photographic process information acquiring unit 150. Alternatively, whether the changes of the photographic process images (e.g., the change of brightness, the change of the color, and the change of the composition) are greater than a predetermined threshold is determined by the presented information processing unit 160 regarding the photographic images acquired by the photographic process information acquiring unit 150, and a photographic process image having a value higher than the threshold is selected. In this case, a photographic process image in which the photographer operation value has changed more than a predetermined threshold may be only selected. Alternatively, when the image characteristic amount of the photographic process image has changed more than a predetermined threshold, the presented information processing unit 160 selects a later photographic process image in a time series.
As described above, a photographic process image to be presented is selected from among multiple photographic process images stored in the photographic process information, so that the user need only know the photographic process image necessary for taking a photograph imaged by the user.
A ninth embodiment of the present invention is described with reference to
Next, a tenth embodiment of the present invention is described with reference to
In the tenth embodiment, a presenting device 200 which is present outside the image processing apparatus 100 is further provided as shown in
As described above, the reference image or the photographic process information is output to the presenting device 200 outside the image processing apparatus 100, so that the reference image or the photographic process information is displayed in the presenting unit 210. In the first embodiment, the reference image or the photographic process information is displayed in the presenting unit 140. In this instance, other images or information such as through-images may be displayed in the presenting unit 140, so that many images or pieces of information may be displayed in an overlapping state. Therefore, it is difficult for the user to have a look at the images or information. Thus, the reference image and the photographic process information are displayed in the presenting unit 210, so that images such as through-images and information can be displayed in the presenting unit 140 without overlapping.
Next, an eleventh embodiment of the present invention is described with reference to
Next, a twelfth embodiment of the present invention is described. In the twelfth embodiment, the change of the photographic process image whose display has been switched in the photographic process image display area 140a is highlighted.
The image processing apparatus 100 in the twelfth embodiment has the presented information processing unit 160 described in the seventh embodiment, and has a configuration shown in
Alternatively, information indicating the changes of multiple photographic process images may be previously added to the photographic process information and saved in the reference image DB. The highlighting in the presenting unit 140 is performed on the basis of the information indicating the changes of the multiple photographic process images.
As described above, in the twelfth embodiment, the changes of the precedently and subsequently displayed photographic process images are highlighted. It may be difficult for the user to recognize the changes in multiple images, such as slight movements of the subject in the photographic process images or slight changes in colors, even by comparing these changes. The changes in the photographic process images are presented to the user so that the user can know a photographic technique for more easily acquiring image data as imaged.
When the image processing apparatus 100 is connected in communication with the external imaging device, the image processing apparatus 100 can perform highlighting based on the operational information in this external imaging device. While the present invention has been described in connection with the first to twelfth embodiments of the present invention, it should be understood that modifications and applications can be made within the scope of the present invention. For example, a schematic diagram shown in
Moreover, all the processing by the imaging device according to the embodiments described above may be stored as an executable program. This program can be stored in and read from a storage medium of an external storage device such as a memory card (e.g., ROM card or RAM card), a magnetic disk (floppy (registered trademark) disk or hard disk), an optical disk (CD-ROM or DVD), or a semiconductor memory, and the operation can be controlled by the read program, so that the processing described above can be performed.
Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2013-271763 | Dec 2013 | JP | national |
This application is a Continuation Application of PCT Application No. PCT/JP2014/079595, filed Nov. 7, 2014 and based upon and claiming the benefit of priority from the prior Japanese Patent Application No. 2013-271763, filed Dec. 27, 2013, the entire contents of both of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2014/079595 | Nov 2014 | US |
Child | 14790569 | US |