Patent Application
20120249529
The present invention relates to 3D (three-dimensional) image displaying apparatus, 3D image displaying methods and 3D image displaying programs adapted to display a 3D (three-dimensional) image (stereoscopic image) generated from a plurality of images, as well as recording media having such programs recorded thereon.
It is known that a human being perceives the third dimension of an object by viewing the object with his/her right and left eyes at different angles and distances, that is to say, owing to the difference between the appearance of the object as viewed with the right eye and that of the object as viewed with the left eye. Such difference in appearance, or spatial disparity, between an object viewed with the right eye and the same object viewed with the left eye is referred to as parallax. To human beings perceiving the third dimension according to the magnitude of the parallax, an image with a larger parallax appears to protrude to a greater extent.
Up until today proposed were methods of exploiting the principle of third dimension perception by human beings to make people perceive 2D (two-dimensional) images (planar images) as stereo images. As an example: If one and the same subject is shot at different angles to obtain images for right eye and for left eye, and the image for right eye is presented to the right eye of a person, while the image for left eye is presented to the left eye, the person perceives that he/she is viewing a stereo image of the subject because there is a certain parallax between the images for right eye and for left eye. Hereafter, the 2D images as displayed so that they may appear to people stereoscopic are referred to as 3D images.
Among various technologies for presenting an image for right eye to the right eye while presenting an image for left eye to the left eye so as to provide a 3D image, parallax barrier technology and lenticular technology may be mentioned as typical ones. In these technologies, an image for left eye and an image for right eye are each decomposed in the form of vertical strips, and the strips of the image for left eye and of the image for right eye are alternately arranged on the same screen to form one image. In the case of parallax barrier technology, only the image for left eye is seen with the left eye, and only the image for right eye with the right eye, of a person viewing the formed image through strip-shaped slits. In the case of lenticular technology, a lenticular lens provided on the screen, on which the formed image is displayed, makes such restriction that only the image for left eye is seen with the left eye while only the image for right eye is seen with the right eye. In addition, 3D printing technology for printing 3D images based on a similar principle concerning lenticular lenses has been proposed.
Since the third dimension perception by human beings is according to the parallax, the stereoscopic impression which is given to people can be modified by adjusting the parallax. In the parallax barrier technology or lenticular lens technology, for instance, people have a stronger stereoscopic impression if an image for left eye and an image for right eye displayed on a screen are displaced from each other in such directions that they do not overlap, so as to increase the parallax between the images for left eye and for right eye. JP 2000-78615 A discloses the digital broadcast receiver in which 3D video images are freely adjustable in parallax.
A camera with a 3D photographing mode, and so forth have been proposed in order to obtain images for right eye and for left eye available for stereopsis in such a way as above. JP 2008-172342 A and JP 2004-104330 A each disclose an apparatus for automatically selecting from among a plurality of images those which are able to be used as images for right eye and for left eye available for stereopsis. A combination of images for right eye and for left eye available for stereopsis is stored as 3D image data, with the images being associated with each other.
Recently, it is often the case that the orderer who is going to order a print of an image taken with a digital camera selects the image to be printed while viewing images displayed on a display device. If printing of 2D image data is to be ordered, the image to be printed is selected, the print size is selected, and the area of the image that is to be printed is confirmed before an order is placed. On the other hand, if printing of 3D image data is to be ordered, it is required not only to make such selections as made during the order for printing of 2D image data but determine whether to have the 3D image data printed as a 2D image or a 3D image. If the 3D image data is to be printed as a 2D image, it is further required to determine whether the image for left eye or for right eye is printed. If the data is to be printed as a 3D image, it is required to select the stereoscopic impression of a 3D image printed. In other words, the order for printing of 3D image data is inconvenient as compared with the order for printing of 2D image data because of a larger number of selections and determinations to be made. In particular, it is desirable that the selected stereoscopic impression of a 3D image printed is confirmed by the orderer with his/her own eyes before an order is placed.
In the digital broadcast receiver as described in JP 2000-78615 A, 3D images are adjustable in parallax, although it is not possible to confirm the stereoscopic impression of the 3D image as adjusted in parallax. In the apparatus as described in JP 2008-172342 A and JP 2004-104330 A, images suitable for stereopsis are merely selected, and it is uncertain whether or not an image generated from the selected image pair is a 3D image giving a stereoscopic impression desirable for the operator.
The present invention has been made in view of the above facts. It is an object of the present invention to provide a 3D image displaying apparatus, a 3D image displaying method and a 3D image displaying program, each allowing display of the 3D images from which a user is able to select with ease a 3D image giving a desired stereoscopic impression, as well as a recording medium having such a program recorded thereon.
In order to achieve the above object, the present invention provides a three-dimensional image displaying method for displaying a plurality of three-dimensional images, each being constructed from a two-dimensional image pair composed of two two-dimensional images taken, wherein the three-dimensional images to be displayed are different from one another in depth, and are displayed in list form; and the three-dimensional images to be displayed share at least part of shot subjects with one another.
In order to achieve the above object, the present invention provides a three-dimensional image displaying apparatus comprising: a three-dimensional image displaying device for displaying a plurality of two-dimensional images sharing at least part of shot subjects with one another so as to display a three-dimensional image in which at least a portion of the two-dimensional images is perceived by a viewer as a stereo image with a specified depth; and a display controlling device for making a depth of the three-dimensional image vary so as to provide a plurality of three-dimensional images with different depths, and causing the three-dimensional images with different depths to be displayed in list form on the three-dimensional image displaying device.
In the concept of the 3D image displaying device as above, included are not only display means available for stereopsis with the naked eye but the display means which are available for stereopsis if a viewer wears glasses formed of polarizing plates or the like. The term “3D image” refers to not an image completely stereoscopic but the 2D images as displayed so that a viewer may perceive them stereoscopic. Objects contained in a 3D image do not need to appear to a viewer stereoscopic in whole, that is to say, they may appear stereoscopic at least in part.
The term “a plurality of 2D images sharing at least part of shot subjects with one another” refers to the images which appear stereoscopic at least in part if stereoscopically displayed by the 3D image displaying device. Specifically, the images are those which share at least part of shot subjects with one another, and are almost identical to one another in composition including background and so forth.
The images to be displayed in list form may or may not be displayed at a time. In other words, the images reduced in size which are to be displayed in list form may also be displayed sequentially by changing the displayed images using a scroll bar or the like.
It is preferable that the three-dimensional image displaying apparatus according to the present invention further comprises an image extracting device for extracting from a plurality of two-dimensional images stored in a storage medium those two-dimensional images which are displayable by the three-dimensional image displaying device as a three-dimensional image if they are combined together, wherein the display controlling device makes the depth of the three-dimensional image vary by forming different combinations of the two-dimensional images as extracted by the image extracting device, and causes three-dimensional images generated from the different combinations of the two-dimensional images to be displayed in list form on the three-dimensional image displaying device.
The configuration as above allows automatic extraction of images suitable for stereopsis from the images stored in a storage medium and, accordingly, makes it possible to extract images not expected by a viewer to be combined together. The viewer may select a desired 3D image by mutually comparing 3D images generated from the automatically extracted images.
The display controlling device may make the depth of the three-dimensional image vary by displacing the two-dimensional images displayed on the three-dimensional image displaying device.
The configuration as above allows the parallax between 2D images to vary, that is to say, allows 3D images with different depths to be generated from the same combination of 2D images.
The display controlling device preferably causes a plurality of two-dimensional images constituting the three-dimensional images with different depths to be displayed as two-dimensional images along with the three-dimensional images, with the three-dimensional images and the two-dimensional images being displayed in list form.
If the images are displayed as above, a viewer is able to select a desired image by comparing the 3D images and the 2D images with each other.
The image extracting device preferably extracts the two-dimensional images which meet a predetermined condition, based on a file format, image analysis, or two-dimensional image tag information.
If the 2D images which meet a predetermined condition are extracted based on the file format, image analysis, or 2D image tag information, images available for stereopsis are extracted with efficiency.
The display controlling device preferably causes three-dimensional images to be displayed in list form in such an order that a three-dimensional image determined to be more suitable for stereopsis based on the predetermined condition is displayed with a higher priority.
If the images are displayed as above, a viewer is able to examine initially those images which are determined to be suitable for stereopsis, so that a desired image is easy to find.
The display controlling device preferably causes an area cut off during generation of the three-dimensional image to be displayed along with the three-dimensional image.
Such display of an area cut off during the generation of a 3D image allows a viewer to identify the area, and recognize that the area to be cut off varies with the 3D image depth.
The three-dimensional images with different depths as displayed on the three-dimensional image displaying device are preferably three-dimensional images displayed in order to select from among them those to be printed.
It is preferable that the three-dimensional image displaying apparatus of the present invention further comprises a device for selecting a three-dimensional image to be printed from among the three-dimensional images with different depths as displayed on the three-dimensional image displaying device.
It is also preferable that the three-dimensional image displaying apparatus of the present invention further comprises a print size designating device for designating a print size for an image.
The display controlling device preferably causes a frame with a size resulting from the print size as designated by the print size designating device to be displayed so that it may be superimposed on the three-dimensional image.
If the frame is displayed as above, it is readily possible for a viewer to select, for the purpose of printing in particular, the 3D image which has a desired depth to give a desired stereoscopic impression, and which the viewer wants to be printed. Moreover, since the area to be actually printed is made definite, printing of an image in an unexpected range is prevented.
The present invention may also be implemented as a three-dimensional image displaying program for causing a computer to perform as its procedures: a display step of displaying a plurality of two-dimensional images sharing at least part of shot subjects with one another so as to display a three-dimensional image in which at least a portion of the two-dimensional images is perceived by a viewer as a stereo image with a specified depth; and a control step of carrying out control so that three-dimensional images differing from one another in depth may be displayed in list form in the display step.
It is also possible to implement the present invention as a computer readable recording medium with the three-dimensional image displaying program as above recorded thereon.
The present invention thus allows display of the 3D images from which a user is able to select with ease a 3D image giving a desired stereoscopic impression.
In the accompanying drawings:
In the following, the 3D image displaying apparatus, the 3D image displaying method and the 3D image displaying program according to the present invention are detailed based on the preferred embodiments as shown in the accompanying drawings.
First of all, description is made on 3D images.
In
A person looking at the 3D display unit 8 with the images 12 and 14 displayed thereon as above perceives the point on the subject that is represented by the points 16 and 18 to be present at a point 10, namely, the point at which a line of sight 26 of the left eye directed to the point 18 and a line of sight 28 of the right eye directed to the point 16 intersect with each other. In other words, the subject as represented by the points 16 and 18 appears to protrude from the 3D display unit 8 by a distance of D0 between the 3D display unit 8 and the point 10. The distance of protrusion from the 3D display unit 8 is hereafter referred to as “depth of a 3D image,” or “3D image depth.” In the case as shown, the 3D image depth is D0, the distance between the 3D display unit 8 and the point 10.
In the 3D display unit 8 as above, the magnitude of the parallax may be caused to vary by displaying the image for right eye 12 and the image for left eye 14 with a horizontal displacement therebetween. The length of horizontal displacement between an image for right eye and an image for left eye is hereafter referred to as “amount of displacement.” If an image for right eye and an image for left eye are displayed in an absolutely superimposed manner, the amount of displacement measures zero. Since the third dimension perception by human beings is according to the parallax, and the magnitude of the parallax is adjustable with the amount of displacement, the stereoscopic impression (or, the depth) of a 3D image can be modified by adjusting the amount of displacement between the image for right eye 12 and the image for left eye 14.
It is conventional that an image for right eye and an image for left eye are obtained by shooting a subject in the positions which are horizontally shifted with respect to the subject. The distance between the corresponding points located on an image for right eye and an image for left eye, respectively, that is to say, the magnitude of the parallax can be changed by changing the distance between the positions in which the images for right eye and for left eye are taken, respectively. The depth of a 3D image displayed on the 3D display unit 8 will vary with the magnitude of the parallax. FIG. 2D shows the 3D image depth which is brought about by the parallax between images for right eye and for left eye that is different in magnitude from the parallax in the case as shown in
In FIG. 2D, the distance between a corresponding point 46 on an image for right eye 42 and a corresponding point 48 on an image for left eye 44 measures L3 (>L0). A person looking at the 3D display unit 8 with the images 42 and 44 displayed thereon as above perceives the point on a subject that is represented by the points 46 and 48 to be present at a point 40, namely, the point at which a line of sight 52 of the left eye directed to the point 48 and a line of sight 54 of the right eye directed to the point 46 intersect with each other. In the case as shown, the 3D image depth for the subject as represented by the points 46 and 48 is D3 (>D0). In other words, a 3D image displayed on the 3D display unit 8 has a greater depth as the parallax between images for right eye and for left eye is increased.
As described above, the 3D display unit 8 causes people to perceive 2D images as a 3D image, by utilizing the parallax between the corresponding points located on an image for right eye and an image for left eye, respectively, and the amount of displacement between the images for right eye and for left eye. Although not shown, similar principles may be exploited to express the depth of a 3D image so that people may perceive an object in the image to be retracting in the back of the 3D display unit 8.
If the amount of displacement is too large, the eyes of a user is overloaded, and stereopsis is no more possible due to the structure of human eyes. The range in which the amount of displacement is selectable depends on the horizontal length of a 3D image (length in the directions in which an image for right eye and an image for left eye are displaced from each other), and the amount of displacement is able to be selected in a wider range as the image size is larger.
As evident from the principles of the 3D display unit 8 as described above, the depth of a 3D image is allowed to vary by changing the amount of displacement, which also applies to the printing of a 3D image. In addition, a 3D image is seen differently from individual to individual, so that there are individual differences with respect to a desirable depth of the 3D image. On the basis of the above, the present inventors have come up with the idea of a 3D image displaying apparatus allowing the selection of a 3D image having a desirable depth by displaying various 3D images with different depths in list form.
The depth of a 3D image depends on the magnitude of the parallax between images for right eye and for left eye, and the parallax between images for right eye and for left eye varies in magnitude with the position of an object in the images in the depth direction. Specifically, the parallax is larger for an object nearer to a camera during shooting, while smaller for an object farther from the camera. In other words, one 3D image should have various depths for the objects as contained therein. In the interest of simplicity, the 3D image depth hereafter refers to that for the corresponding points which have the largest disparity therebetween, that is to say, the corresponding points which represent a subject nearest to a camera if the amount of displacement between images for right eye and for left eye is zero.
The embodiments of the present invention are described below in reference to the accompanying drawings.
The internal memory 102 is a memory for storing therein the images for right eye and for left eye on which a 3D image is based. Any storage medium is usable as the internal memory 102 as long as images are able to be stored in and read from it, with examples including a hard disk and RAM.
The memory slot 104 is a slot for electrically connecting the 3D image displaying apparatus 100 with the external memory 106. The display control unit 108 can read out the data on images and the like as stored in the external memory 106 if the memory 106 is connected to the memory slot 104. Any storage medium is usable as the external memory 106 as long as images are able to be stored in and read from it, with examples including a flexible disk, a MO disk, a CD-R, a DVD-R, and a flash memory.
The display control unit 108 controls the display on the monitor 112 by converting image data into the format as required by the monitor 112, and outputting the image data to the monitor 112. The display control unit 108 adjusts the depth of a 3D image by adjusting the amount of displacement between images for right eye and for left eye displayed on the monitor 112. Adjustment of the amount of displacement between images for right eye and for left eye is carried out using as the reference the distance between the corresponding points which have the largest disparity therebetween if the images for right eye and for left eye are superimposed on each other. In addition, the display control unit 108 changes the size of a 3D image displayed. The display control unit 108 is realized by a CPU and an operation program causing the CPU to perform various processes. The operation program is stored in the internal memory 102.
A user input device 110 is a device for the input by a user, exemplified by a mouse and a keyboard.
The monitor 112 is a monitor allowing the display of 3D images. The monitor 112 displays images outputted from the display control unit 108. The monitor 112 is capable of the display of 2D images alone, the display of 3D images alone, and the display of both 2D images and 3D images in a mixed manner. Any known technology is applicable to the display of 3D images, with examples including parallax barrier technology.
The 3D image displaying apparatus 100 outputs the image data, which is selected and whose printing is ordered by a user, to a printer through a network or the like.
The reduced images, namely thumbnail images, which are obtained by reducing in size a plurality of images as stored in the internal memory 102 or the external memory 106 are displayed in a thumbnail image displaying section 120 located at the left of the monitor 112. In the thumbnail image displaying section 120, thumbnail images as 2D images and those as 3D images are displayed in a mixed manner. The data on a 3D image that is stored in the internal memory 102 or the external memory 106 is composed of the data on an image for right eye, the data on an image for left eye and the tag information which are associated with one another to form data on one 3D image. Tag information includes the 3D image depth with respect to the associated images for right eye and for left eye. The 3D images as stereoscopically displayed in the thumbnail image displaying section 120 have their respective depths which have been stored in advance.
A scroll bar 124 is provided on the right side of the thumbnail image displaying section 120. A knob 122 in the scroll bar 124 is movable in vertical directions in the drawing plane. A user scrolls up or down the images as displayed in the thumbnail image displaying section 120 by using the user input device 110 such as a mouse to drag the knob 122 vertically in the drawing plane. In consequence of such operation, all the images as stored in the internal memory 102 or the external memory 106 are displayed sequentially in the thumbnail image displaying section 120. The user then uses a mouse, for instance, to select from among the thumbnail images as displayed in the thumbnail image displaying section 120 the image which he/she wants to be scaled up. The selected thumbnail image is surrounded by a cursor 126. It should be noted that image selection in the thumbnail image displaying section 120 is in no way the final determination of the image whose printing is to be ordered.
The thumbnail image as selected in the thumbnail image displaying section 120, namely, the image as surrounded by the cursor 126 is scaled up so as to display the scaled-up image in a selected image displaying section 130 located in the middle of the monitor 112. An image displayed in the selected image displaying section 130 is larger than a thumbnail image displayed in the thumbnail image displaying section 120, although not of the original size. If the image as selected in the thumbnail image displaying section 120 is a 2D image, the selected 2D image as such is scaled up and displayed in the selected image displaying section 130.
If the image as selected in the thumbnail image displaying section 120 is a 3D image, the 2D and 3D images which can be generated from the selected 3D image data are displayed in list form in the selected image displaying section 130. To be more specific: In an upper part of the selected image displaying section 130, an image for left eye 132 and an image for right eye 134 are displayed side by side, with the images 132 and 134 constituting the selected 3D image. The image for left eye 132 and the image for right eye 134 are each displayed as a 2D image. On the image for left eye 132 and the image for right eye 134, a frame 132a and a frame 134a are displayed, respectively, in a superimposed manner. Each of the frames 132a and 134a indicates the area of the relevant image that is to be printed if the image is subjected to printing at the designated print size.
In a lower part of the selected image displaying section 130, 3D images 136, 138 and 140 are displayed side by side, whereupon each of the images 136, 138 and 140 can be generated from the selected 3D image data. The 3D images 136, 138 and 140 are different from one another in depth, with the 3D image 136 having the smallest depth, and the 3D image 140 having the largest. In other words, a 3D image displayed in the selected image displaying section 130 at a location nearer to the left end of the section 130 has a smaller depth, while a 3D image displayed at a location nearer to the right end of the section 130 has a larger depth. At the bottom of the selected image displaying section 130, a scroll bar 142 is provided. A user may cause the images which are not displayed at present in the selected image displaying section 130 to be displayed in the section 130 by dragging a knob 144 in the scroll bar 142 in horizontal directions in the drawing plane. As the knob 144 is dragged rightward, 3D images with increasing depths are sequentially displayed in the selected image displaying section 130.
Dark portions 136b and 136c are displayed on the horizontal sides of the 3D image 136, with the portions 136b and 136c being shown by hatching. Similarly, dark portions 138b and 138c are displayed on the horizontal sides of the 3D image 138, and dark portions 140b and 140c are displayed on the horizontal sides of the 3D image 140. The dark portions each represent the size of the area which is cut off from the relevant 3D image as compared with the original image for right eye or for left eye, as a result of the generation of the 3D image by displaying images for right eye and for left eye with a displacement therebetween. The areas to be cut off during the generation of a 3D image are larger as the depth of the 3D image is increased, that is to say, the amount of displacement between images for right eye and for left eye is increased. Accordingly, with respect to the 3D images 136, 138 and 140 as displayed in the selected image displaying section 130 of
The image for left eye 132, the image for right eye 134, and the 3D images with different depths are displayed in list form in the selected image displaying section 130, so that a user is able to select the desired image. Specifically, a user is able to determine by comparison whether to print a 2D image or a 3D image because 2D images and 3D images are displayed in list form. In the case where a 2D image is to be selected, it is possible to select a desirable image, either the image for left eye or the image for right eye. If the image for left eye is selected, for instance, printing of the image for left eye can be ordered. The 3D images with different depths as displayed in list form allow a user to specify the depth of a 3D image by comparison. Since the areas at both horizontal ends of a 3D image that are cut off in accordance with the change in the depth of the image are additionally indicated for identification, a user is able to know the extent of such areas.
The depth of the 3D image as selected from among the displayed 3D images may be employed as the depth of a 3D image subsequently selected. It is assumed that, in
At the right of the monitor 112, a “scale up” button 146, a “scale down” button 148, arrow buttons 150, and print size selecting buttons 152a through 152c are displayed. The “scale up” button 146 and the “scale down” button 148 are used for performing the scale up and the scale down of the selected image, respectively. A user can scale up an image displayed in the selected image displaying section 130 by selecting the “scale up” button 146 with a mouse, for instance. If the “scale down” button 148 is selected, an image displayed in the selected image displaying section 130 is scaled down. The arrow buttons 150 are used for moving the cursor 126 or the like. If the right arrow button is selected, the cursor 126 is moved right, and another image is selected. The print size selecting buttons 152a through 152c are used for selecting the size of the print to be made. On the print size selecting buttons 152a through 152c, symbols, characters, and the like denoting various print sizes are represented. For instance, the print size selecting button 152a which bears letter L is used for placing an order for a print of large size.
In a lower part of the monitor 112, a “previous” button 154 and a “next” button 156 are displayed. The screen as displayed on the monitor 112 is changed into a screen one hierarchical level higher by pressing the “previous” button 154. A screen one hierarchical level higher refers to, for instance, a screen for selecting the memory from which image data are read. The screen as displayed on the monitor 112 is changed into a screen one hierarchical level lower by pressing the “next” button 156. A screen one hierarchical level lower refers to, for instance, a screen for confirming an order for printing of the image as selected in the selected image displaying section 130.
In the case where only one 3D image is displayed at a time, with its depth being changed at will or automatically, as described above in reference to
The 3D image displaying apparatus 100 according to Embodiment 1 of the present invention as described above allows a user to select a desired 2D image or a 3D image giving a desired stereoscopic impression because 2D images and a plurality of 3D images with different depths are displayed in list form in the apparatus.
If scaling up or down of a 3D image is performed in the 3D display unit 8, the distance between corresponding points varies, so that the depth of the 3D image varies accordingly. The depth of a 3D image also varies with the size at which the image is printed, with a smaller print size causing a reduced depth. In consequence, the 3D image as printed at a small size may not appear stereoscopic due to too small a depth selected by a user.
In order to prevent the above, such an image editing screen as shown in
In
The parallax between images for right eye and for left eye may be slight, that is to say, an image for right eye and an image for left eye may be almost the same in such 3D image data as obtained by shooting a distant subject. In that case, it is not necessary to display both images for right eye and for left eye as 2D images, but only the image for left eye 132 as a 2D image may be displayed, as shown in
In the present embodiment, the depth of a 3D image may vary with time not at intervals of three seconds but at other time intervals. In addition, the variation in 3D image depth may not be caused in three steps.
In Embodiment 2, the 3D images with different depths that are generated from various combinations of 2D images are displayed in list form, in contrast to Embodiment 1 in which two 2D images, and 3D images with different depths generated from the two 2D images are displayed in list form.
An image extractor 202 for extracting images available for stereopsis extracts, from the images as stored in an internal memory 102 or an external memory 106, the images two out of which are available in combination for stereopsis. The image extractor 202 extracts images meeting predetermined conditions, with a specific extraction method being detailed later. The process of extraction based on predetermined conditions is performed on all the images stored in the memory as selected by a user.
The images two out of which are available in combination for stereopsis are the images of the same subject which were taken with similar compositions. Examples of the predetermined conditions for the extraction of images available for stereopsis include the condition that a group of the images as contained in a Multi-Picture format (MPF) file should be extracted. In a MPF file, a plurality of 2D images are associated with one another and stored as one file. This file format is chiefly used if 2D images available for stereopsis are to be associated with one another and stored. Consequently, a combination of the 2D images as contained in a MPF file is likely to be a combination of images available for stereopsis. If a twin-lens reflex camera is used to take two images, for instance, the two images are associated with each other and stored as a MPF file. In addition, two or more images of the same subject as taken with a camera horizontally moved with respect to the subject may optionally be stored as a MPF file. Therefore, if a group of images are extracted based on the file format, it is highly possible that a 3D image is generated from a combination of two out of the extracted images.
Another example of the predetermined conditions for the extraction of images available for stereopsis is the condition that a group of the images as taken at short time intervals should be extracted. In recent digital cameras, the shooting date and time are stored for each shot, even to the extent of seconds, as tag information. Generally speaking, the images as taken at time intervals of several seconds or shorter are often images of the same subject. Therefore, if the images as taken at time intervals of several seconds or shorter are extracted based on the tag information, it is highly possible that a 3D image is generated from a combination of two out of the extracted images. As an example, the images as taken at time intervals not longer than two seconds are extracted.
Yet another example of the predetermined conditions for the extraction of images available for stereopsis is the condition that images sharing a subject and the composition should be extracted. In the extraction process under such condition, image analysis is conducted so as to determine whether or not the same subject has been shot with similar compositions. If the images of the same subject as taken with similar compositions are extracted, it is highly possible that a 3D image is generated from a combination of two out of the extracted images.
It is thinkable as a predetermined condition for the extraction of images available for stereopsis to utilize position information based on the Global Positioning System (GPS). If an image is taken with a digital camera having a GPS function, position information based on the GPS is recorded in the tag information. Generally speaking, images closely resembling one another in position information are likely to be images of the same subject. Therefore, if images closely resembling one another in position information based on the GPS are extracted, it is highly possible that a 3D image is generated from a combination of two out of the extracted images. Depending on the accuracy of the GPS function, images closely resembling one another in position information are exemplified by the images which have a position information difference not exceeding two meters between them.
It is also thinkable as a predetermined condition for the extraction of images available for stereopsis to extract a group of the images as taken successively in continuous shooting mode. A group of the images as taken successively in continuous shooting mode can be extracted based on the tag information because it is recorded in the tag information that the images were taken in continuous shooting mode. The images as taken successively in continuous shooting mode are likely to be images of the same subject. Therefore, if a group of the images as taken successively in continuous shooting mode are extracted based on the tag information, it is highly possible that a 3D image is generated from a combination of two out of the extracted images. Moreover, images taken in continuous shooting mode are those taken at short intervals.
It is also thinkable as a predetermined condition for the extraction of images available for stereopsis to extract a group of still images constituting a moving image. The moving image as taken with a digital camera consists of a cluster of still images. It is often the case that the same subject is shot when a moving image is taken. In other words, a group of still images constituting a moving image are likely to be images of the same subject. Therefore, if still images constituting a moving image are extracted, it is highly possible that a 3D image is generated from a combination of two out of the extracted images. A moving image and a still image can be distinguished from each other by the file format.
Such predetermined conditions for the extraction of images available for stereopsis as described above may be employed alone or in combination. As an example, the condition that the images as taken at short time intervals should be extracted and the condition that images sharing a subject and the composition should be extracted are combined with each other so as to extract the images sharing a subject and the composition that were taken at time intervals not longer than two seconds.
A display control unit 204 not only has the functions of the display control unit 108 but causes the images as extracted by the image extractor 202 for extracting images available for stereopsis to be displayed on a monitor 112, in accordance with a method described later. The image extractor 202 and the display control unit 204 are realized by a CPU and an operation program causing the CPU to perform various processes. The operation program is stored in the internal memory 102.
In a thumbnail image displaying section 120, the image data as stored in the internal memory 102 or the external memory 106 are displayed for identification in the form of thumbnail images after they are classified in three categories. In this regard, single image data including no pieces of image data allowing the generation of a 3D image is placed in a first category, the image data from which two pieces of image data allowing the generation of a 3D image have been extracted is placed in a second category, and the image data from which three or more pieces of image data allowing the generation of a 3D image have been extracted is placed in a third category. In other words, in the thumbnail image displaying section 120, thumbnail images derived from the image data in the above three categories, respectively, are displayed in a mixed manner. Classification of image data is performed by the image extractor 202 for extracting images available for stereopsis, based on the results of the extraction of images available for stereopsis.
The image data as classified in three categories are so displayed as to be distinguished from one another in category even in the form of thumbnail images. To be more specific: The thumbnail image which represents pieces of image data allowing the generation of a 3D image has at its lower right the label reading 3D as displayed thereon in a superimposed manner. On the other hand, nothing is displayed on the thumbnail image which represents image data including no pieces of image data allowing the generation of a 3D image, namely, 2D image data.
There are two ways of displaying the thumbnail image which represents pieces of image data allowing the generation of a 3D image. A thumbnail image 210 is displayed as a reduced version of one image. The thumbnail image 210 as such indicates that two pieces of 2D image data as extracted by the image extractor 202 for extracting images available for stereopsis are included therein. A thumbnail image 212 is displayed as a plurality of thumbnail images stacked. The thumbnail image 212 as such indicates that three or more pieces of 2D image data as extracted by the image extractor 202 are included therein.
The two 2D images to be extracted by the image extractor 202 for extracting images available for stereopsis are images for right eye and for left eye included in a MPF file, for instance. If the thumbnail image 210 is selected by a cursor 126, 2D images included in the thumbnail image 210, and 3D images with different depths generated from the 2D images are displayed in list form in a selected image displaying section 130, just as in the selected image displaying section 130 of
It is assumed that eight 2D images 216a through 216h shown in
In the selected image displaying section 130, 3D images 220a through 220i generated from the 2D images as included in the thumbnail image 212 are displayed in list form. The 3D images 220a through 220i are generated from different combinations of the 2D images 216a through 216h as included in the thumbnail image 212. Specifically, image analysis is conducted on every two out of the eight 2D images as included in the thumbnail image 212 so as to extract a plurality of image sets suitable for the generation of a 3D image, and 3D images generated from the extracted image sets are displayed in list form in the selected image displaying section 130.
In
Since 3D images generated from various combinations of 2D images are thus displayed in list form in the selected image displaying section 130, a user is able to select a 3D image meeting his/her intent without trying for him-/herself a variety of combinations of many 2D images.
If the image 220g is selected from the 3D images as generated from different combinations of 2D images and displayed in list form as shown in
As described above, the 3D image displaying apparatus 200 according to Embodiment 2 of the present invention is adapted to extract images available for stereopsis automatically from among the images as stored in a memory. In the apparatus 200, various combinations of the automatically extracted 2D images are displayed in list form as 3D images. Consequently, a user is able to select a desired 3D image from 3D images with different depths generated from various combinations of 2D images.
In the interest of simplicity, print size selecting buttons are omitted from the figures as referred to for the description on the present embodiment. Such buttons may be displayed in Embodiment 2, as is the case with Embodiment 1.
In addition, a print size selecting button indicating the size at which a print of the selected 3D image is not expected to be suitable for stereopsis due to the depth of the image may differently be displayed in the present embodiment apart from Embodiment 1.
Also in the interest of simplicity, frames each having an aspect ratio resulting from the print size and displayed on a 3D image in a superimposed manner are omitted from the figures as referred to for the description on the present embodiment. Such frames may be superimposed on 3D images in Embodiment 2, as is the case with Embodiment 1.
The 3D image whose depth is not considered as suitable for stereopsis based on the selected print size may not be displayed in the present embodiment apart from Embodiment 1.
If different combinations of the automatically extracted images are to be displayed in list form as 3D images in the present embodiment, it is desirable that the 3D images are displayed in such an order that a 3D image derived from the image set which is determined to be more suitable for stereopsis is displayed with a higher priority. The 3D images displayed according to priority are positioned so that, in the case where nine images arranged in an array of 3 rows and 3 columns are to be displayed at a time, for instance, the 3D image as determined to be most suitable for stereopsis may be displayed in the top left corner, while the 3D image as determined to be ninthly most suitable for stereopsis may be displayed in the bottom right corner. The 3D image as determined to be tenthly most suitable for stereopsis and succeeding 3D images may be displayed according to priority by scrolling the 3D images as displayed.
The determination whether or not the image set in question is suitable for stereopsis is made based on such predetermined conditions as described before. If image extraction is to be performed under the condition that the images as taken at short time intervals should be extracted, the image set whose constituent images were taken at shorter time intervals is determined to be more suitable for stereopsis. If image extraction is to be performed under the condition that images sharing a subject and the composition should be extracted, image analysis is conducted to determine the disparity between corresponding points, and the image set in which the parallax is more significant only with respect to the subject(s) while more negligible with respect to the background is determined to be more suitable for stereopsis. If image extraction is to be performed under the condition that images closely resembling each other in position information should be extracted, the image set whose constituent images resemble each other in position information more closely is determined to be more suitable for stereopsis. It is also possible to arrange 3D images in such an order that a 3D image with an earlier shooting time is positioned with a higher priority, or a 3D image having a larger depth, namely, a larger disparity between corresponding points is positioned with a higher priority. If 3D images are to be arranged according to the shooting time, the images are ordered referring to an earlier shooting time of either constituent image of each image set.
While an image set constituting a 3D image is composed of images automatically combined with each other in the present embodiment, it is also possible that a user freely combines images together into an image set. As an example, if the thumbnail image 212 was selected, the 2D images as included in the thumbnail image 212 are displayed in list form in the selected image displaying section 130 as shown in
In the case where a user freely selects two 2D images for the generation of a 3D image as described above, the 2D images which will each bring about a more desirable 3D image if combined with the first 2D image as selected by a user may be indicated distinctively as shown in
The determination whether or not the 2D image in question brings about a desirable 3D image may also be made based on a condition other than that for the extraction of the displayed 2D images. As an example, if the eight 2D images as taken at time intervals not longer than two seconds were extracted under the condition that the images as taken at short time intervals should be extracted, the 2D image which has a position information difference not exceeding one meter between itself and the selected 2D image is surrounded by a cursor displayed with broken lines.
After the 2D image to be combined with the selected 2D image 216a was selected, a 3D image generated from the image set as composed of the two 2D images is displayed in a lower part of the selected image displaying section 130.
In each of the embodiments as described above, the monitor 112 may be an external display unit, or an input device such as a touch panel may be provided as the monitor. While it is desirable that the monitor 112 is a display device capable of displaying 2D and 3D images in a mixed manner, the monitor 112 may be a display device allowing selection of the images to be displayed, either 2D images or 3D images. If the display of 3D images is selected, 3D images are only displayed on the monitor, whereupon 3D images generated from the same image for right eye are displayed in a part of the monitor adapted for the display of an image for right eye, and 3D images generated from the same image for left eye are displayed in a part adapted for the display of an image for left eye. In this way, images for left eye and for right eye can be displayed as 2D images even though the monitor is not capable of displaying 2D and 3D imaged in a mixed manner.
In each of the embodiments as described above, images may be displayed in list form in a number higher or lower than those employed in the above description. It is also possible that the number of the images to be displayed in list form is specified at will by a user.
In each of the embodiments as described above, it is not required that only one image is selected in the displayed screen. For instance, two images, such as an image for left eye and a 3D image, may be selected so as to designate their printing.
In each of the embodiments as described above, adjustment of the 3D image depth is performed using a combination of a bar and a knob, to which the interface to be used for the 3D image depth adjustment is not limited. Use of a “+/−” button, direct input of numerical values, selection of a large, medium or small depth from the drop-down list, and so forth are thinkable.
While a 3D image is generated from two 2D images in each of the embodiments as described above, the present invention is also applicable to the case where a 3D image is generated from three or more 2D images. If a 3D image is to be generated from eight 2D images, eight or more 2D images are extracted from those stored in a memory.
The display of 3D images on the monitor 112 as performed in each of the embodiments as described above can be carried out by a 3D image displaying method including the step of displaying a 3D image on a 3D image displaying device by displaying two or more 2D images sharing at least part of shot subjects with one another so that at least a portion of the 2D images may be perceived by a viewer as a stereo image with a specified depth; the step of causing a plurality of 3D images displayed on the 3D image displaying device to vary in depth; and the step of displaying in list form the 3D images as caused to vary in depth on the 3D image displaying device.
A 3D image displaying program for putting a computer in operation in response to various functions of the 3D image displaying apparatus according to the embodiments of the present invention as described above, and a 3D image displaying program for causing a computer to perform as its procedures the steps of the 3D image displaying method as above are each an embodiment of the present invention. In addition, a computer readable storage medium with such a program recorded therein is an embodiment of the present invention.
The embodiments of the present invention as described above merely exemplify the present invention, putting no limitations on the configuration of the present invention. Any of the 3D image displaying apparatus, the 3D image displaying method, the 3D image displaying program, and a recording medium having the 3D image displaying program recorded thereon according to the present invention is not limited to the above embodiments but may be modified miscellaneously and implemented within the scope of the present invention.
The 3D image displaying apparatus, the 3D image displaying method, the 3D image displaying program, and a recording medium having the 3D image displaying program recorded thereon according to the present invention can be used to edit 3D images so as to allow a user to select with ease the 3D image with a desired depth which gives a desired stereoscopic impression.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2011-081302 | Mar 2011 | JP | national |
