1. Field of the Invention
The present invention relates to an image display device and an image display method for displaying moiré stripe by using a two-dimensional lens array or lenticular lens in which a plurality of convex lenses are arranged in at least one direction.
2. Related Art
In a related art, there is known a phenomenon in which a moiré stripe formed by a lattice pattern arranged in parallel with a predetermined interval appears as stand-out pattern or get-dented pattern. Furthermore, there is also known a technology in which a periodic pattern is arranged below the two-dimensional lens array or lenticular lens so as to provide and display the eye-catching moiré stripe having a get-dented appearance (for example, as disclosed in the following Patent Documents 1-7). There is also known a technology in which some variation is applied to a pattern to be displayed (for example, refer to the following Patent Document 8).
Furthermore, there is also known a technology for displaying a three-dimensional (3D) image by arranging, in matrix shape, an image composed by aggregate (aggregation) of parallax components images in a stereoscopic (3D) manner and viewing this image through a lens array (for example, refer to Patent Document 9).
The above mentioned Patent Documents are as follows.
Patent Document 1: Specification of U.S. Patent Application Laid-open No. 2007/0097111
Patent Document 2: Japanese Patent Application Laid-open Publication No. HEI 11-189000
Patent Document 3: Japanese Patent Application Laid-open Publication No. 2001-55000
Patent Document 4: Japanese Patent Application Laid-open Publication No. 2001-180198
Patent Document 5: Japanese Patent Application Laid-open Publication No.
2002-46400
Patent Document 6: Japanese Patent Application Laid-open Publication No. 2002-120500
Patent Document 7: Japanese Patent Application Laid-open Publication No. 2003-220173
Patent Document 8: Japanese Patent Application Laid-open Publication No. 2003-226099
Patent Document 9: Japanese Patent Application Laid-open Publication No. 2008-249809
However, the technologies utilizing the moiré stripe mentioned above are only ones which display geometric pattern or simple pattern of repeated image as moiré stripe, and the stereoscopic (3D) display by using parallax component images has not been made. Moreover, there is no technology of functioning as moving images or animation by frame-display of the moiré stripe.
In the technology of the Patent Document 9, an image is viewed through a plurality of lenses corresponding to images including the parallax component images, which however provides a problem of narrow visible area or range on which the 3D image is displayed. Particularly, in the technology of displaying an image three-dimensionally by using an image including the parallax component image, in a case when a moiré stripe appears, it has been required to remove such moiré stripe, which constitutes an obstacle for positively utilizing the moiré stripe.
The present invention was accordingly conceived in consideration of the circumstances mentioned above and an object thereof is to provide an image display device and an image display method capable of stereoscopically (3D) displaying image or displaying image as animation (moving image) even in a wide-angle view by producing the moiré stripe using the parallax component images or frame component images.
The above and other object can be achieved according to the present invention by providing, in one aspect, an image display device comprising: an aggregate of convex lenses arranged on a surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which x is a suffix representing the direction); and a display unit displaying a plurality of element images on a focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images aligned in the direction Dx with an image pitch wx different from the pitch Px,
wherein a moiré stripe formed by shift in pitches between a plurality of convex lenses and a plurality of element images is stereoscopically displayed as an image, and the element images are composed of an aggregation of a plurality of parallax component images.
According to this arrangement, the moiré stripe is produced from the element images including the parallax component images, thus displaying a stereoscopic (i.e., 3D) image in a wide range.
In another aspect of the present invention, there is also provided an image display device comprising: an aggregate of convex lenses arranged on a surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which x is a suffix representing the direction); and a display unit displaying a plurality of element images on a focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images aligned in the direction Dx with an image pitch wx different from the pitch Px, wherein a moiré stripe formed by shift in pitches between a plurality of convex lenses and a plurality of element images is stereoscopically displayed as an image, and the element images are composed of an aggregation of a plurality of frame component images.
According to this arrangement, the moiré stripe is produced from the element images including the frame component images, thus displaying an animation in a wide range.
Further, in the above aspects, it may be desired that an original image as an object to be displayed is composed of a plurality of segmented images having parallaxes or frames which are different from each other, and the different element images include the segmented images.
According to this example, the different segmented images included in the different element images can be observed through different convex lenses, thus obtaining further stereoscopic feeling or moving images as animation.
In a preferred example in the above aspects, the aggregation of the element images constitutes a periodic image periodically in at least one direction Dx, and the periodic image is formed by the steps of: segmenting or extracting a plurality of line images or point images with interval k0x from a plurality of segmented images being an original image as an object to be displayed having different parallaxes or frames and having image pitch w0x in at least one direction Dx; reducing or thinning out the interval k of the line images or point images to an interval kx, (wherein kx=k0xx(wx/w0x)) in a case of wx≠w0x; and aligning the line images or point images belonging to the same segmented image in an order of segmentation of the line images or point images with the interval Px, and aligning the element images in the direction Dx with the element image pitch wx so as to contact adjacently in an order reverse to the segmented order of the line images or point images belonging to adjacent segmented images.
In this example, the interval kx=|Px−wx| may be desired.
Accordingly, the positions of the line images and the point images are easily obtainable, so that the periodic image can be easily produced.
It may be also desired that the image display device further includes a moving unit for changing relative position between the aggregate of the convex lenses and the element images along the direction Dx to thereby change an image to display in an enlarged manner.
According to this structure, the stereoscopic (i.e., 3D) image or animation image can be viewed without changing the viewing points.
The element images may be formed by using the segmented images obtained by photographing or rendering a three-dimensional object as the original image while rotating sequentially the three-dimensional object around a predetermined axis with a predetermined angular pitch.
According to this arrangement, a plurality of segmented images having different parallaxes or frames can be easily produced as an original image as an object to be displayed.
Furthermore, the above object can be achieved according to the present invention by providing, in a further aspect, an image display method of displaying an image stereoscopically by using an image display device including an aggregate of convex lenses arranged on a surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which x is a suffix representing the direction); and a display unit displaying a plurality of element images on a focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images aligned in the direction Dx with an image pitch wx different from the pitch Px, wherein the element images are composed of an aggregation of a plurality of parallax component images, and a moiré stripe formed by shift in pitches between a plurality of convex lenses and a plurality of element images is stereoscopically displayed as an image.
In a still further aspect of the present invention, there is also provided an image display method of displaying an image as animation by using an image display device including an aggregate of convex lenses arranged on a surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which x is a suffix representing the direction); and a display unit displaying a plurality of element images on a focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images aligned in the direction Dx with an image pitch wx different from the pitch Px, wherein the element images are composed of an aggregation of a plurality of frame component images, and a moiré stripe formed by shift in pitches between a plurality of convex lenses and a plurality of element images is displayed as an image of animation.
As mentioned above, according to the present invention of the characteristic features or arrangement, the moiré stripe can be produced by using the parallax component images or frame component images by utilizing moiré interference which was not displayed in a simply repeated patterns in a prior art, thereby making it possible to display the stereoscopic (3D) display or animation display image according to the present invention.
The nature and further characteristic features of the present invention can be made clearer from the following descriptions made with reference to the accompanying drawings.
In the accompanying drawings:
Hereunder, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
First, with reference to
As shown in
On the other hand, as shown in
Meanwhile, in a conventional display device, the periodic patterns 2 and 5 are used as those of arrangement of the same diagram or those which gradually change in their shapes in accordance with positions.
In the case that the periodic patterns are used as those of arrangement of the same diagram, images that can be visually seen will become simply repeated pattern, and accordingly, since this repeated pattern is the enlarged image of the periodic pattern, a result is easily predicable, and there are many examples realized as actually commercial products.
On the other hand, in the case where a periodic pattern, that varies when viewed from different positions or at different angles, is used, the visual effect may be strong, but relationship between a periodic pattern and a visual displayed pattern is complicated, and hence, it is difficult to make such design. In addition, the change in pattern was limited to a simple one such as rotation.
On the contrary, according to the embodiment of the present invention, it becomes possible to display a three-dimensional image or animation in a wide area or range by producing or forming the moiré stripe using an image including parallax component images or frame (animation) component images.
With reference to
The aggregate of the respective element images 23i constitutes a periodic image 23, which constitutes one sheet of large image arranged under the two-dimensional lens array 22, and the moiré pattern is caused by periodicity (pitch w1) of the periodic image 23. Further, the display unit is a portion displaying the periodic image 23, which may be a panel or like on which the periodic image is printed or may be a liquid crystal display device displaying the periodic image. Hereunder, the display unit and the periodic image may be designated by the same reference numeral such as “23” without being distinguished.
Furthermore, each of the element images 23i is composed of an aggregate of a plurality parallax component images. Because of this arrangement, the aggregate (periodic image) of the element images 23i constitutes the moiré pattern, which is then three-dimensionally (stereoscopically) displayed by the parallax component image.
That is, the element images 23i as aggregate of the parallax component images pass the convex lenses 22i, respectively, and then, the different parallax components are shot in the different directions. At this time, since parallax disparity component images are sent to both eyes of a viewer (i.e., observer), the three-dimensional image is recognized by the recognition of such disparity component image. Further, at least two or more disparity component images are included in the element image 23i.
The element image 23i may be composed of a plurality of plural frame (animation or moving images) component images. In this case, the aggregate of the element images 23i constitutes the moiré pattern, which is then displayed as animation by the frame component images.
That is, the element images 23i as aggregate of the frame component images pass the convex lenses 22i, respectively, and then, the different frame components are shot in the different directions. At this time, when the viewer moves, since different frame component images are sent to the eyes of the viewer, the animation is recognized by the recognition of such frame component image.
Further, as shown in
Next, there will be explained an example for preparing an element image and a periodic image from an optional original image for enabling a displayed image to provide with a desired function or meaning, or to enhance display effect.
The image display device 100 includes only convex lenses arranged only in the horizontal direction D1 which corresponds to a case of suffix (x=1) of “D” in the appended claims, and as direction increases, (for example, horizontal direction and vertical (perpendicular) direction), the suffix “x” is expressed as x=1, 2, - - - to distinguish the directions.
With the image display device 100, even in a case of
Next, with reference to
It is further to be noted that in a case of kx=″Px−w1|, the positions of the line image and the point image, described hereinafter, are easily determined, so that the periodic image can be easily formed, thus being advantageous.
With reference to
The thus arranged original image 10 is segmented (i.e., divided) into a plurality of segmented images 10a to 10c along the direction D1 with a pitch w0. Here, by using a plurality of the segmented images 10a to 10c viewed as the original image from respectively different viewpoints, the original image 10 includes parallax image and the element image (partial image of the periodic image) from this original image 10. Hence, the element image includes the parallax image. On the other hand, in the case of the animation (moving image), it may be possible to prepare a plurality of images (segmented images) viewed, as the original image 10, from respectively different viewpoints in the like manner, or to prepare a plurality of time-varying images (segmented images).
Furthermore, the segmented images 10a to 10c are aligned from the left side in the direction D1. In addition, as like as the segmented images of the original image, the periodic image may be directly produced by using a plurality of parallax images or frame imaged with the width w0. In such case, the segmented processing or treatment will be not required not.
However, in the present invention, regardless of the fact whether the segmented processing is performed or not, the original image different respectively in the parallax or frame will be called “segmented image”.
Further, in the case where the aggregate of the convex lenses is a lenticular lens as shown in
Next, for example, supposing that the segmented image 10b is segmented into a plurality of line images n with an interval k1 in the direction D1, and the line images n belonging to the segmented image 10b are aligned directly below the lens with an interval P1. Herein, the line images n represent line image which are obtained by further segmenting the segmented image 10b which was obtained by segmenting an original image in the nth order from the left side along the direction D1.
It is further to be noted that the convex lens aggregate is the lenticular lens shown in
Likely, the segmented image 10a is segmented into a plurality of line images (n−1) with an interval k1, the segmented image 10c is segmented into a plurality of line images (n+1) with an interval k1, and these line images are aligned in the direction D1 at an interval P1. Herein, the line images (n−1), n, (n+1) are adjacently arranged in an order reverse to the segmented order of the segmented images 10a to 10c (that is, (n+1), n, (n−1) from the left side along the direction D1).
As described above, the line image (n+1) is arranged on the left side of the line image n, and the line image (n−1) is arranged on the right side of the line image n. Then, if the respective line images are aligned along the direction D1 till the time when the image pitch becomes w1, a plurality of line images included in the image pitch w1 constitutes one element image, and the aggregation of a plurality of the element images constitutes the periodic image 8.
With the above description, the respective line images (n−1), n, and (n+1) are parallax component images respectively different in their parallaxes. For example, with reference to
Meanwhile, in the case of the moving image (animation), the respective line images (n−1), n, and (n+1) are frame component images respectively different in their motion. For example, with reference to
Now, with reference to
While shifting rightward the line image (n+1) by the pitch w1 from the line image n, the line images are likely aligned at the pitch P1, respectively in the direction D1. Thereafter, the respective line images are likely aligned in a manner such that the line images are adjacently aligned in an order reverse to the segmented order of the segmented images, and the aligned image having the image pitch w1 is made as one element image (which may be called “partial periodic image”. For example, in the example of
In the manner mentioned above, the periodic image 8 (partial periodic images 8a, 8b, - - - ) are formed, and when the periodic image 8 is viewed through the lenticular lens, the respective segmented images are displayed according to the segmented order of the original image 10.
As shown in
More specifically, with reference to
For example, in the case where an object image to be displayed in an enlarged manner is a parallax image, an enlarged image of the object image is viewed with a depth from a lens surface, and in addition, is observed as stereoscopic image with different parallaxes in accordance with viewing positions. On the other hand, in a case where an object image to be displayed in an enlarged manner is a frame of the animation (moving image), an enlarged image of the object image is viewed with a depth from a lens surface, and in addition, is observed as animation varying in accordance with viewing positions.
Further, it may be possible to prepare a plurality of segmented images 10a to 10c having different parallaxes or frames as an original image as an object to be displayed (these segmented images may be ones obtained by segmenting one original image or may be directly formed as mentioned hereinbefore). It may be also made that the different element images (partial periodic images) 8a and 8b include different segmented images (for example, the element image 8a includes the (n−3)th line image belonging to a specific segmented image, but the element image 8b does not include the (n−3)th line image but includes the (n+1)th line image belonging to another segmented image).
Moreover, in a direction along the direction D1, the original image is cut out with the depth w0, and then, after reducing or thinning out it with the width w1, is widened into (w1×P1). On the other hand, the height H0 of the original image is not processed in the direction perpendicular to the direction D1. Accordingly, in order to make similar the ratio between the width and the height of an image to be display, it is necessary to produce (w1×P1)/w0=H1/H0. That is, the height of the original image is subjected to enlarging or reducing processing so as to provide H1=(w1×P1)×H0/w0.
Incidentally, with the case of
Furthermore, in the embodiment mentioned above, the original image is segmented into the segmented images and the segmented image is segmented into the line images. However, for example, the line images may be directly extracted from the original image. In addition, a digital image may be adopted as an image to be processed. In such case, when segmentation or extraction is performed, if a pixel of a necessary line image with an image pitch w0 does not exist, a line image mage be obtained by interpolation such as linear interpolation or nearest interpolation from surrounding pixels.
Hereunder, a method of producing a periodic image 8x by an image display device according to a second embodiment of the present invention will be described in detail. It is further to be noted that the image display device according to the second embodiment has substantially the same structure as that of the first embodiment except the difference of the periodic image 8x, and in the second embodiment, the pitch P1<w1, and |P1−w1|=k1(w1 is multiple of k1. Further, in the case of P1=5, w1=41, w1=6, and k1=1, for example, when a lenticular lens of 4OLP1 is used, P1=25.4 mm/40=0.635 mm, and k1=0.635 mm/5=0.127 mm.
Because of P1<w1, as shown in
In an arrangement of
As mentioned above, the line image (n−1) is arranged on the left side of the line image n, and the line image (n+1) is arranged on the right side of the line image n. Then, when the line images are likely arranged along the direction D1 to the tile till the image pitch becomes w1, the plural line images included in the image pitch w1 constitutes one element image, and when the plural element images are aggregated, a periodic image 8x is produced. That is, in the periodic image, the line images are aligned in the order of the segmented images, and because the periodic image is inverted laterally with respect to the original image, in the case where the object image displayed in the enlarged manner arranged periodically in the original image is the parallax image, if an enlarged image 13 of the object image in the arrangement of P1<w1 is filed out, a 3D image having corrected parallax can be observed.
Further, as like as the example of
With the case of
Now, then, as the line image (n+1) is shifted leftward by w1 from the line image n, the line image (n+1) is aligned at the pitch P1 in the direction D1 in the like manner. Thereafter, the respective line images are aligned in the like manner such that the line images are aligned adjacently in the same order as the segmented order of the segmented images, and the image having the image pitch w1 is deemed as one element image (i.e., partial periodic image). That is, it may be adopted that the line images are aligned in the order of n, (n+1) from the left side in the direction D1.
More specifically, with reference to
Incidentally, as shown in
In the manner mentioned above, by producing the element image using the plural segmented images different in their angles, it becomes possible to display the 3D (stereoscopic) image having three-dimensional parallax. The term “rendering” means the producing of a two-dimensional image from an object data on a three-dimensional space using the computer graphics.
Herein, although the photographing method using a camera or rendering method is mentioned, a more preferable image may be effectively obtained by arranging a plurality of cameras based on the same principle.
Further, in the cases of P1<w1 and P1>w1, it is necessary to photograph or perform the rendering operation by reversing the rotating direction of the object 14.
Hereinafter, an image display device 110 according to the third embodiment of the present invention with reference to
The image display device 110 includes a lenticular lens 16 like that of the first embodiment in which a plurality of convex lenses are aligned in the horizontal direction D1, a display section on which a periodic image 17 is arranged and an actuator 30 as moving means.
The lenticular lens 16 is fixed in a manner separated from the periodic image 17. The periodic image 17, such as a panel or liquid crystal display device, is movable in the direction D1 and is secured to the actuator 30. The actuator 30 is reciprocally movable in the direction D1 and serves to move the periodic image 17 in the direction D1. As the actuator 30, a hydraulic cylinder, a linear motor, a stepping motor or like may be used, for example.
In the first and second embodiments described above, the displayed image is switchable in accordance with the viewing angle (for example, from the angle L2 to R2 with reference to
For example, in a case of using a periodic image prepared from a 3D image (stereoscopic image) shown in
Next, with reference to
The image display device shown in
Furthermore, in the fourth embodiment, it is supposed that the pitch P1≧w1, |P1−w1|=k1, P1=5.4, w1=4, k1=1. In this case, the w1 is not an integral multiple of k1.
In the fourth embodiment, since w1≠w0, an interval k0 for dividing one segmented image 21a into a plurality of line images differs from the interval k1 of the line images at a time of forming the periodic image 20 with the pitch w1 by arranging the line images.
Then, after the segmenting the segmented image 21a into the line images with the interval k0, the interval of these line images (in this case, k1=k0×(wx/w0)) is reduced to k1 or thinned out. Processes after making the interval of the line images to k1 are substantially the same as those of the first embodiment, the processes are not mentioned herein.
Further, in the case where either one of the P1 and w1 is not the multiple of the element width (k1) such as in the case shown in
Hereinafter, an image display device 120 according to the fifth embodiment of the present invention will be explained with reference to
The image display device 120 includes a two-dimensional lens array (aggregate of convex lenses) in which a plurality of convex lenses are arranged in the horizontal (lateral or transverse) and vertical (perpendicular) directions D1 and D2 respectively with the pitch of P1 and P2 and a display section on which a periodic image 23 is displayed. That is, in the fifth embodiment, the periodic image 23 is stereoscopically arranged in an enlarged scale as moiré strips respectively in the horizontal direction D i and vertical direction D2. Further, in the two-dimensional lens array 22 shown in
Next, a displayed image by the periodic image 23 will be explained by the periodic image 23 with reference to
In the case of the fifth embodiment, the periodic image 23 is composed of a plurality of element images which are arranged in lines and rows in the directions D1 and D2 with horizontal and vertical widths w1 and w2, respectively.
In this embodiment, the original image is segmented horizontally and vertically, as segmented images, and each of the segmented image is further segmented horizontally and vertically as point images. Then, with reference to
Herein, with reference to
First, a rotational angle with the horizontal axis being the center is determined and then “m” is determined, for example, as m=1. For a series of horizontally arranged segmented images represented with the order “n”, the segmented images (1, 1), (1, 2), (1, 3) - - - are obtained by sequentially rotating the object 14 around the perpendicular axis “y” being the center, then photographing or rendering the object. This operation is as like as that was explained with reference to
Hereinabove, although the photographing or rendering method using one camera was explained, an image may be more effectively obtained by arranging a plurality of cameras based on the same principle.
Further, it is the matter of similar that it is necessary to photograph or render the object 14 by inverting the rotating direction thereof according to the cases of P1<w1 and P1>w1, as like as in the case of
Furthermore, the embodiment represented by
Next, with reference to
The image display device 130 includes, as like as the fifth embodiment, a two-dimensional lens array 24, a display section on which a periodic image 25 is displayed, and actuators (moving means) 31, 32. The two-dimensional lens array 24 is fixed and separated from the periodic image 25. The periodic image 25 as a panel or a liquid crystal display device is placed on an x-y directional stage 33 to be movable independently in the direction D1 or D2. The x-y stage 33 is mounted to the actuators 31, 32 to be movable in the direction D1 of the actuator 31 and the direction D2 of the actuator 32. Accordingly, the x-y stage 33 and the periodic image 25 are movable in the directions D1 and D2 by the actuators 31 and 32, respectively, which may be constituted by a hydraulic motor, the linear motor, stepping motor and the like.
The sixth embodiment is, as like as in the third embodiment, an image viewed at the same position (i.e., angle) can vary sequentially by changing the relative positions of the two-dimensional lens array 24 and the periodic image 25 along at least one of the directions D1 and D2. According to this manner, it becomes possible for the image display device 130 to be provided with an animation displaying function.
For example, with reference to
In an alternation, it may be possible to use a lens array, as the two-dimensional lens array 28, as shown in
The segment image may be obtained by rendering or photographing by a plurality of cameras arranged in honey-comb shape. Moreover, likely, the segmented image may be obtained by using the same structure as that shown in
Still furthermore, in the present embodiment, the segmented image is made into a hexagonal shape, from which the point images are extracted in the honey-comb arrangement to thereby form a periodic image composed of the hexagonal element images. In the respective directions D1, D2 and D3, the relationship between the pitch of the element image and the lens pitch may be made to that between the pitch of the element image and the lens pitch in any one of the first to fourth embodiments.
As described above, in one preferred aspect, the image display method of the present invention is performed by using the image display device including an aggregate of convex lenses arranged on the surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which “x” is a suffix (x) representing the direction), and a display unit displaying a plurality of element images on the focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images in the direction Dx with the image pitch wx, the element images being composed of an aggregation of a plurality of parallax component images, thus stereoscopically displaying the moiré stripe, as an image, formed by the shift in pitches between the plural convex lenses and the plural element images.
Furthermore, in another preferred aspect, the image display method of the present invention is performed by using the image display device including an aggregate of convex lenses arranged on the surface thereof with a predetermined lens pitch Px in at least one direction Dx (in which x is a suffix representing the direction), and a display unit displaying a plurality of element images on the focal plane surface of the convex lenses or near the focal plane surface in a manner aligned along the surface to thereby display the element images in the direction Dx with the image pitch wx, the element images being composed of an aggregation of a plurality of frame component images, thus displaying the moiré stripe, as an image of animation (moving image), formed by the shift in pitches between the plural convex lenses and the plural element images.
It is to be noted that the image display methods mentioned hereinabove may be executed by using a computer or the methods may be made as program to be executed by a computer, or the program executed by the computer may be stored in a CDROM or like readable by the computer.
It is further to be noted that the present invention is not limited to the described embodiments and many other modifications, alternations and changes may be made without departing from the scopes of the appended claims.