The invention relates to a method for producing an autostereoscopic display and system for an autostereoscopic display.
Parallax panoramagrams, which are also used as base images for lenticular screen images, can spatially reproduce objects with optically active components placed directly upstream. The reproduced objects can then be observed with the human eye without additional aids. In these systems, for example, optically active components such as lenticular screens, which comprise a planar arrangement of multiple optical split lenses or split cylinders, are arranged in front of the parallax panoramagram of the object to be displayed. The parallax panoramagram is prepared in a particular manner for this purpose. In combination with the human visual apparatus, a spatial impression thus eventually appears. Lenticular screen arrangements or lenticular sheets consist for example of acrylic or polyethylene.
According to the prior art the displayed image of the object (parallax panoramagram) is created according to a so-called interlace method. In this method, multiple half images of the object are created, which involve in particular images of the object from different spatial positions, for example by photography or rendering, and then combined by processing. These multiple half images are separated into “thin strips”, for example by means of a suitable software application, and reassembled strip by strip. A complete set of strips of the half images applied is then located under each lens of the lenticular screen. This is usually transformed with the software application on a data processing device. The interlaced image produced in this way—which if there are two interlaced half images is termed a stereogram, or if more than two a parallax panoramagram—is then printed, in order to subsequently position the corresponding lens arrangement over it. The human visual apparatus perceives the lenticular screen image created as a spatial representation of the imaged object. Without the upstream lenticular screen the stereogram/parallax panoramagram appears blurred to the observer.
Bourke for example published in December 1999 a detailed description of the interlace method in his paper: “Autostereoscopic Lenticular Images” (http://local.wasp.uwa.edu.au/˜pbourke/projection/lenticular/).
Parallax panoramagrams or stereograms generated with the interlace method are subject to observational and manufacturing limitations. In connection with lenticular screen images the most severe limitation occurs with respect to the specified (optimal) observer position or the associated minimum observation distances, since otherwise the spatial image can optically decompose or the stereoscopic effect can even be reversed. Secondly, these 3D images are displayed with relatively low visual resolution, since due to limitations of the technology in the case of the lenticular screen image this resolution is essentially a result of the fineness of the half lenses (75 lpi≈75 dpi, lpi=lenses per inch). These can in turn, the smaller they are, only image three-dimensionality in a limited way For spatial simulations the half lenses or half cylinders of the lenticular screen sheet are constructed in such a way that their focal point is located exactly on the base of the lens. This also leads to unavoidable compromises in quality however that are inherent in the technology. Object contours are always displayed in a stepwise fashion in the horizontal direction. In the lenticular technology at least the result is always a detrimental decline in resolution between horizontal and vertical directions. But the change in the displayed image between the individual half-image strips, the so-called image flip, also constitutes a defect. Lenticular screen sheets for animation effects differ from this construction principle. The individual half lenses do not focus as sharply. This also reduces the decline in resolution within the lenticular screen image.
In order to generate 3D images also with animation lenses, base images conesponding to the imaging properties of the individual lenses are necessary. This means that the optical advantages of these lenses for these images can be exploited. These include for example a lower drop in resolution, lower material thickness of the lenticular screen sheets for example, increased dimensions of the individual lenses (up to approximately 1 cm wide≈2 lpi) and hence improved manufacturability and handling properties, improved adjustment of the individual components of an autostereoscopic image generated in this way.
Other methods for manufacturing parallax panoramagrams are known. These have mostly been developed in photography and are hardly used any longer today. The manufacture is accomplished by a complex and constantly repeated exposure of the image by means of, for example, a lenticular screen element placed immediately upstream of the photofilm. Using this technology it is usually possible only to simulate a spatial image in front of the so-called stereo window, this being the case both for lenticular as well as for integral images. In the latter, circular lens arrangements for example are used on the screen sheet. This considerably impairs the realistic and convincing effect of the stereoscopic image. Moreover, huge manufacturing costs are required relative to the interlace method. Its implementation normally requires a good deal of technical knowledge (cf. Roberts et al.: “The History of Integral Print Methods”; http://www.integralresource.org/Integral_History.pdf).
Further explanations on this topic can be found for example in Roberts et. al., “The History of Integral Print Methods” (http://www.microlens.com/pdfs/history_of_lenticular.pdf). Of particular interest to the new method described here is document WO 95/31795. The creation of an object depth-dependent parallax panoramagram using a calculation algorithm and virtual spatial computer data is described. This mechanism is very costly however in complex displays and for photorealistic displays for example, such as are used in particular to produce renderings, it is relatively poorly suited.
The problem addressed by the invention is to create an improved method for producing an autostereoscopic display and an improved system for an autostereoscopic display, which simplify the provision of autostereoscopic images with optimised quality.
According to one aspect of the invention, a method for producing an autostereoscopic display which may also referred to as one of picture, image, and depiction is provided which shows at least one object, wherein in the method, by means of an application running on a data processing device for the at least one object, with the help of a radiation image design in a virtual optical imaging system, which comprises the at least one object, an imaging lens that is disposed opposite the at least one object and images said object as an object image in an image plane, and a recording device recording the object image in the image plane, image data is produced for a parallax panoramagram of the object image in the recording device, an image corresponding to the image data for the parallax panoramagram is produced and an autostereoscopic display is produced by disposing a transparent planar arrangement of imaging elements that corresponds to the imaging lens upstream of the parallax panoramagram.
According to a further aspect of the invention a system or arrangement with an autostereoscopic display is created, in which an image, which corresponds to image data of a parallax panoramagram for an object image, is applied on an imaging side of a carrier material and a transparent component is arranged upstream of the imaging side with a transparent planar arrangement of imaging elements, corresponding to an imaging lens, wherein by means of an application running on a data processing device for at least one object with the help of a radiation image design in a virtual optical imaging system, which comprises the at least one object, the imaging lens that is disposed opposite the at least one object and images said object as an object image in an image plane, and a recording device (8) recording the object image (6a, 6b) in the image plane, the image data for the parallax panoramagram of the object image in the recording device are generated in the recording device.
The invention comprises the idea of using the radiation image design in an optical imaging system during the production of the parallax panoramagram. The optical imaging system comprises the at least one object to be displayed and an imaging lens that is disposed opposite the at least one object and images said object as an object image in an image plane. The imaging lens is for example a planar lens arrangement, which can also be referred to as a lenticular screen, of an appropriate design. Furthermore the optical imaging system comprises a recording device, for example a camera, with which the object image generated in the image plane by means of a radiation image design is recorded, wherein the recorded image (parallax panoramagram) is also generated in the recording device by using the radiation image design.
The image data for the recorded image (parallax panoramagram) are then used to generate a corresponding image, either by means of an electronic image display, for example on a display, or by printing the image on to a carrier material. The autostereoscopic image or display then arises by disposing a lens corresponding to the imaging lens of the optical imaging system, for example designed as a planar lens arrangement, upstream of the image. In one configuration, in which the image corresponding to the image data of the recorded image (parallax panoramagram) is output via a display, the planar lens arrangement can also be generated on the display by means of electronic simulation, in order to thus create the spatial 3D impression for the human visual apparatus. When applying the image on to a carrier material, for example by printing, the planar lens arrangement, for example in the form of an appropriately configured, transparent, optically active component is placed upstream of the image.
In contrast to the prior art, in the proposed method, which can also be referred to as the VLR method (VLR—“Virtual Lenticular Rendering”), it is not necessary to first generate multiple images of the object to be displayed and then decompose them into strips, in order to then recombine them according to a pre-defined order. Rather, by using the radiation image design corresponding to the parameters of the optical imaging system the recorded image (parallax panoramagram) is generated directly in the recording device, which is in turn derived by means of the radiation image design from the object image in the image plane.
According to a further aspect of the invention a method for producing an autostereoscopic display is created, which shows at least one object, wherein the method uses an interlace method and wherein the strips interlaced together in the interlace method comprise strips of different width. The width of the strips is derived directly from the optical properties of the arrangement of imaging elements subsequently placed downstream. In doing so both the individual imaging element as well as its position in the overall arrangement of the imaging elements can be taken into account.
A further aspect of the invention provides a method for producing an autostereoscopic display, which shows at least one object, wherein the method uses an interlace method and wherein distances between recording positions for a recording device, with which as part of the interlace method images of the at least one object are generated, comprise differing, non-equidistant intervals. These variable distances are derived from the optical properties of the arrangement of imaging elements subsequently placed upstream. In doing so the alignment can be converted from the percentage of imaging exposure, for example of a half lens of a lenticular screen sheet, directly into recording device intervals.
With the aid of the different aspects of the invention it becomes possible to better take into account, in different ways, the specific surface construction and the optical properties of the arrangement of imaging elements in which a lenticular screen sheet is involved in a preferred embodiment, in order thus to optimise the quality of autostereoscopic images. To this extent the various aspects of the invention form different solution options for the problem addressed here.
In the following, advantageous configurations of the aspects of the method for producing autostereoscopic images are described.
A preferred embodiment of the invention provides that the autostereoscopic display is generated by displaying the image data for the parallax panoramagram via a display area and the arrangement of imaging elements upstream of the imaging lens is displayed on the display area in the form of an electronically simulated arrangement of imaging elements. In this manner autostereoscopic displays can be generated on any desired display devices.
In an expedient embodiment of the invention it can be provided that the autostereoscopic display is generated by generating the image corresponding to the image data for the parallax panoramagram on a carrier material on an imaging side and a transparent component with the arrangement of imaging elements being arranged upstream of the imaging side. For the arrangement of imaging elements, standard commercial lenticular screen sheets can for example be used, which are known as such in different variants. For example, such lenticular screen sheets are available in acrylate or polyethylene.
An advantageous embodiment of the invention provides that the imaging and optically active component is specifically adapted depending on the at least one object (scenery), in particular by having a variable size for the individual elements. Due to a close coupling between the spatial image depth that can be imaged, lens surface and lens size, by separately adapting each individual element of a screen sheet the image properties can be enhanced. A lenticular screen sheet for example could then, optimised by different half lens sizes, reproduce autostereoscopic displays, object-specifically and scene-specifically.
An advantageous embodiment of the invention provides that the parallax panoramagram be printed on to the carrier material. The printing is carried out on to photo paper by means of a printer, for example.
An embodiment of the invention provides that the transparent component is adhesively disposed on the imaging side. This involves an adhesive connection being established between the carrier material and the transparent component by using a suitable adhesive agent, for example a transparent glue.
In an advantageous embodiment of the invention it can be provided that when generating the image data for the object image the radiation image design in the virtual imaging system is designed so as to use a refractive index that is not equal to 1.
An embodiment of the invention can provide that lenses of the arrangement of imaging elements are shaped such that on a side facing away from the image they comprise a curved surface, and on a side facing the image side an essentially flat surface. In one configuration of the VLR method, when determining the image data per image element the surface of the virtual arrangement of imaging element is arranged to be mirror-inverted with respect to the imaging lens of the mounted transparent component.
One preferred embodiment of the invention provides that autostereoscopic display data are stored on an electronic storage medium, which data comprise the image data for the parallax panoramagram and information about parameters for the imaging lens. The parallax panoramagram data can then be read and processed by means of a suitable software application from the electronic storage medium, which is for example a CDROM, a DVD or a memory stick, in order to generate the desired autostereoscopic image of the object on a display device. The image data, including the electronic information about the lens arrangement, can be regarded as a kind of coded display for the image of the object.
The invention is described in greater detail in the following, with the aid of exemplary embodiments and by reference to figures. They show:
a schematic illustration with an object to be imaged and multiple recording positions,
a schematic illustration to explain an interlacing of strip elements in an adapted interlace method with variable strip widths,
a schematic illustration with an object to be imaged and multiple non-equidistant recording positions,
a schematic illustration to explain the interlace method using half images, which have been produced by non-equidistant recording positions, and
Since the position and size of the imaging region are dependent on the viewing angle, the observation position is then displaced in steps parallel to the lenticular screen sheet, i.e. laterally, in the diagram according to
On account of the optical properties of the lens it can also be useful in creating the diagram to consider not only the light beams at the outer ends of the lens curvature, but also to scan the entire lens surface step by step as seen from the observation position. Due to the spherical aberration the light beams at the outermost ends of the lens curvature do not necessarily indicate the largest possible imaging area. Light beams which are localised further towards the centre of the lens can by comparison, especially at higher viewing angles, show larger regions at the base of the lens. The diagram would therefore change appropriately.
A stepwise change in the viewing angles is also conceivable. If it is assumed that when viewed perpendicularly (viewing angle 0°) for example 20 percent of the lens base is clear, the next viewing angle to be considered is that which makes the neighbouring imaging region visible.
At this viewing angle the imaging region is then smaller than the first, e.g., 15 percent. This is continued until the whole lens width of the individual lens has been covered. This would result in a diagram with few points. These could however be translated directly into strip widths (20, 15, . . . percent) and, it is assumed, the number of points represents the optimal number of half images to be processed for this lenticular screen.
The optical imaging system comprises an object 1, which is to be imaged. Opposite to the object 1 a planar lens arrangement 2 is arranged with multiple lens elements 2a in the form of a lenticular screen, wherein curved surfaces 3 are formed on a side facing the object 1 and flat surfaces 4 on a side facing away from the object 1. Using construction beams 5 and considering the optical properties of the planar lens arrangement 2, in particular the beam refraction at the boundary surfaces, multiple object images 6a, 6b of the object 1 arise in an image plane 7. Arranged downstream of the planar lens arrangement 2 is a camera 8. With the aid of the radiation image design shown, a recorded image (parallax panoramagram) of the multiple object images 6a, 6b in the image plane 7 is generated in the camera 8, which image can in other embodiments also be formed nearer to or further away from the curved surface 3. The image data generated in this way for the recorded image (parallax panoramagram) represent a kind of base image for creating the lenticular image. They can subsequently be used to output the base image on a display or to print it on to photographic paper. The described method, which can also be referred to as the VLR method, is expediently embodied by means of a suitable software application, which is implemented so that is can run on a data processing device. The optical imaging system is formed virtually using the application and used to create the radiation image design. Software applications, with which such a radiation image design corresponding to the physical parameters of an optical image in a given imaging system can be embodied, are available as such in different designs, and for this reason they will not be discussed further here. The image data of the parallax panoramagram then exist ultimately as electronic data, which can be passed to a further processing stage, for example outputting via a display or processing in a printer.
In the following, embodiments using an interlace method will be described. The interlace method is known as such. For example, reference is made to the description in Bourke, “Autostereoscopic Lenticular Images” (http://local.wasp.uwa.edu.au/˜pbourke/projection/lenticular/), December 1999.
Below, a method for producing a parallax panoramagram using the interlace method will be described by reference to
In the method, stereo image recordings of the object to be imaged are first generated in the conventional manner by means of a recording device, in particular a camera, or virtually, namely by means of a software application installed on a computer, which is suitable for image construction. The intervals between recording positions, in which the recording device is arranged either actually or virtually, are selected to be equidistant (cf.
Following this the individual half images are interlaced in accordance with their position relative to the lens elements (cf.
In the following, by reference to
As part of the interlace method individual half images of the object to be imaged are first generated, either actually or virtually, by placing the recording device at different recording positions. The selection of the recording positions is performed in accordance with the transparent, optically active component used for the parallax panoramagram, for example a lenticular screen. The optimised distribution of the recording positions has a form that is inversely proportional to the imaging width under the individual lens (
The described methods can be used with lenticular screens in which the individual lenses are also different in their shape and dimensions to the shapes shown in the exemplary embodiments. After investigation of the imaging behaviour of other lens shapes or surface characteristics, all the methods described here can be modified accordingly.
This would change
In order to determine the strip width, the number of half images for the calculation should be halved, as
Then, based on the previously determined relevant number of half images, the range of the viewing angle is sub-divided equally between zero and the given critical angle. The percentage figures for the imaging exposure at the base of the lens that can then be read off can be interpreted as a ratio of the individual half-image strips to each other. Using an example of ten half images, in
In the example, this results in a half-image strip width for the ten half images used of approx. 1.1%; 6.3%; 11.1%; 14.2%; 17.3%; 17.3%; 14.2%; 11.1%; 6.3%; 1.1%. This partitioning does not yet take into account the fact that animation lenses in the range of the viewing angles given cannot free the entire base of the lens (cf.
The half-image strips must then be converted into pixel widths based on the width of the lens and printer resolution and then the rounded values used. If, for example, exactly 60 pixels are interlaced under one lens element (for an animation lens with 10 lpi equivalent to a printer resolution of 600 dpi) the pixel widths of the half-image strips in the example are to be divided up approximately as follows: 1; 4; 7; 8; 10; 10; 8; 7; 4; 1. It can also be useful to retrospectively convert the individual half-image strips from the conventionally calculated strips of the interlace method (in the example a constant 6 pixels wide) into the suggested pixel widths, and then compress them or stretch them in width. Even the position of the individual lens element to the left or right in the lenticular screen sheet can affect the sequence of the interlaced half images. Thus a further deformation of these modified half-image strips can comprise the fact that in the right-hand region of the, for example, lenticular screen image the half images recorded further to the right are placed in the middle and those to the left correspondingly placed to the left (cf.
In order to calculation the non-equidistant camera intervals it is necessary to proceed, as just described, with the aid of
In particular in the methods presented that build on the interlace method, an advantageous characteristic consists in the fact that not all of the available half images per lens element are used. This depends on the position underneath the lenticular screen sheet. Although for example 10 half images are available, it can be useful to process only 7 for an individual lens. This is given as a specific supplement to the methods presented with variable strip width and non-equidistant camera positions.
The features of the invention disclosed in the present description, claims and the drawings can be of significance both individually and in any desired combination for the implementation of the invention in its various embodiments.
Number | Date | Country | Kind |
---|---|---|---|
102008025103.8 | May 2008 | DE | national |
PCTDE2009000718 | May 2009 | WO | international |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/DE2009/000718 | 5/25/2009 | WO | 00 | 2/16/2011 |