The present invention relates to a method and device for encoding computer-generated holograms in pixelated light modulators in consideration of the defect which is caused by the pixel shape and pixel transparency during reconstruction.
A method for calculating computer-generated video holograms and a corresponding device are known from document DE 10 2004 063 838 A1, where, as shown in
A diffraction image in the form of a separate two-dimensional distribution of wave fields is calculated from each object data set of each object section plane 6, 7, 8 for a reference plane 10, which is situated at a finite distance D6, D7, D8 and parallel to the object section planes 6, 7, 8, where the wave fields of all object section planes are calculated for at least one aggregated virtual observer window 11, which is situated in the reference plane 10 near the observer eyes 12, where the area of said observer window 11 is reduced compared with the hologram 13.
The calculated distributions for the wave fields of all object section planes 6, 7, 8 are added in a reference data set in order to define an aggregated wave field for the virtual observer window 11. For generating a hologram data set for the common computer-generated hologram 13 of the object 1, the reference data set is transformed into a hologram plane 14, which is situated at a finite distance and parallel to the reference plane 10 that coincides locally with the pixel matrix of the light modulator 9.
The amplitude and phase values of the hologram, which are to be realised in the individual pixels, are also calculated dot by dot for the hologram plane 14.
Typically, two-dimensional light modulators with an encoding surface of m pixel rows at n pixels each are used for recording computer-generated holograms, where the pixels are not dots, but have a finite extent and a given shape and a certain amplitude transparency and phase transparency.
Further, it is common practice when describing optical paths to use an xyz coordinate system related to the encoding surface of the light modulator, where x usually denotes the horizontal direction, y the vertical direction and z the normal direction to the encoding surface, and where in the encoding surface n pixels are arranged in a pixel row in the x direction and m pixel rows are arranged in the y direction.
Light modulators with the encoding surfaces shown in
The difference between the usual types of encoding surfaces is shown in
One problem of the prior art is that the dot-by-dot calculation of the hologram and its representation in pixels with finite extent on the light modulators 9, 9′ cause an adulteration, and the reconstruction of the original object 1, which is watched by the observer, shows instances of imprecision.
The occurring defects are caused by the real extent of the pixels, which are based on a conflict between the dot-by-dot calculation of the hologram and the real extent of the pixels, which remains unconsidered.
It is also known that the rectangular pixels of the light modulator, given a uniform transparency or reflectance, exhibit an amplitude distribution in the form of a sinc function of
in a Fourier plane, if they are illuminated with coherent light.
The calculation of the complex light distributions in the plane of the observer window 11 and in the hologram plane 14 is only valid for dots which are intersecting points of a given virtual grid. If the complex distributions are represented on a light modulator 9, 9′, there are pixels which are for example of rectangular shape and which exhibit constant amplitude transparency and/or phase transparency. The representation of the complex hologram values in the pixels of a real light modulator is mathematically a convolution of the calculated hologram with a rectangular function that represents the pixel extent in the x and y directions, as shown in
The size of an observer window is given as the visibility region for an observer in the reference plane 10, it may for example have the size of an eye pupil.
One problem is that the complex wave front in the given observer window 11 and thus also the reconstruction of the three-dimensional object 1 within the volume between the observer window 11 and the hologram 13 are adulterated by the effects of the finite pixel extent in the light modulator 9, 9′. For example, with a reconstruction in the 0th diffraction order, the amplitude distribution of the wave front in the observer window 11 is smaller towards the edges than it would be in the case with ideal dot pixels, due to the multiplicative superimposition of the sinc function.
Complex numbers can usually not be written directly into light modulators, but for example only amplitude values or only phase values. With the help of a suitable encoding method, a complex number is represented by multiple amplitude or phase values, which are written into adjacent pixels of the light modulator.
In the case of Burckhardt encoding, for example, a complex number is represented by three amplitude values. More generally, N*M complex numbers are represented by 3N*M amplitude values.
If one complex value is written into k pixels of a light modulator, only the 1/kth portion of the Fourier transform of the written values corresponds with the Fourier transform of the complex value.
Given an array of 3N*M Burckhardt components, there will be 3N*M complex values after the Fourier transformation, of which only ⅓, i.e. M*N, complex values correspond with the Fourier transform of the 3N*M complex hologram values.
Because of the scanning in the hologram plane, there will be a periodic continuation of the Fourier transform in the observer plane. A portion 1/k of this repeating region can be used as a virtual observer window.
In the case of a phase encoding with k phase values, e.g. in the context of an iterative optimisation, a region 1/k in the Fourier plane can for example be chosen in which the virtual observer window lies.
In the case of this encoding method, the representation of the hologram values in the pixels of a real light modulator again corresponds to a convolution of the encoded hologram with a function that represents the size and transparency of a single pixel of the light modulator, even if a complex number is represented by multiple pixels.
In the reconstruction of the hologram, in the plane of the observer window, the Fourier transform of the ideal hologram, which is encoded object point by object point, is multiplied with the Fourier transform of the pixel shape and transparency, e.g. with a sinc function.
The reconstruction of the object is thus perceived with a defect again.
It is therefore an object of the present invention to provide a method and device for encoding computer-generated holograms on pixelated light modulators, said method and device being designed such that the adulteration of the reconstruction of the hologram which is caused by the real pixel extent of the light modulator is widely eliminated.
The object of the invention is solved by the features of claims 1 and 2. According to the method for encoding computer-generated holograms in pixelated light modulators, object points with complex amplitude values of a three-dimensional original object are assigned to matrix dots of parallel virtual object section planes, so that for each object section plane individual object data sets are defined with discrete amplitude values for the matrix dots, and a holographic encoding for the pixel matrix of a light modulator is calculated from the object data sets,
where from each object data set of each object section plane a diffraction pattern is calculated in the form of a separate two-dimensional distribution of wave fields for a reference plane, which is disposed at a finite distance and parallel to the object section planes, where the wave fields of all object section planes are calculated for at least one aggregated virtual observer window, which lies in the reference plane near the eyes of an observer and whose window area is reduced compared with the hologram, and where the calculated complex wave fields of all object section planes for describing an aggregated wave field for the window are added in a reference data set, which is transformed into a hologram plane, which is disposed at a finite distance and parallel to the reference plane, and which coincides locally with the pixel matrix of the light modulator, for the generation of a hologram data set for the common computer-generated hologram of the object,
where according to the characterising clause of claim 1
the wave front in the observer window, which is calculated from the object section planes, is multiplied with the inverse transform of the pixel shape and pixel transparency, before the wave front modified by the multiplication is transformed into the hologram plane and encoded in the pixels of the light modulator in the form of an amplitude distribution and phase distribution of the hologram. The inverse transform is understood in this document to be the reciprocal of the transform.
Thereby the transforming relation between the reference plane and the hologram plane can be a Fourier transformation.
In this case, the sinc function is used as the Fourier transform for the multiplication for pixels with rectangular shape and uniform amplitude transparency and phase transparency.
In case of other pixel structures or pixel shapes other than the rectangular shape or other transparency gradients in the respective encoding surface of the light modulators, transformations other than the sinc function can be used for the multiplication.
The method is realised in the device for encoding computer-generated holograms in pixelated light modulators, comprising a computer with a processing unit with at least one memory unit for storing the wave front in the observer window, which is calculated from the object section planes, and a manager, and with an output unit, which is connected with the light modulator and which writes the calculated amplitude and phase distribution of the hologram pixel by pixel to the encoding surface of the light modulator,
where according to the characterising clause of claim 5
the processing unit
The second memory unit may also be provided for immediate storage of the inverse transforms of the pixels contained in the encoding surface such that means for the formation of the inverse transformation can be omitted in the multiplication unit. However, means for the formation of the inverse transforms, before they are written into the second memory unit, are provided in the processing unit.
The present invention is described in more detail with the help of an embodiment and a number of drawings, wherein
a shows a transmissive light modulator with a fill factor which is lower than 100%, and
b shows a reflective light modulator with a fill factor of about 100%,
a shows schematically a top view of a horizontal cross-section of the Fourier transform of a pixel with square amplitude transparency as a greyscale representation with a highlighted observer window,
b shows a horizontal cross-section of the Fourier transform of a pixel with rectangular amplitude transparency as a detail of a sinc function, where the observer window is indicated for the Burckhardt encoding method, and
According to the method for encoding computer-generated holograms in pixelated light modulators, object points with complex amplitude values of a three-dimensional original object 1 are assigned to matrix dots 2, 3, 4, 5 of parallel virtual object section planes 6, 7, 8, as shown in
where a diffraction pattern from each object data set of each object section plane 6, 7, 8 is calculated in the form of a separate two-dimensional distribution of wave fields for a reference plane 10, which is disposed at a finite distance and parallel to the object section planes 6, 7, 8, whereby the wave fields of all object section planes are calculated for at least one aggregated observer window 11, which lies in the reference plane 10 near the eyes 12 of an observer and whose window area is reduced compared with the hologram 13, and whereby the calculated distributions of the wave fields of all object section planes 6, 7, 8 for the description of an aggregated wave field for the observer window 11 are added in a reference data set, where the reference data set is transformed into a hologram plane 14, which is disposed at a finite distance and parallel to the reference plane 10, and which coincides locally with the pixel matrix of the light modulator 9, for the generation of a hologram data set for the common computer-generated hologram 13 of the object 1.
According to the invention, the wave front in the observer window 11, which is calculated from the object section planes 6, 7, 8, is multiplied with the inverse transform of the pixel shape and pixel transparency before the wave front modified by the multiplication is transformed into the hologram plane 14 and encoded in the pixels of the light modulator 9 in the form of an amplitude distribution and/or phase distribution of the hologram 13.
The correction can be specified for a light modulator 9 which has pixels of rectangular shape and a uniform amplitude and phase transparency. The inverse transform is then an inverse sinc function. However, it can also be provided for light modulators which have other pixel shapes and pixel transparency values. The corresponding inverse transform of the actual pixel shape and transparency must be used in that case.
Consequently, there may be transforming relations between the reference plane 10 and the hologram plane 14 other than the Fourier transformation mentioned above.
The device 21 for encoding computer-generated holograms in a pixelated light modulator 9, which is illustrated in the form of a block diagram in
The second memory unit 19 may also be provided for immediate storage of the inverse Fourier transforms of the pixels contained in the encoding surface such that means for the formation of the inverse Fourier transforms can be omitted in the multiplication unit 20. However, means for the formation of the inverse Fourier transforms, not shown, before they are written into the second memory unit 19, can be provided in the processing unit 15.
The method according to this invention is simulated with the example of an encoding with one pixel per complex value by way of calculation in one dimension, where
Encoding the hologram modified according to the invention on the light modulator 9, 9′, there will result the values shown in
In the case of other pixel structures and other pixel shapes or other transparency gradients in the encoding surface of the light modulators, e.g. if the pixels deviate from an ideal rectangular shape or if they are arranged irregularly, their Fourier transforms differ from the sinc function. The transforms or their inverse functions which differ from the sinc function are then used for the inventive correction of the holograms.
The method can also be employed if the complex hologram values in the light modulator are not encoded in one pixel, but phase and amplitude are encoded in multiple pixels for each complex value.
In order to correct the defect, it must be multiplied with that section of the inverse transform of the pixel shape and transparency that lies within the virtual observer window 11.
a shows schematically in a top view the Fourier transform of a square pixel with constant transparency as a greyscale representation. The Fourier transform here is the product of the two functions sinc(a·x) and sinc(a·y) with a fixed factor a.
A rectangular box indicates the position of the virtual observer window 11 in the Fourier plane in the case of a Burckhardt encoding, as shown in
b shows the plot in a one-dimensional horizontal cross-section in the Fourier plane at the position y=0, similar to the drawing in
The correction illustrated in
Even if an amplitude or phase encoding method is used, a correction of the complex values can preferably already take place in the virtual observer window 11, before a division into amplitude and phase values is effected in the hologram.
The procedure illustrated using the example of the Burckhardt encoding method here can also be applied to other encoding methods, such as the phase encoding method. The correction of the reconstruction described can also be combined with the iterative optimisation of the phase encoding method disclosed by the applicant in document DE 10 2006 003 741 A1. It will then for example only be necessary for the correction to be performed once, prior to the iteration. This means that only modified set-point values will be generated for the iteration; the iteration process itself will remain unchanged.
As shown in the example described above, in addition to the pixel shape and transparency, the number and arrangement of the pixels which represent one complex value, i.e. the encoding method, must be known for determining the corrective function.
Likewise, the method described above can also be applied in the case of being a transforming relation other than the Fourier transformation between the reference plane and the hologram plane.
Number | Date | Country | Kind |
---|---|---|---|
102006042467.0 | Sep 2006 | DE | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP07/58883 | 8/27/2007 | WO | 00 | 9/30/2009 |