Patent Application
20090002787
This invention relates to holographic image projection systems and to electronic devices incorporating a holographic projector.
Many small, portable consumer electronic devices incorporate a graphical image display, generally a LCD (Liquid Crystal Display) screen. These include digital cameras, mobile phones, personal digital assistants/organisers, portable music devices such as the iPOD (trade mark), portable video devices, laptop computers and the like. In many cases it would be advantageous to be able to provide a larger and/or projected image but to date this has not been possible, primarily because of the size of the optical system needed for such a display.
Background prior art can be found in GB 2,379,351A, GB 2,350,963A, WO 00/40018, WO 2004/066037, U.S. Pat. No. 5,589,955, and U.S. Pat. No. 5,798,864. GB '351 describes a system for producing a three-dimensional image, in which the quantity of data to be displayed is reduced by using a horizontal parallax only (HPO) hologram. GB '963 describes a system in which a battle/shutter arrangement is employed, aligned with a tiled region of an SLM (Spatial Light Modulator) projection surface so that spatially tiled sub-hologram images may be employed in order to produce a three-dimensional image without the need for an optically addressed SLM. By contrast WO '018 employs an optically addressed SLM. In most of the described embodiments a conventional image is formed on an electrically addressed SLM which drives the OASLM although the possibility of using the system to display three-dimensional holographic images is mentioned. WO'037 displays computer generated hologram (CGH) images on an SLM to form a two-dimensional image at a screen, using pre-calculated CGH elements they call “hogels”, each of which is a diffraction pattern that generates a single pixel on the projection screen. However the optics to direct light diffracted by the SLM to the screen are cumbersome. U.S. Pat. No. '955 describes a laser pattern scribing device; U.S. Pat. No. '864 describes a projection-type image display apparatus in which, to avoid time consuming calculation operations, a hologram for display on a display element is calculated by supposing that a phase conjugate minor is situated at the position of the display element, summing spherical light waves, at this position, emanating from all points on a screen on which an image is to be reproduced; a complex conjugate of a result of this calculation is obtained.
According to a first aspect of the present invention there is therefore provided a holographic projection module for a consumer electronic device, the holographic projection module comprising: at least one substantially monochromatic light source; a spatial light modulator (SLM) to phase modulate light from said light source to provide a phase hologram for generating a two-dimensional displayed image; projection optics to project said phase modulated light to form said two-dimensional displayed image; wherein said projection optics comprise an optical system configured to demagnify a conventional, non-holographic image, to increase the divergence of said light forming said displayed image; and a digital signal processor to generate data for a plurality of temporal holographic subframes from a desired image for display, for modulating said SLM, such that temporal averaging amongst the subframes reduces the perceived level of noise, in said displayed image when images corresponding to the subframes are displayed successively and sufficiently fast that they are integrated together in the eye of a human observer.
The monochromatic light source preferably comprises a laser such as a laser diode or another at least partially coherent light source, and may incorporate some form of collimation; alternatively a collimator may be included to approximately collimate the light prior to modulation by the spatial light modulator.
Counter-intuitively embodiments of the optical system produce a demagnifying effect with a conventional, non-holographic image. Substantially any sort of conventionally demagnifying optics can be employed (and if the collimation is poor then generally the optical system may be used to at least partially compensate for this). A consequence is that in embodiments of the optical system the displayed image is substantially focus-free: that is the image is substantially in focus over a wide range or at substantially all distances from the projection module.
A wide range of different optical arrangements can be used to achieve this effect but one particularly advantageous combination comprises first and second lenses with respective first and second focal lengths, the second focal length being shorter than the first and the first lens being closer to the spatial light modulator (along the optical path) than the second lens. Preferably the distance between the lenses is substantially equal to the sum of their focal distances, in effect forming a (demagnifying) telescope. In embodiments two positive (i.e., converging) simple lenses are employed although in other embodiments one or more negative or diverging lenses may be employed.
In embodiments, in particular where the incident light on the SLM is substantially collimated, the first lens may be spaced away from the SLM by a distance substantially equal to a focal length of this lens. However this is not essential and in other embodiments the first lens may be spaced away from the SLM by a distance different to a focal length of this lens, in particular where the incident light on the SLM is not collimated.
The optical system may further comprise a filter to filter out unwanted parts of the displayed image, for example a bright (zero order) undiffracted spot or a repeated first order image (which may appear as an upside down version of the displayed image).
In general any type of pixellated microdisplay which is able to phase modulate light may be employed for the SLM, optionally in association with an appropriate driver chip if needed. Embodiments use an electrically addressable SLM. Suitable SLMs include, but are not limited to, liquid crystal SLMs including LCOS (liquid crystal on silicon) and DLP (registered TM) (digital light processing) SLMs.
In embodiments the displayed image is formed from a plurality of holographic sub-images which visually combine to give (to a human observer) the impression of the desired image for display. These holographic temporal sub-frames are displayed in rapid succession so as to be integrated within the human eye. Each of the holographic temporal sub-frames generates an image having substantially a spatial extent of the desired image for display. In embodiments a holographic sub-frame substantially completely occupies the SLM (apart from 10%, 5% or fewer pixels around the edge of the SLM, to inhibit edge effects).
The data for successive holographic sub-frames may be generated by a digital signal processor, which may comprise either a general purpose DSP under software control, for example in association with a program stored in non-volatile memory, or dedicated hardware, or a combination of the two such as software with dedicated hardware acceleration. Preferred embodiments of a hardware accelerator comprise modules to implement one or more of a phase modulation stage, a space-frequency transformation stage and a quantitation stage of processing.
Thus according to a related aspect of the invention there is therefore provided a holographic projection module comprising: at least one substantially monochromatic light source; a spatial light modulator (SLM) to phase modulate light from said light source to provide a phase hologram for generating a displayed image; and a digital signal processor configured to input digital data for said displayed image and to calculate hologram data for driving said SLM to provide said phase hologram for generating said displayed image; and wherein said digital signal processor is configured to generate holographic data for a plurality of temporal sub-frames each approximating a hologram of an entire image to be displayed for driving said SLM to generate a plurality of phase hologram sub-frames such that, to a human observer, said temporal sub-frames give the impression of said displayed image, a noise variance of said displayed image being perceived as attenuated by averaging across said plurality of phase hologram subframes.
In a holographic projection module, in particular as described above, the SLM may comprise a reflective SLM. This enables a particularly compact optical design.
Thus in a further related aspect of the invention there is therefore provided a holographic projection module comprising: at least one substantially monochromatic light source; a spatial light modulator (SLM) to phase modulate light from said light source to provide a phase hologram for generating a two-dimensional displayed image; and projection optics to project said phase modulated light to form said two-dimensional displayed image; and wherein said SLM comprises a reflective SLM.
In this way, in some preferred embodiments at least part of the optical path to and from the SLM may be shared. In particular at least a portion of the projection optics may be shared, for example the demagnification system at least in part doubling as an optical collimation system. Preferably a polariser is included to suppress interference between light travelling in different directions, that is into and out of the SLM; this may conveniently (and compactly) be implemented using a polarising beam splitter. In particular a polarising beam splitter can be used to direct the output, modulated light at 90 degrees on the image plane, and also to provide the function of the polariser.
The invention further provides a consumer electronic device, in particular a portable device, including a holographic projection module along the lines described above.
The invention still further provides an advertising/signage system and a helmet-mounted or head-up display including a holographic projection module along the lines described above.
The above described aspects of the invention, and features of the above described aspects may be combined in any permutation.
These and other aspects of the invention will now be further described, by way of example only, with reference to the accompanying figures in which:
a and 11b show further examples of optical systems for the holographic projection module of
We have previously described, in UK Patent Application No. GB0329012.9, filed 15 Dec. 2003 now published as WO2005/059881 (hereby incorporated by reference in its entirety), a method of displaying a holographically generated video image comprising plural video frames, the method comprising providing for each frame period a respective sequential plurality of holograms and displaying the holograms of the plural video frames for viewing the replay field thereof, whereby the noise variance of each frame is perceived as attenuated by averaging across the plurality of holograms. The video image may be a moving picture or still image.
Broadly speaking embodiments of the method aim to display an image by projecting light via a spatial light modulator (SLM) onto a screen. The SLM is modulated with holographic data approximating a hologram of the image to be displayed but this holographic data is chosen in a special way, the displayed image being made up of a plurality of temporal sub-frames, each generated by modulating the SLM with a respective sub-frame hologram. These sub-frames are displayed successively and sufficiently fast that in the eye of a (human) observer the sub-frames (each of which have the spatial extent of the displayed image) are integrated together to create the desired image for display.
Each of the sub-frame holograms may itself be relatively noisy, for example as a result of quantising the holographic data into two (binary) or more phases, but temporal averaging amongst the sub-frames reduces the perceived level of noise. Embodiments of such a system can provide visually high quality displays even though each sub-frame, were it to be viewed separately, would appear relatively noisy.
A scheme such as this has the advantage of reduced computational requirements compared with schemes which attempt to accurately reproduce a displayed image using a single hologram, and also facilitate the use of a relatively inexpensive SLM.
Here it will be understood that the SLM will, in general, provide phase rather than amplitude modulation, for example a binary device providing relative phase shifts of zero and π(+1 and −1 for a normalised amplitude of unity). In preferred embodiments, however, more than two phase levels are employed, for example four phase modulation (zero, π/2, π, 3π/2), since with only binary modulation the hologram results in a pair of images one spatially inverted in respect to the other, losing half the available light, whereas with multi-level phase modulation where the number of phase levels is greater than two this second image can be removed. Further details can be found in our earlier application GB0329012.9 (ibid), hereby incorporated by reference in its entirety.
Although embodiments of the method are computationally less intensive than previous holographic display methods it is nonetheless generally desirable to provide a system with reduced cost and/or power consumption and/or increased performance. It is particularly desirable to provide improvements in systems for video use which generally have a requirement for processing data to display each of a succession of image flames within a limited frame period.
We have also described, in GB0511962.3, filed 14 Jun. 2005, a hardware accelerator for a holographic image display system, the image display system being configured to generate a displayed image using a plurality of holographically generated temporal sub-frames, said temporal sub-frames being displayed sequentially in time such that they are perceived as a single reduced-noise image, each said sub-frame being generated holographically by modulation of a spatial light modulator with holographic data such that replay of a hologram defined by said holographic data defines a said sub-frame, the hardware accelerator comprising: an input buffer to store image data defining said displayed image; an output buffer to store holographic data for a said sub-frame; at least one hardware data processing module coupled to said input data buffer and to said output data buffer to process said image data to generate said holographic data for a said sub-frame; and a controller coupled to said at least one hardware data processing module to control said at least one data processing module to provide holographic data for a plurality of said sub-frames corresponding to image data for a single said displayed image to said output data buffer.
In this preferably a plurality of the hardware data processing modules is included for processing data for a plurality of the sub-frames in parallel. In preferred embodiments the hardware data processing module comprises a phase modulator coupled to the input data buffer and having a phase modulation data input to modulate phases of pixels of the image in response to an input which preferably comprises at least partially random phase data. This data may be generated on the fly or provided from a non-volatile data store. The phase modulator preferably includes at least one multiplier to multiply pixel data from the input data buffer by input phase modulation data. In a simple embodiment the multiplier simply changes a sign of the input data.
An output of the phase modulator is provided to a space-frequency transformation module such as a Fourier transform or inverse Fourier transform module. In the context of the holographic sub-frame generation procedure described later these two operations are substantially equivalent, effectively differing only by a scale factor. In other embodiments other space-frequency transformation is may be employed (generally frequency referring to spatial frequency data derived from spatial position or pixel image data). In some preferred embodiments the space-frequency transformation module comprises a one-dimensional Fourier transformation module with feedback to perform a two-dimensional Fourier transform of the (spatial distribution of the) phase modulated image data to output holographic sub-frame data. This simplifies the hardware and enables processing of for example, first rows then columns (or vice versa).
In preferred embodiments the hardware also includes a quantiser coupled to the output of the transformation module to quantise the holographic sub-frame data to provide holographic data for a sub-frame for the output buffer. The quantiser may quantise into two, four or more (phase) levels. In preferred embodiments the quantiser is configured to quantise real and imaginary components of the holographic sub-frame data to generate a pair of sub-frames for the output buffer. Thus in general the output of the space-frequency transformation module comprises a plurality of data points over the complex plane and this may be thresholded (quantised) at a point on the real axis (say zero) to split the complex plane into two halves and hence generate a first set of binary quantised data, and then quantised at a point on the imaginary axis, say 0j, to divide the complex plane into a further two regions (complex component greater than 0, complex component less than 0). Since the greater the number of sub-frames the less the overall noise this provides further benefits.
Preferably one or both of the input and output buffers comprise dual-ported memory. In some particularly preferred embodiments the holographic image display system comprises a video image display system and the displayed image comprises a video frame.
Referring now to
In an embodiment, the various stages of the hardware accelerator implement the algorithm listed below. The algorithm is a method of generating, for each still or video frame I=Ixy, sets of N binary-phase holograms h(l) . . . h(N). Statistical analysis of the algorithm has shown that such sets of holograms form replay fields that exhibit mutually independent additive noise.
where Q(n)=median (muv(n)) and 1≦n≦N
Step 1 folks N targets Gxy(n) equal to the amplitude of the supplied intensity target Ixy, but with independent identically-distributed (i.i.t.), uniformly-random phase. Step 2 computes the N corresponding full complex Fourier transform holograms guv(n). Steps 3 and 4 compute the real part and imaginary part of the holograms, respectively, Binarisation of each of the real and imaginary pails of the holograms is then performed in step 5: thresholding around the median of muv(n) ensures equal numbers of −1 and 1 points are present in the holograms, achieving DC balance (by definition) and also minimal reconstruction error. In an embodiment, the median value of muv(n) is assumed to be zero. This assumption can be shown to be valid and the effects of making this assumption are minimal with regard to perceived image quality. Further details can be found in the applicant's earlier application (ibid), to which reference may be made.
Referring to
Optical system 26 increases the size of the projected holographic image by diverging the light forming the displayed image, as shown.
Still referring to
Lens pair L3 and L4 (with focal lengths f3 and f4 respectively) form the beam-expansion pair. This effectively reduces the pixel size of the modulator, thus increasing the diffraction angle. As a result, the image size increases. The increase in image size (size of the replay field) is determined by the demagnification of the system and is set by the ratio of f3 to f4, which are the focal lengths of lenses L3 and L4 respectively.
Potentially a variable demagnification may be provided by using a variable focal length lens for L3 and/or L4 and adjusting the focal length to adjust the demagnification, for example reducing f3 (and moving L4 and/or increasing f4 so that the focal points of L3 and L4 still coincide).
Two examples of such a lens are manufactured by Varioptic [M. Meister and R. J. Winfield, “Local improvement of the signal-to-noise ratio for diffractive optical elements designed by unidirectional optimization methods,” Applied Optics, vol. 41, 2002] and Philips [M. P. Chang and O. K. Ersoy, “Iterative interlacing error diffusion for synthesis of computer-generated holograms,” Applied Optics, vol. 32, 1993]. Both utilise the electrowetting phenomenon, in which a water drop is deposited on a metal substrate covered in a thin insulating layer. A voltage applied to the substrate modifies the contact angle of the liquid drop, thus changing the focal length. Other, less suitable, liquid lenses have also been proposed in which the focal length is controlled by the effect of a lever assembly on the lens aperture size [R. Eschbach, “Comparison of error diffusion methods for computer-generated holograms,” Applied Optics, vol. 30, 1991]. Solid-state variable focal length lenses, using the birefringence change of liquid crystal material under an applied electric field, have also been reported [R. Eschbach and Z. Fan, “Complex-valued error diffusion for off-axis computer-generated holograms,” Applied Optics, vol. 32, 1993, A. A. Falou, M. Elbouz, and H. Hamam, “Segmented phase-only filter binarized with a new error diffusion approach,” Journal of Optics A: Pure and Applied Optics, vol. 7, 2005, O. B. Frank Fetthauer, “On the error diffusion algorithm: object dependence of the quantization noise,” Optics Communications, vol. 120, 1995].
In a colour system light beams from red, green and blue lasers may be combined and modulated by a common SLM (time multiplexed). Techniques for implementing a colour display are described in more detail in UK patent application GB 0610784.1 filed on 2 Jun. 2006, also incorporated by reference in its entirety.
We have also described, in UK patent application GB 0606123.8 filed on 28 Mar. 2006, also incorporated by reference in its entirety, how one or more of the above lenses may be encoded onto the displayed hologram in order to provide a more compact optical system.
Continuing to refer to
The DSP 100 may comprise dedicated hardware and/or Flash or other read-only memory storing processor control code to implement the above described procedure in order to venerate the sub-frame phase hologram data for output to the SLM 24.
Referring to
The purpose of the phase-modulation block shown in the embodiment of
The quantisation hardware that is shown in the embodiment of
There are many different ways in which phase-modulation data, as shown in
In another embodiment, pre-calculated phase modulation data is stored in a look-up table and a sequence of address values for the look-up table is produced, such that the phase-data read out from the look-up table is random. In this embodiment, it can be shown that a sufficient condition to ensure randomness is that the number of entries in the look-up table, N, is greater than the value, m, by which the address value increases each time, that m is not an integer factor of N, and that the address values ‘wrap around’ to the start of their range when N is exceeded. In a preferred embodiment, N is a power of 2, e.g. 256, such that address wrap around is obtained without any additional circuitry, and m is an odd number such that it is not a factor of N.
In other embodiments the operations illustrated in
In some implementations of an OSPR-type algorithm the input image is padded with zeros around the edges to create an enlarged image plane prior to performing a holographic transform, for example, so that the transformed image fits the SLM (for more details see co-pending UK patent application no. 0610784.1 filed 2 Jun. 2006, hereby incorporated by reference in its entirety. In such a case when performing an (I) FFT the zeros (more precisely, the zeroed areas) may be omitted to speed up the processing.
We refer to the example procedure described above as One Step Phase Retrieval (OSPR). However embodiments of the invention are also useful for OSPR-type procedures in which, strictly speaking, in some implementations it could be considered that more than one step is employed. Examples of these are described in GB05518912.1 filed 16 Sep. 2005 and GB0601481.5 filed on 25 Jan. 2006, both hereby incorporated by reference in their entirety. In the first of the above two patent applications “noise” in one sub-frame is compensated in a subsequent sub-frame so that the number of subframes required for a given image quality can be reduced. More particularly feedback is used so that the noise of each subframe compensates for the cumulative noise from previously displayed subframes. In the second, by calculating the holographic subframe data at a higher resolution than is used to display a subframe, phase-induced errors can be compensated by adjusting the target phase data for pixels of the image to compensate for the errors introduced. Preferably this is performed so that the desirable requirement of a substantially flat spatial spectrum is met.
Referring again to
a illustrates such a lens sharing arrangement, in which a polariser is included to suppress interference between light travelling in different directions, that is into and out of the SLM.
Applications for the above described holographic projection module include, but are not limited to, the following: mobile phone; PDA; laptop; digital camera; digital video camera; games console; in-car cinema; personal navigation systems (in-car or wristwatch GPS); head-up/helmet-mounted displays for automobiles or aviation; watch; personal media player (e.g. MP3 player, personal video player); dashboard mounted display; laser light show box; personal video projector (a “video iPod™”); advertising and signage systems; computer (including desktop); and a remote control unit. A projection module as described above may also be incorporated into an architectural fixture. In general embodiments of the above described holographic projection module are particularly useful in a device where it is desirable to share pictures or for more than one person to view an image at once.
No doubt many other effective alternatives will occur to the skilled person. It will be understood that the invention is not limited to the described embodiments and encompasses modifications apparent to those skilled in the art lying within the spirit and scope of the claims appended hereto.
| Number | Date | Country | Kind |
|---|---|---|---|
| 0512179.3 | Jun 2005 | GB | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/GB2006/050158 | 6/15/2006 | WO | 00 | 8/7/2008 |
