Patent Application
20180246325
The present invention relates to image projection systems and in particular to a heads-up display device for applications such as a vehicle. While some embodiments will be described herein with particular reference to that application, it will be appreciated that the invention is not limited to such a field of use, and is applicable in broader contexts.
Any discussion of the background art throughout the specification should in no way be considered as an admission that such art is widely known or forms part of common general knowledge in the field.
Many modern vehicles are incorporating heads-up-display (HUD) devices to more safely display useful information to drivers. HUDs are typically either incorporated into the vehicle dash upon manufacture or added as a separate off-the-shelf dash-mounted module. These HUDs project an image vertically onto the angled windscreen such that a virtual representation of the image is seen by the driver in a lower region of the windscreen. HUDs display useful information to drivers without significantly distracting the driver from the forward road scene. Such useful information includes the current vehicle speed, GPS navigation signals, alerts and indicators.
The dominant technology currently used in HUDs is LED backlit Liquid Crystal Displays (LCDs). These backlit devices necessarily require significant power to sufficiently illuminate the image as a portion of the light is absorbed upon passing through the LCD. These devices also have limitations in terms of contrast and dynamic range. Alternatively the use of mirror matrices (for example, Texas Instruments DLP projectors) can be used in a HUD but they are also inefficient in optical power usage for a display with sparse information such as is common for an instrument display. These technologies do not provide naturally for a variable perceived distance of the virtual object which is of great value in a HUD environment to convey simple information about location of dangers or navigational features such as upcoming intersections.
More recently, phase only holography based HUD systems have been proposed. These systems utilize a Liquid Crystal On Silicon (LCOS) spatial light modulator to generate a holographic image diffraction pattern. Coherent light is projected onto the LCOS and a holographic image is generated at an image plane corresponding to the spatial Fourier transform of the diffraction pattern. More generally a holographic projection scheme is one which utilizes the coherent phase of light to create an optical field that later propagates to form an image. It is in this more general sense that the terms ‘holographic projection’ and ‘holographic image’ will be used in this specification. The holographic image is projected onto a vehicle windscreen such that the driver sees a virtual representation of the holographic image at some distance in front of the windscreen. Existing LCOS based holographic projectors rely on complicated, costly and bulky lensing systems (of long focal length) to both remove the zero-order diffraction component (which would significantly degrade contrast by providing a background optical power) and to create an intermediate image of sufficient lateral extent to provide an extended angular field of view. For a given focal length or projection distance, the lateral extent of the intermediate image is constrained by the pixel size due to the physics of diffraction and reducing pixel size can come at a cost of reduced performance. In particular, reduced pixel size can give rise to increased phase flicker, which strongly affects the contrast achievable and the reduction of order artifacts which can arise in holographic projection systems. By way of example, US Patent Application Publication 2013/0265622 to Christmas et al. entitled “2D/3D Holographic Display System” removes the zero-order diffraction component through a spatial filter at the image plane.
There is a desire in the art for cheaper, more compact HUD projection systems having small throw distances.
In accordance with a first aspect of the present invention there is provided an image projector for a holographic display system including an input light source for generating an at least partially coherent optical input beam and an imaging system for transforming an image representation in the Fourier domain into a corresponding holographic image in the spatial domain, the image projector including:
The coupling prism is preferably positioned such that the optical input beam is incident onto the first surface at an angle in the first dimension equal to or greater than the critical angle for total internal reflection and reflected onto the spatial light modulator.
The coupling prism preferably includes a second surface and the optical input beam is preferably reflected sequentially off the first and second surfaces at the critical angle for total internal reflection in a first dimension and coupled onto the spatial light modulator and a second subset of diffraction components is reflected off the first surface and refracted through the second surface.
The coupling prism is preferably triangular in the first dimension having sides defined by the first and second surfaces and a third surface disposed adjacent the spatial light modulator.
In one embodiment, the first subset of diffraction components represents negative orders of a diffraction pattern generated at the phase manipulating surface and the second subset of diffraction components represents positive orders of the diffraction pattern generated at the phase manipulating surface. Preferably a zero order diffraction component is spatially separated from the first and second subsets. In one embodiment the zero order diffraction component is reflected off both the first and second surfaces at the critical angle of total internal reflection. In one embodiment the zero order diffraction component is coupled to a photosensor to monitor the power of the zero order diffraction component. Preferably the photosensor is spatially offset from the input light source in a second dimension orthogonal to the first dimension.
The imaging system preferably includes an optical power element and the coupling prism is positioned to refract the first and second subsets of diffraction components onto the optical power element to produce a holographic image in the spatial domain. The second subset of diffraction components are preferably refracted by the coupling prism directly onto a first region of the optical power element. Preferably an angled mirror is provided for reflecting the refracted first diffraction components to a second region of the optical power element.
In one embodiment the optical power element is a positive lens. In another embodiment the optical power element is a concave mirror.
Preferably the phase profile is a Fourier domain representation of the holographic image. In some embodiments the phase profile includes a pre-distortion factor to at least partially compensate for distortion due to the coupling prism. The pre-distortion factor preferably includes an intensity distortion factor to compensate for intensity distortions due to the coupling prism. The pre-distortion factor preferably includes a nonlinear dispersion distortion factor to compensate for nonlinear dispersion distortions due to the coupling prism.
In one embodiment, the spatial light modulator is responsive to the electric control signal to generate a two-dimensional phase and amplitude profile on the reflective phase manipulation surface.
In one embodiment, the phase profile includes a focusing factor to vary the position of the holographic image in the spatial domain along an optical axis.
The holographic image preferably has a higher resolution in a central region and a lower resolution in peripheral regions.
The spatial light modulator is preferably a Liquid Crystal On Silicon device having a two dimensional array of independently electrically drivable pixels to produce the phase profile.
In accordance with a second aspect of the present invention there is provided a heads-up display system including an image projector according to the first aspect. The heads-up display system is preferably incorporated into a vehicle. The holographic image preferably includes vehicle related indicia.
In accordance with a third aspect of the present invention there is provided a method of controlling an LCOS device to generate a diffraction profile for generating a corresponding holographic image from incident light, the method including the steps of:
The step of distorting the image data preferably includes swapping the spatial position of image data in a peripheral region of the array with image data in a central region of the array. The step of distorting the image data preferably also includes increasing the intensity of image data in peripheral regions of the array.
The step of distorting the image data preferably further includes spatially compressing the image data as a function of distance from the center of the array.
The method preferably also includes the step:
Preferred embodiments of the disclosure will now be described, by way of example only, with reference to the accompanying drawings in which:
The present invention relates to an image projector subsystem for a holographic display system. The embodiments of the invention described herein are adapted for use in a heads-up display (HUD) type holographic system having applications in modern vehicles. However, it will be appreciated that the field of the present invention extends beyond this exemplary application. For example, the described image projector system could be incorporated into other types of image or video projectors or other HUD devices such as video gaming devices and military defense related systems.
Referring to
Referring to
Light source 19 provides a single color projection for a monochrome system. In a time multiplexed multicolor system, more than one laser is included, each of which projects a beam of different wavelength through the same projection system. Alternatively, different color inputs could be directed onto separate LCOS devices or separate regions of a single LCOS device. For simplicity, only a monochrome system is illustrated. However, a multicolor system could be implemented with the same optics as described below with the only addition of more than one light source stacked side-by-side and optionally additional LCOS devices. Alternatively, a single tunable light source may be implemented which tunes the output wavelength across multiple output wavelengths in a rapid time division manner. A collimating lens 21 acts to collimate the optical input beam in both the x and y dimensions as illustrated.
The optical input beam is passed through a coupling prism 23, the operation of which will be described in detail below. The optical input beam propagates through prism 23 and onto a spatial light modulator in the form of an LCOS device 25. Device 25 includes a two-dimensional array of independently electrically controllable liquid crystal pixels. Each pixel is drivable by a digital or analogue controlled voltage signal between a number of optical states, each of which impose a different phase delay to a local wavefront of the input optical signal incident thereon. The pixels are deposited on a highly reflective silicon substrate. Together, the reflective silicon layer substrate and liquid crystals define a reflective phase manipulating surface. Preferably the LCOS would provide a phase and amplitude response to accurately capture the optical field information but phase only LCOS are much simpler than phase and amplitude LCOS. Therefore the two-dimensional array of phase only pixels can define a diffraction or phase profile 26 which represents the two-dimensional spatial Fourier Transform of an image which approximates the desired image to be projected at the image plane. This approximate image places no constraints on the phase of the image at the image plane and also may introduce regions of the image plane which will be blocked. These reduced constraints on the image allow for dumping of rejected or unwanted light and permit an optimization such that the intensity profile in the region of interest very closely approximates the desired image.
The optical input beam is reflected off LCOS 25 and diffracted into angularly separated diffraction components based on the current generated diffraction profile. The diffraction components are passed back through coupling prism 23 (again, in a manner that will be described below). In the illustrated embodiment, the coupling lens is positioned such that the diffraction components are coupled to an optical power element in the form of a Fourier lens 27 in the imaging system 5. Lens 27 is a positive lens which acts to focus the diffraction components to the intermediate image plane 9 at its focal length ‘f’. Lens 27 operates as a Fourier transformer to transform the Fourier domain image (represented as the phase profile on LCOS 25) into the desired spatial domain image at plane 9. In other embodiments (not illustrated), lens 27 is replaced with a concave mirror having a concavity to provide the same focal length ‘f’. In another embodiment (not shown), image projector 1 operates in the far-field and no Fourier lens is required; the diffraction components are coupled directly to intermediate image plane 9.
For efficient generation of a holographic image, the coherence length Lc of the optical input beam should satisfy the following equation:
where Np is the number of pixels of the LCOS in the longest dimension and λ is the wavelength of the optical input beam. For example, for an LCOS design having 1024 pixels of pitch 5 mm, a coherence length of greater than about 0.5 mm should be adequate for a wavelength of 700 nm. Thus, suitable light sources for the invention include lasers, Vertical-Cavity Surface-Emitting Lasers (VCSELs) and some narrow band superluminescent diodes (SLEDs).
Returning to
Referring now to
Prism 23 includes three sides defined by three surfaces: an input surface 33 allows for coupling of the optical input beam into prism 23; and first and second reflecting surfaces 35 and 37 are positioned to reflect the optical input beam under total internal reflection onto LCOS 25. This is illustrated best in
To achieve total internal reflection, surfaces 35 and 37 are oriented such that the input beam is incident onto each surface at an angle in the x-z plane that is equal to or greater than the critical angle for total internal reflection. The critical angle (θr) at a surface or boundary is determined from Snell's law and expressed as:
where θi is the angle of incidence, n1 is the refractive index of the material in which the beam is incident and n2 is the refractive index of the second material forming the boundary or surface. In the case of prism 23 formed of BK7 glass (n≈1.52) and disposed in an air environment (n≈1), the critical angle is about 41.1°. Here, angles of incidence and reflection are defined relative to a surface normal.
Referring to
Refraction of the diffraction components at prism surfaces 37 and 35 occurs in a nonlinear fashion giving rise to a nonlinear angular spread between the diffraction components. Lower spatial frequency diffraction components are incident at close to the critical angle and undergo a larger angular deviation (from their original trajectory) while higher spatial frequency diffraction components, which are incident further from the critical angle, undergo a smaller angular deviation. The resulting angular spread of diffraction components upon passing through prism 23 is illustrated as the solid line in
The zero order represents the direct specular reflection component and typically can be a very strong component. The zero order contains the majority of optical power when LCOS pixels are in an undriven state, so it is important to ensure that this cannot be directed to a viewer for safety reasons.
The particular geometry of prism 23 is such that the negative order diffraction components are incident onto second surface 37 at angles less than the critical angle and are thus transmitted through surface 37 at a refracted angle. Conversely, positive order diffraction components are incident onto second surface 37 at angles greater than the critical angle and are thus reflected internally off surface 37 onto first surface 35. These positive orders strike first surface 35 at angles less than the critical angle and are thus transmitted but refracted through surface 35. The refraction of the positive and negative orders at surfaces 37 and 35 magnifies the angular dispersion of the diffraction components.
Prism 23 operates on the zero order component uniquely in that it strikes both surfaces 37 and 35 at angles greater than or equal to the critical angle and is thus reflected off both surfaces. This results in the zero order being reflected back through input surface 33. The returned zero order is separated from the optical input beam by transmitting the input beam at a slight offset from the center of coupling lens 21 in the y dimension, as illustrated in
Referring now to
Because lens 27 is positioned at a distance from the intermediate image plane 9 equal to its focal length f, lens 27 performs a spatial frequency-to-space conversion such that the real holographic image is generated at image plane 9. The position of prism 23 adjacent LCOS 25 acts to enhance the angular dispersion of the diffraction components from LCOS 25 by a factor of about 3 to 3.5 due to the refraction at surfaces 37 and 35. The amount of enhancement to the angular magnification is dependent upon the difference in angle from the critical angle. Diffraction components refracted close to the critical angle experience a large enhancement in angular magnification.
Where the intermediate image 9 is to be transmitted directly to imaging system 5 without the use of an optical diffuser, an angle adjuster 45 can be placed at intermediate image plane 9 to correct the offset between central rays, as illustrated in
As illustrated in
Furthermore, controller 31 may be responsive to video image data captured by a forward facing camera such as a ‘dashcam’. The received video image data may be processed to detect certain patterns in the image such as signs, pedestrians, nearby vehicles and other potential hazards. In response, controller 31 projects a corresponding warning image in the driver's field of view.
In operation, controller 31 sends voltage drive signals to each pixel of LCOS 25 for each image frame to be projected to image plane 11. The voltage signals drive the respective liquid crystal pixels to generate a two-dimensional phase profile in a manner known in the art. For example, Christmas et al. discloses a method of driving an LCOS device to generate Fourier domain phase representation of a holographic image.
In addition to generating the relevant Fourier domain phase profile across the pixels, controller 31 is also able to overlay additional phase profiles for more advanced functionality. In particular, LCOS 25 is also able to provide lensing capability to change the focal position of the diffraction components and hence vary plane 9 to provide variable image depth control. Further, LCOS 25 can pre-distort the Fourier domain phase profile to compensate for distortions that are incorporated by coupling lens 21.
A process 900 of generating a Fourier domain phase (or phase and amplitude) profile on LCOS 25 from input image data is illustrated in
Pre-distortion steps 902 and 903 are interchangeable in order and can be effected by a single image transformation determined by a dispersion curve and intensity map of spatial frequencies of the desired image. Following these pre-distortion steps, at step 904, an appropriate phase (or phase and amplitude) matrix is determined to approximate the generation of the required target image in the Fourier domain of LCOS 25. This is achieved by performing a discrete space Fourier transform on the image data by, for example a method such as the Gerchberg-Saxton method outlined in Christmas et al involving fast Fourier transform algorithms. However, other techniques are known in the art. Finally, at step 905, appropriate voltages are applied to the pixels of LCOS 25 to produce the phase (or phase and amplitude) matrix. This includes accounting for calibration of LCOS in terms of voltage to phase curves for wavelength
Referring now to
In this embodiment, the particular diffraction components to be imaged is defined by the angle of incidence of the optical input beam, the geometry of prism 54 and the refractive index of prism 54. As the zero order diffraction component is not automatically separated from the other components, additional optics may be required to suppress or attenuate this high power component.
The invention is an improvement over existing LCOS based holographic projectors by significantly reducing the size, complexity and cost of the lensing system required to both remove the high intensity zero-order diffraction component and to do the angular magnification to allow a shorter throw distance. The invention can be implemented at very low cost and with very compact optics which, in some embodiments, can all be incorporated into one integral component. Very high suppression of the zero-order diffraction component (greater than 50 dB) can be easily achieved.
For vehicle HUD applications, the invention also allows for a significant enhanced horizontal image size, independent of magnification of the vertical image size. Further, the resolution of the central vision area can be made significantly higher than the resolution of peripheral areas which is ideal for best utilization of a limited number of driven pixels. The higher resolution central region is likely to have detailed instrumentation and instruction and the lower resolution peripheral regions provide vision for warnings and other less important indicia.
Monitoring of the separated zero-order diffraction component can easily be enabled for image optimization and for monitoring safety concerns. An emergency cutoff of the HUD can be implemented in response to detection of reduced zero-order detection (and therefore increased projected light).
The present invention also provides quality high-contrast imaging that is substantially free of flicker contrast artifacts. This is provided through the use of high quality analogue LCOS devices having pixels of dimension greater than or equal to 5 square microns. Analogue drive voltages provide much less phase ripple and much higher contrast than the digital drive signals. This can be especially useful for projections during night time driving and bright daylight conditions. Conventionally, increasing the contrast in LCOS projectors has focused on decreasing the pixel size. However, smaller pixels reduce the pixel capacitance, which affects the ability of the device to maintain an analog drive voltage over a frame. Furthermore, reducing the pixel size introduces a fringing field issue wherein the steering ability of the LCOS is significantly reduced.
Finally, the lack of need for an optical diffuser at the intermediate image plane allows for simple variable image plane depth perception.
It will be understood by one skilled in the art that the frequency and wavelength of a laser beam are connected by the equation:
Speed of light=wavelength*frequency.
As a consequence, when reference is made to frequency shifting, frequency converting, frequency broadening, different frequencies and similar terms, these are interchangeable with the corresponding terms wavelength shifting, wavelength converting, wavelength broadening, different wavelengths and the like.
Throughout this specification, use of the term “element” is intended to mean either a single unitary component or a collection of components that combine to perform a specific function or purpose.
Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as “processing,” “computing,” “calculating,” “determining”, analyzing” or the like, refer to the action and/or processes of a computer or computing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities into other data similarly represented as physical quantities.
In a similar manner, the term “controller” or “processor” may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory. A “computer” or a “computing machine” or a “computing platform” may include one or more processors.
The methodologies described herein are, in one embodiment, performable by one or more processors that accept computer-readable (also called machine-readable) code containing a set of instructions that when executed by one or more of the processors carry out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. Each processor may include one or more of a CPU, a graphics processing unit, and a programmable DSP unit. The processing system further may include a memory subsystem including main RAM and/or a static RAM, and/or ROM. A bus subsystem may be included for communicating between the components. The processing system further may be a distributed processing system with processors coupled by a network. If the processing system requires a display, such a display may be included, e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT) display. If manual data entry is required, the processing system also includes an input device such as one or more of an alphanumeric input unit such as a keyboard, a pointing control device such as a mouse, and so forth. The term memory unit as used herein, if clear from the context and unless explicitly stated otherwise, also encompasses a storage system such as a disk drive unit. The processing system in some configurations may include a sound output device, and a network interface device. The memory subsystem thus includes a computer-readable carrier medium that carries computer-readable code (e.g., software) including a set of instructions to cause performing, when executed by one or more processors, one of more of the methods described herein. Note that when the method includes several elements, e.g., several steps, no ordering of such elements is implied, unless specifically stated. The software may reside in the hard disk, or may also reside, completely or at least partially, within the RAM and/or within the processor during execution thereof by the computer system. Thus, the memory and the processor also constitute computer-readable carrier medium carrying computer-readable code.
Reference throughout this specification to “one embodiment”, “some embodiments” or “an embodiment” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, appearances of the phrases “in one embodiment”, “in some embodiments” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner, as would be apparent to one of ordinary skill in the art from this disclosure, in one or more embodiments.
As used herein, unless otherwise specified the use of the ordinal adjectives “first”, “second”, “third”, etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
In the claims below and the description herein, any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others. Thus, the term comprising, when used in the claims, should not be interpreted as being limitative to the means or elements or steps listed thereafter. For example, the scope of the expression a device comprising A and B should not be limited to devices consisting only of elements A and B. Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
It should be appreciated that in the above description of exemplary embodiments of the disclosure, various features of the disclosure are sometimes grouped together in a single embodiment, Fig., or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claims require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this disclosure.
Furthermore, while some embodiments described herein include some but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the disclosure, and form different embodiments, as would be understood by those skilled in the art. For example, in the following claims, any of the claimed embodiments can be used in any combination.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the disclosure may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it is to be noticed that the term coupled, when used in the claims, should not be interpreted as being limited to direct connections only. The terms “coupled” and “connected,” along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other. Thus, the scope of the expression a device A coupled to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means. “Coupled” may mean that two or more elements are either in direct physical, electrical or optical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.
Thus, while there has been described what are believed to be the preferred embodiments of the disclosure, those skilled in the art will recognize that other and further modifications may be made thereto without departing from the spirit of the disclosure, and it is intended to claim all such changes and modifications as fall within the scope of the disclosure. For example, any formulas given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present disclosure.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2016/047969 | 8/22/2016 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 62208882 | Aug 2015 | US |
