The present disclosure relates to a display system. Particularly, but not exclusively, the disclosure relates to apparatus for displaying images on a screen in a ghost image free manner at an arbitrary projection distance.
Heads-up displays (HUDs) are known displays where images are projected onto a transparent surface, such as a windscreen or visor. Such displays are well known in a number of different environments including in vehicles.
Within the automotive industry, most commercial HUDs utilize a separate optical screen (combiner-type HUDs), or display directly onto the windshield (windscreen-type HUDs). Combiner-type HUDs can be installed in most types of cars without a great deal of modifications. They utilize a transparent plastic projector screen to combine the real driving environment and the projected virtual image. Whilst relatively cheap to install, the plastic screen will partially obscure the view of the driver, and furthermore its performance is poor when the unit experiences vibrations.
Windscreen-type HUDs utilize a vehicle's windscreen to combine a virtual image and real environment. As the windscreen has a finite thickness (typically much greater than the screens used in combiner-type HUDs), the projected image will be reflected both at the front and the back surface of the windscreen, resulting in a primary image and an secondary offset ‘ghost’ image. The term ghost image is used in the art, and throughout the specification to describe the secondary offset image. In order to negate this effect, a special film can be applied to the windscreen that enhances reflection at the front surface (thereby reducing subsequent reflection at the back surface and diminishing the ghost image). Whilst relatively low cost, such films can be visually unappealing, adversely affect image quality and can decreased in effectiveness following long-term exposure to sunlight. Another solution is to provide a special multi-layer, wedged windscreen which effectively overlap the two reflected images, such that the driver is presented with single, clear image. A schematic of a wedged windscreen is shown in
An alternative approach is to engineer a windscreen with one or more layers of emissive/scattering nanoparticles. Each layer will generate a visible emission at one of R/G/B waveband when excited by a scanning laser projector. By overlaying the images of multiple wavebands, a coloured image is displayed on the windshield. This so-called full windscreen HUD has an unlimited viewing angle, unlimited display site and no laser speckle, but are again expensive and complicated to produce. Further, as the driver has to focus on the windscreen in order to view the displayed information, multi-depth images (i.e. images having elements at different apparent depths) cannot be experienced.
A further difficulty arises when designing HUDs for applications in which the windscreen has a large tilting angle, such as those found in trains and lorries. For small cars, the tilting angle of the windscreen is usually between 30° and 45° and the HUD system is installed just beneath the dashboard, making it easier to design the HUD system. For larger vehicles however, the tilting angles of windscreens can vary over a while range. For example, most train windscreens have a tilting angle from 60° to 80. As for trucks and buses, the tilting angle can be even higher—up to 90°. Not only does the larger tilting angle, in combination with the thicker windscreens used in larger vehicles, make the ghost image problem more prominent by increasing the offset of the images reflected from the front and back surface of the windscreen, it also increases the cost of the conventional mitigation techniques discussed above.
As such the existing methods do not allow for the reduction of ghost images across multiple different systems.
An object of the present invention is to mitigate some of the deficiencies of the prior art mentioned above.
Aspects and embodiments of the invention provide apparatus as claimed in the appended claims.
According to a first aspect of the invention there is provided an image generation system for providing a ghost image free head-up display, the system comprising a display screen having a front surface and a back surface, a picture generation unit for projecting an image towards the display screen for reflection towards an eye box, a field lens, and an anisotropic optical component having a first optical power along a first axis and second optical power along a second axis, wherein the first and second axis are perpendicular, wherein the picture generation unit is configured to project light through the field lens such that light is incident on the front surface of the display screen forming a first virtual image, wherein a portion of the light is transmitted through the display screen and is incident on the back surface of the display screen forming a second virtual image, wherein the first and second virtual images are offset along the first axis, wherein the field lens is configured to project the first virtual image at a first projection distance and the second virtual image at a second projection distance such that the offset is below a threshold magnitude and the first and second virtual images are substantially overlaid as viewed from the eye box, and wherein the anisotropic optical component is configured to magnify the first and second virtual image along the second axis only.
This approach allows for ghost image free projection without the need for any modification to the display screen surface or internal structure. It further allows for images to be displayed at a shorter apparent projection distance than would otherwise be required to eliminate the ghost image.
Optionally, the field lens is configured to project the first and second virtual images at the first and second projection distances such that the offset between the first and second virtual image is below a threshold angular resolution.
Optionally, the threshold angular resolution is equal to the dimensions of a pixel.
Optionally, the threshold angular resolution is equal to the angular resolution of the human eye. By reducing the offset below the limits of the display and/or the human eye's ability to resolve, the ghost image is effectively eliminated.
Optionally, the anisotropic optical component is provided by one of a free form mirror, free form lens, cylindrical mirror or a cylindrical lens.
Optionally, the field lens is provided by one of a concave mirror, a free-form surface, a Fresnel lens, a waveguide, a diffractive optical element, a holographic optical element or one or more tapered optical fibers. Tapered optical fibers in particular allow for lensless magnification of the projected image fiberspace, thereby shortening the optical path of the light and allowing the overall spatial footprint of the system to be reduced.
Optionally, the picture generation unit comprises a light source and a spatial light modulator.
Optionally, the picture generation unit comprises a projector and a diffuser for realising a projected image.
Optionally, the picture generation unit comprises a laser and a 2D scanning mirror.
Optionally, the picture generation unit comprises a holographic unit to produce computer generated holograms and a diffuser for realising the holograms.
Optionally, the picture generation unit comprises one or more of a LCD device, a LED device, a micro LED device, a OLED device or a digital light processing digital micromirror device.
Such devices are capable of being activated by the application of current, which can be localised and modulated as desired. They can further provide a flexible, multi-colour display.
Optionally, the system further comprises intervening optics between any of the picture generation unit, the field lens, the display screen and/or the anisotropic optical component.
Such intervening optics allow the path of the light to be arranged around the physical confines of the installation environment, as well as compensating for any optical effects of the windscreen itself.
Optionally, the intervening optics comprise one of a fold mirror, waveguide, diffractive optical element or holographic optical element.
Optionally, the system further comprises an image processor in communication with the picture generation unit, wherein the image processor is configured to account for distortions caused by the optical set up such that the images appears undistorted on the display screen. This obviates the need for any post-image generation corrections as well as bulky correction optics. Furthermore, it provides a higher degree of flexibility which can adapt to different display surfaces and optical setups.
Optionally, the display screen of the head-up display is a windscreen of a vehicle.
Optionally, one or more of the field lens, projection unit, anisotropic optical component and/or intervening optical components (if present) are moveable relative to one another.
Optionally, the image comprises a first region and a second region, wherein the system is arranged such that the first and second region are projected through the field lens whilst only the second region is projected through the anisotropic optical component. The projection of an image at multiple distances through the HUD system can produce a convincing representation of a real object.
According to a second aspect of the invention there is provided a method for providing a ghost image free head-up display, the method comprising generating an image at a picture generation unit, said image to be rendered on a display screen for reflection towards a predetermined eye box, the display screen having a front surface and a back surface, providing a field lens between the picture generation unit and the display screen, providing an anisotropic optical component between the picture generation unit and the display screen, the anisotropic optical component having a first optical power along a first axis and second optical power along a second axis, wherein the first and second axis are perpendicular, wherein a portion of the light incident on the front surface of the display screen is reflected forming a first virtual image, and a portion of the light is transmitted through the display screen and is incident on the back surface forming a second virtual image, wherein the first and second virtual images are offset along the first axis, configuring the field lens to project the first virtual image at a first projection distance and the second virtual image at a second projection distance such that the offset is below a threshold magnitude and the first and second virtual images are substantially overlaid as viewed from the eye box, and configuring the anisotropic optical component to magnify the first and second virtual image along the second axis only.
Other aspects of the invention will be apparent from the appended claim set.
One or more embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
In an aspect of the invention the apparatus and the display are installed in a vehicle, such as a motor vehicle. Whilst the following description is described with reference to a HUD of a motor vehicle utilising the windscreen as the display screen, the disclosure, and concepts described herein are applicable to other forms of HUD (for example those installed on other forms of vehicles, wearable platforms such as helmets or goggles or other known types of HUDs), as well as displays in general.
In particular, it is envisaged that the invention is installed for use in a confined environment such as a vehicle which can be operated on land (on/off road, or track), under or over sea, in air or space. The examples can be, but not limited to, cars, buses, lorries, excavators, exoskeleton suit for heavy-duty tasks, motorcycles, trains, theme park rides; submarines, ships, boats, yachts, jet-skies and other types of sea vehicles; planes, gliders and other types of air crafts, spaceships and shuttles for space crafts. Furthermore, the technology can be installed/integrated in a mobile platform such as a driver's/operator's head/eye protection apparatus such as a helmet or goggles. Therefore, any activity, which involves in wearing protective helmets/goggles, can utilise the invention described herein. These protective helmets/goggles can be worn, but not limited to, by motorcyclist/cyclist, skiers, astronauts, exoskeleton operators, military personnel, miners, scuba divers and construction workers. Moreover, it can be used in a standalone environment for game consoles, arcade machines and with a combination of an external 2D/3D display it can be used as a simulation platform. Also, it can be used in institutions and museums for educational and entertainment purposes.
The relationships are given by following equations:
where γ is the incident angle of the light beam out from the HUD system 10. In practical situations, the longitudinal displacement is usually much smaller compared with the projection distance, thus making it less discernible to the observer. On the other hand, the transverse displacement is the one discerned by the observer, which only exits along the vertical direction or y direction as illustrated in
The transverse displacement δy of the ghost image (and the visibility of the ghost image to the observer 200) can be minimised by reducing the divergence of the projection beam, or in other words, locating the primary and ghost images at a long projection distance such that the angular resolution of the vertical displacement between the ghost image and the primary image is lower than the angular resolution of human eye, where the observer will regard the two images as one.
The minimum angular resolution human eyes can discern is 0.0003. If we define the apparent distance between the image and the observer as dei, then the threshold distance at which the ghost image is not visible is given according to equation (3):
For an given setup having incident angle to the transparent reflector of 30°, a refractive index of 1.5, and a windscreen thickness of 8 mm, the displacement of the ghost image and the primary image can be calculated to be 4.90 mm according to equation (2). Equation (3) then provides a threshold projection distance of 16.33 m. This can also be understood from the prospective of beam divergence, wherein the divergence along the primary direction is almost parallel such that the human eye will regard the ghost image and the primary image as one.
Whilst the ghost image is effectively removed using this approach, the long projection distances involved require an optical system with large a magnification power, which can be difficult to accommodate into design constraints and furthermore negatively affect the quality of the observed final image. Certain HUD systems (such as those in the automotive sector) also fundamentally require images to be projected to much shorter distances (typically around 2 m so as to appear just over the bonnet of the vehicle). It is therefore of practical value to design a system where ghost image free projection can be achieved for over a wider range of projection distances suitable for wider range of applications.
This is achieved via the use of anisotropic optics to separate the image formation along different directions, so that along the primary direction (with impact on ghost image) the image is formed at a projection distance equal to or larger than the threshold distance; while along the secondary direction (which does not impact on the ghost image), the image is formed at any particular target distance. Here “anisotropic optics” means any optical component whose optical power is directionally dependent, such as a cylindrical lens, a cylindrical mirror, or an anisotropic free form mirror or lens. For example, a cylindrical mirror has a finite optical power along one direction and no optical power along the perpendicular direction, while an anisotropic free form mirror has one optical power along one direction and another different optical power along the perpendicular direction.
This principle of anisotropic power is illustrated in
This analysis can be extended from a point source to a one dimensional line object and two dimensional object.
From the analysis of the imaging property of cylindrical lens, it can be concluded that the cylindrical mirror has different imaging properties along the y axis (the axis of infinite curvature) and along the x axis (the axis of finite curvature) and z axis (the light propagation direction). For the y axis, it follows the rule of mirror reflection and for x and z axis, it follows the rule of imaging of the curved surface (for example, parabolic mirror imaging in the case discussed above). It is this anisotropic imaging property that is desirable, and whilst discussed in relation to a cylindrical mirror, the skilled person would appreciate that any other suitably anisotropic optical component could be used, such as a cylindrical lens or free form lens.
The HUD system 10 is made up of a PGU 100 and a diffuser 110 (not shown), a cylindrical lens 130, a field lens 120, fold mirror 111 and a conventional windscreen 1. The PGU 100 is provided by a projector, though the skilled person would appreciate that any suitable light source and imaging means may be used provided they were capable of operating in the manner described below. Accordingly, in an embodiment the PGU 100 is formed of a laser and 2D scanning mirror, or a holographic unit which produces computer generated holograms for forming on the diffuser 110. In an alternative embodiment, the PGU 100 is a light field unit to produce 3-dimentional light field images for forming on the diffuser 110. A Digital Micromirror Device (DMD), Liquid crystal display (LCD) device, liquid crystal on silicon (LCoS) display, laser projector, light-emitting diode (LED) display, organic light-emitting diode (OLED) display, quantum-dot light-emitting diode (QLED) display and micro-light-emitting diode (μLED) display may also be used in or as the PGU 100. The skilled person would understand that in the DMD, LCoS and LCD embodiments the PGU 100 would further comprise an initial light source. In contrast, a PGU 100 comprising LEDs would not require any further light emitting components. Furthermore, in the DMD, LCoS, LCD or LED, OLED, QLED, μLED embodiments no external image realisation surface is required such that the diffuser 110 is not present.
Whilst the illustrated setup employs a windscreen 1 as a transparent reflector, the skilled person would be aware that any suitable transparent screen of finite thickness could be used, such as the visor of a pair of augmented reality goggles, or the reflector screen of a transparent reflector-type HUD.
In an embodiment, the PGU 100 is able to account for any distortion resulting from the transmission of light through components used to manipulate the optical path, such that the final images visible to the user are correctly displayed. In an embodiment, this is achieved by a software-based distortion correction module in (or otherwise in communication with) the PGU 100 that applies a pre-compensating inverse distortion to the image in the digital domain before it is projected. In an embodiment, the distortion correction module calculates the expected distortion from the optical components of the projecting optics and the display and determines the inverse distortion that must be applied such that the final image visible to a user are undistorted. This allows for the PGUs to account for asymmetries in the optical path of each image. Such pre-compensating distortions can be determined by software in a known manner. This obviates the need for any post-image generation corrections as well as bulky correction optics. Furthermore, it provides a higher degree of flexibility which can adapt to different display surfaces and optical setups.
In use, the PGU 100 projects light on to the diffuser 110 to form an image. This image is then projected through the cylindrical lens 130 and the field lens 120 and reflected by mirror 111 so as to converge the projected image onto the windscreen 1 where it is reflected towards the observer 200. The skilled person would appreciate that any suitable focussing and magnifying optics may be used, providing they meet the requirements set out below. In an embodiment, the field lens 120 is provided by a Fresnel lens. In a further embodiment, the field lens 120 is configured so as to alter the divergent beam from the PGU 100 to a near parallel beam. Whilst the illustrated embodiment uses a cylindrical lens 130 as the anisotropic optical component, the skilled person would appreciate that any suitable optical component could be used providing it demonstrated different optical/magnification powers along the primary and secondary directions. Other suitable optical components include a cylindrical mirror, a free form mirror or a free form lens. The skilled person would further appreciate that the exact order of the cylindrical lens 130 and field lens 120 depends upon their properties (i.e concave or convex) such that their relative position in the HUD system 10 is not fixed, provided they are positioned so as to intercept light emitted by the PGU 100.
Whilst the illustrated system includes a single isotropic lens (to project the image beyond the threshold distance defined by equation (3)) and a single anisotropic lens (to change the projection distance in the secondary direction perpendicular to the direction in the transverse plane where ghost image is displaced from the primary image), the skilled person would appreciate that more than one of each type of lens could be employed. In an embodiment, further optical components are included to compensate for optical aberrations, distortions or achromatic dispersion, thus improving image quality.
The path of the light from the PGU 100 transmitted through the cylindrical lens 130 and the field lens 120 and onto the windscreen 1 via mirror 111 is referred to as the optical path. The skilled person would understand that any number of intervening reflectors/lens or other optical components may be placed along the optical path between the PGU 100 and the field lens 120, or between the field lens 120 and the windscreen 1 in order to manipulate the optical path as necessary (for example, to minimize the overall size of the HUD system 10).
An aspect of the present invention is that it allows for a flexible, configurable system, which will result in the reduction of ghost images in a manner which is not installation specific. As described, by requiring the angular separation between the primary and ghost image is less than the angular resolution of the human eye, and implementing the HUD system accordingly, variations in user height, display angle, size, etc., can be accounted for.
For a standardised automotive application, a suitable overall target projection distance is 2.2 meters, resulting in an observed image just over the front side of the automotive bonnet. A typical windscreen is slanted at an angle of 30° and has a thickness of 6 mm and a refractive index of 1.5. The distance between the driver and the windscreen is 700 mm. The distance between the windscreen and the exit pupil of the HUD is set to 500 mm, the eye box size to 130 mm×50 mm, and the field of view to 7°×4°.
According to equation (2), the resulting transverse displacement is 4.24 mm, which requires a projection distance of approximately 14 m in order to remove the ghost image. Adopting setup of
with the negative sign of di accounting for the image being a virtual image. This gives a value of do of 293.13 mm. In order to project the image at the desired distance of 2.2 m away from the observer, the second image distance to the exit pupil should be 1 m, which is achieved by using an anisotropy optical component (i.e. the cylindrical lens 130 in this embodiment).
As shown in
In order to project the image at a projection distance of 14 m, the generated object should be positioned 293 mm away from the field lens 130 having a 300 mm focal length. The cylindrical lens 130 is introduced to image the first virtual image 301 to the second virtual image 302 along x direction as shown in
In conclusion, a GIF HUD system has been designed following the principle of this invention, which meets the standard specifications of 2.2 meters projection distance and H7°×V4° FOV.
It is a popular trend in automotive HUD systems that the display includes a compound image formed of multiple layers or portions each having different projection distances, where a first layer of an image is projected to a short distance for viewing comfort in an urban driving area and a second image layer is projected to a longer distance for viewing comfort in rural driving area. The same principle can also be used to approximate 3D images on the HUD.
The system parameters are identical to those described above in relation to either of
Simulation results are shown in
Accordingly, there is provided a HUD system 10 in accordance with an aspect of the invention.
Number | Date | Country | Kind |
---|---|---|---|
2016870.4 | Oct 2020 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/GB2021/052721 | 10/21/2021 | WO |