The invention relates to a holographic direct view display which is usable in particular in a vehicle such as a motor vehicle or any other land craft, aircraft or watercraft. The invention is also directed to an associated operating method, an appropriately configured control unit, and a vehicle equipped therewith.
The use of energy-efficient displays is becoming ever more important as vehicles become increasingly electrified. Moreover, the demand for innovative concepts providing experiences is becoming ever greater as the digitization of our world progresses. Among these priorities, there is strong interest in highly efficient holographic displays in which spatial phase modulation by way of electrically controllable pixels is used for holographic reconstruction of a desired display image. In particular, three-dimensional display images can also be created in addition to two-dimensional ones, without the use of additional techniques such as autostereoscopy or 3-D glasses.
However, a practical realization of a holographic direct view display (also referred to as “holo display” in the prior art) is associated with numerous technical difficulties. For example, for pixel dimensions that are realizable from a technical point of view, both currently and in the foreseeable future, a best case observation angle of only a few degrees is so small that the light source would have to be practically directly in front of the eyes of a user in the case of a holo display based on reflection. This represents a major disadvantage, especially for use in a vehicle. Transmissive displays include, inter alia, high intensity losses among the known disadvantages.
The problem addressed by the present invention is that of specifying alternative and/or improved display technology, which is suitable in particular for use in a vehicle and enables improvement over known display concepts, for example in view of the energy efficiency, ergonomics, the representability of 3-D content, the contrast, the visibility, the image quality and/or other aspects.
This problem is solved by a holographic direct view display and by an associated operating method, an appropriately configured control unit and a vehicle equipped therewith according to the claimed invention. All additional features and effects specified in the claims and the following description for the holographic direct view display also apply in relation to the operating method, the control unit and the vehicle, and vice versa.
A first aspect provides a holographic direct view display (also referred to as “holo display” herein for short) which may be designed in particular for use in a vehicle. For example, the vehicle can be a motor vehicle, but also any other land craft, aircraft or watercraft.
The holo display presented herein comprises a display light source embodied to create at least partly coherent display light and a two-dimensional micromirror array arranged opposite therefrom, from where the display light is reflected directly to the eyes of a user (for example a driver or any other occupant of the vehicle). In this case, each micromirror is embodied as a display pixel that is electrically controllable independently of the other micromirrors by virtue of being translationally displaceable in a direction transverse to its mirror surface in order to impress a respective required phase shift for holographic reconstruction of a desired (two- or three-dimensional) display image on the display light reflected thereon. Moreover, each micromirror is rotatable at least about a first axis of rotation (and optionally additionally about a crossed second axis of rotation) in order to reflect the display light to a respective current eye position of the user, wherein the entire display light beam is in each case provided for a respective eye of the user in alternation by the micromirror array during the operation of the holo display.
In order to not impede the forward view of the user, i.e. on the holo display and in particular through the windshield of the vehicle as well, and also to not restrict the user in their freedom of movement, the display light source in this case is arranged outside of a user display viewing angle that fills out a spatial region between a predetermined eyebox of the holo display for the user's eyes and the micromirror array. As is conventional, an eyebox refers to a two-dimensional or three-dimensional spatial region determined for the eyes of the user and from where the display image is visible without restrictions for the user.
One idea of the presently presented holo display thus consists in the micromirror array thereof being embodied and used not only for the image creation but also for the deflection of the display light from the display light source such that said display light is incident on the eyes of the observer (i.e. user) even if the light source is positioned not directly in front of their pupil but outside of their viewing angle (for example to the side of or above their head). Disadvantages of the prior art mentioned at the outset can thus be overcome by way of the image-creating translational displacement of the individual micromirrors in combination with the rotation thereof for deflecting light to the respective eye position, for example on the basis of a suitable eye-tracking signal.
The structure presented herein of the holographic direct view display makes it possible to render the entire light intensity created by the display light source visible to the user as a display image, virtually without losses, since light deflection by way of angles of rotation of individual micromirrors is extremely efficient. At the same time, the structure has absolutely no impact on user comfort, is ergonomic and allows the creation of three-dimensional display images (i.e. three-dimensional display objects) without additional technologies such as 3-D glasses or autostereoscopy etc., and so the proposed holo display is highly suitable in this regard too for use in a vehicle.
The direction of the translational displacement of a micromirror, transverse to the mirror surface, can be constant over time and/or the same for all micromirrors of the micromirror array in a simple case. However, it may also vary from micromirror to micromirror, for example in each case in a manner dependent on its rotational position, for example by virtue of it corresponding to the direction of its respective surface normal.
For example, the display light source can be embodied as one (or more) laser light source(s) for creating display light at one (or more) predetermined wavelength(s).
In particular, any desired phase offset of between 0 and 2π radians can be creatable between the individual pixels/micromirrors by way of the aforementioned translational displacement. Depending on the rotational position of each individual micromirror and depending on how the transverse direction of its displacement is defined relative thereto, the displacement direction of the micromirror can generally deviate from the light propagation direction of the display light reflected therefrom. In this case, the component of the displacement contributing to the phase shift is obtained by an orthogonal projection on the associated light propagation direction in accordance with the angle of incidence and angle of reflection of the reflected display light.
In particular, each individual micromirror can be translationally displaceable within a displacement interval which, in orthogonal projection on the associated light propagation direction of the display light reflected thereon, corresponds to half a predetermined wavelength (or optionally half of the largest of a plurality of predetermined wavelengths) of the display light. This allows the displaceability of the micromirrors to be restricted to a minimum required to create any desired phase offset between the individual pixels.
Further, the holo display can comprise in particular an eye-tracking device embodied to ascertain a current position of each eye of the user. For example, it may comprise one or more cameras to this end, which can be integrated or able to be assembled in or on the micromirror array or to the side thereof. In this case, each micromirror is controllable for the rotation at least about its first axis of rotation, in such a way that the display light created by the display light source is reflected by the micromirror array to the respective currently ascertained position of the relevant eye of the user. An eye-tracking device for the user usable to this end can alternatively also be provided independently of the holo display, i.e. in any case, for example like onboard a vehicle as a constituent part of a driver-monitoring system, etc.
In particular, each micromirror of the micromirror array can be embodied to optically image the display light source into the respective eye of the user. To this end, it can be embodied as a suitable concave mirror or else as a so-called Fresnel mirror with the optical function of a concave mirror. In a manner similar to the functional principle of a Fresnel lens, a Fresnel mirror can obtain largely the same functionality as a conventional concave mirror while having a substantially flatter construction.
As mentioned, the aforementioned rotatability of each micromirror of the micromirror array may comprise rotatability about two crossed (i.e. intersecting, for example perpendicularly arranged) axes of rotation: the aforementioned first axis of rotation and additionally, crossed therewith, a second axis of rotation of the respective micromirror. By rotating the micromirrors about two independent axes of rotation in each case, the micromirror array can be precisely adapted to corresponding multidimensional movements of the user's eyes.
According to an embodiment, the holo display also comprises a calibration device embodied and configured to monitor, and where required correct or calibrate, the functionality of the micromirror array with regard to proper reflection/imaging of the display light source to the respective eye of the user. To this end, the calibration device comprises an infrared light source arranged next to or integrated in the display light source such that it emits an infrared light beam substantially of the same shape and in the same direction as the display light beam created by the display light source. The calibration device further comprises a calibration computing unit embodied and configured to receive, for example from a suitable infrared camera, infrared recordings of a spatial region with the predetermined eyebox for the user's eyes, detect therein an image of the infrared light beam on a face of the user, determine deviations from a predetermined imaging quality and, in the case of determined deviations, control the micromirrors to perform such a rotation and/or translational displacement that these deviations are reduced and ideally eliminated.
A further aspect provides a method for operating a holographic direct view display as presented herein. The method comprises the creation of the at least partly coherent display light by the display light source and the control of the micromirrors of the micromirror array to perform such a rotation about their first and/or optionally second axis of rotation that the display light created by the display light source is reflected to a respective eye of the user in alternation by the micromirror array. In the process, each micromirror is controlled to perform such a translational displacement in a direction transverse to its mirror surface that a phase shift required for the holographic reconstruction of a current two- or three-dimensional display image is impressed on the display light reflected therefrom. For example, the translational displacement of all micromirrors can be performed at predetermined time intervals for the purpose of creating a respective new display interval, with these time intervals not being resolvable by the human eye, wherein all micromirrors can be rotated therebetween for the purpose of changing the light steering direction to the respective other eye of the user.
In a specific configuration of the method, in addition to the rotation of each micromirror its translational displacement in the aforementioned transverse direction can additionally also be used to steer the display light created by the display light source from the micromirror array to the respective eye of the user. To this end, an additional phase shift contributing to the required light deflection to the respective eye of the user can be impressed on the display light reflected by said micromirror array, in addition to the aforementioned phase shift required for the holographic reconstruction of the respective display image. For example, this can be used for fine setting or readjustment of the light steering function of the micromirror array, especially during the calibration as described above and below.
According to an embodiment, a calibration of the reflection of the display light, created by the display light source, to the respective eye of the user brought about by the micromirror array is also carried out. To this end, use can be made in particular of the calibration device as specified above and in the claims. The calibration comprises the following steps:
A control unit embodied and configured to automatically perform the operating method, as presented herein, for the holo display is provided according to a further aspect. To this end, an appropriate computer program, for example, can be executed in the control unit.
A vehicle, in particular a motor vehicle or any other land craft, aircraft or watercraft, is provided according to a further aspect. Terms relating to spatial orientation, such as “top”, “bottom”, “on”, “under”, “laterally”, “front”, “horizontal”, “vertical”, etc., as used herein, relate to the usual vehicle-fixed Cartesian coordinate system containing mutually perpendicular longitudinal, transverse and height axes of the vehicle.
The vehicle comprises a passenger compartment upwardly delimited by a roof liner at least in part; a vehicle seat arranged in the passenger compartment and having a headrest; and a holographic direct view display of the type presented herein, designed for use by a user on the aforementioned vehicle seat. In particular, the aforementioned control unit may also be provided in the vehicle. In this case, the display light source is arranged outside of a user display viewing angle that fills out a spatial region between a predetermined eyebox for the user's eyes in the passenger compartment and the micromirror array. In particular, to this end, the display light source can be arranged on or in the roof liner or at, in or on the headrest of the vehicle seat.
The aforementioned aspects of the invention and their embodiments and specific configurations are explained in more detail below on the basis of examples depicted in the attached drawings. The drawings are highly simplified schematic illustrations of the basic optical construction principle, i.e. should in particular not be construed as true to scale.
All of the various embodiments, variants and specific design features of the holographic direct view display, its operating method, the control unit and the vehicle according to the aforementioned aspects of the invention, as mentioned above in the description and in the appended claims, may be implemented in the examples shown in
The passenger compartment 5 of the vehicle 1 contains a vehicle seat (not depicted separately) having a headrest 6 for a vehicle occupant, for example the driver, who in this example is the user of the holo display 2 and is indicated in
The two-dimensional micromirror array 8 comprises a plurality of micromirrors 9—five are shown purely symbolically—which are electrically controllable independently of one another and which are shown separately in
In this example, the display light source 7 is embodied as a laser light source for creating at least partly coherent display light L at a predetermined wavelength A. In order to keep the required deflection by the micromirrors 9 as small as possible, it is advantageous to position the display light source 7 in the vicinity of the eyes A of the user but outside of a user display viewing angle which fills out a spatial region between their eyes A and the micromirror array 8. As shown in
In this example, the holo display 2 also includes an eye-tracking device 10 that is embodied to ascertain a current position of each eye AL and AR of the user. For example, it may comprise one or more cameras to this end, these cameras being able to be integrated or assembled in or on the micromirror array 8 or to the side thereof or at any other suitable position in the vehicle 1. In this case, each micromirror 9 is controllable for rotation at least about its first axis of rotation D such that the display light L created by the display light source 7 is reflected by the micromirror array 8 to the respective currently ascertained position of the relevant eye AL/AR of the user. An eye-tracking device 10 that is usable to this end can be provided as a constituent part of the holo display 2, or might be provided in any case onboard the vehicle 1, for example as a constituent part of a driver-monitoring system.
Below, an exemplary embodiment of an operating method for a holo display 2 according to the aspects of the invention described above and in the claims is described with reference to
During the operation of the holo display 2, at least partly coherent display light L is created by the display light source 7. The micromirrors 9 of the micromirror array 8 are controlled to perform, at least about their first axis of rotation D, such a rotation that the display light L created by the display light source 7 is reflected by the micromirror array 8 to a respective eye AL and AR of the user in alternation. In this case,
As indicated by double-headed arrows in
Thus
This basic functionality is illustrated in
As a result of the majority of light steering being implemented by way of the mirror rotation in this example (as illustrated in
By contrast, pixel dimensions of the order of approximately 2.5 μm would be required if the intention were to create all of the light steering by way of the holographic function. A holo display with typical dimensions of 200×100 mm would require the number of pixels to total approximately 3.2 Gpixel as a result, which is thus far beyond all current manufacturing limits and all manufacturing limits achievable in the medium term.
The disadvantage mentioned at the outset of a very small observation angle for conventional holographic direct view displays is thus rectified in the structure presented here by way of the additional function of light deflection by way of the rotatable micromirrors 9 in combination with the eye-tracking signal from a suitable eye-tracking device 10. In other words, the micromirror array 8 is used not only for the image creation but also in order to deflect the display light L from the display light source 7 in such a way that it is incident on the eyes AL and, respectively, AR of the observer even if the display light source 7 is not positioned directly in front of the pupil of the respective eye AL/AR.
Using the construction concepts presented herein for a holo display 2, use thereof in vehicles is also realizable and, in the process, opens up new dimensions in view of the energy efficiency and display possibilities.
Number | Date | Country | Kind |
---|---|---|---|
10 2022 113 344.3 | May 2022 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2023/054927 | 2/28/2023 | WO |