The present invention concerns a near-eye image projection system having small form factor. The present invention further concerns a wearable device comprising said near-eye image projection system, such as augmented/mixed reality or smart glasses. More particularly the present invention concerns a near-eye light-field projection system. The near-eye light-field projection system can have foveation capability.
Light-field image projection by means of sequential spatial light modulation of structured incident light by a spatial light modulator (SLM) typically requires that the source light from a light source is shaped by several optical elements that are separated by sufficient volume of a transparent medium in order to achieve the required characteristics of the structured incident light and, therefore, of the projected light-field image. Such arrangement results in a bulkier device that is not suitable for use in applications where small form-factor is required, such as in wearable devices, e.g. smart glasses. Shrinking the optics by using higher power optical elements, such as lenses with shorter focal length, freeform optics, etc. still requires substantial volume for light propagation, or is penalized by the lower quality of the illumination light structure and, consequently, of the projected image, and higher compensation requirements due to optical artifacts such as distortions, aberrations, diffractions, etc.
Document EP3542206A1 discloses a method of light-field projection by sequential spatial light-modulation of structure light. Document WO2020157562A1 discloses several methods of combination of light-field projection system with different types of combiners and document US20190285897A1 discloses an apparatus using image pupil expansion with a waveguide in combination with a reflective combiner.
The present disclosure concerns a near-eye image projection system, comprising a pin-light source generating a plurality of incident light beams; a SLM configured to modulate said plurality of incident light beams and generate a plurality of modulated light beams such as to form pin-light images at a first plane; illumination optics and imaging optics configured to deliver the incident light beams from the pin-light source to the SLM. The imaging optics is further configured to deliver sequentially the modulated light beams from the SLM along a projection axis to an eye-box in a second plane substantially parallel to the first plane. The illumination optics is in a third plane and the projection axis is in a fourth plane; the third and fourth planes are substantially perpendicular to the first plane. The illumination optics defines a first optical path followed by the incident light beams in a direction from the first plane to the second plane, and a second optical path followed by the incident light beams in a direction from the third plane to the fourth plane. The imaging optics defines a third optical path followed by the modulated light beams in a direction from the second plane to the first plane, and a fourth optical path followed by the modulated light beams in a direction from the first plane o the second plane. The imaging optics further comprises an optical combiner to project image light beams from the modulated light beams and to transmit natural light from the real world towards the eye-box, wherein the modulated light beams comprise foveal modulated light beams forming foveal pin-light images at the first plane and peripheral modulated light beams forming peripheral pin-light images at the first plane, and wherein the optical combiner comprises a foveal combiner configured to reflect the foveal modulated light beams and project foveal image light beams towards a foveal eye-box.
The near-eye image projection system disclosed herein has a small form factor and is well adapted for wearable applications such as for augmented/mixed reality or smart glasses.
Exemplar embodiments of the invention are disclosed in the description and illustrated by the drawings in which:
Referring to
A possible configuration of the illumination optics is shown in
In one aspect, the illumination optics comprises a collimating optical element 50 configured to collimate the incident light beams 100a, to a narrow beam. The collimating optical element 50 can comprise any one or a plurality of a lens, a mirror, a hologram or any other optical element performing the collimation.
In one aspect, the illumination optics further comprises an illumination deflecting element 61 configured to redirect the incident pin-lights 100a, 100b along the first optical path 171. The illumination deflecting element 61 can comprise any one or a plurality of a prism, a grating, a hologram or any other optical element performing the redirecting.
In one aspect, the illumination optics comprises an illumination pupil expansion device 36a configured to expand the incident light beams 100a, 100b from an entrance of the illumination pupil expansion device 36a to an exit pupil. The illumination pupil expansion device 36a enables an increased field of view (FOV) of a projected image.
In one aspect, the illumination pupil expansion device comprises a light-guide or illumination waveguide 36a including an illumination in-coupling element 35a configured to input the incident pin-lights 100a, 100b. The illumination waveguide 36a can further include an illumination out-coupling element 37a configured to output the incident pin-lights 100a, 100b along the second optical path 172.
The collimated incident light beams 100a, 100b are injected into the illumination waveguide 36a by means of interaction with the illumination in-coupling element 35a. The latter can comprise diffraction gratings, holograms, inclined mirrors or prisms, stack of semi-reflective interfaces, or any other suitable optical element. The incident light beams 100a, 100b propagates due to internal reflection while they expand in the plane of the illumination waveguide 36a by means of interaction with 1D or 2D fold gratings or by any other optical element expanding the incident light beams 100a, 100b. The illumination out-coupling element 37a can comprise a diffraction grating, a hologram, an inclined mirror or prism array, stack of semi-reflective interfaces, or any other optical element configured to output the incident pin-lights 100a, 100b along the second optical path 172. The illumination out-coupling element 37a can be configured such that the incident light beams 100a, 100b exit the illumination waveguide 36a multiplicated with homogeneously distributed intensity and collimated in the orientation given by the tilt angle of the injected incident light beams 100a, 100b, the orientation being the second optical path 172.
The expanded collimated beams sequentially illuminate the reflective or transmissive SLM 20. In the case of transmissive SLM, the incident light components become modulated and propagate to projection optics.
Again referring to
In an embodiment, the imaging optics comprises an illumination and projection optical element 70. The latter can comprise a prism 70 including a first and second beam shaping outer surfaces 52, 53. In the case of a reflective SLM 20, such as shown in
In one aspect, the prism 70 can include a beam splitter 140 configured to be traversed by the incident light beams 100a, 100b along the second optical path 172 before the incident pin-lights 100a, 100b reach the SLM 20.
The (reflective) SLM 20 modulates the incident light beams 100a or 100b and reflects the modulated light beams 110a, 110b (image components) along the second optical path 172 back to the prism 70 through the second beam shaping surface 53. The SLM 20 is further configured to reflect the modulated light beams 110a, 110b with in-plane polarization (s-polarization) or higher-than-total internal reflection angle (in case the SLM 20 comprises a digital micromirror device), which is obtained during the modulation at the SLM 20.
The beam splitter 140 can be further configured to reflect the modulated light beams 110a, 110b generated by the SLM 20 along the third optical path 173. The prism 70 further includes a third and fourth beam shaping outer surfaces 54, 58. The modulated light beams 110a, 110b reflected by the beam splitter 140 is reflected by the third beam shaping outer surface 54 along the fourth optical path 174.
The third beam shaping outer surface 54 can be configured such that the polarization of the modulated light beams 110a, 110b is reversed relative to the in-plane polarization provided by the SLM 20.
In one aspect, the third beam shaping outer surface 54 can comprise a quarter-wave plate 56 configured such that the modulated light beams 110a, 110b along the third optical path 173 becomes p-polarized.
The modulated light beams 110a, 110b reflected by the third beam shaping outer surface 54 passes through the fourth beam shaping outer surfaces 58. The fourth beam shaping outer surface 58 can be configured to collimate the SLM pixel beams that compose the modulated light beams 110a, 110b.
In an embodiment, the imaging optics comprises an optical combiner 40 configured to receive the modulated light beams 110a, 110b and project image light beams 112a, 112b along the projection axis 170a, 170b to the eye-box 121a, 121b. The optical combiner 40 is further configured to transmit natural light from the real world 190 towards the eye-box 121a, 121b.
The near-eye image projection system 200 is destined to be worn by a viewer for virtual and mixed reality applications. The image projection system can be configured such that, when it is worn by the viewer, the eye-box 121a, 121b and an exit pupil (or view point) 120 is within the viewer's eye 90. The image light beams 112a, 112b are projected towards a pupil 130 of the viewer's eye 90, such that the image light beams 112a, 112b are projected on the retina 92.
The modulated light beams can comprise foveal modulated light beams 110a forming foveal pin-light images 31 at the first plane 30 and peripheral modulated light beams 110b forming peripheral pin-light images 39 at the first plane 30.
In one aspect, the imaging optics further comprises a Fourier filter 34 in the first plane 30. The Fourier filter 34 can comprise imaging deflecting elements 60a (see
In particular,
A plurality of pin-lights 10a of the pin-light source 10 can generate a plurality of incident foveal light beams 100a and the illumination optics and imaging optics project a plurality of foveal modulated light beams 110a and foveal image light beams 112a towards a foveal eye-box 121a.
The imaging optics can further comprise an imaging mirror 32 configured to reflect the foveal modulated light beams 110a reflected by the imaging deflecting elements 60a to the foveal combiner 41. The imaging mirror 32 can be placed in the vicinity of the SLM 20 such the foveal modulated light beams 110a are reflected by the imaging deflecting elements 60a towards the SLM 20 and reflected back by the imaging mirror 32 towards the foveal combiner 41. The imaging deflecting elements 60a can comprise inclined mirrors or prisms. The imaging mirror 32 produces foveal modulator images 114a in a modulator image plane 115 between the imaging mirror 32 and the foveal combiner 41. Since each of the imaging deflecting elements 60a can be oriented at different angles (for example, the mirrors or prisms can be inclined at different angles), the foveal modulator images 114a can create an array wherein at least some of the foveal modulator images 114a are spatially displaced in the modulator image plane 115 relative to other foveal modulator images 114a. In this case the foveal combiner 41 would cause that the image array is seen by a viewer from the eye box 121a.
In an embodiment, the imaging mirror 32 can be movable such as to deflect the foveal modulated light beams 110a reflected by the imaging mirror 32 from the projection axis 170a, 170b.
In one aspect, the near-eye image projection system 200 can comprise an eye-tracking and steering device (not shown) providing eye-tracking information. The imaging mirror 32 can then be moved (rotated) in accordance with eye-tracking information.
In one aspect, the Fourier filter 34 is further configured to let the peripheral modulated light beams 110b pass through the Fourier filter 34 and reach an image injection optics 150 configured to expand the peripheral modulated light beams 110b from a first angle α to a second angle β larger than the first angle α.
The Fourier filter 34 can thus be configured to split the optical path of the foveal modulated light beams 110a and the peripheral modulated light beams 110b.
The inputted peripheral modulated light beam 110b enters the peripheral image injection optics 150 with the first angle α through an opening 341 in the Fourier filter 34. The opening 341 coincides with the peripheral pin-light image 39 of the peripheral modulated light beam 110b.
The peripheral modulated light beam 110b is inputted in the peripheral image injection optics 150 with a beam angle α through the opening 341. The peripheral modulated light beam 110b propagates within the peripheral image injection optics 150 due to internal reflection on the reflective surfaces 152, 153 and 154 while it expands to the second angle β, towards an imaging in-coupling element 35. The peripheral image injection optics 150 creates a peripheral modulator image 114b of the SLM 20. In this configuration, a peripheral modulated light beam 110b from each pixel of the image 114b is collimated by the beam shaping reflective surface 154 and is injected by the imaging in-coupling element 35.
In the embodiments shown in
The imaging waveguide 36 can comprise an imaging out-coupling element 37 configured to allow the peripheral image light beams 112b to exit the imaging waveguide 36 and be projected along the projection axis 170b within the peripheral eye-box 121b. The peripheral eye-box 121b is typically larger than the foveal eye-box 121a due to pupil replication that is performed by the imaging waveguide 36.
In
The imaging out-coupling element 37 can comprise a volume hologram, diffraction grating mirror arrays or stack of prism (semi-transparent interfaces). The out-coupling element 37 and the waveguide 36 are used as the peripheral combiner and, thus, need to be partly transparent in augmented reality applications. They can be non-transparent for virtual reality applications and video pass-through augmented reality applications. The foveal combiner 41 can comprise a wide range of semi-transparent optical devices, such as volume holograms, Fresnel types of reflectors, or ellipsoid surface with semi-reflective inner surface.
The near-eye image projection system 200 allows for projecting the foveal modulated light beams 110a and the peripheral modulated light beams 110b, via the optical combiner 40, along the projection axis 170a, 170b to the eye-boxes 121a and 121b as foveal image light beams 112a and peripheral image light beams 112b, respectively.
Other configuration of the illumination optics can be contemplated. For example, in
The present disclosure further pertains to a wearable device comprising the image projection system 200.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2020/057836 | 8/20/2020 | WO |