This application claims the benefit of priority to European Patent Application Serial No. 23212582.3, filed on Nov. 28, 2023, which is incorporated herein by reference in its entirety.
The present invention relates to a light projector, in particular a light projector for augmented reality or virtual reality applications.
In an augmented reality headset, a transparent waveguide is provided in front of an eye or eyes. A light projector transmits light towards the waveguide. Light from the projector can be coupled into the waveguide by an input diffraction grating. Light then propagates within the waveguide by total internal reflection and an output diffraction grating couples light out of the waveguide and towards a viewer. In use, a viewer can see light from their external environment, transmitted through the transparent waveguide, as well as projected light from the projector. This can provide an augmented reality experience.
Some light projectors for augmented or virtual reality applications generate a main image that is intended to be displayed to the user, as well as a second image, or “ghost image”, which is not intended to be generated or seen by the user. In some light projectors, the second image can be coupled into the waveguide and shown to the user unintentionally, which can obscure and reduce the clarity of the main image.
An object of the present invention is to address this issue.
According to a first aspect of the invention there is provided a projector for an augmented reality or mixed reality headset, comprising: an emissive display defining an optical axis, configured to provide first supplied light; an exit pupil configured to couple the first supplied light into a waveguide for an augmented reality or mixed reality headset, the exit pupil comprising a first region; an optical arrangement configured to couple the first supplied light from the emissive display towards the exit pupil; and an absorptive structure at the emissive display arranged to absorb visible light reflected towards the emissive display from the exit pupil; wherein the emissive display is configured to provide the first supplied light to the optical arrangement off-centre with respect to the optical axis so that the first supplied light is coupled towards the first region of the exit pupil; wherein the first region is positioned off-centre from the optical axis in a first direction to enable a first partial reflection of the first supplied light at the exit pupil, to be coupled towards and absorbed by the absorptive structure.
In this way, the undesirable first partial reflection, which appears to the user as a second image (often referred to as a ghost image) if coupled into the waveguide, can be separated spatially from the first supplied light. The first partial reflection can then be prevented, at least partially, from being coupled into the waveguide by the absorptive structure. This improves the experience for a user by mitigating ghost effects. Advantageously, the absorptive structure is provided at the emissive display. This may be preferable than providing a structure to absorb the first partial reflection at the exit pupil in some scenarios as it enables a more compact arrangement for the light projector. Additionally, separating the first partial reflection from the first supplied light in this way can be implemented in known light projectors without changing the size or number of pixels of the display. This means the first partial reflection can be prevented from reaching the exit pupil in a way that is generally compatible with existing light projectors.
The emissive display can be of any kind, such as a plasma display panel (PDP), light emitting diode (LED), micro light emitting diode (uLED) display or an organic light emitting diode (OLED) display.
The absorptive structure can be positioned and oriented in any suitable manner that enables the first supplied light to reach the exit pupil while at least partially absorbing the first partial reflection. In one example, the absorptive structure can comprise features angled with respect to the optical axis to intercept the path of the first partial reflection at the emissive display.
Strictly speaking, the term “image” refers to light of a particular focus coupled into a waveguide that would be perceived as an image by the user during use, whereas “supplied light” refers to light supplied by the display, yet to form an image in the waveguide. For the sake of simplicity and conciseness, the term “supplied light”, which forms a (desirable) image as viewed by the user during use, may be used interchangeably with the term “image” throughout. For example, it may be pedagogically useful to refer to supplied light as an image before it is coupled into the waveguide and provided to the user as an image. Similarly, for brevity “reflected light”, which can appear as an (undesirable) image to the user if allowed to be coupled into the waveguide, may also be referred to throughout as an image. Specifically, the first supplied light and the first partial reflection may be referred to as first and second images, respectively. Second supplied light generated by the emissive display and a corresponding second partial reflection, as described further below, may similarly be referred to as a third and fourth image, respectively.
The emissive display preferably provides one or more light cones in the first supplied light. The one or more light cones can have a chief ray that is not parallel to the optical axis. In this way, the first supplied light can be directed towards the first region of the exit pupil. The first partial reflection of the first supplied light can therefore be directed back towards the absorptive structure where it can be absorbed.
The optical arrangement can comprise one or more optical components, such as lenses, mirrors, beam splitters, wave plates, or other components suitable for coupling light from the emissive display to the exit pupil. The optical arrangement may be configured to operate as, and may be described as, projection optics.
Preferably, the emissive display comprises a first portion configured to provide the first supplied light and a second portion configured to provide second supplied light to the optical arrangement off-centre with respect to the optical axis so that the second supplied light is coupled towards a second region of the exit pupil that is off-centre from the optical axis in a second direction so that the first and second regions are at least partially spatially separated from one another, to enable a second partial reflection of the second supplied light at the exit pupil, to be coupled towards and absorbed by the absorptive structure.
In this way, the emissive display can provide a wider field of view while inhibiting ghost images. The first portion and the second portion of the emissive display may correspond to approximately half of the emissive display on opposing sides of the optical axis. The absorptive structure may be oriented differently at each portion of the emissive display to account for the different angles of arrival of the first and second partial reflections.
The first region and the second region are preferably provided on respective sides of the optical axis (i.e. on opposite sides). The first region and the second region may be different parts of a continuous aperture. Alternatively, the first region and the second region of the exit pupil may be spatially separated to provide an exit pupil comprising two discrete apertures.
The emissive display preferably provides one or more light cones in the second supplied light. The one or more light cones can have a chief ray that is not parallel to the optical axis. In this way, the second supplied light can be directed towards the second region of the exit pupil. A partial reflection of the second supplied light can therefore be directed back towards the absorptive structure where it can be absorbed.
Preferably, the first portion and the second portion of the emissive display are configured to operate simultaneously to provide different parts of a field of view to the exit pupil at the same time. In this way, the full emissive display can be utilised to provide a larger field of view while still absorbing the first partial reflection and the second partial reflection to mitigate ghost effects. This is possible because the absorptive structure is provided at the emissive display and not the exit pupil, which allows both portions of the emissive display to provide light to the exit pupil without becoming absorbed by the absorptive structure.
Preferably, at the first portion of the emissive display, the absorptive structure comprises features oriented towards the first direction and, at the second portion of the emissive display, the absorptive structure comprises features oriented towards the second direction. This arrangement allows the absorptive structure to absorb partial reflections originating from the first and second regions of the exit pupil, which are offset from the optical axis in different directions. In other embodiments, it is envisaged the absorptive structure could be oriented in other ways while nevertheless absorbing the first and second partial reflections.
Preferably, the absorptive structure comprises a plurality of absorptive slats arranged between the emissive display and the optical arrangement. This provides an effective method of preventing the first partial reflection from reaching the exit pupil. Several absorptive slats may be provided for each pixel (or for each row and/or column of pixels) of the emissive display. The absorptive slats may be positioned directly over pixels of the emissive display and could be held in place by a frame, in one example.
Where the emissive display comprises a first portion and a second portion as described above, some or all absorptive slats at the first portion of the emissive display may be oriented towards a first side of the optical axis corresponding to the first direction to couple light from the first portion towards the first region of the exit pupil. Similarly, some or all absorptive slats of the second portion may be oriented towards an opposing second side of the optical axis corresponding to the second direction to couple light from the second portion towards the second region. This allows the absorptive slats to shape light from the emissive display towards the desired region of the exit pupil while also providing the function of absorbing the partial reflections.
Preferably, the absorptive slats are oriented at a plurality of angles relative to the emissive display in a fanned arrangement. In this way, the emissive display can emit light towards the optical arrangement at a larger cone angle to increase the field of view provided to the exit pupil. Several absorptive slats in a fanned arrangement may be provided for each row and/or column of pixels of the emissive display. The absorptive slats may be angled to point towards the centre of a respective row or column of pixels of the emissive display, which minimises the absorption of light travelling along paths leading to the first or second region of the exit pupil. The absorptive slats can be angled in other ways in other embodiments.
The absorptive slats in a given fanned arrangement may be arranged at a minimum angle to the optical axis on one side of the fanned arrangement and arranged at a maximum angle to the optical axis at an opposing side. The skilled person would appreciate the particular angles may be selected based on the numerical aperture of the light projector, which is dependent on the size of the exit pupil and the focal length of the projector.
Preferably, the plurality of absorptive slats comprises a first set of slats and a second set of slats that are arranged substantially perpendicularly to the first set of slats. In this way, the absorptive slats can prevent ghost images arising from light propagating along axes parallel to either dimension of the emissive display. The first set and the second set may be arranged similarly but rotated by 90 degrees with respect to one another in the plane of the emissive display.
Preferably, the first set of slats and the second set of slats intersect to form a plurality of truncated rectangular pyramids. Each truncated rectangular pyramid may correspond to a particular pixel to absorb light emitted by the pixel towards specific regions of an exit pupil that are offset from the optical axis.
Preferably, the plurality of absorptive slats are arranged to enable light from a central pixel of the emissive display to be re-coupled towards the exit pupil. In this way, the clarity of the first image as perceived by the user can be improved. This is achieved because providing an absorptive slat positioned directly over the central pixel, can create a dark line in the image presented to the user. Meanwhile, light from a small number of central pixels that is recoupled into the waveguide is typically not sufficiently bright to generate a perceptible ghost image. The central pixel, or pixels, may be substantially aligned with the optical axis.
Preferably, the emissive display comprises a plurality of pixels, and exposed external surfaces of the emissive display between respective pixels of the plurality of pixels are configured to absorb visible light to provide at least part of the absorptive structure. One source of ghost images can be specular reflection of reflected light (i.e., the first and second partial reflections) at the emissive display between pixels. Configuring exposed parts of the emissive display to absorb visible light in this way prevents such specular reflections to mitigate the presence of ghost images. The exposed external surfaces can be made from or coated with any suitable material that absorbs visible light. The exposed external surfaces may be configured to absorb all the colours of light produced by the emissive display.
In some embodiments, the projector further comprises a collimating tube for each of the plurality of pixels, and an exposed external surface of each of the collimating tubes is configured to absorb visible light to provide at least part of the absorptive structure. In this way, the collimating tubes can couple light from its respective pixel towards the first region or the second region of the exit pupil. The exposed external surfaces can be made of or, alternatively, coated with a material that absorbs visible light emitted by the emissive display to mitigate ghost images.
According to a further aspect of the present invention there is provided an augmented or virtual reality headset comprising the light projector of any of the embodiments described above.
Embodiments of the invention are now described, by way of example, with reference to the drawings, in which:
Strictly speaking, the term “image” refers to light of a particular focus coupled into a waveguide that would be perceived as an image by the user in use, whereas “supplied light” refers to light supplied by the display, yet to form an image in the waveguide. For the sake of simplicity and conciseness, the term “supplied light”, which forms a (desirable) image as viewed by the user during use, may be used interchangeably with the term “image” throughout. For example, it may be pedagogically useful to refer to supplied light as an image before it is coupled into the waveguide and provided to the user as an image.
The display 2, the optical arrangement 6, and the exit pupil 8 are arranged centred on an optical axis A. The optical axis A is aligned with the geometric centre of the part of the reflective display 2 that generates the first image 4. The optical axis A also runs through the centre of each component of the known light projector 1 that interacts with the light. If the display 2 is a reflective or transmissive display, this can include a light source and any illumination optics that might be necessary to couple light from the light source to the reflective or transmissive display. In this way, the light projector 1 has rotational symmetry about the optical axis A. Thus, the light in the known light projector 1 is generally completely centred on the optical axis A. The rotational symmetry of the optical axis A can be illustrated by two reference rays, equidistant from and parallel to the optical axis A, which would have paths through the known light projector 1 mirrored with respect to the optical axis A.
In the schematic example shown in
As described above, the first image 4 is coupled towards the exit pupil 8 and coupled into the waveguide (not shown). The first image 4 can partially reflect from the input diffractive optical element of the waveguide and this reflection can propagate back through the light projector 1 as a partial reflection of the first image 4. This partial reflection will form a second image 5 in the waveguide.
For brevity “partial reflections” of images formed from supplied light, which can appear as an (undesirable) image to the user if allowed to be coupled into the waveguide, may also be referred to throughout as a “ghost image”.
The second image 5 propagates in the direction shown by the arrow A2 in
The second image 5 is generally undesirable and can obscure the first image 4, which is the image intended to be shown to the user. The second image 5 is typically perceived by the user as a fainter copy of the first image 4 that is typically inverted relative the first image 4. Thus, the second image 5 is sometimes referred to as a “ghost image”. The second image 5 is continuously present in the overall image provided to the user in use, and it is challenging to mitigate or eliminate the presence of the second image 5. One concern of the present invention is to mitigate the presence of this ghost image from the overall image presented to the user.
The light projector 10 comprises an emissive display 20 and an absorptive structure 70 positioned over the emissive display 20. The emissive display comprises an array of pixels 22 mounted on a base 24. Only three pixels are shown in
Each pixel 22 can emit light of a single colour to provide a monochrome emissive display 20. Alternatively, each pixel 22 can comprise sub-pixels, each of which emits light in a different colour, to provide a full-colour emissive display 20.
Each absorptive slat 72 may be elongated to cover a full linear extent of the emissive display 20 along one dimension of the array of pixels 22. From the perspective of
The frame 74 can be any suitable structure for holding the slats over the emissive display 20, such as a rectangular frame attached to the ends of each of the absorptive slats 72 to avoid obstructing light from the emissive display 20.
In this example, the absorptive slats 72 are arranged in groups of two slats associated with a particular row (or column, as explained further below) of pixels. Each group has absorptive slats 72 that are angled to point at the centre of their associated row or column of pixels. Exemplary first, second and third groups 72a, 72b and 72c are shown in
The skilled person would appreciate the maximum angle of the absorptive slats 72 with respect to the optical axis 9 can be selected based on the numerical aperture of the projector, which is associated with the size of the exit pupil and the focal length of the projector. The spacing between slat groups, or between slats within a group, may also vary to accommodate the requirements of the projector and any optical arrangement therein.
The absorptive slats 72 are made from or coated with an absorptive material configured to absorb visible light emitted from the pixels 22 emitted in a leftwards direction from the perspective of
Exemplary light rays emitted by the emissive display 20 during use are shown propagating in the direction A1. The exemplary light rays form a first image 40 that is intended to be shown to a user once coupled into the waveguide; however, for brevity, these light rays will also be referred to as the first image 40. The first image 40 is provided in a plurality of cones of light, each cone having a chief ray that is not parallel to the optical axis 9. This is achieved by the absorptive structure 70, which absorbs light emanating from the emissive display 20 towards one side of the optical axis 9. Specifically, the absorptive structure absorbs light propagating towards the left side of the optical axis 9 from the perspective of
The first image 40 is emitted towards an optical arrangement 60 configured to receive light from the emissive display 20 and couple the received light towards an exit pupil 80. The optical arrangement 60 shapes the light so that the first image 40 is formed at an infinite distance, which is a focal length suitable for receipt of the first image 40 by an augmented reality waveguide. The exit pupil 80 receives the first image 40 and allows the first image 40 to be coupled into a waveguide (not shown) suitable for augmented or virtual reality applications. The waveguide typically comprises an input diffractive optical element configured to in-couple light from the exit pupil 80 into the waveguide and an output diffractive element configured to out-couple light from the waveguide towards a user's eye. The waveguide can also be configured to expand the first image 40 using an intermediate grating or the output grating. By “expansion of the image”, it is meant that the exit pupil, which contains the entire first image 40, is replicated across the region of the output diffractive element, also sometimes referred to as the “eyebox”, through which a user's eye looks when moving through a range of angles. The larger the eyebox, the greater the likelihood a user will perceive first image 40 at any viewing angle.
The emissive display 20, the optical arrangement 60, and the exit pupil 80 are arranged centred on an optical axis 9. The emissive display 20 and the exit pupil 80 are arranged perpendicularly to the optical axis 9. Components of the optical arrangement 60 may also be arranged normal to the optical axis 9. The optical axis 9 is aligned with the geometric centre of the part of the emissive display 20 that generates the first image 40 and is perpendicular to the surface of the emissive display 20. Thus, the emissive display 20 defines the optical axis 9. The optical axis 9 runs through the centre of each of the components of the light projector 10 shown in
In the schematic example shown in
The optical arrangement 60 shown in
The exit pupil 80 is configured as an aperture in a housing of the light projector 10. Alternatively, the exit pupil 80 could comprise two or more separate apertures, or a single aperture that is not elongate. In other embodiments, the exit pupil 80 could comprise an optical component, such as transparent glass, configured to couple the first image 40 into the waveguide.
The waveguide is positioned with respect to the exit pupil 80 so that the first image 40 is incident on an input grating of the waveguide. In other embodiments, intervening optical components could couple the first image 40 from the exit pupil 80 to the input grating. The input grating is configured to couple the first image 40 into the waveguide, which propagates through the waveguide by total internal reflection towards an output grating. The output grating then couples the first image 40 towards a user's eye. In augmented reality applications, the waveguide is usually transparent so that the external environment can be viewed through the waveguide. The first image 40 can be provided to the eye so that the first image 40 is viewed as an overlay on the surrounding environment.
Unlike the display 2 of the known light projector 1, the light from the emissive display 20 is shaped by the absorptive slats 72 of the absorptive structure 70 to transmit the first image 40 off-centre with respect to the optical axis 9, as shown in
Upon reaching the waveguide, the first image 40 is mainly transmitted into an input grating of the waveguide, whereafter it is coupled towards a user. However, a partial reflection also occurs at the input grating that is transmitted back towards the emissive display 20 through the exit pupil 80. This partial reflection, also referred to as a second image 50 as shown in
The second image 50 is reflected from the first region 82 and the light forming the second image 50 retraces its path back to the emissive display 20.
The second image 50 then reflects from the emissive display 20 at an angle of reflection equal to and opposite the angle of incidence. As illustrated in
In the embodiment of
The further set of absorptive slats can be provided with a similar spacing and angle relative to the optical axis as the absorptive slats 72. That is, the further absorptive slats can be in a fanned arrangement and arranged in groups associated with a particular column of pixels 20.
In front of a central pixel 22a at the optical axis 9 an absorptive slat 72 may not be present. This avoids the creation of a black line in the image presented to the user, which could otherwise arise from an absorptive slat positioned directly over the central pixel 22a that absorbs a thin portion of light emitted by the central pixel 22a. Although this would allow light from the central pixel 22a to be re-coupled towards the exit pupil 80 and the waveguide, the single pixel 22a is typically not bright enough to generate a user-perceptible ghost image.
The absorptive structure 70 shapes light from the first portion 71a of the emissive display 20 to couple the first image 40 towards the first region 82 of the exit pupil in a similar manner as described with respect to
At the same time, the absorptive structure 70 also shapes light from the second portion 71b to transmit a third image 42 off-centre with respect to the optical axis 9. The third image 42 is intended to be coupled into the waveguide to form a different part of the field of view in the overall image provided to a user. The third image 42 is coupled towards the optical arrangement 60 centred along a path that is at a non-zero angle to the optical axis 9 at a reduced cone angle, as described previously. This enables the optical arrangement 60 to couple the third image 42 towards a second region 84 of the exit pupil 80 that is also offset with respect to the optical axis 9 in the same direction as the orientation of the angled absorptive slats 72 at the second portion 71b. The second portion 71b of the emissive display 20 may only illuminate half of the optical arrangement 60 “below” the optical axis 9 from the perspective of
In this example, the second region 84 is shifted from the optical axis 9 so that the optical axis 9 is tangential to a peripheral edge of the second region 84. The first region 82 and the second region 84 are spatially separated and offset from the optical axis 9 in equal and opposite directions. The third image 42 enters a waveguide through the second region 84 of the exit pupil.
The second portion 71b and the first portion 71a are configured to operate simultaneously to provide different parts of a field of view of an overall image to a user at the same time. In this manner, the absorptive structure 70 of
As shown in
As described previously, the absorptive structure 70 can comprise further absorptive slats arranged substantially perpendicularly to the absorptive slats 72 shown in
The emissive display 120 comprises an array of pixels 22 mounted on a base 24 to provide monochrome or full-colour images, as described previously. In addition, each pixel 22 comprises a collimating tube 26, i.e. a tube with a reflective inner surface, to shape the light emitted by the respective pixel 22. In particular, each collimating tube 26 is asymmetric so that emitted light is coupled preferentially towards one side of the optical axis 9. The collimating tubes 26 are flared on their right sides only (as depicted), from the perspective of
In general, partial reflections arising from (desirable) images entering a waveguide may reach the emissive display 120 in the same manner as described previously. These partial reflections can re-reflect or scatter from the surfaces of the LEDs or the base 24. To mitigate this, the external faces (away from the emitters) of the collimating tubes 26 is coated with an absorptive coating 170 configured to absorb visible light to inhibit ghost images. This prevents the second image 50 from reflecting from the base 24 or the LEDs 22 to reduce the intensity of any ghost images in the overall images provided to the user.
Alternatively, as shown in
In other examples, the emissive display 120 may have collimating tubes 26 flared towards different directions on opposing sides of the optical axis 9, so that each side of the emissive display 120 couples light to one of two opposing regions of an exit pupil. For instance, pixels 22 to the right of the optical axis 9 may have collimating tubes 26 flared towards the right side of the optical axis 9 and vice versa. This allows each side of the emissive display 120 to couple emitted light towards a specific region of the exit pupil that is offset from the optical axis.
Instead of the absorptive coating 170, the external face or faces of the collimating tubes 26, or the exposed outer surface of the platform 172, may be made from a material configured to absorb visible light to inhibit partial reflections.
The emissive display 120 can replace the emissive display 20 in the light projector 10 described above. The light projector 10 equipped with the reflective display 20 or the reflective display 120 can be provided in any suitable augmented or virtual reality headset equipped with a waveguide to provide clearer images to a user.
| Number | Date | Country | Kind |
|---|---|---|---|
| 23212582.3 | Nov 2023 | EP | regional |