The present invention relates to a device for use in an augmented reality or virtual reality display such as a headset or a head-up display. In particular, the invention relates to a waveguide that provides an improved optical efficiency in an output diffractive optical element that can simultaneously expand light in two-dimensions and couple it out of the waveguide for viewing by a user.
An augmented reality display allows a user to view their surroundings as well as projected images. In military or transportation applications the projected images can be overlaid on the real world perceived by the user. Other applications for these displays include video games and wearable devices, such as glasses. By contrast, in a virtual reality display a user can only perceive projected images and light from their real world surroundings is obscured.
In a normal augmented reality set-up a transparent display screen is provided in front of a user so that they can continue to see the physical world. The display screen is typically a glass waveguide, and a projector is provided to one side. Light from the projector is coupled into the waveguide by a diffraction grating (an input grating). The projected light is totally internally reflected within the waveguide. The light is then coupled out of the waveguide by another diffraction grating (an output grating) so that it can be viewed by a user. The projector can provide information and/or images that augment a user's view of the physical world.
An optical device is disclosed in WO 2016/020643 for expanding input light in two dimensions in an augmented reality display. An input diffractive optical element is provided for coupling input light from a projector into a waveguide. The optical device also includes an output element having two diffractive optical elements overlaid on one another in the waveguide so that each of the two diffractive optical elements can receive light from the input diffractive optical element and couple it towards the other diffractive optical element in the pair, which can then act as an output diffractive optical element which couples light out of the waveguide towards a viewer. In one embodiment the two diffractive optical elements overlaid on one another are provided in a photonic crystal. This is achieved by having an array of pillars arranged within or on the surfaces the waveguide, having an increased refractive index relative to the surrounding waveguide medium. The pillars in WO 2016/020643 are described as having a circular cross-sectional shape when viewed in the plane of the waveguide, from the perspective of a viewer. This arrangement has been found to be very effective at simultaneously expanding light in two dimensions and coupling light out of the waveguide. Advantageously this can improve the use of space on the waveguide. However, it has been found that this arrangement can also produce some light paths that offer expansion within the waveguide without any outcoupling towards a viewer. This can produce some inefficiency and it would be desirable to improve this arrangement in order to increase optical efficiency (i.e. optical power received at a user's eye versus optical power input to the system from a projector). An object of the present invention is to provide an optical device that can expand light in two dimensions in an augmented reality display with increased optical efficiency.
According to an aspect of the present invention there is provided an optical structure for use in an augmented reality or virtual reality display, comprising: a waveguide; an input diffractive optical structure configured to receive light from a projector and couple the received light into the waveguide; an output diffractive optical structure configured to receive light from the input diffractive optical element in an input direction, wherein the output diffractive optical structure comprises at least a first diffractive optical element and a second diffractive optical element with different respective diffraction efficiencies, wherein the first diffractive optical element has a relatively high diffraction efficiency and the second diffractive optical element has a relatively low diffraction efficiency and the first and second diffractive optical elements are overlaid on one another in or on the waveguide, wherein the first diffractive optical element is configured to receive light along the input direction and couple it towards the second diffractive optical element which can then act as an output diffractive optical element, providing outcoupled orders towards a viewer, and wherein the second diffractive optical element is configured to receive light along the input direction and couple it towards the first diffractive optical element which can then act as an output diffractive optical element, providing outcoupled orders towards a viewer; wherein the output diffractive optical structure comprises a first portion and a second portion, wherein in the first portion the first diffractive optical element is configured to couple light from the input direction towards the second portion and wherein the second diffractive optical element is configured to couple light from the input direction away from the second portion, and in the second portion the first diffractive optical element is configured to couple light from the input direction towards the first portion and wherein the second diffractive optical element is configured to couple light from the input direction away from the first portion.
In this way, the output diffractive optical structure can be provided with two distinct portions. In practice there may be two sides in the output diffractive optical structure: a left side and a right side, and these sides may have equal and opposite diffractive properties. It has been found that this arrangement can advantageously increase the optical efficiency of the system because light can be diffracted relatively strongly by one portion towards the other portion whereupon it is diffracted relatively strongly again such that it couples out of the waveguide towards a viewer. The diffraction efficiencies can therefore be selected to promote outcoupling of light towards a viewer, after it has been initially turned within the output structure. This means that light can be preferentially expanded in two dimensions within the output structure and coupled out of the waveguide. This contrasts with the known arrangement where some light paths can continue to be captured within the waveguide under total internal reflection without being coupled out towards a viewer. The present arrangement therefore increases the proportion of light that is coupled into useful orders and is presented to the viewer's eye. This advantageously improves the overall optical efficiency of the system which is important in a wearable device with limited battery resources because it means that battery life can be extended for the same brightness of display.
Preferably the first diffractive optical element in the first portion has a grating vector which is substantially parallel to the grating vector of the second diffractive optical element in the second portion. Likewise, the second diffractive optical element in the first portion preferably has a grating vector which is substantially parallel to the grating vector of the first diffractive optical element in the second portion. This provides strong and weak diffractive optical elements in both of the first and second portions. Preferably the features of the first and second diffractive optical elements are the mirror image of one another, reflected about an axis that is parallel with the input direction.
The first and second diffractive optical elements are preferably oriented at respective angles of +30° and −30° to the input direction. This means that the first and second diffractive optical elements can provide first diffracted orders that extend in directions respectively at angles of ±120° to the input direction. It has been found that this arrangement allows light paths to be simultaneously expanded in two dimensions within the output diffractive optical structure and coupled out of the waveguide towards a viewer.
Different respective diffraction efficiencies for the first diffractive optical element and the second diffractive optical element may be provided using features with different respective dimensions in the first and second diffractive optical elements. For example, different respective feature heights may be provided in the first and second diffractive optical elements. In this situation the first and second diffractive optical elements may be surface relief gratings. The first and second diffractive optical elements may be provided on opposite waveguide surfaces or they may be superimposed on one another on the same waveguide surface.
In another example, different feature lengths may be provided along respective axes defined by the first and second diffractive optical elements respectively. In this way, each of the first and second diffractive optical elements may be provided using features with sides that are parallel to the grooves or lines of the relevant diffractive optical element. In other words, the sides of the respective features are arranged in a direction that is orthogonal to the grating vector of the relevant diffractive optical element. In one example, the second diffractive optical element may be provided by a dotted or dashed line of elements having sides that are aligned with the respective diffractive optical elements. By contrast, the first diffractive optical element ma be provided with a continuous feature that is parallel to the grooves or lines. The lengths of the sides in the dots or dashes in the second diffractive optical element may be selected to control diffraction efficiency relative to the diffraction efficiency of the first diffractive optical element.
In a further example, a combination of different feature heights and feature lengths may be provided to yield different diffraction efficiencies for the first and second diffractive optical elements.
The output diffractive optical structure preferably comprises a plurality of optical structures arranged in an array to provide the first and second diffractive optical elements. Each of the plurality of optical structures preferably has a shape, when viewed in the plane of the waveguide, having respective sides that are parallel to the first and second diffractive optical elements and wherein the side or sides that are parallel to the first diffractive optical element have a different length to the side or sides that are parallel to the second diffractive optical element in order to provide the difference in diffraction efficiency between the first and second diffractive optical elements. Preferably the optical structures are provided within a photonic crystal. The optical structures may be provided with a refractive index that is equal to or different from (and generally higher than) the refractive index of the surrounding waveguide medium.
In one embodiment, each of the plurality of optical structures may have a parallelogram shape, when viewed in the plane of the waveguide. The major sides of the parallelogram are preferably parallel with the first diffractive optical element in the first and second portions of the waveguide and the minor sides of the parallelogram are preferably parallel with the second diffractive optical element in the first and second portions of the waveguide. The difference in size between the major and minor sides may give rise to the difference in diffraction efficiency between the first and second diffractive optical elements. This difference in size may be selected to achieve the desired difference in diffraction efficiency.
The optical structures in the first portion preferably have a shape which is a mirror image of the shape of optical structures in the second portion about an axis of reflection that is parallel with the input direction. In one embodiment, the optical structures may be parallelograms which are similar but which are presented in a different orientation in the first and second portions of the output diffractive optical element.
The input diffractive optical element is preferably positioned along a line between the first and second portions of the output diffractive optical structure. The input direction may therefore define a line that separates the first and second portions from one another.
The output diffractive optical structure may receive light directly or indirectly from the input diffractive optical element. In some arrangements an intermediate diffractive optical element may be provided between the input diffractive optical structure and the output diffractive optical structure. Such an intermediate diffractive optical structure may be included in order to provide some intermediate beam expansion before the light is received at the output diffractive optical structure.
According to another aspect of the invention there is provided an augmented reality or virtual reality device comprising: a projector configured to provide augmented reality or virtual reality images; and the optical structure as previously defined. The device may further comprise a battery configured to supply electrical power to the projector. The optical structure may enable improved optical efficiency which means that battery resources can be conserved.
Embodiments of the invention are now described, by way of example, with reference to the drawings, in which:
The input grating 4 has a grating vector oriented along the y-axis with a magnitude that is inversely proportional to the separation of the grooves in the grating. Similarly, a grating vector can be defined for other diffraction gratings or diffractive optical structures.
The output element 10 has a structure as described in WO 2016/020643. Thus, the output element 10 includes two diffractive optical elements overlaid on one another in or on the waveguide so that each of the two diffractive optical elements can receive light from the input diffractive optical element and couple it towards the other diffractive optical element in the pair, which can then act as an output diffractive optical element which couples light out of the waveguide towards a viewer. This may be achieved by providing two diffractive optical elements overlaid on one another in a photonic crystal. In this way, the output element 10 can simultaneously expand light in two dimensions and couple light out of the waveguide towards a viewer.
In one arrangement the output element 10 can be created by superimposing two diffractive optical structures on top of one another. As shown in
It has been found that it can be advantageous to produce an output element that is composed of overlaid first and second diffraction gratings with different diffraction efficiencies for a given wavelength. As shown schematically in
In these examples, the difference in diffraction efficiency can be provided by adjusting the feature height of the diffractive features in the first and second diffraction gratings 30, 32, as would be understood by a person skilled in the art. Alternatively the dimensions of the features that are parallel to the grooves or lines of the diffractive features are selectively controlled. In the digital approximation 36 the second diffraction grating is represented by “notches” in the first diffraction grating. Effectively, this provides a second diffraction grating represented by dashed lines. The reduced overall length of the features provided in the second diffraction grating versus those features in the first diffraction grating, which have a continuous length, can give rise to a difference in diffraction efficiency, even if the same feature height is used. A similar principle can be used in a photonic crystal when controlling the shape of elements within a regular array.
With reference to
In the example of
The diffractive features in the first and second portions 62, 64 of the output element 60 are different. In the first portion 62, the digital approximation 40 is provided, as shown in
In operation, when light is received at the first portion 62 of the output element along the input direction from the input grating 54, it is diffracted into one of several orders, as described above in connection with
As explained above, a significant proportion of the light diffracted in the first portion 62 extends in the direction 42, towards the second portion 64. These light paths then encounter the diffractive structures in the second portion 64 of the output element. In this case, the first diffractive element is oriented at +30°, which is orthogonal to the path of the incoming rays. Therefore, the first diffractive element, which has the higher diffraction efficiency, is preferentially arranged to couple rays out of the waveguide 52 and towards a viewer along the z-axis.
The second portion 64 of the output element 60 is effectively a mirror image of the first portion 62, reflected about the y-axis. Therefore, opposite diffractive interactions occur within the second portion 64 in comparison to the first portion 62. When light is received at the second portion 64 from the input grating 54 along the y-axis it is preferentially diffracted into a direction at an angle of −120° to the y-axis. These diffracted orders of light extend towards the left when viewed in the plane view of
Light paths that are diffracted at −120° to the y-axis from the second portion 64 towards the first portion 62 are incident on the diffractive structures of the first portion. The digital approximation 40 comprises a first diffractive optical element that is oriented at −30° to the y-axis, which is in a direction that is orthogonal to the incoming rays. Thus, rays that are received at the second portion 64 are preferentially turned to the path at −120° to the y-axis and then are preferentially coupled out of the waveguide towards a viewer along the z-axis. This arrangement means that outcoupling from the waveguide 52 is more strongly promoted, following two-dimensional expansion, which advantageously improves the optical efficiency of the system. This reduces wasted light and, within an augmented reality system, means that battery life can be extended for the same brightness of output.
In another embodiment the elements 72 can be embedded within the waveguide medium. The elements 72 can therefore be provided entirely within the waveguide medium. This requires a refractive index mismatch between the elements 72 and the waveguide medium in order for diffraction to occur. This can be achieved by creating a waveguide having a surface relief profile with the elements 72 on one surface. A bonding material can then be applied on the elements 72 and this can be bonded to a cover piece having the same refractive index as the waveguide. By choosing a bonding material that has a different (usually higher) refractive index than the waveguide medium a unified waveguide can be created between the original waveguide and the cover piece, with the bonding material sandwiched in between. In this design the bonding material has the same shape as the elements 72, but a different refractive index from the surrounding waveguide medium.
The regular arrangement of elements 72 in the array may be thought of as a number of effective diffraction gratings or diffractive optical structures. In particular it is possible to define a grating H2 with rows of optical structures 10 at an angle of +30° to the y-axis, with adjacent rows separated by a distance p, known as the lattice constant. Grating H3 is arranged with rows of optical structures at an angle of −30° to the y-axis, with adjacent rows separated by a distance p. Grating H1 can be defined in a direction that is aligned with the x-axis, with adjacent rows of optical structures separated by an effective distance q. Grating H1 can be thought of as a product of the combination of gratings H2 and H3. The values p and q are related to one another by the expression q=p Cos(30°). It has been found that an effective photonic crystal can be created with values of p in the range of 340 nm to 650 nm.
In the photonic crystal 70 the elements 72 have a parallelogram shape with major and minor parallel sides. The major sides have a length Ma and the minor sides have a length Mi. The major sides with length Ma align to produce the grating H3. The minor sides with length Mi align to produce the grating H2. The diffraction efficiency of the grating H3 is higher than the diffraction efficiency of the grating H2 due to the different sizes of the features that contribute to the gratings.
When light from an input grating received along the y-axis is incident on the photonic crystal 70 it undergoes multiple simultaneous diffractions by the various diffractive optical elements. Light can be diffracted into a zero order, which is a continuation of the propagation of the incident light along the y-axis. Light can also be diffracted into a first diffraction order by grating H1. The first order is coupled out of the waveguide 14 in a positive direction along the z-axis, towards a viewer which can be defined as the straight to eye order. Light can also be diffracted into a first diffracted order by the H2 diffractive optical structure. A relatively small proportion of the incident light is diffracted into this order because of the relatively low diffraction efficiency of the grating H2. The diffracted order extends in a direction that is at +120° to the y-axis, and this light beam goes on to make further interactions with the photonic crystal. Light can also be diffracted into a first diffracted order by the H3 diffractive optical structure. Light is coupled preferentially into this order because of the relatively high diffraction efficiency of the grating H3. This first order is diffracted at −120° to the y-axis, and this light beam goes on to make further interactions with the photonic crystal.
The first portion 62 of the output element 60 can include parallelogram elements 72 that are similar to those shown in
Number | Date | Country | Kind |
---|---|---|---|
1817310.4 | Oct 2018 | GB | national |
This application is a continuation of U.S. patent application Ser. No. 17/287,479, filed on Apr. 21, 2021, which is a U.S. national-phase application filed under 35 U.S.C. § 371 from International Application Serial No. PCT/GB2019/052075, filed on Jul. 24, 2019, and published as WO 2020/084275 on Apr. 30, 2020, which claims the benefit of priority to United Kingdom Patent Application Serial No. 1817310.4, filed on Oct. 24, 2018, each of which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 17287479 | Apr 2021 | US |
Child | 18771278 | US |