This invention generally relates to electronic displays and more particularly relates to displays that use an image light guide to display virtual image content to a viewer.
Head-Mounted Displays (HMDs) are being developed for a range of diverse uses, including military, commercial, industrial, fire-fighting, and entertainment applications. For many of these applications, there is particular value in forming a virtual image that can be visually superimposed over the real-world image that lies in the field of view of the HMD user. Optical image light guides convey image-bearing light to a viewer in a narrow space for directing the virtual image to the viewer's pupil and enabling this superposition function.
In such conventional image light guides, collimated, relatively angularly encoded light beams from an image source are coupled into a planar waveguide by an input coupling such as an in-coupling diffractive optic, which can be mounted or formed on a surface of the planar waveguide or buried within the waveguide. Such diffractive optics can be formed as diffraction gratings, holographic optical elements or in other known ways. For example, the diffraction grating can be formed by surface relief. After propagating along the waveguide, the diffracted light can be directed back out of the waveguide by a similar output grating, which can be arranged to provide pupil expansion along one dimension of the virtual image. In addition, a turning grating can be positioned along the waveguide between the input and output gratings to provide pupil expansion in an orthogonal dimension of the virtual image. The image-bearing light output from the waveguide provides an expanded eyebox for the viewer.
Conventional image light guides form a virtual image at optical infinity, conveying only collimated light to the viewer eyebox. However, there can be advantages to forming the virtual image such that it appears to be focused at some close distance, such as in the range from 1 meter to 1.5 meters, for example. Using near-focused solutions can allow the viewer to have the advantage of augmented reality imaging in applications where it is useful to have the real-world scene content at a close distance.
There can be further benefits to a head-mounted optical imaging apparatus with an image light guide that forms both a conventional virtual image at infinity and another virtual image at a near distance from the viewer. At the same time, the apparatus should provide good visibility of the real-world scene that lies in the viewer's field of view. Solutions that have been proposed for providing this feature include bulky designs that require multiple image-forming components and employ complex timing schemes in order to present both near-focused and infinity-focused images.
Thus, it can be appreciated that there would be advantages to a display apparatus that forms virtual image content at a near-focus position.
It is an object of the present disclosure to advance the art of virtual image presentation particularly when using compact head-mounted devices and similar imaging apparatus. Advantageously, embodiments of the present disclosure provide an optical imaging apparatus that forms a virtual image so that it appears to be at a close fixed focus. This can allow simultaneous visibility of the virtual image with the real-world scene content that lies in the field of view of the viewer.
These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.
According to an aspect of the present disclosure, there is provided an image light guide for forming a virtual image including a waveguide, an in-coupling diffractive optic, and an out-coupling diffractive optic. The in-coupling diffractive optic directs image-bearing light beams into the waveguide, and the out-coupling diffractive optic directs the image-bearing light beams from the waveguide toward a viewer eyebox. In addition, the out-coupling diffractive optic includes an array of zones each comprising a set of diffractive features. The diffractive features within each set have a common pitch. Successive zones along one dimension of the array have respective sets of diffractive features with a different common pitch that progressively varies between the successive zones in a stepwise manner for forming a virtual image that is viewable from the eyebox at a near focus distance.
The sets of diffractive features in the successive zones along the one dimension of the array can also share a common shape, such as a linear or curvilinear shape. The array of zones can be a multi-dimensional array of zones such that the one dimension of the array is a first dimension of the array along which the sets of diffractive features in the successive zones are oriented in the same direction. Successive zones along a second of the dimensions of the array can have respective sets of diffractive features that are oriented in different directions in a manner that progressively varies in a stepwise manner between the successive zones along the second dimension.
The respective sets of diffractive features within the successive zones along the second dimension of the array can also have a different common pitch. However, the displacements between the diffractive features along the first dimension of the array can remain the same between the successive zones along the second dimension of the array. The diffractive features of adjacent zones along the second dimension of the array can have respective linear diffractive features that abut each other forming contiguous chordal segments of a curve.
Each of the image-bearing light beams includes angularly encoded information concerning a pixel within the virtual image and the multi-dimensional array of zones preferably provides for overlapping each of the image-bearing light beams within the eyebox in a form that produces the virtual image at the near focus distance on an opposite side of the waveguide as viewed within the eyebox. The multi-dimensional array of zones preferably focuses each of the image-bearing light beams within the virtual image to a different focus spot, and both the stepwise variation in pitch between the successive zones along the first dimension of the array and a stepwise variation in the orientation of the diffractive features between the successive zones along the second dimension of the array are preferably limited to avoid overlap between the different focus spots within the virtual image.
The out-coupling diffractive optic is preferably arranged to reflect one portion and to diffract another portion of each of the image-bearing light beams through each of a plurality of encounters with each of the image-bearing light beams. An intermediate turning grating preferably provides for expanding one dimension of each of the image-bearing light beams in advance of the out-coupling diffractive optic, and each of the so-expanded image-bearing light beams preferably encounters a plurality of zones along the second dimension of the array upon each encounter of the image-bearing light beam with the out-coupling diffractive optic.
According to another aspect of the present disclosure, there is provided another image light guide for forming a virtual image including a waveguide, an in-coupling diffractive optic, and an out-coupling diffractive optic. The in-coupling diffractive optic directs image-bearing light beams into the waveguide, and the out-coupling diffractive optic directs the image-bearing light beams from the waveguide toward a viewer eyebox. The out-coupling diffractive optic including an array of zones each comprising a set of diffractive features. The diffractive features within each set have a common orientation. Successive zones along one dimension of the array have respective sets of diffractive features with different orientations that progressively vary between the successive zones in a stepwise manner for forming a virtual image that is viewable from the eyebox at a near focus distance.
The array of zones is a multi-dimensional array of zones and the one dimension of the array is a second dimension of the array and the sets of diffractive features along a first dimension of the array are oriented in the same direction. The diffractive features along the first dimension of the array can progressively vary in pitch. Alternatively, the diffractive features within each set can have equal pitch and successive zones along the first dimension of the array can have respective sets of diffractive features with a different pitch that progressively varies between the successive zones in a stepwise manner along the first dimension of the array. The diffractive features within the successive zones along the second dimension of the array can also have a differing pitch. However, displacements between the diffractive features along the first dimension of the array can remain the same between the successive zones along the second dimension of the array.
According to another aspect of the present disclosure, there is provided an imaging apparatus for forming a virtual image having a planar waveguide, an in-coupling diffractive optic that directs image-bearing light beams into the waveguide, and an out-coupling diffractive optic that directs the image-bearing light beams from the waveguide toward a viewer eyebox. The waveguide is arranged for propagating the image-bearing light beams from the in-coupling diffractive optic to the out-coupling diffractive optic as a set of angularly related collimated beams. The out-coupling diffractive optic includes a two-dimensional array of contiguous diffractive zones. Each of the diffractive zones (i) has first and second pairs of opposite sides and (ii) has a set of diffractive features that extend between the second pair of opposite sides, wherein the diffractive features in each set have a common orientation and a common pitch. A succession of the zones along a first dimension of the array has contiguous sides among the first pair of sides and respective sets of diffractive features that progressively vary in pitch in a stepwise manner. A succession of the zones along a second dimension of the array has contiguous sides among the second pair of sides and respective sets of diffractive features that progressively vary in orientation in a stepwise manner. The successions of zones along the first and second dimensions of the array are arranged for converting each of the collimated beams into a diverging beam that appears to emanate from a near focus spot on an opposite side of the planar waveguide as viewed within the eyebox.
Preferably, the out-coupling diffractive optic focuses each of the image-bearing light beams within the virtual image to a different focus spot, and both the stepwise variation in pitch between the successive zones along the first dimension of the array and a stepwise variation in the orientation of the diffractive features between the successive zones along the second dimension of the array are limited to avoid overlap between the different focus spots within the virtual image.
According to yet another aspect of the present disclosure, there is provided an imaging apparatus for forming dual virtual images including a planar waveguide, a first in-coupling diffractive optic that direct a first set of image-bearing light beams into the waveguide, a first out-coupling diffractive optic that directs the first set of image-bearing light beams from the waveguide toward a viewer eyebox, a second in-coupling diffractive optic that directs a second set of image-bearing light beams into the waveguide, and a second out-coupling diffractive optic that directs the second set of image-bearing light beams from the waveguide toward the viewer eyebox. The second out-coupling diffractive optic has an array of contiguous diffractive zones. Each of the diffractive zones has at least one pair of sides and a set of diffractive features having at least one of a common orientation and a common pitch. A succession of the zones along one dimension of the array has contiguous sides among the one pair of sides and respective sets of diffractive features that progressively vary in at least one of orientation and pitch in a stepwise manner, The first out-coupling diffractive optic is arranged for forming a virtual image that is viewable from the eyebox at a first focus distance, and the second out-coupling diffractive optic is arranged together with the array of contiguous diffractive zones for forming a virtual image that is viewable from the eyebox at a second nearer focus distance.
The waveguide is preferably arranged for propagating the second set image-bearing light beams from the second in-coupling diffractive optic to the second out-coupling diffractive optic as a set of angularly related collimated beams, and the array of contiguous diffractive zones is preferably arranged for converting each of the collimated beams into a diverging beam that appears to emanate from a near focus spot on an opposite side of the planar waveguide as viewed within the eyebox.
Preferably, the diffractive features within each of the sets of diffractive features have a common pitch, the one dimension of the array is a first dimension of the array, and the succession of zones along the first dimension of the array has respective sets of diffractive features with a different common pitch that progressively varies between the successive zones in a stepwise manner. In addition, the diffractive features within each of the sets of diffractive features preferably have a common orientation, and a succession of zones along a second dimension of the array has respective sets of diffractive features with a different common orientation that progressively varies between the successive zones along the second dimension in a stepwise manner.
While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter of the present invention, it is believed that the invention will be better understood from the following description when taken in conjunction with the accompanying drawings, wherein:
The present description is directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with embodiments of the invention. It is to be understood that elements not specifically shown or described may take various forms known to those skilled in the art.
Where they are used herein, the terms “first”, “second”, and so on, do not necessarily denote any ordinal, sequential, or priority relation, but are simply used to more clearly distinguish one element or set of elements from another, unless specified otherwise.
By “exemplary” is meant to be “an example of”, not intended to suggest any preferred or ideal embodiment.
In the context of the present disclosure, the terms “viewer”, “operator”, “observer”, and “user” are considered to be equivalent and refer to the person who views virtual images conveyed by one of the considered image light guides, especially as arranged in an HMD viewing device.
As used herein, the term “energizable” relates to a device or set of components that perform an indicated function upon receiving power and, optionally, upon receiving an enabling signal.
The term “actuable” has its conventional meaning, relating to a device or component that is capable of effecting an action in response to a stimulus, such as in response to an electrical signal, for example.
The term “set”, as used herein, refers to a non-empty set, as the concept of a collection of elements or members of a set is widely understood in elementary mathematics. The term “subset”, unless otherwise explicitly stated, is used herein to refer to a non-empty proper subset, that is, to a subset of the larger set, having one or more members. For a set S, a subset may comprise the complete set S. A “proper subset” of set S, however, is strictly contained in set S and excludes at least one member of set S.
As an alternative to real image projection, an optical system can produce a virtual image that is apparent to the eye of a viewer. In contrast to methods for forming a real image, a virtual image is not formed on a display surface. That is, if a display surface were positioned at the perceived location of a virtual image, no image would be formed on that surface. Virtual image display has a number of inherent advantages for augmented reality presentation. For example, the apparent size of a virtual image is not limited by the size or location of a display surface. Additionally, the source object for a virtual image may be small; a magnifying glass, as a simple example, provides a virtual image of its object. In comparison with systems that project a real image, a more realistic viewing experience can be provided by forming a virtual image that appears to be some distance away. Providing a virtual image also obviates the need to compensate for screen artifacts, as may be necessary when projecting a real image.
The phrases “optical infinity” and “at infinity” as used herein correspond to conventional usage in the camera and imaging arts, indicating image formation using one or more bundles of substantially collimated light, so that the focus distance exceeds at least about 4 meters.
The terms “coupled” or “coupler” in the context of optics refer to a connection by which light travels from one optical medium or device to another optical medium or device through an intermediate structure that facilitates the connection.
The terms “beam expander” and “pupil expander” are considered synonymous and are used interchangeably herein. These terms are used generally herein to refer to enlarging the area of overlap among angularly related beams for conveying virtual images.
A composite prism is formed from two or more component prism elements in a defined relationship, including those that are joined in direct optical contact or through an intervening optical medium.
When used as a part of a virtual display system, in-coupling diffractive optic IDO couples the image-bearing light WI from a real, virtual or hybrid image source (not shown) into the substrate S of the planar waveguide 22. Any real image or image dimension is first converted, e.g. converged toward a focus, into an array of overlapping angularly related beams encoding the different positions within the image similar to a virtual image for presentation to the in-coupling diffractive optic IDO. The image-bearing light WI is diffracted (generally through a first diffraction order) and thereby redirected by in-coupling diffractive optic IDO into the planar waveguide 22 as image bearing light WG for further propagation along the planar waveguide 22 by Total Internal Reflection (TIR). Although diffracted into a generally more condensed range of angularly related beams in keeping with the boundaries set by TIR, the image-bearing light WG preserves the image information in an encoded form. An out-coupling diffractive optic ODO receives the encoded image bearing light WG and diffracts (also generally through a first diffraction order) the image bearing light WG out of the planar waveguide 22 as the image bearing light WO toward the intended location of a viewer's eye. Generally, the out-coupling diffractive optic ODO is designed symmetrically with respect to the in-coupling diffractive optic IDO to restore the original angular relationships of the image-bearing light WI among outputted angularly related beams of the image-bearing light WO. However, to increase one dimension of overlap among the angularly related beams in a so-called eyebox E within which the virtual image can be seen, the out-coupling diffractive optic ODO is arranged to encounter the image bearing light WG multiple times and to diffract only a portion of the image bearing light WG on each encounter. The multiple encounters along the length of the out-coupling diffractive optic ODO have the effect of enlarging one dimension of each of the angularly related beams of the image bearing light WO thereby expanding one dimension of the eyebox E within which the beams overlap. The expanded eyebox E decreases sensitivity to the position of a viewer's eye for viewing the virtual image.
The out-coupling diffractive optic ODO is shown as a transmissive type diffraction grating arranged on the inner surface 14 of the planar waveguide 22. However, similar to the in-coupling diffractive optic IDO, the out-coupling diffractive optic ODO can be located on the outer or inner surface 12 or 14 of the planar waveguide 22 and be of a transmissive or reflective type in a combination that depends upon the direction through which the image-bearing light WG is intended to exit the planar waveguide 22.
The perspective view of
In the image light guide 20 of
That is, while the image bearing light WI input into the image light guide 20 is encoded into a different set of angularly related beams by the in-coupling diffractive optic IDO, the information required to reconstruct the image is preserved by accounting for the systematic effects of the in-coupling diffractive optic IDO. The turning grating TG, located in an intermediate position between the in-coupling and out-coupling diffractive optics IDO and ODO, is typically arranged so that it does not induce any significant change on the encoding of the image bearing light WG. The out-coupling diffractive optic ODO is typically arranged in a symmetric fashion with respect to the in-coupling diffractive optic IDO, e.g., including diffractive features sharing the same period. Similarly, the period of the turning grating TG also typically matches the common period of the in-coupling and out-coupling diffractive optics IDO and ODO. Although the grating vector k1 of the turning grating TG is shown oriented at 45 degrees with respect to the other grating vectors, which remains a possible orientation, the grating vector k1 of the turning grating TG is preferably oriented at 60 degrees to the grating vectors k0 and k2 of the in-coupling and out-coupling diffractive optics IDO and ODO in such a way that the image bearing light WG is turned 120 degrees. By orienting the grating vector k1 of the intermediate turning grating at 60 degrees with respect to the grating vectors k0 and k2 of both the in-coupling and out-coupling diffractive optics IDO and ODO, the grating vectors k0 and k2 of the in-coupling and out-coupling diffractive optics IDO and ODO are also oriented at 60 degrees with respect to each other. Basing the grating vector magnitudes on the common pitch of the turning grating TG and the in-coupling and out-coupling diffractive optics IDO and ODO, the three grating vectors k0, k1, and k2 form an equilateral triangle, and sum to a zero magnitude, which avoids asymmetric effects that could introduce unwanted aberrations including chromatic dispersion.
The image-bearing light WI that is diffracted into the planar waveguide 22 is effectively encoded by the in-coupling optic, whether the in-coupling optic uses gratings, holograms, prisms, mirrors, or some other mechanism. Any reflection, refraction, and/or diffraction of light that takes place at the input must be correspondingly decoded by the output in order to re-form the virtual image that is presented to the viewer. Preferably, the turning grating TG, placed at an intermediate position between the in-coupling and out-coupling diffractive optics IDO and ODO, is typically designed and oriented so that it does not induce any change on the encoded light. Out-coupling diffractive optic ODO decodes the image bearing light WG into its original or desired form of angularly related beams that have been expanded to fill the eyebox 74. In a broader sense, whether any symmetries are maintained or not among the turning grating TG and the in-coupling and out-coupling diffractive optics IDO and ODO or whether or not any change to the encoding of the angularly related beams of the image bearing light WI takes place along the planar waveguide 22, the turning grating TG and the in-coupling and out-coupling diffractive optics IDO and ODO are related so that the image bearing light WO that is output from the planar waveguide 22 preserves or otherwise maintains the original or desired form of the image bearing light WI for producing the intended virtual image.
The letter “R” represents the orientation of the virtual image that is visible to the viewer whose eye is in the eyebox 74. As shown, the orientation of the letter “R” in the represented virtual image matches the orientation of the letter “R” as encoded by the image bearing light WI. A change in the rotation about the z axis or angular orientation of incoming image bearing light WI with respect to the x-y plane causes a corresponding symmetric change in rotation or angular orientation of outgoing light from out-coupling diffractive optic (ODO). From the aspect of image orientation, the turning grating TG simply acts as a type of optical relay, providing expansion of the angularly encoded beams of the image bearing light WG along one axis (e.g., along the y axis) of the image. Out-coupling diffractive optic ODO further expands the angularly encoded beams of the image bearing light WG along another axis (e.g., along the x axis) of the image while maintaining the original orientation of the virtual image encoded by the image bearing light WI. The turning grating TG is typically a slanted or square grating or, alternately, can be a blazed grating and is typically arranged on the front or back surfaces of the planar waveguide 22.
The image light guides 10 and 20 depicted in
Conventional virtual imaging systems based on image light guides that convey virtual images to expanded eyeboxes from offset image sources present the virtual images at an optical infinity focus. That is, each of the angularly related beams that comprise the image bearing light within the eyebox remains in a substantially collimated form. As schematically represented in
In
Virtual image content that appears to be at a shorter focus distance than the conventional infinity focus provides additional control over the way in which virtual images can be presented to viewers such as by presenting images of objects at a perceived distance in front of other objects within the viewer's field of view. Near or finite focal distance Q can be at any distance within about 1 meter to 2 meters, such as at about 0.6 m from the image light guide 30, for example. In order to form a virtual image that appears to have a finite focal distance, each of the angularly related beams of the image bearing light that is emitted from the out-coupling diffractive optic ODO has its principal rays diverging from the apparent location within the virtual image that is positioned at the near focus distance Q. The near focusing of each of the otherwise collimated beams among the set of angularly related beams does not change the relative positions at which the beams appear to be focused within the virtual image. Instead, the entire virtual image appears closer to the viewer
One mechanism for converting a dimension of a collimated beam propagating along the planar waveguide 22 into a diverging beam representing a near focus position in a virtual image is presented in
Considered in the x-z plane, stepwise adjustments to the period d along the x-axis length of the out-coupling grating 80 provide for diffracting the representative collimated beam through progressively varying diffraction angles so that the light appears to emanate from a near-focus point f. The other angularly related beams of the image bearing light WG are also diffracted through a progression of different diffraction angles with each successive encounter with the out-coupling grating 80 so that the light from each of these beams appears to emanate from a different near-focus point elsewhere in a common focal plane at the distance Q in accordance with their differing angular content.
Another mechanism for converting a different dimension of a collimated beam propagating along the planar waveguide 22 into a diverging beam representing a near focus position in a virtual image is presented in
Each of the zones Z, as shown numbered Z1 through Z12 in
The linear diffractive grating features 82 within each zone Zn extend in parallel, and the linear diffractive grating features 82 within each of the zones of a row also extend in parallel. Thus, grating vectors k of the zones within each row extend in parallel. However, within each row, the grating pitch (period d) progressively varies in a stepwise manner among the zones of each row. Thus, the magnitudes of the grating vectors k progressively vary along each row. For example, as shown in
Among the zones of each column, the grating vectors progressively change in angular orientation in a stepwise manner through the angle cp. While the displacements between grating features 82 in the x-axis direction remain constant among the zones within each of the columns, the pitch itself varies as a product of the x-axis displacement and the cosine of angle φ. Thus, the angular orientations of the grating vectors k1, k4, k7, and k10 vary in angle φ a stepwise manner between the contiguous zones Z1, Z4, Z7, and Z10 of a column and the magnitudes of these grating vectors k1, k4, k7, and k10 vary as a function of a constant x-axis displacement of the grating features within the column and the cosine of angle φ. A similar observation can be made among the grating vectors of the zones Z2, Z5, Z8, and Z11 and the zones Z3, Z6, Z9, and Z12 of the other depicted columns.
While the zones of each row include upper and lower boundaries that are all aligned in parallel to a common axis, i.e. the x axis, the zones in each column are aligned along a respective arc. For example, the zones along two columns of the out-coupling diffractive optic of
As will be recognized by those skilled in the grating fabrication arts, the zoned arrangement of the ODO diffraction grating shown in
An alternative approach as shown in
While the zonal arrays can have multiple zones along each row and column, the grating features such as shown in
Conversely, the zonal arrays can be fashioned as shown in
While the zonal arrays have been presented in simplified and symmetric forms for emphasizing manufacturing expedience, other including higher order variations can be superimposed to achieve various performance objectives. These variations known in the art of diffractive optics can include variations in the form or substance of the grating features and their distribution within and between the zones.
For the purpose of providing highly resolved image content, the size and number of stepwise varying zones in the array is set to focus each of the angularly related beams at a virtual unique near focus spot that is sized to significantly limit or avoid overlap with the virtual focus spots of the other angularly related beams in the eyebox. Preferably, each of the focus spots spreads over an area less than the size of about 0.5 pixels. For example, where the field of view (FOV) is 100 degrees and with a display generates 1000 pixels across the FOV, each pixel is separated by 0.1 degrees. Therefore, the angular step, for example, associated with the changing orientation angle φ between zones of adjacent rows is preferably limited to less than 0.05 degrees. The angular step associated with the changing x-axis displacements of the grating features between the zones of adjacent columns is preferably similarly limited.
As depicted for example in
Referring to the schematic view of
The two virtual images that are formed by dual imaging apparatus 200 are located at different focal lengths. An alternate embodiment of the present disclosure can use two zoned ODO gratings to provide two focal lengths, where neither focal length is considered at optical infinity.
The perspective view of
The perspective view of
In-coupling and out-coupling diffractive optics IDO and ODO can be diffraction gratings or formed as volume holograms, or formed from a holographic polymer dispersed liquid crystal, for example. The waveguide substrate S of the image light guide is typically glass or other optical material with sufficient index of refraction for supporting TIR transmission between an in-coupling diffractive optic, distribution gratings, and an out-coupling diffractive optic.
In-coupling diffractive optics IDO, distribution or turning gratings, and out-coupling diffractive optics ODO can have different grating periods appropriate to their functions. After proper surface preparation of a glass substrate blank, the diffraction components can be formed on one or both outer surfaces of the pupil expander using nano-imprinting methods, for example. At least one of the in-couplings and out-couplings can be a surface relief diffraction grating.
In practice, it can be difficult to measure successive angular changes that define each zone Z of the ODO, particularly where high resolution is provided. Boundary portions of the ODO can be compared to indicate changes in the respective angles of the grating patterns.
The invention has been described in detail with particular reference to presently preferred embodiments, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2018/030821 | 5/3/2018 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62507550 | May 2017 | US |