This invention generally relates to electronic displays and more particularly relates to a wearable electronic display that forms a virtual image.
Head-Mounted Displays (HMDs), which include near-eye displays in a form resembling conventional eyeglasses or sunglasses, are being developed for a range of diverse uses, including military, commercial, industrial, fire-fighting, and entertainment applications. For many of these applications, there is particular value in forming a virtual image that can be visually superimposed over the real-world object-scene image that lies in the field of view of the HMD user.
In general, HMD optics must meet a number of basic requirements for viewer acceptance, including the following:
Aspects (i)-(iii) relate to the eyebox, which defines a volume within which the eye of the observer can comfortably view the virtual image. The size of the eyebox depends in part on the length of the path of the light from the image source to where the image is viewed and image source size, and in part on the divergence of the image source and/or the collimation of the light after its emission by the image source. The desirable size of the eyebox depends largely on the quality of viewing experience that is desired from the display and the range of eye positions at which the virtual image is intended to be viewed.
In addition to optical requirements, HMD designs should also address practical factors such as variable facial geometry, acceptable form factor with expectations of reduced size for wearing comfort, weight, and cost, and ease of use.
A goal for most HMD systems is to make the imaging/relay system as compact as possible; however, when using conventional optics, there are basic limits. The output of the optic system should have a pupil that is large enough to fill the pupil of the viewer's eye and also allow for some movement of the eye. In a binocular system there is also the issue of varying intraocular distances among different users and the need for the output pupil of the optical system to allow for this.
A number of near-eye HMD devices use planar waveguides. These devices often employ a series of optical diffraction gratings and total internal reflection (TIR) to laterally translate the exit pupil of a projection system so that the projection system can be located to the side of the viewing path, such as alongside the viewer's head. Optical waveguides also expand the exit pupil in one or two dimensions so that the size of the imaged-light projection system can be reduced. This allows the exit pupil of the projection system to be quite small while enlarging the eyebox and allowing the projection system to be moved out of the viewer's line of site. At the same time, the waveguide can be transparent, so the virtual image can be superimposed over the ambient environment.
With the bulk of the projection optics laterally translated out of the user's view and highly compact, there is still a desire to configure the projection components to a form factor that is more consistent with glasses and thus more acceptable to a broad user population. A number of approaches have been proposed for using a prism or mirror to fold the optical path. However, the net effect has often been awkward placement of projection components, such as having these components further removed from the waveguide, increasing the dimensional requirements of the head-mounted device.
Another difficulty with proposed approaches relates to imaging aspect ratios and device form factors that are conventionally used for projection devices and that have been adapted for use with micro-projector and so-called “pico-projector” devices. The imaging height-to-width aspect ratio for projection can be 9 to 16 (9:16), for example. Projection devices are correspondingly designed with a shorter vertical (height) dimension and a larger horizontal (width) dimension. This makes it awkward to employ a conventional projector design with a waveguide HMD; a more suitable aspect ratio would be achieved by rotating the projector 90 degrees and allowing the projector to fit snugly against the viewer's head, rather than to extend horizontally outward. The usable image area, however, would be reduced by such an arrangement.
There is thus a need for an HMD that incorporates a more compact projector and allows projector rotation and seating of the projector near the side of the viewer's head.
One object of the present disclosure is to advance the art of virtual image presentation using head-mounted devices. Advantageously, embodiments of the present disclosure provide light coupling solutions that are compatible with the general form factor of eyeglasses and allow the use of projector optics that are rotated and fitted against the side of the viewer's head.
These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.
According to an aspect of the present disclosure, there is provided head-mounted virtual image display apparatus comprising:
The optical coupler can comprise a first prism facing the projector and having a first reflective surface reorients the projection axis; and a second prism that is optically coupled to the first prism and has a second reflective surface that further reorients the projection axis. In addition, the optical coupler can further comprise a third prism that is optically coupled to the second prism and has a third reflective surface that yet further reorients the projection axis to an acute angle with respect to the waveguide. An optical stop of the projector can be disposed within the optical coupler.
The planar waveguide is preferably configured to receive the image-bearing light beams through an input aperture along a central input beam axis, and the optical coupler is preferably configured to reorient the projection axis into alignment with the central input beam axis. In addition, the planar waveguide is preferably configured to output the expanded image-bearing beams through the output aperture along a central output beam axis, and the central input beam axis preferably intersects the central output beam axis on a side of the planar waveguide facing the projector.
While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter of the present invention, it is believed that the invention will be better understood from the following description when taken in conjunction with the accompanying drawings, wherein:
The present description is directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with the invention. It is to be understood that elements not specifically shown or described may take various forms well known to those skilled in the art.
Where they are used herein, the terms “first”, “second”, and so on, do not necessarily denote any ordinal, sequential, or priority relation, but are simply used to more clearly distinguish one element or set of elements from another, unless specified otherwise. The terms “top” and “bottom” do not necessarily designate spatial position but provide relative information about a structure.
In the context of the present disclosure, the terms “viewer”, “operator”, “observer”, and “user” are considered to be equivalent and refer to the person who wears the HMD viewing device.
As used herein, the term “energizable” relates to the capability of a device or set of components upon receiving power and, optionally, upon receiving an enabling signal to perform an indicated function.
The term “set”, as used herein, refers to a non-empty set, as the concept of a collection of elements or members of a set is widely understood in elementary mathematics. The term “subset”, unless otherwise explicitly stated, is used herein to refer to a non-empty proper subset, that is, to a subset of the larger set, having one or more members. For a set S, a subset may comprise the complete set S. A “proper subset” of set S, however, is strictly contained in set S and excludes at least one member of set S.
In the context of the present disclosure, the term “oblique” means at an angle that is not an integer multiple of 90 degrees. Two lines, linear structures, or planes, for example, are considered oblique with respect to each other if they diverge from or converge toward each other at an angle that is at least about 5 degrees or more away from parallel, or at least about 5 degrees or more away from orthogonal. An “obtuse angle” is larger than 90° but less than 180°.
The terms “coupled” or “coupler” in the context of optics refers to a connection by which light travels from one optical medium or device to another optical medium or device through an intermediate structure that facilitates the connection.
As an alternative to real image projection, an optical system can produce a virtual image display. In contrast to methods for forming a real image, a virtual image is not formed on a display surface. That is, if a display surface were positioned at the perceived location of a virtual image, no image would be formed on that surface. Virtual image display has a number of inherent advantages for augmented reality display. For example, the apparent size of a virtual image is not limited by the size or location of a display surface. In comparison with systems that project a real image, a more realistic viewing experience can be provided by forming a virtual image that appears to be some distance away. Providing a virtual image also obviates any need to compensate for screen artifacts, as may be necessary when projecting a real image.
A HMD (head-mounted display) 10 is shown in
In a binocular virtual image display apparatus 12, a planar waveguide 20 can be provided for each eye of the viewer 14. In such a binocular system as shown in
Waveguide 20 is formed of glass or other transparent optical material and incorporates two or more embedded optical gratings that cooperate with TIR within the waveguide structure to resize and redirect incident image-bearing beams into and out of the waveguide 20. For example, waveguide 20 has characteristic behavior relative to incident input beam 26 and exiting output beam 28 as shown in
In a symmetry preserving arrangement, when central input beam 26 is oriented at an oblique angle of incidence to plane P, the corresponding central output beam 28 exits at a corresponding oblique angle, as shown in the examples of
In the
Equating the central output beam axis A2 to the center axis CA of the FOV of
As also shown in
The projector 30 is preferably also of a type having an aspect ratio, such as the preferred 9:16 aspect ratio, where the width of the generated image exceeds the height of the generated image. The imbalanced aspect ratio affects corresponding dimensions of the projector 40 and its optics. The HMD can be made more compact by rotating the projector 30 about the projection axis A3 by 90 degrees so that the range of angles of the image-bearing beams encoding the width dimension of the image is oriented normal to the view of
The perspective view of
Reflective surfaces M1, M2, and M3 of the prisms PM1, PM2, and PM3 can be mirrored surfaces, such as dielectric or metalized surfaces. Alternately, where the index of refraction of the prism material is sufficiently high, total internal reflection (TIR) can be used, obviating the need for a reflective coating for folding the optical axis A′. Prisms PM1, PM2, and PM3 can be cemented to each other along their adjoining faces, such as with an index matching adhesive. An anti-reflection coating can be provided along the input and output surfaces of the optical coupler 40.
While the arrangement shown in
The optical coupler 40A of
An exploded view of the optical coupler 40A in
Projector Optics Design
Projectors, using a variety of display technologies, can be found in a form factor that is fairly compact, have a pupil size comparable to the entrance aperture of an optical waveguide, and have the brightness required to provide a reasonably bright image. However, within the projection optics of these projectors there is often a stop (this can be a physical aperture or a lens aperture acting as a stop) within the lens system. This means that the ray bundles for each field point in the virtual image begin to diverge within the projection optics before or at the last outermost lens surface of the projector. The ray bundles originating from the corners of the image generator are often clipped (vignetted) as they diverge from the projection optics. The further removed from the waveguide, the more divergence there is in the ray bundles. With this problem in mind, an embodiment of the present disclosure provides further advantages for HMD imaging with improvements to projector optics design.
In embodiments of the present disclosure, the stop can be positioned outside the projector, beyond the last optical surface of the projector that emits the projected image-bearing light beam. The stop may be viewed as an exit pupil rather than a physical stop. Embodiments shown herein position a mirrored surface at or near the remote pupil to form a stop. For virtual image display apparatus 12 in HMD 10, this design feature constrains the beam width of light that is delivered to optical coupler 40A and enables coupler 40A to be more compact. With reference to the perspective view of
According to an embodiment of the present disclosure, the virtual image display apparatus 12 uses an optical coupler 40A to provide the stop for projected light from projector 30. In one example of the virtual image display apparatus 12, optical coupler 40A provides a stop at an internal reflective surface and has an angular arrangement that improves upon the orthogonal rotation configuration shown in
The optical coupler 40A is therefore arranged having regard for both the spread of the angularly related image-bearing beams and the location of a stop. According to an embodiment, mirror M2 on prism PM2 provides the stop for the projection optics. The schematic diagram of
More generally, the optical coupler 40A can have a stop 54 associated with any of the surfaces of prisms PM1, PM2, and PM3, including the input surface at PM1, the output surface at PM3, or any of the intermediate reflective surfaces M1, M2, or M3. For at least one of the reflective surfaces M1, M2, or M3, the area defined by projection of the reflective fold surface onto a plane that is normal to the redirected projection axis A3′ is less than the surface area of the input surface and less than the surface area of the output surface. In particular, this relationship holds where the reflective fold surface serves as the stop, as with the surface M2 in the examples
In general, higher index glass (n>1.6) is advantageous for reducing the optical path dimensions with coupler 40. As noted previously, the virtual image display apparatus of the present disclosure can be used in a monocular or binocular optical system.
The invention has been described in detail with particular reference to presently preferred embodiments, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2017/040542 | 7/1/2017 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2018/009467 | 1/11/2018 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5191485 | Kahle | Mar 1993 | A |
7457040 | Amitai | Nov 2008 | B2 |
8827463 | Morikuni | Sep 2014 | B2 |
9348143 | Gao | May 2016 | B2 |
20050002001 | Yoon | Jan 2005 | A1 |
20060238718 | Erickson | Oct 2006 | A1 |
20130222896 | Komatsu | Aug 2013 | A1 |
20150212325 | Choi | Jul 2015 | A1 |
20160195723 | Murray | Jul 2016 | A1 |
20180356637 | Hu | Dec 2018 | A1 |
Number | Date | Country |
---|---|---|
6-130353 | May 1994 | JP |
Entry |
---|
International Search Report for International Application No. PCT/US2017/040542 dated Sep. 14, 2017. |
International Written Opinion for International Application No. PCT/US2017/040542 dated Sep. 14, 2017. |
Number | Date | Country | |
---|---|---|---|
20190212563 A1 | Jul 2019 | US |
Number | Date | Country | |
---|---|---|---|
62358432 | Jul 2016 | US |