Multiple-eye, single-display, ultrawide-field-of-view optical see-through augmented reality system

Abstract

An optical system that includes a lens element and a lens element holder. The optical system also includes a display device holder that is configured to hold a display device having a single light-emitting panel. The lens element includes a right-eye reflective surface and a left-eye reflective surface. The right-eye reflective surface includes a first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a first portion of the light-emitting panel toward a predetermined right-eye location, and the left-eye reflective surface includes a second plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a second portion of the light-emitting panel toward a predetermined left-eye location.

Description

TECHNICAL FIELD

The embodiments relate generally to optical systems and, in particular, to a single-display optical see-through augmented reality system.

BACKGROUND

See-through augmented reality systems that provide different imagery to two eyes require two display systems. Using two display systems increases costs and complexity, requires substantial alignment, and reduces reliability.

SUMMARY

The embodiments relate to an augmented reality system that utilizes a single-display system to provide different imagery to two different eyes of a user.

In one embodiment, an optical system is provided. The optical system includes a lens element and a lens element holder that is configured to position the lens element with respect to eyes of the user. The optical system also includes a display device holder that is configured to hold a display device having a single light-emitting panel. The lens element includes a right-eye reflective surface and a left-eye reflective surface. The right-eye reflective surface includes a first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a first portion of the light-emitting panel toward a predetermined right-eye location, and the left-eye reflective surface includes a second plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a second portion of the light-emitting panel toward a predetermined left-eye location. The display device holder is configured to maintain the light-emitting panel in a predetermined position and orientation with respect to the lens element to reflect light emitted from the light-emitting panel from the right-eye reflective surface toward the predetermined right-eye location and the left-eye reflective surface toward the predetermined left-eye location.

In one embodiment, the optical system further includes a support coupled to the lens element holder and the display device holder. The support is configured to be mounted on a helmet.

In one embodiment, the lens element comprises a single lens element. In one embodiment, the right-eye reflective surface and the left-eye reflective surface are each non-symmetrical concave surfaces and join at a center region of the single lens element. In another embodiment, the lens element comprises a first lens element and a second lens element that is separate from the first lens element, and the first lens element comprises the right-eye reflective surface, and the second lens element comprises the left-eye reflective surface.

In one embodiment, the light-emitting panel is configured to concurrently provide left-eye imagery from the first portion of the light-emitting panel and right-eye imagery from the second portion of the light-emitting panel.

In one embodiment, the first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of the first portion of the light-emitting panel is further oriented to reflect light received from the second portion of the light-emitting panel in a direction other than toward the right eye of the user.

In one embodiment, the display device holder is configured to receive a portable display device. In one embodiment, the display device holder is configured to maintain the light-emitting panel above and in front of the eyes of the user.

In one embodiment, the optical system further comprises a lens element adjustment mechanism that is configured to alter a distance of the lens element from the light-emitting panel.

In one embodiment, the lens element may be partially transparent and partially reflective, such as is implemented by a beam-splitter. The lens element may thus provide a see-through augmented reality mode, wherein eyes of a user can perceive real-world imagery through the lens element in conjunction with imagery reflected from the interior reflective surfaces of the lens element. The lens element may also provide a completely reflective mode, wherein eyes of the user receive only imagery reflected from the interior reflective surfaces of the lens element, which facilitates a completely immersive virtual reality experience.

Those skilled in the art will appreciate the scope of the disclosure and realize additional aspects thereof after reading the following detailed description of the embodiments in association with the accompanying drawing figures.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawing figures incorporated in and forming a part of this specification illustrate several aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a block diagram illustrating a plan view of an optical system according to one embodiment;

FIG. 2 is a block diagram illustrating a plan view of an optical system according to another embodiment;

FIG. 3 is a perspective view illustrating the optical system according to one embodiment;

FIG. 4 is a perspective view illustrating an optical system according to another embodiment; and

FIG. 5 is a diagram illustrating a side view of the optical system according to one embodiment.

DETAILED DESCRIPTION

The embodiments set forth below represent the information to enable those skilled in the art to practice the embodiments and illustrate the best mode of practicing the embodiments. Upon reading the following description in light of the accompanying drawing figures, those skilled in the art will understand the concepts of the disclosure and will recognize applications of these concepts not particularly addressed herein. It should be understood that these concepts and applications fall within the scope of the disclosure and the accompanying claims.

The use herein of ordinals in conjunction with an element is solely for distinguishing what might otherwise be similar or identical labels, such as “first lens element” and “second lens element,” and does not imply a priority, a type, an importance, or other attribute, unless otherwise stated herein. The term “about” used herein in conjunction with a numeric value means any value that is within a range of ten percent greater than or ten percent less than the numeric value.

FIG. 1 is a block diagram illustrating a plan view of an optical system 10 according to one embodiment. The optical system 10 includes a lens element 12, which has a right-eye reflective surface 14 and a left-eye reflective surface 16. A display device 18 has a single light-emitting panel 20 (hereinafter “light-emitting panel 20”). The phrase “single light-emitting panel” refers to one light-emitting panel that utilizes a single set of drivers and has a single set of driving electronics, such as, for example, is found in a typical smartphone.

The right-eye reflective surface 14 and the left-eye reflective surface 16 are non-rotationally symmetric surfaces, and, in some embodiments, concave surfaces, that are “mapped” to the light-emitting panel 20. In particular, the right-eye reflective surface 14 comprises a first plurality of different surface elements oriented to reflect and collimate light from corresponding regions of a first portion 22 of the light-emitting panel 20 toward a predetermined right-eye location 24. Similarly, the left-eye reflective surface 16 comprises a second plurality of different surface elements oriented to reflect and collimate light from corresponding regions of a second portion 26 of the light-emitting panel 20 toward a predetermined left-eye location 28. Thus, the right-eye reflective surface 14 comprises a surface that comprises multiple, such as thousands, of different surface elements that are mapped to corresponding regions of the first portion 22 of the light-emitting panel 20. Similarly, the left-eye reflective surface 16 comprises a surface that comprises multiple, such as thousands, of different surface elements that are mapped to corresponding regions of the second portion 26 of the light-emitting panel 20.

Such mapping may be implemented, for example, as disclosed in U.S. Pat. No. 8,781,794 (hereinafter the '794 Patent), the contents of which are incorporated by reference herein. As disclosed in the '794 Patent, non-symmetrical lens surfaces, such as the right-eye reflective surface 14 can be engineered to, among other advantages, increase a field of view (FOV) 30 of a user, such that imagery presented by the light-emitting panel 20 can be reflected from a desired surface element or surface elements of the right-eye reflective surface 14 toward the predetermined right-eye location 24. Such surface elements may overlap one another. In some embodiments, the optical system 10 can provide a 180-degree FOV 30. Such an engineered surface can also effectively shift imagery presented by the first portion 22 toward the predetermined right-eye location 24 in a manner that prevents skewing or other aberrations to a right eye 32.

The light-emitting panel 20 is configured to concurrently provide right-eye imagery 34 from the first portion 22 of the light-emitting panel 20 and left-eye imagery 36 from the second portion 26 of the light-emitting panel 20. The ability for a single light-emitting panel to provide two sets of imagery can be implemented in a number of different ways, including, by way of non-limiting example, via Pinnacle Studio software, available from Corel Corporation, 1600 Carling Avenue, Ottawa, Ontario, K1Z 8R7, Canada. The use of two sets of imagery facilitates, for example, 3D imagery being presented by the first portion 22 and the second portion 26. The right-eye reflective surface 14 reflects the 3D imagery presented by the first portion 22 to the right eye 32 of the user, and the left-eye reflective surface 16 reflects the 3D imagery presented by the second portion 26 to a left eye 38 of the user.

Note that a center 40 of the light-emitting panel 20 is preferably aligned with a center region 42 of the single lens element 12, wherein the right-eye reflective surface 14 and the left-eye reflective surface 16 join. Due to the engineered right-eye reflective surface 14, a center 44 of the first portion 22 need not align with a center of the right-eye reflective surface 14, nor with the right eye 32. Similarly, due to the engineered left-eye reflective surface 16, a center 46 of the second portion 26 need not align with a center of the left-eye reflective surface 16, nor with the left eye 38. Similarly, a first distance 48 between a center point of the first portion 22 of the light-emitting panel 20 and a center point of the second portion 26 of the light-emitting panel 20 may be less than a second distance 50 between the predetermined right-eye location 24 and the predetermined left-eye location 28.

As an example of the effect of the engineered left-eye reflective surface 16, light 52 may be emitted from a region of the second portion 26 of the light-emitting panel 20. The light 52 is reflected from a surface element located on the left-eye reflective surface 16 in a direction 54 toward the predetermined left-eye location 28. To the left eye 38, the imagery carried in the light 52 may be perceived to be at a location 56. It will be appreciated that the light 52, although illustrated as striking the particular surface element located on the left-eye reflective surface 16, in fact travels in waves and may strike multiple other surface elements on the left-eye reflective surface 16, and indeed may strike all other surface elements on the left-eye reflective surface 16. However, since such other surface elements are oriented to reflect light received from different regions of the second portion 26, the light 52 will be reflected in a direction other than the predetermined left-eye location 28. For example, light 58 emitted from a region of the first portion 22 of the light-emitting panel 20 may strike a surface element of the left-eye reflective surface 16, and is thus reflected in a direction 60 away from the predetermined left-eye location 28.

In some embodiments, the lens element 12 is partially transparent and partially reflective and comprises, for example, a beam splitter. In some embodiments, the right-eye reflective surface 14 and the left-eye reflective surface 16 may be coated with a material, such as chromium, aluminum, or the like, to provide such partially reflective properties. In such embodiments, the optical system 10 may operate in an augmented reality mode, wherein the eyes 32, 38 can view a mixture of real-world environment through the lens element 12 and imagery from the light-emitting panel 20 via one or both of the left-eye reflective surface 16 and the right-eye reflective surface 14. The lens element 12 may also provide a completely reflective mode, wherein the eyes 32, 38 receive only imagery reflected from the reflective surfaces 14, 16, which facilitates a completely immersive virtual reality experience.

In one embodiment, exterior surfaces 61 of the lens element 12 may be coated with an anti-reflective (AR) coating. The use of an AR coating may substantially reduce double-imaging that may occur in certain circumstances, wherein some light emitted by the light-emitting panel 20 passes through the interior reflective surfaces 14, 16 and is reflected back by the exterior surfaces 61 toward the eyes 32, 38. The use of an AR coating on the exterior surfaces 61 can cause some, or all, of such light to pass through the lens element 12 rather than reflect back toward the eyes 32, 38. The AR coating may comprise any suitable coating, such as, by way of non-limiting example, a dielectric such as silicon dioxide, and the like.

FIG. 2 is a block diagram illustrating a plan view of an optical system 10-1 according to another embodiment. The optical system 10-1 operates substantially similarly to the optical system 10, except in this embodiment a first lens element 12-1A comprises the right-eye reflective surface 14, and a second lens element 12-1B comprises the left-eye reflective surface 16. The first lens element 12-1A and the second lens element 12-1B may be moved different distances from one another to accommodate different distances 50 between the eyes 32, 38 of different users. This interpupillary distance adjustment can also be facilitated by having different sized lenses computed and constructed for users having different sized heads, and may also be adjusted by shifting the imagery to the left and right in opposite eyes. The imagery may be displaced closer to the nose for users having eyes closer together, or displaced away from the nose for users having wider-spaced eyes.

FIG. 3 is a perspective view illustrating the optical system 10, according to one embodiment. The optical system 10 may include a lens element holder 62 configured to position the lens element 12 with respect to eyes of the user. The optical system 10 may also include a display device holder 64 configured to hold the display device 18 (FIG. 1) having the light-emitting panel 20. The display device holder 64 is configured to maintain the light-emitting panel 20 in a predetermined position and orientation with respect to the lens element 12 to reflect light emitted from the light-emitting panel 20 from the right-eye reflective surface 14 toward the predetermined right-eye location 24 and from the left-eye reflective surface 16 toward the predetermined left-eye location 28. The display device holder 64 may also be configured to maintain the light-emitting panel 20 above and in front of the eyes of the user. The optical system 10 may also include a support 66 that is coupled to the lens element holder 62 and the display device holder 64, which is configured to be mounted on a helmet 68.

The optical system 10 may also include a lens element adjustment mechanism 70 that is configured to alter a distance of the lens element 12 from the light-emitting panel 20, and/or the eyes of the user, for focusing and alignment purposes.

FIG. 4 is a perspective view illustrating an optical system 10-2, according to one embodiment. The optical system 10-2 is substantially similar to the optical system 10-1, except in this embodiment a display device holder 64-1 is configured to receive a portable display device 18-1, such as a smartphone or computing tablet.

FIG. 5 is a diagram illustrating a side view of the optical system 10, according to one embodiment. The second portion 26 of the light-emitting panel 20 emits light 74-1-74-N from a plurality of different regions 76-1-76-N (generally, regions 76) of the second portion 26. A region 76 may comprise, for example, a pixel, or a group of pixels. Corresponding surface elements 78-1-78-N (generally, surface elements 78) on the left-eye reflective surface 16 (FIG. 1) have each been mapped to the regions 76. A surface element 78 may comprise, for example, a particular area size on the left-eye reflective surface 16.

Each surface element 78 both collimates and reflects the corresponding light 74 toward the predetermined left-eye location 28. While for purposes of illustration only five regions 76 and five surface elements 78 are depicted, it will be appreciated that depending on the imagery, the size of the regions 76, and the size of the surface elements 78, light 74 may be emitted from tens or hundreds of thousands of different regions 76 and collimated and reflected by corresponding tens or hundreds of thousands of different surface elements 78 toward the predetermined left-eye location 28.

While the precise parameters of the optical system 10 may differ depending on the application, or the second distance 50 between the predetermined right- and left-eye locations 24, 28 (FIG. 1), in one embodiment, the display device holder 64 (FIG. 3) maintains the light-emitting panel 20 at an approximately 48-degree angle 80 with respect to horizontal. A distance 82 between a base of the light-emitting panel 20 and the bottom of the lens element 12 is about 62.8 millimeters (mm). A distance 84 between the base of the lens element 12 and a vertical line extending from the base of the light-emitting panel 20 is about 39.8 mm.

Those skilled in the art will recognize improvements and modifications to the preferred embodiments of the disclosure. All such improvements and modifications are considered within the scope of the concepts disclosed herein and the claims that follow.

Claims

1. An optical system comprising: a lens element;a lens element holder configured to position the lens element with respect to eyes of a user;a display device having a single light-emitting panel;a display device holder configured to hold the display device, the light-emitting panel configured to concurrently provide left-eye imagery from a first portion of the light-emitting panel and right-eye imagery from a second portion of the light-emitting panel;wherein the lens element comprises a right-eye reflective surface and a left-eye reflective surface, the right-eye reflective surface comprising a first plurality of different surface elements oriented to receive light directly from the first portion of the light-emitting panel with no intervening elements between the first portion of the light-emitting panel and the right-eye reflective surface, and to reflect and collimate light from corresponding different regions of the first portion of the light-emitting panel directly to a predetermined right-eye location and the left-eye reflective surface comprising a second plurality of different surface elements oriented to receive light directly from the second portion of the light-emitting panel with no intervening elements between the second portion of the light-emitting panel and the left-eye reflective surface, and to reflect and collimate light from corresponding different regions of the second portion of the light-emitting panel directly to a predetermined left-eye location;wherein a center of the first portion of the light-emitting panel is not aligned with a center of the right-eye reflective surface and neither the center of the first portion of the light-emitting panel nor the center of the right-eye reflective surface are aligned with the predetermined right-eye location, and the first plurality of different surface elements of the right-eye reflective surface is configured to correct for image skew of an image depicted by the first portion of the light-emitting panel and reflected toward the predetermined right-eye location; andwherein the second plurality of different surface elements of the left-eye reflective surface is configured to correct for image skew of an image depicted by the second portion of the light-emitting panel and reflected toward the predetermined left-eye location;wherein a first distance between a center point of the first portion of the light-emitting panel and a center point of the second portion of the light-emitting panel is different from a second distance between the predetermined right-eye location and the predetermined left-eye location.

2. The optical system of claim 1, wherein the display device holder is configured to maintain the light-emitting panel in a predetermined position and orientation with respect to the lens element to reflect light emitted from the light-emitting panel from the right-eye reflective surface toward the predetermined right-eye location and the left-eye reflective surface toward the predetermined left-eye location.

3. The optical system of claim 1, wherein the optical system further comprises a support coupled to the lens element holder and the display device holder, the support configured to be mounted on a helmet.

4. The optical system of claim 3, further comprising the helmet, wherein the support is mounted on the helmet.

5. The optical system of claim 1, wherein the lens element comprises a single lens element.

6. The optical system of claim 1, wherein the right-eye reflective surface and the left-eye reflective surface are each non-symmetrical concave surfaces and join at a center region of the lens element.

7. The optical system of claim 1, wherein the lens element comprises a first lens element and a second lens element that is separate from the first lens element, the first lens element comprising the right-eye reflective surface and the second lens element comprising the left-eye reflective surface.

8. The optical system of claim 1, wherein the second distance is greater than the first distance.

9. The optical system of claim 1, wherein the first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of the first portion of the light-emitting panel is further oriented to reflect light received from the second portion of the light-emitting panel in a direction other than toward the right eye of the user.

10. The optical system of claim 1, wherein the display device holder is configured to receive a portable display device.

11. The optical system of claim 1, wherein the display device holder is configured to maintain the light-emitting panel above and in front of the eyes of the user.

12. The optical system of claim 1, wherein the optical system further comprises a support coupled to the lens element holder and the display device holder, and further comprising a lens element adjustment mechanism that is configured to, in response to user manipulation, alter a distance of the lens element from the light-emitting panel and the eyes of the user.

13. The optical system of claim 1, wherein the lens element is a partially transparent and partially reflective lens element.

14. The optical system of claim 1, wherein the lens element comprises a beam splitter.

15. The optical system of claim 1, wherein the lens element comprises a right-eye exterior surface and a left-eye exterior surface, and further comprising an anti-reflective coating disposed on the right-eye exterior surface and the left-eye exterior surface.

16. An optical system consisting of: a lens element;a lens element holder configured to position the lens element with respect to eyes of a user;a display device holder configured to hold a display device having a single light-emitting panel;a support coupled to the lens element holder and the display device holder, and further comprising a lens element adjustment mechanism that is configured to, in response to user manipulation, alter a distance of the lens element from the light-emitting panel and the eyes of the user; andwherein the lens element comprises a right-eye reflective surface and a left-eye reflective surface, the right-eye reflective surface comprising a first plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a first portion of the light-emitting panel directly to a predetermined right-eye location and the left-eye reflective surface comprising a second plurality of different surface elements oriented to reflect and collimate light from corresponding different regions of a second portion of the light-emitting panel directly to a predetermined left-eye location.