The present invention has application within the field of compact wearable displays, and in particular, head-mounted display (HMD) systems used for applications such as virtual reality and augmented reality.
A head-mounted display (HMD) system is a type of wearable device with increasing popularity within the consumer electronics industry. HMDs, along with similar devices such as helmet-mounted displays, smart glasses, and virtual reality headsets, allow users to wear a display device such that the hardware remains fixed to their heads regardless of the user's movement.
When combined with environmental sensors such as cameras, accelerometers, gyroscopes, compasses, and light meters, HMDs can provide users with experiences in virtual reality and augmented reality. Virtual reality (VR) allows a user to be completely submerged into a virtual world where everything the user sees comes from the display device. Devices that provide augmented reality (AR) allow users to optically see the environment, and images generated by the display device are added to the scene and may blend in with the environment. Accordingly, traditional VR and AR technology involves a display that is mounted in front of the user's head with a lens configuration that determines the virtual image position and field.
A basic layout of typical commercial VR or AR systems (both involving and not involving use of a smartphone for a display) includes a display device and a lens structure that images the display light into the far field to enable comfortable viewing. To ensure sufficient magnification, with wide field of view and to have a virtual image at a far enough distance from the eye, the size of this arrangement is restricted. In addition, the display is a relatively far distance from the eyes, meaning that the device must be strapped to the head to not fall off. Furthermore, the weight of the device is far forward when worn, meaning that long term viewing could become tiresome on the face and neck due to the torque generated about the head by the weight of the device. Lens elements used in such systems may be configured as a normal curved surface lens of known type, or a structured Fresnel lens with angled features of known type, or other known lens arrangements involving one or more lenses.
One of the primary elements of HMDs is the display module mounted onto the head. However, since the unaided human eye cannot accommodate (that is, change optical power to provide a focused image) for images closer than a certain distance from the eye, eyepiece lenses are required to re-image the display module such that the display image appears to be at a comfortable viewing distance from the user. Such optical configuration requires substantial space between the eyepiece and the display module. Furthermore, complex lenses are needed if the HMD needs to display images with high quality and a wide field of view (FOV). The result of these requirements in conventional systems is a heavy and bulky headset that is uncomfortable to wear for any length of time, and the size is limited by basic optics to achieve the correct magnification and the virtual image distance.
A number of known methods have been used to attempt to achieve image panel-based, light-weight HMDs without the need for bulky eyepiece lenses. “Light-field displays” (also known as integral imaging) provides for one of the thinnest types of HMD systems, but along with other magnifier-based HMDs, light-field displays suffer from a fundamental limit whereby the display's resolution is heavily traded off for a smaller hardware form factor.
One known method for reducing the size and weight of an HMD system includes the use of a polarization reflection approach to reduce size. Such configurations, however, suffer from ghost image formation. Another method uses multiple small lenses with overlapping images that modify the magnification required. However, such an arrangement has a lower apparent resolution and can suffer from visibility of the image overlap. Applicant's commonly owned Application GB 1621621.0, filed Dec. 19, 2016, describes an alternative overlap method with two displays and a folded W-shaped mirror arrangement. The field of view in this case is defined by the maximum aperture and path length.
There is a need in the art, therefore, for an enhanced HMD system that is compact and comfortable to wear, without sacrificing image quality as needed for optimal VR and AR applications. The present invention provides for HMD configurations that are light weight and comfortable for viewing, with high image quality and a wide field of view (FOV). Configurations of an HMD system described in this disclosure solve problems of existing HMD systems by folding up the optical path of the HMDs using segmented images from multiple image panels, such that the optical distance from the image panels to eye can be increased without compromising on the HMD system's thickness.
The HMD system of the present disclosure improves the compactness of the system while using a folded optical arrangement. Configurations of the HMD system employ a combination of image panels that are on the eye or viewing side of the eyepiece lenses, close to the head, and also image panels that are on the image or non-viewing side of the eyepiece lenses. An advantage of such arrangement is that the HMD system protrudes from the face for a distance less than previous designs, and therefore can have a significant reduced weight, is much closer to the face, and hence would produce less fatigue while wearing. The design also means near-eye optics can be used to give a large FOV, but also allows space for the user's nose to provide a more comfortable configuration to wear.
In exemplary embodiments, an HMD system includes four image panels, including first and second image panels of equal dimensions, and third and fourth image panels that may be combined of equal dimensions to one of the first/second image panels. The first image panel and the second image panel are respectively used to present an image in an unshared fashion respectively to each of the left eye and the right eye. The HMD system further includes the third image panel that presents an image to the right eye, and the fourth image panel that presents an image to the left eye. With such configuration, each of the left and right eye can see two image panels, including one large image panel of either the first or second image panel, and one smaller image panel of either the third or fourth image panel. Further with such configuration, images from the various image panels are combined such that the images optimally fill the typical human visual field.
The described configuration has an advantage in that there is as little unseen area on the image panels as practicable, which minimizes the form factor of the HMD system. In addition, with such configuration the optical arrangement allows plenty of room for the user's nose. Furthermore, the weight is concentrated closer to the user's head, so the torque on the head and neck is reduced, and the conventional requirement for a strap to wear the system becomes less necessary. The result is an enhanced HMD system that is compact and comfortable to wear, without sacrificing image quality as needed for optimal VR and AR applications.
An aspect of the invention, therefore, is a head-mounted display (HMD) system including two main image panels and two additional image panels, wherein the image panels are positioned to emit image light that optimally fills a typical visual field. In exemplary embodiments, a head-mounted display (HMD) system includes an optical arrangement; a first image panel, wherein the optical arrangement directs image light from the first image panel along a first optical pathway; a second image panel, wherein the optical arrangement directs image light from the second image panel along a second optical pathway different from the first optical pathway; and a third image panel and a fourth image panel, wherein the third and fourth image panels are spaced apart from each other and the optical arrangement directs light from the third image panel and the fourth image panel along different optical pathways. The optical arrangement is configured such that light from the first image panel and the third image panel are emitted from the HMD system in a combined fashion in a first eye direction, and light from the second image panel and the fourth image panel are emitted from the HMD system in a combined fashion in a second eye direction different from the first eye direction.
In exemplary embodiments, the first image panel and the third image panel are positioned on opposite sides of an ocular axis, and the second image panel and the fourth image panel are positioned on opposite sides of the ocular axis.
The optical arrangement may include first and second lens components that may extend perpendicularly or at an acute angle off of perpendicular relative to the ocular axis respectively between the first and third image panels, and the second and fourth image panels. In an orientation of use, the first and second image panels may be arranged with the long sides horizontal or at an acute angle relative to horizontal and short sides vertical or at an acute angle relative to vertical, and the third and fourth image panels are also arranged with the long sides horizontal or an acute angle relative to horizontal and short sides vertical or at an acute angle relative to vertical.
To the accomplishment of the foregoing and related ends, the invention, then, comprises the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative embodiments of the invention. These embodiments are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Other objects, advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
Embodiments of the present invention will now be described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. It will be understood that the figures are not necessarily to scale.
With such configuration, each of the left and right eye can see two image panels, including one large image panel of either the first or second image panel, and one smaller image panel of either the third or fourth image panel. Further with such configuration, images from the various image panels are combined such that the images optimally fill the typical human visual field. The image display panels may be electronically controlled with suitable electronics incorporated into the HMD system in any suitable manner as is known in the art, so as to emit image light corresponding to the desired images from each image panel. Accordingly, for simplicity of illustration the control electronics is omitted from the figures.
In configurations of the HMD system 10, the first and second image panels 12 and 14 are located on a viewing or eye side of the HMD system, close to the head. The third and fourth image panels 32 and 34 are located on a non-viewing or imaging side of the HMD system. An advantage of such arrangement is that the HMD system protrudes from the face for a distance less than previous designs, and therefore can have a significant reduced weight. The system overall is positioned much closer to the face as compared to conventional configurations, and hence produces less torque relative to the head thereby reducing fatigue while wearing. The design also means near-eye optics can be used to give a large FOV, but also allows space for the user's nose to provide a more comfortable configuration to wear.
An aspect of the invention, therefore, is a head-mounted display (HMD) system including two main image panels and two additional image panels, wherein the image panels are positioned to emit image light that optimally fills a typical visual field. In exemplary embodiments, a head-mounted display (HMD) system includes an optical arrangement; a first image panel, wherein the optical arrangement directs image light from the first image panel along a first optical pathway; a second image panel, wherein the optical arrangement directs image light from the second image panel along a second optical pathway different from the first optical pathway; and a third image panel and a fourth image panel, wherein the third and fourth image panels are spaced apart from each other and the optical arrangement directs light from the third image panel and the fourth image panel along different optical pathways. The optical arrangement is configured such that light from the first image panel and the third image panel are emitted from the HMD system in a combined fashion in a first eye direction, and light from the second image panel and the fourth image panel are emitted from the HMD system in a combined fashion in a second eye direction different from the first eye direction.
In exemplary embodiments the optical arrangement includes a plurality of mirror components and a plurality of lens components, wherein the plurality of mirror components are configured to direct image light from the first, second, third, and fourth image panels along respective optical pathways to the plurality of lens components. Referring to
Similarly, as associated with the second image panel 14, the HMD system 10 further includes a second mirror assembly 26 that directs image light from the second image panel 14 along a second optical pathway different from the first optical pathway, to a second lens component 28 and ultimately to the left eye 18. Similarly to minimize the size or footprint of the HMD system, the second mirror assembly also may be configured with a plurality of mirror segments in a “folded” or wedge-shaped arrangement, whereby the optical path of light is increased while maintaining a minimal size. With such configuration, light emitted from the second image panel 14 is directed by the mirror segments of the second mirror assembly 26 only through the second lens component 28, and thus only to one (the left) eye.
As associated with the third image panel 32 and the fourth image panel 34, the HMD system 10 further includes respectively a third mirror assembly 36 and fourth mirror assembly 38 that direct image light from such image panels as follows. Light emitted from the third mage panel portion 32 is directed by the third mirror assembly 36 to one (e.g., the right) eye 16, and image light emitted from the fourth image portion 34 is directed by the fourth mirror assembly 38 to the other (e.g., the left) eye 18 along different optical pathways.
The third and fourth mirror assemblies 36 and 38 also are configured as a plurality of mirror segments that are arranged to provide a compact and easily worn configuration. For particular mirror segments, the third mirror assembly 36 includes a first nose segment adjacent to the user's nose 44 when worn, and a first external segment opposite from the first nose segment. Similarly, the fourth mirror assembly 38 includes a second nose segment adjacent to the user's nose 44 when worn, and a second external segment opposite from the second nose segment. The nose segments are arranged to accommodate the user's nose 44 when the HMD system is worn, with the external segments permitting a controlled directing of the image light in a compact arrangement. To accommodate the different image panels 32 and 34, the first and second nose segments are spaced apart from each other, and the first and second external segments are parallel to respective nose segments.
As referenced above, in the example of
In the particular examples of
Using four image panels configured as described provides an efficient and cost-effective way of imaging onto the human field of view. Light emitted from the third image panel 32 is combined with light emitted from first image panel 12; and light emitted from the fourth image panel 34 is combined with light emitted from second image panel 14. The disclosed configuration of an HMD system has advantages over conventional configurations. The use of a four-image-panel configuration, in which image light emitted from pairs of image panels is combined for each eye, has an advantage in that there is as little unseen area on the image panels as is practicable, which minimizes the form factor of the HMD system. In addition, with such configuration the optical arrangement allows plenty of room for the user's nose to provide a more comfortable fit for wearing the HMD system. Furthermore, the weight of the HMD system is concentrated closer to the user's head as compared to conventional configurations, so the torque on the head and neck is reduced, and the conventional requirement for a strap to wear the system becomes less necessary. The result is an enhanced HMD system that is compact and comfortable to wear, without sacrificing image quality as needed for optimal VR and AR applications.
The example configuration of
In exemplary embodiments, therefore, the optical arrangement further comprises a polarizer located on each of the lens components, and a quarter wave plate located respectively on a mirror component associated with each of the image panels. Referring to the example of
As referenced above, the example configuration of
Alternative configurations may be employed to minimize the generation of ghost images. For example, the optical arrangement may include a plurality of light-directing components that are configured to ensure that only light emitted along certain desired optical pathways can pass through the lens components. For example,
As another example of using a light-directing component,
In example embodiments as depicted in
The second refractive material 94, having a refractive index denoted rc, is located in central parts of the HMD system 90 associated with the third and fourth image panels 32 and 34. In other words, light emitted from the first and second image panels 12 and 14 passes through the first refractive material 92, and light emitted from the third and fourth image panels 32 and 34 passes through the second refractive material 94. As referenced above, the refractive indices of the first refractive material and the second refractive material, rp and rc, may be different. For example, rP may be air having a refractive index of 1.0, and rC may be PMMA having a refractive index of 1.5. The lens components may be formed integral with the refractive materials, i.e., the lens components may be a curved shaping of a respective refractive material, or the lens components may be separate elements bonded to the respective refractive material.
In another exemplary embodiment, secondary corrective lenses comparably as in the embodiment of
An aspect of the invention, therefore, is a head-mounted display (HMD) system including two main image panels and two additional panels, wherein the image panels are positioned to emit image light that optimally fills a typical visual field. In exemplary embodiments, a head-mounted display (HMD) system includes an optical arrangement; a first image panel, wherein the optical arrangement directs image light from the first image panel along a first optical pathway; a second image panel, wherein the optical arrangement directs image light from the second image panel along a second optical pathway different from the first optical pathway; and a third image panel and a fourth image panel, wherein the third and fourth image panels are spaced apart from each other and the optical arrangement directs light from the third image panel and the fourth image panel along different optical pathways. The optical arrangement is configured such that light from the first image panel and the third image panel are emitted from the HMD system in a combined fashion in a first eye direction, and light from the second image panel and the fourth image panel are emitted from the HMD system in a combined fashion in a second eye direction different from the first eye direction. The HMD system may include one or more of the following features, either individually or in combination.
In an exemplary embodiment of the HMD system, the first and second image panels are located on a viewing side of the HMD system, and the third and fourth image panels are located on a non-viewing side of the HMD system.
In an exemplary embodiment of the HMD system, the first image panel and the second image panel are rectangular image panels of equal dimensions, and combined dimensions of the third and fourth image panels are equal to the equal dimensions of the first and second image panels.
In an exemplary embodiment of the HMD system, the third image panel and the fourth image panel are of equal dimensions.
In an exemplary embodiment of the HMD system, the first image panel and the third image panel are positioned on opposite sides of an ocular axis, and the second image panel and the fourth image panel are positioned on opposite sides of the ocular axis.
In an exemplary embodiment of the HMD system, the optical arrangement includes first and second lens components that extend perpendicularly relative to the ocular axis respectively between the first and third image panels and the second and fourth image panels.
In an exemplary embodiment of the HMD system, in an orientation of use, the first and second image panels are arranged with long sides horizontal and short sides vertical, and the third and fourth image panels are also arranged with long sides horizontal and short sides vertical.
In an exemplary embodiment of the HMD system, the optical arrangement includes first and second lens components that extend an acute angle off of perpendicular relative to the ocular axis respectively between the first and third image panels and the second and fourth image panels.
In an exemplary embodiment of the HMD system, in an orientation of use, the first and second image panels are arranged the long sides at an acute angle relative to horizontal and short sides at an acute angle relative to vertical, and the third and fourth image panels are also arranged with long sides at an acute angle relative to horizontal and short sides at an acute angle relative to vertical.
In an exemplary embodiment of the HMD system, the optical arrangement comprises a plurality of mirror components and a plurality of lens components, wherein the plurality of mirror components are configured to direct image light from the first, second, third, and fourth image panels along respective optical pathways to the plurality of lens components.
In an exemplary embodiment of the HMD system, the optical arrangement comprises: a first mirror assembly that directs image light from the first image panel to a first lens component; a second mirror assembly that directs image light from the second image panel to a second lens component; a third mirror assembly that directs image light from the third image panel to the first lens component; and a fourth mirror assembly that directs image light from the fourth image panel to the second lens component.
In an exemplary embodiment of the HMD system, the first mirror assembly and the second mirror assembly each has a folded arrangement including a plurality of mirror segments.
In an exemplary embodiment of the HMD system, the optical arrangement further comprises a polarizer located on each of the lens components, and a quarter wave plate located respectively on a mirror component associated with each of the first through fourth image panels.
In an exemplary embodiment of the HMD system, the optical arrangement includes a plurality of light-directing components that are configured to direct light along certain optical pathways.
In an exemplary embodiment of the HMD system, the plurality of light-directing components comprises a louver film located on each of the first, second, third, and fourth image panels.
In an exemplary embodiment of the HMD system, the plurality of light-directing components comprises a plurality of corrective lens elements that operate as a secondary lens for optical pathways of light emitted from each of the first, second, third, and fourth image panels.
In an exemplary embodiment of the HMD system, a volume between an image panel and a lens component is filled with a transparent refractive material.
In an exemplary embodiment of the HMD system, the transparent refractive material comprises a first refractive material located in peripheral parts of the HMD system associated with the first image panel and the second image panel such that light from the first and second image panels passes through the first refractive material; the transparent refractive material further comprises a second refractive material located in central parts of the HMD system associated with the third and fourth image panels such that light from the third and fourth image panels passes through the second refractive material; and a refractive index of the first refractive material differs from a refractive index of the second refractive material.
In an exemplary embodiment of the HMD system, the first refractive material is air and the second refractive material is Poly(methyl methacrylate) (PMMA).
In an exemplary embodiment of the HMD system, the plurality of lens components includes a singular first eye lens component that is positioned to receive light from the first image panel and the third image panel, and a singular second eye lens component that is positioned to receive light from the second image panel and the fourth image panel, and a non-air refractive material that is located in a central portion of the HMD system.
Although the invention has been shown and described with respect to a certain embodiment or embodiments, it is obvious that equivalent alterations and modifications will occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. In particular regard to the various functions performed by the above described elements (components, assemblies, devices, compositions, etc.), the terms (including a reference to a “means”) used to describe such elements are intended to correspond, unless otherwise indicated, to any element which performs the specified function of the described element (i.e., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary embodiment or embodiments of the invention. In addition, while a particular feature of the invention may have been described above with respect to only one or more of several illustrated embodiments, such feature may be combined with one or more other features of the other embodiments, as may be desired and advantageous for any given or particular application.
The present invention relates to wearable displays, in particular for achieving small and light weight head-mounted display (HMD) systems. Hardware manufactured using this disclosure may be useful in the fields of virtual reality (VR) and augmented reality (AR) for both consumer and professional markets. HMD systems manufactured in accordance with this disclosure could have applications including gaming, entertainment, task support, medical, industrial design, navigation, transport, translation, education, and training.