Patent Grant
11852827
The present disclosure relates generally to optical devices and, more specifically, to a switchable artificial reality device.
An artificial reality device, such as a head-mounted display (“MID”) or heads-up display (“HUD”) device, have wide applications in various fields, including aviation, engineering design, medical surgery practice, and video gaming, etc. The artificial reality device may display virtual objects or combine images of real objects with virtual objects, as in augmented reality (“AR”), virtual reality (“VR”), and/or mixed reality (“MR”) applications. When implemented for AR and/or MR applications, the artificial reality device may be at least partially transparent from the perspective of a user, enabling the user to view a surrounding real world environment. When implemented for VR application, the artificial reality device may be opaque such that the user is substantially immersed in the VR imagery provided via the artificial reality device.
Consistent with an aspect of the present disclosure, a device is provided. The device includes a reflective polarizer configured to selectively reflect or transmit a polarized light based on a polarization of the polarized light. The device also includes a display element disposed at a first side of the reflective polarizer, and configured to output a first image light representing a virtual image. The device also includes a polarization switch disposed between the display element and the reflective polarizer, and configured to switch or maintain a polarization of the first image light. The device further includes an active dimming device disposed at a second side of the reflective polarizer, and configured to provide an adjustable transmittance of an input light.
Other aspects of the present disclosure can be understood by those skilled in the art in beam of the description, the claims, and the drawings of the present disclosure. The foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the claims.
The following drawings are provided for illustrative purposes according to various disclosed embodiments and are not intended to limit the scope of the present disclosure. In the drawings:
Embodiments consistent with the present disclosure will be described with reference to the accompanying drawings, which are merely examples for illustrative purposes and are not intended to limit the scope of the present disclosure. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or similar parts, and a detailed description thereof may be omitted.
Further, in the present disclosure, the disclosed embodiments and the features of the disclosed embodiments may be combined. The described embodiments are some but not all of the embodiments of the present disclosure. Based on the disclosed embodiments, persons of ordinary skill in the art may derive other embodiments consistent with the present disclosure. For example, modifications, adaptations, substitutions, additions, or other variations may be made based on the disclosed embodiments. Such variations of the disclosed embodiments are still within the scope of the present disclosure. Accordingly, the present disclosure is not limited to the disclosed embodiments. Instead, the scope of the present disclosure is defined by the appended claims.
As used herein, the terms “couple,” “coupled,” “coupling,” or the like may encompass an optical coupling, a mechanical coupling, an electrical coupling, an electromagnetic coupling, or any combination thereof. An “optical coupling” between two optical elements refers to a configuration in which the two optical elements are arranged in an optical series, and a beam output from one optical element may be directly or indirectly received by the other optical element. An optical series refers to optical positioning of a plurality of optical elements in a beam path, such that a beam output from one optical element may be transmitted, reflected, diffracted, converted, modified, or otherwise processed or manipulated by one or more of other optical elements. In some embodiments, the sequence in which the plurality of optical elements are arranged may or may not affect an overall output of the plurality of optical elements. A coupling may be a direct coupling or an indirect coupling (e.g., coupling through an intermediate element).
The phrase “at least one of A or B” may encompass all combinations of A and B, such as A only, B only, or A and B. Likewise, the phrase “at least one of A, B, or C” may encompass all combinations of A, B, and C, such as A only, B only, C only, A and B, A and C, B and C, or A and B and C. The phrase “A and/or B” may be interpreted in a manner similar to that of the phrase “at least one of A or Be” For example, the phrase “A and/or B” may encompass all combinations of A and B, such as A only, B only, or A and B. Likewise, the phrase “A, B, and/or C” has a meaning similar to that of the phrase “at least one of A, B, or C.” For example, the phrase “A, B, and/or C” may encompass all combinations of A, B, and C, such as A only, B only, C only, A and B, A and C, B and C, or A and B and C.
When a first element is described as “attached,” “provided,” “formed,” “affixed,” “mounted,” “secured,” “connected,” “bonded,” “recorded,” or “disposed,” to, on, at, or at least partially in a second element, the first element may be “attached,” “provided,” “formed,” “affixed,” “mounted,” “secured,” “connected,” “bonded,” “recorded,” or “disposed,” to, on, at, or at least partially in the second element using any suitable mechanical or non-mechanical manner, such as depositing, coating, etching, bonding, gluing, screwing, press-fitting, snap-fitting, clamping, etc. In addition, the first element may be in direct contact with the second element, or there may be an intermediate element between the first element and the second element. The first element may be disposed at any suitable side of the second element, such as left, right, front, back, top, or bottom.
When the first element is shown or described as being disposed or arranged “on” the second element, term “on” is merely used to indicate an example relative orientation between the first element and the second element. The description may be based on a reference coordinate system shown in a figure, or may be based on a current view or example configuration shown in a figure. For example, when a view shown in a figure is described, the first element may be described as being disposed “on” the second element. It is understood that the term “on” may not necessarily imply that the first element is over the second element in the vertical, gravitational direction. For example, when the assembly of the first element and the second element is turned 180 degrees, the first element may be “under” the second element (or the second element may be “on” the first element). Thus, it is understood that when a figure shows that the first element is “on” the second element, the configuration is merely an illustrative example. The first element may be disposed or arranged at any suitable orientation relative to the second element (e.g., over or above the second element, below or under the second element, left to the second element, right to the second element, behind the second element, in front of the second element, etc.).
When the first element is described as being disposed “on” the second element, the first element may be directly or indirectly disposed on the second element. The first element being directly disposed on the second element indicates that no additional element is disposed between the first element and the second element. The first element being indirectly disposed on the second element indicates that one or more additional elements are disposed between the first element and the second element.
The term “processor” used herein may encompass any suitable processor, such as a central processing unit (“CPU”), a graphics processing unit (“GPU”), an application-specific integrated circuit (“ASIC”), a programmable logic device (“PLD”), or any combination thereof. Other processors not listed above may also be used. A processor may be implemented as software, hardware, firmware, or any combination thereof.
The term “controller” may encompass any suitable electrical circuit, software, or processor configured to generate a control signal for controlling a device, a circuit, an optical element, etc. A “controller” may be implemented as software, hardware, firmware, or any combination thereof. For example, a controller may include a processor, or may be included as a part of a processor.
The term “non-transitory” computer-readable medium” may encompass any suitable medium for storing, transferring, communicating, broadcasting, or transmitting data, signal, or information. For example, the non-transitory computer-readable medium may include a memory, a hard disk, a magnetic disk, an optical disk, a tape, etc. The memory may include a read-only memory (“ROM”), a random-access memory (“RAM”), a flash memory, etc.
The term “film,” “layer,” “coating,” or “plate” may include rigid or flexible, self-supporting or free-standing film, layer, coating, or plate, which may be disposed on a supporting substrate or between substrates. The terms “film,” “layer,” “coating,” and “plate” may be interchangeable. The term “film plane” refers to a plane in the film, layer, coating, or plate that is perpendicular to the thickness direction. The film plane may be a plane in the volume of the film, layer, coating, or plate, or may be a surface plane of the film, layer, coating, or plate. The term “in-plane” as in, e.g., “in-plane orientation,” “in-plane direction,” “in-plane pitch,” etc., means that the orientation, direction, or pitch is within the film plane. The term “out-of-plane” as in, e.g., “out-of-plane direction,” “out-of-plane orientation,” or “out-of-plane pitch” etc., means that the orientation, direction, or pitch is not within a film plane (i.e., non-parallel with a film plane). For example, the direction, orientation, or pitch may be along a line that is perpendicular to a film plane, or that forms an acute or obtuse angle with respect to the film plane. For example, an “in-plane” direction or orientation may refer to a direction or orientation within a surface plane, an “out-of-plane” direction or orientation may refer to a thickness direction or orientation non-parallel with (e.g., perpendicular to) the surface plane.
The term “orthogonal” as in “orthogonal polarizations” or the term “orthogonally” as in “orthogonally polarized” means that an inner product of two vectors representing the two polarizations is substantially zero. For example, two beams or beams with orthogonal polarizations (or two orthogonally polarized beams or beams) may be two linearly polarized beams (or beams) with two orthogonal polarization directions (e.g., an x-axis direction and a y-axis direction in a Cartesian coordinate system) or two circularly polarized beams with opposite handednesses (e.g., a left-handed circularly polarized beam and a right-handed circularly polarized beam).
The wavelength ranges, spectra, or bands mentioned in the present disclosure are for illustrative purposes. The disclosed optical device, system, element, assembly, and method may be applied to a visible wavelength band, as well as other wavelength bands, such as an ultraviolet (“UV”) wavelength band, an infrared (“IR”) wavelength band, or a combination thereof. The term “substantially” or “primarily” used to modify an optical response action, such as transmit, reflect, diffract, block or the like that describes processing of a beam means that a major portion, including all, of a beam is transmitted, reflected, diffracted, or blocked, etc. The major portion may be a predetermined percentage (greater than 50%) of the entire beam, such as 100%, 98%, 90%, 85%, 80%, etc., which may be determined based on specific application needs.
The term “optic axis” may refer to a direction in a crystal. A beam propagating in the optic axis direction may not experience birefringence (or double refraction). An optic axis may be a direction rather than a single line: beams that are parallel to that direction may experience no birefringence.
The present disclosure provides an artificial reality device that is switchable between operating in an AR (or MR) mode and operating in a VR mode.
For discussion purposes,
In some embodiments, as shown in
The object tracking assembly 190 may include an infrared (“IR”) light source 191 configured to emit an IR light to illuminate the eye 159 and/or the face, a deflecting element 192 (such as a grating), and an optical sensor 193 (such as a camera). The deflecting element 192 may deflect (e.g., diffract) the IR light reflected by the eye 159 toward the optical sensor 193. The optical sensor 193 may generate a tracking signal relating to the eye 159. The tracking signal may be an image of the eye 159. The artificial reality device 100 may include a controller (not shown), which may control various optical elements in the left-eye display modules 110L, the object tracking assembly 190, and/or the viewing optics assembly 180.
The artificial reality device 100 may be configured to operate in a VR mode, an AR mode, an MR mode, or any combination thereof. The artificial reality device 100 may be configured to be switchable among operating in the VR mode, the AR mode, and the MR mode, in both indoor and outdoor environments. In some embodiments, when the artificial reality device 100 operates in the AR or an MR mode, the left-eye and right-eye display systems 110L and 110R may be fully or partially transparent from the perspective of the user, which may provide the user with a view of a surrounding real-world environment. In some embodiments, when the artificial reality device 100 operates in the VR mode, the left-eye and right-eye display systems 110L and 110R may be opaque to block the light from the real-world environment, such that the user may be immersed in the VR imagery based on computer-generated images. In some embodiments, the artificial reality device 100 may include an adaptive or active dimming device 165 configured to dynamically adjust the transmittance of a light from a real world environment (referred to as a real world light), thereby switching the artificial reality device 100 between operating in the VR mode and operating in the AR mode, or between operating in the VR mode and operating in the MR mode. In some embodiments, along with switching between the AR mode and the VR mode, or between the MR mode and the VR mode, the active dimming device 165 may be configured to mitigate differences in intensities of a real world light and a virtual image light when the artificial reality device 100 operates in the AR or MR mode.
In the following, exemplary artificial reality devices configured to be switchable between operating in the VR mode and operating in the AR mode, or between operating in the VR mode and operating in the MR mode, will be explained.
The active dimming device 265 may be disposed at an output portion of the light guide 210, spatially overlapping with the out-coupling element 245. The active dimming device 265 may be separately formed and disposed at (e.g., affixed to) at a surface of the light guide 210 facing a real-world environment (e.g., a first surface 210-1), or may be integrally formed as a part of the light guide 210. In some embodiments, the active dimming device 265 and the out-coupling element 245 may be disposed at opposite surfaces of the light guide 210. The light guide 210 may be disposed between the active dimming device 265 and the out-coupling element 245. In some embodiments, an area of the active diming device 265 may be greater than or equal to an area of the out-coupling element 245. In some embodiments, the active dimming device 265 and the out-coupling element 245 may be disposed at the same surface (e.g., the first surface 210-1) of the light guide 210, with the out-coupling element 245 disposed between the active dimming device 265 and the light guide 210. The output image light 232 may not be attenuated by the active dimming device 265.
The active dimming device 265 may be a suitable active dimming device configured to dynamically adjust the transmittance of a visible light from a real world environment (referred to as a real world light 262 hereinafter), thereby dynamically adjusting the transmittance of a see-through view observed through the artificial reality device 200. The active dimming device 265 may attenuate or dim an input light via a suitable dimming mechanisms, such as polarization, absorption, scattering, and/or diffusion, etc. The transmittance or the dimming effect of the active dimming device 265 may be adjustable by a suitable external field, e.g., a mechanical force, an electric field, a magnetic field, or a light, etc. Examples of the active dimming device 265 may include blinds or micro blinds, a guest-host liquid crystal (“LC”) dimming device, a polymer stabilized cholesteric LC dimming device, a suspended particle device, an electrochromic diming device, or a photochromic diming device, etc. The active dimming device 265 may be a global or local dimming device.
The controller 225 may be communicatively coupled with the active dimming device 265 to control an operation state of the active dimming device 260. In some embodiments, the controller 225 may control the active dimming device 265 to be switchable between operating in a clear state and a dark state (also referred to as an opaque state). The active dimming device 265 operating in the dark state may be configured to substantially block the real world light 262, e.g., with a light transmittance of less than or equal to about 0.02%, e.g., about 0.01% (or with an optical density of 4). Thus, the user may be immersed in the VR imagery based on computer-generated images. The light transmittance of the active dimming device 265 operating in the dark state may be referred to as a minimum transmittance of the active dimming device 265. For example, the minimum transmittance may be 0.01% or 0.02%.
The active dimming device 265 operating in the clear state may be configured to provide a transmittance that is greater than the minimum transmittance to the real world light 262. In some embodiments, the transmittance in the clear state may be greater than 10%. In some embodiments, the transmittance in the clear state may be adjustable or tunable in a range, or may be a fixed value selected from the range. The range may be from about 10% to about 20%, from about 10% to about 30%, from about 10% to about 40%, from about 10% to about 50%, from about 10% to about 60%, from about 10% to about 70%, from about 10% to about 80%, from about 10% to about 90%, from about 20% to about 30%, from about 20% to about 40%, from about 20% to about 50%, from about 20% to about 60%, from about 20% to about 70%, from about 20% to about 80%, from about 20% to about 90%, from about 30% to about 40%, from about 30% to about 50%, from about 30% to about 60%, from about 30% to about 70%, from about 30% to about 80%, from about 30% to about 90%, from about 40% to about 50%, from about 40% to about 60%, from about 40% to about 70%, from about 40% to about 80%, from about 40% to about 90%, from about 50% to about 60%, from about 50% to about 70%, from about 50% to about 80%, from about 50% to about 90%, from about 60% to about 70%, from about 60% to about 80%, from about 60% to about 90%, from about 70% to about 80%, from about 70% to about 90%, from about 80% to about 90%, etc. In some embodiments, the transmittance in the clear state may be a fixed value, e.g., 35%, or any other suitable value selected in one of the above ranges. In some embodiments, the active dimming device may be configured with a light transmittance of less than or equal to 0.02% in a dark state and a light transmittance of greater than or equal to 10% (e.g., 35%) in a clear state. Thus, the user may perceive a virtual scene superimposed with a real-world scene. For discussion purposes, the predetermined transmittance of the active dimming device 265 operating in the clear state may be referred to as a maximum transmittance of the active dimming device 265, which may be adjustable or fixed. In some embodiments, the controller 225 may control the active dimming device 265 to operate in an intermediate state, in addition to the clear state and the dark state. The active dimming device 265 operating in the intermediate state may provide an intermediate transmittance that is greater than the minimum transmittance provided in the dark state, and less than the maximum transmittance provided in the clear state. For example, in the intermediate state, the intermediate transmittance may be 3%, 4%, 5%, etc.
The active dimming device 265 may be controlled by the controller 225 to dynamically adjust the transmittance of the see-through view observed through the artificial reality device 200, thereby switching the artificial reality device 200 between operating in the VR mode and operating in the AR device, or between operating in the VR device and operating in the MR device. For example, when the controller 225 controls the active dimming device 265 to operate in the dark state, the artificial reality device 200 may be configured to operate in the VR mode. When the controller 225 controls the active dimming device 265 to operate in the clear state or intermediate state, the artificial reality device 200 may be configured to operate in the AR mode or MR mode. In some embodiments, the active dimming device 265 may be configured to dynamically attenuate the real world light 262 depending on the brightness of the real-world environment, thereby adjusting the brightness of the see-through view. For example, when the artificial reality device 200 operates in the AR mode or MR mode, the active dimming device 265 may be configured to adjust the brightness of the see-through view to mitigate the brightness difference between the see-through view and the virtual image that are perceived by the user.
For discussion purposes,
As shown in
In some embodiments, the image light 329 output from the pico-projector may be a linearly polarized light. In some embodiments, the image light 329 output from the pico-projector may not be a linearly polarized light, and a linear polarizer (not shown) may be disposed between the pico-projector and the polarization switch 315 to convert the image light 329 into a linearly polarized light. For discussion purposes, the image light 329 shown in
The polarization switch 315 may be configured to control the polarization of the image light 330 incident onto the reflective polarizer 345. The controller 225 may be communicatively coupled with the polarization switch 315 to control an operation state of the polarization switch 315. In some embodiment, the controller 225 may control the polarization switch 315 to switch between operating in a switching state and a non-switching state. The polarization switch 315 operating in the switching state may change the polarization of the image light 329 to an orthogonal polarization while transmitting the image light 329. That is, the image light 329 and the image light 330 may have orthogonal polarizations. The polarization switch 315 operating in the non-switching state may maintain the polarization of the image light 329 while transmitting the image light 329. That is, the image light 329 and the image light 330 may have the same polarization. In some embodiments, the polarization switch 315 may be synchronized with the active dimming device 265. In some embodiments, the polarization switch 315 may not be synchronized with the active dimming device 265.
In some embodiments, the polarization switch 315 may include a switchable half-wave plate. In some embodiments, the polarization switch 315 may include a twisted-nematic liquid crystal (“TNLC”) cell. For example, when the TNLC cell operates at a voltage-on state, the TNLCcell may rotate a polarization direction of a linearly polarized input light by about 90°, while transmitting the linearly polarized input light. When the TNLC cell operates at a voltage-off state, the TNLC cell may maintain the polarization direction of the linearly polarized input light, while transmitting the linearly polarized input light. In some embodiments, the switchable half-wave plate may be a suitable liquid crystal (“LC”)-based switchable half-wave plate that includes one or more LC cells, e.g., a Pi cell, a ferroelectric cell, an electronically controlled birefringence (“ECB”) cell, a dual ECB cell, etc., or a combination thereof. In some embodiments, the switchable half-wave plate may be electrically driven. For example, the switchable half-wave plate may be electrically coupled with a power source, and the controller 225 may be communicatively coupled with the power source to control an output of the power source. For example, when the switchable half-wave plate operates at a voltage-off state, the switchable half-wave plate may change a polarization direction of a linearly polarized input light to an orthogonal polarization direction, while transmitting the linearly polarized input light. When the switchable half-wave plate operates at a voltage-on state, the switchable half-wave plate may maintain the polarization direction of the linearly polarized input light, while transmitting the linearly polarized input light.
In some embodiments, the switchable half-wave plate may be mechanically driven. For example, the switchable half-wave plate may be mounted on a rotation stage, which may be rotatable around an axis perpendicular to a surface of the switchable half-wave plate. The controller 225 may be communicatively coupled with the rotation stage to control a rotation angle of the rotation stage, thereby controlling an angle of a polarization axis (e.g., a fast axis) of the switchable half-wave plate with respective to the polarization direction of the linearly polarized image light 329. For example, when the angle of the polarization axis of the switchable half-wave plate with respective to the polarization direction of the linearly polarized image light 329 is about 45°, the switchable half-wave plate may change a polarization direction of a linearly polarized input light to an orthogonal polarization direction, while transmitting the linearly polarized input light. When the angle of the polarization axis of the switchable half-wave plate with respective to the polarization direction of the linearly polarized image light 329 is about 0 or 90°, the switchable half-wave plate may maintain the polarization direction of the linearly polarized input light, while transmitting the linearly polarized input light.
In some embodiments, when a linear polarizer is disposed between the switchable half-wave plate and the display element 305 (e.g., pico-projector), the controller 225 may be communicatively coupled with the rotation stage to control a rotation angle of the rotation stage, thereby controlling an angle of a polarization axis (e.g., a fast axis) of the switchable half-wave plate with respective to a transmission axis of the linear polarizer.
In some embodiments, the reflective polarizer 345 may be a linearly reflective polarizer. For example, the reflective polarizer 345 may be configured to substantially reflect a linearly polarized light having a first polarization direction, and substantially transmit a linearly polarized light having a second polarization direction that is orthogonal to the first polarization direction. The reflective polarizer 345 may have a first surface facing the eye-box region 260, and a second surface opposite to the first surface. The active dimming device 265 may be disposed at the second surface of the reflective polarizer 345 facing the real world environment. The active dimming device 265 may dynamically adjust the transmittance of a real world light 362, thereby adjusting the brightness of the see-through view observed through the artificial reality device 200. By adjusting the transmittance of the real world light, the active dimming device 265 may switch the artificial reality device 300 between operating in the VR mode and operating in the AR mode, or between operating in the VR mode and operating in the MR mode.
For discussion purposes,
Referring to
In some embodiments, the lens assembly 380 may include one or Fresnel lenses (or Fresnel lens arrays), or a folded lens assembly, etc. The Fresnel lens may provide apertures and focal lengths comparable to conventional lenses, with a smaller thickness and weight. The folded lens assembly may be configured to fold an optical path of the image light 332 from the reflective polarizer 345 to the eye-box region 260, thereby increasing the length of the optical path of the image light 332 from the reflective polarizer 345 to the eye-box region 260 without increasing the physical distance between the reflective polarizer 345 and the eye 259. The folded lens assembly may increase a field of view (“FOV”) of the artificial reality device 300 without increasing the physical distance between the reflective polarizer 345 and the eye 259 or without compromising the image quality. Examples of the folded lens assembly include a pancake lens assembly, a double pancake lens assembly, a lens assembly including one or more reflective holographic elements, etc. For example, the folded lens assembly may include a first optical element including a quarter-wave plate, a first lens, a first partial reflector (e.g., 50:50 mirror), and a second optical element including a second lens and a second partial reflector (e.g., a reflective polarizer).
In some embodiments, the lens assembly 380 may be configured with an adjustable optical power. For example, the lens assembly 380 may be configured with a large aperture size (such as 50 mm) for a large field of view (such as 65 degrees with 20 mm eye relief distance), a large and continuous adjustment range of optical power for adapting human eye vergence accommodation, a fast switching speed at the milli-seconds level or tens of milliseconds level, and a high image quality for meeting human eye acuity. The lens assembly 380 may include one or more varifocal lenses, such as a mechanical zoom lens stack (which includes at least two lenses with an adjustable distance therebetween), a liquid lens based on a suitable mechanism, a gradient refractive index liquid crystal, or a stack of one or more Pancharatnam-Berry Phase (“PBP”) lenses and one or more switchable half-wave plates, etc. In some embodiments, the lens assembly 380 having the adjustable optical power may be configured to correct the off-axis aberration in the image light reflected from the reflective polarizer 345, while transmitting the image light reflected from the reflective polarizer 345. In some embodiments, the lens assembly 380 having the adjustable optical power may also be configured to address an accommodation-vergence conflict in the artificial reality device 300, e.g., based on eye-tracking information received from an object tracking assembly included in the artificial reality device 300 (e.g., the object tracking assembly 190 shown in
In some embodiments, the lens assembly 380 may be a first lens assembly 380, and the artificial reality device 300 may also include a second lens assembly 340 disposed at the second surface of the reflective polarizer 345. As shown in
In some embodiments, the reflective polarizer 345 may be configured with an optical power. The optical power of the reflective polarizer 345 may be fixed or variable. In some embodiments, the optical power of the reflective polarizer 345 may be configured, such that the reflective polarizer 345 may reflect and focus the image light 330 having the first polarization direction as the image light 332 propagating through the exit pupil 257 at which the eye 259 is located. In some embodiments, the reflective polarizer 345 may also be configured to correct the off-axis aberration in the image light 330 while reflecting the image light 330. In such an embodiment, the viewing optics assembly 380 may be omitted. When the artificial reality device 300 operates in the AR mode or MR mode, the optical powers provided by the reflective polarizer 345 and the second lens assembly 340 may have opposite signs and a substantially same absolute value. Thus, when the artificial reality device 300 operates in the AR mode or MR mode, the second lens assembly 340 may be configured to compensate for the distortion of the real world light 262 caused by the reflective polarizer 345, such that images of real-world objects viewed through the artificial reality device 300 may be substantially unaltered.
In the embodiment shown in
In the embodiment shown in
In addition, the active dimming device 265 operating in the intermediate state may also at least partially forwardly scatter and/or transmit the image light 330 that has been transmitted through the reflective polarizer 345 to the real world environment. The artificial reality device 300 may have a first side facing the eye 259 of the user (e.g., a first user), and a second side facing the real world environment. In some embodiments, an eye 359 of a second user facing the first user and located at the second side of the artificial reality device 300 may also perceive a magnified image 387 of the virtual object 302. Thus, both of the first user located at the first side of the artificial reality device 300 and the second user located at the second side of the artificial reality device 300 may perceive the virtual object 302 generated by the display element 305 at the same time. In other words, the first user located at the first side of the artificial reality device 300 may be able to share the content generated by the display element 305 with the second user located at the second side of the artificial reality device 300.
In the embodiment shown in
For discussion purposes, the reflective polarizer 345 is shown in
Referring to
In some embodiments, the polarization of the in-coupled image light 431 may be substantially maintained when the in-coupled image light 431 propagates inside the light guide 410 via TIR toward the out-coupling element 445. In some embodiments, the polarization of the in-coupled image light 431 may change when the in-coupled image light 431 propagates inside the light guide 410 via TIR toward the out-coupling element 445. In some embodiments, the light guide 410 may also be coupled with one or more retardation films disposed at one or more surfaces of the light guide 410. The retardation film may be configured to maintain the polarization of the in-coupled image light 431, when the in-coupled image light 431 propagates inside the light guide 410 via TIR toward the out-coupling element 445.
For discussion purposes, the image light 429 is shown in
The artificial reality device 400 may provide an increased distance to unfold the optical path of the image light from the display element 305 to the eye-box region 260. Thus, the artificial reality device 400 may provide a reduced focal length for a virtual image generated by the display element 305. The artificial reality device 400 may include the display element 305 disposed at a rear portion of the head of the user (at least behind the ear). This configuration may help balance the weight distribution of the artificial reality device 400. Compared to a conventional artificial reality device in which all or most of the optical elements are included in a module worn to the forehead of the user, or disposed at a side (left and/or right) of the head and in front of the ear, the weight distribution of the artificial reality device 400 may be more balanced. Accordingly, the user of the artificial reality device 400 may have an improved wearing experience of the artificial reality device 400.
In some embodiments, the front optics assembly 491 may include the reflective polarizer 345, the active dimming device 265, the second lens assembly 340, and the viewing optics assembly 380. In some embodiments, the front optics assembly 491 may include additional elements not shown in
The connecting optics assembly 493 may be configured to guide lights to propagate between the rear optics assembly 492 and the front optics assembly 491. For example, the connecting optics assembly 493 may include the display optics assembly 401 shown in
The artificial reality device 400 may include a frame 485 (also referred to as a mounting frame 485). For illustrative purposes, the frame 485 is shown as an eye-glass type frame. Other suitable type of mounting fixtures may be used in place of or in combination with the frame 485. The front optics assembly 491, the connecting optics assembly 493, and the rear optics assembly 492 may be mounted to different portions of the frame 485. The frame 485 may extend from a position adjacent an eye of the user to a position at least behind an ear of the user. In some embodiments, the frame 485 may extend to a side rear portion of the head behind the ear, or to a position behind a rearmost point of the head. For discussion purposes, the frame 485 may be roughly divided into a front frame portion 481, a rear frame portion 482, and a middle frame portion 483. The front frame portion 481 may be a portion that is positioned in front of an ear and adjacent an eye 259. The rear frame portion 482 may be a portion that is entirely positioned behind the ear of the user. The middle frame portion 483 may be a portion between the front frame portion 481 and the rear frame portion 482. In some embodiments, the middle frame portion 483 may span above the ear, i.e., a portion of the middle frame portion 483 may be in front of the ear and a portion of the middle frame portion 483 may be behind the ear. The front optics assembly 491 may be mounted to the front frame portion 481. The rear optics assembly 492 may be mounted to the rear frame portion 482. The connecting optics assembly 493 may be mounted to at least the middle frame portion 483. In some embodiments, the connecting optics assembly 493 may be mounted to the middle frame portion 483, or may form the part of or the entire middle frame portion 483. In some embodiments, the connecting optics assembly 493 may be mounted to portions of the front frame portion 481, the middle frame portion 483, and the rear frame portion 482. In some embodiments, the light guide included in the connecting optics assembly may extend along the frame 485 between the rear optics assembly 492 and the front optics assembly 491.
In conventional head-mounted artificial reality systems, most of the optical elements may be disposed at a front portion of a frame, which may cause the front portion of the frame to be much heavier, which may adversely affect user experience. In the present disclosure, the rear optics assembly 492, including the display element 305, may be disposed at the rear frame portion 482 at a rear portion of the head (at least behind the ear), such that the weight distribution may be more balanced.
In the following, exemplary active dimming devices will be explained. The active dimming device may attenuate an input light via a suitable dimming mechanisms, such as polarization, absorption, and/or scattering, etc. An active dimming device based on polarization may include a liquid crystal display (“LCD”) that has a single large cell or “pixel” that covers the entire display area. Examples of active dimming devices based on polarizations may include a nematic LC dimming device, a ferroelectric LC (“FLC”) dimming device, a guest-host LC dimming device, a polymer stabilized blue phase LC (“BPLC”) dimming device, etc. A nematic LC dimming device including a Pi-cell may have a relatively fast switching speed, e.g., the transition between the clear state and the dark state may have a relatively short duration.
The LC cell 530 may include upper and lower substrates 502 arranged opposite to one another. The substrates 502 may be substantially transparent in the visible band (about 380 nm to about 700 nm). In some embodiments, the substrates 502 may also be transparent in some or all of the IR band (about 700 nm to about 1 mm). The substrates 502 may include a suitable material that is substantially transparent to the light of above-listed wavelengths range, e.g., glass, plastic, sapphire, etc. A conductive electrode 504 such as an indium tin oxide (“ITO”) electrode may be disposed on opposing surfaces of the substrates 502 to apply an electric field to the LC cell 530.
An alignment layer 506 may be disposed on opposing surfaces of the electrodes 504, and an LC layer including nematic LC molecules 512 may be disposed between the two alignment layers 506. The two alignment layers 506 may be configured with a homogeneous parallel alignment direction, for example, in an x-direction indicated by an arrow 514, through which the nematic LC molecules 512 near the upper and lower substrates 502 may be oriented in parallel directions. The directors of the LC molecules 512 may be twisted by 180° from one substrate 502 to the other substrate 502, formed by the parallel alignment direction (e.g., parallel rubbing direction) on the two substrates 502. As a comparison, in a TNLC cell, the alignment directions on two substrates are perpendicular to each other and, thus, a 90° twist of LC directors from one substrate to the other is formed inside the TNLC cell.
When a relatively low electric field is applied (e.g., when a relatively low voltage V1 (e.g., V1=2V) is applied), as shown in
When a relatively high electric field is applied (e.g., when a relatively high voltage V2 (e.g., V2=10 V) is applied), as shown in
When a voltage between the relatively high voltage V2 and the relatively low voltage V1 is applied to the LC cell 530 (not shown), the LC cell 530 may operate in state between the homeotropic state and the bend state. After propagating through the LC cell 530, the polarization direction of the incident light 540 may be rotated by less than 90° and greater than 0°, such that the incident light 540 may be partially transmitted through the analyzer 520, realizing an intermediate state of the LC dimming device 500.
The dichroic dyes 610 may be organic molecules having an anisotropic absorption. The absorption properties of the dichroic dyes 610 may depend on a relative orientation between an absorption axis of the dichroic dyes 610 (e.g., long axis or short axis of the dye molecules) and a polarization direction of an incident light. For example, the dichroic dyes 610 may strongly absorb an incident light having a polarization direction that is parallel to an absorption axis (e.g., long axis or short axis) of the dye molecules 610, and weakly absorb the incident light having a polarization direction that is perpendicular to the absorption axis (e.g., long axis or short axis) of the dye molecules 610. Thus, through varying the orientation of the dye molecules 610 via, e.g., an electric field, the transmittance of the incident light 640 may be adjusted.
The LCs 608 in the LC layer may have positive or negative dielectric anisotropy. For illustrative purposes,
In a voltage-off state, as shown in
A polymer network liquid crystal (“PNLC”) dimming device may include a PNLC layer disposed between two opposite substrates. Each substrate may be provided with a transparent electrode, such as an ITO electrode, for applying a voltage to the PNLC layer. In some embodiments, the PNLC layer may include nematic LCs. The operation principle of the PNLC dimming device may be similar to the PDLC dimming device, and the operating voltage of the PNLC dimming device may be reduced compared to the PDLC dimming device, due to a relatively low polymer concentration in the PNLC layer. The switching speed of the PNLC dimming device may be further improved by using sheared PNLC, where the PNLC layer is subjected to a shearing force parallel to the substrates. The shearing force may orient the polymer chains within the PNLC in the direction of the shearing movement. The resulting sheared PNLC dimming device may have a switching speed at the level of tens of milli-seconds.
In some embodiments, the PNLC layer may include cholesteric LCs, and the pitch of the cholesteric LC may be a few micrometers. In some embodiments, the PNLC layer may not be coupled with alignment layers. Polymerization of monomer in the cholesteric LC may occur when a relatively high voltage is applied to the LC cell. The voltage may unwind the cholesteric structure, and reorient the LC molecules to the homeotropic state (e.g., LC directors being perpendicular to the substrate). The polymer network may be formed perpendicular to the substrate in the direction of homeotropically aligned cholesteric LCs under the relatively high voltage. After the polymerization, in a voltage-off state, the cholesteric LCs may tend to have a helical structure, while the polymer network may tend to keep the LC directors parallel to the polymer network. The competition between the two factors may result in a focal conic texture. The PNLC layer may have a polydomain structure that may be optically scattering, realizing a dark state of the PNLC dimming device. In a voltage-on state, the LCs with positive dielectric anisotropy (Δε>0) may be switched to the homeotropic texture, and the incident light may experience the ordinary reflective index no of LCs that is matched with the refractive index np of the polymer. Thus, the incident light may be transmitted through the PNLC layer with negligible scattering, realizing a clear state of the PNLC dimming device.
In a voltage-off state, as shown in
In a voltage-on state, as shown in
In some embodiments, the active dimming device disclosed herein may be switched to operate in different states by applying different voltages. For example, when the dimming effect is based on absorption, the control voltage may range from 0 V to 18 V, 0 V to 20 V, 0 V to 22 V, or 0 V to 25 V, etc. The dark state transmission may be 0.01%, 0.02%, etc. The clear state transmittance may be around 10%, 11%, 12%, 13%, 15%, etc. In the clear state, the haze (or scattering) may be around 0.3%, 0.4%, 0.5%, 0.6%, etc. In the dark state, the haze may be minimal (e.g., around 0%). In some embodiments, when the dimming effect is based on absorption, the inventors have discovered that the dimming device may provide VR experience regardless of its dependency on polarization and/or incident angle.
In some embodiments, the present disclosure provides a device. The device includes a reflective polarizer configured to selectively reflect or transmit a polarized light based on a polarization of the polarized light. The device also includes a display element disposed at a first side of the reflective polarizer, and configured to output a first image light representing a virtual image. The device also includes a polarization switch disposed between the display element and the reflective polarizer, and configured to switch or maintain a polarization of the first image light. The device also includes an active dimming device disposed at a second side of the reflective polarizer, and configured to provide an adjustable transmittance of an input light. In some embodiments, the active dimming device is a global or local dimming device. In some embodiments, the polarization switch is configured to transmit the first image light as a second image light that is incident onto the reflective polarizer as an off-axis incident light. In some embodiments, the device further includes a controller configured to control the polarization switch to switch between outputting the second image light having a first polarization and outputting the second image light having a second polarization orthogonal to the first polarization. In some embodiments, the reflective polarizer is configured to substantially reflect the second image light having the first polarization, and substantially transmit the second image light having the second polarization.
In some embodiments, the controller is configured to control the active dimming device to switch between operating in a clear state to substantially transmit the input light and operating in a dark state to substantially block the input light. In some embodiments, the controller is configured to control the active dimming device to switch between operating in an intermediate state and operating in the clear state, or switch between operating in the intermediate state and operating in the clear state, and the active dimming device provides a maximum transmittance when operating in the clear state, a minimum transmittance when operating in the dark state, and an intermediate transmittance greater than the minimum transmittance and less than the maximum transmittance when operating in the intermediate state.
In some embodiments, the controller is configured to control the polarization switch to transmit the first image light as the second image light having the first polarization, and control the active dimming device to operate in the clear state, the intermediate state, or the dark state, and the reflective polarizer is configured to reflect the second image light having the first polarization as a third image light. In some embodiments, the controller is configured to control the polarization switch to transmit the first image light as the second image light having the second polarization, and control the active dimming device to operate in the clear state or the intermediate state.
In some embodiments, the device further includes a lens assembly at least partially overlapping with the reflective polarizer, wherein the reflective polarizer is disposed between the active dimming device and the lens assembly. In some embodiments, the lens assembly is configured to focus the third image light toward one or more exit pupils of an eye-box region of the device. In some embodiments, the lens assembly is configured with an adjustable optical power. In some embodiments, the active dimming device operating in the clear state or the intermediate state is configured to transmit a real world light toward the one or more exit pupils of the eye-box region of the device. In some embodiments, the active dimming device and the reflective polarizer at least partially overlap with one another.
In some embodiments, the display element includes a pico-projector. In some embodiments, the display element is disposed behind an ear of a user of the device. In some embodiments, the display element is disposed at a rear portion of a head of a user of the device. In some embodiments, the device further includes a light guide disposed between the polarization switch and the reflective polarizer, wherein the light guide is coupled with an in-coupling element and an out-coupling element to guide the second image light output from the polarization switch to the reflective polarizer. In some embodiments, the device further includes a frame extending from a first position adjacent an eye of the user of the device to a second position behind an ear of the user. The frame includes a front frame portion, a middle frame portion, and a rear frame portion, and the reflective polarizer is mounted to a front frame portion, the light guide is mounted to the middle frame portion, and the display element is mounted to the rear frame portion. In some embodiments, the active dimming device is mounted to the front frame portion of the frame, and the polarization switch is mounted to the rear frame portion of the frame.
The foregoing description of the embodiments of the present disclosure have been presented for the purpose of illustration. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Persons skilled in the relevant art can appreciate that modifications and variations are possible in beam of the above disclosure.
Some portions of this description may describe the embodiments of the present disclosure in terms of algorithms and symbolic representations of operations on information. These operations, while described functionally, computationally, or logically, may be implemented by computer programs or equivalent electrical circuits, microcode, or the like. Furthermore, it has also proven convenient at times, to refer to these arrangements of operations as modules, without loss of generality. The described operations and their associated modules may be embodied in software, firmware, hardware, or any combinations thereof.
Any of the steps, operations, or processes described herein may be performed or implemented with one or more hardware and/or software modules, alone or in combination with other devices. In one embodiment, a software module is implemented with a computer program product including a computer-readable medium containing computer program code, which can be executed by a computer processor for performing any or all of the steps, operations, or processes described. In some embodiments, a hardware module may include hardware components such as a device, a system, an optical element, a controller, an electrical circuit, a logic gate, etc.
Embodiments of the present disclosure may also relate to an apparatus for performing the operations herein. This apparatus may be specially constructed for the specific purposes, and/or it may include a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a non-transitory, tangible computer readable storage medium, or any type of media suitable for storing electronic instructions, which may be coupled to a computer system bus. The non-transitory computer-readable storage medium can be any medium that can store program codes, for example, a magnetic disk, an optical disk, a read-only memory (“ROM”), or a random access memory (“RAM”), an Electrically Programmable read only memory (“EPROM”), an Electrically Erasable Programmable read only memory (“EEPROM”), a register, a hard disk, a solid-state disk drive, a smart media card (“SMC”), a secure digital card (“SD”), a flash card, etc. Furthermore, any computing systems described in the specification may include a single processor or may be architectures employing multiple processors for increased computing capability. The processor may be a central processing unit (“CPU”), a graphics processing unit (“GPU”), or any processing device configured to process data and/or performing computation based on data. The processor may include both software and hardware components. For example, the processor may include a hardware component, such as an application-specific integrated circuit (“ASIC”), a programmable logic device (“PLD”), or a combination thereof. The PLD may be a complex programmable logic device (“CPLD”), a field-programmable gate array (“FPGA”), etc.
Embodiments of the present disclosure may also relate to a product that is produced by a computing process described herein. Such a product may include information resulting from a computing process, where the information is stored on a non-transitory, tangible computer readable storage medium and may include any embodiment of a computer program product or other data combination described herein.
Further, when an embodiment illustrated in a drawing shows a single element, it is understood that the embodiment or an embodiment not shown in the figures but within the scope of the present disclosure may include a plurality of such elements. Likewise, when an embodiment illustrated in a drawing shows a plurality of such elements, it is understood that the embodiment or an embodiment not shown in the figures but within the scope of the present disclosure may include only one such element. The number of elements illustrated in the drawing is for illustration purposes only, and should not be construed as limiting the scope of the embodiment. Moreover, unless otherwise noted, the embodiments shown in the drawings are not mutually exclusive, and they may be combined in any suitable manner. For example, elements shown in one figure/embodiment but not shown in another figure/embodiment may nevertheless be included in the other figure/embodiment. In any optical device disclosed herein including one or more optical layers, films, plates, or elements, the numbers of the layers, films, plates, or elements shown in the figures are for illustrative purposes only. In other embodiments not shown in the figures, which are still within the scope of the present disclosure, the same or different layers, films, plates, or elements shown in the same or different figures/embodiments may be combined or repeated in various manners to form a stack.
Various embodiments have been described to illustrate the exemplary implementations. Based on the disclosed embodiments, a person having ordinary skills in the art may make various other changes, modifications, rearrangements, and substitutions without departing from the scope of the present disclosure. Thus, while the present disclosure has been described in detail with reference to the above embodiments, the present disclosure is not limited to the above described embodiments. The present disclosure may be embodied in other equivalent forms without departing from the scope of the present disclosure. The scope of the present disclosure is defined in the appended claims.
This application claims the benefit of priority to U.S. Provisional Application No. 63/291,923, filed on Dec. 20, 2021. The content of the above-mentioned application is incorporated herein by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 10303030 | Robinson | May 2019 | B2 |
| 10598933 | Ouderkirk | Mar 2020 | B2 |
| 10989926 | Matsuda et al. | Apr 2021 | B1 |
| 20110188115 | Sharp | Aug 2011 | A1 |
| 20150198810 | Lee et al. | Jul 2015 | A1 |
| 20190331947 | Hagiwara | Oct 2019 | A1 |
| 20210223601 | Van Heugten et al. | Jul 2021 | A1 |
| 20210339609 | Farreyrol | Nov 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 2021131568 | Sep 2021 | JP |
| 20070046800 | May 2007 | KR |
| 20200095509 | Aug 2020 | KR |
| WO-2017090289 | Jun 2017 | WO |
| WO-2018150773 | Aug 2018 | WO |
| Entry |
|---|
| International Search Report and Written Opinion for International Application No. PCT/US2022/053431, dated Apr. 24, 2023, 9 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20230194873 A1 | Jun 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| 63291923 | Dec 2021 | US |
