Augmented reality (AR) technology has advanced rapidly, bringing forth a new generation of AR display systems designed to overlay digital content onto the real world. These AR display systems (typically configured as wearable headsets) typically comprise left and right displays that project images into a user's eyes, creating an immersive experience. One aspect of successfully operating such AR display systems is maintaining precise alignment between the left and right displays to ensure a coherent and comfortable visual experience. Misalignments, even subtle ones, can lead to user discomfort, including eye strain and headaches, and degrade the quality of the AR experience.
Several factors contribute to misalignment in AR display systems. Thermal fluctuations, mechanical stresses, and natural aging of the headset materials can all cause slight shifts in the position or orientation of the display elements. Current AR headsets, especially those striving for lightweight and eyeglasses-like designs, face significant challenges in maintaining stable alignment over time.
Existing solutions to this problem typically involve the use of rigid structures or additional hardware components to stabilize the displays. However, these solutions have inherent limitations. Rigid structures add weight and bulk to the headset, detracting from user comfort and the overall experience. Additional hardware components, such as sensors and actuators for real-time alignment adjustments, increase the complexity, power consumption, and cost of the headset.
The present disclosure may be better understood, and its numerous features and advantages made apparent to those skilled in the art by referencing the accompanying drawings. The use of the same reference symbols in different drawings indicates similar or identical items.
Current solutions for aligning and/or calibrating displays in wearable AR display systems fail to provide a practical means for users to recalibrate those display systems. In most cases, AR display systems with misaligned displays must be returned to the manufacturer or a service center for realignment, causing inconvenience to the user and additional service costs.
Embodiments of techniques described herein provide a user-operable calibration device for wearable AR display systems, enabling a user-initiated and precise alignment of left and right displays. Such techniques address AR display system misalignment due to (as non-limiting examples) thermal fluctuations, mechanical stresses, and aging, enhancing user comfort and visual experience. Via various embodiments, such techniques are adaptable to various display AR systems, offering a cost-effective and user-friendly method for maintaining optimal display alignment.
The support frame 102 further can include one or more batteries or other portable power sources for supplying power to the electrical components of the WARD system 100. In some embodiments, some or all of these components of the WARD system 100 are fully or partially contained within an inner volume of support frame 102, such as within the arm 104 in region 112. Similarly, the arm 105 may house some or all corresponding components of the WARD system 100 (including, for example, a light engine and/or one or more optical elements) in region 113, to be used in conjunction with the corresponding FOV area (not shown) of lens element 108. In the illustrated implementation, the WARD system 100 utilizes an eyeglasses form factor. However, the WARD system 100 is not limited to this form factor and thus may have a different shape and appearance from the eyeglasses frame depicted in
The lens elements 108, 110 are used by the WARD system 100 to provide an AR display in which rendered graphical content can be superimposed over or otherwise provided in conjunction with a real-world view as perceived by the user through the lens elements 108, 110. For example, laser light or other display light is used to form a perceptible image or series of images that are projected onto the eye of the user via one or more optical elements, including a waveguide, formed at least partially in the corresponding lens element. One or both of the lens elements 108, 110 thus includes at least a portion of a waveguide that routes display light received by an incoupler (IC) (not shown in
In various embodiments, non-limiting example display architectures include scanning laser projector and holographic optical element combinations, side-illuminated optical light guide displays, pin-light displays, or other wearable AR display system. The term light engine as used herein is not limited to referring to a singular light source, but can also refer to a plurality of light sources, and can also refer to a light engine assembly (LEA). A light engine assembly may include some components which enable the light engine to function, or which improve operation of the light engine. As one example, a light engine may include a light source, such as a laser or a plurality of lasers. The light engine assembly may additionally include electrical components, such as driver circuitry to power the at least one light source. The light engine assembly may additionally include optical components, such as collimation lenses, a beam combiner, or beam shaping optics. In certain embodiments, the LEA additionally includes beam redirection optics, such as least one MEMS mirror operated to scan light from at least one laser light source, such as in a scanning laser projector. In the above example, the LEA includes a light source and also optical components, which accept the output from at least one light source and produce conditioned display light to convey AR content. In various embodiments, components in the light engine assembly are included in a housing of the light engine assembly, are affixed to a substrate of the light engine assembly (e.g., a printed circuit board or similar), or are separately mounted components of a wearable AR display.
In the depicted embodiment, the clamp 210 connects to a support frame 205, which extends from the support frame 102 via the clamp 210 to securely position the CAA 200 relative to the WARD system 100. This configuration improves stability and precision of the CAA 200 during calibration, allowing it to remain fixed in the intended position. In various embodiments, the support frame 102 is adjustable to accommodate multiple distinct wearable augmented-reality display (WARD) systems having multiple distinct physical parameters.
A collimating lens 215 is coupled to the support frame 205 and positioned to project an optical alignment pattern 221 via a graticule 220. As used herein, a graticule refers to a visual reference pattern, often in the form of crosshairs, grids, concentric circles, or other markings, that is superimposed on the optical field of an instrument to aid in alignment and measurement. In the context of WARD system calibration, the graticule 220 serves as a stable reference pattern within the CAA 200, allowing the user to align projected images (e.g., crosshairs and/or other alignment markings) from the respective left and right light engine assemblies to achieve precise calibration.
In the depicted embodiment, the optical alignment pattern 221 (which typically includes markings such as a crosshair and/or additional alignment markings) is projected into the user's eyes via both left and right light engine assemblies (LEAs), simulating the viewing experience of an object located at a predetermined distance (e.g., two meters (2 m)). This projected optical alignment pattern 221 enables the user to merge these instances of the optical alignment pattern 221 using the CAA 200, adjusting the displayed instances until the LEA-projected crosshairs align precisely with those from the collimator. In certain embodiments, the support frame 205 is coupled to two collimating lenses (both operationally identical to collimating lens 215, one corresponding to each eye) such that the two collimating lenses are respectively configured to project the alignment pattern 221 towards the right and left eyes of the user.
In some embodiments, the support frame 102 includes a user interface to facilitate adjustment of the position or orientation of the CAA 200 relative to the AR display system 100, such as one or more user controls to align instances of the alignment pattern 221 projected towards the eyes of the user. As non-limiting examples, the user interface may include one or more mechanical adjustment mechanisms, such as dials, sliders, or knobs, to enable fine-tuning of the collimator's placement along one or more axes. As another example, the user interface may be implemented as an electronic adjustment system, such as motorized actuators controlled via buttons, a touchscreen, or a companion application on a communicatively connected device (e.g., on a mobile computing device such as a smart phone, on the AR display system itself, or on other suitable device). These adjustment mechanisms allow the user to ensure precise alignment of the collimator 200 with the optical components of the AR display system 100, improving the accuracy of the calibration process.
In the depiction of
The calibration process involves adjusting the WARD system 100, either digitally or physically, until the projected crosshairs 310 and 320 converge with the graticule crosshairs 300, as shown on the right side of
In operation, to align the projected instances of the optical alignment pattern 221 users can modify the calibration of the WARD system 100 through either digital or physical adjustments. In some embodiments, the WARD system 100 provides software-based based controls accessible via a user interface or companion software application, allowing users to adjust the alignment of the LEA-projected crosshairs digitally. By altering parameters such as angle, position, or convergence of the projected images through these software controls, users can align the crosshairs with the reference pattern of the graticule 220 within the CAA 200. In other embodiments, the WARD system 100 allows for manual, physical adjustments to the position or orientation of the light engine assemblies (LEAs). This may involve the use of one or more physical fine-tuning mechanisms, such as screws, sliders, or dials, positioned on the support frame 102 or within the temple arms 104, 105, enabling the user to adjust the LEAs until the projected crosshairs align precisely with the graticule's reference pattern.
In the depicted embodiment, the display light emitted by the LEA 410 passes through a sequence of lens elements 415, 420, 425, 430, and 435. Each of these lenses modifies one or more of the direction, focus, and collimation of the display light, creating a controlled path with minimal divergence. As the display light progresses through these elements, the lenses 415, 420, 425, 430, and 435 operate in tandem to transform the display light from the LEA 410 into a coherent, parallel beam that can project a clear and stable optical alignment pattern at a target focal distance.
The final lens element 435 of the series serves as the last collimating component, producing the output display light as a precisely aligned beam. In some embodiments, lens element 435 may correspond to one of the lens elements 108 or 110 of the WARD system 100 in
A 2 mm scale reference at the bottom of
It should be noted that the specific arrangement of lenses depicted in
At the input of the collimator apparatus 500 is a light engine assembly (LEA) 501, which emits three distinct display lights corresponding to the red, green, and blue (RGB) components of the alignment pattern. These display lights are emitted at specific angular offsets relative to the baseline of the blue light. In the illustrated example, the blue display light at 515 defines the 0-degree baseline; the green display light at 510 is offset by 0.4 degrees, and the red display light at 505 is offset by 0.8 degrees. This angular separation allows the collimator to provide proper convergence of the RGB light components within the optical system.
The RGB display light emitted by the LEA 501 enters the collimator apparatus 500 through an incoupling aperture 520, which directs the display light into the subsequent optical pathway: after passing through the incoupling aperture 520, the display light is reflected off each of the opposing reflective surfaces 530 and 540 in turn. The resultingly redirected light is thereby collimated into a parallel beam and emitted from the collimator apparatus 500 as a coherent optical alignment pattern at the outcoupling surface 550. This alignment pattern is visible to the user through the WARD system's optical elements (e.g., lens elements 108 or 110 in
A laser diode 605 serves as the light engine for the depicted embodiment. The laser diode 605 emits a display light 610 that is directed toward a mirror 615. The mirror 615 redirects the emitted light upward to a collimating reflector 620, which aligns and collimates the light rays of the display light 610 into a coherent, parallel beam. The collimating reflector 620 directs this now-coherent display light toward a holographic optical element (grating) 625. As used herein, a holographic grating refers to an optical element that utilizes a holographically recorded pattern to diffract, redirect, or manipulate light in a controlled manner. This pattern, typically encoded within a photosensitive material, interacts with incoming light to produce specific optical effects, such as splitting the light into multiple beams, redirecting its path, or modifying its phase or wavelength distribution. In the context of the collimator system 600 and other embodiments, a holographic grating 625 is used to shape and refine the light path of the display light 610, contributing to the generation of a precise alignment pattern for calibration purposes.
After encountering the holographic grating 625, the processed display light 610 then passes to a reticle image hologram 630, which in the depicted embodiment serves as a graticule for the collimator system 600. The reticle image hologram 630 generates the alignment pattern formed by the processed display light 610—such as crosshairs or other calibration markers—and projects the alignment pattern toward the user 680. This holographically generated alignment pattern provides a precise and stable visual reference, enabling accurate calibration of the AR system's optical components.
By functioning as a holographically implemented graticule, the reticle image hologram 630 offers flexibility in design, allowing for more complex and customizable alignment patterns compared to traditional physical graticules. This compact configuration ensures that the collimator system 600 is suitable for integration into wearable AR devices.
As depicted are two configurations, respectively occurring before and after alignment of an input display light beam provided by an AR display system. Both configurations involve input display light beams that are emitted from a light engine (not shown) and received by an incoupler 712 of the lens 110. The lens 110, previously shown in
In the leftmost ‘before alignment’ configuration, an angular misalignment of the input display light beam 710 causes the input display light beam 710 to enter the lens 110 at an angle of incidence that is not normal to the input grating 712. This angular misalignment causes the display light to reflect improperly within the interior waveguide of the lens 110. The misaligned light exits the waveguide at the outcoupler 732 and is directed toward a retroreflector 701. The retroreflector 701 reflects the display light back toward the outcoupler 720; however, due to the initial misalignment, the user's eye 745 perceives a split image caused (in the simplified depiction) by disparate display light beams 720 and 730. This split image visually indicates that the AR display system is not properly aligned.
In contrast, the rightmost configuration ‘after alignment’ shows a corrected input beam 750 that has been realigned to enter the lens 110 at an angle of incidence that is normal to that input grating 712. When so properly aligned, the display light propagates accurately along the interior waveguide of the lens 110, reflecting internally in a controlled manner. The display light exits the waveguide at the outcoupler 732 and is directed toward the retroreflector 701. The retroreflector 701 reflects the light back toward the outcoupler 732, and, because the alignment is correct, the returning display light exits the waveguide with coherent beams directed to the user's eye 790, resulting in a perceived coincident image and confirming that the optical components of the AR display system are properly aligned.
By iteratively adjusting the input display light beam angle—modifying the orientation of the light engine or related components of the AR system—the user can transition from the split image perceived by the user's eye 745 (before alignment) to the coincident image perceived by the user's eye 790 (after alignment). The retroreflector 701 provides intuitive visual feedback that enables precise calibration of the AR system.
At step 805, the collimating alignment apparatus receives display light representing an optical alignment pattern from a light engine, such as a light engine of a wearable AR display system (e.g., the WARD system 100 of
At step 810, the received display light is collimated via one or more collimating optical elements of the collimating alignment apparatus. These optical elements, which may include one or more retroreflectors, catadioptric lenses, and/or collimating lenses, ensure that the emitted display light forms a coherent and parallel beam.
At step 815, the collimated display light is redirected towards the eye of the user for comparison with an alignment pattern graticule. The graticule provides a stable reference alignment pattern that the user can visually compare to the projected collimated display light. This comparison enables calibration of the AR display system's optical components, ensuring that its field of view is properly aligned.
In some embodiments, certain aspects of the techniques described above may be implemented by one or more processors of a processing system executing software. The software comprises one or more sets of executable instructions stored or otherwise tangibly embodied on a non-transitory computer readable storage medium. The software can include the instructions and certain data that, when executed by the one or more processors, manipulate the one or more processors to perform one or more aspects of the techniques described above. The non-transitory computer readable storage medium can include, for example, a magnetic or optical disk storage device, solid state storage devices such as Flash memory, a cache, random access memory (RAM) or other non-volatile memory device or devices, and the like. The executable instructions stored on the non-transitory computer readable storage medium may be in source code, assembly language code, object code, or other instruction format that is interpreted or otherwise executable by one or more processors.
A computer readable storage medium may include any storage medium, or combination of storage media, accessible by a computer system during use to provide instructions and/or data to the computer system. Such storage media can include, but is not limited to, optical media (e.g., compact disc (CD), digital versatile disc (DVD), Blu-Ray disc), magnetic media (e.g., floppy disk, magnetic tape, or magnetic hard drive), volatile memory (e.g., random access memory (RAM) or cache), non-volatile memory (e.g., read-only memory (ROM) or Flash memory), or microelectromechanical systems (MEMS)-based storage media. The computer readable storage medium may be embedded in the computing system (e.g., system RAM or ROM), fixedly attached to the computing system (e.g., a magnetic hard drive), removably attached to the computing system (e.g., an optical disc or Universal Serial Bus (USB)-based Flash memory), or coupled to the computer system via a wired or wireless network (e.g., network accessible storage (NAS)).
Note that not all of the activities or elements described above in the general description are required, that a portion of a specific activity or device may not be required, and that one or more further activities may be performed, or elements included, in addition to those described. Still further, the order in which activities are listed are not necessarily the order in which they are performed. Also, the concepts have been described with reference to specific embodiments. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the present disclosure as set forth in the claims below. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of the present disclosure.
Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any feature(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature of any or all the claims. Moreover, the particular embodiments disclosed above are illustrative only, as the disclosed subject matter may be modified and practiced in different but equivalent manners apparent to those skilled in the art having the benefit of the teachings herein. No limitations are intended to the details of construction or design herein shown, other than as described in the claims below. It is therefore evident that the particular embodiments disclosed above may be altered or modified and all such variations are considered within the scope of the disclosed subject matter. Accordingly, the protection sought herein is as set forth in the claims below.
| Number | Date | Country | |
|---|---|---|---|
| 63610488 | Dec 2023 | US |