The described embodiments relate generally to electronic eyewear. More particularly, the present embodiments relate to electronic head mountable devices having a hinge-forward design that allows for repeatable and reliable optical alignment.
Electronic eyewear, such as head mountable devices (HMDs), computer glasses, or smart glasses are worn on a user's head and incorporate optical displays and computing capabilities. With the advent of HMDs comes an increased demand for small and stylish form factors. Binocular-display systems in electronic devices can include two displays that are aligned relative to each other with a very high precision. A misalignment of the displays can lead to a range of issues, such as eye strain, discomfort, and even total inability to merge the two images. Thus, a need exists for reliable alignment of the displays while maintaining a suitable form factor.
According to some aspects of the present disclosure, a head-mountable electronic device can include a frame, a first display window attached to the frame, a second display window attached to the frame, a first waveguide associated with the first display window, a second waveguide associated with the second display window; a first arm connected to the frame, the first arm including a first projector to emit light into the first waveguide, the first projector pivotable relative to the first waveguide, and a second arm connected to the frame, the second arm including a second projector to emit light into the second waveguide, the second projector pivotable relative to the second waveguide.
In some examples, the head-mountable electronic device can include an optical sensor disposed in the frame. Each of the first waveguide and the second waveguide can include an input coupler, a first output coupler to direct light to an eye of a user, and a second output coupler to direct light to the optical sensor. The head-mountable electronic device can include an optical sensor disposed in the frame to receive light from the first projector through the first waveguide and the second projector through the second waveguide and to detect an alignment between the first projector and the second projector. The head-mountable electronic device can include a third waveguide positioned in the frame between the first waveguide and the second waveguide, the third waveguide can direct light from the first projector and the second projector to the optical sensor.
In some examples, the head-mountable electronic device can include a first optical sensor disposed in the frame to detect light from the first waveguide, and a second optical sensor disposed in the frame to detect light from the second waveguide. The first projector can include an active field-of-view region emitting light from a projection panel, and the first projector can include an expanded field-of-view region that extends beyond the active projection panel. The active field-of-view region can be approximately 25 degrees. The expanded field-of-view region can be approximately 1.25 degrees. In some examples, the expanded field-of-view region can be more than 3 degrees greater than the active field-of-view region.
The head-mountable electronic device can include a first hinge pivotally connecting the first arm to the frame. The first hinge can be positioned between the frame and the first projector. The head-mountable electronic device can include a second hinge pivotally connecting the second arm to the frame. The second hinge can be positioned between the frame and the second projector.
According to some aspects, an electronic system can include a frame including an optical sensor, a display window including a waveguide connected to the frame, an arm including a light emitter connected the frame, and a hinge pivotally joining the frame and the light emitter, the hinge positioned between the frame and the light emitter. The optical sensor can detect an alignment between the light emitter and the waveguide.
In some examples, the hinge can include a cover to secure an optical path between the light emitter and the waveguide. The electronic system can include an attachment to releasably secure the arm in an open position. The light emitter can be movably suspended within the arm. The optical sensor can include a camera rigidly fixed to the frame. The display window can be a first display window, the waveguide can be a first waveguide, the arm can be a first arm, the light emitter can be a first light emitter, and the hinge can be a first hinge. The electronic eyewear further include a second display window including a second waveguide, a second arm including a second light emitter, and a second hinge pivotally joining the frame and the second light emitter, the second hinge positioned between the frame and the second light emitter. The optical sensor can detect an alignment between the first light emitter and the second light emitter. The optical sensor can detect an alignment between the first waveguide and the second waveguide.
According to some aspects, electronic glasses can include an arm structure defining an internal volume and an aperture, a light emitter disposed at least partially within the internal volume of the arm, the light emitter can include a first optical surface at the aperture, and a frame including a display window and a waveguide. The waveguide can define a second optical surface. When the arm structure is in a closed position, the first optical structure can be separated from the second optical surface, and when the arm structure is in an open position, the first optical surface can be adjacent to the second optical surface to define an optical path between the light emitter and the waveguide.
In some examples, the electronic glasses can include a sensor to detect whether the arm structure is in the open position or closed position. The electronic glasses can include an optical sensor disposed in the frame and optically aligned with the waveguide. An active field-of-view region can be electronically shifted within a projection panel in response to the optical sensor detecting a misalignment between the light emitter and the waveguide. The display window can be a first display window, and the waveguide can be a first waveguide. The frame can include a second display window and a second waveguide. The electronic glasses can further include an optical sensor disposed in the frame and optically aligned with the first display window and the second display window, wherein an active field-of-view region can be shifted within a projection panel in response to the optical sensor detecting a misalignment between the first display window and the second display window.
The disclosure will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
Reference will now be made in detail to representative embodiments illustrated in the accompanying drawings. It should be understood that the following descriptions are not intended to limit the embodiments to one preferred embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as can be included within the spirit and scope of the described embodiments as defined by the appended claims.
The following disclosure relates to a novel structure and alignment mechanism for electronic eyewear (i.e., electronic glasses or head-mountable electronic devices (HMDs)). Binocular-display systems in augmented reality (AR), virtual reality (VR) and mixed reality (MR) (collectively referred to as extended reality (XR)) devices can involve two displays that are aligned relative to each other with a very high precision (around) ˜0.1°. A misalignment of the displays can lead to a range of issues, such as eye strain/discomfort and even total inability to merge the two images.
Traditional or conventional XR display architectures are designed with a structurally rigid connection between the waveguides and the light emitters or projectors, with the projectors fixed to the frame of the device to maintain alignment between the projectors and the waveguides. In some devices, the projectors are mounted above the bridge of the frame, however, this leads to a product having a thick brow form factor, unlike typical glasses. In some devices, the projectors are mounted along a length of fixed arms. However, this arrangement can cause the hinge point to move back behind the projectors, which creates a non-typical and bulky design in the folded state.
Further, the rigid architecture employed by conventional devices relies on the assumption that the alignment between each waveguide and projector is fixed and changes minimally over the device's lifetime. This assumption can quickly break down and cause in-field failures that cannot be diagnosed without an active feedback loop of the alignment between the projectors and the waveguides. Thus, conventional architectures use an extremely rigid optical bench resulting in a higher product weight, increased size, and aesthetically unpleasing designs.
The present disclosure describes using an optical architecture that includes at least one sensor in the bridge or frame of electronic glasses that can directly measure the binocular boresight of the two displays relative to each other. The sensor(s) can be complemented by a projector having an oversized field-of-view (FoV) and capable of performing electronic image shifting to correct for detected misalignment. A bi-stable hinge mechanism can advantageously be positioned between the projector and the waveguide to produce a natural and typical glasses design in a closed configuration. Using the architecture described herein, the electronic glasses include a more natural and compact form factor.
In some examples, the waveguides include a first, main, or primary output coupler that out-couples the image to the user, and a secondary output coupler that out-couples the same image as the user's eye would see. The secondary output coupler is imaged by an optical sensor, such as a camera, and is used to calculate an alignment between the projector and the waveguide, or to calculate the alignment between a first display image and a second display image. For example, the optical sensor can calculate the display boresight.
In some examples, the hinge mechanism can include attachment features such as detents, magnets, protrusions, springs, latches, or any other mechanical features to secure the arms in a folded and unfolded state. In the unfolded state, such as when the user is wearing the glasses, the hinge mechanism can be capable of securing the position of the arm relative to the frame with high repeatability and with low angular variation. A variation from the nominal hinge position can be detected and measured by the optical sensor. Electronic image shifting can then be used to account for variations.
In some examples, the electronic glasses can include at least one projector having an oversized or expanded FoV. Once a misalignment is detected by the optical sensor, an oversized FoV can be used to realign the two displays relative to each other. For example, the projector can reserve additional FoV borders or regions around a nominal active area. In some examples, to achieve a nominal 25° (degrees)×25° (degrees) FoV, an additional ˜1.25° border can be reserved. Thus, in this case, the oversized or expanded projector can include a 27.5°×27.5° FoV. To re-align the two displays, the image can be electronically shifted to display within the projector's capable FoV. Thus, in this specific example, each display can be misaligned by ˜1.25° without cropping any of the image.
In this manner, electronic glasses using an optical bridge sensor in tandem with a robust and accurate hinge attachment system and oversized projector allows for a product desirable form factor product that can realign the displays each time the device is used. Further, the electronic classes advantageously include a hinge-forward design where the projectors are disposed behind the hinges, such that the hinges reside between the frame/waveguides and the projectors.
These and other embodiments are discussed below with reference to
In some examples, the frame 104 can include an optical sensor module 120. The optical sensor module 120 can include one or more optical sensors, such as cameras. The optical sensor module 120 can be disposed, partially or entirely, within the internal volume of the frame 104. In some examples, the optical sensor module 120 can define an exterior of the frame 104. The optical sensor module 120 can be mounted or secured to the frame 104 via a bracket. In some examples, the optical sensor module 120 can provide structural stability and support to the frame 104.
The electronic glasses 100 can include one or more arms 108. In the embodiment depicted in
The electronic device 100 can include multiple modes, states, or configurations. For example, the electronic glasses 100 can include a closed state in which the arms 108 are folded inward to be adjacent to and substantially parallel with the frame 104 (as depicted in
One or more of the arms 108 can include a light emitter or projector 116. In the embodiments described herein, each arm 108 comprises a projector 116. The projectors 116 generate and emit light producing images to be viewed by the user. The projectors 116 can be attached to the arms 108. In some examples, the projectors 116 are disposed within an internal volume of the arms 108. In some examples, the projectors 116 are mounted or attached on an exterior surface of the arms 108.
The projectors 116 can be rigidly fixed within or on the arms 108. In some examples, the projectors 116 can be movably secured to the arms 108. For example, the projectors 116 can be suspended or float within the arm 108 using springs or tensile wires, allowing for relative motion between the projectors 116 and the waveguides. This movement can enable the projectors 116 to move in order to properly couple with the waveguides when the arms 108 assume the open state. When in the open state, the projectors 116 can be locked or fixed in place. For example, the projectors 116 can include mating features that prevent motion of the projectors relative to the waveguides, once the arms 108 are in the open position.
The projectors 116 can be positioned at an end of the arm 108. In some examples, the arms 108 can define an opening or aperture at the end of the arms 108. When in the closed state, the projectors 116 can be exposed to an outside environment. In some examples, an optical surface of the projectors 116 can define an exterior surface of the arm 108 and can be exposed through the open end of the arms 108. In some examples, when in the open state, the optical surfaces of the projectors 116 can be covered or not exposed to the outside environment. A further discussion of the optical surface and optical pathway of the projectors are provided below with reference to
As shown in
In some examples, to detect misalignment between the projectors 116, the electronic glasses 100 can include multiple optical sensors 120 that are aligned rigidly on the frame 104 of the electronic glasses 100. Advantageously, keeping optical sensors 120 rigidly fixed in position on the bridge is less of a challenge than rigidly fixing the entire bridge and projectors, as is done conventionally. In some examples, brackets can rigidly secure the optical sensors 120 in/on the bridge.
In some examples, the arms 108 and/or the frame 104 can include detents, magnets, mechanical features, kinematic mounts, or other features to enable secure, repeatable and consistent connection between optical surfaces when arms 108 are opened. Such attachment features could also enable proper securement for the arms 108 when in the open configuration, even in there is play between the arms 108 and the frame 104 in the closed configuration.
Any of the features, components, and/or parts, including the arrangements and configurations thereof shown in
The first output coupler 238 can be a main or primary output coupler that directs some of the light forming an image 239 to be viewed by an eye 228 of the user. A portion of the light 230 travels beyond the first output coupler 238 to the second output coupler 240. The second output coupler directs light forming an image 242 to an optical sensor 220. The image 239 presented to the eye 228 and the image 242 presented to the optical sensor 220 can be the same.
Any of the features, components, and/or parts, including the arrangements and configurations thereof shown in
The waveguides 301 can include SAG surface relief grating designed with an angle and shape to bounce and split light and allow a portion of the light to continue on. The waveguides 301 can include a plurality of gratings 350 to direct light 339 toward the first output coupler 338. The first output coupler 338 can be a main or primary output coupler that directs some of the light forming an image to be viewed by an eye of the user. A portion of the light 342 travels beyond the first output coupler 338 to the second output coupler 240. The second output coupler directs light forming an image to an optical sensor. The image presented to the eye from the first output coupler 338 and the image presented to the optical sensor from the second output coupler 340 can be the same.
In some examples, the electronic glasses can include a single optical sensor for imaging both second output couplers 340 from each of the waveguides 301. In the case of a single optical sensor monitoring both waveguides 301, there can be a third waveguide or intermediate waveguide (not shown) to direct the light from the waveguides 301 to the optical sensor.
In some examples, the waveguides 301 can produce image replication by taking a single image pupil from the projector and expanding it into multiple pupils toward output couplers 338, 340. Thus, from a single input image, multiple image pupils can be generated using the waveguides 301.
Any of the features, components, and/or parts, including the arrangements and configurations thereof shown in
For example, the projection panel 405 can typically have a field-of-view (FoV) of about 25° of active area. In the present example, the projector can include an extra ˜1.25° of field-of-view around the active DMD panel 305. Thus, when shifts do occur, the projector 416 can shift where on the DMD panel 305 the image is being projected, and accordingly, what the eye sees is still aligned. In some examples, the expanded FoV region 307 can be expanded by between about 1° to 3°, by about 3° to 5°, or by about 8° to 10°. In other words, the projectors can include an active field-of-view region directed onto imaging projection panel, and an expanded field-of-view region that extends beyond the active projection panel.
Any of the features, components, and/or parts, including the arrangements and configurations thereof shown in
In some examples, the hinge cover 530 can move as the arm 508 moves such that an opening or aperture is reveal in the hinge cover 530 to allow for passage of light when the end of the arm 508 is securely positioned against the frame 504, preventing ingress of debris between the arm 508 and the frame 504. As the arm 508 is moved to a closed state, the hinge cover 530 can move to occlude or block the gap formed between the end of the arm 508 and the frame 504.
Any of the features, components, and/or parts, including the arrangements and configurations thereof shown in
At step 605, a target or test image can be projected into the waveguide. The calibration protocol can include instructing the projectors to display a predetermined image or target that is sensed by the optical sensor(s). The position of the target images can be tested against a known location where the target images should be during proper alignment. At step 607, an alignment can be detected by the optical sensor(s). At step 609, upon detecting a misalignment, the calibration protocol can instruct one or more projectors to perform electronic image shifting in order to correct the misalignment. At step 611, realignment of the system can be tested by performing a confirmation calibration protocol. The confirmation calibration protocol can include performing steps 603 and 605 to confirm whether the realignment was successful or if additional correction is needed. The above is one example of a calibration protocol that can be performed using the components and structures (e.g., optical sensor(s) and oversized projector) as described herein.
In some examples, during the calibration protocol, each projector can be compared relative to the other projector. However, this method may not inform the system which projector is misaligned, but rather simply that the projectors are not aligned relative to each other. Thus, in some examples, an aligned test can be performed on each projector, independently, to isolate which projector is out of alignment.
To the extent applicable to the present technology, gathering and use of data available from various sources can be used to improve the delivery to users of invitational content or any other content that may be of interest to them. The present disclosure contemplates that in some instances, this gathered data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data can include demographic data, location-based data, telephone numbers, email addresses, TWITTER® ID's, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other identifying or personal information.
The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to deliver targeted content that is of greater interest to the user. Accordingly, use of such personal information data enables users to calculated control of the delivered content. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.
The present disclosure contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure. Such policies should be easily accessible by users, and should be updated as the collection and/or use of data changes. Personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection/sharing should occur after receiving the informed consent of the users. Additionally, such entities should consider taking any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices. In addition, policies and practices should be adapted for the particular types of personal information data being collected and/or accessed and adapted to applicable laws and standards, including jurisdiction-specific considerations. For instance, in the US, collection of or access to certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly. Hence different privacy practices should be maintained for different personal data types in each country.
Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of advertisement delivery services, the present technology can be configured to allow users to select to “opt in” or “opt out” of participation in the collection of personal information data during registration for services or anytime thereafter. In another example, users can select not to provide mood-associated data for targeted content delivery services. In yet another example, users can select to limit the length of time mood-associated data is maintained or entirely prohibit the development of a baseline mood profile. In addition to providing “opt in” and “opt out” options, the present disclosure contemplates providing notifications relating to the access or use of personal information. For instance, a user may be notified upon downloading an app that their personal information data will be accessed and then reminded again just before personal information data is accessed by the app.
Moreover, it is the intent of the present disclosure that personal information data should be managed and handled in a way to minimize risks of unintentional or unauthorized access or use. Risk can be minimized by limiting the collection of data and deleting data once it is no longer needed. In addition, and when applicable, including in certain health related applications, data de-identification can be used to protect a user's privacy. De-identification may be facilitated, when appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of data stored (e.g., collecting location data a city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and/or other methods.
Therefore, although the present disclosure broadly covers use of personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing such personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data. For example, content can be selected and delivered to users by inferring preferences based on non-personal information data or a bare minimum amount of personal information, such as the content being requested by the device associated with a user, other non-personal information available to the content delivery services, or publicly available information.
The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the described embodiments. However, it will be apparent to one skilled in the art that the specific details are not required in order to practice the described embodiments. Thus, the foregoing descriptions of the specific embodiments described herein are presented for purposes of illustration and description. They are not target to be exhaustive or to limit the embodiments to the precise forms disclosed. It will be apparent to one of ordinary skill in the art that many modifications and variations are possible in view of the above teachings.
This application claims the benefit of U.S. Provisional Patent Application No. 63/585,582, filed 26 Sep. 2023, and entitled “ELECTRONIC GLASSES,” the entire disclosure of which is hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
63585582 | Sep 2023 | US |