This relates generally to electronic devices, and, more particularly, to electronic devices such as head-mounted devices.
Electronic devices such as head-mounted devices may have displays for displaying images. The displays may be housed in a head-mounted support structure.
A head-mounted device may have optical components that are used to provide images to eye boxes for viewing by a user. The optical components, which may sometimes be referred to as optics or optical parts, may include display projectors that produce images. The head-mounted device may have a glasses frame and/or other head-mounted support structures to support the optical components.
The optical components in the head-mounted device may include waveguides and optical couplers. The waveguides may be used in conveying the images from the projectors to the eye boxes. Optical couplers such as prisms may be used to couple images from the projectors into the waveguides. The waveguides may guide the images to output couplers that couple the images toward the eye boxes for viewing by a user.
During operation of the head-mounted device, sensor circuitry may be used to measure for potential misalignment between the optical components that could lead to unwanted image distortion. Control circuitry may provide control commands to zero hold power piezoelectric actuators or other positioners based on the sensor measurements, thereby tilting and otherwise repositioning the optical components relative to each other to correct for optical component misalignment.
Electronic devices such as head-mounted devices may include displays for presenting content to users. The displays may be projectors. A head-mounted device may have a left projector that produces a left image and a right projector that produces a right image. Optical systems (sometimes referred to as optical assemblies) such as systems based on optical prisms, waveguides and/or other optical components (sometimes referred to as optics or optical parts) may be used to convey the left and right images from the projectors to corresponding left and right eye boxes where the images may be viewed by a user. To compensate for potential misalignment between the projectors, waveguides, and optical components such as prisms, a head-mounted device may be provided with alignment systems (sometimes referred to as aligners, alignment circuitry, or positioners). The alignment systems may use low-power actuators to adjust the positions of components in the head-mounted device and thereby ensure that images are provided satisfactorily to the left and right eye boxes.
A schematic diagram of an illustrative system that may include a head-mounted device is shown in
As shown in
During operation, the communications circuitry of the devices in system 8 (e.g., the communications circuitry of control circuitry 12 of device 10), may be used to support communication between the electronic devices. For example, one electronic device may transmit video data, audio data, and/or other data to another electronic device in system 8. Electronic devices in system 8 may use wired and/or wireless communications circuitry to communicate through one or more communications networks (e.g., the internet, local area networks, etc.). The communications circuitry may be used to allow data to be received by device 10 from external equipment (e.g., a tethered computer, a portable device such as a handheld device or laptop computer, online computing equipment such as a remote server or other remote computing equipment, or other electrical equipment) and/or to provide data to external equipment.
Device 10 may include input-output devices 22 (sometimes referred to as input-output circuitry or input-output). Input-output devices 22 may be used to allow a user to provide device 10 with user input (e.g., input-output devices 22 may have input sensors with which a user provides device 10 with input). Input-output devices 22 may also be used to gather information on the environment in which device 10 is operating (e.g., using sensors). Output components in devices 22 may allow device 10 to provide a user with output and may be used to communicate with external electrical equipment.
As shown in
Displays 14 are used to display visual content for a user of device 10. The content that is presented on displays 14 may include virtual objects and other content that is provided to displays 14 by control circuitry 12. This virtual content may sometimes be referred to as computer-generated content. Computer-generated content may be combined with real-world content by using an optical coupling system that allows computer-generated content to be optically overlaid on top of a real-world image. As an example, device 10 may have a see-through display system that provides a computer-generated image to a user through a beam splitter, prism, holographic coupler, diffraction grating, or other optical coupler (e.g., an output coupler on a waveguide that is being used to provide computer-generated images to the user) while allowing the user to view real-world objects through the optical coupler and other transparent structures (e.g., transparent waveguide structures, vision-correction lenses and/or other lenses, etc.).
Input-output circuitry 22 may include sensors 16. Sensors 16 may include, for example, three-dimensional sensors (e.g., three-dimensional image sensors such as structured light sensors that emit beams of light and that use two-dimensional digital image sensors to gather image data for three-dimensional images from light spots that are produced when a target is illuminated by the beams of light, binocular three-dimensional image sensors that gather three-dimensional images using two or more cameras in a binocular imaging arrangement, three-dimensional lidar (light detection and ranging) sensors, three-dimensional radio-frequency sensors, or other sensors that gather three-dimensional image data), cameras (e.g., infrared and/or visible digital image sensors), gaze tracking sensors (e.g., a gaze tracking system based on an image sensor and, if desired, a light source that emits one or more beams of light that are tracked using the image sensor after reflecting from a user's eyes), touch sensors, capacitive proximity sensors, light-based (optical) proximity sensors, other proximity sensors, force sensors, sensors such as contact sensors based on switches, gas sensors, pressure sensors, moisture sensors, magnetic sensors, audio sensors (microphones), ambient light sensors, microphones for gathering voice commands and other audio input, sensors that are configured to gather information on motion, position, and/or orientation (e.g., accelerometers, gyroscopes, compasses, and/or inertial measurement units that include all of these sensors or a subset of one or two of these sensors), and/or other sensors.
User input and other information may be gathered using sensors and other input devices in input-output devices 22. If desired, input-output devices 22 may include other devices 24 such as haptic output devices (e.g., vibrating components), light-emitting diodes and other light sources, speakers such as ear speakers for producing audio output, circuits for receiving wireless power, circuits for transmitting power wirelessly to other devices, batteries and other energy storage devices (e.g., capacitors), joysticks, buttons, and/or other components. Actuators in devices 22 may be used to adjust the positions of components in device 10. For example, actuators may be used to adjust the angular orientation of display projectors, optical coupling components such as prims, and waveguides.
Electronic device 10 may have housing structures (e.g., housing walls, straps, etc.), as shown by illustrative support structures 26 of
During operation of device 10, images are presented to a user's eyes in eye boxes 30 from projectors 36 using waveguides 38. Waveguides 38 are transparent, so that a user with eyes located in eye boxes 30 may view real-world objects such as objects 34 through waveguides 38 while simultaneously viewing overlaid computer-generated (virtual) images such as virtual image 32.
Eye boxes 30 include a left eye box that receives a left image and a right eye box that receives a right image. Device 10 may include a left display system that presents the left image to the left eye box and a right display system that presents the right image to the right eye box. In an illustrative configuration, each display system has a corresponding projector 36, a waveguide 38, and an optical coupler (e.g., a prism and/or other optical coupling element(s)) to couple an image from the projector into the waveguide from the projector. An output coupler on each waveguide may be used to couple the image out of that waveguide towards a respective eye box after the waveguide has guided the image to a location overlapping the eye box.
In the illustrative configuration of
During use of device 10, device 10 may be subjected to excessive stress (e.g., during drop events or other events in which more force than desired is applied to structures 26 and other portions of device 10). This may lead to a potential for optical components (sometimes referred to as optics or optical parts) in device 10 to become misaligned. As one example, projectors 36 may become angularly misaligned relative to waveguides 38 and prisms in device 10. In some scenarios, optical component misalignment (sometimes referred to as optical part misalignment or optics misalignment) may occur due to deformation of structures 26 as device 10 is being worn on a user's head.
To compensate for optical component movements, the relative angular orientation of components (structures) in device 10 (e.g., the orientation of parts such as projectors, prisms, waveguides or other optics, housing structures, etc.) can be monitored using sensor circuitry (e.g., one or more sensors 16) to detect optical misalignment. As an example, a nose bridge strain gauge sensor may be used to determine when some or all of the housing of device 10 and the components in device 10 exhibits misalignment (e.g., misalignment as the left and right sides of device 10 bend about the X axis of
Optical sensors, inertial measurement units, or other sensor devices that measure changes in angular orientation (and, if desired, changes in lateral position) of optical components in device 10 may make real time optical misalignment measurements (e.g., angular orientation measurements, etc.) that reveal optical misalignment of the optics in device 10. Control circuitry 12 can use this optical component orientation information to control actuators in device 10. The actuators may be used to reposition any misaligned components and thereby compensate for measured misalignment (e.g., by measuring optical misalignment, the positioners in device 10 can correct the optical misalignment). As an example, control circuitry 12 may use sensor circuitry to detect that the left projector in device 10 has become angularly misaligned by 0.5° relative to the left waveguide in device 10. Based on this measurement, the position (e.g., angular orientation) of the left projector and/or the left waveguide may be adjusted so that the left projector and left waveguide are aligned as desired. In this way, image distortion (e.g., keystoning, image rotation, etc.) that might otherwise arise when components become misaligned can be avoided.
As shown in
In the example of
To conserve battery power (e.g., when device 10 is running solely on a battery), it may be desirable to minimize power consumption by actuators 40. This may be accomplished by using actuators that do not consume power unless actively being used to reposition components. These actuators may sometimes be referred to as zero holding power actuators, because no power is consumed when components are held in position, only when the actuators are being adjusted to reposition components. Examples of zero holding power actuators that may be sued in device 10 include motor-driven lead screw actuators, stepper motors, and zero holding power piezoelectric actuators. Zero holding power piezoelectric actuators, which may sometimes be described herein as an example, may be light in weight and compact, thereby helping to avoid producing excess weight or size for device 10.
The operation of a zero holding power actuator (no holding power actuator) such as a zero holding power piezoelectric actuator is shown in the graphs of
Prism module (prism) 58 may include a prism to reflect image light (image 62) towards waveguide 38 and may, if desired, include optical components such as lenses (sec, e.g., illustrative optical component 60). Prism module 58 may be mounted on a hemispherical pivot or other pivot such as pivot 48 (e.g., a pivot mounted to structures 26). This allow prism module 58 to be tilted in two dimensions. For example, a first of actuators 40 that is coupled between projector 36 and prism module 58 may be used to rotate module 58 about the X axis and a second of actuators 40 that is coupled between projector 36 and prism module 58 may be used to rotate module 58 about the Y axis).
In the example of
In some embodiments, sensors may gather personal user information. To ensure that the privacy of users is preserved, all applicable privacy regulations should be met or exceeded and best practices for handling of personal user information should be followed. Users may be permitted to control the use of their personal information in accordance with their preferences.
In accordance with an embodiment, a head-mounted device is provided that includes a head-mounted support, a projector supported by the head-mounted support and configured to produce an image, a waveguide supported by the head-mounted support and configured to guide the image, at least one sensor configured to measure optical misalignment of at least one of: the projector or the waveguide, and a positioner configured to adjust based on the measured optical misalignment to correct the optical misalignment.
In accordance with another embodiment, the head-mounted device includes a prism configured to direct the image from the projector to the waveguide, the at least one sensor is configured to measure angular orientation between the projector and the prism, the positioner includes a zero hold power piezoelectric actuator, and the positioner is configured to prevent misalignment-induced distortion to the image by using the zero hold power piezoelectric actuator to adjust the angular orientation between the projector and the prism.
In accordance with another embodiment, the positioner includes a zero holding power actuator.
In accordance with another embodiment, the head-mounted device includes a pivot about which a given one of the projector and the waveguide tilts.
In accordance with another embodiment, the head-mounted device includes a prism.
In accordance with another embodiment, the pivot is configured to allow a given one of the projector, the waveguide, and the prism to tilt about two different axes.
In accordance with another embodiment, the head-mounted device includes a prism.
In accordance with another embodiment, positioner is configured to adjust angular alignment between the projector and the prism.
In accordance with another embodiment, the positioner is configured to adjust angular alignment between the prism and the waveguide.
In accordance with another embodiment, the head-mounted device includes fluid between the prism and the waveguide, the prism is configured to receive the image from the projector after the image has passed through the waveguide.
In accordance with an embodiment, a head-mounted device is provided that includes a head-mounted support, left and right waveguides supported by the head-mounted support, left and right projectors configured to produce respective left and right images, left and right optical couplers configured to couple the left and right images respectively into the left and right waveguides, and zero hold power actuators configured to move the left and right optical couplers relative to the left and right projectors, respectively.
In accordance with another embodiment, the head-mounted device includes at least one sensor configured to measure angular orientations of the left and right projectors relative to the left and right optical couplers, respectively.
In accordance with another embodiment, the zero hold power actuators are configured to tilt the left and right optical couplers relative to the left and right projectors to compensate for misalignment between the left and right optical couplers and the left and right projectors, respectively.
In accordance with another embodiment, the zero hold power actuators include at least one zero hold power actuator coupled to the head-mounted support.
In accordance with another embodiment, the zero hold power actuators include at least one zero hold power actuator coupled to a selected one of the left and right projectors.
In accordance with another embodiment, the left and right optical couplers each include a tiltable prism.
In accordance with an embodiment, a head-mounted device is provided that includes a head-mounted support, a projector, a waveguide, and a prism that are supported by the head-mounted support and that are configured to provide an image to an eye box, and at least one zero hold power piezoelectric actuator configured to adjust optical alignment of the projector, the waveguide, and the prism.
In accordance with another embodiment, at least a given one of the projector, the waveguide, and the prism is tilted about a pivot by the zero hold power piezoelectric actuator.
In accordance with another embodiment, the zero hold power piezoelectric actuator is configured to tilt the projector.
In accordance with another embodiment, the zero hold power piezoelectric actuator is configured to tilt the waveguide.
The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application is a continuation of international patent application No. PCT/US2022/043217, filed Sep. 12, 2022, which claims priority to U.S. provisional patent application No. 63/246,452, filed Sep. 21, 2021, which are hereby incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
63246452 | Sep 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2022/043217 | Sep 2022 | WO |
Child | 18444945 | US |