The present disclosure relates to a system for calibrating a waveguide-based holographic head-up display.
A head-up display (HUD) shows information such as, for example, vehicle speed and navigational instructions, directly onto a windscreen of a vehicle, within the driver's forward field of view. Accordingly, the head-up display provides drivers with information without looking away from the road. In some instances, head-up displays may be employed in augmented reality displays that overlay images on the windscreen to enhance a driver's view of the environment outside the vehicle and require precision alignment of the images relative to the driver.
After the head-up display is installed into the vehicle at a final assembly plant, an end-of-line calibration is performed to account for distortions that are introduced by variations in the windscreen. During the end-of-line calibration a warp map, which may also be referred to as a distortion compensation map, is calculated. The warp map yields a shaped or pre-distorted image that accounts for variations in the shape of the windscreen, where the pre-distorted image is then projected upon the windscreen. The end-of-line calibration at the final assembly plant may utilize a camera that is mounted upon a robotic arm. During calibration, the robotic arm moves the camera into different positions within an eyebox of the head-up display located within the interior cabin of the vehicle to capture images that are projected upon the windscreen by the head-up display. The warp map is calculated to compensate for the image artifacts at different positions within the eyebox. However, manipulating the camera into different angles by the robotic arm requires a relatively long tact time. Such a relatively long tact time may become difficult to accommodate in some instances, especially when there is only limited time on the assembly line.
Thus, while current approaches to calibrate a head-up display achieve their intended purpose, there is a need in the art for an improved system to calibrate a head-up display in a reduced amount of time.
According to several aspects, a system for calibrating a waveguide-based holographic head-up display that projects images upon a windscreen of a vehicle is disclosed. The system includes a light-diffusing panel positioned at a center of an eyellipse to reflect the images projected by the waveguide-based holographic head-up display, where an eyebox of the waveguide-based holographic head-up display is positioned at the center of an eyellipse, and the eyebox is divided into a plurality of unit exit pupils. The system also includes a camera positioned to capture the images reflected by the light-diffusing panel. The system also includes one or more controllers in electronic communication with the waveguide-based holographic head-up display and the camera. The one or more controllers execute instructions to instruct the waveguide-based holographic head-up display to generate a calibration graphic upon the windscreen of the vehicle, where the calibration graphic includes a plurality of individual calibration patterns that each coincide with one of the plurality of unit exit pupils of the eyebox. The one or more controllers execute instructions to receive image data from the camera, where the image data captures the calibration graphic that is reflected upon the light-diffusing panel, and where the calibration graphic reflected upon the light-diffusing panel includes a plurality of warped individual calibration patterns. The one or more controllers execute instructions to correct distortions in each of the plurality of warped individual calibration patterns of the calibration graphic to create a plurality of corrected individual calibration patterns. The one or more controllers determine a warp map based on the plurality of corrected individual calibration patterns.
In an aspect, at least one fiducial alignment mark is disposed along a light-diffusing surface of the light-diffusing panel.
In another aspect, the light-diffusing panel is positioned in place by aligning the fiducial alignment mark of the light-diffusing surface relative to a center of the eyellipse.
In yet another aspect, the one or more controllers execute instructions to determine a misalignment of the calibration graphic relative to a center of the eyellipse.
In one aspect, the one or more controllers execute instructions to instruct the waveguide-based holographic head-up display to align the calibration graphic with the center of the eyellipse, where once the calibration graphic is aligned with the center of the eyellipse a center of each warped individual calibration pattern of the calibration graphic is aligned with a center of a corresponding corrected individual calibration pattern.
In another aspect, in response to determining the center of each of a plurality of warped individual calibration patterns is aligned with the center of the corresponding corrected individual calibration pattern, the one or more controllers correct distortions in a remaining portion of each of the plurality of warped individual calibration patterns of the calibration graphic.
In yet another aspect, correcting the distortions in the remaining portion of the warped individual calibration pattern includes aligning a remaining portion of a plurality of alignment marks that are part of the warped individual calibration pattern with a plurality of alignment marks that are part of the corresponding corrected individual calibration pattern.
In an aspect, the one or more controllers execute instructions to determine a difference in position between each of the plurality of alignment marks that are part of the warped individual calibration pattern and each of the alignment marks that are part of the corresponding corrected individual calibration pattern.
In another aspect, the warp map includes a plurality of individual unit exit pupil warp maps that each correspond to one of the unit exit pupils of the eyebox.
In yet another aspect, each individual unit exit pupil warp map includes a plurality of coordinates that each correspond to an alignment mark that is part of the individual calibration pattern.
In an aspect, the individual calibration pattern includes a symmetrical array of alignment marks that are arranged in corresponding rows and columns.
In another aspect, the alignment marks are dots.
In yet another aspect, the waveguide-based holographic head-up display includes a holographic projector and a waveguide, and the holographic projector includes a laser light source and a spatial light modulator.
In an aspect, a vehicle is disclosed. The vehicle includes a windscreen, a waveguide-based holographic head-up display that projects images upon the windscreen of the vehicle, and a system for calibrating the waveguide-based holographic head-up display. The system includes a light-diffusing panel positioned at a center of an eyellipse to reflect the images projected by the waveguide-based holographic head-up display, where an eyebox of the waveguide-based holographic head-up display is positioned at the center of eyellipse the light-diffusing panel, and wherein the eyebox is divided into a plurality of unit exit pupils. The system also includes a camera positioned to capture the images reflected by the light-diffusing panel. Finally, the system includes one or more controllers in electronic communication with the waveguide-based holographic head-up display and the camera, where the one or more controllers execute instructions to instruct the waveguide-based holographic head-up display to generate a calibration graphic upon the windscreen of the vehicle, where the calibration graphic includes a plurality of individual calibration patterns that each coincide with one of the plurality of unit exit pupils of the eyebox. The one or more controllers receive image data from the camera, where the image data captures the calibration graphic that is reflected upon the light-diffusing panel, and wherein the calibration graphic reflected upon the light-diffusing panel includes a plurality of warped individual calibration patterns. The one or more controllers correct distortions in each of the plurality of warped individual calibration patterns of the calibration graphic to create a plurality of corrected individual calibration patterns. Finally, the one or more controllers determine a warp map based on the plurality of corrected individual calibration patterns.
In another aspect, a method for calibrating a waveguide-based holographic head-up display that projects images upon a windscreen of a vehicle is disclosed. The method includes instructing the waveguide-based holographic head-up display to generate a calibration graphic upon the windscreen of the vehicle by one or more controllers, where the calibration graphic includes a plurality of individual calibration patterns that each coincide with one of a plurality of unit exit pupils of an eyebox, and where the eyebox of the waveguide-based holographic head-up display is positioned at a center of an eyellipse the light-diffusing panel. The method also includes receiving, by the one or more controllers, image data from a camera, where the image data captures the calibration graphic that is reflected upon a light-diffusing panel, and where the calibration graphic reflected upon the light-diffusing panel includes a plurality of warped individual calibration patterns, and where the light-diffusing panel is positioned at the center of the eyellipse. The method includes correcting distortions in each of the plurality of warped individual calibration patterns of the calibration graphic to create a plurality of corrected individual calibration patterns. The method includes determining, by the one or more controllers, a warp map based on the plurality of corrected individual calibration patterns.
In another aspect, the method includes determining a misalignment of the calibration graphic relative to a center of the eyellipse.
In yet another aspect, the method includes instructing the waveguide-based holographic head-up display to align the calibration graphic with the center of the eyellipse, where once the calibration graphic is aligned with the center of the eyellipse a center of each warped individual calibration pattern of the calibration graphic is aligned with a center of a corresponding corrected individual calibration pattern.
In an aspect, in response to determining the center of each of a plurality of warped individual calibration patterns is aligned with the center of the corresponding corrected individual calibration pattern, the method includes correcting distortions in a remaining portion of each of the plurality of warped individual calibration patterns of the calibration graphic.
In another aspect, the method includes correcting the distortions in the remaining portion of the warped individual calibration pattern by aligning a remaining portion of a plurality of alignment marks that are part of the warped individual calibration pattern with a plurality of alignment marks that are part of the corresponding corrected individual calibration pattern.
In yet another aspect, the method includes determining a difference in position between each of the plurality of alignment marks that are part of the warped individual calibration pattern and each of the alignment marks that are part of the corresponding corrected individual calibration pattern.
Further areas of applicability will become apparent from the description provided herein. It should be understood that the description and specific examples are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
The drawings described herein are for illustration purposes only and are not intended to limit the scope of the present disclosure in any way.
The following description is merely exemplary in nature and is not intended to limit the present disclosure, application, or uses.
Referring to
The waveguide-based holographic head-up display 12 includes a holographic projector 30 and a waveguide 32, where the holographic projector 30 includes a laser light source 34 and a spatial light modulator 36. The one or more controllers 20 are in electronic communication with the holographic projector 30. The spatial light modulator 36 is positioned between the laser light source 34 and the waveguide 32. The spatial light modulator 36 is configured to receive laser light from the laser light source 34 and project a holographic image into an exit pupil replicator 38 of the waveguide 32, where the holographic image propagates inside the exit pupil replicator 38 and is extracted multiple times before being projected towards the windscreen 16 as the virtual image. The one or more controllers 20 instruct the holographic projector 30 of the waveguide-based holographic head-up display 12 to generate the virtual images that are projected onto the windscreen 16.
As mentioned above, a fixture (not shown) is used during calibration of the waveguide-based holographic head-up display 12 to secure the light-diffusing panel 24 in place within an interior cabin 50 of the vehicle 14.
Referring to
Referring to
Referring to
It is to be appreciated that the eyellipse 54 only represents a potential location of the eyes of a driver. However,
Referring to
After the system 10 calibrates the waveguide-based holographic head-up display 12 and the light-diffusing panel 24 is removed, a driver may be seated within the vehicle 14, where the head of the driver is located within the eyebox 58. The camera 22 may then capture the location of the right and left eyes of the driver, and the one or more controllers 20 determine the unit exit pupils 44 that correspond to the actual positions A, B of the right and left eyes of the driver. The controller 20 may then select the individual unit exit pupil warp maps 102 (
Referring to
It is to be appreciated that the calibration graphic 60 reflected by the light-diffusing panel 24 includes distortions that are created by variations in the shape of the windscreen 16 of the vehicle 14. Referring to
Referring to
In response to determining the center 74 of each warped individual calibration pattern 68 is aligned with the center 78 of the corrected individual calibration pattern 70, the one or more controllers 20 correct the distortions in a remaining portion of each of the plurality of warped individual calibration patterns 68 of the calibration graphic 60. Specifically, in the example as shown in
Referring now to
In block 204, the one or more controllers 20 receive a prompt indicating the waveguide-based holographic head-up display 12 is to be calibrated. The method 200 may then proceed to block 206.
In block 206, in response to receiving the prompt, the one or more controllers 20 instruct the waveguide-based holographic head-up display 12 to generate the calibration graphic 60 (
In block 208, the one or more controllers 20 receive image data from the camera 22, where the image data captures the calibration graphic 60 (
In block 210, the one or more controllers 20 correct distortions in each of the plurality of warped individual calibration patterns 68 (
As mentioned above, correcting the distortions includes first determining the misalignment of the calibration graphic 60 (
In block 212, the one or more controllers 20 determine the warp map 100 (
Referring generally to the figures, the disclosed system for calibrating the waveguide-based holographic head-up display provides various technical effects and benefits. Specifically, the disclosure provides a relatively quick, cost-effective approach to determine a warp map for each exit unit pupil of the eyebox. The disclosed system results in reduced tact time when compared to conventional approaches that perform the end-of-line calibration to determine the warp map. The disclosed system also determines unique warp maps that each coincide with one of the plurality of unit exit pupils of the eyebox. Thus, once a driver is located within the eyebox, the system may select the warp maps that correspond to the unit exit pupils that represent the actual positions of the right and left eyes of the driver.
The controllers may refer to, or be part of an electronic circuit, a combinational logic circuit, a field programmable gate array (FPGA), a processor (shared, dedicated, or group) that executes code, or a combination of some or all of the above, such as in a system-on-chip. Additionally, the controllers may be microprocessor-based such as a computer having a at least one processor, memory (RAM and/or ROM), and associated input and output buses. The processor may operate under the control of an operating system that resides in memory. The operating system may manage computer resources so that computer program code embodied as one or more computer software applications, such as an application residing in memory, may have instructions executed by the processor. In an alternative embodiment, the processor may execute the application directly, in which case the operating system may be omitted.
The description of the present disclosure is merely exemplary in nature and variations that do not depart from the gist of the present disclosure are intended to be within the scope of the present disclosure. Such variations are not to be regarded as a departure from the spirit and scope of the present disclosure.