The present invention relates generally to display systems, and more specifically to the treatment of chromatic aberrations in display systems.
Laser beam scanning display systems typically scan a white light beam composed of red, green, and blue laser beams on a planar surface using a scanner that moves the beam on two axes. Various distortion mechanisms may cause distortions in the resultant image, including distortions caused by the relative geometry between light sources and scanners, and chromatic aberrations caused by optical devices in the light path.
In the following detailed description, reference is made to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It is to be understood that the various embodiments of the invention, although different, are not necessarily mutually exclusive. For example, a particular feature, structure, or characteristic described herein in connection with one embodiment may be implemented within other embodiments without departing from the scope of the invention. In addition, it is to be understood that the location or arrangement of individual elements within each disclosed embodiment may be modified without departing from the scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims, appropriately interpreted, along with the full range of equivalents to which the claims are entitled. In the drawings, like numerals refer to the same or similar functionality throughout the several views.
In operation, video buffer 402 stores one or more rows of video content at 401 and provides drive values on node 403 starting when commanded by drive circuit 470 through the video buffer enable signal 471. The commanded drive values correspond to electrical currents for visible light sources within laser scanning module 440 (e.g., red, green, and blue laser diodes) such that the output intensity from the laser light sources is consistent with the input video content. In some embodiments, this process occurs at output pixel rates in excess of 150 MHz.
In some embodiments, the video data arrives row by row. For example, the first video data received may correspond to an upper left pixel in an image. Succeeding video data represents the remainder of the pixels in the top row from left to right, and then further rows from top to bottom. When the bottom right of the image is reached, then a complete “frame” of video data has been supplied. The rate at which frames of video data are received is referred to herein as the “frame rate.” In typical applications, an input vertical sync (VSYNC) signal 413 is received with the video data and is asserted once per frame. Accordingly, the input VSYNC is periodic at the frame rate.
Laser scanning module 440 includes laser light sources 420, beam combining optics 430, fold mirror 450, scanning device 414, and slow-scan chromatic aberration correcting optics 442. In some embodiments, laser light sources 420 include at least two laser light sources that emit light of different wavelengths. For example, in some embodiments, laser light sources 420 include a first laser diode that emits red light and a second laser diode that emits green light. Also for example, in some embodiments, laser light sources 420 include a third laser diode that emits blue light. In still further embodiments, laser light sources 420 includes a fourth laser diode that emits infrared (IR) light. These and other embodiments are described further below. The terms “red,” “green,” and “blue” are used herein to refer to wavelengths that are perceived by a human eye as that particular color. For example, “red” refers to any wavelength of light that a human may perceive as the color red, “green” refers to any wavelength of light that a human may perceive as the color green, and “blue” refers to any wavelength of light that a human may perceive as the color blue.
Beam combining optics 430 includes one or more optic devices that combine laser light received from laser light sources 420. This combined laser beam is reflected off fold mirror 450 and directed to scanning mirror 416 within scanning device 414. In some embodiments, fold mirror 450 is included in beam combining optics 430, and in other embodiments, fold mirror 450 is omitted.
In some embodiments, scanning mirror 416 is an ultra-high speed gimbal mounted two dimensional bi-axial laser scanning mirror. In some embodiments, this bi-axial scanning mirror is fabricated from silicon using MEMS processes. In some embodiments, two independent MEMS mirrors are employed in a combined optical system, each responsible for one of the scan axes. One axis of rotation is operated quasi-statically and creates a sawtooth raster trajectory. This axis is also referred to as the slow-scan axis. The second axis of rotation is orthogonal to the first and is operated on a resonant vibrational mode of the scanning mirror. In some embodiments, the MEMS device uses electromagnetic actuation, achieved using a miniature assembly containing the MEMS die and small subassemblies of permanent magnets and an electrical interface, although the various embodiments are not limited in this respect. For example, some embodiments employ electrostatic or piezoelectric actuation. Any type of mirror actuation may be employed without departing from the scope of the present invention. In some embodiments, the slow-scan axis corresponds to the vertical axis and the fast-scan axis corresponds to the horizontal axis, although this is not a limitation of the present invention. For example, a rotation of the projector may result in the fast-scan axis being the vertical axis and the slow-scan axis being the horizontal axis
In some embodiments, raster scan 482 is formed by combining a sinusoidal component on the horizontal fast-scan axis and a sawtooth component on the vertical slow-scan axis. In these embodiments, output beam 417 sweeps sinusoidally on the horizontal (back and forth left-to-right) axis, and sweeps vertically (top-to-bottom) in a sawtooth pattern with the display blanked during flyback (bottom-to-top).
Slow-scan chromatic aberration correcting optics 442 is an optical device that receives the light beam from the scanning mirror, expands the field of view, and corrects for chromatic aberrations on the vertical slow-scan axis. Slow-scan chromatic aberration correcting optics 442 may also correct other distortions such as keystone distortion and smile distortion. Example embodiments of slow-scan chromatic aberration correcting optics are described further below with reference to later figures.
A mirror drive circuit 470 provides a slow-scan drive signal on node 487 and a fast-scan drive signal on node 489. The fast-scan drive signal on node 489 includes an excitation signal to control the resonant angular motion of scanning mirror 416 on the fast-scan axis, and the slow-scan drive signal includes an excitation signal to cause deflection on the slow-scan axis. The slow-scan and fast-scan drive signals are combined by summer 485 to produce a drive signal on node 473 used to drive MEMS device 414. The resulting mirror deflection on both the fast and slow-scan axes causes output beam 417 to generate a raster scan 482 in field of view 480. In video projection operation, the laser light sources produce light pulses for each output pixel and scanning mirror 416 reflects the light pulses as beam 417 traverses the raster pattern.
Mirror drive circuit 470 receives a fast-scan position feedback signal from scanning device 414 on node 475, and also receives a slow-scan position feedback signal on node 477. The fast-scan position feedback signal on node 475 provides information regarding the position of scanning mirror 416 on the fast-scan axis as it oscillates at a resonant frequency. In some embodiments, the fast-scan position feedback signal describes the instantaneous angular position of the mirror, and in other embodiments, the feedback signal is periodic at the frequency of oscillation. The slow-scan position feedback signal on node 477 provides information regarding the position of scanning mirror 416 on the slow-scan axis. In some embodiments, the slow-scan position feedback signal is used to phase lock movement on the slow-scan axis to the period of the input VSYNC signal received on node 413. In these embodiments, the frequency of movement on the slow-scan axis is dictated by a received sync signal (in this case, the input VSYNC).
Scanning device 414 may include any suitable circuit elements to sense mirror position on the fast-scan axis and slow-scan axis. For example, in some embodiments, scanning device 414 includes piezoelectric sensors to sense mirror position on the two axes. In some embodiments, scanning device 414 includes one or more analog-to-digital converters to digitize sensed position information. In these embodiments, either or both of the fast-scan feedback signal and the slow-scan position feedback signal are digital representations of the mirror position on the two axes. In other embodiments, the feedback signals are analog signals, and drive circuit 470 includes one or more analog-to-digital converters to digitize the feedback signals as appropriate.
Drive circuit 470 may be implemented in hardware, a programmable processor, or in any combination. For example, in some embodiments, drive circuit 470 is implemented in an application specific integrated circuit (ASIC). Further, in some embodiments, some of the faster data path control is performed in an ASIC and overall control is provided by a software programmable microprocessor.
Fast-scan chromatic aberration compensation circuit 406 receives the commanded drive values on node 403 and electronically compensates for chromatic aberrations on the fast-scan axis by separately varying the timing of the drive values for each laser light source as a function of mirror position as represented by the fast-scan position feedback signal and the slow-scan position feedback signal. As a result, the timing of drive signals presented to the laser light sources on node 407 compensate for dispersion on the fast-scan axis caused by slow-scan chromatic aberration correcting optics 442. In some embodiments, fast-scan chromatic aberration compensation circuit 406 also corrects for image distortions such as keystone distortion. Various embodiments of fast-scan chromatic aberration compensation circuit 406 are described further below with reference to later figures.
The chromatic aberrations on the slow-scan axis shown in
The design and manufacture of slow-scan chromatic aberration correcting optics 442 is simplified by limiting the chromatic aberration correction to the slow-scan axis. As shown in
In some embodiments, lens 910 and 920 are shaped to correct for keystone distortion. Lenses 910 and 920 also have different indices of refraction and/or Abbe number to correct for chromatic aberrations on the vertical fast-scan axis. For example, in some embodiments, lens 910 is made of a plastic material with an index of refraction (n) between 1.51 and 1.53 and an Abbe number of 56, and lens 920 is made of a polycarbonate material with n=1.63-1.68 and an Abbe number of 23. These indices of refraction and Abbe numbers are provided as examples and the various embodiments of the present invention may include lenses having higher or lower indices of refraction and higher or lower Abbe numbers.
In some embodiments, lenses 910 and 920 may be designed according to, and described by, polynomials. The present invention is not limited by the type or number of polynomials that are used to describe lens or mirror surfaces.
In some embodiments, lenses 910 and 920 may be designed according to, and described by, Chebyshev polynomials. For example, using a finite sum of Chebyshev polynomial terms, the resulting sag equation may take the form:
where:
z is the sag of the surface parallel to the z-axis;
c is the vertex curvature;
aij are the coefficients of the Chebyshev polynomial sum;
N and M are the maximum polynomial orders in x and y dimensions.
The first ten Chebyshev polynomial coefficients are given by:
T
0(x)=1;
T
1(x)=x;
T
2(x)=2x2−1;
T
3(x)=4x3−3x;
T
4(x)=8x4−8x2+1;
T
5(x)=16x5−20x3+5x;
T
6(x)=32x6−48x4+18x2−1;
T
7(x)=64x7−112x5+56x3−7x;
T
8(x)=128x8−256x6+160x4−32x2+1;
T
9(x)=256x9−576x7+432x5−120x3+9x; and
T
10(x)=512x10−1280x8+1120x6−400x4+50x2−1.
In other embodiments, lenses 910 and 920 may designed according to, and described by, Zernike polynomials. For example, Zernike polynomial surface equations may take the form:
where:
z is the sag of the surface parallel to the z-axis;
c is the vertex curvature;
k is the conic constant;
r is the radial distance=√{square root over (x2+y2)};
ZPj is the jth Zernike polynomial (range of j: 1 to 66);
C(j+1) is the coefficient for ZPj; and
In still further embodiments, polynomials describing free form surfaces of lenses and/or mirrors may include extended polynomial terms and take the form:
where:
z is the sag of the surface parallel to the z-axis;
c is the vertex curvature;
k is the conic constant;
r is the radial distance=√{square root over (x2+y2)};
N is the number of extended polynomial terms;
Ai is the coefficient on the ith extended polynomial term; and
Ei is the ith extended polynomial term.
The polynomial terms E are a power series in x and y. The first term is x, then y, then x2, xy, y2, etc.
Various embodiments of the slow-scan chromatic aberration correcting optics employ different lens designs to achieve various combinations of field of view expansion, keystone correction, and chromatic aberration correction on the slow-scan axis.
A variety of techniques may be used for determining polynomial coefficients and other parameters used to determine shapes and material properties of lenses 910 and 920 to achieve field of view expansion, keystone distortion correction, and chromatic aberration correction on the vertical slow-scan axis. For example, the optimization of all surfaces in the lenses may be determined together along with material choices with the corresponding indices of refraction and Abbe numbers.
As one example, a merit function can be provided that defines the various constraints and goals of the projected image. For example, the merit function can define target levels of field of view expansion, keystone distortions at various projection distances, and chromatic aberration targets on the vertical slow-scan axis. Other potential parameters and constraints in the merit function may include target laser spot size, ratio of laser spot size to pixel image size, image size target and horizontal or vertical line spacing targets.
Various embodiments of the present invention weight some of these parameters and constraints more or less in the merit function depending on specific needs. For example, in some embodiments it may be desirable to heavily weight a target spot size. In other embodiments it may be desirable to limit the amount of work done by a particular lens surface. For example, it may be desirable to increase the amount of work done by reflective surfaces compared to the work done by refractive surfaces to reduce the amount of chromatic aberration that would otherwise occur in the refractive surfaces. With these and other parameters included in the merit function, optical optimization software can be used to find a local or global minimum of the merit function and provide the ability to make appropriate tradeoffs. Thus, the parameters can be determined that precisely define the surface shapes and material properties (e.g., index of refraction, Abbe number) of lens 910 and lens 920.
In some embodiments, laser light sources 420 emit visible light such as red, green, and blue light. In other embodiments, laser light sources 420 emit nonvisible light such as IR light. In still further embodiments, laser light sources 420 emit a combination of visible and nonvisible light. In operation, laser light sources 420 emit light that is collimated, focused, and combined by optics 430. Optics 430 may include mirrors, dichroic mirrors, polarization rotating devices, and polarizing beam splitters and/or combiners as appropriate depending on the number and wavelengths of light beams to be combined. Scanning device 414 receives the combined output beam from optics 430. In some embodiments, as shown in
In some embodiments, delay values are determined mathematically as a function of pixel position. For example, in some embodiments, polynomials that represent the chromatic aberrations are produced as part of the design process, and these polynomials are used to determine delay values to compensate for chromatic aberrations.
Method 1500 is shown beginning with block 1510. As shown at 1510, laser light pulses of different wavelengths are produced at different times to compensate for chromatic aberrations on a first scan axis of a lens system. For example, the timing of laser light source drive signals may be individually controlled to compensate for chromatic aberrations on a fast-scan axis of lens system. In some embodiments, red, green, and blue laser light pulses are produced for a single display pixel at different times that are a function of pixel position.
At 1520, the laser light pulses are scanned on the first scan axis and on a second scan axis substantially perpendicular to the first scan axis. For example, a scanning mirror may scan sinusoidally on the first scan axis and non-sinusoidally on the second scan axis. In some embodiments, the laser light pulses are scanned using a single biaxial scanning mirror, and in other embodiments, the laser light pulses are scanned using two scanning mirrors, at least one of which may be resonant.
At 1530, the scanned laser light pulses are passed through the lens system, where the lens system is shaped to reduce chromatic aberrations on the second axis. In some embodiments, the lens system includes two lenses having different indices of refraction and Abbe number as described above. In some embodiments, the lens system may also expand a field of view and correct for other distortions, such as keystone distortion.
Scanning system 1601 may receive image data from any image source. For example, in some embodiments, scanning system 1601 includes memory that holds still images. In other embodiments, scanning system 1601 includes memory that includes video images. In still further embodiments, scanning system 1601 displays imagery received from external sources such as connectors, wireless interface 1610, a wired interface, or the like.
Wireless interface 1610 may include any wireless transmission and/or reception capabilities. For example, in some embodiments, wireless interface 1610 includes a network interface card (NIC) capable of communicating over a wireless network. Also for example, in some embodiments, wireless interface 1610 may include cellular telephone capabilities. In still further embodiments, wireless interface 1610 may include a global positioning system (GPS) receiver. One skilled in the art will understand that wireless interface 1610 may include any type of wireless communications capability without departing from the scope of the present invention.
Processor 1620 may be any type of processor capable of communicating with the various components in mobile device 1600. For example, processor 1620 may be an embedded processor available from application specific integrated circuit (ASIC) vendors, or may be a commercially available microprocessor. In some embodiments, processor 1620 provides image or video data to scanning system 1601. The image or video data may be retrieved from wireless interface 1610 or may be derived from data retrieved from wireless interface 1610. For example, through processor 1620, scanning system 1601 may display images or video received directly from wireless interface 1610. Also for example, processor 1620 may provide overlays to add to images and/or video received from wireless interface 1610, or may alter stored imagery based on data received from wireless interface 1610 (e.g., modifying a map display in GPS embodiments in which wireless interface 1610 provides location coordinates).
Although the present invention has been described in conjunction with certain embodiments, it is to be understood that modifications and variations may be resorted to without departing from the scope of the invention as those skilled in the art readily understand. Such modifications and variations are considered to be within the scope of the invention and the appended claims.