This application relates generally to the attenuation of low frequency or DC-noise.
Digital projection systems typically utilize a light source and an optical system to project an image onto a surface or screen. The optical system includes components such as mirrors, lenses, waveguides, optical fibers, beam splitters, diffusers, spatial light modulators (SLMs), and the like.
Various aspects of the present disclosure relate to circuits, systems, and methods for determining an attenuating wavefront in a projector.
In one exemplary aspect of the present disclosure, there is provided a system, comprising a light source; a spatial light modulator including a substantially transparent material layer and a phase modulation layer; an imaging device configured to receive a light from the light source as reflected by the spatial light modulator, and to generate an image data; and a controller. The controller is configured to provide a phase-drive signal to the spatial light modulator, and determine an attenuating wavefront of the substantially transparent material layer based on the image data.
In another exemplary aspect of the present disclosure, there is provided a method of driving an optical system, comprising: providing a phase-drive signal to a spatial light modulator, the spatial light modulator including a substantially transparent material layer and a phase modulation layer; generating an image data based on receiving a light from a light source that has been reflected by the spatial light modulator and received by an imaging device; and determining an attenuating wavefront of the substantially transparent material layer based on the image data.
In another exemplary aspect of the present disclosure, there is provided a non-transitory computer-readable medium storing instructions that, when executed by a processor of a computer, cause the computer to perform operations comprising providing a phase-drive signal to a spatial light modulator, the spatial light modulator including a substantially transparent material layer and a phase modulation layer; generating an image data based on receiving a light from a light source that has been reflected by the spatial light modulator and received by an imaging device; and determining an attenuating wavefront of the substantially transparent material layer based on the image data.
In this manner, various aspects of the present disclosure provide for the attenuation of low frequency and DC-noise (also referred to as “wavefront correction”), and effect improvements in at least the technical fields of image projection, holography, signal processing, and the like.
These and other more detailed and specific features of various embodiments are more fully disclosed in the following description, reference being had to the accompanying drawings, in which:
This disclosure and aspects thereof can be embodied in various forms, including hardware or circuits controlled by computer-implemented methods, computer program products, computer systems and networks, user interfaces, and application programming interfaces; as well as hardware-implemented methods, signal processing circuits, memory arrays, application specific integrated circuits, field programmable gate arrays, and the like. The foregoing summary is intended solely to give a general idea of various aspects of the present disclosure, and does not limit the scope of the disclosure in any way.
In the following description, numerous details are set forth, such as circuit configurations, waveform timings, circuit operations, and the like, in order to provide an understanding of one or more aspects of the present disclosure. It will be readily apparent to one skilled in the art that these specific details are merely exemplary and not intended to limit the scope of this application.
Moreover, while the present disclosure focuses mainly on examples in which the various circuits are used in digital projection systems, it will be understood that this is merely one example of an implementation. It will further be understood that the disclosed systems and methods can be used in any device in which there is a need to reduce or attenuate noise; for example, microscopy, image sensing, telecommunications, non-projection image display, and so on.
Projector Systems
In a projector system, various internal components, such as components of the optical system, may contain irregularities which introduce amplitude and/or phase variations in the optical wavefront from the light source. These irregularity-containing wavefronts may further interact with other components of the optical system, resulting in low frequency noise visible at the reconstruction plane.
The light source 111 may be, for example, a laser light source, a high-pressure discharge lamp, an LED, and the like. In some aspects of the present disclosure, the light source 111 may comprise multiple light sources 111, each corresponding to a different wavelength or wavelength band. The light source 111 emits light in response to an image signal provided by the controller 113. The controller 113 may be, for example, a processor such as a central processing unit (CPU) of the projector 110. The controller 113 also controls the SLM 112, which receives light from the light source 111. The SLM 112 imparts a spatially-varying modulation, such as a phase modulation, to the light, and redirects the modulated light toward the projection lens 114. The SLM 112 may be, for example, a liquid-crystal-on-silicon (LCOS) SLM, such as a reflective LCOS SLM or a transmissive LCOS SLM.
The liquid crystal layer 240 is disposed between the first electrode layer 220 and the second electrode layer 230, and includes a plurality of liquid crystals 241. The liquid crystals 241 are particles which exist in a phase intermediate between a solid and a liquid; in other words, the liquid crystals 241 exhibit a degree of directional order, but not positional order. The direction in which the liquid crystals 241 tend to point is referred to as the “director.” The liquid crystal layer 240 modifies incident light entering from the cover glass 250 based on the birefringence Δn of the liquid crystals 241, which may be expressed according to the following expression (1):
In expression (1), ne refers to the refractive index in a direction parallel to the director (“extraordinary refractive index”) and no refers to the refractive index in a direction perpendicular to the director (“ordinary refractive index”). From expression (1), the maximum optical path difference, referred to as the “retardation” F, may be expressed according to the following expression (2):
In expression (2), t refers to the thickness of the liquid crystal layer 240. This thickness is set by the spacer 260, which seals the SLM 220a and ensures a set distance between the cover glass 250 and the silicon backplane 210. The liquid crystals 241 generally orient themselves along electric field lines between the first electrode layer 220 and the second electrode layer 230. As illustrated in
In a projector, incident light enters the SLM 200a or 200b, passes through the cover glass 250 and the second electrode layer 230 (and, if present, the alignment layer 270). In this manner, the cover glass is substantially transparent; in other words, the cover glass has a transmissivity of approximately 90% or greater. The light is then subjected to a phase modulation via the liquid crystal layer 240 and is reflected by the first electrode layer 220 to eventually exit the SLM 200a or 200b via the cover glass 250.
In practical applications, while most of the optical energy of the incident light traverses the cover glass 250 into the liquid crystal layer 240, the surface of the cover glass 250 reflects back some of the optical energy of the incident light. The surface of the cover glass 250 has irregularities which may introduce amplitude and phase variations in the wavefront reflected therefrom. This directly-reflected wavefront then interferes with the wavefront modulated by the liquid crystals 241 and reflected from the first electrode layer 220, which creates low-frequency noise visible at the reconstruction.
While the above description has been provided in the context of an LCOS SLM, it should be understood that the present disclosure is not limited to LCOS SLMs. In general, the present disclosure is applicable to any type of active-matrix phase modulator that has a cover glass or any transparent material layer and that may introduce low-frequency (DC−) noise.
Derivation of the Attenuating Wavefront
In order to compensate for the DC-noise introduced by the cover glass 250 (or other transparent material), it is possible to derive the attenuating wavefront using, for example, phase-shifting holography.
The exemplary system includes a light source 410 which emits a coherent light 420a; a beam splitter 430 which splits the coherent light 420 into first and second propagating wavefronts 420b and 420c; an object 440 (e.g., a cover glass or a transparent material) which reflects the first propagating wavefront 420b to generate a first reflected wavefront 420d, wherein the first reflected wavefront 420d carries a surface description of the object 440 as an amplitude and phase modulation; a controllable piezoelectric mirror 450 which reflects the second propagating wavefront 420c to generate a second reflected wavefront 420e; a beam combiner 460 which combines the first and second reflected wavefronts 420d and 420e into a combined wavefront 420f; and an imager which captures the resulting interference in the combined wavefront 420f. The piezoelectric mirror 450 and the imager 470 are operably connected to a controller 480, thereby to introduce a predetermined phase-delay pattern into the second reflected wavefront 420e and thereby to process an image data from the imager 470. The controller 480 may thus derive a complex-amplitude description of the surface of the object 440.
The concept of phase-shifting holography may be applied to a projection system including, for example, an SLM, to compensate low-frequency noise introduced by the cover glass or transparent material of the SLM.
The light 520a is split into two propagating wavefronts when traversing the cover glass 531, with a first portion of the optical energy, the first wavefront 520b, being directly reflected back from the surface of the cover glass 531 as an amplitude and phase modulation. The second portion of the optical energy travels into the phase modulator 532 and interacts with the array of pixels in the phase modulator 532, which introduces predetermined (computer-controlled) phase delays into the wavefront In many physical implementations, the second portion contains the majority of the optical energy incident on the SLM 530. While, for ease of explanation, the first reflected wavefront 520b is shown separate from the second reflected wavefront 520c, in reality the wavefronts may be combined. The resulting interference is captured by the imager 540 so as to be processed by the controller 550, thereby to derive a complex-amplitude description of the surface of the cover glass 531. In this configuration, the SLM 530 itself is intrinsically used as a holographic phase-shifting setup to derive the numerical description of the surface of the cover glass 531. As such, compared with the phase-shifting holography system illustrated in
To derive the attenuating wavefront, the controller 550 may be, for example, a computer including components such as a CPU, a memory, a user interface, communication circuitry, and the like. The derivation itself may be carried out in the controller 550 using hardware components, software components, or a combination of hardware and software components. Additionally or alternatively, one or more processing steps may be performed by a remote computer such as a server. In such a configuration, the controller 550 may upload data for calculation by the remote computer and download the calculation results.
When the SLM 530 is configured with a flat phase-drive signal with overall phase φ, the second reflected wavefront 520c is the light 520a shifted by the overall phase φ. The first reflected wavefront 520b, represented by Γ, may be estimated by using the following expression (3):
In expression (3), i is the imaginary unit, x′ and y′ are the coordinates at the camera plane (that is, the plane of the imager 540), and Iφ is the intensity image recorded by the imager 540 for a given phase-shift φ in the SLM 530. The first reflected wavefront 520b at the camera plane, Γ(x′, y′), may be back-propagated numerically into the modulator plane to yield the attenuating wavefront H according to the following expression (4):
In expression (4), represents the Fourier transform, represents the inverse Fourier transform, x and y are the coordinates at the modulator plane, dc is the distance between the imager 540 and the SLM 530, and G is the propagation operator, also known as the transfer function of free space. The propagation operator may be, for example, the Rayleigh-Sommerfeld operator, although other operators and wave propagation functions (such as the Fresnel transform) may be used depending on, among other things, the degree of numerical precision desired, computational complexity requirements, and the distance dc.
In order to calculate the attenuating wavefront H, the pixel pitch of the imager 540 does not need to be exactly the same as the pixel pitch of the SLM 530. In practice, many types of commercially-available imagers have a pixel pitch half that of many types of commercially-available SLMs. In such a case, the first reflected wavefront 520b at the camera plane Γ(x′, y′) can be interpolated into an SLM pixel grid before back-propagation. In any event, the attenuating wavefront H calculated according to expression (4) above contains information about the distortions introduced by the cover glass 531 (or other transparent material); e.g., surface deformations or irregularities are modulated as amplitude and phase variations.
Compensation of the Phase Drive
Once the attenuating wavefront {tilde over (H)} has been derived, it may be used to configure the SLM 530 to produce a reconstruction free from noise introduced by the cover glass 531 (or other transparent material). This is referred to as “tuning” the phase-drive signal provided to the SLM 530. However, at least in some embodiments, it may not be sufficient to merely apply the attenuating wavefront {tilde over (H)} to the phase modulator 532. For example, in many applications the exact (wavelength-accurate) distance between the modulator plane and the reconstruction plane is not known beforehand; thus, to attenuate the noise visible at the reconstruction, the overall phase of the attenuating wavefront {tilde over (H)} needs to be adjusted such that it destructively interferes with the first reflected wavefront 520b. Furthermore, because the noise introduced by the cover glass 531 (or other transparent material) at reconstruction has low intensity, the attenuating wavefront H should be adjusted to have a similar intensity.
To address the first issue, the attenuating wavefront {tilde over (H)} from the SLM 530 should be adjusted by a certain phase shift to destructively interfere with the first reflected wavefront 520b, which represents a DC-noise wavefield from the cover glass 531. To account for instances in which dc is unknown, it is possible to compute multiple attenuating wavefront candidates {tilde over (H)}s shifted by phases ranging from s=0 to half the wavelength (λ) of the light 520a, and then select the particular wavefront candidate that yields the reconstruction with the smallest DC-noise effect (e.g., maximizing or optimizing the compensation of the noise). This may be accomplished according to the following expression (5):
The phase drive of {tilde over (H)}s is the phase component of the complex amplitudes, represented according to the following expression (6):
To address the second issue, attenuating wavefront {tilde over (H)}s needs to be “added” into an existing phase drive ϕ to compensate the reconstruction for the noise effects of the cover glass 531 and DC-noise. This is determined according to the following expression (7):
In expression (7), a represents the intensity correction factor, which controls the intensity relationship between the existing phase drive ϕ and the attenuating wavefront {tilde over (H)}s, by adjusting a power of the attenuating wavefront {tilde over (H)}s, thereby allowing for the compensation to have the same intensity (or substantially the same intensity) as the noise to be compensated. Then, the compensated phase drive can be obtained by extracting the phase component of the complex amplitudes H. This compensated phase drive is then applied by the controller 550 to the phase modulator 532.
The exemplary derivation and compensation processes are illustrated in
The derivation process may be performed once during projector calibration, performed at projector startup, or on a per-frame (one or more) basis. For example, the attenuating wavefront can be derived during a calibration stage of a projector production process and can be stored in the projector (e.g., stored in the controller or a storage component). In order to perform the derivation at projector startup or on a per-frame basis, it is possible to simultaneously or alternatingly perform display and image capture operations.
The noise derivation system of
The noise derivation system of
The light source 811 may be, for example, a laser light source, a high-pressure discharge lamp, an LED, and the like. In some aspects of the present disclosure, the light source 811 may comprise multiple light sources 811, each corresponding to a different wavelength or wavelength band. The light source 811 emits light in response to an image signal provided by the controller 816. The controller 816 may be, for example, a processor such as a central processing unit (CPU) of the projector 810. The controller 816 also controls the SLM 812, which receives light from the light source 811. The controller 816 controls and/or receives data from the imager 815. The SLM 812 imparts a spatially-varying modulation, such as a phase modulation, to the light, and redirects the modulated light toward the selective reflective element 813. The selective reflective element 813 may be a beam splitter, in which case it directs a first portion of light to the projection lens 814 and a second portion of light to the imager 815. The selective reflective element 813 may be a movable mirror, in which case it directs substantially all of the light to the imager 815 when in a first position, and allows substantially all of the light to pass to the projection lens 814 when in a second position. The SLM 812 may be, for example, a liquid-crystal-on-silicon (LCOS) SLM, such as a reflective LCOS SLM or a transmissive LCOS SLM. More specifically, the SLM 812 may be a reflective LCOS SLM such as the SLM 200a or 200b described above. The projector 810 may be configured to form derivation and compensation processes, such as those described above, once at a time of startup of the projector 810 or repeatedly after one or more frames during a display operation of the projector 810.
With regard to the processes, systems, methods, heuristics, etc. described herein, it should be understood that, although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes could be practiced with the described steps performed in an order other than the order described herein. It further should be understood that certain steps could be performed simultaneously, that other steps could be added, or that certain steps described herein could be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating certain embodiments, and should in no way be construed so as to limit the claims.
Accordingly, it is to be understood that the above description is intended to be illustrative and not restrictive. Many embodiments and applications other than the examples provided would be apparent upon reading the above description. The scope should be determined, not with reference to the above description, but should instead be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. It is anticipated and intended that future developments will occur in the technologies discussed herein, and that the disclosed systems and methods will be incorporated into such future embodiments. In sum, it should be understood that the application is capable of modification and variation.
All terms used in the claims are intended to be given their broadest reasonable constructions and their ordinary meanings as understood by those knowledgeable in the technologies described herein unless an explicit indication to the contrary in made herein. In particular, use of the singular articles such as “a,” “the,” “said,” etc. should be read to recite one or more of the indicated elements unless a claim recites an explicit limitation to the contrary.
The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2020/013950 | 1/16/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/150523 | 7/23/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6016210 | Stappaerts | Jan 2000 | A |
7193765 | Christensen | Mar 2007 | B2 |
7400449 | Christensen | Jul 2008 | B2 |
7959297 | Silverstein | Jun 2011 | B2 |
8031382 | Johnson | Oct 2011 | B2 |
8437059 | Golan | May 2013 | B2 |
8665504 | Awatsuji | Mar 2014 | B2 |
8888296 | Ota | Nov 2014 | B2 |
9848176 | Damberg | Dec 2017 | B2 |
9874319 | Minor | Jan 2018 | B2 |
10003776 | Damberg | Jun 2018 | B2 |
20020122254 | Gluckstad | Sep 2002 | A1 |
20100165429 | Buckley | Jul 2010 | A1 |
20120116703 | Pavillon | May 2012 | A1 |
20140293388 | Matsumoto | Oct 2014 | A1 |
20150085069 | Yamaichi | Mar 2015 | A1 |
20150277137 | Aschwanden | Oct 2015 | A1 |
20160124221 | Huang | May 2016 | A1 |
20160223987 | Park | Aug 2016 | A1 |
20170180708 | Hazeghi | Jun 2017 | A1 |
20180048873 | Damberg | Feb 2018 | A1 |
20180176519 | Damberg | Jun 2018 | A1 |
Number | Date | Country |
---|---|---|
106444053 | Feb 2017 | CN |
206115152 | Apr 2017 | CN |
109212796 | Jan 2019 | CN |
69714807 | Apr 2003 | DE |
2919055 | Sep 2015 | EP |
2007116136 | May 2007 | JP |
20130106723 | Sep 2013 | KR |
201300834 | Jan 2013 | TW |
2015072737 | May 2015 | WO |
2015104239 | Jul 2015 | WO |
2016019204 | Feb 2016 | WO |
2017115081 | Jul 2017 | WO |
Entry |
---|
US 9,906,760 B2, 02/2018, Damberg (withdrawn) |
Bianco, V. et al “Quasi noise-free digital Holography” Light: Science & Applications, 2016, pp. 1-13. |
Pang, H. et al “High-accuracy method for holographic image projection with suppressed speckle noise” vol. 24, No. 20, Oct. 3, 2016. |
Number | Date | Country | |
---|---|---|---|
20220101807 A1 | Mar 2022 | US |
Number | Date | Country | |
---|---|---|---|
62794271 | Jan 2019 | US |