The present invention relates to the field of optical data processing.
Many optical processing systems use an SLM (spatial light modulator) to modulate a beam of light, which modulated beam is then processed by various optical elements. The processed light is often detected using a CCD array detector or another type of PDA (planar array detector). Such optical systems utilize discrete optical elements, such as the SLM and detector, even when the nature of processing is continuous, for example using a Fourier lens. This results in a mismatch between the input and output, in some systems. In some cases, also some of the optical processing elements are discrete.
An aspect of some embodiments of the invention relates to determining a matching between discrete optical elements, such as an SLM and a CCD, and continuous optical systems, subsystems and/or elements, such as Fourier lens and individual lenslets of lenslet arrays. Exemplary processing performed by such matched systems includes discrete transforms, such as the discrete Fourier transform, the discrete cosine transform and the discrete wavelet transform.
In an exemplary embodiment of the invention, the matching is between a continuous signal produced by a processing element (or subsystem) and some kind of non-uniform detector, for example a discrete detector array. Exemplary detectors include CCD detectors and optical fiber array detectors (e.g., for further optical processing). The matching may, for example, take the shape of an optical element between the processing system and the detector, an optical element in the subsystem and/or a selection of data sampling using the detector.
In one embodiment of the invention, the active size of elements in the CCD and the SLM is matched. Alternatively or additionally, one or more binary, continuous or semi-continuous spatially varying neutral density filters are used to match the CCD and/or SLM to the rest of the optical system. Alternatively or additionally, not all the CCD pixels are used to detect the processed light, effectively describing a windowing filter on the CCD. In some embodiments, a spatially varying filter can be emulated by suitable weighting of the driving voltages of the SLM or weighting the received signals on the CCD.
In an exemplary embodiment of the invention, the elements are matched for a general system and not for a dedicated system. Optionally, off-the-shelf elements are used and a matching is determined and implemented, instead of tweaking component parameters or designing custom components. Alternatively or additionally, the matching parameters are changed dynamically, as various optical system parameters change.
The matching may be determined at system construction. Alternatively or additionally, the matching is determined on the fly when the system is reprogrammed or responsive to a particular data set or transform to be implemented by the system.
There is thus provided in accordance with an exemplary embodiment of the invention, a method of designing an optical processing system, comprising:
providing an optical processor comprising at least one discrete element, comprising at least a discrete detector and at least one optical processing element which produces a spatially continuous signal;
determining a matching between said discrete detector and said continuous signal, to provide a desired output on said discrete detector, responsive to a data input; and
applying said determined matching in said system. Optionally, determining a matching comprises modeling a behavior of at least one discrete pixel portion of said detector. Alternatively, said detector is an electro-optical detector.
In an exemplary embodiment of the invention, applying said matching comprises selecting a plurality of weight for a plurality of discrete pixel portions of said detector. Optionally, at least 50% of said pixels are ignored. Alternatively or additionally, at least 90% of said pixels are ignored.
In an exemplary embodiment of the invention, applying said matching comprises setting up a matching element. Optionally, said matching element is between said processing element and said detector element. Alternatively, said matching element is between said processing element and an input element, which provides said data.
In an exemplary embodiment of the invention, said element is a flat plate. Alternatively, said matching element is an LCD.
In an exemplary embodiment of the invention, said matching element comprises a mask. Optionally, said mask is a binary mask. Alternatively, said mask is a multi-density mask.
In an exemplary embodiment of the invention, said mask has a plurality of holes defined therein, each hole corresponding to a single discrete pixel of the discrete detector. Optionally, not all the pixels of said discrete detector have a corresponding hole.
In an exemplary embodiment of the invention, an input to said optical processing element comprises an SLM.
In an exemplary embodiment of the invention, an input to said optical processing element comprises a spatially discrete modulated light source.
In an exemplary embodiment of the invention, said optical processing element comprises a lens. Alternatively or additionally, said optical processing element comprises a lenslet array. Alternatively or additionally, said desired output comprises a desired optical transform of said data. Optionally, said transform comprises a Fourier-derived transform. Optionally, said transform comprises a DCT transform. Alternatively, wherein said transform comprises a discrete linear transform.
There is also provided in accordance with an exemplary embodiment of the invention, an optical processing system comprising:
a first, continuous, optical element which generates a continuous spatially modulated beam;
a second, discrete, optical element, which receives said beam; and
a matching element, which matches said discrete element to said continuous element to provide a desired optical behavior of the system. Optionally, said matching element comprises a mask. Alternatively, said mask comprises a binary mask.
In an exemplary embodiment of the invention, said mask comprises a plurality of apertures, one per pixel of said discrete optical element, at least for some of the pixels of the optical element.
In an exemplary embodiment of the invention, said matching element comprises a controllable element.
In an exemplary embodiment of the invention, said matching element is between said discrete and said continuous elements. Alternatively or additionally, at least one matching element is between said continuous elements and an input element. Optionally, said input element comprises an SLM (spatial light modulator).
In an exemplary embodiment of the invention, said continuous element comprises a lens. Alternatively, said continuous element comprises a lenslet array.
There is also provided in accordance with an exemplary embodiment of the invention, a method of determining a matching between optical system elements, comprising:
determining a spatial optical distribution field of an input to a processing system;
determining the effect of the processing system on the field;
selecting a desired discrete transform to be applied by the system; and
determining a desired matching between a detector of said system and the rest of said system to achieve said desired discrete transform. Optionally, determining a spatial distribution field comprises modeling at least one SLM (spatial light modulator) pixel. Alternatively or additionally, determining a desired matching comprises modeling at least one detector pixel.
The present invention will now be described in the following detailed description of some embodiments of the invention and from the attached drawings, in which:
In one embodiment of the invention, in order to achieve a discrete transform using unit 108, the data is optionally provided as an impulse image, with each image pixel being a spatial delta function, and with optical element 108 comprising, for example, a single or an array of Fourier transform lenses or a 4-f system, which implements a continuous convolution or correlation, which, with matching implemented, can be used to apply a discrete convolution. Spatial delta function-type data provision can be achieved using an SLM with a pinhole filter (e.g., an array of pin-holes), for example a filter 107.
In one embodiment of the invention, for example for DCT transforming, both the SLM and the CCD are spatially matched according to the following formula:
in which Δx defines the distances between centers of pixels 105, e.g., the distance between the delta functions (pinholes) in the SLM and Au defines the distances between the centers of pixels 111, e.g., the center-to-center distance between the delta-function receptors in the CCD. Optionally, an ideal (delta function) CCD detector is modeled by providing a pinhole filter in front of the CCD, for example a filter 114, or by creating pinhole detectors on the CCD plane, during its manufacture. In these formulae, f is the focal length of optical element 108, λ is the wavelength of the light, N is the number of elements in the discrete sequence of numbers, for example 8 for a 8×8 DCT block transform, and Δ{overscore (x)} is the placement of the delta function in the interval between pixel centers (spatial shift) in the SLM, e.g., relative to pixel borders.
Since the pixels intervals in the CCD and the SLM are not necessarily the same, some of the CCD pixels. In multi-wavelength based embodiments, different pinholes may be designated for different wavelengths, for example using active filter elements, such as LCA arrays, that can provide multiple pinhole sizes and/or locations. Alternatively or additionally, circuitry 112 may selectively read signals from different ones of pixels 111, to provide different effective pixel distributions. A high resolution CCD is optionally provided to allow a significant degree of freedom with respect to pixel selection. Alternatively or additionally, a dedicated CCD may be designed, for example including concentric pixels (physically concentric or read as concentric), so that a variable size pixel may be selected electronically. Optionally, different CCD pixels are ignored for different wavelengths, data sets, desired accuracy, expected post-processing and/or transforms. Optionally, a lens or other optical element is used to match the scaling of the system and the detector and/or to allow more efficient use of the desirable (from a matching point of view) CCD detector elements. The percentage of pixels ignored can vary, for example, being greater than 50%, 80%, 90%, 95% or 99%, for example. Alternatively or additionally, the portion of the pixel masked is greater than 50%, 80%, 90%, 95% or 99%, for example. Suitable selection of a matching condition, allows a non-vanishing width to be used for the SLM and/or CCD apertures and still achieve a substantially exact processing.
The above matching condition may be derived using the following analysis (for a one-dimensional case). In one exemplary embodiment of the invention, the modulated light source and system response are mathematically modeled and then, based on the desired transform to be measured, a desired sampling behavior is determined. This sampling behavior may require changes in the system or an additional matching element. In an exemplary embodiment of the invention, depending on the type of matching, one or more of the following may be modeled: the light source distribution, intra-pixel effects on the detector and between pixel effects (e.g., pixel size and dead zone) on the detector.
The following equation defines an exemplary JPEG-DCT, which is to be achieved using optical processing system 100:
Assuming symmetric input, where every block of 16×16 samples (8×8 mirrored twice) is represented as a combination of delta functions, spaced at intervals of size Δx, and transmitted from a Δ{overscore (x)} position inside each interval:
where s(x) is field distribution function. Applying the optical Fourier transform:
The imaginary parts cancel out (due to the input being symmetric):
Assuming accurate sampling at the Fourier plane (the CCD) (or, alternatively, compensating for it using suitable matching):
Since equation (2) is desired, we match:
One matching condition is:
Leading to:
and
resulting in the above (Eq. 1) matching condition:
In some cases, it may be not be convenient, possible or desirable to provide delta functions (pinholes or other optical elements) on one or both of the SLM and CCD. The following analysis shows a method of matching a CCD and an SLM, by spatially modulating the light in a less drastic manner, for example using continuous neutral density filters, for filter elements 107 and 114.
The following equation describes a one-dimensional SLM-like object, e.g., a pixelated source:
Where 1(x) is a general transmission function of each pixel in the SLM, assumed identical for all pixels, and symmetric, so it can be mirrored. However, it should be noted that a similar but more complex analysis can also be performed in the case where not all the pixels are identical, in size, location, intensity or uniformity of transmission, as will be provided below.
After applying the optical (and continuous) Fourier transform:
Where L(u) is the Fourier transform of 1(x). Since the actual sampling is done by summing all intensities on a detector cell (i.e., a CCD pixel cell), equation (5) transforms to:
It should be noted that equation (14) is slightly different from that stated for coherent systems, {tilde over (s)}(u) denotes field distribution rather than intensity. In equation (14), W(u) is the CCD's pixel detection weight function. Again, it is assumed that W is the same for all pixels but this assumption is not essential, except that it simplifies the calculations and is often a relatively correct assumption. Using equation (13):
In the DCT example, we match:
We define:
The matching requirement is thus:
Which results in the following N×N Fredholm I equations for n,k=0, 1, . . . , N−1 (for the 1D case. In 2D it is N×N×N×N equations)
If one sets Δu to be:
then, one may write
It should be noted that Eq. (19) defines a different matching condition than Eq. (11). This condition was obtained in order to simplify Eq. (18) and assure a simple solution of it. This solution defines a matching between individual pixels in the SLM (n) and the CCD (k). ukε[k·Δu−Δū/2,k·Δu+Δū/2)]. This matching may be applied, for example, by mounting suitable masks on the SLM and/or the CCD, in order to get a proper Rk(u).
It should be noted that equation 20 actually defines a family of solutions, thus, in some embodiments of the invention, standard geometries of SLMs and CCDs are used, while in others one or both of the SLM and CCD are modified to better fit a particular matching solution. In the general case, the matching may be performed by using neutral filters and by matching at least the locations, if not the sizes of CCD and SLM pixels. Sizes of the complete SLM and detector arrays may be matched, for example using a beam expander.
In an exemplary embodiment of the invention, the above matching condition(s) are applied towards other discrete linear transforms which are to be applied using a Fourier lens:
Applying the same procedure as in equations (12)–(20), equation (18) now reads:
So for the general 1D linear transform:
In the context of matching conditions it should be noted that a matrix arrangement of sub-elements is not required. Rather, it is sufficient that there be a correspondence between the pixels in the SLM and the pixels in the CCD. A simple to manufacture construction is that of a matrix of elements.
The use of the above matching condition may depend on the type of detector used. A standard CCD detector measures power (amplitude squared). Thus, a square root of the measurement may need to be determined. A related issue is that a CCD detector integrates the square of the amplitude, so when even after taking a square root the result is not precise. However, in many cases the effect of the error is negligible and usually smaller than that allowed by the JPEG standard, for compression applications. This error is especially small if most of the CCD area (for each pixel) is ignored, e.g., using a suitable mask. Ignoring most of the CCD area is also useful in that it reduces noise, albeit usually requiring more signal strength.
Alternatively, an amplitude (rather than power) detector is used, for example using a detector with a gamma of 0.5.
Following is a description of an exemplary coherent optical processing system including sign retrieval and the squared Fourier nonlinear channel. A Fourier plane bias term is provided to provide sign retrieval, implemented via a central pixel in each channel (other pixels are mirrored, whereas the bias pixel is centered and unique), as follows:
The actual PDA measurement is:
that is,
Since all the terms are real, the ∥2 is a regular square:
Now, we define a new R:
Substituting the equation (28) into equation (27), and opening the quadratic term in the integrand gives:
To recover the sign, equate (29) with the form (F(k)+B)2=B2+2B·F(k)+F(k)2·I1 can be seen to be a scaling factor for the B2 constant bias term. I2 is the linear term described above (and solved by a cosine series).
The previously described solution for the linear channel still performs well even as a solution for (29). However, due to (28), R2 is inherently non-negative, contrary to the cosine series. To avoid this issue, a solution of the type R2=R+φ, where φ is a general non-negative bias-like function, can be used in some embodiments of the invention. Equation (29) now reads:
Choices of φ spawn various system architectures: in the most trivial case, φ=const., the φ terms combine nicely, however, varying 0 can be used in alternative embodiments:
Hence, the DCT can be computed by subtracting the last terms (which can be optionally calculated via electrical logic circuits) from the PDA result.
Following are the results of a simulation of matching between an SLM and a CCD, under the assumption that the system is an exact continuous Fourier relation with scaling of λf, where λ is the wavelength of the illuminating source and f is the focal length of the Fourier lens.
The goal is to match the SLM and the CCD sufficiently well (e.g., below a desired error threshold), so that the symmetry in the input plane will allow us to obtain a discrete cosine transform (DCT) relation between the values of the SLM pixels and those of the CCD. Had these pixels been modeled as impulses, the desired result would have been obtained. As described above, however, neither the pixels in the SLM nor those in the CCD are usually impulses (very small apertures); rather, they often have a finite size with a limited dead zone.
Assume that the masks to be generated are simple binary masks (one for the SLM and the other for the CCD) consisting of rectangular holes that appear in the middle of each pixel (SLM and CCD). Following is an attempt to determine the expected performances as a function of the width of each rectangular hole. It should be noted, however, that other patterns may be used, including non-binary patterns, such as a Gaussian density and other geometric shapes, such as a plurality of pinholes, circular holes and rectangular holes. The shape of the hole may or may not match the shape of the discrete optical element.
If the widths of each pixel is reduced (i.e., an increase the dead zone) by placing the masks, better results as indicated above may be obtained. However, less light will be detected and low signal-to-noise ratio (SNR) can be expected. Therefore, simulations were carried out to determine the maximum active part of each pixel that should be used, in an exemplary system, in order to obtain an error that is less than 0.1% (9 bit precision). Different results may be expected for different systems, as indicated above.
One hundred random 8-bit series and additional 10 known functions (exponential, sine, cosine, rectangular and linear) were tested. It was found that for a wavelength of 670 nm and pixel size of 20 μm, substantially any active size in the input plane (SLM) could be tolerated but a 90% dead zone in the CCD pixels is desirable. The error (in percent) between the obtained results and the exact DCT is determine to be less than 0.09% in a 90% dead zone embodiment simulated.
The above description has focused on matching for a Fourier system. The following is a presentation of designing a matched optical system for an arbitrary discrete linear transformation of the form:
where
are the input and output series respectively.
In order to implement such a transformation optically, let us consider an arbitrary optical system (coherent or incoherent), which is linear in terms of field or intensity distributions, i.e., such a system satisfies the superposition integral:
g(x)=∫h(x,{overscore (x)})f({overscore (x)})d{overscore (x)} (33)
where f({overscore (x)}) is the input continuous signal and h(x,{overscore (x)}) is the response of the system to a shifted impulse function.
Exemplary special cases of the above general equation are the Fresnel, Fourier and fractional Fourier transforms, which can be easily realized by free space propagation and a lens. Another exemplary case is the convolution integral, which is obtained for shift invariant systems, i.e., whenever h(x,{overscore (x)})=h0(x−{overscore (x)}). Convolution can be realized optically with 4-f or imaging systems, both under spatially coherent and incoherent illuminations.
In order to realize a discrete linear transformation using this class of optical systems, consider an input distribution, which is composed of N pixels located at
Each pixel is characterized by a weighting function Ln({overscore (x)}), which is assumed to be identically zero for any
Further assume that each input pixel consists of N rectangular functions with equal widths and different heights. I.e., defining:
yields that
where
Introducing the latter expression in Eq. (33) yields
If the output plane is sampled at:
then the following is obtained:
where k=0, 1 . . . N−1. Comparing Eq. (38) with Eq. (32) yields:
Defining a set of N N*N matrices (Rn) by:
yields that the heights wm,n may be found, for example, by solving a set of N linear equations for each pixel. In other words, in order to find the shape of the nth pixel, the following may be solved:
It should be appreciated that the above selection of a form for the masking element is arbitrary and is meant to reflect a particular manufacturing capability on hand. Gray-scale, half-tone and binary masks are all contemplated for various embodiments of the invention.
Up to here an arbitrary linear optical system was analyzed. The following is a brief analysis of a shift invariant case, i.e., where h(x,{overscore (x)})→h(x−{overscore (x)}). By defining:
we obtain
and Eq. (41) still holds.
This particular embodiment is useful for some applications as it includes several interesting optical systems as special cases (e.g., free space propagation, coherent and incoherent imaging). In any particular solution, it may be desirable to check that Rn is not singular and/or that Eq. (41) has a solution.
In order to test the above described matching method, computer simulations were performed. The goal was to realize the discrete cosine transform (DCT) with the help of a quasi-monochromatic, spatially incoherent imaging system with a rectangular aperture. i.e., in this case:
where N=8, D=5 mm (aperture's width), λ=0.5 μm (wavelength) and f=5 cm. The size of each pixel in the input plane was chosen to be 20 μm. The input data was a random i.i.d. sequence, uniformly distributed between zero and one. A suitable (multi-rectangular type) input mask was designed and a system including the input mask was simulated. An absolute error relative to a real DCT of the random input (assuming a high quality input mask could be realized) was found to be less than 10−6.
The present application is related to the following four PCT applications filed on same date as the instant application in the IL receiving office, by applicant JTC2000 Development (Delaware), Inc.: PCT/IL00/00283 which especially describes various optical processor designs, PCT/IL00/00285 which especially describes reflective and incoherent optical processor designs, PCT/IL00/00284 which especially describes a method of optical sign extraction and representation, and PCT/IL00/00286 which especially describes a method of processing by separating a data set into bit-planes and/or using feedback. The disclosures of all of these applications are incorporated herein by reference.
It should be appreciated that the assumptions on the behavior of the various optical elements described above were solely for simplicity of mathematical description and should not be construed as unnecessarily limiting the application of the invention, in some embodiments thereof. A same mathematical analysis may be performed without the above assumption, to yield solutions for various exemplary systems where the above assumptions do not hold.
It will be appreciated that the above described methods of optical matching may be varied in many ways, including, changing the order of steps, which steps are performed using electrical components and which steps are performed using optical components, the representation of the data and/or the hardware design. In addition, various distributed and/or centralized hardware configurations may be used to implement the above invention. In addition, a multiplicity of various features, both of methods and of devices, have been described. It should be appreciated that different features may be combined in different ways. In particular, not all the features shown above in a particular embodiment are necessary in every similar embodiment of the invention. Further, combinations of the above features are also considered to be within the scope of some embodiments of the invention. In addition, the scope of the invention includes methods of using, constructing, calibrating and/or maintaining the apparatus described herein. When used in the following claims, the terms “comprises”, “comprising”, “includes”, “including” or the like mean “including but not limited to”.
Number | Date | Country | Kind |
---|---|---|---|
130038 | May 1999 | IL | national |
131094 | Jul 1999 | IL | national |
This application is a U.S. national filing of PCT Application No. PCT/IL00/00282, filed May 19, 2000. This application is also a continuation in part of PCT application No. PCT/IL99/00479, filed Sep. 5, 1999, designating the US, the disclosure of which is incorporated herein by reference.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IL00/00282 | 5/19/2000 | WO | 00 | 2/21/2002 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO00/72105 | 11/30/2000 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
3891968 | McMahon | Jun 1975 | A |
3969699 | McGlaughlin | Jul 1976 | A |
4005385 | Joynson et al. | Jan 1977 | A |
4460969 | Chen et al. | Jul 1984 | A |
4590608 | Chen et al. | May 1986 | A |
4615619 | Fateley | Oct 1986 | A |
4847796 | Aleksoff et al. | Jul 1989 | A |
4892370 | Lee | Jan 1990 | A |
4892408 | Pernick et al. | Jan 1990 | A |
4972498 | Leib | Nov 1990 | A |
5072314 | Cheng | Dec 1991 | A |
5080464 | Toyoda | Jan 1992 | A |
5107351 | Leib et al. | Apr 1992 | A |
5166508 | Davis et al. | Nov 1992 | A |
5216529 | Paek et al. | Jun 1993 | A |
5227886 | Efron et al. | Jul 1993 | A |
5235439 | Stoll | Aug 1993 | A |
5262979 | Chao | Nov 1993 | A |
5274716 | Mitsuoka et al. | Dec 1993 | A |
5317651 | Refregier et al. | May 1994 | A |
5327286 | Sampsell et al. | Jul 1994 | A |
5339305 | Curtis et al. | Aug 1994 | A |
5454047 | Chang et al. | Sep 1995 | A |
5485312 | Horner et al. | Jan 1996 | A |
5537492 | Nakajima et al. | Jul 1996 | A |
5659637 | Bagley, Jr. et al. | Aug 1997 | A |
5675670 | Koide | Oct 1997 | A |
5694488 | Hartmann | Dec 1997 | A |
5790686 | Koc et al. | Aug 1998 | A |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/IL99/00479 | Sep 1999 | US |
Child | 09979178 | US |