The present invention relates generally to optical devices and systems, and particularly to optical projection systems.
In an optical projection system, a beam of light illuminates a patterning element, and the pattern of light created by this element is cast onto a surface or volume in space. (The term “light” is used in the context of the present description and in the claims to refer to any sort of optical radiation, which may be in the visible, infrared and/or ultraviolet range.) The patterning element typically comprises a transparency through which the illuminating beam is transmitted, but in some cases it may comprise a reflective element. Projection systems are used in many applications, including three-dimensional (3D) mapping and imaging (also referred to as depth mapping) using structured or otherwise patterned light.
For example, U.S. Patent Application Publication 2010/0118123, whose disclosure is incorporated herein by reference, describes methods and systems for depth mapping using projected patterns. An illumination assembly includes a transparency containing a fixed pattern of spots. A light source transilluminates the transparency with optical radiation so as to project the pattern onto the object. An image capture assembly captures an image of the pattern that is projected onto the object. A processor processes the image captured by the image capture assembly so as to reconstruct a 3D map of the object.
In many illumination systems, it is desirable that the illuminating beam be as homogeneous as possible, with minimal variations in intensity over the field that is illuminated. Various means have been developed for beam homogenization. For example, U.S. Pat. No. 7,186,004 describes a homogenizing optical sheet, which accepts light transmitted at or within a specific entrance cone angle and then redirects and transmits the light within an exit cone that is substantially normal to the plane of the sheet. The intensity of the light within the exit cone is substantially uniform for any light source entering the sheet within the sheet's acceptance angle. The optical sheet is made of transparent material with microlens arrays formed on its opposite front and back surfaces. The thickness of the optical sheet is sufficient so that the microlenses on the opposite surfaces are separated a distance equal to the microlens focal length, with each microlens on the front and back surfaces having substantially similar size and shape, with centers transversely aligned.
Embodiments of the present invention that are described hereinbelow provide optical projectors with improved illumination beam homogeneity.
There is therefore provided, in accordance with an embodiment of the present invention, optical apparatus, which includes a matrix of light sources arranged on a substrate with a predetermined, uniform spacing between the light sources. A beam homogenizer includes a first optical surface, including a first microlens array, which has a first pitch equal to the spacing between the light sources and which is aligned with the matrix so that a respective optical axis of each microlens in the array intercepts a corresponding light source in the matrix and transmits light emitted by the corresponding light source. A second optical surface includes a second microlens array, which is positioned to receive and focus the light transmitted by the first microlens array and which has a second pitch that is different from the first pitch.
Typically, the first and second optical surfaces are immediately adjacent to one another in the apparatus, without any intervening surface having optical power between the first and second optical surfaces. The first and second optical surfaces may respectively include front and rear surfaces of a single optical element.
In some embodiments, the first and second microlens arrays include microlenses arranged in different, respective first and second geometrical arrangements. In one embodiment, the first geometrical arrangement is hexagonal, and the second geometrical arrangement is rectangular.
Typically, the first microlens array is configured to collimate the light emitted by the light sources.
In some embodiments, the beam homogenizer includes a collection lens, which is configured to receive and collimate the light shaped by the second microlens array. The apparatus may also include a patterned element, which is configured to intercept and apply a predefined pattern to the collimated light from the collection lens, and a projection lens, which is configured to project the pattern of the light from the patterned element onto a surface. The patterned element may include a third microlens array, including microlenses arranged in a non-uniform pattern. In one embodiment, the apparatus includes an imaging assembly, which is configured to capture an image of the pattern on the surface and to process the image so as to derive a three-dimensional map of the surface.
There is also provided, in accordance with an embodiment of the present invention, optical apparatus, including a matrix of light sources arranged on a substrate with a predetermined, uniform spacing between the light sources. Abeam homogenizer includes a first optical surface including a microlens array, which has a pitch equal to the spacing between the light sources and which is aligned with the matrix so that a respective optical axis of each microlens in the array intercepts a corresponding light source in the matrix and collimates light emitted by the corresponding light source. A second optical surface defines a diverging lens having a negative optical power, which is positioned to receive and transmit the light collimated by the microlens array. A collection lens is configured to receive and collimate the light transmitted by the second optical surface.
Typically, the first and second optical surfaces are immediately adjacent to one another in the apparatus, without any intervening surface having optical power between the first and second optical surfaces, and may respectively include front and rear surfaces of a single optical element.
In a disclosed embodiment, the diverging lens and the collection lens have a common focal plane.
There is additionally provided, in accordance with an embodiment of the present invention, an optical method, which includes providing a matrix of light sources arranged on a substrate with a predetermined, uniform spacing between the light sources. A first optical surface, including a first microlens array, which has a first pitch equal to the spacing between the light sources, is aligned with the matrix so that a respective optical axis of each microlens in the array intercepts a corresponding light source in the matrix and transmits light emitted by the corresponding light source. A second optical surface, including a second microlens array having a second pitch that is different from the first pitch, is positioned to receive and focus the light transmitted by the first microlens array so as to homogenize the light.
There is further provided, in accordance with an embodiment of the present invention, an optical method, which includes providing a matrix of light sources arranged on a substrate with a predetermined, uniform spacing between the light sources. A first optical surface, including a microlens array, which has a first pitch equal to the spacing between the light sources, is aligned with the matrix so that a respective optical axis of each microlens in the array intercepts a corresponding light source in the matrix and collimates light emitted by the corresponding light source. A second optical surface, defining a diverging lens having a negative optical power, is positioned to receive and transmit the light collimated by the microlens array. A collection lens is positioned to receive and collimate the light transmitted by the second optical surface.
The present invention will be more fully understood from the following detailed description of the embodiments thereof, taken together with the drawings in which:
In many optical projection applications, it is important that the beam of light that is used in illuminating the patterning element be homogeneous, since variations in the illuminating beam can lead to deviations in the projected light pattern. Inhomogeneities in the illumination beam can appear as spurious intensity variations in the pattern that is projected. In laser-based projectors, laser speckle in particular can be a source of troublesome high-contrast inhomogeneity. In 3D mapping systems based on patterned light (such as the sort of system described in the above-mentioned U.S. Patent Application Publication 2010/0118123), speckle and other inhomogeneities can significantly degrade mapping accuracy.
Embodiments of the present invention that are described hereinbelow provide novel apparatus and methods for beam shaping and homogenization. These embodiments provide compact, inexpensive solutions for efficient generation of homogeneous projection beams. These solutions are described below with reference to pattern projection for 3D mapping, and they are particularly useful in this context. The principles of the disclosed embodiments, however, may similarly be applied in optical projection systems of other sorts.
In some embodiments, a beam homogenizer operates in conjunction with a matrix of light sources, such as an array of laser diodes, which are arranged on a substrate with a predetermined, uniform spacing between the light sources. The beam homogenizer comprises two optical surfaces, comprising respective microlens arrays with different, respective pitches. The first microlens array, on the optical surface facing the light sources, has a pitch equal to the spacing between the light sources. The microlenses are aligned with the matrix so that the optical axis of each microlens in the array intercepts a corresponding light source and transmits the light emitted by this light source. The second microlens array, on the other optical surface of the beam homogenizer, receives and focuses the light transmitted by the first microlens array. Typically, a collection lens then collimates the light focused by the second microlens array in order to generate the projection beam.
As a result of the different pitches, there is a mutual offset between the microlenses in the two arrays, which varies of the area of the beam homogenizer. The two arrays may be arranged in different, respective geometrical arrangements, such as one hexagonal array and one rectangular array. The offset between the arrays causes mixing of the light emitted from the different light sources over the area of the projected beam, and this mixing tends to average out the speckles generated by each individual light source and gives a combined beam of roughly uniform intensity. (Assuming the homogenizer mixes N light sources of roughly equal intensities, the speckle contrast will be reduced by approximately 1/√{square root over (N)}.) There is typically no intervening surface having optical power between the first and second optical surfaces (on which the respective microlens arrays are formed), and these two surfaces may conveniently be produced as the front and rear surfaces of a single optical element.
In other embodiments, the beam homogenizer, comprises a first optical surface comprising a microlens array, which is aligned with the matrix of light sources as described above and collimates the light emitted by the light sources. Instead of the second microlens array, however, the second optical surface defines a diverging lens having a negative optical power, which is positioned to receive and transmit the light collimated by the first microlens array. A collection lens, which typically shares a common focal plane with the diverging lens, collimates the light transmitted by the second optical surface. (The terms “collimate” and “collimated” are used in the present description and in the claims in the sense of rendering the rays in question approximately parallel, for instance to within about 5°, as would be understood by those skilled in the art, since perfect collimation can be achieved only with ideal point sources and optics.) This arrangement is advantageous in that the beam homogenizer can be made very compact by using a diverging lens with short focal length, i.e., with high divergence angle.
System 20 comprises a projection assembly 30, which projects a patterned beam 38 onto the surface of an object 28—in this example the hand of a user of the system. An imaging assembly 32 captures an image of the projected pattern on the surface and processes the image so as to derive a three-dimensional map of the surface. For this purpose, assembly 32 typically comprises objective optics 40 and an image sensor 42, which captures the image. Details of the image capture and processing aspects of system 20 are described, for example, in the above-mentioned U.S. Patent Application Publication 2010/0118123, as well as in U.S. Patent Application Publication 2010/0007717, whose disclosure is incorporated herein by reference.
Projection assembly 30 comprises an optical pattern generator 34, which outputs a patterned illumination beam, and a projection lens 36, which projects the beam onto object 28. In the examples described below, the pattern comprises high-contrast light spots on a dark background, in a random or quasi-random arrangement, as described in the above-mentioned patent application publications. Alternatively, any other suitable type of pattern (including images) may be projected in this fashion.
A beam shaper 46 homogenizes and focuses the light from emitter 44 to generate a homogeneous, wide-area beam. For projection applications, this beam may desirably be collimated. Possible designs of this beam shaper are described below.
The shaped beam passes through a patterning element 48, which applies a predefined pattern to the beam. Element 48 may comprise, for example, a non-uniform microlens array, wherein each microlens produces a respective spot in the pattern, as described in the above-mentioned U.S. Patent Application Publication 2010/0118123. Alternatively or additionally, element 48 may comprise any other suitable sort of optical element, such as a transparency imprinted with the desired pattern or a diffractive optical element (DOE), which diffracts the input beam to create the desired pattern.
Projection lens 36 projects the patterned light through an exit pupil 50 onto the object of interest.
Beam homogenizer 52 comprises an optical blank with a front optical surface 64 and a rear optical surface 68, with arrays of plano-convex microlenses 62, 66 formed on the respective surfaces. Array 52 may thus conveniently be formed as a single optical element, as shown in the figure. The element may be made from molded plastic or glass or molded polymer on glass. Typically the microlenses have an effective focal length in the range of 50-100 μm, and beam homogenizer 52 has an overall thickness in the range of 0.1-0.5 mm. Alternatively, the two component microlens arrays may be formed as separate optical elements (either plano-convex or in some other form), which are placed immediately adjacent to one another in beam shaper 46, without any intervening surface having optical power between their respective surfaces. The above structures and dimensions are presented by way of example, and other structures and dimensions implementing the principles of the present invention may alternatively be used depending on technology and system requirements, as will be apparent to those skilled in the art.
Microlenses 62 are aligned with the matrix of light sources 60, so that the optical axis of each microlens 62 intercepts a corresponding light source 60 in the matrix and collimates the light emitted by the corresponding light source. The array of microlenses 62 thus has the same pitch as the matrix of light sources 60, while microlenses 66, which receive and focus the collimated light transmitted by microlenses 62, have a significantly different pitch. Because of the short focal length of microlenses 66, the light transmitted through homogenizer will spread to reach each location on patterning element 48 (
Reference is now made to
As shown in
In the pattern projected by assembly 30 in the embodiment described above, the minimum size of the projected spots depends on the divergence of the beam output by collection lens 54, which in turns depends on the distance between homogenizer 52 and the collection lens. Thus, to achieve smaller spot size, the overall length of beam shaper 46 must generally be increased. For applications in which assembly 30 is required to be very compact and at the same time generate a fine pattern, an alternative design may be desirable, as described below.
As in the preceding embodiment, the array of microlenses 76 and diverging lens 78 may advantageously be produced as front and rear surfaces of a single optical element. Alternatively, the microlens array and diverging lens may be formed as separate elements, placed immediately adjacent to one another in beam shaper 70, without any intervening surface having optical power between them.
In the configuration shown in
It will be appreciated that the embodiments described above are cited by way of example, and that the present invention is not limited to what has been particularly shown and described hereinabove. Rather, the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove, as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description and which are not disclosed in the prior art.
This application claims the benefit of U.S. Provisional Patent Application 61/521,395, filed Aug. 9, 2011, which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
3796498 | Post | Mar 1974 | A |
4850673 | Velzel et al. | Jul 1989 | A |
5406543 | Kobayashi et al. | Apr 1995 | A |
5477383 | Jain | Dec 1995 | A |
5606181 | Sakuma et al. | Feb 1997 | A |
5648951 | Kato et al. | Jul 1997 | A |
5691989 | Rakuljic et al. | Nov 1997 | A |
5742262 | Tabata et al. | Apr 1998 | A |
5781332 | Ogata | Jul 1998 | A |
6002520 | Hoch et al. | Dec 1999 | A |
6031611 | Rosakis et al. | Feb 2000 | A |
6560019 | Nakai | May 2003 | B2 |
6583873 | Goncharov et al. | Jun 2003 | B1 |
6611000 | Tamura et al. | Aug 2003 | B2 |
6707027 | Liess et al. | Mar 2004 | B2 |
6927852 | Reel | Aug 2005 | B2 |
6940583 | Butt et al. | Sep 2005 | B2 |
7112774 | Baer | Sep 2006 | B2 |
7227618 | Bi | Jun 2007 | B1 |
7304735 | Wang et al. | Dec 2007 | B2 |
7335898 | Donders et al. | Feb 2008 | B2 |
7700904 | Toyoda et al. | Apr 2010 | B2 |
7952781 | Weiss et al. | May 2011 | B2 |
8384997 | Shpunt et al. | Feb 2013 | B2 |
20040012958 | Hashimoto et al. | Jan 2004 | A1 |
20040082112 | Stephens | Apr 2004 | A1 |
20040156130 | Powell et al. | Aug 2004 | A1 |
20050178950 | Yoshida | Aug 2005 | A1 |
20060001055 | Ueno et al. | Jan 2006 | A1 |
20060252167 | Wang | Nov 2006 | A1 |
20060252169 | Ashida | Nov 2006 | A1 |
20060269896 | Liu et al. | Nov 2006 | A1 |
20070019909 | Yamauchi et al. | Jan 2007 | A1 |
20080198355 | Domenicali et al. | Aug 2008 | A1 |
20080212835 | Tavor | Sep 2008 | A1 |
20080240502 | Freedman et al. | Oct 2008 | A1 |
20080278572 | Gharib et al. | Nov 2008 | A1 |
20090090937 | Park | Apr 2009 | A1 |
20090096783 | Shpunt et al. | Apr 2009 | A1 |
20090183125 | Magal et al. | Jul 2009 | A1 |
20090185274 | Shpunt | Jul 2009 | A1 |
20100007717 | Spektor et al. | Jan 2010 | A1 |
20100013860 | Mandella et al. | Jan 2010 | A1 |
20100142014 | Rosen et al. | Jun 2010 | A1 |
20110019258 | Levola | Jan 2011 | A1 |
20110069389 | Shpunt | Mar 2011 | A1 |
20110075259 | Shpunt | Mar 2011 | A1 |
20110114857 | Akerman et al. | May 2011 | A1 |
20110187878 | Mor et al. | Aug 2011 | A1 |
20110188054 | Petronius et al. | Aug 2011 | A1 |
20110295331 | Wells et al. | Dec 2011 | A1 |
20120038986 | Pesach | Feb 2012 | A1 |
20120140094 | Shpunt et al. | Jun 2012 | A1 |
20120140109 | Shpunt et al. | Jun 2012 | A1 |
20130038881 | Pesach et al. | Feb 2013 | A1 |
20130038941 | Pesach et al. | Feb 2013 | A1 |
Number | Date | Country |
---|---|---|
1725042 | Jan 2006 | CN |
2011118178 | Jun 2011 | JP |
2007043036 | Apr 2007 | WO |
2007105205 | Sep 2007 | WO |
2008120217 | Oct 2008 | WO |
2010004542 | Jan 2010 | WO |
2012020380 | Feb 2012 | WO |
2012066501 | May 2012 | WO |
Entry |
---|
U.S. Appl. No. 13/567,095 Office Action dated Oct. 1, 2013. |
U.S. Appl. No. 13/008,042 Office Action dated Dec. 3, 2013. |
U.S. Appl. No. 12/330,766 Office Action dated Jul. 16, 2013. |
International Application PCT/IB2013/051986 Search Report dated Jul. 30, 2013. |
U.S. Appl. No. 13/008,042 Office Action dated Jul. 15, 2013. |
Fienup, J.R., “Phase Retrieval Algorithms: A Comparison”, Applied Optics, vol. 21, No. 15, Aug. 1, 1982. |
International Application PCT/IL2008/01592 Search Report dated Apr. 3, 2009. |
U.S. Appl. No. 12/840,312 Office Action dated Jul. 12, 2012. |
Gerchberg et al., “A Practical Algorithm for the Determination of the Phase from Image and Diffraction Plane Pictures,” Journal Optik, vol. 35, No. 2, pp. 237-246, year 1972. |
Sazbon et al., “Qualitative Real-Time Range Extraction for Preplanned Scene Partitioning Using Laser Beam Coding,” Pattern Recognition Letters 26, pp. 1772-1781, year 2005. |
Moharam et al. “Rigorous coupled-wave analysis of planar-grating diffraction”, Journal of the Optical Society of America, vol. 71, No. 6, pp. 818-818, Jul. 1981. |
U.S. Appl. No. 12/945,908 Official Action dated Dec. 5, 2012. |
Eisen et al., “Total internal reflection diffraction grating in conical mounting”,Optical Communications 261, pp. 13-18, year 2006. |
O'Shea et al., “Diffractive Optics: Design, Fabrication and Test”, SPIE Tutorial Texts in Optical Engineering, vol. TT62, pp. 66-72, SPIE Press, USA 2004. |
U.S. Appl. No. 13/008,042 Official Action dated Jan. 3, 2013. |
U.S. Appl. No. 61/568,185, filed Dec. 8, 2011. |
U.S. Appl. No. 12/330,766 Official Action dated Dec. 14, 2010. |
Ezconn Czech A.S. “Site Presentation”, Oct. 2009. |
Luxtera Inc., “Luxtera Announces World's First 10GBit CMOS Photonics Platform”, Carlsbad, USA, Mar. 28, 2005 (press release). |
Bradley et al., “Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays”, IEEE International Workshop on Projector-Camera Systems—PROCAMS 2009, Miami Beach, Florida, 2009. |
Marcia et al., “Fast Disambiguation of Superimposed Images for Increased Field of View”, IEEE International Conference on Image Processing, San Diego, USA, Oct. 12-15, 2008. |
U.S. Appl. No. 13/798,231, filed Mar. 13, 2013. |
Btendo, “Two Uni-axial Scanning Mirrors Vs One Bi-axial Scanning Mirror”, Kfar Saba, Israel, Aug. 13, 2008. |
Microvision Inc., “Micro-Electro-Mechanical System (MEMS) Scanning Mirror”, years 1996-2009. |
European Patent Application # 11150668.9 Partial European Search Report dated Apr. 1, 2011. |
U.S. Appl. No. 12/330,766 Official Action dated Jun. 7, 2011. |
Garcia et al., “Three-dimensional mapping and range measurement by means of projected speckle patterns”, Applied Optics, vol. 47, No. 16, pp. 3032-3040, Jun. 1, 2008. |
Garcia et al.., “Projection of Speckle Patterns for 3D Sensing”, Journal of Physics, Conference series 139, year 2008. |
CN Patent Application # 200880119911.9 Office Action dated Jan 29, 2012. |
U.S. Appl. No. 12/955,939 Office Action dated Jan. 30, 2012. |
U.S. Appl. No. 12/955,940 Office Action dated Jan. 11, 2012. |
U.S. Appl. No. 12/762,373 Office Action dated Mar. 7, 2012. |
International Application PCT/IB2011/053560 Search Report dated Jan. 19, 2012. |
U.S. Appl. No. 61/611,075, filed Mar. 15, 2012. |
International Application PCT/IB2011/055155 Search Report dated Apr. 20, 2012. |
U.S. Appl. No. 12/955,939 Office Action dated Jun. 1, 2012. |
U.S. Appl. No. 12/955,940 Office Action dated Jun. 27, 2012. |
Number | Date | Country | |
---|---|---|---|
20130038941 A1 | Feb 2013 | US |
Number | Date | Country | |
---|---|---|---|
61521395 | Aug 2011 | US |