The present invention relates to optical image processing, and in particular to illumination of objects for purposes of automated inspection.
A portion of this patent document disclosure contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
Optical image processing systems find use in many industrial tasks. A central problem of many imaging systems is correct illumination of the target. Common problems with existing illuminators or illumination systems are illumination uniformity, consistent illumination direction across the target, illuminator efficiency, and illuminator size. As the area being inspected increases, these problems with existing illumination systems becomes much more intractable.
A common application for optical image processing is the inspection of printed circuit boards such as those found in computers and mobile devices. A typical application of optical image processing systems includes detecting the presence or absence of an electrical component on the circuit board and detection of a proper solder joint at the proper location on the component. The system described could as easily be applied to illumination of other objects of interest, such as semiconductor wafers, web processed materials, or mechanical piece parts, for example.
An illuminator is described which may be used with large inspection areas and which provides a dark field illumination pattern that is spatially uniform, illuminates from consistent angles, has high efficiency, and is smaller than existing solutions. A light pipe has a first end proximate an object to be illuminated and a second end opposite the first end and spaced from the first end. The light pipe also has at least one reflective sidewall. The first end of the light pipe includes an exit aperture and the second end has at least one opening to allow at least one image acquisition device to view the surface therethrough. At least one light source is configured to provide illumination in the light pipe. The object is illuminated by the first end of the light pipe by illumination at a selected elevation angle and substantially all azimuth angles.
a, 6b are polar plots of the LED ring light relative to positions 10a and 10b in
a is a diagrammatic view of a light pipe used as dark field illuminator in accordance with an embodiment of the present invention.
b, 9c are plots of the input and output of the illuminator shown in
d diagrams a design of a light pipe exit aperture dimensions.
e is a diagrammatic view of the area illuminated by the light pipe.
a-10e are diagrammatic views of a single axis reflective diffuser useful with embodiments of the present invention.
a and 11b are diagrammatic views of the diffuser of
It is desirable to collect images of printed circuit boards (PCB) at high speed with high resolution and at a low cost. A typical circuit board may be a rectangle 200-300 mm on a side and must be scanned in less than 10 seconds to keep up with ever increasing production line rates. Traditionally these boards were scanned with a single camera imaging a small area (the area imaged is referred to as the Field Of View or FOV), the camera FOV is moved over the board by a two axis robotic system. A typical camera might have 1 million pixels in a 1,024×1,024 array. A 20 micron pixel size on a PCB results in a 20 mm field of view. To scan a typical circuit board, the camera must collect more than 100 images, requiring the same number of motion steps. As camera costs have decreased and camera resolutions (pixel count) have increased other architectures became more cost effective. One low cost camera architecture uses either a line scan detector or a row of 2D (area array) cameras. Such cameras are able to image the entire width of a PCB at once. By moving the PCB across the camera field (or moving the camera relative to the PCB), images of the entire target (PCB) may be captured in one motion step. The cost of extra cameras is more than made up for by the elimination or simplification of the expensive robotic motion system. This line or array or 2D cameras (or line scan camera(s)) will be referred to as a bar camera in this document. Bar cameras typically have very asymmetric FOVs; a bar using a row of area array cameras may have a 300 mm×30 mm effective FOV, whereas a line scan camera in the same application may have a 300 mm×0.1 mm FOV.
Illumination for optical image processing applications is typically controlled in intensity (or brightness) and direction.
Optical image processing systems must illuminate the target (a printed circuit board in described example) such that features of interest are visible to the camera(s). An optical image processing system's illuminator (ideally) is energy efficient, small, low cost and provides illumination which is both spatially uniform and consistent in illumination elevation angle across the effective field of view. Illumination for traditional imaging systems was relatively easy, the small FOV allowed for small and low cost illuminators. Many vendors produce illumination devices which work for a single camera with a small FOV. Examples of bright field illuminators include Diffuse on Axis Lighting, DOAL-75 part number NER-01020050 and Coaxial on Axis Lighting, COAL-50 part number NER-010204500 both available from Microscan NERLITE of Nashua, N.H. Dark field illuminators may take the form a fiber optic ring light; Fiber Optic Ring Light, part number NT54-258 available from Edmund Optics of Barrington, N.J. is a ring with an inside diameter of 89 mm. Dark field illuminators may also take the form of an LED ring; 5.00 inch, white, LED Darkfield illuminator, part number NT56-591 available from Edmund Optics is an LED ring with 32 mm field coverage in a 5″ (127 mm) diameter package.
Bar cameras have much larger FOVs and operate poorly with existing lighting methods.
To scale up the ring light described above to work over a 300 mm wide field might require a ring greater than 1 meter in diameter. This enormous ring fails to meet market needs in several respects: the large size consumes valuable space on the assembly line, the large light source is expensive to build, the illumination angles are not consistent across the working field, and it is very inefficient—the light output will be scattered over a significant fraction of the 1 meter circle while only a slim rectangle of the board is actually imaged.
To deal with the large FOV found in bar cameras, manufacturers solve the cost and efficiency problem presented by the over-sized ring light by instead using light bars arrayed on either side of the effective FOV. An example light bar is the Fiber Optic Line Light Guide, part number NT53-986 available from Edmund Optics.
As described above, existing lighting systems provide illumination which varies across the working area (both in intensity and in angle). An optical device which produces a very uniform light field is sometimes used in image projectors. U.S. Pat. No. 1,577,388 describes a light pipe used to back illuminate a film gate. Commercial versions of these light pipes are available, Light Pipe Homogenizer, Model LPH-PIP-8 from Newport Corporation of Irvine, Calif. is an example. These light source homogenizers are typically solid glass rods (4 or 6 sided polygonal in cross section) which are much longer than wide (typically greater than 10 times as long as wide); the Newport Corp. model discussed above is a solid glass rod with an 8×8 mm square cross-section and a 100 mm length. In a typical application a light source (say an arc lamp) is imaged onto the input face of the rod, the output face is illuminated by the input face directly and by multiple images of the input face reflected off of the internal faces of the rod. This sum of many light sources (many images of the input arc) is spatially very uniform. In Modern Optical Engineering, Warren Smith explains an important characteristic of these glass rods (and of optical fibers): if a light ray enters the rod (fiber) at some angle with respect to the axis of the rod it will exit the rod (fiber) at the same angle with respect to the axis of the rod. The radial direction of the ray will be nearly random, in fact, a small collimated bundle of rays shining onto the input face at some angle with respect to the rod central axis will exit the rod as a hollow cone with a half angle the same as the input angle. This hollow cone of light is the input light beam after it has been azimuthally homogenized.
Referring back to
a shows a hollow box 65 acting as a light pipe which, when used as described, will generate a uniform dark field light pattern. Camera 20 views the target down the length of the light pipe through optical apertures at the ends of the light pipe. A light source 60 (for example an arc in a parabolic reflector) is arranged such that it projects light into the entrance aperture 67 of a light pipe (a box with internally reflecting surfaces) such that light descends at the desired elevation angle. An arc lamp with a parabolic reflector is shown, alternatively a lensed LED or other source may be used as long as the range of source elevation angles matches the desired range of elevation angles at the target. The light source may be either strobed or continuous. A strobed light source may be used to minimize the effects of motion blurring of a moving target. A continuous light source may be used with slowly moving or stationary targets. The fan of rays from the source proceeds across the pipe and downward until it strikes one of the side walls. As in the light pipe homogenizers described above, the ray fan is split and spread in azimuth at the corners of the pipe but the elevation angle is preserved. This expanded ray fan then spreads out, striking many different sections of side wall where it is further spread (randomized) in azimuth angle and largely unchanged in elevation angle. After a number of bounces all azimuth angles are present. As in the light pipe homogenizer, the exit aperture 68 (and the target 10) is spatially uniformly illuminated. Therefore all points on the target are illuminated by light from all azimuth angles but only those elevation angles present in the original source. The elevation angles of the source (as viewed at the target 10) do not change over the surface of the target. Note that the lateral extent of the source (the light pipe) is only slightly larger than the FOV, not much larger as in the case of the ring light.
As the elevation angle of light exiting the illuminator is the same as those present in the source it is relatively easy to tune those angles to specific applications. If a lower elevation angle is desired then the source may be aimed closer to the horizon and the target will see light coming from those same shallow angles. The lower limit to the illumination angle is set by the standoff of the light pipe bottom edge (light can not reach the target from angles below the bottom edge of the pipe) and reduced efficiency as the number of reflections increases at shallower angles (some light is lost on each reflection). The upper limit to the illumination elevation angle is set by the length of the light pipe, several bounces (reflections) are required to randomize the illumination elevation angle, as elevation angle is increased there will be fewer bounces before reaching the target.
d shows the constraints on the size of aperture 68. Once the dimensions of the FOV 11a and 11b, the desired illumination elevation angle 61, and the light pipe standoff 63 (distance between the target and the bottom edge of the light pipe) have been selected, the minimum size of the light pipe exit aperture may be calculated. The minimum exit aperture size 66a and 66b must be large enough that a line from the edge of the FOV 10 ascending at illumination angle 61 is inside the exit aperture when it reaches standoff height 63. If exit aperture 68 is undersized, then the outside edges of FOV 10 will not be illuminated from the lowest illumination angles (the exit aperture vignettes the illumination pattern). If the exit aperture is oversized, then some light will be wasted as an unnecessarily large area will be illuminated.
e shows the total area illuminated by the dark field illuminator. Light exits all portions of the exit aperture at all azimuth angles, descending at the desired angle. Light strikes the level of the target covering area 69. As shown, some of the light lands inside of FOV 10, but some lands outside of FOV 10 and is therefore wasted. The fraction of wasted light is less for larger FOV sizes and shorter standoff heights. For clarity
The polygonal light pipe homogenizer only forms new azimuth angles at its corners, therefore many bounces are needed to get a uniform output (hence the large aspect ratio of the commercially available light pipe homogenizers). If all portions of the light pipe side walls could spread or randomize the light pattern (in the azimuth direction) then fewer bounces would be required and the aspect ratio of the light pipe could be reduced (making the illuminator shorter and/or wider).
a-10e show a method of producing a light pipe side wall which is diffuse (or scattering) in only one axis. Both fiber optic light guides and light pipe homogenizers transmit light without spreading the input light elevation angle (angle with respect to the axis of the guide). Light travels down the guide, reflecting off of the guide's (or pipe's) side walls, reflections may result in new azimuth angles but no new elevation angles. The elevation angle is preserved because the surface normal of the reflectors has no component in the Z axis (the optical axis of the guide). In the system described here it is preferred that the azimuth angles of the light bundle be spread on each reflection while maintaining elevation angles; this is achieved by adding curved or faceted surfaces to the side walls 70. At every point the surface normal 71 of the reflector 70 has no Z component, therefore the elevation angle of the source is maintained. The curved (or faceted) surface of the side wall creates a range of new azimuth angles on every reflection over the entire surface of the light pipe wall, therefore the azimuth angle of the source is rapidly randomized. It is obvious that the same results can be obtained by means other than curved minor surfaces, features using any combination of refraction, diffraction, and reflection could be used.
Surfaces curved in segments of a cylinder spread incoming light evenly in one axis (approximating a Lambertian surface) and do not spread light in the other axis. This shape is also easy to form in sheet metal. A sine wave shape has more curvature at the peaks and valleys and less curvature on the sides, therefore the angular spread is stronger at the edges than in the center. The cylindrical shape (more Lambertian surface) is preferred. The radius of curvature 72 and curve spacing (pitch) 73 are selected using the following criteria: The radius of curvature must be larger than the minimum bend radius of the reflector (i.e. bending a metallic reflector too sharply will damage its optical properties); smaller curve pitch produces less structure in the output light patterns. As pitch increases while radius of curvature is held the same then maximum slope angle 74 increases and steeper angles of reflection are possible. Simulation shows that as the maximum angle of the curve is increased, the reflected input beam is spread over a wider angle. That is, very small bend angles in the reflector (nearly flat) spread the incoming beam very little, while large bend angles (a deeply corrugated reflector) spread the incoming beam over a wide angle. After a 45 degree maximum bend angle (an incoming beam normal to the reflector is spread by +/−90 degrees) little is gained by further increases in bend angle.
e shows how a collimated bundle of light rays 62 is spread perpendicular to the axis of the cylindrical bends on surface 70 and maintained in along the axis of the cylindrical bends on surface 70.
a shows the curved surfaces applied to a light pipe illuminator 80 for bar camera 18 made up of individual cameras 20a-e. Fewer bounces are needed as the (single axis) diffuse reflecting sides 70 randomize azimuth angles more rapidly than a flat sided box. This allows a shorter light pipe to be used (saving space and allowing the camera to be closer to the target).
a shows the light pipe with rectangular cross section; as is shown in
Bar camera 18 views the target through openings in the first and second ends of the light pipe. The openings may be either open apertures or be of a transparent material.
The system shown in
The purpose of the minors shown in
As described so far, the light pipe has had vertical sides—there is no optical power in the Z direction. Light pipes can be constructed with some taper or power in the side walls in order to change both the illuminated area and the illumination angles. Such a scheme could be used here. If the pipe widens near the bottom, then the light field will spread to cover a larger area and the angles will become more normal to the object (higher elevation angles). Narrowing the pipe near the bottom will result in the opposite effect. Thus, embodiments of the present invention include a light pipe homogenizer with some optical power on the side walls.
Applications of this illumination method are not limited to bar camera imaging systems. The small size of the light pipe (only slightly larger than the area imaged instead of much larger as is the case of the ring light) make it useful for single camera systems with nearly square FOVs.
Although the present invention has been described with reference to preferred embodiments, workers skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
1577388 | Twyman | May 1923 | A |
4677473 | Okamoto et al. | Jun 1987 | A |
4750798 | Whitehead | Jun 1988 | A |
4795913 | Blessing et al. | Jan 1989 | A |
4799175 | Sano et al. | Jan 1989 | A |
4896211 | Hung | Jan 1990 | A |
4978224 | Kishimoto | Dec 1990 | A |
4993826 | Yoder | Feb 1991 | A |
5039868 | Kobayashi et al. | Aug 1991 | A |
5058178 | Ray | Oct 1991 | A |
5058982 | Katzir | Oct 1991 | A |
5060065 | Wasserman | Oct 1991 | A |
5086397 | Schuster et al. | Feb 1992 | A |
5153668 | Katzir | Oct 1992 | A |
5245421 | Robertson | Sep 1993 | A |
5260779 | Wasserman | Nov 1993 | A |
5291239 | Jackson | Mar 1994 | A |
5347363 | Yamanaka | Sep 1994 | A |
5455870 | Sepai et al. | Oct 1995 | A |
5517234 | Straayer | May 1996 | A |
5550583 | Amir | Aug 1996 | A |
5577833 | English et al. | Nov 1996 | A |
5684530 | White | Nov 1997 | A |
5696591 | Bilhorn | Dec 1997 | A |
5822055 | Tsai | Oct 1998 | A |
5825495 | Huber | Oct 1998 | A |
5880772 | Kalnajs | Mar 1999 | A |
6020957 | Rosengaus et al. | Feb 2000 | A |
6023663 | Kim | Feb 2000 | A |
6175107 | Juvinall | Jan 2001 | B1 |
6222624 | Yonezawa | Apr 2001 | B1 |
6362877 | Kobayashi et al. | Mar 2002 | B1 |
6577405 | Kranz et al. | Jun 2003 | B2 |
6603103 | Ulrich et al. | Aug 2003 | B1 |
6633375 | Veith et al. | Oct 2003 | B1 |
6750899 | Fishbaine et al. | Jun 2004 | B1 |
6757966 | Inoue et al. | Jul 2004 | B2 |
6850855 | Kawai et al. | Feb 2005 | B2 |
7019826 | Vook et al. | Mar 2006 | B2 |
7027639 | Fishbaine et al. | Apr 2006 | B2 |
7075565 | Raymond et al. | Jul 2006 | B1 |
7270457 | Guo et al. | Sep 2007 | B2 |
7310438 | Prince | Dec 2007 | B2 |
7372632 | Lizotte | May 2008 | B2 |
7394084 | Kuriyama et al. | Jul 2008 | B2 |
7460219 | Jung et al. | Dec 2008 | B2 |
7828472 | Liu et al. | Nov 2010 | B2 |
8098372 | Eitan et al. | Jan 2012 | B2 |
20020089664 | Shibata et al. | Jul 2002 | A1 |
20030039388 | Ulrich et al. | Feb 2003 | A1 |
20030110610 | Duquette et al. | Jun 2003 | A1 |
20030179369 | Feldman et al. | Sep 2003 | A1 |
20030227618 | Some | Dec 2003 | A1 |
20040156539 | Jansson et al. | Aug 2004 | A1 |
20050219518 | Komgut | Oct 2005 | A1 |
20050259245 | Cemic et al. | Nov 2005 | A1 |
20060062013 | Imade | Mar 2006 | A1 |
20110069154 | Case | Mar 2011 | A1 |
20110069878 | Case | Mar 2011 | A1 |
20110075156 | Patel et al. | Mar 2011 | A1 |
20110090333 | Haugan et al. | Apr 2011 | A1 |
20110102575 | Case et al. | May 2011 | A1 |
20110175997 | Case et al. | Jul 2011 | A1 |
20120133920 | Skunes et al. | May 2012 | A1 |
20120327215 | Case et al. | Dec 2012 | A1 |
Number | Date | Country |
---|---|---|
202008004430 | Jan 2009 | DE |
0301255 | Feb 1989 | EP |
0994646 | Apr 2000 | EP |
1578186 | Sep 2005 | EP |
1694109 | Feb 2006 | EP |
2271683 | Apr 1994 | GB |
2417072 | Feb 2006 | GB |
2444409 | Jun 2008 | GB |
61134718 | Jun 1986 | JP |
6229875 | Dec 1987 | JP |
63011642 | Jan 1988 | JP |
02268260 | Nov 1990 | JP |
08327561 | Dec 1996 | JP |
2002271099 | Sep 2002 | JP |
2006324599 | Nov 2006 | JP |
WO9819200 | May 1998 | WO |
WO 0026640 | May 2000 | WO |
WO 0038494 | Jun 2000 | WO |
WO 0196839 | Dec 2001 | WO |
WO2009014940 | Jan 2009 | WO |
WO 2009094489 | Jul 2009 | WO |
Entry |
---|
Martin, “A practical Guide to Machine Vision Lighting”, Advance Illumination, Rochester, VT, United States, Oct. 2007. |
Scharstein and Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms”Microsoft Research, Microsoft Corporation, Redmond, WA. |
U.S. Appl. No. 12/939,267, filed Nov. 4, 2010. |
Kang,Web, Zitinick, and Takeo, “A Multibaseline Stereo System with Active Illumination and Real-time Image Acquisition.” |
Collins, “A Space-Sweep Approach to True Multi-Image Matching” University of Massachusetts, Amherst, MA. |
CyberOptics, “Flex Ultra TM HR, Automated Optical Inspection”, CyberOptics Corporation 2007. |
U.S. Appl. No. 12/940,214, filed Nov. 5, 2010. |
Notification of transmittal of the International Search Report and the Written Opinion for International application No. PCT/US2010/049619 dated Dec. 8, 2010. |
Notification of transmittal of the International Search Report and the Written Opinion for International application No. PCT/US2010/055452 dated Jan. 17, 2011. |
U.S. Appl. No. 12/864,110, filed Jul. 22, 2010. |
International Search Report and Written Opinion for international application No. PCT/US2009/031744, dated May 18, 2009. |
Smith, Warren J. Modern Optical Engineering: The Design of Optical Systems, 4th ed. New York: McGraw-Hill, 2008. |
International Preliminary Report on Patentability for the related International application No. PCT/US2011/059040, dated Jan. 9, 2013. |
International Preliminary Report on Patentability for the related International application No. PCT/US2010/055452, dated Feb. 22, 2013. |
Search Report and Written Opinion for the related International application No. PCT/US2012/065838, dated Feb. 14, 2013. |
Office Action from United States Patent Office issued in related U.S. Appl. No. 12/939,267, mailed Jun. 20, 2013. |
Written Opinion for International application No. PCT/US2010/049617. |
International Preliminary Report on Patentability for the International Application No. PCT/US2010/049617. |
International Search Report and Written Opinion for International Application No. PCT/US2011/059040. |
Scharstein and Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms”Microsoft Research, Microsoft Corporation, Redmond, WA, 2002. |
Kang,Web, Zitinick, and Takeo, “A Multibaseline Stereo System with Active Illumination and Real-time Image Acquisition.”, 1995. |
Collins, “A Space-Sweep Approach to True Multi-Image Matching” University of Massachusetts, Amherst, MA, Feb. 1996. |
Notification of transmittal of the International Search Report and the Written Opinion for International application No. PCT/US2010/04617 dated Dec. 8, 2010. |
First Office Action from Chinese patent application No. 201080042290.6, dispatched Jan. 20, 2014. 18 pages. |
First Office Action from Japanese patent application No. 2012-530966, dispatched on Mar. 11, 2014. 11 pages. |
Number | Date | Country | |
---|---|---|---|
20110069507 A1 | Mar 2011 | US |