The present invention generally concerns machine-vision, particularly systems and methods for lighting/illuminating objects in machine-vision systems.
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. The following notice applies to the software and data as described below and in the drawings hereto: Copyright © 1998-2000, PPT Vision, Inc., All Rights Reserved.
There is a widespread need for inspection data for electronic parts in a manufacturing environment. Machine-vision systems have become vital to many complex manufacturing processes, particularly for quality control. For example, during the manufacture of integrated circuits which contain millions of transistors and other electrical components, machine-vision systems visually inspect the circuits at various manufacturing stages for surface blemishes or other defects, rejecting or accepting circuits based on appearance.
Machine-vision systems typically includes an imaging device, such as an electronic camera and an illumination system, which illuminates an object for the camera. The typical illumination system, generally designed to illuminate all sides of an object simultaneously, comprises some form of a circular ring of lights, for example a ring-shaped flashtube, a ring of light-emitting diodes, or a ring of optical fibers. The circular ring of lights usually lies between the camera and object, with the camera looking down through the ring to the object and the lights oriented down and inward to the object.
Conventional illumination systems suffer from at least two major problems. First, they lack a convenient way for varying the angle of illumination, that is, the angle light strikes an object. Conventional illumination systems require technicians to manually adjust orientation of the complete ring of lights or to manually adjust orientation of its individual lights. However, manual adjustments are not only time consuming, but often lead to angular variations which compromise consistency of machine-vision systems. Second, conventional systems lack convenient way of switching from one illumination mode to another, for example, from a particular selected angle of illumination to a multi-directional object illumination, such as “cloudy-day illumination.” Some select-angle illumination modes are better for viewing scratches, while cloudy-day illumination is better for specular or irregular surfaces. This lack of a convenient way of switching illumination modes often leads to use of more than one machine-vision system, and thus forces manufacturers to buy separate systems, to use human inspectors, or to skip inspection for some types of defects. Accordingly, there is a need for better illumination systems for machine-vision systems.
In the context of a machine-vision system for inspecting a part, this invention includes method and apparatus to provide high-speed changing and/or automatic adjustment of illumination angle, dispersion, intensity, and/or color of illumination in a machine vision system.
One aspect of the present invention provides a machine-vision system having an optical axis. This system includes a light source emitting light having a polarization, a machine-vision imager that obtains an image of an object illuminated by the light, a processor coupled to receive an image from the imager, and operative to generate a quality parameter based on the image, and one or more of the various means as described above for selectively directing the light in a predetermined pattern based on its polarization and based on the quality parameter of the image.
Another aspect of the present invention provides a machine-vision system having an optical axis. This system includes a machine-vision imager located along the optical axis, a controllable light source, a first optical element that selectively directs light in a first predetermined pattern relative to the optical axis based on light characteristics, a second optical element, that directs light in a second predetermined pattern relative to the optical axis, and an electronic controller operatively coupled to the imager and the controllable light source to control the light characteristics and thereby selecting one or more of the first and second predetermined patterns.
Another aspect of the present invention provides an illumination method that includes emitting light, selectively polarizing the light, and selectively directing the light based on its polarization.
In some embodiments, the selectively directing provides two or more different angles of illumination (e.g., alpha and/or beta). In some such embodiments, the angle is a conical angle of a ring illumination.
Yet another aspect of the present invention provides a machine-vision method for inspecting an object. This method includes (a) setting one or more illumination parameters, (b) illuminating the object based on the one or more illumination parameters, (c) obtaining an image of the illuminated object, (d) generating a quality parameter based on an image quality of a predetermined region of interest in the image, and (e) iterating (b), (c), and (d) using a different illumination parameter. In some embodiments of this method, the iterating is based on the quality parameter. In some embodiments, the one or more illumination parameters includes a predetermined azimuth angle of illumination. In some embodiments, the one or more illumination parameters includes a predetermined compass angle of illumination. In some embodiments, the one or more illumination parameters includes a predetermined compass angle of illumination.
In the following detailed description of the preferred embodiments, reference is made to the accompanying drawings which form a part hereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
Machine-vision and optical-feature-recognition techniques can be used to distinguish parts that deviate from a predetermined intended aspect of an ideal device. In this description, a “device” is meant to be any part, device of manufacture or object, for example an integrated circuit package, electronic part, semiconductor, molded plastic part, aluminum wheel, gemstone or even an egg or strawberry, which can be inspected. Typically, according to the present invention, a manufacturing operation will use geometric information about the parts acquired from machine-vision inspection of the device to distinguish “good” devices from “bad” devices, and can discard the bad devices and insert previously inspected good devices in their place, for example to obtain a tray of all-good devices. In some embodiments, the devices under test are placed into pocketed trays or into cartons for ease of handling and transport, and inspection will take place of the devices while the devices are in the pocketed trays, according to the present invention. In other embodiments, a parts holder having a clamping mechanism is used to hold a plurality of parts, such as disk suspensions, to an inspection-station fixture.
In operation, light source 108 emits light to polarizer 110, which polarizes the light in a select direction. Polarized light exits to liquid-crystal panel 112 which may or may not alter the polarization of the polarized light, depending on applied electrical stimulus. Light exiting panel 112 is reflected by or transmitted through polarized reflector 114 depending on its polarization. Reflector 114 is oriented to reflect appropriately polarized light toward object 150 at a first predetermined angle α relative to axis 105.
Light that is not polarized for reflection by reflector 114 passes to second liquid-crystal panel 116 which with appropriate electrical stimulus changes polarization of incoming light. Light exiting panel 116 strikes polarized reflector 118, which reflects or transmits it, based on its polarization. Reflector 118 is oriented to reflect appropriately polarized light toward object 150 at a second predetermined angle β relative to axis 105.
Thus, using a light source, and one or more sets of electrically controllable polarizers and polarized reflectors, one can select various angles of illumination for objects in a machine-vision system. Thus, without physically changing optical components, one can quickly and easily change the illumination angle to obtain images that improve contrast and/or clarity of features of interest on object 150. In some cases, highly reflective or specular features can be better imaged if the light is at a particular angle that either enhances or suppresses reflections from such surfaces to the camera 104. In other cases, fine machining marks (e.g., polishing lines) will show clearly if the light is at a particular angle, and depending on whether the user wants to enhance or suppress such marks on the image, a different angle will be chosen.
In some embodiments, optical element 110 and optical element 112 together combine to form an electrically controllable polarizer 111, wherein the angle of polarization can be electronically controlled by processor 102. Thus, if controllable polarizer 111 sets a first angle of polarization that matches that which is reflected by polarized reflector 114, then illumination angle alpha (a) is obtained. On the other hand, if the angle of polarization generated by controllable polarizer 111 matches that which is transmitted by polarized reflector 114, then, in some embodiments (i.e., those that omit LCD 116 and have reflector 118 totally reflecting), the transmitted light is reflected by reflector 118 with illumination angle beta (>). In other embodiments that include LCD 116, the polarizer 110, LCD 114 and LCD 116 together form an electronically controllable polarizer for the light directed to reflector 118 (and optionally further elements 120).
In some embodiments, illumination source 106 is circularly symmetric, having a ring light source 108, a ring polarizer 110, a ring liquid-crystal device (LCD) 112, a conical section angled polarized reflector/transmitter 114, a second ring LCD 116, and a second conical section angled polarized reflector/transmitter 114. In some embodiments, further pairs of LCDs and angled reflectors (shown as ellipses 120) are included. In some embodiments, LCD 116 is omitted for the outermost ring, and reflector 118 is maximally reflective for all incident light. In other embodiments, further polarizers 116 and reflectors 118 are included to provide yet other angles of illumination light. In some embodiments, each ring or conical section is centered about optical axis 105. In such embodiments, selectable illumination angles α and β are conical angles relative to the optical axis 105 that represent the conical surface that the illumination is centered about. In some such embodiments, light source 108 is one or more rows of light-emitting diodes (LEDs) mounted facing radially outward on a cylindrical surface. In some embodiments, the LEDs of light source 108 are divided into banks, wherein each bank is separately driven (e.g., eight banks, wherein each bank represents a forty-five-degree section of the ring, for example the eight compass directions N, NE, E, SE, S, SW, W, and NW—wherein compass angle is defined as an angle in a direction circumferential to the optical axis), allowing further selection of the compass angle using the LED drivers, as well as the azimuth angle selected by the LCDs and polarized reflector(s) as described above.
In some embodiments, banks of LEDs are organized such that different banks have different colors of light. In some such embodiments, an image is obtained at each of a plurality of colors, the quality of the images is determined by image processor 202, and the color (or combination of colors) that yields the best image is used.
In some embodiments, banks of LEDs are organized such that different banks have different dispersion angles light (e.g., using LEDs having different emission angles). In some such embodiments, an image is obtained at each of a plurality of dispersion angles, the quality of the images is determined by image processor 202, and the parameter that yields the best image is used.
In some embodiments, banks of LEDs are organized such that different banks have different colors of light. In some such embodiments, an image is obtained at each of a plurality of colors, the quality of the images is determined by image processor 202, and the color that yields the best image is used.
In other embodiments, each component of
In yet other embodiments, each component of
In some embodiments, illumination driver 222 provides a short pulse of current to all the LEDs at once (e.g., providing a cone of illumination or illumination centered on one or more conical sections). In some embodiments, illumination driver 222 includes drivers such as described in U.S. patent application Ser. No. 09/349,684, entitled “MACHINE-VISION SYSTEMS AND METHODS WITH UP AND DOWN LIGHTS” (Attorney Docket No. 139.052US1), filed Jul. 8, 1999, and/or U.S. Pat. No. 5,745,176 entitled MACHINE VISION ILLUMINATION SYSTEM AND METHOD” ISSUED Apr. 28, 1998 (both incorporated by reference). In some other embodiments, the LEDs of light source 208 are divided into banks, wherein each bank is separately driven by illumination driver 222 (e.g., eight banks, wherein each bank represents a forty-five-degree section of the ring, for example the eight compass directions N, NE, E, SE, S, SW, W, and NW), allowing further selection of the compass angle of illumination using the LED drivers, as well as the azimuth angle selected by the LCDs 212 and refractor ring(s) as described above.
In other embodiments,
Some embodiments further include a support station 450 (such as a conveyor belt) that supports an object being inspected by the machine vision system, and a selector 451 that rejects that object based on an analysis of the image.
In some embodiments (not shown), a variable-angle liquid-crystal reflector, such as available from Boulder Nonlinear Systems Incorporated (BNS), a privately-held Colorado business located at 450 Courtney Way, #107 Lafayette, Colorado USA 80026, is used to provide electronically controlled beam reflection at various different angles. For example, in some embodiments, light from an array of LEDs is reflected off of an LCD reflective device such as a Boulder Nonlinear Systems Incorporated 1×4096 optical Beam Steering Array having 4096 pixels, and arranged as a reflective VLSI backplane in ceramic PGA carrier, and having an array size of 7.4×7.4 mm with a pixel size of 1 μm wide by 7.4 mm high and a pixel pitch of 1.8 μm. In some embodiments, a liquid crystalline mixture comprising nematic or chiral smectic liquid crystal active material is used. In some embodiments, this provides an optical modulation (analog)˜4 to 6 bits linear modulation levels providing a resolution of 225 different angles and steer angles of ±3.4° (with light wavelength λ=1550 nm), and random selection of steer angle. In other embodiments, a liquid crystal refractor of similar design is used to replace the variable-angle mechanism 310 and 320 of
In various embodiments, image processor 202 of
Other embodiments of the invention use a piezo-electric mechanism to vary the refractive properties of a ring lens, that is, a lens having a central hole or cutout. In this embodiment, the imager 104 peers through the hole in the ring lens to an object 150. Another embodiment uses a liquid-crystal panel to vary the angle of reflection of a ring reflector.
In some embodiments, the present invention provides a machine-vision system having an optical axis, including a processor; an imager coupled to the processor; means for emitting light; means for selective polarizing the light; and means for selectively reflecting the polarized light in a predetermined direction relative to the optical axis based on its polarization.
In some embodiments, the present invention provides a machine-vision system including a processor; an imager coupled to the processor; at least one light source; at least one liquid-crystal panel proximate the one light source; and at least one reflector proximate the one liquid-crystal panel.
In some embodiments, the present invention provides a machine-vision system including a processor, an imager coupled to the processor, at least one light source for emitting light, at least one liquid-crystal panel proximate the one light source for selectively changing polarization of the light, and at least one selective reflector proximate the one liquid-crystal panel for selectively reflecting light from the liquid-crystal panel based on its polarization.
In some embodiments, the present invention provides apparatus including means for emitting light, means for selective polarizing the light, and means for selectively reflecting the polarized light in a predetermined direction based on its polarization.
In some embodiments, the present invention provides a machine-vision system having an optical axis, including a light emitter having a polarization, and an electrically activatable polarized reflector unit for selectively reflecting the light in a predetermined direction relative to the optical axis based on its polarization.
In some embodiments, the present invention provides an illumination method including emitting light, selectively polarizing the light, and selectively reflecting the light based on its polarization.
In some embodiments, the present invention provides a machine-vision system having an optical axis, including a light source, means for selectively directing light in a first predetermined direction relative the optical axis based on its polarization, and means for selectively directing light in a second predetermined direction relative to the optical axis based on its polarization.
One aspect of the present invention provides a machine-vision system 100 having an optical axis 105. This system 100 includes a light source 108-110-112 emitting light having a polarization, a machine-vision imager 104 that obtains an image of an object illuminated by the light, a processor 102 coupled to receive an image from the imager, and operative to generate a quality parameter based on the image, and one or more of the various means as described above for selectively directing the light in a predetermined pattern based on its polarization and based on the quality parameter of the image.
In some embodiments, the means for selectively directing the light include a liquid-crystal device 112. In some embodiments, the means for selectively directing the light further include a polarized reflector 114.
Another aspect of the present invention provides a machine-vision system 100, 200, 300, or 400 having an optical axis 105. This system includes a machine-vision imager 104 located along the optical axis 105, a controllable light source (108-110-112, 208-212, 310, or 412-413-414), a first optical element (114, 214, 311, or 432) that selectively directs light in a first predetermined pattern relative to the optical axis based on light characteristics, a second optical element (118, 214, 312, or 433), that directs light in a second predetermined pattern relative to the optical axis, and an electronic controller 102 or 202) operatively coupled to the imager 104 and the controllable light source to control the light characteristics and thereby selecting one or more of the first and second predetermined patterns.
In some embodiments, the controllable light source includes a light source (108), and a controllable polarizer (111) for setting a polarity of the light, wherein the electronic controller is operatively coupled to the controllable polarizer to control the light polarization characteristics and thereby selecting one or more of the first and second predetermined patterns.
In some such embodiments, the first optical element 114 includes a polarized reflector that reflects light polarized on one direction and transmits light polarized in another direction.
In some embodiments, the controllable light source includes a light source 208, and a liquid crystal device (LCD) 212 having two or more areas that are each controllable to selectively transmit light.
In some embodiments, the first optical element includes a prism refractor 214 or 311 that refracts light in the first pattern when a first one of the two or more LCD areas transmits light.
In some embodiments, the second optical element includes a prism refractor 214 or 312 that refracts light in the second pattern when a second one of the two or more LCD areas transmits light.
In some embodiments, the controllable light source includes a light source 208 or 412-413-414 having two or more banks each having one or more LEDs and each operatively coupled to be activated by the electronic controller, wherein one or more of the banks can be simultaneously activated.
In some embodiments the first optical element is a ring reflector 432 situated to reflect only light from a first one of the banks 412, and the second optical element is a ring reflector 433 situated to reflect only light from a second one of the banks 413.
In some embodiments, the electronic controller 202 further selects a region of interest of an image, determines an image quality within the region of interest, and selectively controls the first and second light pattern based on the image quality.
Some embodiments further include a support station 450 (such as a conveyor belt) that supports an object being inspected by the machine vision system, and a selector 451 (see
Another aspect of the present invention provides an illumination method that includes emitting light, selectively polarizing the light, and selectively directing the light based on its polarization (see
In some embodiments, the selectively directing provides two or more different angles of illumination (e.g., alpha and/or beta). In some such embodiments, the angle is a conical angle of a ring illumination.
In some embodiments, the selectively directing includes selectively reflecting based on polarization. In some embodiments, the selectively polarizing includes electronically driving a liquid-crystal device. In some such embodiments, the selectively directing further includes blocking light of one polarization and refracting light of another polarization (see, e.g.,
Yet another aspect of the present invention provides a machine-vision method for inspecting an object. This method includes (a) setting one or more illumination parameters, (b) illuminating the object based on the one or more illumination parameters, (c) obtaining an image of the illuminated object, (d) generating a quality parameter based on an image quality of a predetermined region of interest in the image, and (e) iterating (b), (c), and (d) using a different illumination parameter.
In some embodiments of this method the iterating is based on the quality parameter. In some embodiments, the one or more illumination parameters includes a predetermined azimuth angle of illumination. In some embodiments, the one or more illumination parameters includes a predetermined compass angle of illumination. In some embodiments, the one or more illumination parameters includes a predetermined compass angle of illumination.
The embodiments described above are intended only to illustrate and teach one or more ways of practicing or implementing the present invention, not to restrict its breadth or scope. The actual scope of the invention, which embraces all ways of practicing or implementing the teachings of the invention, is defined only by the following claims and their equivalents.
This application is a divisional under 37 C.F.R. 1.53(b) of U.S. application Ser. No. 09/612,763 filed Jul. 10, 2000, which claims priority under 35 U.S.C. 119(e) from U.S. Provisional Application Ser. No. 60/142,999 filed Jul. 9, 1999; which applications are incorporated herein by reference. This invention is also related to: U.S. patent application Ser. No. 09/350,051, entitled “CIRCUIT FOR MACHINE-VISION SYSTEM” (Attorney Docket No. 139.040US1), filed Jul. 8, 1999 (U.S. Pat. No. 6,603,103), U.S. patent application Ser. No. 09/350,050, entitled “MACHINE-VISION SYSTEM AND METHOD FOR RANDOMLY LOCATED PARTS” (Attorney Docket No. 139.041US1), filed Jul. 8, 1999 (abandoned), U.S. patent application Ser. No. 09/350,255, entitled “PARTS MANIPULATION AND INSPECTION SYSTEM AND METHOD” (Attorney Docket No. 139.042US1), filed Jul. 8, 1999 (abandoned), U.S. patent application Ser. No. 09/349,684, entitled “MACHINE-VISION SYSTEMS AND METHODS WITH UP AND DOWN LIGHTS” (Attorney Docket No. 139.052US1), filed Jul. 8, 1999 (abandoned), U.S. patent application Ser. No. 09/349,948, entitled “METHOD AND APPARATUS TO CALCULATE BGA BALL TOPS” (Attorney Docket No. 139.055US1), filed Jul. 8, 1999 (abandoned), U.S. patent application Ser. No. 09/350,049, entitled “COMBINED 3D-AND 2D-SCANNING MACHINE-VISION SYSTEM AND METHOD” (Attorney Docket No. 139.056US1), filed Jul. 8, 1999 (U.S. Pat. No. 6,522,777), U.S. patent application Ser. No. 09/350,037, entitled “MACHINE-VISION SYSTEM AND METHOD HAVING A SINE-WAVE PROJECTION PATTERN” (Attorney Docket No. 139.057US1), filed Jul. 8, 1999 (abandoned), U.S. patent application Ser. No. 09/350,251, entitled “TRAY FLIPPER AND METHOD FOR PARTS INSPECTION” (Attorney Docket No. 139.059US1), filed Jul. 8, 1999, U.S. patent application Ser. No. 09/598,069, entitled “BINARY GRATING AND METHOD FOR GENERATING A MOIRE PATTERN FOR 3D IMAGING” (Attorney Docket No. 139.066US1), filed Jun. 20, 2000 (U.S. Pat. No. 6,509,559), U.S. patent application Ser. No. 09/597,795, entitled “PRECISION 3D SCANNER BASE AND METHOD FOR MEASURING MANUFACTURED PARTS” (Attorney Docket No. 139.067US1), filed on Jun. 20, 2000 (U.S. Pat. No. 6,486,963), U.S. patent application Ser. No. 09/597,865, entitled “3D SCANNER AND METHOD FOR MEASURING HEIGHTS AND ANGLES OF MANUFACTURED PARTS” (Attorney Docket No. 139.068US1), filed on Jun. 20, 2000 (U.S. Pat. No. 6,501,554), which are all assigned to a common assignee, and which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
60142999 | Jul 1999 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09612763 | Jul 2000 | US |
Child | 10903753 | Jul 2004 | US |