This application is based on and claims priority under 35 U.S.C. 119 with respect to Japanese patent application No. 2010-164133 filed on Jul. 21, 2010, the entire content of which is incorporated herein by reference.
1. Field of the Invention
The present invention relates to a component presence/absence judging apparatus and a component presence/absence judging method for judging whether or not components are mounted at predetermined places on a board after component mounting operations.
2. Discussion of the Related Art
As component presence/absence judging apparatus and method for judging whether or not components are mounted at predetermined places on a board after component mounting operations, there have been known electronic component mounting confirmation equipment and method which are disclosed in, for example, JP2001-345600 A.
In the known equipment and method, there are detected a color indicating each of scheduled mounting places on a board before the mountings of electronic components and another color indicating each of the scheduled mounting places on the board after the mountings of the electronic components, and these colors detected are compared to confirm the mounting state of the electronic component at each of the scheduled mounting places on the board.
However, in the known equipment and method, it is carried out to detect the color at around the center part of each electronic component which part is drawn to a nozzle at the time of a mounting operation. Therefore, where the color at around the center part of each electronic component is a color which hardly differs from the color at a scheduled mounting place on the board for the mounting of each such electronic component, there occurs a possibility that the component is erroneously judged not to be mounted thought having been mounted.
Accordingly, it is an object of the present invention to provide a component presence/absence judging apparatus and a component presence/absence judging method capable of accurately judging whether or not components are mounted at predetermined places on a board after the mountings of the components.
In order to solve the foregoing problem, as a result of engaging in enthusiastic study and repeating one trial and error after another, the present inventors reached completion of the present invention through a finding that it is possible to accurately judge whether or not components are respectively mounted at predetermined places after the mountings of the components, by configuring a classifier by the use of a support vector machine and then by making use of the configured classifier in judging the presence/absence of a component at each of the predetermined places.
Herein, the term “support vector machine” means a known method of configuring a pattern classifier for two classes. The support vector machine has inputted thereto sampling or training data belonging to one class and sampling or training data belonging to the other class and determines a separation hyperplane for separating those data from each other. Then, the support vector machine classifies which class given data belongs to, on the basis of the separation hyperplane.
Briefly, according to the present invention in a first aspect, there is provided a component presence/absence judging apparatus for judging whether or not components are mounted at predetermined places on a board after component mounting operations which mount the components on the board. The apparatus comprises an image pickup device for relatively moving the board and a camera to pickup images of the predetermined places on the board; ante-mounting feature acquisition means for acquiring at least brightness information as ante-mounting features from an ante-mounting image which the image pickup device picks up at each of the predetermined places on an ante-mounting board before mounting the components at the predetermined places thereon; post-mounting feature acquisition means for acquiring at least brightness information as post-mounting features from a post-mounting image which the image pickup device picks up at each of the predetermined places on a post-mounting board after mounting the components at the predetermined places thereon; classifier configuration means for configuring a classifier by registering the ante-mounting features and the post-mounting features in a support vector machine; post-mounting operation feature acquisition means for acquiring at least brightness information as post-mounting operation features from a post-mounting operation image which the image pickup device picks up at each of the predetermined places on an inspection board after mounting the components at the predetermined places thereon; input means for inputting the post-mounting operation features to the support vector machine configured as the classifier; and judgment means for judging whether or not a component is mounted at each of the predetermined places on the inspection board, by the support vector machine configured as the classifier.
According to the present invention in a second aspect, there is provided a component presence/absence judging method for judging whether or not components are mounted at predetermined places on a board after component mounting operations which mount the components on the board. The method comprises an ante-mounting feature acquisition step of acquiring at least brightness information as ante-mounting features from an ante-mounting image which an image pickup device picks up at each of the predetermined places on an ante-mounting board before mounting the components at the predetermined places thereon; a post-mounting feature acquisition step of acquiring at least brightness information as post-mounting features from a post-mounting image which the image pickup device picks up at each of the predetermined places on a post-mounting board after mounting the components at the predetermined places thereon; a classifier configuration step of configuring a classifier by registering the ante-mounting features and the post-mounting features in a support vector machine; a post-mounting operation feature acquisition step of acquiring at least brightness information as post-mounting operation features from a post-mounting operation image which the image pickup device picks up at each of the predetermined places on an inspection board after mounting the components at the predetermined places thereon; an input step of inputting the post-mounting operation features to the support vector machine configured as the classifier; and a judgment step of judging whether or not a component is mounted at each of the predetermined places on the inspection board, by the support vector machine configured as the classifier.
With the construction in each of the first and second aspects, the classifier is configured by utilizing the support vector machine, and the configured classifier judges whether or not a component is mounted at each of the predetermined places on each inspection board. Thus, judgment of whether or not a component is mounted at each of the predetermined places on each inspection board can be made accurately after component mounting operations. Further, the support vector machine is faster to learn than neural networks or the like. Thus, it is possible to configure the classifier promptly. Accordingly, even in the case where objects to be inspected are changed, it becomes possible to proceed to judgments promptly.
The foregoing and other objects and many of the attendant advantages of the present invention may readily be appreciated as the same becomes better understood by reference to the preferred embodiment of the present invention when considered in connection with the accompanying drawings, wherein like reference numerals designate the same or corresponding parts throughout several views, and in which:
Hereafter, an embodiment according to the present invention will be described with reference to the accompanying drawings. That is, with reference to
The component presence/absence judging apparatus 1 shown in
The image pickup device 10 is a device for relatively moving a board and a camera to successively pickup images of the predetermined places on the board with or without components mounted thereat. As shown in
The camera 100 is a device for picking up images on each of ante-mounting, post-mounting and post-mounting operation boards 13 (which will be respectively designated hereafter as 13a, 13b and 13c from time to time for the purpose of distinguishing the boards from one another) on which components 12 are to be mounted or have been mounted. Each of the oblique illumination light sources 101, 102 is an illumination for lighting up the board 13 from obliquely above as indicated by the arrow in picking up an image by the camera 100. The oblique illumination light sources 101, 102 are arranged to throw lights toward the board 13 from obliquely above on one side and the other side.
The processing unit 11 is a device for processing the images picked up by the image pickup device 10 and for judging whether or not components are respectively mounted at predetermined places, that is, at respective scheduled or programmed target places on a board to be inspected. The processing unit 11 is composed of a CPU 110, a program memory 111 and a data memory 112. The CPU 110 together with programs stored in the program memory 111 constitutes a support vector machine. In accordance with a program stored in the program memory 111, the CPU 110 processes the images picked up by the image pickup device 10 and judges the presence/absence of a component at each predetermined place. As shown in
First, the registration step S1 as preparation stage prior to the inspection step S2 will be described together with the operation thereat. The registration step S1 is a step of acquiring features at each of the predetermined places with and without components mounted thereat, based on the images picked up by the image pickup device 10 and of configuring a classifier by registering the acquired features of each predetermined place in the support vector machine. As shown in
The ante-mounting feature acquisition step S10 is a step of acquiring as ante-mounting features brightness information and area information relating to electrode areas from an ante-mounting image which the image pickup device 10 takes at each of predetermined places each being a rectangular shape where components are to be mounted, on an ante-mounting board before mounting the components at the predetermined places thereon. Here, the ante-mounting board is a first master board for classification which is used for the purpose of configuring the classifier and on which no component has been mounted at all though solder has been printed thereon.
For brevity in explanation,
As shown in
In this particular embodiment, the ante-mounting features on each ante-mounting image include brightness information and area information relating to the electrodes areas (i.e., solder portions Sp, Sp) which are acquired from each ante-mounting image picked up.
The brightness information includes the highest brightness and the lowest brightness on an inspection area image which is made by extracting a predetermined area Ai1, Ai2 (encircling the predetermined place P1, P2 as shown in
The area information includes the area (square measure) of each electrode area (i.e., solder portion Sp) which is acquired from each of the picked-up images, and the major axis length and the minor axis length of an ellipse equivalent to each electrode area.
Here, the electrode areas on the ante-mounting board 13a mean pad portions (e.g., solder portions Sp, Sp) at each of which solder has been printed. The electrode areas Sp, Sp at each predetermined area P1, P2 are acquired as follows. First, areas of a predetermined rate in higher ranks which are higher in brightness are extracted from each of the picked-up images. Then, of the extracted areas, areas whose square measures are less than a predetermine rate of the total square measure of each picked-up image are excluded therefrom. Of the remaining areas, two in higher ranks which are larger in square measure are extracted as the electrode areas.
The post-mounting feature acquisition step S11 shown in
For brevity in explanation,
As shown in
The post-mounting feature acquisition step S11 is the same in processing as the ante-mounting feature acquisition step S10 though it only differs in images to be processed thereat. As shown in
The classifier configuration step 12 shown in
Next, the inspection step S2 will be described in detail. The inspection step S2 as actual inspection stage shown in
The post-mounting operation feature acquisition step S20 is executed after component mounting operations in which all of components have been mounted on the predetermined places P1, P2 on each inspection board 13c, and is a step of acquiring as post-mounting operation features brightness information and area information relating to the electrode areas Ce, Ce from each of post-mounting operation images which the image pickup device 10 takes at the predetermined places P1, P2 of the rectangular shape on each of the post-mounting operation boards 13c on which components 12 have been mounted at the predetermined places P1, P2 thereon. Here, each of the post-mounting operation boards 13c is a board to be inspected on which solder has been printed and components 12 have been mounted by mounting operations at the respective predetermined places P1, P2.
As shown in
The post-mounting operation feature acquisition step S20 is the same in processing as the ante-mounting feature acquisition step S10 though it only differs in images to be processed thereat. Where a component 12 is mounted at each of the predetermined places P1, P2 on each post-mounting operation board 13c, the electrodes of the component 12 become the electrode areas Ce, Ce at each predetermined place P1, P2. Where no component has been mounted at each of the predetermined places P1, P2, on the contrary, the pad portions Sp, Sp (shown in
The input step S21 shown in
The judgment step shown in
Next, advantages will be described. According to the component presence/absence judging apparatus and method in the present embodiment typically shown in
According to the component presence/absence judging apparatus and method in the present embodiment typically shown in
According to the component presence/absence judging apparatus in the present embodiment typically shown in
According to the component presence/absence judging apparatus in the present embodiment typically shown in
According to the component presence/absence judging apparatus and method in the present embodiment typically shown in
According to the component presence/absence judging apparatus and method in the present embodiment typically shown in
Although the present embodiment takes an example that uses as the features acquired the square measure of each electrode area Sp/Ce and a major axis length and a minor axis length of the ellipse equivalent to each electrode area Sp/Ce, the present invention is not limited to doing so. The long side length and the short side length of a smallest rectangular on which each electrode area Sp/Ce is circumscribed may be used as the features acquired. Further, there may be used roundness of each electrode area Sp/Ce. Furthermore, the square measure or the like of an area to which plural electrode areas Sp, Sp/Ce, Ce on one component 12 are combined may be used instead of the square measures or the like of individual electrode areas Sp, Sp/Ce, Ce.
In the foregoing embodiment, for the purpose and convenience of distinguishing the preparation stage from the inspection stage, the ante-mounting board 13a and the post-mounting board 13b at the preparation stage have been referred to respectively as first and second master boards, whereas the post-mounting operation board 13c has been referred to as inspection board. However, the ante-mounting board 13a and the post-mounting board 13b at the preparation stage may be or may not necessarily be any particular individual boards and may be the same board. Further, neither of the ante-mounting board 13a and the post-mounting board 13b at the preparation stage may differ in kind from the post-machining operation board 13c at the inspection stage. Moreover, either of the ante-mounting board 13a and the post-mounting board 13b at the preparation stage may be one of boards in a lot, and the post-mounting operation boards 13c at the inspection stage may be the rest of the boards in the same lot.
Preferably, the presence/absence judgments of components on each of the post-mounting operation boards 13c at the inspection stage are made after all of components have been mounted on all of the boards in a lot. However, the presence/absence judgments at the inspection stage may be made each time all of components are mounted on each board of those in a lot. Alternatively, the inspection stage may be taken each time one or more components but not all are mounted on one board of those in a lot. In other words, once the preparation stage is taken in advance, the inspection stage may be taken for each component, several components or all of components on each of the post-mounting operation boards or on a lot basis of post-mounting operation boards each with all of components having been mounted thereon.
Obviously, numerous further modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the present invention may be practiced otherwise than as specifically described herein.
Number | Date | Country | Kind |
---|---|---|---|
2010-164133 | Jul 2010 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5761337 | Nishimura et al. | Jun 1998 | A |
7864988 | Cho et al. | Jan 2011 | B2 |
8281166 | Carroll | Oct 2012 | B2 |
20030097617 | Goeller et al. | May 2003 | A1 |
20040208114 | Lao et al. | Oct 2004 | A1 |
20040215689 | Dooley et al. | Oct 2004 | A1 |
20050207655 | Chopra et al. | Sep 2005 | A1 |
20060251293 | Piirainen et al. | Nov 2006 | A1 |
20080298644 | Irmatov et al. | Dec 2008 | A1 |
20090066933 | Takano et al. | Mar 2009 | A1 |
Number | Date | Country |
---|---|---|
2001-345600 | Dec 2001 | JP |
Entry |
---|
U.S. Appl. No. 13/179,745, filed Jul. 11, 2011, Oike, et al. |
Number | Date | Country | |
---|---|---|---|
20120020545 A1 | Jan 2012 | US |