The invention relates to a method for calibrating at least one device that comprises a camera.
The invention also relates to a method for calibrating a number of devices positioned side by side, which each comprise a camera.
The invention further relates to an object suitable to be applied to such methods.
It is known per se to place components onto a substrate with a device. At least a portion of the substrate is perceived by means of a camera belonging to the machine, after which the device is driven such that a component can be positioned on the substrate on a desired position.
Then the substrate is moved relative to the device, after which again a component is positioned on the substrate. Once an initial position of the substrate relative to the device has been established by means of the camera, the substrate is then moved to any desired position relative to the device by a drive. If the substrate is moved relative to the device it is important to be sure that this imposed displacement is also really executed. For this purpose the device is to be calibrated.
It is an object of the invention to provide a method with which the device can be calibrated in a simple manner.
This object is achieved with the method according to the invention in that an object having at least one reference element is brought into an image area of the camera, after which a first position of the reference element relative to the device is determined from an image made by the camera, then a displacement relative to the device is imposed on the object, a second position of the reference element relative to the device is determined from a second image made by the camera, after which a real displacement of the object relative to the device is determined from the first and second relative positions, which real displacement is compared with the imposed displacement.
If the real displacement corresponds to the imposed displacement and when subsequently the device is used for, for example, placing components onto a substrate, it may be assumed when the substrate is displaced, that this substrate really undergoes this desired displacement.
If the real displacement does not correspond to the imposed displacement, there should be examined what has caused this deviation and the device can be adapted as required. Alternatively, however, it is possible to adapt the imposed displacement on the basis of the differences perceived between the real displacement and the imposed displacement so that a desired real displacement is realized as yet.
The method is suitable for a single device or a number of devices erected side by side which each comprise a camera.
When a number of devices are used which are located side by side calibration can take place separately for each device. If a substrate is simultaneously provided with components by means of a number of devices, it is, however, also important for the interdependent positions of the devices to be taken into account.
Therefore, the invention has for an object to provide a method in which a number of devices installed side by side can be calibrated relative to one another in a relatively simple and accurate way.
The reference elements on the object have a fixed mutual position. By taking a number of images of the object by means of a number of cameras, with at least one reference element being perceivable in each image, the relative position of the reference element concerned relative to the device can now be determined from each image. Since the mutual positions of the reference elements on the object are known or can be determined, the mutual positions of the devices can be derived from the available information.
An embodiment of the method according to the invention is characterized in that the object comprises at least four reference elements whose mutual positions are known, at least two reference elements being perceived while an image is being made by means of the camera
Based on the position of at least two reference elements as well as the mutual positions of the reference elements, the orientation of the reference-element-carrying object relative to the device can be established in a simple manner. For calibrating a single device, it is possible for example first to perceive all four reference elements, whereas not more than two reference elements are perceived once a displacement has occurred. Thus it is possible to perform an accurate calibration of the displacement carried out by means of the device.
If at least two adjacent devices have to be calibrated, for example first an image can be produced by means of a camera of a first device, while all reference elements are perceivable in the image. Then the object is displaced to a position where two reference elements are perceived by means of the first camera while at the same time the other reference elements are perceived by means of a camera of a device located next to it.
Since the mutual positions of the reference elements relative to each other can be determined from the image produced first, the mutual positions of the devices relative to each other can be simply derived from the images produced subsequently of two reference elements each.
Yet a further embodiment of the method according to the invention is characterized in that the positions of the reference elements relative to each other can be determined from an image produced by the camera.
In this way the mutual position of the reference elements relative to each other is determined by means of the camera located on the device. Thus these mutual positions need not be determined in advance. The advantage of this is that if the object has shrunk or expanded owing to temperature variations, this does not affect the accuracy of the calibration method because the mutual positions of the reference elements are determined just before the device is calibrated.
It is also an object of the invention to provide an object with which a device can be calibrated in a simple fashion.
For the object according to the invention this object is achieved in that the object comprises a number of reference elements.
In this way it is possible to apply an object that accommodates clearly perceivable reference elements, which can be detected relatively well by means of a camera and whose mutual positions can be accurately determined from an image produced by means of the camera. The object may be the substrate on which components are to be mounted or a product specifically made for the purpose of calibration.
One embodiment of the object according to the invention is characterized in that the object is a plate on which a number of marking elements serving as reference elements are introduced.
Such an object with a relatively large number of reference elements can be manufactured in a simple way and is suitable to perceive by means of a number of cameras, which are installed on a number of devices arranged in a side-by-side array. Furthermore, by means of such an object the mutual positions of the devices can be established in a relatively accurate and fast manner.
The invention will be further explained with reference to the drawings in which:
Like elements in the Figures have like reference numerals.
Now if the positions of the separate reference elements 4 relative to each other are known or are determined, the positions of the devices 2 relative to each other can be established in a simple manner.
To calibrate the two coordinate systems X1-Y1 and X2-Y2 respectively relative to each other which belong to devices 2, that is to say to establish the mutual relation, an image 5, 6 is made by means of the camera belonging to the device concerned. From the image 5, 6 are determined the relative positions of the reference elements 4 present in the image 5, 6 relative to the coordinate system X1-Y1 and X2-Y2 respectively. The reference elements 4 present in the image 5 are situated in a coordinate system Xr1-Yr2 relative to the object 3, whereas the marking elements 4 present in the image 6 are situated in a coordinate system Xr2-Yr2 relative to the object 3. The positions of the coordinate systems Xr1-Yr1 and Xr2-Yr2 relative to each other are known per se, for example because the mutual positions are measured prior to the placement of the object 3 in the machine 1. The position of the coordinate system X1-Y1 relative to the coordinate system X2-Y2 can be determined from the positions of the reference elements relative to the coordinate systems X1-Y1 and X2-Y2 as well as the mutual positions known per se between the reference elements present in the image 5 and the reference elements present in the image 6. In this respect use is made of techniques known for example from robotics such as homogeneous coordinates transformation. In the situation shown in
Based on the information thus obtained it is possible to reckon with the deviation in X, Y and φ direction when the components are placed on a substrate by means of the device 2, which direction the substrate will have relative to an expected position, so that the component can yet be placed on the desired position on the substrate while these deviations are taken into account.
In the images represented in
Alternatively, however, it is possible to calibrate with a substrate on which components are to be placed.
In the situation shown in
Then the substrate 10 is moved in a direction shown by the arrow P2. In this position of the substrate 10 images 15, 16 are made by the same devices 2 that have made images 8, 9. The substrate 10 is moved such that now two elements 11, 12 serving as reference elements are perceivable in the image 15 and two elements 13, 14 serving as reference elements are perceivable in the image 16. The positions of the elements 11, 12 are again determined relative to the coordinate system X1-Y1. From the position of the elements 11, 12 in image 8 and image 15 respectively, the real displacement of the substrate 10 can be determined. From the image 16 are calculated the positions of the elements 13, 14 relative to a coordinate system X2-Y2 belonging to the image 16. Since the positions of the elements 13, 14 relative to the elements 11, 12 have not been changed and have been determined from image 8, it is subsequently possible to determine the position of the coordinate system X2-Y2 relative to the coordinate system X1-Y1 from the available information. If the position of the coordinate system X2-Y2 were located at an expected position relative to the coordinate system X1-Y1, the reference elements 13, 14 would be located on the positions 13′, 14′ relative to the expected coordinate system. From the mutual positions of the reference elements 13, 14 and 13′, 14′ can be determined the real position of the coordinate system X2-Y2 relative to the expected location of the coordinate system X2 -Y2 relative to the coordinate system X1-Y1.
It is alternatively possible to regard more than four elements as reference elements, thus enhancing accuracy.
Number | Date | Country | Kind |
---|---|---|---|
03075867.6 | Mar 2003 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB04/50294 | 3/19/2004 | WO | 11/6/2006 |