Patent Application
20190162673
The present disclosure relates to a metering apparatus by using an optical method. More particularly, the present disclosure relates to an image processing system and an image processing method.
Automated optical inspection (AOI) is a high speed and precision optical imaging inspection system, which uses machine vision as the standard technology of inspection for overcoming the drawback of human inspection.
In general, after the tested object (for example, the semiconductor wafer) is well produced, an inspection process must be carried out; an exterior of the object is inspected by the automatic optical inspection device for determining whether a defect is appeared on the appearance of the object or not. More specifically, the automatic optical inspection is carried out by the optical inspection device, and during the inspection process, the object is illuminated with light, and the image of the object is captured by the image-sensing unit to determine whether the defect is existed or not.
In the past, automatic optical inspection captures images of the objected by surface-scanner mainly includes a lens and a camera, wherein the object in the field of view of the lens and the camera will be captured. However, the image resolution of the surface scanner is limited by the lens and the camera, and a poor resolution is generated while the field of view increases. Besides, the image capturing speed is too slow to meet the industrial needs.
According to one aspect of the present disclosure, an optical inspection system includes at least one lighting module, a plurality of image-sensing units, and an editing and computing unit. Each lighting module is configured to generate a light beam for illuminating an object; each image-sensing unit is configured to capture an inspecting image of the object, wherein two adjacent inspecting images of the object has a repeated image; the editing and computing unit receiving the inspecting images captured by the image-sensing unit is configured to position the inspecting images in accordance with the repeated images and then recombinant the inspecting images for creating a full inspecting image.
In an embodiment of the present disclosure, the editing and computing unit generates the full inspecting image by recombining the inspecting image provided by one of the image-sensing unit and multiple partial inspecting images provided by the other image-sensing units in accordance with the position of the inspecting images, and repeated images is not the partial inspecting images.
In an embodiment of the present disclosure, the editing and computing unit configured to form the full inspecting image by recombining a plurality of partial inspecting images provided the image-sensing units and the position of the inspecting images, the repeated image in the previous or following image-sensing units is not existed in the partial inspecting image.
In an embodiment of the present disclosure, the editing and computing unit performs a uniformity compensation procedure by a dark image and a brightness image.
In an embodiment of the present disclosure, the optical inspection system further comprises: a non-volatile memory coupled to the editing and computing unit and configured to store the dark image and white image, a volatile memory coupled to the editing and computing unit and configured to store the inspecting images, and an analog and digital conversion unit electrically connected between the image-sensing units and the editing and computing unit and configured to convert the inspecting image with analog form capture by the image-sensing units into digital inspecting image for convenient edition, operation, and storage.
In an embodiment of the present disclosure, the optical inspection system further comprises a driving unit coupled to the editing and computing unit and configured to transmit the full inspecting image to a computer.
In an embodiment of the present disclosure, the lighting module and the image-sensing unit are arranged at unilateral of the object, and each image-sensing unit is configured to capture the inspecting image generated by the object reflecting the light from the lighting module.
In an embodiment of the present disclosure, the lighting module and the image-sensing units are arranged at opposite side of the object, and each image-sensing unit is configured to capture the inspecting image generated by partial light from the lighting module and passing through the object.
In an embodiment of the present disclosure, the optical inspection system further comprising a light splitter arranged at an intersection of the optical route of the light generated by the lighting module and the inspecting image passing through.
In an embodiment of the present disclosure, the optical inspection system further comprises a plurality of lighting module arranged at the opposite side of the object and respectively generates light for illuminate the object, the image-sensing units captures the light reflected by and passing through the object to form the inspecting images.
According to another aspect of the present disclosure, an image-processing method applied to an optical inspection system comprises: capturing a plurality inspecting images from different source; sensing a plurality of repeated images from the inspecting images; positioning the inspecting images in accordance with the repeated images; and generating a full inspecting image in accordance with the positioned inspecting images.
In an embodiment of the present disclosure, the step of sensing a plurality of repeated images from the inspecting images further comprises performing a pre-procedure to the inspecting images to make the inspecting images with analog form into digital form.
In an embodiment of the present disclosure, further comprising performing a uniformity compensation procedure by a dark image and a brightness image.
The present disclosure can be more fully understood by reading the following detailed description of the embodiment, with reference made to the accompanying drawings as follows:
The delivery device 20 further includes a plurality of rollers 24, and the conveyer belt 22 is trained around the rollers 24; a driver is in mechanical communication with the rollers 24 to facilitate movement of the conveyer belt 22 along a first direction Y, such that the object O is capable of moving to the optical-inspecting device 30. In the other words, delivery device 20 takes each object O arranged on the conveyor belt 22 moving.
The light provided by the lighting module 32 may be a linear light having a particular lighting angle, and the illuminant area of the light module completely covering the object O. the light module 32 may be implemented by a plurality of light emitting diodes, light tube(s), or light bulbs. In addition, the light module 32 may generate white light, visible light or invisible light with particular wavelength.
The image-capture module 34 has a particular view angle for capturing image of the illuminated object O. The image process unit 36 receives inspecting images of the object O captured by the image-capturing module 34 and configured to recombine the inspecting images for creating a full inspecting image; such that the object O can be determined to be a good object or defective object.
In
1°≤θ<90°.
The axis of the image-capturing module 34 may be parallel to the normal N of the bottom (or top) surface of the object O. The length of the lighting module 32 at a second direction X perpendicular to the first direction Y is greater than that of the image-capturing module 34 for illuminating entire object O.
The image-capturing module 34 includes a plurality of image-sensing units 340, which can be charge-coupled devices (CCD) or complementary metal-oxide-semiconductor (CMOS) elements. The among of the image-sensing units 340 may be adjusted in accordance with the size of the object O; in general, the amount of the image-sensing units 340 is increased when the size of the object increases.
The image-sensing units 340 may be arranged along the second direction X. Each image-sensing unit 340 is configured to capture partial of inspecting image of the object O, and two inspecting images of the object O captured by two adjacent image-sensing units 340 has an overlapping area. In the other words, two inspecting images captured by two adjacent image-sensing units 340 include a repeated image. The image-capturing module 36 receives the inspecting images from each image-sensing unit 340 and configured to recombine the inspecting images to form the full inspecting image.
Each image-sensing unit 340 includes multiple pixels used for converting the image light reflected by the object O into inspecting image with analog form by photoelectron conversion. In the present invention, each image-sensing unit 340 may include P pixels (as shown in
In order to provide the repeated image in the capturing images captured by two adjacent image-sensing units 340, the adjacent image-sensing units 340 may be staggered in the first direction Y to make partial pixels of the image-sensing units 340 overlap in the second direction X. For example, in
It should be noted that the method to make the inspecting images captured by two adjacent image-sensing units 340 has the overlapping area is not limited to staggered arranged the image-sensing units 340. In the practical applications, the image-sensing units 340 may linearly arranged in the second direction X, and arrange at least one lens between the image-sensing units 340 and the object O for enlarging an image-capturing area of each image-sensing unit 340, such that the overlapping area may exist in the inspecting images captured by two adjacent image-sensing units 340.
In addition, the image-sensing units 340 not position at the edge (left-most and right-most) of the image-capturing module can capture two repeated images, i.e., the inspecting image captured by 1 to n+1 pixels of the second image-sensing unit 340 is the same as that of captured by P−n to P pixels of the first image-sensing unit 340, and the inspecting image captured by P-n to P pixels of the second image-sensing unit 340 is the same as that of captured by 1 to n+1 pixels of the third image-sensing unit 340,
With referring to
The A/D conversion unit 360 receives the inspecting images with analog form (hereafter “analog inspecting images”) and configured to convert the analog inspecting images into inspecting images with digital form (hereafter “digital inspecting images”). The digital inspecting images are thereafter transmitted to the editing and computing unit 362.
The editing and computing unit 362 may be a field programmable gate array (FPGA). The editing and computing unit 362 receives the digital inspecting images and configured to provide a function of edition and operation. In particularly, the editing and computing unit 362 is configured to recombine and compensate uniformity of the digital inspecting images to produce the full inspecting image.
The editing and computing unit 362 may firstly store the digital inspecting images in the volatile memory 366, and then recombine the digital inspecting images and perform a uniformity compensating procedure. Due to the volatile memory 366 is an addressable memory, the arrangement of the digital inspecting images from different image-sensing units 340 stored in the volatile memory 366 can be mapped to the arrangement of the image-sensing units 340, which is beneficial to recombine the inspecting images. However, in the practical applications, the editing and computing unit 362 may configured to recombine and perform the uniformity compensating procedure of the digital inspecting images received from the A/D conversion unit 360, i.e., the editing and computing unit 362 may configured to recombine and perform the uniformity compensating procedure of the digital inspecting images which are not stored in the volatile memory 366.
In combining the digital inspecting images, the editing and computing units 362 receive the digital inspecting images from different image-sensing units 340; the digital inspecting images may be instantaneously captured by the image-sensing units 340 and converted in to digit form by the A/D conversion unit 360 or the digital inspecting image previously stored in the volatile memory 366.
Thereafter, the editing and computing unit 362 may find the repeated images in the digital inspecting images for positioning the digital inspecting images. As aforementioned, the repeated images are existed in the digital inspecting images, thus if the editing and computing unit 362 find the repeated image from two of the digital inspecting images means that the image-sensing units 340 for capturing the digital inspecting images having the repeated image are neighbor.
Thereafter, the editing and computing unit 362 configured to recombine the digital inspecting images to form the full inspecting image. With referring to
The editing and computing unit 362 may form the full inspecting image by combining the digital inspecting image captured by the 1 to P−n−1 pixels of the first and second image-sensing units 340 and the 1 to P pixels of the third image-sensing units 340. In short, the editing and computing units 362 generate the full inspecting image by the digital inspecting image captured by combining the last image-sensing unit 340 and the partial digital inspecting images do not include the repeated image captured by the other image-sensing units 340.
The editing and computing unit 362 may further form the full inspecting image by combining the digital inspecting image captured by the 1 to P−n−1 pixels of all of the image-sensing units 340. In short, the editing and computing units 362 may form the full inspecting image by combining partial digital inspecting images do not include the repeated image captured by all the image-sensing units 340.
The editing and computing unit 362 may further compensates uniformity of the digital inspecting images or the full inspecting image. More particular, the editing and computing unit 362 may first captures a dark image and a white image stored in the non-volatile memory 368, and then compare the full inspecting image to the dark image and white image, respectively, for adjusting the brightness of the digital inspecting images or the full inspecting image. The dark image is an image generated by capturing an entirely dark object, and the white is an image generated by capturing an entirely white object.
In
The lighting module 32 are arranged at opposite side of the image-capturing module 34 along the Y axis, and an included angle θ is between axes of each light modules 32 and the image-capturing module 34 for providing different illuminant effect. The function and relative description of other components of the optical inspection system shown in
The function and relative description of other components of the optical inspection system shown in
In
When the optical inspection system is user for inspecting an optical-transparent object O. the optical-transparent object O is directly arranged on the rollers 24. A driver is in mechanical communication with the rollers 24 to facilitate movement of the optical-transparent object O along a first direction Y, as can be seen in
In
In
Although the present disclosure has been described with reference to the foregoing preferred embodiment, it will be understood that the disclosure is not limited to the details thereof. Various equivalent variations and modifications can still occur to those skilled in this art in view of the teachings of the present disclosure. Thus, all such variations and equivalent modifications are also embraced within the scope of the disclosure as defined in the appended claims.
