The present invention relates to an inspection system and inspection method which capture an illuminated inspected object and use the captured image as the basis to inspect the inspected object.
In the past, there has been known the defect inspection system of a transparent sheet member which is described in PLT 1. In this defect inspection system (inspection system), an inspected object, that is, a transparent sheet member, is illuminated by an illumination device which is arranged at one surface side of that inspected transparent sheet member. In that state, a CCD camera which is arranged at the other surface side of the transparent sheet member is used to capture that transparent sheet member. Further, the image which is captured by the CCD camera is processed to thereby detect scratches or other defects in the transparent sheet member.
In the illumination device, a halogen lamp, xenon lamp, high pressure mercury lamp, sodium lamp, etc. is used as a light source. Further, a suitable amount of illumination light of the illumination device is determined to enable an image enabling scratches and other defects to be discerned to be captured by the CCD camera.
PLT 1: Japanese Patent Publication No. 2001-141662 A1
In this regard, due to the high amount of illumination light and, further, long lifetime and other advantages, use of the known high brightness LEDs as the light source of the illumination system may be considered. An illumination system which uses such high brightness LEDs as a light source is structured to maintain a high amount of illumination light by, as one example, sealing a plurality of LEDs (light emitting diodes) by a resin in which a phosphor is mixed. However, when emitting light by an initially set initial amount of light and then, in that state, switching the set amount of light to a target amount of light, due to the presence of the phosphor, the structure which is explained above, etc., a relatively long time is taken for the actual amount of illumination light to become the target amount of light (for example, sometimes 20 minutes or so are taken). For this reason, when it is necessary to change the amount of illumination light along with a change in the type of the inspected object, time ends up being taken until the suitable amount of illumination light is reached and therefore the inspection after the change of type of object ends up being delayed. On the other hand, if starting an inspection before the suitable amount of illumination light is reached, good precision inspection would be difficult.
The present invention was made in consideration of such a situation and provides an inspection system and an inspection method which enable good precision inspection compared with the past even if using an illumination system which requires a relatively long time for the amount of illumination light to reach a target amount of light when switching the set amount of light to the target amount of light like in an illumination system using high brightness LEDs etc. as a light source (that is, which is poor in response to switching of the set amount of light) and starting the inspection before the amount of illumination light of the illumination system reaches the target amount of light.
The inspection system according to the present invention is an inspection system which has an illumination system which illuminates an inspected object, a camera unit which captures the inspection object which is illuminated by the illumination system to output an image signal, and a processing unit which uses the image signal from the camera unit as the basis to generate image data which expresses an image of the inspected object and processes the image of the inspected object which is expressed by the image data for inspection, the processing unit having a processing information determining unit determining processing information which is used for the inspection processing which changes along with the change of the amount of illumination light from the illumination system from the initial amount of light to the target amount of light when the set amount of light of the illumination system is changed from the initial amount of light to the target amount of light, wherein the processing unit performs the inspection processing by using processing information which is determined by the processing information determining portion in accordance with the elapsed time from when the set amount of light of the illumination system is switched from the initial amount of light to the target amount of light.
Due to such a constitution, when the set amount of light of the illumination system is switched from the initial amount of light to the target amount of light, the inspection processing on the image of the inspected object which is expressed by the image data which is produced based on the image signal from the camera unit is performed using the processing information which changes in accordance with the change of the amount of illumination light from the illumination system from the initial amount of light to the target amount of light.
In the inspection system according to the present invention, the processing unit uses the processing information constituted by the image inspection criteria as the basis to process the image of the inspected object which is expressed by the image data for inspection. The processing information determining unit can be constituted so as to determine the image inspection criteria which changes in accordance with the change of the amount of illumination light from the illumination system from the initial amount of light to the target amount of light.
Further, the processing information determining unit, for example, can have a portion for determining a correction coefficient of the image data which changes in accordance with the change of the amount of illumination light of the illumination system from the initial amount of light to the target amount of light and can use the correction coefficient to determine the image data which is used for the inspection processing which changes along with the change in the amount of illumination light from the illumination system from the initial amount of light to the target amount of light.
Furthermore, the processing information determining unit, for example, can have a portion for determining gain information of the image signal from the camera unit which changes in accordance with the change of the amount of illumination light of the illumination system from the initial amount of light to the target amount of light and can use the gain information to adjust the level of the image signal which is used for the inspection processing which changes along with the change in the amount of illumination light from the illumination system from the initial amount of light to the target amount of light.
An inspection method according to the present invention is an inspection method which performs an inspection processing to an image of an inspected object which is expressed by image data obtained by capturing the inspected object by a camera unit, the inspected object being illuminated by an illumination system, the inspection method comprising a processing information determining step of determining processing information which is used for the inspection processing which changes along with the change of the amount of illumination light from the illumination system from the initial amount of light to the target amount of light when the set amount of light of the illumination system is changed from the initial amount of light to the target amount of light and an inspection processing execution step of performing the inspection processing by using processing information which is determined by the processing information determining step in accordance with the elapsed time from when the set amount of light of the illumination system is switched from the initial amount of light to the target amount of light.
According to the present invention, when the set amount of light of the illumination system is switched from the initial amount of light to the target amount of light, the inspection processing is performed by using processing information which changes when the amount of illumination light from the illumination system changes from the initial amount of light to the target amount of light, so it is possible to perform good precision inspection compared with the past even if using an illumination system which requires a relatively long time for the amount of illumination light to reach a target amount of light when switching the set amount of light to the target amount of light like in an illumination system using high brightness LEDs etc. as a light source (that is, which is poor in response to switching of the set amount of light) and starting the inspection before the amount of illumination light of the illumination system reaches the target amount of light.
Other objects, features and advantages of the present invention will become more apparent from the following detailed description when read in conjunction with the accompanying drawings, in which:
Embodiments of the present invention will be explained with reference to the accompanying drawings.
An object which is inspected by an inspection system according to an embodiment of the present invention (inspected object) will be explained while referring to
In
Such a structure of a sensor panel assembly 10, as shown in
In the process of producing the above-mentioned such structure of sensor panel assembly 10, sometimes bubbles will form inside of the binder 13 or dust or other foreign matter will enter the binder 13. Further, sometimes the binder 13 will be squeezed out from between the sensor panel 11 and the cover glass 12 or the binder 13 will become insufficient. An inspection system for inspecting for such defects in the sensor panel assembly 10 is, for example, constituted as shown in
In
The illumination unit 30 has a light source device 31, an illumination head 32, a light guide 33 which guides the light emitted from the light source device 31 to the illumination head 32, and a light condenser 34 which is bonded to the emission surface of the light of the illumination head 32 and enables adjustment of the focusing position. The light source device 31, for example, as shown in
The illumination head 32 of the illumination unit 30 is arranged at the downstream side of the line sensor camera 41 in the movement direction A of the sensor panel assembly 10 on the path of movement, that is, at the upstream side of the line sensor camera 41 in the scan direction B of the line sensor camera 41, so as to face the sensor panel 11. The posture of the illumination head 32 is adjusted so as to illuminate the surface of the sensor panel assembly 10 from a slant above the sensor panel assembly 10, specifically, from a direction whereby the optical axis AOPT2 becomes a predetermined angle α with respect to the normal direction of the surface of the sensor panel assembly 10 (sensor panel 11) without cutting across the optical axis AOPT1 of the line sensor camera 41. Due to such adjustment, part of the light which is emitted from the illumination head 32 of the illumination unit 30 is reflected at the surface of the inspected sensor panel assembly 10 and strikes the line sensor camera 41. Further, another part of the light which is emitted from the illumination head 32 passes through the sensor panel assembly 10 and is reflected at the reflector 42 by diffused reflection. Part of the diffused reflected light then passes through the sensor panel assembly 10 and strikes the line sensor camera 41.
In such a structure of an inspection system, the movement mechanism 50 is used so that the sensor panel assembly 10 moves on the path of movement in the direction A, whereby the relative positional relationship between the line sensor camera 41 and the illumination head 32 is maintained while making the line sensor camera 41 optically scan the sensor panel assembly 10 in the reverse direction to the movement direction A. Due to this scan, the line sensor camera 41 captures the sensor panel assembly 10.
The processing system of the inspection system is constituted as shown in
In
The processing unit 60 performs control to adjust the light of the illumination system 30. This control for adjustment of light is performed by switching the electric power which is supplied from the power source unit 313 of the illumination unit 30 (see
The processing unit 60 uses the produced test image data as the basis to make the display unit 61 display an image of the sensor panel assembly 10 and, further, uses that test image data to perform inspection processing. This inspection processing is performed on the image of the sensor panel assembly 10 which is expressed by the test image data based on various types of threshold levels which express judgment criteria for the edges of the sensor panel assembly 10 in the image etc., judgment criteria for judging image parts as bubbles, scratches, and other defect, and various other criteria expressed in a recipe (image inspection criteria). The recipe is determined for each type of inspected sensor panel assembly 10 and is stored in the storage unit 64 linked with the product type. Note that, the processing unit 60 can acquire the information relating to the various instructions corresponding to operations of the operating unit 62 and can make the results of the inspection processing, that is, information relating to the inspection results, be displayed at the display unit 61.
In control for adjustment of light of the illumination unit 30 which includes the high brightness LED unit 311, when switching the set amount of light form the initial amount of light Iint to the target amount of light Itgt, time is taken until the actual amount of illumination light of the illumination unit 30 reaches the target amount of light Itgt. This is due, as explained above, to the presence of the phosphor and the large number of LEDs 310 in the high brightness LED unit 311 sealed by a resin containing a phosphor (see
For example, as shown in
Correction information F of the recipe is prepared as processing information to be used for the inspection processing to enable suitable inspection even if the image which is expressed by the test image data which is obtained in the period from when the set amount of light of the illumination unit 30 is switched from the initial amount of light Iint to the target amount of light Itgt to when the actual amount of illumination light reaches the target amount of light Itgt is brighter or darker in state than the image which is suitable for inspection processing. This corrected information F is prepared in accordance with the routine which is shown in
First, patterns of switching the set amounts of light at the times of switching the types of the sensor panel assembly 10 being inspected (patterns of switching from the initial amount of light Iint to the target amount of light Itgt) are extracted from a preset inspection schedule (for example, types of inspected objects and inspection order). A set of correction information F for all of the patterns (correction information file) is prepared.
In
In the process of actually operating the inspection system, when the set amount of light of the illumination unit 30 is switched from the initial amount of light Iint to the target amount of light Itgt, the processing is performed under the control of the processing unit 60 in accordance with the routine which is shown in
In
On the other hand, when the set amount of light has to be switched due to switching of the type (at S23, YES), the set amount of light of the illumination unit 30 is switched from the initial amount of light Iint (the amount of illumination light up to now) to the target amount of light Itgt suitable for inspection of that type (S24). This being so, the amount of the light which is actually emitted from the illumination unit 30 (the amount of illumination light) gradually changes from the initial amount of light Iint (see
If the elapsed time from when the set amount of light is switched exceeds the first time t1 (at S25, NO), in the time period until the elapsed time reaches the second time t2 (at S28, YES), the correction information F which corresponds to the time period from when the first time t1 elapses from when the set amount of light is switched until the second time t2 is reached is selected from the correction information file which is stored in the storage unit 64 and, in the same way as the above-mentioned processing, the selected correction information F is used to correct the original recipe and prepare the corrected recipe (S29: included in processing information determining means). Further, the image of the sensor panel assembly 10 is processed for inspection using that corrected recipe (S27: inspection processing execution step).
Furthermore, if the elapsed time from when the set amount of light is switched exceeds the second time t2 (at S28, NO), it is deemed that the amount of illumination light of the illumination unit 30 has reached the target amount of light Itgt and the image of the sensor panel assembly 10 is processed for inspection using the original recipe (suitable recipe under environment of target amount of light Itgt) (S30). After that, for that type, the original recipe is used to continue the inspection processing.
According to the above-mentioned such inspection system, when the set amount of light of the illumination unit 30 is switched from the initial amount of light Iint to the target amount of light Itgt, a corrected recipe which changes in accordance with the change of the amount of illumination light from the illumination unit 30 in the time from the initial amount of light Iint to the target amount of light Itgt is used for inspection processing on the image of the sensor panel assembly 10 obtained from the line sensor camera 41 (test image data), so even if using the illumination unit 30 which includes the high brightness LED unit 311 with the relatively long time required for the amount of illumination light to reach the target amount of light Itgt when the set amount of light is switched from the initial amount of light Iint to the target amount of light Itgt and starting inspection before the amount of illumination light of the illumination unit 30 reaches the target amount of light, it is possible to perform good precision inspection compared with the past.
Note that, in the above-mentioned embodiment of the present invention, the processing for preparing a correction information file in accordance with the routine which is shown in
In the above-mentioned inspection system, the correction information F which corrects the original recipe is stored linked with the elapsed time from the time of switching of the set amount of light, but the corrected recipe itself which is obtained by correction of the original recipe by the correction information F may also be stored linked with the elapsed time from the time of switching of the set amount of light. In this case, in actual operation, rather than producing a corrected recipe for each elapsed time after switching of the set amount of light, the inspection processing is performed using the corrected recipe which is read out from the storage unit 64 and corresponds to that time period.
Further, in the above-mentioned inspection system, the correction information F which corrects the original recipe is stored linked with the elapsed time from the switching of the set amount of light, but it may also be stored linked with the amount of illumination light which changes together with the elapsed time from the switching of the set amount of light. In this case, the patterns of switching the set amount of light at the time of switching the type of the sensor panel assembly 10 being inspected are extracted in advance from an inspection schedule. A correction information file which links these with the amount of illumination light which changes along with the elapse of time of all of the patterns is prepared. Note that, when storing correction information F linked with the elapsed time from when switching the set amount of light, the correction information F is made to be set for each time period, but in the same way as when storing correction information F linked with the amount of illumination light, it is also possible to divide the amount of illumination light which changes from when the set amount of light is switched into a plurality of illumination light sections and set the information for each illumination light section.
Further, in actual operation, the amount of illumination light from the illumination unit 30 is switched to the target amount of light Itgt and the amount of illumination light gradually changes from the initial amount of light Iint to the target amount of light Itgt. In the process, for example, illumination light characteristics QDOWN, QUP which are shown in the
Note that, as the above-mentioned correction information, among the items of the recipe which shows various criteria (including threshold values etc.), items which end up changing in criteria due to fluctuations in the amount of illumination light may be mentioned. For example, an inspection system which classifies the sizes of the bubbles which are detected as defects based on the image information of the inspected object as 10 μm or less, 11 μm to 20 μm, and 21 μm to 30 μm and inspects the numbers of the same is assumed. In this case, all of the detected bubbles are classified based on their detected sizes under suitable amounts of light.
For the contents above-mentioned, as shown in
On the other hand, as shown in
Note that, the set values of the above-mentioned such correction information can be determined by using a test member with known actual dimensional values and other values, obtaining an image of the test member for each elapsed time or for each change in amount of illumination light after switching the set amount of light, using that for measurement, and comparing the detected values and the actual dimensional values.
Further, in the above-mentioned example, the correction information F corresponding to the elapsed time from when the set amount of light was switched from the initial amount of light Iint to the target amount of light Itgt is prepared in accordance with the processing of
In the above-mentioned inspection system, the recipe (image inspection criteria) which is used for the inspection processing is the processing information changing along with the time of change of the amount of illumination light from the initial amount of light to the target amount of light, but the invention is not limited to this. For example, it is possible to make a correction coefficient with respect to pixel values of the image data which expresses the image of the inspected sensor panel assembly 10 the processing information changing along with the time of change of the amount of illumination light from the initial amount of light to the target amount of light. In this case, in the processing which is shown in
Further, for example, the gain information of the image signal which is output from the line sensor camera 41 which captures the inspected sensor panel assembly 10 may be made the processing information changing along with the time of change of the amount of illumination light from the initial amount of light to the target amount of light. In this case, in the processing which is shown in
As explained above, when correcting or adjusting the image data or the image signal as well, in the same way as when correcting the recipe, it is possible to perform good precision inspection compared with the past even if using an illumination unit 30 including a high luminance LED unit 311 which requires a relatively long time for the amount of illumination light of the illumination unit 30 to reach a target amount of light Itgt when the set amount of light of the illumination unit 30 is switched from the initial amount of light Iint to the target amount of light Itgt and starting the inspection before the amount of illumination light of the illumination unit 30 reaches the target amount of light.
Further, in the above-mentioned inspection system, the recipe (image inspection criteria) and correction coefficient or gain information which are used for the inspection processing are made the processing information changing along with the time of change of the amount of illumination light from the initial amount of light to the target amount of light, but it is possible to make shading correction information which corrects unevenness of illumination of the illumination unit 30 (unevenness of illumination in position) or unevenness of sensitivity of the devices of the line sensor which is provided in the line sensor camera 41 (camera unit) (unevenness of sensitivity in position) the processing information changing along with the time of change of the amount of illumination light from the initial amount of light to the target amount of light. Usually, in the above-mentioned such inspection system, at the stage of adjustment of the system, the shading correction is performed for devices of the line sensor camera 41 so that the unevenness of illumination of the illumination unit 30 or the unevenness of sensitivity of the devices of the line sensor which is arranged at the line sensor camera 41 becomes the minimum. After adjustment (processing of actual operation), the shading correction information at the stage of adjustment explained above is applied and inspection is performed. However, the optimal shading correction information changes depending on the amount of illumination light, so to enable more precise inspection, it is preferable to use the shading correction information under the amount of illumination light which is actually emitted.
In this case, for example, in
Further, as explained above, patterns of switching the set amounts of light at the times of switching the types of the sensor panel assembly 10 being inspected (patterns of switching from the initial amount of light Iint to the target amount of light Itgt) are extracted from the inspection schedule (patterns of switching from initial amount of light Iint to the target amount of light Itgt). A corrected recipe which corresponds to the amount of illumination light for each elapsed time (t1, t2, . . . ) from switching of all of the patterns is prepared and stored.
In actual operation, the set amount of light from the illumination unit 30 is switched to the target amount of light Itgt and the amount of illumination light gradually changes from the initial amount of light Iint to the target amount of light Itgt. In the process, the shading correction information which corresponds to the elapsed time from when the set amount of light is switched or the shading correction information which corresponds to the amount of illumination light closest to the amount of illumination light which corresponds to that elapsed time is added to the corrected recipe which corresponds to that elapsed time and then the inspection processing is performed. That is, shading correction information which corresponds to the elapsed time from when the set amount of light is switched or to the amount of illumination light closest to the amount of illumination light corresponding to that elapsed time is selected and that shading correction information is used to correct the sensitivity of the devices of the line sensor which is provided at the line sensor camera 41. Further, from the line sensor camera 41, an image signal which has been corrected by shading correction in this way is supplied to the processing unit 60. After that, the processing unit 60 uses the image signal as the basis to produce image data and performs inspection processing on the image of the sensor panel assembly 10 which is expressed by that image data while using a corrected recipe corresponding to the elapsed time.
Note that, in the above-mentioned inspection system, the corrected recipe and shading correction information which change along with the change in time of the amount of illumination light from the initial amount of light Tint to the target amount of light Itgt are made the processing information, but the invention is not limited to this. The above-mentioned correction image data and shading correction information, the above-mentioned image signal and shading correction information, and other processing information combining processing information may also be used so that even if using an illumination system, like an illumination system which uses high brightness LEDs as a light source, where the time required for the amount of illumination light to reach a target amount of light when the set amount of light is switched from the initial amount of light to the target amount of light is relatively long, it is possible to perform inspection with a better precision than the past even if starting the inspection before the set amount of light of the illumination system reaches the target amount of light.
In the above-mentioned inspection system (see
Number | Date | Country | Kind |
---|---|---|---|
2011-290497 | Dec 2011 | JP | national |
2012-052755 | Mar 2012 | JP | national |