This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2021-038682 filed Mar. 10, 2021.
The present disclosure relates to a surface inspection apparatus.
For various products, components (referred to below as “molded components”) composed of molded synthetic resin are used. In some cases, defects that are visually observable appear on surfaces of the molded components. Examples of these kinds of defects include a “sink mark” that is a depression that is unintentionally formed and a “weld line” that is formed on a portion to which melted resin joins. Also, in some cases where unevenness is intentionally formed on a surface by texturing processing, there is a difference in texture from supposed texture. The texture changes due to a composite factor of color, gloss, and unevenness.
Defects that are visually observable are visually inspected.
Japanese Patent No. 5765152 is an example of related art.
There are various proposed methods for a device that inspects the surface state of an object to be inspected. However, these need special optical systems, and there are no devices that enable the defects and the texture to be inspected at low costs.
Aspects of non-limiting embodiments of the present disclosure relate to an inspection of the defects and the texture at lower costs than those in the case where the special optical systems are used.
Aspects of certain non-limiting embodiments of the present disclosure address the above advantages and/or other advantages not described above. However, aspects of the non-limiting embodiments are not required to address the advantages described above, and aspects of the non-limiting embodiments of the present disclosure may not address advantages described above.
According to an aspect of the present disclosure, there is provided a surface inspection apparatus including an imaging device that images a portion of an object to be inspected, a first light source that is included in a plurality of light sources that illuminate the portion, the first light source being configured such that a light component that is included in light emitted from the first light source and that is reflected by specular reflection from the portion to be inspected is a principal light component that is incident on the imaging device, and a second light source that is included in the plurality of light sources and that is disposed opposite the first light source with an optical axis of the imaging device interposed therebetween such that a light component that is reflected by diffuse reflection from the portion to be inspected is a principal light component that is incident on the imaging device.
Exemplary embodiments of the present disclosure will be described in detail based on the following figures, wherein:
Exemplary embodiments of the present disclosure will hereinafter be described with reference to the drawings.
The surface inspection apparatus 1 that is used according to the first exemplary embodiment is a so-called area camera. A range that the surface inspection apparatus 1 images (referred to below as an “imaging range”) is defined by a plane.
In
The light-shielding frame 100 is also used for position adjustment between the surface inspection apparatus 1 and an inspection object 10 in addition to natural light shielding. Example of the position adjustment described herein include position adjustment for the imaging range, position adjustment between a surface of the inspection object 10 and light sources 108 and 109 (see
The light-shielding frame 100 configures a part of the surface inspection apparatus 1. The light-shielding frame 100 and the surface inspection apparatus 1 may have a single body, or the light-shielding frame 100 may be attachable to and detachable from the housing of the surface inspection apparatus 1.
In
An inspection with the area camera is conducted with the surface inspection apparatus 1 and the inspection object 10 being at rest. In other words, the surface of the inspection object 10 is inspected in a state in which the surface inspection apparatus 1 and the inspection object 10 do not relatively move.
In
In some practical cases, the inspection object 10 has, for example, a hole, a notch, a projection, or a step.
Examples of the kinds of finishes of the surface of the inspection object 10 include no processing, mirror finish processing, semi-mirror finish processing, and texturing processing.
The surface inspection apparatus 1 inspects defects and the texture of the surface of the inspection object 10.
Examples of the defects include a sink mark and a weld line. The sink mark is a surface depression that is formed in a thick portion or a rib portion. The weld line is a stripe that is formed on a portion to which the end of melted resin joins in a mold. A dent and a scratch that are formed when an object hits the surface are also included in the examples of the defects.
The texture represents visual or tactile impression and is affected by the color, gloss, and unevenness of the surface of the object. The unevenness of the surface includes a stripe that is formed when a mold is cut. This kind of stripe differs from the defects.
The surface inspection apparatus 1 according to the present exemplary embodiment is used not only for an inspection of the defects and the texture but also for an inspection of a stain on the surface.
The surface inspection apparatus 1 generates an image that emphasizes each defect of the surface of the inspection object 10 and quantifies and outputs the result of evaluation of the texture. The defects described herein correspond to unevenness and a stripe that appear at a portion that is originally flat, that is, the sink marks and the weld line. The texture is evaluated by a numeral. The inspection object 10 illustrated in
The surface inspection apparatus 1 is disposed above the inspection object 10 in the vertical direction. In other words, the optical axis of an optical system that is used by the surface inspection apparatus 1 for imaging the inspection object 10 is set to be substantially parallel to the normal of the surface of the inspection object 10. In the following description, conditions for the optical axis are also referred to as “imaging conditions”.
At this time, the surface inspection apparatus 1 is placed at a position that satisfies the imaging conditions. The surface inspection apparatus 1 may be placed so as to be secured to a specific member or so as to detachable from the specific member.
The surface inspection apparatus 1 may be carried by an operator. In this case, the operator holds the surface inspection apparatus 1 by, for example, the hands and directs a light-receiving surface at the inspection object 10 to inspect a freely selected surface.
The surface inspection apparatus 1 illustrated in
The processor 101, the ROM 102, and the RAM 103 function as a computer. The processor 101 achieves various functions by performing the program. For example, the processor 101 performs the program for generating an image that represents the surface of the inspection object 10 and the luminescence of illumination light.
The image data that is acquired by imaging the surface of the inspection object 10 is stored in the auxiliary storage device 104. Examples of the auxiliary storage device include a semiconductor memory and a hard disk device. The auxiliary storage device 104 also stores firmware and an application program. In the following description, the firmware and the application program are collectively referred to as a “program”.
Examples of the display 105 include a liquid-crystal display and an organic EL display, and the display 105 displays, for example, an image of the entire inspection object 10 or a specific portion of the inspection object 10. The display 105 is also used for position adjustment between the inspection object 10 and the imaging range.
According to the present exemplary embodiment, the display 105 is integrally formed with the apparatus body but may be an external device that is connected via the communication IF 110 or may be a part of another device that is connected via the communication IF 110. For example, the display 105 may be a display for another computer that is connected via the communication IF 110.
The operation-receiving device 106 is configured by using, for example, a physical switch or button that is included in the housing or a touch sensor that is included in the display 105.
A device into which the display 105 and the operation-receiving device 106 are integrally formed is called a touch screen. The touch screen is used to receive a user operation into a displayed software keyboard (also referred to as a soft keyboard).
According to the present exemplary embodiment, a color camera is used as the camera 107. A charge coupled device (CCD) imaging sensor element or a complementary metal oxide semiconductor (CMOS) imaging sensor element, for example, is used as an imaging element in the camera 107.
The use of the color camera as the camera 107 enables the luminance and the color tone of the surface of the inspection object 10 to be observed. The camera 107 is an example of an imaging device.
According to the present exemplary embodiment, white light sources are used as the light sources 108 and 109.
The light source 108 is disposed at an angle such that a light component that is reflected by specular reflection from the surface of the inspection object 10 is a principal light component that is incident on the camera 107. The light source 108 is an example of a first light source.
The light source 109 is disposed at an angle such that a light component that is reflected by diffuse reflection from the surface of the inspection object 10 is a principal light component that is incident on the camera 107. The light source 109 is an example of a second light source.
In
According to the present exemplary embodiment, the light source 108 and the light source 109 are disposed opposite each other with the optical axis of the camera 107 interposed therebetween.
According to the present exemplary embodiment, unparallel light sources are used as the light source 108 and the light source 109. That is, point light sources or surface light sources are used as the light source 108 and the light source 109.
In the surface inspection apparatus 1 according to the present exemplary embodiment, the output axis of illumination light that is emitted from the light source 108, the output axis of illumination light that is emitted from the light source 109, and the optical axis of the camera 107 are substantially on the same plane.
The communication IF 110 is configured by using a module that conforms to a wired or wireless communication standard. An Ethernet (registered trademark) module, a universal serial bus (USB), or a wireless LAN, for example, is used as the communication IF 110.
In
According to the present exemplary embodiment, the range of an opening of the light-shielding frame 100 that is pressed against the surface of the inspection object 10 corresponds to the imaging range. However, the range of the opening of the light-shielding frame 100 that is pressed against the surface of the inspection object 10 may be wider than the imaging range.
The opening of the light-shielding frame 100 is formed such that there is no gap between the surface of the inspection object 10 and the light-shielding frame 100 that is pressed against the surface of the inspection object 10. An elastic member composed of, for example, rubber or resin that deforms when being pressed may be attached around the opening.
A jaw portion a section of which has a V-shape is disposed at the opening of the light-shielding frame 100 illustrated in
In
In
In this case, the modulation transfer function (MTF) of the camera 107 within the field of vision is substantially uniform. For this reason, a variation in contrast due to a difference in a position within the field of vision is small, and the state of the surface of the inspection object 10 is faithfully imaged.
However, the optical axis L1 may not be strictly parallel to the normal N0, for example, provided that the optical axis L1 is substantially within 10° with respect to the normal N0.
In
However, the surface of the inspection object 10 practically has structural or design unevenness, a curved portion, a step, a seam, fine unevenness that is formed during, for example, molding, or another unevenness.
Accordingly, the direction in which the camera 107 is disposed is determined by using the average value of the normal N0 in a region AR to which attention is paid in the inspection object 10 or the normal N0 at a specific position P to which attention is paid. Other than these, the normal N0 of a representative portion or an average, virtual surface of the inspection object 10 may be used.
A non-telecentric lens is used as the lens of the camera 107 that is used according to the present exemplary embodiment. The unparallel light sources are used as the light sources 108 and 109 as described above.
For this reason, the size and costs of the camera 107 are smaller than those in the case where a telecentric lens and parallel light sources, for example, are used.
In
In the case where the light source 108 is the point light source or the surface light source, the output axis LA of the illumination light means the central axis of luminous flux that is emitted from the light source 108, and this results in a direction in which luminous intensity is the maximum. The same is true for the output axis LB in the light source 109.
In the case where the angle θA is set to be less than substantially 5°, the light source 108 is likely to inhibit the light component that is reflected by the specular reflection from the surface of the inspection object 10 from being incident on the camera 107. According to the present exemplary embodiment, for this reason, the minimum of the angle θA is set to be substantially 5°.
According to the present exemplary embodiment, the maximum of the angle θA is set to be substantially 15°. However, 15° is a guide, and the maximum of the angle may be 15° or more. For example, the maximum of the angle θA may be set to be substantially 15° or more by using the telecentric lens and the parallel light sources.
In the case where the angle θA is more than substantially 15° and is more than a threshold angle, however, the principal light component that is included in reflection light that is incident on the camera 107 is changed from the light component that is reflected by the specular reflection into the light component that is reflected by the diffuse reflection.
In view of this, in an example according to the present exemplary embodiment, the percentage of the light component that is reflected by the specular reflection in the reflection light that is incident on the camera 107 is increased, the light source 108 is located so as not to inhibit the light component from being incident on the camera 107, and the angle θA of the light source 108 is set to be substantially 5°.
Consequently, the light component that is included in the illumination light that is emitted from the light source 108 and that is reflected by the specular reflection is the principal light component that is incident on the camera 107.
A phrase such as the “light component that is reflected by the specular reflection is the principal light component that is incident on the camera 107” is described herein because there is a possibility that the light component that is reflected by the diffuse reflection from the surface of the inspection object 10 is somewhat incident on the camera 107 depending on a relationship between slopes of the fine unevenness that is formed on the surface or the structural unevenness of the inspection object 10 and the angle of the illumination light.
According to the present exemplary embodiment, the illumination light that is emitted from the light source 108 is used to acquire information about the texture of the surface of the inspection object 10, particularly the gloss. This is also because a person readily notices a defect of a portion having the gloss.
The illumination light that is emitted from the light source 108 is incident on the unevenness of the surface of the inspection object 10 in the substantially vertical direction. For this reason, an image that the camera 107 acquires by imaging by using the illumination light that is emitted from the light source 108 has little information about shadow due to the unevenness of the surface of the inspection object 10.
In
In the case where the angle θB is set to be substantially 45°, the light component that is reflected by the diffuse reflection from the surface of the inspection object 10 is the principal light component that is incident on the camera 107.
Also, in this case, there is a possibility that the light component that is included in the illumination light that is emitted from the light source 109 and that is reflected by the specular reflection is incident on the camera 107 depending on a relationship between the structural or design unevenness of the inspection object 10 or the like and the angle of the illumination light. For this reason, a phrase such as the “light component that is reflected by the diffuse reflection from the surface of the inspection object 10 is the principal light component that is incident on the camera 107” is used.
According to the present exemplary embodiment, the light source 108 and the light source 109 are disposed opposite each other with the optical axis L1 of the camera 107 interposed therebetween. For this reason, directions in which shadow that is formed in association with the unevenness of the surface of the inspection object 10 extends are opposite each other in principle.
In other words, the direction of the shadow that is formed by the illumination light that is emitted from the light source 108 in association with the unevenness of the surface of the inspection object 10 is opposite the direction of the shadow that is formed by the illumination light that is emitted from the light source 109 in association with the same unevenness of the surface of the inspection object 10.
The unevenness of the surface of the inspection object 10 is illuminated with the illumination light that is emitted from the light source 109 diagonally from above. Accordingly, the shadow of a projecting portion on the surface appears so as to be away from the light source 109, and the shadow of a depressed portion on the surface appears so as to approach the light source 109.
Accordingly, in the case where the surface of the inspection object 10 is imaged from above in the vertical direction, it may be made easy to observe the unevenness of the surface of the inspection object 10 by using the light source 108 and the light source 109.
The surface inspection apparatus 1 according to the present exemplary embodiment starts the inspection operation, switches the light source A on, and acquires an image A by imaging the surface of the inspection object 10 (step 1). The light source A described herein is the light source 108. The image A is an example of a first image.
When imaging for the image A ends, the surface inspection apparatus 1 switches the light source A off (step 2).
Subsequently, the surface inspection apparatus 1 switches the light source B on and acquires an image B by imaging the surface of the inspection object 10 (step 3). The light source B described herein is the light source 109. The image B is an example of a second image.
When imaging for the image B ends, the surface inspection apparatus 1 switches the light source B off (step 4).
Subsequently, the surface inspection apparatus 1 generates an image C by subtracting a luminance profile SB of the image B from a luminance profile SA of the image A (step 5) and displays the generated image C on the display 105 (see
The luminance profiles SA and SB described herein represent so-called intensity value distribution of a luminance signal. The image C is an example of a third image and contains information about the texture such as the gloss and so on.
In
In this case, as for the luminance profile SA illustrated in
As for the luminance profile SB illustrated in
The distribution of the intensity value occurs because the light source 109 is on the left of the depression. A principal light component that is contained in the luminance profile SB is the light component that is reflected by the diffuse reflection.
As illustrated in
Consequently, as for the image C illustrated in
The image C contains shadow due to the illumination light that is radiated from both regions with the optical axis Ll interposed therebetween. The image A that is acquired by using the illumination light from the light source 108 has little information about the shadow.
The camera 107 of the surface inspection apparatus 1 that is used according to the present exemplary embodiment is the non-telecentric lens.
The surface inspection apparatus 1 calculates a difference between the light component that is reflected by the specular reflection and the light component that is reflected by the diffuse reflection, that is, generates the image C related to the luminance profile SA-SB.
In an example described according to the present exemplary embodiment, the image C is displayed on the display 105 (see
The example of the display illustrated in
If the determination completely depends on the operator, a location to be checked is overlooked in some cases.
As for the example of the display illustrated in
The frame 105A illustrated in
In
The number of the frame 105A that is displayed at the same time may be plural. For example, the frames 105A may be displayed at all of locations that are surrounded by dashed lines in
The location to be checked may be inhibited from being overlooked regardless of the proficiency of the operator by displaying the frame 105A.
The form of displayed blinking, the kind of a line, the thickness of the line, and the color of the displayed frame 105A, for example, may be determined depending on the environment of the inspection or the inspection object 10. For example, an opposite color or a complementary color of the color tone of the inspection object 10 may be used as the color of the frame 105A to improve the visibility of the location to be checked.
Various methods of determining the location at which the frame 105A is displayed are thought.
For example, in the case where the position of the surface inspection apparatus 1 and the position of the inspection object 10 are uniquely determined, the position on the screen at which the frame 105A is displayed is set in advance. In other words, in the case where the position of the inspection object 10 is adjusted to be the position that is set in advance for the surface inspection apparatus 1, the position on the screen at which the frame 105A is displayed or the shape thereof, for example, is set in advance.
In the case where the position of the surface inspection apparatus 1 and the position of the inspection object 10 are not uniquely determined, however, a structurally characteristic point that is contained in the image C that is acquired by imaging is used as a criterion, and the processor 101 (See
Also, in an example described according to the present exemplary embodiment, the image C is displayed on the display 105 (see
According to the present exemplary embodiment, however, the indicator is physically attached to the surface inspection apparatus 1.
According to the present exemplary embodiment, as illustrated in
For this reason, as illustrated in
It may be facilitated to make position adjustment between the surface inspection apparatus 1 that is stationary and the inspection object 10 and position adjustment between the inspection object 10 that is stationary and the surface inspection apparatus 1 by displaying the frame 112A on the display 105.
The surface inspection apparatus 1 illustrated in
One of the two light sources 109 is disposed at the same position as the light source 109 according to the first exemplary embodiment. In
The other light source 109 that is added in
According to the present exemplary embodiment, the angle θB1 and the angle θB2 are substantially equal to each other.
However, the angle θB1 and the angle θB2 may differ from each other. The angle θB1 and the angle θB2 are set to be within the range in which the light component that is reflected by the diffuse reflection from the surface of the inspection object 10 is the principal light component that is incident on the camera 107.
According to the present exemplary embodiment, the output axis LA of the illumination light that is emitted from the light source 108, the output axis LB1 of the illumination light that is emitted from the light source B1, the output axis LB2 of the illumination light that is emitted from the light source B2, and the optical axis L1 of the camera 107 are substantially on the same plane.
The angle θB2 of the light source B2 is larger than the angle θA of the light source A. Accordingly, the length of shadow that appears in the image B2 is longer than that length of shadow that appears in the image A even when the same unevenness is imaged.
In the case where the light source B1 and the light source B2 are disposed opposite each other with the optical axis L1 of the camera 107 interposed therebetween, directions in which the shadow extends are opposite each other between two images B that are acquired by imaging the illumination light of the light sources.
The surface inspection apparatus 1A that is used according to the present exemplary embodiment uses a so-called line camera. For this reason, the imaging range is linear.
According to the present exemplary embodiment, the inspection object 10 is moved in the direction of an arrow with the inspection object 10 placed on a single-axis stage 20 during inspection. The entire inspection object 10 is imaged by moving the single-axis stage 20 in one direction.
A relationship in arrangement of the camera 107, the light source 108 (See
Specifically, it may be thought that the light-receiving surface of the camera 107 linearly extends in the Y-axis, that is, in the direction toward the back of the paper in
(1) The exemplary embodiments of the present disclosure are described above. However, the technical range of the exemplary embodiments of the present disclosure is not limited by the range described according to the exemplary embodiments described above. It is clear from the recitation of claims that exemplary embodiments that are acquired by modifying or altering the exemplary embodiments described above in various ways are in the technical range of the exemplary embodiments of the present disclosure.
(2) According to the exemplary embodiments described above, the color camera is used as the camera 107 (See
(3) According to the exemplary embodiments described above, the white light sources are used as the light sources 108 and 109 (See
The illumination light is not limited to the visible light but may be infrared light, ultraviolet light, or another light. When the infrared light or the ultraviolet light, for example, is used as the illumination light, the positions at which the light source 108 and the light source 109 are disposed are defined by using a relationship between the specular reflection and the diffuse reflection.
(4) According to the exemplary embodiments described above, the maximum of the angle θA is substantially 15°. However, in the case where the telecentric lens that makes the principal ray parallel to the optical axis of the lens is used as the camera 107, the maximum of the angle θA may be substantially 25°.
(5) According to the exemplary embodiments described above, the angle θB is substantially 45° but may be in the range from substantially 35° to substantially 55°.
(6) According to the exemplary embodiments described above, the image C is generated by subtracting the image B that is acquired by imaging the reflection light of the light source 109 from the image A that is acquired by imaging the reflection light of the light source 108. However, the images may be separately displayed on the display 105.
(7) According to the exemplary embodiments described above, the images are captured by switching the light source 108 and the light source 109 on and off. However, the images may be captured with the light source 108 and the light source 109 simultaneously switched on.
(8) In the description according to the above exemplary embodiments, the output axis LA of the illumination light that is emitted from the light source 108, the output axis LB of the illumination light that is emitted from the light source 109, and the optical axis L1 of the camera 107, for example, are substantially on the same plane. However, the light source 108 or the light source 109 may be on a different plane.
(9) In the embodiments above, the term “processor” refers to hardware in a broad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
The foregoing description of the exemplary embodiments of the present disclosure has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical applications, thereby enabling others skilled in the art to understand the disclosure for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the disclosure be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2021-038682 | Mar 2021 | JP | national |