The present invention relates to a foreign object inspection device configured to inspect presence or absence of a foreign object floating on a liquid surface, an information processing method, and a storage medium.
Various types of devices configured to inspect whether or not there is a foreign object in the liquid contained in a transparent container have been used in practice. Many of them mainly detect presence or absence of a foreign object floating in the liquid (for example, see Patent Literature 1 and 2). However, a foreign object such as a plastic piece may float on a liquid surface of injection preparation or the like contained in a transparent container. Therefore, it is important to inspect present or absence of a foreign object floating on a liquid surface.
An example of a device configured to inspect presence or absence of a foreign object floating on a liquid surface is described in Patent Literature 3. In the art described in Patent Literature 3 (hereinafter referred to as art related to the present invention), illumination light is emitted to the rear side of a liquid surface from the bottom of a transparent container, and the rear side of the liquid surface is imaged by an imaging means disposed on the advancing path of the light reflected on the rear side of the liquid surface, and whether or not there is a foreign object on the liquid surface is determined based on the captured image.
In the art related to the present invention, when a liquid surface is a completely flat surface, the liquid surface is imaged as a uniform white region, and a foreign object floating on the liquid surface is captured as a blackish image according to the reflection coefficient thereof. However, there is a case where it is difficult to stably determine that there is no foreign object on a liquid surface because of appearance of a blackish area that is hard to be distinguished from an image of a foreign object due to various grounds.
An object of the present invention is to provide a foreign object inspection device that solves the above-described problem.
A foreign object inspection device, according to one aspect of the present invention, is configured to include an acquisition means for acquiring an image around a liquid surface in the shape of a paraboloid of revolution in a transparent container, the liquid surface in the shape of a paraboloid of revolution being formed when the transparent container containing a transparent liquid is rotated about a central axis at a given speed, the image being captured from a side of the transparent container under transmitted illumination; and a determination means for acquiring a luminance value of a pixel along a line extending in a direction parallel to the central axis in the image, generating one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determining whether or not there is a foreign object on the liquid surface.
Further, a foreign object inspection method, according to another aspect of the present invention, is configured to include
Further, a computer-readable medium, according to another aspect of the present invention, is configured to store thereon a program for causing a computer to execute processing to:
Since the present invention has the configurations described above, it is possible to stably determine that there is no foreign object on a liquid surface.
Next, a first example embodiment of the present invention will be described with reference to the drawings. First, the basic principle of determining that there is no foreign object on a liquid surface will be described. Hereinafter, it is assumed that a specific example of a foreign object floating on a liquid surface is a plastic piece. However, a foreign object floating on a liquid surface is not limited to a plastic piece.
In order to determine that there is no foreign object on a liquid surface, it is necessary to detect a liquid surface and confirm that there is no foreign object on the detected liquid surface.
When a colorless and transparent liquid is put into a cylindrical transparent container and is rotated about the central axis at a given speed, a liquid surface in the shape of a paraboloid of revolution is formed. An image 1 obtained by capturing the vicinity of the liquid surface in the shape of a paraboloid of revolution with a camera from a lateral direction under the transmitted illumination is, for example, an image schematically illustrated in
Meanwhile, when the speed of rotation of the transparent container becomes a predetermined value or lower, a liquid surface in the shape of a paraboloid of revolution is not formed. As a result, when the image 1 is obtained by capturing the transparent container under the same condition as that of
In view of the above, in the present embodiment, a liquid surface in the shape of a paraboloid of revolution is formed by rotating a transparent container containing a transparent liquid about the central axis at a given speed. Then, an image around the liquid surface in the shape of a paraboloid of revolution is acquired by capturing the transparent container in which the liquid surface in the shape of a paraboloid of revolution is formed, from a lateral direction under the transmitted illumination. Then, a liquid surface is detected by detecting the low luminance region 4 having a predetermined luminance value or lower from the image. As a result, it is possible to stably detect the liquid surface in the container.
In the case where a plastic piece having a specific gravity smaller than that of a content liquid is floating on the liquid surface in a transparent container, when the transparent container is rotated about the central axis to form a liquid surface in the shape of a paraboloid of revolution, the plastic piece tends to come close to the center of the liquid surface in the shape of a paraboloid of revolution (near the central axis of the container). Therefore, when the image 1 is obtained by capturing the transparent container under the same condition as that of
In the case where there is a bubble around the liquid surface in the shape of a paraboloid of revolution, it moves in synchronization with rotation of the container in a state where the bubble adheres to or does not adhere to the inner wall of the container. Therefore, when the image 1 is obtained by capturing the transparent container under the same condition as that of
The present embodiment acquires luminance values of pixels along a line extending in a direction parallel to the central axis of the container in the image of a liquid surface in the shape of a paraboloid of revolution as described above, generates one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determines whether or not there is a foreign object on the liquid surface.
In
Therefore, in the present embodiment, the feature of a spatial change in the luminance values in the one-dimensional data 8 as illustrated in
The basic principle of the present embodiment to determine that there is no foreign object on a liquid surface is as described above. Next, a configuration and operation of the present embodiment will be described in detail with reference to the drawings.
The container 400 is a transparent or translucent container having a circular cross-section such as a glass bottle or a plastic bottle. The container 400 contains therein liquid pharmaceuticals (hereinafter referred to as a drug solution). On the liquid surface of the drug solution contained in the container 400, there is a possibility that a foreign object floats. A foreign object floating on a liquid surface is, for example, a plastic piece. The container 400 is a syringe previously filled with a drug solution, for example. However, the container 400 to be inspected is not limited to a syringe. The container 400 may be a vial or an ampule in which a drug solution is contained. Moreover, the container 400 is not limited to a container containing a drug solution, and it may be a container containing drinking water.
The holding device 110 is configured to hold the container 400 in an upright posture. For example, in the case of a syringe, the holding device 110 holds the syringe in an upright posture with the nozzle side being the upper side. Any mechanism may be used for holding the container 400 in an upright posture. For example, the holding mechanism may be configured to include a pedestal on which the container 400 is placed in an upright posture, a member that presses a top surface of a vertex portion 401 of the container 400 placed on the pedestal, and the like.
The holding device 110 is configured to rotate the container 400 about the central axis while holding the container 400. Any mechanism may be used for rotating the container 400. For example, the mechanism for rotation may be configured to include a motor that rotates the entire holding mechanism in a state of holding the container 400.
The holding device 110 is connected with the foreign object inspection device 200 in a wired or wireless manner. When the holding device 110 is activated by an instruction from the foreign object inspection device 200, the holding device 110 rotates the container 400 about the central axis in an upright posture while being held. Further, the holding device 110 stops operation of rotating the container 400 in response to a stop instruction from the foreign object inspection device 200.
When the container 400 is rotated at a given speed as described above, the liquid in the container 400 flows and a liquid surface in the shape of a paraboloid of revolution is formed. In the case where a foreign object such as a plastic piece is floating on the liquid surface of the container 400, when the container 400 is rotated and a liquid surface in the shape of a paraboloid of revolution is formed, the foreign object such as a plastic piece tends to move to the central portion of the liquid surface in the shape of a paraboloid of revolution. Moreover, a bubble existing near the liquid surface before the rotation and a bubble generated near the liquid surface by the rotation move near the liquid surface in synchronization with the rotation. Accordingly, the foreign object inspection device 200 inspects whether or not there is any floating object on the liquid surface in the shape of a paraboloid of revolution, and when there is any, identifies whether the floating object is a foreign object or a bubble.
The illumination device 120 is configured to irradiate the liquid contained in the container 400 with illumination light. For example, the illumination device 120 is a surface light source in a size corresponding to the size of the container 400. The illumination device 120 is disposed on the side opposite to the side where the camera device 130 is disposed when viewed from the container 400. That is, illumination provided by the illumination device 120 is transmitted illumination.
The camera device 130 is a high-speed camera that images a liquid in the container 400 from a direction opposite to the side where the illumination device 120 is installed when viewed from the container 400. The video rate of the camera device 130 may be about 160 fps, for example. However, the video rate of the camera device 130 may be other than that described above. Further, the camera device 130 may be a black and white camera equipped with a charge-coupled device (CCD) image sensor or a complementary MOS (CMOS) image sensor having a pixel capacity of about several millions pixels, and outputs a grayscale image representing one pixel in eight bits, for example. However, the camera device 130 may be a color camera. Moreover, the level of a luminance value of the grayscale image is not limited to 256 gradations, and more or less gradations are also acceptable. The camera device 130 is connected with the foreign object inspection device 200 in a wired or wireless manner. The camera device 130 transmits the captured time-series images to the foreign object inspection device 200, together with information indicating the capturing time and the like.
The display device 300 is a display device such as a liquid crystal display (LCD). The display device 300 is connected with the foreign object inspection device 200 in a wired or wireless manner. The display device 300 displays the results of inspection and the like of the container 400 performed by the foreign object inspection device 200.
The foreign object inspection device 200 is configured to perform image processing on the time-series images captured by the camera device 130, and inspect presence or absence of a foreign object floating on the liquid surface of the liquid contained in the container 400. The foreign object inspection device 200 is connected with the holding device 110, the camera device 130, and the display device 300 in a wired or wireless manner.
The communication I/F unit 210 is configured of a data communication circuit, and is configured to perform data communication with the holding device 110, the camera device 130, the display device 300, and other external devices not illustrated, in a wired or wireless manner. The operation input unit 220 is configured of operation input devices such as a keyboard and a mouse, and is configured to detect operation by an operator and output it to the arithmetic processing unit 240.
The storage unit 230 is configured of one or more storage devices of one or a plurality of types such as a hard disk and a memory, and is configured to store therein processing information necessary for various types of processing performed in the arithmetic processing unit 240 and a program 231. The program 231 is a program for implementing various processing units by being read and executed by the arithmetic processing unit 240, and is read in advance from an external device or a storage medium, not illustrated, via a data input-output function of the communication I/F unit 210 and is stored in the storage unit 230. The main processing information to be stored in the storage unit 230 includes image information 232 and inspection result information 233.
The image information 232 includes time-series images obtained by sequentially capturing the liquid in the container 400 with the camera device 130. In the case where there is a floating object in the liquid in the container 400, an image of the floating object is shown in the image information 232.
The inspection result information 233 is information about a result of inspecting presence or absence of a foreign object in the liquid contained in the container 400 to be inspected.
Referring to
The acquisition unit 241 controls the holding device 110 to rotate the container 400 containing a transparent liquid about the central axis at a given speed to thereby form a liquid surface in the shape of a paraboloid of revolution. The acquisition unit 241 also controls the camera device 130 to continuously image the container 400 in which the liquid surface in the shape of a paraboloid of revolution is formed, from a side of the container 400 under the transmitted illumination by the illumination device 120. The acquisition unit 241 also acquires a plurality of grayscale images around the liquid surface in the shape of a paraboloid of revolution obtained from continuous imaging, and stores them in the storage unit 230 as image information 232.
The determination unit 242 reads the image information 232 from the storage unit 230, and determines whether or not there is a foreign object on the liquid surface for each grayscale image around the liquid surface in the shape of a paraboloid of revolution represented by the image information 232. For example, the determination unit 242 acquires a luminance value of a pixel along each of the lines extending in a direction parallel to the central axis of the container 400 in the grayscale image, and generates one-dimensional data of the luminance values for each line. Then, the determination unit 242 determines whether or not there is a foreign object on the liquid surface, on the basis of a spatial change in the luminance values in the one-dimensional data for each line. Specifically, the determination unit 242 compares a spatial change in the luminance values in the one-dimensional data with a change in the luminance values when there is no floating object on the liquid surface, and when they match, determines that there is no foreign object on the liquid surface. On the contrary, when they do not match, the determination unit 242 computes a floating object candidate area where there is a possibility that a floating object is present on the basis of a spatial change in the luminance values in the one-dimensional data, and recognizes the floating object from the floating object candidate area, and determines whether the recognized floating object is a foreign object or a bubble. The determination unit 242 repeats the above-described processing on all grayscale images obtained from the same container 400 included in the image information 232. Then, the determination unit 242 creates the inspection result information 233 on the basis of a result of determination on all grayscale images, and stores it in the storage unit 230.
The output unit 243 reads the inspection result information 233 from the storage unit 230, displays it on the screen of the display device 300 via the communication I/F unit 210, or/and outputs it to an external device not illustrated.
Next, operation of the inspection system 100 will be described.
Referring to
Then, the determination unit 242 reads the image information 232 from the storage unit 230, and for each grayscale image, acquires a luminance value of a pixel along each of the lines extending in a direction parallel to the central axis, and generates one-dimensional data of the luminance values of the pixels for each line (step S3). Further, on the basis of a spatial change in the luminance values in the one-dimensional data generated for each grayscale image and each line at step S3, the determination unit 242 determines whether or not there is a foreign object on the liquid surface, and creates the inspection result information 233 representing the determination result and stores it in the storage unit 230. Then, the output unit 243 reads the inspection result information 233 from the storage unit 230, displays it on the screen of the display device 300 via the communication I/F unit 210, or/and outputs it to an external device not illustrated (step S4).
Next, the acquisition unit 241 and the determination unit 242 will be described in detail.
First, the details of the acquisition unit 241 will be described.
The acquisition unit 241 first activates the holding device 110 holding the container 400 in an upright posture to rotate the container 400 about the central axis at a rotational speed of a given speed, that is, about 100 to 200 rotations/minute, and forms a liquid surface in the shape of a paraboloid of revolution in the container 400. The given speed may be 100 to 200 rotations/minute, for example. However, a rotational speed necessary for forming a liquid surface in the shape of a paraboloid of revolution differs depending on the viscosity of the contained liquid. Therefore, it is desirable to check the rotational speed at which a liquid surface in the shape of a paraboloid of revolution is formed through a previous test. In addition, when the rotational speed of the container 400 varies, the liquid surface in the shape of a paraboloid of revolution varies. Therefore, it is desirable that the rotational speed of the container 400 is a predetermined constant speed.
Then, the acquisition unit 241 continuously images the rotating container 400 with the camera device 130 under the transmitted illumination by the illumination device 120. For example, in the case where the frame rate of the camera device 130 is 160 fps for example, when the camera device 130 continuously images it for 0.5 seconds for example, 80 pieces of grayscale images are acquired. By continuously capturing a plurality of images of the rotating container 400 in this way, it is possible to image a foreign object floating on the liquid surface in different postures. Therefore, it is possible to prevent a foreign object from being overlooked. Note that the number of images to be acquired is determined based on a tradeoff between the inspection accuracy and the processing speed.
Then, the acquisition unit 241 performs an image stabilization process such as elimination of flickers on each of the acquired grayscale images, and then cuts out an image around the liquid surface in the shape of a paraboloid of revolution and stores it in the storage unit 230 as the image information 232.
As described above, the acquisition unit 241 acquires a plurality of grayscale images around the liquid surface in the shape of a paraboloid of revolution as schematically illustrated in
Next, the details of the determination unit 242 will be described.
Each piece of the image analysis information 502 is configured of an image ID 503, a luminance measurement line ID 504, one-dimensional data 505, a comparison result 506, a floating object candidate area 507, and presence/absence of foreign object 508. In the field of the image ID 503, an ID of a grayscale image (for example, imaging time 2322) is set. There are a plurality of sets of the luminance measurement line ID 504, the one-dimensional data 505, and the comparison result 506. In the field of the luminance measurement line ID 504, an ID of a line in which the luminance value of a pixel on the grayscale image is measured is set. In the field of the one-dimensional data 505, one-dimensional data of a luminance value of a pixel acquired along the line specified by the luminance measurement line ID 504 of the same set is set. In the field of the comparison result 506, a result of comparing the feature of a spatial change in the luminance value in the one-dimensional data 505 in the same set with the previously registered reference feature is set.
Referring to
In the initialization step S11 of the control table 500 in
Upon completion of initialization of the control table 500, the determination unit 242 focuses on one image ID 503 (for example, top image ID 503) set in the control table 500 (step S11). Then, for each luminance measurement line ID 504 from the grayscale image identified by the focused image ID 503, the determination unit 242 acquires a luminance value of a pixel along the luminance measurement lines 510-1 to 510-6 and creates the one-dimensional data 505 (step S13). For example, the determination unit 242 creates the one-dimensional data 505 by sequentially acquiring the luminance value of a pixel of the grayscale image along one luminance measurement line from the air layer 2 side one by one, and aligning the acquired luminance values of the pixels in the acquired sequence in a line. Instead of storing the created one-dimensional data as it is in the control table 500, the determination unit 242 may store one-dimensional data obtained by performing smoothing on the created one-dimensional data in the control table 500.
Then, for each piece of the one-dimensional data 505, the determination unit 242 compares the feature of a spatial change in the luminance values of the pixels in the one-dimensional data 505 with the reference feature, and stores the comparison result 506 showing whether or not the feature of the one-dimensional data 505 matches the reference feature (step S14). The reference feature is previously created based on the one-dimensional data of the case where there is no foreign object and bubble on the liquid surface, and stored previously. The reference feature has a feature that after the luminance value of a pixel largely drops in the boundary part between the air layer 2 and the low luminance region 4, the luminance value of a pixel never drops thereafter until it reaches the liquid layer 3. Accordingly, the determination unit 242 scans the luminance value of a pixel from the top (air layer side) of the one-dimensional data 505, and detects a part where the luminance value of a pixel drops to a value equal to or smaller than a predetermined threshold as a boundary between the air layer 2 and the low luminance region 4 (that is, liquid surface). Then, after the detected boundary, when the luminance value of a pixel never drops from the luminance value of the pixel immediately before it until the end of the one-dimensional data 505, the determination unit 242 determines that the one-dimensional data 505 matches the reference feature. On the other hand, after the boundary, when there is at least one part where the luminance value of a pixel in the one-dimensional data 505 drops from the luminance value of the pixel immediately before it, the determination unit 242 determines that the one-dimensional data 505 does not match the reference feature.
Then, the determination unit 242 determines whether or not every one-dimensional data 505 matches the reference feature (step S15). Then, when every one-dimensional data 505 matches the reference feature, the determination unit 242 records that there is no foreign object in the field of the presence/absence of foreign object 508 corresponding to the focused image ID 503 (step S16). Then, the determination unit 242 proceeds to step S21.
On the other hand, when at least one piece of one-dimensional data 505 does not match the reference feature, the determination unit 242 computes the floating object candidate area 507 (step S17).
Moreover, the determination unit 242 determines an upper boundary line 513 of the floating object candidate area 507 as described below. First, the determination unit 242 detects a boundary between the air layer 2 and the low luminance region 4 from the one-dimensional data 505 not matching the reference feature. When there are a plurality of pieces of one-dimensional data 505 not matching the reference feature, the determination unit 242 detects a boundary that is present on the uppermost side among the respective boundaries detected therefrom. Then, the determination unit 242 draws a line passing through the detected boundary and intersecting the central axis of the container 400, and determines the line as the upper boundary line 513 of the floating object candidate area 507.
Furthermore, the determination unit 242 determines a lower boundary line 514 of the floating object candidate area 507 as described below. First, the determination unit 242 scans the luminance value of the pixel of the one-dimensional data 505 not matching the reference feature from the last (liquid layer side) to the top, and detects a part where the luminance value of the pixel drops by a certain value ΔL or more for the first time, as a lower boundary. Here, ΔL is determined in advance based on the difference in the luminance values of the pixels between the liquid layer 3 and the floating object. When there are a plurality of pieces of one-dimensional data 505 not matching the reference feature, the determination unit 242 detects a lower boundary that is present on the lowermost side among the respective lower boundaries detected therefrom. Then, the determination unit 242 draws a line passing through the detected lower boundary and intersecting the central axis of the container 400, and determines the line as the lower boundary line 514 of the floating object candidate area 507.
The determination unit 242 determines an area surrounded by the left boundary line 511, the right boundary line 512, the upper boundary line 513, and the lower boundary line 514 determined as described above, to be the floating object candidate area 507. By determining the floating object candidate area 507 on the basis of the one-dimensional data 505 not matching the reference feature, it is possible to reduce the size of the floating object candidate area 507 compared with the case of handling the entire area around the liquid surface as the floating object candidate area, and accordingly, to reduce the processing amount to check a foreign object and a bubble from the floating object candidate area 507.
Note that the method of determining the floating object candidate area 507 on the basis of the one-dimensional data 505 not matching the reference feature is not limited to that described above. For example, it is possible to detect an upper end and a lower end of a foreign object or a bubble from a spatial change in the luminance value of a pixel in the one-dimensional data 505, and determine the lines passing through the detected upper end and lower end and intersecting the central axis of the container 400 to be the upper boundary line 513 and the lower boundary line 514. With such a method, in the example of
Referring to
The determination unit 242 first recognizes the floating object area from the floating object area candidate area 507 in the grayscale image of the focused image ID. A foreign object or a bubble in the liquid layer 3 and the high luminance region 5 appear as a group of low luminance pixels, compared with the liquid layer 3 and the high luminance region 5. Therefore, the determination unit 242 recognizes an area where low luminance pixels are distributed continuously in the certain number of pixels or more in the liquid layer 3 and the high luminance region 5, as one floating object area. Further, a foreign object or a bubble in the low luminance region 4 appears as a group of high luminance pixels, compared with the low luminance region 4. Therefore, the determination unit 242 recognizes an area where high luminance pixels are distributed continuously in the certain number of pixels or more in the low luminance region 4, as one floating object area.
Then, for each floating object area, the determination unit 242 determines whether the area is a foreign object or a bubble, on the basis of the feature of the shape. For example, a bubble in the liquid layer 3 and the high luminance region 5 has a hollow shape configured of a linear contour portion and a hollow portion in the contour portion, while it is an extremely rare case where a foreign object appears in a hollow shape. Moreover, since a bubble in the low luminance region 4, the liquid layer 3, and the high luminance region 5 is a hollow ball-shaped body, it is an extremely rare case where a bubble appears in a shape that is flat at a certain level or more or a shape that is inclined at a certain level or more. On the other hand, it is highly likely that a plastic piece that is a foreign object appears in a relatively large and flat shape. Moreover, while a foreign object tends to appear in a shape in which the part near the center of gravity thereof is relatively opaque, it is extremely rare that a bubble appears in a shape in which the part near the center of gravity thereof is opaque at a certain level or more. On the basis of such features of the shape, the determination unit 242 determines whether the floating object area represents a foreign object or a bubble.
In the case where at least one floating object area is determined to represent a foreign object, the determination unit 242 records that there is a foreign object in the field for the presence/absence of foreign object 508 corresponding to the focused image ID 503 in the control table 500 (steps S19, S20). On the other hand, in the case where all floating object areas are determined to represent bubbles, the determination unit 242 records that there is no foreign object in the field for the presence/absence of foreign object 508 corresponding to the focused image ID 503 in the control table 500 (steps S16). Then, the determination unit 242 proceeds to step S21.
At step S21, the determination unit 242 moves the focus to the next image ID 503 in the control table 500. Then, the determination unit 242 returns to step S13 via step S22, and repeats the same processing as that described above on the grayscale image of the newly focused image ID 503. Then, upon completion of focusing on all image IDs 503 in the control table 500 (YES at step S22), the determination unit 243 proceeds to step S23.
At step S23, the determination unit 242 checks all fields for the presence/absence of foreign object 508 in the control table 500, and when it is recorded that there is a foreign object in at least one presence/absence of foreign object 508, the determination unit 242 creates the inspection result information 233 indicating NG, and stores it in the storage unit 230 (step S24). Meanwhile, when it is recorded that there is no foreign object in all fields for the presence/absence of foreign object 508, the determination unit 242 creates the inspection result information 233 indicating OK, and stores it in the storage unit 230 (step S25). Then, the determination unit 242 ends the processing of
Examples of the detailed configuration and operation of the determination unit 242 are as described above. However, the configuration and the operation of the determination unit 242 are not limited to those described above. For example, the determination unit 242 may be configured and operate as described below.
In the example described above, with respect to one grayscale image, the determination unit 242 creates one-dimensional data through acquisition of luminance values of pixels, compares the one-dimensional data with the reference feature, computes a floating object candidate area when the one-dimensional data does not match the reference feature, and analyzes the floating object candidate area, and then repeats the same processing on the next grayscale image. However, as another example, with respect to all or a group of grayscale images, the determination unit 242 creates one-dimensional data through acquisition of luminance values of pixels, compares the one-dimensional data with the reference feature, and computes a floating object candidate area when the one-dimensional data does not match the reference feature, and then, computes an area by logical OR operation from the computed one or all of the two or more floating object candidate areas, as a final floating object candidate area. Then, the determination unit 242 performs analysis of the floating object candidate areas on all grayscale images that do not match the reference feature, by commonly using the final floating object candidate area. With this operation, it is possible to extremely decrease the probability that a foreign object is present in an area other than the floating object candidate area. Moreover, in order to simplify the processing, analysis of a floating object candidate area may be performed on some of all grayscale images that do not match the reference feature, by commonly using the final floating object candidate area.
Further, while the same processing is repeated on all grayscale images corresponding to an container ID in the above example, at the point of time when a foreign object is detected from at least one grayscale image, it is possible to omit the processing to be performed on the rest of the grayscale images, immediately create inspection result information indicating NG, and end the processing of
Furthermore, while the luminance measurement line 510 whose lateral width is one pixel is used in the above example, a luminance measurement line whose lateral width is two pixels or more may be used. In that case, a luminance average value may be calculated for each set of two or more pixels continuing in the lateral direction, and create one-dimensional data by aligning the average values.
As described above, according to the present embodiment, it is possible to stably determine that there is no foreign object on a liquid surface. One of the reasons is that the present embodiment includes the acquisition unit 241 that acquires the image 1 around a liquid surface in the shape of a paraboloid of revolution. The image 1 is obtained by capturing, with the camera device 130, the transparent container 400 in which the liquid surface in the shape of a paraboloid of revolution is formed by being rotated about the central axis at a given speed in a state of containing a transparent liquid, from a side of the container under the transmitted illumination. Another reason is that the present embodiment includes the determination unit 242 that acquires luminance values of pixels along a line extending in a direction parallel to the central axis of the container 400 in the image, generates one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determines whether or not there is a foreign object on the liquid surface.
On the other hand, in the art related to the present invention, when a liquid surface is a completely flat surface, the liquid surface is imaged as a uniform white region, and a foreign object floating on the liquid surface is captured as a blackish image according to the reflection coefficient thereof. However, even in a state where the transparent container is completely stationary, the liquid surface is not completely flat due to a meniscus. In a transparent container with a small inner diameter, such a phenomenon is particularly notable. Moreover, due to the structure of an inspection stage on which a transparent container is placed or noise environment of the inspection location, fine vibration may be caused in the transparent container during imaging and a ripple may be generated on the liquid surface during imaging. As described above, a liquid surface is not imaged as a uniform white region unless it is completely flat, and a blackish area that is hard to be distinguished from an image of a foreign object appears. Accordingly, it is difficult to stably determine that there is no foreign object on the liquid surface.
Next, a foreign object inspection device according to a second exemplary embodiment of the present invention will be described.
Referring to
The acquisition means 601 is configured to acquire an image around a liquid surface in the shape of a paraboloid of revolution of a transparent container. The liquid surface in the shape of a paraboloid of revolution is formed by rotating the container, containing a transparent liquid, about the central axis at a given speed. The image is obtained by capturing the transparent container from a side of the transparent container under the transmitted illumination. The acquisition means 601 may have the same configuration as that of the acquisition unit 241 of
The determination means 602 is configured to acquire a luminance value of a pixel along a line extending in a direction parallel to the central axis in the image acquired by the acquisition means 601, generate one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determine whether or not there is a foreign object on the liquid surface. The determination means 602 may have the same configuration as that of the determination unit 242 of
The foreign object inspection device 600 configured as described above operates as described below. First, the acquisition means 601 acquires an image around a liquid surface in the shape of a paraboloid of revolution of a transparent container. The liquid surface in the shape of a paraboloid of revolution is formed by rotating the container, containing a transparent liquid, about the central axis at a given speed. The image is obtained by capturing the transparent container from a side of the transparent container under the transmitted illumination. Then, the determination means 602 acquires a luminance value of a pixel along a line extending in a direction parallel to the central axis in the image acquired by the acquisition means 601, generates one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determines whether or not there is a foreign object on the liquid surface.
According to the foreign object inspection device 600 that is configured and operates as described above, it is possible to stably determine that there is no foreign object on a liquid surface. One of the reasons is that the foreign object inspection device 600 includes the acquisition means 601 that acquires an image around a liquid surface in the shape of a paraboloid of revolution of a transparent container. The liquid surface in the shape of a paraboloid of revolution is formed by rotating the container, containing a transparent liquid, about the central axis at a given speed. The image is obtained by capturing the transparent container from a side of the transparent container under the transmitted illumination. Another reason is that the foreign object inspection device 600 includes the determination means 602 that acquires a luminance value of a pixel along a line extending in a direction parallel to the central axis of the transparent container in the image, generates one-dimensional data of the luminance values, and on the basis of a spatial change in the luminance values in the one-dimensional data, determines whether or not there is a foreign object on the liquid surface.
While the present invention has been described with reference to the exemplary embodiments described above, the present invention is not limited to the above-described embodiments. The form and details of the present invention can be changed within the scope of the present invention in various manners that can be understood by those skilled in the art.
The present invention is applicable to inspection of confirming whether or not there is a foreign object such as plastic piece on a liquid surface of drug solution contained in a container such as a syringe.
The whole or part of the exemplary embodiments disclosed above can be described as, but not limited to, the following supplementary notes.
A foreign object inspection device comprising:
The foreign object inspection device according to claim 1, wherein
The foreign object inspection device according to supplementary note 1 or 2, wherein
The foreign object inspection device according to supplementary note 3, wherein
The foreign object inspection device according to supplementary note 4, wherein
The foreign object inspection device according to any of supplementary notes 1 to 5, wherein
A foreign object inspection system comprising:
A foreign object inspection method comprising:
The foreign object inspection method according to supplementary note 8, wherein
The foreign object inspection method according to supplementary note 8 or 9, wherein
The foreign object inspection method according to supplementary note 10, wherein
The foreign object inspection method according to supplementary note 11, wherein
The foreign object inspection method according to any of supplementary notes 8 to 12, wherein
A computer-readable medium storing thereon a program for causing a computer to execute processing to:
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2021/045388 | 12/9/2021 | WO |