The disclosed technique relates to inspection systems, in general, and to methods and systems for inspecting three-dimensional patterns such as Braille alphabet, in particular.
The Braille alphabet is a system for reading and writing for blind, visually impaired or partially sighted people. Generally, the Braille alphabet has texture that blind people can feel with their fingers and thus, read by touch. In the Braille alphabet, each character and symbol (e.g., a comma, an exclamation point, a question mark and the like) are represented by a distinct pattern of dots selected from six dot positions, arranged in a rectangle having two columns of three dots each. This rectangle is referred to as a ‘Braille cell’. A dot may be raised (i.e., protruding) or embossed (i.e., either a dot may protrude or create a depression) at any of the six positions.
As a result of recent regulations in some jurisdictions, pharmaceutical companies are obliged to label all packages of medicine in Braille, specifying information relating to the medicine. Thus, blind, visually impaired or partially sighted individuals may identify the medicine and the details thereof. There is therefore a necessity to ensure that the Braille on such packages is correct in terms of the represented characters with respect to the intended language content. In addition, there is a necessity to ensure that the Braille on such packages is correct with respect to the location of the Braille dots relative to each other, to the printed text and to the completeness and the size of the Braille dots.
It is an object of the disclosed technique to provide a novel method and system for methods and systems for inspecting three-dimensional patterns such as Braille alphabet. In accordance with the disclosed technique, there is thus provided an inspection system of a printed substrate, the printed substrate at least including a three-dimensional pattern. The system includes a light source, and imager and a processor. The light source emits light beams toward the substrate. The light beams are substantially aligned when impinging on the substrate. The imager acquires an image of the substrate. The image includes a representation of the three-dimensional pattern and of the matter printed on the substrate. The processor is coupled with the light source and with the imager, and processes the acquired image to determine the correctness of the three-dimensional pattern.
The disclosed technique will be understood and appreciated more fully from the following detailed description taken in conjunction with the drawings in which:
The disclosed technique overcomes the disadvantages of the prior art by providing an inspection system for inspecting three dimensional (3D) patterns in general and an inspection system for inspecting Braille alphabet on printed substrates such as packages in particularly. The printed substrate includes Braille dot protrusions or Braille dot cavities, as well as matter printed, deposited or laminated thereon. The matter printed on the substrate, as well as any deposited or laminated materials on the substrate, are herein collectively referred to as ‘non-Braille matter’.
The system according to the disclosed technique includes a light source, an imager and a processor. The light source illuminates the printed substrate. Light incident of the printed substrate reflects either diffusively or specularly or both (i.e., a portion of the light incident of the printed substrate diffusively reflects and a portion of the light specularly reflects off the printed substrate). The imager acquires an image of the printed substrate. The acquired images include a representation of the non-Braille matter and of the Braille dots. According to the disclosed technique, the respective position (i.e., location and orientation) in a reference coordinate system, of the imager and the light source, as well as parameters characterizing light beams emitted by the light source, are determined to maximize the contrast between the representation, in the acquired image, of the non-Braille matter printed on printed the substrate and the representations of Braille dots. The processor processes the acquired image to determine Braille alphabet characteristics. Braille alphabet characteristics include, for example, the location of the Braille dots relative to each other and to the printed text, the completeness of the Braille dots and the size of the Braille dots. Braille alphabet characteristics may further include the represented characters and the correctness of the Braille text with respect to the intended language content. It is noted that although the disclosed technique is exemplified herein with reference to Braille, the disclosed technique is applicable for inspection of any three-dimensional (3D) patterns (i.e., protruding or recessed). For example, the disclosed technique is applicable for inspection protruding letters and symbols in cigarette packages.
Reference is now made to
Reference is now made to
Imager 152 may be embodied as a line-scan camera, which includes a one-dimensional line detector such as a Charged Coupled Device (CCD) detector, a Complementary Metal Oxide Semiconductor (CMOS) detector and the like, that acquires a plurality of one-dimensional images. The plurality of one-dimensional images forms a two-dimensional spatial image. Alternatively, imager 152 can be embodied as an area camera, which includes a two-dimensional area detector that acquires a two-dimensional spatial image directly. The detector (not shown) of imager 152 is sensitive to the spectrum of light emitted by light source 154. Therefore, if light source 154 emits light in the visible spectrum, imager 152 may correspondingly be a color camera, which acquires images, where the color of each pixel is associated with a respective location in a selected color space, such as RGB (Red Green and Blue), CYMK (Cyan Yellow Magenta and Black), CIEXYZ and the like. If light source 154 emits light in the IR spectrum, imager 152 then acquires images in the IR spectral band.
Printed substrate 158 includes a surface 164 with Braille dots 1601, 1602 and 1603 and matter printed thereon (not shown). Each one of Braille dots 1601, 1602 and 1603 exhibits a substantially hemispherical shape. Braille dots 1601, 1602 and 1603 may be embossed on printed substrate 158. Alternatively, Braille dots 1601, 1602 and 1603 may be made of silicon drops applied to printed substrate 158.
Light source 154 emits a light beam toward printed substrate 158. A portion of the light impinging on surface 164 of printed substrate 158 and Braille dots 1601, 1602 and 1603 reflects back toward imager 152. The other portion of the light impinging on surface 164 is either scattered or absorbed by printed substrate 158 and Braille dots 1601, 1602 and 1603. Imager 152 acquires an image of printed substrate 158. Imager 152 provides the acquired image to processor 156. Processor 156 inspects the acquired image to determine Braille alphabet characteristics. The image employed for inspection of Braille alphabet characteristics is referred to herein as a ‘Braille inspection image’. As mentioned above, Braille alphabet characteristics include, for example, the location of the Braille dots relative to each other and to the printed text, the location of the Braille cell on the substrate, the completeness of the Braille dots and the size of the Braille dots. Braille alphabet characteristics may further include the represented characters and the correctness of the Braille text with respect to the intended language content. Processor 156 may further determine the correctness of the Braille alphabet characteristics.
For processor 156 to inspect the representations of Braille dots 1601, 1602 and 1603 in the Braille inspection image, the contrast between the representation of the non-Braille matter and the representations of Braille dots 1601, 1602 and 1603 should be maximized. To maximize this contrast, the ratio between the light reflected from surface 164 of printed substrate 158 and the light reflected from Braille dots 1601, 1602 and 1603, toward imager 152 should be maximized. To that end, the respective position (i.e., location and orientation) in a reference coordinate system 162, of each one of imager 152 and light source 154, is determined to maximize the contrast between the representation, in the acquired image, of the non-Braille matter printed on printed substrate 158 and the representations of Braille dots 1601, 1602 and 1603. Furthermore, parameters characterizing light beams emitted by light source 154, such as the light intensity, the phase and the angular span β of the light beams emitted by light source 154, are also determined to maximize the contrast between the representation of the non-Braille matter and the representations of Braille dots 1601, 1602 and 1603 in the acquired image. The relative position between imager 152 and light source 154 affects the angle α between the optical axes of imager 152 and light source 154. Furthermore, the relative position between imager 152 and light source 154 affects the heights h1 and hS, of imager 152 and light source 154 respectively, above substrate 158. These heights also affect the angles of incident of the light on the Braille dots as further explained below. It is noted that coordinate system 162 may be a Cartesian coordinate system, cylindrical coordinate system, spherical coordinate system and the like. The orientation of imager 152 and light source 154 may be specified according to Euler angles, Tait-Bryan angles and the like.
According to one alternative, the relative position between imager 152 and light source 154, as well as the parameters characterizing the light emitted by light source 154, are empirically determined to maximize the contrast between the representation in the acquired image of the non-Braille matter printed on printed substrate 158 and the representations of Braille dots 1601, 1602 and 1603. According to another alternative, the light beams emitted by light source 154 are at least substantially aligned in the vicinity of substrate 158. Imager 152 and light source 154 are positioned relative to each other and relative to substrate 158 such that optical axes of imager 152 and light source 154 intersect a plane 166, tangent to the highest point of the Braille dots (i.e., highest relative to substrate 158), at equal angles. In such a configuration, the angle θ is equal to the angle γ as shown in
Since Braille dots 1601, 1602 and 1603 either protrude from or are depressed into surface 164 of printed substrate 158, light impinging on Braille dots 1601, 1602 and 1603 and on surface 164 of printed substrate 158 scatters and reflects in a plurality of different directions (i.e., diffuse reflection). Only light impinging on the Braille dots 1601, 1602 and 1603, such that the angle of incident between the light and plane 166 is equal to the angle between the optical axis of imager 152 and plane 166, shall reflect back toward imager 152. Furthermore, since substrate 158 is substantially flat, a substantial portion of the light impinges on surface 164 of substrate 158 at an angle equal to the angle between the optical axis of imager 152 and surface 164 of substrate 158 and thus reflects back toward multi-channel imager 152. Thus, less light reflects back toward imager 152 from Braille dots 1601, 1602 and 1603 than from surface 164. Due to this scattering caused by Braille dots 1601, 1602 and 1603, the representations of Braille dots 1601, 1602 and 1603 in an image acquired by imager 152 appears darker than the representation of the non-Braille matter.
Reference is now made to
With reference to
In some print inspection scenarios, it may be required to employ the acquired images of the printed substrate to inspect both Braille alphabet and non-Braille matter. However, since the contrast in the acquired image between the representation of the non-Braille matter and the representation of the Braille dots is maximized, information related to the non-Braille matter printed, deposited or laminated on the substrate, may be lost. To inspect both Braille dots and printed matter, a multi-channel imager is used. According to one alternative, the multi-channel imager includes at least two different detectors and the light entering the imager is split between these detectors (e.g., 2 separate CCD cameras, one with 3 channels and one with a single channel). According to another alternative, the multi-channel imager includes a single detector with at least two groups of sensors (e.g., 4 lines of sensors in one CCD camera or 4 CCDs in one camera). One channel of the multi-channel imager is employed for acquiring an image for inspecting the non-Braille printed matter and the other channel is employed for acquiring a Braille inspection image. The image used for inspecting non-Braille printed matter is referred to herein as ‘non-Braille inspection image’. When the multi-channel image includes four channels, three of the four channels are used to acquire a color image (e.g., RGB, XYZ, CMY, HIS and the like) for inspecting the non-Braille printed matter. The fourth channel is used to acquire image for inspecting the Braille dots (i.e., a Braille inspection image). A light source is positioned relative to the imager as described above in conjunction with
Reference is now made to
Printed substrate 208 includes a surface 214 with printed matter thereon and Braille dots 2101, 2102 and 2103. Each one of Braille dots 2101, 2102 and 2103 exhibits a substantially hemispherical shape. Braille dots 2101, 2102 and 2103 may be embossed on printed substrate 208. Alternatively, Braille dots 2101, 2102 and 2103 may be made of silicon drops applied to printed substrate 208.
Similar to light source 154 (
Light source 204 emits a light beam toward a printed substrate 208. Since Braille dots 2101, 2102 and 2103 either protrude from or are depressed into surface 214 of printed substrate 208, light impinging on Braille dots 2101, 2102 and 2103 scatters and reflects in a plurality of different directions (i.e., diffuse reflection). Only light impinging on the Braille dots 2101, 2102 and 2103, such that the angle of incident between the light and plane 216 is equal to the angle between the optical axis of multi-channel imager 202 and plane 216, shall reflect back toward multi-channel imager 202. Furthermore, since substrate 208 is substantially flat, a substantial portion of the light impinges on surface 214 of substrate 208 at an angle equal to the angle between the optical axis of multi-channel imager 202 and surface 214 of substrate 208 and thus reflects back toward multi-channel imager 202. Thus, less light reflects back toward multi-channel imager 202 from Braille dots 2101, 2102 and 2103 than from surface 214. Due to this scattering caused by Braille dots 2101, 2102 and 2103, the representations of Braille dots 2101, 2102 and 2103 in an image acquired by multi-channel imager 202 appears darker than the representation of the non-Braille matter.
Multi-channel imager 202 acquires one image of the printed substrate employing one of the two channels and employs the other channel to acquire another image of printed substrate. When multi-channel imager 202 includes four channels, multi-channel imager 202 employs three channel to acquire a color non-Braille inspection image and the fourth channel to acquire a monochrome (e.g., Black and White) Braille inspection image. Multi-channel imager 202 provides the acquired images to processor 206. Processor 206 uses non-Braille inspection image for inspecting the non-Braille printed matter and the Braille inspection image for inspection of the Braille alphabet. It is further noted that multi-channel imager 202 may be replaced with two different and separate imagers. One imager (e.g., an RGB camera) acquires non-Braille inspection images and the other imager (e.g., a monochrome camera) acquires Braille inspection images. When two different imagers are used, the relative position between light source 204 and the imager acquiring the Braille inspection images is determined to maximize the contrast between the representation in the acquired Braille inspection image, of the non-Braille matter printed on printed substrate 208 and the representations of Braille dots 2101, 2102 and 2103.
The non-Braille inspection images acquire by multi-channel imager 202 of system 200 (
Reference is now made to
Multi-channel imager 252 is similar to multi-channel imager 202 (
First light source 254 emits a light beam toward a printed substrate 260. Since Braille dots 2621, 2622 and 2623 either protrude from or are depressed into surface 266 of printed substrate 260, light impinging on Braille dots 2621, 2622 and 2623 scatters and reflects in a plurality of different directions (i.e., diffuse reflection). Only light impinging on the Braille dots 2621, 2622 and 2623, such that the angle of incident between the light and plane 268 is equal to the angle between the optical axis of multi-channel imager 252 and plane 268, reflects back toward multi-channel imager 252. Furthermore, since substrate 260 is substantially flat, a substantial portion of the light impinge on surface 266 of substrate 260 at an angle equal to the angle between the optical axis of multi-channel imager 252 and surface 266 of substrate 260 and thus reflects back toward multi-channel imager 252. Thus, less light reflects back toward multi-channel imager 252 from Braille dots 2621, 2622 and 2623 than from surface 266. Due to this scattering caused by Braille dots 2621, 2622 and 2623, the representations of Braille dots 2621, 2622 and 2623 in an image acquired by multi-channel imager 252 appears darker than the representation of the non-Braille matter. At the same time, first light source 254 emits light beams, second light source 256 also emits light beams toward printed substrate 260. The light emitted by second light source 256 also reflects back toward multi-channel imager 252.
Multi-channel imager 252 acquires one image of the printed substrate, in one spectral band, employing one of the two channels. Multi-channel imager 252 uses the other channel to acquire another image of printed substrate in the other spectral band. When multi-channel imager 252 includes four channels, multi-channel imager 252 employs three channels to acquire a color non-Braille inspection image and the fourth channel to acquire a monochrome Braille inspection image (e.g., Black and White). Multi-channel imager 252 provides the acquired images to processor 258. Processor 258 uses non-Braille inspection image for inspecting the non-Braille printed matter and the Braille inspection image for inspection of the Braille alphabet.
Similarly to as described above, multi-channel imager 252 may be replaced with two different and separate imagers. One imager (e.g., an RGB camera) acquires non-Braille inspection images and the other imager (e.g., a monochrome camera) acquires Braille inspection images. When two different imagers are used, the relative position between first light source 254 and the imager acquiring the Braille inspection images is determined to maximize the contrast between the representation in the acquired Braille inspection image, of the non-Braille matter printed on printed substrate 260 and the representations of Braille dots 2621, 2622 and 2623. Processor 258 inspects a first acquired image acquired in the first spectral band (i.e., associated with the light emitted by first light source 254) to determine Braille alphabet characteristics and the correctness thereof similar to the processing described above in
In the above description in conjunction with
When first light source 254 and second light source 256 illuminate the same area of substrate 306, the output values from sensor line 3021, and sensor lines 3022, 3023, 3024 are related to the energy reflected from that same area and which impinges on sensor line 3021, and sensor lines 3022, 3023, 3024. When first light source 254 and second light source 256 illuminate different areas of substrate 306 and the areas are located at a distance from each other (i.e., in the direction of movement of substrate 306), the output values of sensor line 3021, and sensor lines 3022, 3023, 3024 in detector 300, are synchronized with the movement of substrate 306, for example, by employing an encoder, such as a rotating pulse generator, which provides electronic input relating to the movement of the substrate. The electronic pulses from the rotating pulse generator are used to measure the distance between the illuminated areas and thus determine the shift between the Braille inspection image and the non-Braille inspection image. Similarly, when two different imagers are employed, as substrate 306 moves under each imager, the output values of the imagers, from first light source 254 and second light source 256 are also synchronized with the movement of substrate 260.
As noted above, although the disclosed technique is exemplified herein with reference to Braille, the disclosed technique is applicable for inspection of any 3D patterns. The cross-section of the 3D pattern should exhibit a conic-section shape. For example, the above described Braille dots exhibit hemispherical characteristics. However, the Braille dots may also exhibit a hemi-elliptical shape, or exhibit parabolic or hyperbolic characteristics. Similarly, for example, the cross-section of the protruding letters or symbols in cigarette packages should exhibit a conic-section shape. Thus, only light impinging on the 3D pattern, such that the angle of incident between the light a plane tangent to the highest point of the 3D pattern is equal to the angle between the optical axis of an imager and the plane, shall reflect back toward the imager. Thus, the 3D pattern shall appear as dark areas in the acquired image. Additionally, for example, when the cross-section of the 3D pattern exhibits the shape of a plateau, the edges of the pattern shall appear dark in an acquired image. The edges shall appear dark since, when the light source and imager are configured similarly to as described above in conjunction with
It will be appreciated by persons skilled in the art that the disclosed technique is not limited to what has been particularly shown and described hereinabove. Rather the scope of the disclosed technique is defined only by the claims, which follow.
This application claims benefit of U.S. Ser. No. 61/539,231, filed 26 Sep. 2011 and which application is incorporated herein by reference. To the extent appropriate, a claim of priority is made to the above disclosed application.
Number | Date | Country | |
---|---|---|---|
61539231 | Sep 2011 | US |