The invention relates to the field of object classification. More precisely, the invention relates to a method and an apparatus for off-belt object classification.
Machines for inspection and sorting of bulk objects supplied in a continuous stream typically comprise a feed unit, an optical system and an analysis unit. The feed unit supplies a stream of objects which are to be inspected continuously through a detection region that is scanned by the optical system, which is in operational communication with the analysis unit. The analysis unit analyzes each separate object in the object stream for one or more preselected properties, such as color, shape and/or texture or any combination thereof. Based on this analysis, the analysis unit can examine whether the inspected object satisfies specific criteria in terms of the observed property, resulting in a classification.
A requirement for such inspection and sorting apparatuses based on an optical sensor and an analysis device is that a correct distinction can be made between optical information coming from the inspected objects and optical information coming from the background.
WO 2014/013421 describes an apparatus for inspection of objects, provided with a transport mechanism, for instance a conveyor belt or a chute, configured to transport a continuous stream of objects so that, on leaving the transport mechanism, the object stream follows a free-fall path along which it is fed in a single object layer through a detection region, a radiation source configured to illuminate the detection region, a detection unit, configured to optically scan the illuminated detection region, an analysis unit and possibly a removal unit and also a background element, which is situated behind the falling object stream, seen from the position of the detection unit, positioned so that electromagnetic radiation beams from the radiation source impinge on an illumination zone of the background element when these beams do not impinge on an object from the object stream, the detection unit can only receive an image of a detection zone of the background element, characterized in that the background element is mounted so that the illumination zone and the detection zone are separated from each other.
The apparatus provides a solution for detection of products in a product stream without false detection of products from electromagnetic radiation reflected by the background, however it does not provide sorting of products based on optical characteristics and is not optimal for detecting dark products in the product stream.
It is an object of the invention to provide an improved solution for off-belt object classification of transparent objects in a product stream.
According to a first aspect of the invention, this and other objects are achieved by a method for object classification, the method comprising the steps of: guiding a continuous stream of objects from a transport mechanism directly into an unsupported path, along which the object stream is fed through a detection region; emitting electromagnetic radiation along a first direction for illuminating said detection region, which emitted electromagnetic radiation forms a radiation band extending in a direction orthogonal to said first direction; optically scanning the detection region to detect electromagnetic radiation reflected by the at least one object in the detection region by viewing the detection region along a second direction, wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 3°-80° or 10°-80°; analyzing the information from the optical scanning; and classifying objects from the object stream based on the analysis of the transparency information or the reflection information from the optical scanning; wherein the step of analyzing the information from the optical scanning comprises analyzing the objects based on the intensity, spread and optionally texture of the detected radiation from the optical scanning, and wherein the step of analyzing the information from the optical scanning comprises comparing the information to information in a lookup table and/or comparing the information to one or more thresholds.
According to one embodiment, said step of classifying said objects further comprises sorting the objects from the object stream in at least two different direction based on the analysis of the reflection information from the optical scanning and/or based on classification data.
According to one embodiment, said step of analyzing the information from the optical scanning further comprises comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to information in a lookup table and/or to one or more thresholds to determine transparency or reflection information of said at least one object.
According to one embodiment, said step of analyzing the information from the optical scanning further comprises comparing intensity and spread of electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to information in a lookup table and/or to one or more thresholds to determine transparency or reflection information of said at least one object.
According to a second aspect of the invention there is provided a method for object sorting, the method comprising the steps of: guiding a continuous stream of objects from a transport mechanism directly into an unsupported path, along which the object stream is fed through a detection region; emitting electromagnetic radiation along a first direction for illuminating said detection region, which emitted electromagnetic radiation forms a radiation band extending in a direction orthogonal to said first direction; optically scanning the detection region to detect electromagnetic radiation reflected by the at least one object in the detection region by viewing the detection region along a second direction, wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 3°-80° or 10°-80°; analyzing the information from the optical scanning; and sorting objects from the object stream in at least two different directions based on the analysis of the transparency information or reflection information from the optical scanning; wherein the step of analyzing the information from the optical scanning comprises analyzing the objects based on the intensity, spread and optionally texture of the detected radiation from the optical scanning.
The below information, features and embodiments relate to both the first and second aspect of the invention.
In relation to the invention the radiation source is a line illumination, i.e. the illumination forms a radiation band or a line when falling upon a flat surface which radiation band may be captured and viewed at least via an image senor. Further, the emitted electromagnetic radiation forms a radiation band when falling upon a flat surface which radiation band may be captured and viewed at least via an image senor. The illumination may be collimated or focused.
According to one example the measuring system comprises of a radiation source and a detector, preferably focused on the object plane. The detector measurement plane and the line illumination are disjoint and have a cross-section in the object plane. This means that if no object is present in the system, an extremely low radiation is detected by the detector, since the illumination line and the detection line do not intersect in the void space.
The step of analyzing the information from the optical scanning may further comprise determining transparency information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to a first threshold to determine that there is material present in the detection region, and thereafter comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object to a second threshold to determine if the present material is transparent and/or reflective, wherein the second threshold lies above the first threshold, and thereafter setting the transparency information.
By using threshold levels to evaluate whether objects are present in the detection region and determining a probability of the object being transparent an efficient classification and/or sorting of objects in for instance glass detection applications and other applications for classification and/or sorting of transparent objects can be achieved.
In relation to this invention, the term classification data refers to the data obtained in, or resulting from, the step of classifying objects in the object stream. One example of classification data is a specific class, like acceptable/non-acceptable; or a classification value within a certain range (e.g. class A is x1 to x2; class B is x2 to x3, where xi is a number), which classification value may be formed based on one single or a combination of measured parameter values. Another example of classification data is the classification value (formed based on one single or a combination of measured parameter values); the classification value may be a single value or an array of values.
According to one embodiment, the classification data (i.e. the data obtained in, or resulting from, the step of classifying objects in the object stream) is used for sorting individual objects of a product stream in at least two different directions, additionally or alternatively the classification data can be used in the same apparatus or transferred to another device in order to perform various operations, such as sorting in later stages, as well as for statistical analysis. In other words, individual classification data may be assigned to individual objects and keep being linked to this object through various steps in the material handling process, and is optionally used at one or more stations in the material handling process. Additionally, or alternatively, individual or bulks of classification data may be processed for statistical purposes in the same machine where it was determined, or in another device to which it has been provided e.g. by wire or wirelessly.
Additionally or alternatively, the step analyzing the information from the optical scanning further includes classifying to which degree said material is transparent. Additionally or alternatively, the step analyzing the information from the optical scanning further includes classifying to which degree said material is reflective. The step of analyzing the information from the optical scanning may further comprise comparing directly reflected to a third threshold to determine a probability of the present material being transparent.
The step of analyzing the information from the optical scanning may further comprise determining the height, and/or height profiles of objects in the object stream.
The step of analyzing the information from the optical scanning may comprise comparing the information to information in a lookup table (LUT) and/or comparing the information to thresholds. The lookup tables maybe a one-dimensional lookup table or a two-dimensional lookup table or a N-dimensional lookup table. By dimension here it is meant that the lookup table evaluates a sampled representation of a e.g. N variables. The one-dimensional lookup table returns an output in response to only one input parameter, the input parameter being e.g. the intensity or the spread of the detected radiation; i.e. one output is returned for LUT (Intensity) and one output is returned for LUT (Spread). The two-dimensional lookup table on the other hand returns an output in response to two input parameters, e.g. the intensity and the spread of the detected radiation, one output is returned for LUT (Intensity, Spread).
Alternatively, step of analyzing the information from the optical scanning may comprise the use of deep learning or support vector machines.
The method may further comprise a step of optically scanning a zone on a background element where the line illumination hits the background element, wherein the step of analyzing the information from the optical scanning comprises determining whether material is present in the detection region based on the information from the optical scanning of the zone on the background.
Optically scanning the zone on the background element enables for detection of a line illumination reflection on the background element, which enables determination of whether there is an object present in the detection region based on the reflection from the background element, thus enabling to detect and sort even very dark objects in the object stream as well as to distinguish optically dark objects from optically transparent objects.
The steps of optically scanning the zone on the background element and optically scanning the detection region may be performed simultaneously with one camera.
Using one camera with a field of view that covers both the detection region and the zone on the background element where the laser line impinges the background element is a cost-effective solution that also simplifies the analysis of the information from the scanning.
The step of illuminating the detection region may be done with a plurality of line illuminations for a plurality of detection regions and the step of optically scanning the detection region is done in a plurality of measurement lines for the detection regions. The step of analyzing the information from the optical scanning may then comprise determining the motion of the objects in the object stream.
By determining the trajectory of the objects in the object stream more precise ejection of the object may be performed, and a better overall classification and/or sorting can be achieved.
The plurality of line illuminations may have different wavelengths, wherein the step of analyzing the information from the optical scanning comprises determining optical properties and physical properties of the objects in the object stream.
Alternatively or additionally, the plurality of line illuminations may have different polarizations. This may be beneficial for removing background radiation.
According to a third aspect of the invention, there is provided an apparatus for object classification and/or sorting, the apparatus comprising: a transport mechanism arranged to transport an object stream so that the object stream, after leaving the transport mechanism, follows an unsupported path, along which it is fed through a detection region; a radiation source being configured to emit a radiation band in a first direction for illuminating the detection region; a detection unit arranged to view the detection region along a second direction and to detect electromagnetic radiation reflected by the at least one object in the detection region; wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 10°-80°; an analysis unit in operational connection with the detection unit and arranged to determine transparency information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to a lookup table or to one or more thresholds to determine that there is material present in the detection region, and thereafter comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object to a second threshold to determine if the present material is transparent, wherein the second threshold
According to a fourth aspect of the invention, there is provided an apparatus for object classification and/or sorting, the apparatus comprising: a transport mechanism arranged to transport an object stream so that the object stream, after leaving the transport mechanism, follows an unsupported path, along which it is fed through a detection region; a radiation source being configured to emit a radiation band in a first direction for illuminating the detection region; a detection unit arranged to view the detection region along a second direction and to detect electromagnetic radiation reflected by the at least one object in the detection region; wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 3°-80° or 10°-80°; an analysis unit in operational connection with the detection unit and arranged to determine transparency and/or reflection information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to at least one threshold or look-up table to determine if the material present in the detection region is transparent and thereafter setting the transparency or reflection information.
The detection unit may be further configured to sense electromagnetic radiation reflected by a point on a background element where the electromagnetic radiation from the radiation source impinges the background element.
The apparatus may comprise a plurality of radiation sources configured to illuminate objects in the object stream in a plurality of positions along the unsupported path.
The apparatus may further comprise a removal unit configured to remove objects from the object stream, wherein the removal of objects is based on the analysis in the analysis unit.
According to at least one embodiment the analysis unit is further arranged to determine transparency information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to a first threshold or look-up table to determine that there is material present in the detection region, and thereafter comparing electromagnetic radiation from the illumination that is directly reflected by said at least one object to a second threshold or a second look-up table to determine if the present material is transparent, wherein the second threshold optionally lies above the first threshold, and thereafter setting the transparency information.
It is noted that the invention relates to all possible combinations of features in the claims.
The present invention will be described in more detail with reference to the appended drawings, showing currently preferred embodiments of the invention.
As illustrated in the figures, the sizes of layers and regions may be exaggerated for illustrative purposes and, thus, may be provided to illustrate the general structures of embodiments of the present invention. Like reference numerals refer to like elements throughout.
The first direction 10 and the second direction 16 are disjoint and have a cross-section in the detection region 12. The detection region 12 is off-belt and at a position where the object stream 4 discharged from the conveyor belt 2 is in a free-fall path 6. If there is no object present in the detection region 12 the laser line will impinge a part of a background element that is not detected by the part of the measurement plane that travel through the detection region. Hence, there will be no reflected electromagnetic radiation detected if no object is present, which enables for distinct recognition whether there is an object present in the detection region.
The angle between the first direction 10 and the second direction 16 is preferable within the range of 3°-80°, more preferably within the range of 5°-60°, more preferably within the range of 8°-40°, more preferably within the range of 10°-35°, more preferably within the range of 15°-30°, most preferably within the range of 20°-25°.
The wavelength of the emitted electromagnetic radiation is preferably within the range of 300 nm-2000 nm, more preferably within the range of 400 nm-700 nm.
Determination of material properties of the objects in the object stream is done based on the directly reflected electromagnetic radiation at the surface of the objects, the diffusely reflected electromagnetic radiation from the objects and/or the height of the objects. Thresholds can be used to determine optical properties of the objects. Referring to
The analysis of information from the optical scanning may also comprise identifying and analyzing several surfaces of transparent objects in the object stream, based on double surfaces as seen in
According to one embodiment of the invention, determination of the transparency of the objects in the object stream is achieved by comparing the directly reflected electromagnetic radiation to threshold values. A first threshold value is then used to determine if an object is present if the directly reflected electromagnetic radiation exceeds the first threshold value. A second threshold value, higher than the first threshold value, is then used to determine that the object is transparent if the directly reflected electromagnetic radiation does not exceed the second threshold value. Several such thresholds can be applied to determine probabilities of the object being transparent. Combinations of thresholds for the different parameters, that is the directly reflected electromagnetic radiation at the surface of the objects, the diffusely reflected electromagnetic radiation from the objects and/or the height of the objects, to determine various optical properties of the objects can be applied.
Alternatively, or additionally to the threshold determination, lookup tables, deep learning and/or support vector machines can be used to determine properties of the objects.
In order to remove ambient electromagnetic radiation in the analysis of the detected electromagnetic radiation, a frame with the laser on and a frame with the laser of may be recorded. A background subtraction is then performed in the analysis to get rid of the ambient electromagnetic radiation. Pulsing of the laser using a beam splitter may also be used for this purpose.
The apparatus may further comprise a removal unit, such as an air blower, configured to remove objects that are rejected in the analysis and thus sort objects based on the analysis.
The apparatus may additionally include a bandpass filter on the detector, polarized electromagnetic radiation or polarization filter in front of the detector.
The apparatus may also be using a scanned 3D detection with polygon mirror or can be used in combinations with other detectors.
In sorting systems, the object speed and moving direction is normally assumed to be constant in-between detection and ejection and if objects move with non-constant speed, there is a risk for unprecise removal of rejected objects. In some situations, the ejection window is increased in order to compensate the variation in movement. This leads to a stable ejection, but also an increase of unwanted removal of objects from the object stream 4.
An alternative to all of the detection zones being in the free-fall path of the object stream is that one or more of them being in the object stream on the conveyor belt, prior to being in a free-fall path.
The minimum distance between detection and ejection is determined by pixel size and latency. For systems with big pixel sizes the minimum distance between detection and ejection can be quite large. If two detectors are combined, the movement of objects reduces the performance of convergence algorithms and thus also the ejection performance. By determining the trajectory of the objects in the object stream more precise ejection of the object may be performed, and a better overall sorting can be achieved.
Alternatively, or complementary to using the classification data for sorting as described above, the data from the classification step can be used in the same apparatus or transferred to another device in order to do various operations, such as sorting, in later stages, as well as for statistical analysis.
The apparatus may also comprise several lasers of different wavelength, which enables for determination of further optical properties such as the color of the objects and analysis of other parameters based on spectroscopy. Lasers at different positions, such as in
The apparatus may also combine different laser polarizations to filter portions of the reflected electromagnetic radiation and more easily distinguish properties of the objects in the object stream. The apparatus may for instance comprise several lasers with different polarizations or a polarization camera.
The laser line reflected by the background element can also be used to determine if an object in the object stream is transparent, since a transparent object will give rise to transmission of part of the emitted electromagnetic radiation while an opaque object will not enable any transmission of the emitted electromagnetic radiation.
Possible applications for the method and apparatus range over, but are not limited to, classification and/or sorting of glass, foil, napkins, printed circuit boards, cartridges, mining material, as well as quality analysis of food with regards to size and detection of cracks or foreign material. It can also be used to identify polymers in a waste stream.
The person skilled in the art realizes that the present invention by no means is limited to the embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims. For example, the radiation source and detector can be arranged in any direction that still allows for the method to be carried out according to the invention.
Additionally, variations to the disclosed embodiments can be understood and affected by the skilled person in practicing the claimed invention, from a study of the drawings, the disclosure and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality.
IEE1. A method for object classification, the method comprising the steps of:
guiding a continuous stream of objects from a transport mechanism directly into an unsupported path, along which said object stream is fed through a detection region;
emitting electromagnetic radiation along a first direction for illuminating said detection region, which emitted electromagnetic radiation forms a radiation band extending in a direction orthogonal to said first direction;
optically scanning said detection region to detect electromagnetic radiation reflected by the at least one object in the detection region by viewing said detection region along a second direction,
wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 3°-80°;
analyzing the information from the optical scanning; and
classifying objects from the object stream based on the analysis of the reflection information from the optical scanning;
wherein the step of analyzing the information from the optical scanning comprises analyzing the objects based on the intensity and spread of the detected radiation from the optical scanning.
IEE2. The method according to IEE1, wherein said step of classifying said object further comprising sorting the objects from the object stream in at least two different directions based on the analysis of the reflection information from the optical scanning.
IEE3. The method according to any of the preceding IEEs, wherein the step of analyzing the information from the optical scanning comprises determining reflection information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to a first threshold, and thereafter comparing electromagnetic radiation from the illumination that is directly reflected by said at least one object to a second threshold to determine transparency of said at least one object, wherein the second threshold lies above the first threshold, and thereafter setting the reflection information.
IEE4. The method according to any of the preceding IEEs, wherein the step of analyzing the information from the optical scanning further comprises determining height profiles of objects in the object stream.
IEE5. The method according to any of the preceding IEEs, wherein the step of analyzing the information from the optical scanning comprises comparing the information to information in a lookup table and/or comparing the information to thresholds.
IEE6. The method according to any of the preceding IEEs, wherein the step of analyzing the information from the optical scanning comprises the use of deep learning or support vector machines.
IEE7. The method according to any of the preceding IEEs, further comprising a step of optically scanning a zone on a background element where the line illumination hits said background element, wherein the step of analyzing the information from the optical scanning comprises determining whether material is present in the detection region based on the information from the optical scanning of the zone on the background.
IEE8. The method according to IEE 7, wherein the steps of optically scanning the zone on the background element and optically scanning the detection region are performed simultaneously with one camera.
IEE9. The method according to any of the preceding IEEs, where the step of illuminating said detection region with electromagnetic radiation is done with a plurality of line illuminations for a plurality of detection regions and the step of optically scanning said detection region is done in a plurality of measurement lines for said detection regions.
IEE10. The method according to IEE 9, wherein the step of analyzing the information from the optical scanning comprises determining the motion of the objects in the object stream.
IEE11. The method according to IEEs 9 or 10, wherein the plurality of line illuminations have different wavelengths, wherein the step of analyzing the information from the optical scanning comprises determining optical properties and physical properties of the objects in the object stream.
IEE12. The method according to any of IEEs 9-11, wherein the plurality of line illuminations have different polarizations.
IEE13. An apparatus for object classification, the apparatus comprising:
a transport mechanism arranged to transport an object stream so that said object stream, after leaving the transport mechanism, follows an unsupported path, along which it is fed through a detection region;
a radiation source being configured to emit electromagnetic radiation in a first direction for illuminating the detection region, which radiation source is configured to generate a line illumination;
a detection unit arranged to view said detection region along a second direction and to detect electromagnetic radiation reflected by the at least one object in the detection region,
wherein the first direction and the second direction have a cross-section in the detection region and forms an angle relative each other within the range of 10°-80°;
an analysis unit in operational connection with the detection unit and arranged to determine transparency information by comparing electromagnetic radiation from the illumination that is directly reflected by the at least one object in the object stream to a first threshold to determine that there is material present in the detection region, and thereafter comparing electromagnetic radiation from the illumination that is directly reflected by said at least one object to a second threshold to determine if the present material is transparent, wherein the second threshold lies above the first threshold, and thereafter setting the transparency information; and
a removal unit configured to remove objects from the object stream (4), wherein said removal of objects is based on the analysis in the analysis unit.
IEE14. The apparatus according to IEE 13, wherein the detection unit is further configured to sense electromagnetic radiation reflected by a point on a background element where the electromagnetic radiation from the radiation source impinges said background element.
IEE15. The apparatus according to IEE 13, comprising a plurality of radiation sources configured to illuminate objects in the object stream in a plurality of positions along the unsupported path.
Number | Date | Country | Kind |
---|---|---|---|
17189017.1 | Sep 2017 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2018/073639 | 9/3/2018 | WO | 00 |