Patent Grant
11471916
The present disclosure relates in general to the sorting of metals, and in particular, to the sorting between aluminum cast materials, extruded aluminum materials, and aluminum wrought materials.
This section is intended to introduce various aspects of the art, which may be associated with exemplary embodiments of the present disclosure. This discussion is believed to assist in providing a framework to facilitate a better understanding of particular aspects of the present disclosure. Accordingly, it should be understood that this section should be read in this light, and not necessarily as admissions of prior art.
Recycling is the process of collecting and processing materials that would otherwise be thrown away as trash, and turning them into new products. Recycling has benefits for communities and for the environment, since it reduces the amount of waste sent to landfills and incinerators, conserves natural resources, increases economic security by tapping a domestic source of materials, prevents pollution by reducing the need to collect new raw materials, and saves energy. After collection, recyclables are generally sent to a material recovery facility to be sorted, cleaned, and processed into materials that can be used in manufacturing.
The recycling of aluminum (Al) scrap is a very attractive proposition in that up to 95% of the energy costs associated with manufacturing can be saved when compared with the laborious extraction of the more costly primary aluminum. Primary aluminum is defined as aluminum originating from aluminum-enriched ore, such as bauxite. At the same time, the demand for aluminum is steadily increasing in markets, such as car manufacturing, because of its lightweight properties. As a result, there are certain economies available to the aluminum industry by developing a well-planned yet simple recycling plan or system. The use of recycled material would be a less expensive metal resource than a primary source of aluminum. As the amount of aluminum sold to the automotive industry (and other industries) increases, it will become increasingly necessary to use recycled aluminum to supplement the availability of primary aluminum.
Correspondingly, it is particularly desirable to efficiently separate aluminum scrap metals into alloy families, since mixed aluminum scrap of the same alloy family is worth much more than that of indiscriminately mixed alloys. For example, in the blending methods used to recycle aluminum, any quantity of scrap composed of similar, or the same, alloys and of consistent quality, has more value than scrap consisting of mixed aluminum alloys. Within such aluminum alloys, aluminum will always be the bulk of the material. However, constituents such as copper, magnesium, silicon, iron, chromium, zinc, manganese, and other alloy elements provide a range of properties to alloyed aluminum and provide a means to distinguish one aluminum alloy from the other.
The Aluminum Association is the authority that defines the allowable limits for aluminum alloy chemical composition. The data for the aluminum wrought alloy chemical compositions is published by the Aluminum Association in “International Alloy Designations and Chemical Composition Limits for Wrought Aluminum and Wrought Aluminum Alloys,” which was updated in January 2015, and which is incorporated by reference herein. In general, according to the Aluminum Association, the 1xxx series of wrought aluminum alloys is composed essentially of pure aluminum with a minimum 99% aluminum content by weight; the 2xxx series is wrought aluminum principally alloyed with copper (Cu); the 3xxx series is wrought aluminum principally alloyed with manganese (Mn); the 4xxx series is wrought aluminum alloyed with silicon (Si); the 5xxx series is wrought aluminum primarily alloyed with magnesium (Mg); the 6xxx series is wrought aluminum principally alloyed with magnesium and silicon; the 7xxx series is wrought aluminum primarily alloyed with zinc (Zn); and the 8xxx series is a miscellaneous category.
The Aluminum Association also has a similar document for cast alloys. The 1xx series of cast aluminum alloys is composed essentially of pure aluminum with a minimum 99% aluminum content by weight; the 2xx series is cast aluminum principally alloyed with copper; the 3xx series is cast aluminum principally alloyed with silicon plus copper and/or magnesium; the 4xx series is cast aluminum principally alloyed with silicon; the 5xx series is cast aluminum principally alloyed with magnesium; the 6xx series is an unused series; the 7xx series is cast aluminum principally alloyed with zinc; the 8xx series is cast aluminum principally alloyed with tin; and the 9xx series is cast aluminum alloyed with other elements. Examples of cast alloys utilized for automotive parts include 380, 384, 356, 360, and 319. For example, recycled cast alloys 380 and 384 can be used to manufacture vehicle engine blocks, transmission cases, etc. Recycled cast alloy 356 can be used to manufacture aluminum alloy wheels. And, recycled cast alloy 319 can be used to manufacture transmission blocks.
Generally speaking, wrought aluminum alloys have a higher magnesium concentration than cast aluminum alloys, and cast aluminum alloys have a higher silicon concentration than wrought aluminum alloys.
Furthermore, the presence of commingled pieces of different alloys in a body of scrap limits the ability of the scrap to be usefully recycled, unless the different alloys (or, at least, alloys belonging to different compositional families such as those designated by the Aluminum Association) can be separated prior to re-melting. This is because, when commingled scrap of plural different alloy compositions or composition families is re-melted, the resultant molten mixture contains proportions of the principle alloy and elements (or the different compositions) that are too high to satisfy the compositional limitations required in any particular commercial alloy.
Moreover, as evidenced by the production and sale of the Ford F-150 pickup having a considerable increase in its body and frame parts composed of aluminum instead of steel, it is additionally desirable to recycle sheet metal scrap (e.g., wrought aluminum of certain alloy compositions), including that generated in the manufacture of automotive components from sheet aluminum. Recycling of the scrap involves re-melting the scrap to provide a body of molten metal that can be cast and/or rolled into useful aluminum parts for further production of such vehicles. However, automotive manufacturing scrap (and metal scrap from other sources such as airplanes and commercial and household appliances) often includes a mixture of scrap pieces of wrought and cast pieces and/or two or more aluminum alloys differing substantially from each other in composition. Thus, those skilled in the aluminum alloy art will appreciate the difficulties of separating aluminum alloys, especially alloys that have been worked, such as cast, forged, extruded, rolled, and generally wrought alloys, into a reusable or recyclable worked product.
Two examples of aluminum alloys used in automotive manufacturing are 5052 and 6061 series alloys; their respective chemical compositions are shown in
While it would therefore be beneficial to be able to sort a mass or body of aluminum scrap containing a heterogeneous mixture of pieces of different alloys, to separate the different alloy compositions or at least different alloy families before re-melting for recycling, scrap pieces of different aluminum alloy compositions are not ordinarily visually distinguishable from each other. Optically indistinguishable metals (especially alloys of the same metal) are difficult to sort. For example, it is possible but not easy to manually separate and identify small pieces of cast from wrought aluminum or to spot zinc or steel attachments encapsulated in aluminum. There also is the problem that color sorting is nearly impossible for identically colored materials, such as the all-gray metals of aluminum alloys, zinc, and lead.
Currently, the only existing technology which separates cast from wrought in a cost-effective fashion is an x-ray transmission technology. Because cast is heavier than wrought due to the higher silicon concentration, the cast alloys are denser than the wrought alloys. The x-ray transmission technology is able to measure the heavier density cast aluminum alloys and then sort the cast from the wrought alloys.
However, this method is not perfect. For example, cast alloys 319 and 383 have a relatively high zinc concentration (e.g., ˜3%), giving these cast alloys their higher respective density. Cast alloy 360 however, has a lower relative zinc concentration (e.g., ˜0.5%), and therefore lower density. The lower density of cast alloy 360 causes the x-ray transmission method to classify this alloy as a wrought alloy and not a cast alloy. Therefore, the x-ray transmission technology does not classify all of the cast alloys correctly due to the large variance in their respective densities. Thus, such cast alloys end up being sorted along with the wrought aluminum alloys, which will result in too much relative silicon in the melted mixture.
Various detailed embodiments of the present disclosure are disclosed herein. However, it is to be understood that the disclosed embodiments are merely exemplary of the disclosure, which may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to employ various embodiments of the present disclosure.
As used herein, a “material” may include a chemical element, a compound or mixture of chemical elements, or a compound or mixture of a compound or mixture of chemical elements, wherein the complexity of a compound or mixture may range from being simple to complex. As used herein, “element” means a chemical element of the periodic table of elements, including elements that may be discovered after the filing date of this application. Classes of materials may include metals (ferrous and nonferrous), metal alloys, plastics (including, but not limited to PCB, HDPE, UHMWPE, and various colored plastics), rubber, foam, glass (including, but not limited to borosilicate or soda lime glass, and various colored glass), ceramics, paper, cardboard, Teflon, PE, bundled wires, insulation covered wires, rare earth elements, etc. As used herein, the term “aluminum” refers to aluminum metal and aluminum-based alloys, viz., alloys containing more than 50% by weight aluminum (including those classified by the Aluminum Association). As used herein, the terms “scrap” and “scrap pieces” refer to material pieces in a solid state as distinguished from a molten or liquid state. Within this disclosure, the terms “scrap,” “scrap pieces,” “materials,” and “material pieces” may be used interchangeably.
As defined within the Guidelines for Nonferrous Scrap promulgated by the Institute Of Scrap Recycling Industries, Inc., the term “Zorba” is the collective term for shredded nonferrous metals, including, but not limited to, those originating from end-of-life vehicles (“ELVs”) or waste electronic and electrical equipment (“WEEE”). The Institute Of Scrap Recycling Industries, Inc. (“ISRI”) in the United States established the specifications for Zorba. In Zorba, each scrap piece may be made up of a combination of the nonferrous metals: aluminum, copper, lead, magnesium, stainless steel, nickel, tin, and zinc, in elemental or alloyed (solid) form. Furthermore, the term “Twitch” shall mean fragmented aluminum scrap. Twitch may be produced by a float process whereby the aluminum scrap floats to the top because heavier metal scrap pieces sink (for example, in some processes, sand may be mixed in to change the density of the water in which the scrap is immersed).
As used herein, the terms “identify” and “classify,” and the terms “identification” and “classification,” may be utilized interchangeably. For example, in accordance with certain embodiments of the present disclosure, a vision system (as further described herein) may be configured (e.g., with a machine learning system) to collect any type of information that can be utilized within a sorting system to selectively sort materials (e.g., scrap pieces) as a function of a set of one or more (user-defined) physical characteristics, including, but not limited to, color, hue, size, shape, texture, physical appearance, uniformity, and/or manufacturing type of the scrap pieces. As used herein, “manufacturing type” refers to the type of manufacturing process by which the material in a scrap piece was manufactured, such as a metal part having been formed by a wrought process, having been cast (including, but not limited to, expendable mold casting, permanent mold casting, and powder metallurgy), having been forged, a material removal process, extruded, etc.
The material sorting systems described herein according to certain embodiments of the present disclosure receive a heterogeneous mixture of a plurality of materials (e.g., scrap pieces), wherein at least one material within this heterogeneous mixture includes a composition of elements different from one or more other materials and/or at least one material within this heterogeneous mixture was manufactured differently from one or more other materials. Though all embodiments of the present disclosure may be utilized to sort any types or classes of materials as defined herein, certain embodiments of the present disclosure are hereinafter described for sorting metal alloy scrap pieces, including aluminum alloy scrap pieces, and including between wrought, extruded, and/or cast aluminum scrap pieces.
It should be noted that the materials to be sorted may have irregular sizes and shapes (e.g., see
Embodiments of the present disclosure will be described herein as sorting materials (e.g., scrap pieces) into such separate groups by physically depositing (e.g., ejecting) the materials (e.g., scrap pieces) into separate receptacles or bins as a function of user-defined groupings (e.g., material type classifications). As an example, within certain embodiments of the present disclosure, materials (e.g., scrap pieces) may be sorted into separate bins in order to separate materials (e.g., scrap pieces) composed of wrought aluminum from other materials (e.g., scrap pieces) composed of cast and/or extruded aluminum.
As previously disclosed herein, though x-ray transmission technology can be used to sort between some cast, extruded, and/or wrought aluminum alloys, it does not classify all of the cast and/or extruded alloys correctly due to the large variance in their respective densities. The use of artificial intelligence, however, does not use density to make the decision of whether the alloy is cast, extruded, or wrought, and therefore, does not suffer from this problem. Recent melt test results by the inventors show that sorter technology as configured in accordance with embodiments of the present disclosure is >99% accurate in its ability to distinguish between cast, extruded, and/or wrought aluminum alloys. This accuracy is far greater than the x-ray transmission technology, and enables a cost-effective method for sorting between cast aluminum, extruded aluminum, and/or wrought aluminum alloys. As referenced herein, a melt test is when selected metal scrap pieces are melted together, and a composition analysis is performed on the melted together scrap to determine the percentages of the various metals existing within the melt.
The aluminum scrap called Twitch typically includes a mixture of various aluminum scrap alloys from automobiles, construction/demolition projects, refrigerators, washing machines, some soda cans, and other appliances. This may include cast, extruded, and/or wrought alloys, and thus may contain significant amounts of Si, Mg, Fe, Mn, Cu, and Zn, and can vary significantly from lot to lot depending on the composition of scrap metals being shredded.
After going through a shredder, sidings (typically made from thin aluminum sheets), extrusions (typically manufactured from thick aluminum framing bars), and castings look very different.
Embodiments of the present disclosure utilize a vision system as described herein capable of sorting between these three different types of aluminum scrap pieces. In doing so, the utilization of chlorine is not required, while resulting in recycled cast aluminum having less than 1% Mg in the final composition of the sorted scrap pieces (or ingots made from the sorted scrap pieces), and even less than 0.5% Mg.
Embodiments of the present disclosure sort the wrought aluminum from the Twitch, which contains both wrought and cast aluminum scrap pieces. In certain embodiments of the present disclosure, extruded aluminum can be sorted with the wrought aluminum. Since most of the Mg is within the wrought aluminum, the remaining aluminum scrap pieces, containing mostly cast aluminum, have relatively insignificant amounts of Mg. In accordance with certain embodiments of the present disclosure, another sort (or plurality of sorting cycles) can be performed on these remaining aluminum scrap pieces (also referred to herein as the cast fraction) in order to remove other impurities (e.g., scrap pieces composed of PCB, stainless steel, foam, rubber, etc.).
The cast fraction may include cast alloys such as 319, 356, 360, and/or 380 series alloy pieces. These alloys contain varying amounts of silicon, Cu, Zn, Fe, and Mn, but contain extremely small amounts of Mg, typically 0-0.6%. When the cast fraction scrap is melted, the molten aluminum can be manufactured into a cast alloy (e.g., 380 or 384 series) without the need to remove any magnesium.
Furthermore, though the illustration in
In accordance with certain embodiments of the present disclosure, some sort of suitable feeder mechanism may be utilized to feed the scrap pieces 101 onto the conveyor belt 103, whereby the conveyor belt 103 conveys the scrap pieces 101 past various components within the sorting system 100. Within certain embodiments of the present disclosure, the conveyor belt 103 is operated to travel at a predetermined speed by a conveyor belt motor 104. This predetermined speed may be programmable and/or adjustable by the operator in any well-known manner. Monitoring of the predetermined speed of the conveyor belt 103 may alternatively be performed with a position detector 105. Within certain embodiments of the present disclosure, control of the conveyor belt motor 104 and/or the position detector 105 may be performed by an automation control system 108. Such an automation control system 108 may be operated under the control of a computer system 107 and/or the functions for performing the automation control may be implemented in software within the computer system 107.
The conveyor belt 103 may be a conventional endless belt conveyor employing a conventional drive motor 104 suitable to move the conveyor belt 103 at the predetermined speeds. A position detector 105, which may be a conventional encoder, may be operatively coupled to the conveyor belt 103 and the automation control system 108 to provide information corresponding to the movement (e.g., speed) of the conveyor belt 103. Thus, as will be further described herein, through the utilization of the controls to the conveyor belt drive motor 104 and/or the automation control system 108 (and alternatively including the position detector 105), as each of the scrap pieces 101 travelling on the conveyor belt 103 are identified, they can be tracked by location and time (relative to the system 100) so that the various components of the sorting system 100 can be activated/deactivated as each scrap piece 101 passes within their vicinity. As a result, the automation control system 108 is able to track the location of each of the scrap pieces 101 while they travel along the conveyor belt 103.
In accordance with certain embodiments of the present disclosure, after the scrap pieces 101 are received by the conveyor belt 103, a tumbler and/or a vibrator (not shown) may be utilized to separate the individual scrap pieces from a collection of scrap pieces. In accordance with alternative embodiments of the present disclosure, the scrap pieces may be positioned into one or more singulated (i.e., single file) streams, which may be performed by an optional active or passive singulator 106. As previously discussed, incorporation or use of a singulator is not required. Instead, the conveyor system (e.g., the conveyor belt 103) may simply convey a collection of scrap pieces, which have been deposited onto the conveyor belt 103 in a random manner.
Referring again to
Additionally, such a vision system 110 may be configured to identify which of the scrap pieces 101 are not of the kind to be sorted by the sorting system 100 (e.g., scrap pieces classified as other than wrought and cast aluminum scrap), and send a signal to reject such scrap pieces. In such a configuration, the identified scrap pieces 101 may be ejected utilizing one of the mechanisms as described herein for physically moving sorted scrap pieces into individual bins.
Referring next to
As previously noted, the sorting devices may include any well-known mechanisms for redirecting selected scrap pieces towards a desired location, including, but not limited to, ejecting the scrap pieces from the conveyor belt system into the plurality of sorting bins. For example, a sorting device may utilize air jets, with each of the air jets assigned to one or more of the classifications. When one of the air jets (e.g., 127) receives a signal from the automation control system 108, that air jet emits a stream of air that causes a scrap piece 101 to be ejected from the conveyor belt 103 into a sorting bin (e.g., 137) corresponding to that air jet. High speed air valves from Mac Industries may be used, for example, to supply the air jets with an appropriate air pressure configured to eject the scrap pieces 101 from the conveyor belt 103.
Although the example illustrated in
In addition to the N sorting bins 136 . . . 139 into which scrap pieces 101 are ejected, the system 100 may also include a receptacle or bin 140 that receives scrap pieces 101 not ejected from the conveyor belt 103 into any of the aforementioned sorting bins 136 . . . 139. For example, a scrap piece 101 may not be ejected from the conveyor belt 103 into one of the N sorting bins 136 . . . 139 when the classification of the scrap piece 101 is not determined (or simply because the sorting devices failed to adequately eject a piece). Thus, the bin 140 may serve as a default receptacle into which unclassified scrap pieces are dumped. Alternatively, the bin 140 may be used to receive one or more classifications of scrap pieces that have deliberately not been assigned to any of the N sorting bins 136 . . . 139. For example, in accordance with embodiments of the present disclosure, scrap pieces not classified as wrought aluminum (and thus classified as cast aluminum) may be allowed to pass into the bin 140.
Depending upon the variety of classifications of scrap pieces desired, multiple classifications may be mapped to a single sorting device and associated sorting bin. In other words, there need not be a one-to-one correlation between classifications and sorting bins. For example, it may be desired by the user to sort certain classifications of materials (e.g., all scrap materials not classified as cast aluminum) into the same sorting bin. To accomplish this sort, when a scrap piece 101 is classified as falling into a predetermined grouping of classifications, the same sorting device may be activated to sort these into the same sorting bin. Such combination sorting may be applied to produce any desired combination of sorted scrap pieces. The mapping of classifications may be programmed by the user (e.g., using the sorting algorithm (e.g., see
The conveyor system 103 may include a circular conveyor (not shown) so that unclassified scrap pieces are returned to the beginning of the sorting system 100 to be run through the system 100 again. Moreover, because the system 100 is able to specifically track each scrap piece 101 as it travels on the conveyor system 103, some sort of sorting device (e.g., the sorting device 129) may be implemented to eject a scrap piece 101 that the system 100 has failed to classify after a predetermined number of cycles through the sorting system 100.
Within certain embodiments of the present disclosure, the conveyor belt 103 may be divided into multiple belts configured in series such as, for example, two belts, where a first belt conveys the scrap pieces past the vision system, and a second belt conveys the scrap pieces from the vision system to the sorting devices. Moreover, such a second conveyor belt may be at a lower height or elevation than the first conveyor belt, such that the scrap pieces fall from the first belt onto the second belt.
As previously noted, embodiments of the present disclosure may implement one or more vision systems (e.g., vision system 110) in order to identify, track, and/or classify scrap pieces.
Such a vision system may be configured with one or more devices for capturing or acquiring images of the scrap pieces as they pass by on a conveyor system. The devices may be configured to capture or acquire any desired range of wavelengths reflected by the scrap pieces, including, but not limited to, visible, infrared (“IR”), ultraviolet (“UV”) light. For example, the vision system may be configured with one or more cameras (still and/or video, either of which may be configured to capture two-dimensional, three-dimensional, and/or holographical images) positioned in proximity (e.g., above) the conveyor system so that visual images of the scrap pieces are captured as they pass by the vision system(s).
Regardless of the type(s) of images captured of the scrap pieces, the images may then be sent to a computer system (e.g., computer system 107) to be processed by a machine learning system in order to identify and/or classify each of the scrap pieces for subsequent sorting of the scrap pieces in a desired manner. Such a machine learning system may implement one or more any well-known machine learning algorithms, including one that implements a neural network (e.g., artificial neural network, deep neural network, convolutional neural network, recurrent neural network, autoencoders, reinforcement learning, etc.), fuzzy logic, artificial intelligence (“AI”), deep learning algorithms, deep structured learning hierarchical learning algorithms, support vector machine (“SVM”) (e.g., linear SVM, nonlinear SVM, SVM regression, etc.), decision tree learning (e.g., classification and regression tree (“CART”), ensemble methods (e.g., ensemble learning, Random Forests, Bagging and Pasting, Patches and Subspaces, Boosting, Stacking, etc.), dimensionality reduction (e.g., Projection, Manifold Learning, Principal Components Analysis, etc.) and/or deep machine learning algorithms, such as those described in and publicly available at the deeplearning.net website (including all software, publications, and hyperlinks to available software referenced within this website), which is hereby incorporated by reference herein. Non-limiting examples of publicly available machine learning algorithms, software, and libraries that could be utilized within embodiments of the present disclosure include Python, OpenCV, Inception, Theano, Torch, PyTorch, Pylearn2, Numpy, Blocks, TensorFlow, MXNet, Caffe, Lasagne, Keras, Chainer, Matlab Deep Learning, CNTK, MatConvNet (a MATLAB toolbox implementing convolutional neural networks for computer vision applications), DeepLearnToolbox (a Matlab toolbox for Deep Learning (from Rasmus Berg Palm)), BigDL, Cuda-Convnet (a fast C++/CUDA implementation of convolutional (or more generally, feed-forward) neural networks), Deep Belief Networks, RNNLM, RNNLIB-RNNLIB, matrbm, deeplearning4j, Eblearn.lsh, deepmat, MShadow, Matplotlib, SciPy, CXXNET, Nengo-Nengo, Eblearn, cudamat, Gnumpy, 3-way factored RBM and mcRBM, mPoT (Python code using CUDAMat and Gnumpy to train models of natural images), ConvNet, Elektronn, OpenNN, NeuralDesigner, Theano Generalized Hebbian Learning, Apache Singa, Lightnet, and SimpleDNN.
Machine learning often occurs in two stages, or phases. For example, first, training occurs offline in that the sorting system 100 is not being utilized to perform actual sorting of scrap pieces. In accordance with certain embodiments of the present disclosure, a portion of the system 100 may be utilized to train the machine learning system in that one or more homogenous sets of scrap pieces (i.e., having the same material composition (e.g., aluminum (cast or wrought))) are passed by the vision system 110 by the conveyor system 103 (and all such scrap pieces are not sorted, but may be collected in a common bin (e.g., bin 140)). Alternatively, the training may be performed at another location remote from the system 100, including using some other mechanism for collecting images of homogenous sets of scrap pieces. During this training stage, the machine learning algorithm(s) extract features from the captured images using image processing techniques well known in the art. Non-limiting examples of training algorithms include, but are not limited to, linear regression, gradient descent, feed forward, polynomial regression, learning curves, regularized learning models, and logistic regression. It is during this training stage that the machine learning algorithm(s) learn the relationships between different types of materials and their features (e.g., as captured by the images, such as color, texture, hue, shape, brightness, overall physical appearance, etc.), creating a knowledge base for later classification of a heterogeneous mixture of scrap pieces received by the sorting system 100 for sorting by desired classifications. Such a knowledge base may include one or more libraries, wherein each library includes parameters for utilization by the vision system 110 in classifying and sorting scrap pieces during the second stage, or phase. For example, one particular library may include parameters configured by the training stage to recognize and classify a particular material (e.g., either wrought aluminum or cast aluminum or extruded aluminum). In accordance with certain embodiments of the present disclosure, such libraries may be inputted into the vision system and then the user of the system 100 may be able to adjust certain ones of the parameters in order to adjust an operation of the system 100 (for example, adjusting the threshold effectiveness of how well the vision system recognizes a particular material (e.g., wrought aluminum and/or cast aluminum and/or extruded aluminum) from a heterogeneous mixture of materials).
Additionally, it is well-known that the inclusion of certain materials (e.g., chemical elements or compounds) in scrap pieces (e.g., metal alloys), or combinations of certain chemical elements or compounds, result in identifiable physical features (e.g., visually discernible characteristics) in materials, As a result, when a plurality of scrap pieces containing such a particular composition are passed through the aforementioned training stage, the machine learning system can learn how to distinguish such scrap pieces from others. Consequently, a machine learning system configured in accordance with certain embodiments of the present disclosure may be configured to sort between materials (e.g., scrap pieces) as a function of their respective material/chemical compositions. For example, such a machine learning system may be configured so that aluminum alloys can be sorted as a function of the percentage of a specified alloying material contained within the aluminum alloys.
For example,
Secondly, after the algorithms have been established and the machine learning system has sufficiently learned the differences for the material classifications, the libraries for the different materials are then implemented into the material sorting system (e.g., the system 100) to be used for identifying and/or classifying and then sorting scrap pieces (e.g., sorting between cast aluminum scrap pieces and wrought aluminum scrap pieces).
One point of mention here is that the detected/extracted features (e.g., observed characteristics) are not necessarily simply corners, or brightness, or shapes; they can be abstract formulations that can only be expressed mathematically, or not mathematically at all; nevertheless, the machine learning system parses all of the data to look for patterns (e.g., observable) that allow the control samples to be classified during the training stage. The machine learning system may take subsections of a captured image of a scrap piece and attempt to find correlations between the pre-defined classifications (e.g., wrought aluminum and cast aluminum).
In the process block 1206, image post processing may be performed. Image post processing may involve resizing the image to prepare it for use in the neural networks. This may also include modifying certain image properties (e.g., enhancing image contrast, changing the image background, or applying filters) in a manner that will yield an enhancement to the capability of the machine learning system to classify the scrap pieces. Subsequent to image post processing, normalization of the various images may be performed in the process block 1207 so that the images of the various scrap pieces can be more easily compared to each other. In the process block 1208, each of the images may be resized. Image resizing may be necessary under certain circumstances to match the data input requirements for certain machine learning systems, such as neural networks. Neural networks require much smaller image sizes (e.g., 225×255 pixels or 299×299 pixels) that the sizes of the images captured by typical digital cameras. Moreover, the smaller the image size, the less processing time is needed to perform the classification. Thus, smaller image sizes can ultimately increase the throughput of the sorter system and increase its value.
In the process blocks 1209 and 1210, for each scrap piece, the type of material is identified/classified based on the detected features. For example, the process block 1209 may be configured with a neural network employing one or more machine learning algorithms, which compare the extracted features with those stored in the knowledge base generated during the training stage, and assign the classification with the highest match to each of the scrap pieces based on such a comparison. The machine learning algorithm(s) may process the captured image in a hierarchical manner by using automatically trained filters. The filter responses are then successfully combined in the next level(s) of the algorithm(s) until a probability is obtained in the final step. In the process block 1210, these probabilities may be used for each of the N (N>1) classifications to decide into which of the N sorting bins the respective scrap pieces should be sorted. For example, each of the N classifications may be assigned to one sorting bin, and the scrap piece under consideration is sorted into that bin that corresponds to the classification returning the highest probability larger than a predefined threshold. Within embodiments of the present disclosure, such predefined thresholds may be preset by the user. A particular scrap piece may be sorted into an outlier bin (e.g., sorting bin 140) if none of the probabilities is larger than the predetermined threshold.
In the process block 1211, a sorting device corresponding to the classification, or classifications, of the scrap piece is activated (e.g., see
In accordance with certain embodiments of the present disclosure, a plurality of at least a portion of the system 100 may be linked together in succession in order to perform multiple iterations or layers of sorting. For example, when two or more systems 100 are linked in such a manner, the conveyor system may be implemented with a single conveyor belt, or multiple conveyor belts, conveying the scrap pieces past a first vision system configured for sorting scrap pieces of a first set of a heterogeneous mixture of materials by a sorter (e.g., the first automation control system 108 and associated one or more sorting devices 126 . . . 129) into a first set of one or more receptacles (e.g., sorting bins 136 . . . 139), and then conveying the scrap pieces past a second vision system configured for sorting scrap pieces of a second set of a heterogeneous mixture of materials by a second sorter into a second set of one or more sorting bins.
Such successions of systems 100 can contain any number of such systems linked together in such a manner. In accordance with certain embodiments of the present disclosure, each successive vision system may be configured to sort out a different material than previous vision system(s).
Referring to
In this particular example, a group of materials that includes a heterogeneous mixture 3801a of aluminum, stainless steel, plastic, wood, rubber, brass, copper, PCB, e-scrap, and copper wire is deposited onto a first conveyor system 3803a (identified as Conveyor Belt #1 in
The remaining heterogeneous mixture of scrap pieces 3801b may then be conveyed along the same conveyor system, or deposited 3802b onto a separate conveyor system 3803b (identified as Conveyor Belt #2 in
In this particular example, the remaining heterogeneous mixture of scrap pieces 3801c (minus the stainless steel and aluminum scrap pieces) is then deposited 3802c onto another conveyor system 3803c (identified as Conveyor Belt #3 in
Embodiments of the present disclosure are not limited to a linear succession of such sorting systems, but may include a combination of branching of such sorting systems for further classification and sorting of a particular class or classes of materials. For example,
As can be readily seen, the sorting system illustrated in
As has been described herein, embodiments of the present disclosure may be implemented to perform the various functions described for identifying, tracking, classifying, and sorting materials, such as scrap pieces. Such functionalities may be implemented within hardware and/or software, such as within one or more data processing systems (e.g., the data processing system 3400 of
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, process, method, and/or program product. Accordingly, various aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.), or embodiments combining software and hardware aspects, which may generally be referred to herein as a “circuit,” “circuitry,” “module,” or “system.” Furthermore, aspects of the present disclosure may take the form of a program product embodied in one or more computer readable storage medium(s) having computer readable program code embodied thereon. (However, any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium.)
A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, biologic, atomic, or semiconductor system, apparatus, controller, or device, or any suitable combination of the foregoing, wherein the computer readable storage medium is not a transitory signal per se. More specific examples (a non-exhaustive list) of the computer readable storage medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (“RAM”) (e.g., RAM 3420 of
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, controller, or device.
The flowchart and block diagrams in the figures illustrate architecture, functionality, and operation of possible implementations of systems, methods, processes, and program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, segment, or portion of code, which includes one or more executable program instructions for implementing the specified logical function(s). It should also be noted that, in some implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Modules implemented in software for execution by various types of processors (e.g., GPU 3401, CPU 3415) may, for instance, include one or more physical or logical blocks of computer instructions, which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may include disparate instructions stored in different locations which, when joined logically together, include the module and achieve the stated purpose for the module. Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data (e.g., material classification libraries described herein) may be identified and illustrated herein within modules, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices. The data may provide electronic signals on a system or network.
These program instructions may be provided to one or more processors and/or controller(s) of a general purpose computer, special purpose computer, or other programmable data processing apparatus (e.g., controller) to produce a machine, such that the instructions, which execute via the processor(s) (e.g., GPU 3401, CPU 3415) of the computer or other programmable data processing apparatus, create circuitry or means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
It will also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems (e.g., which may include one or more graphics processing units (e.g., GPU 3401)) that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. For example, a module may be implemented as a hardware circuit including custom VLSI circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, controllers, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, or the like.
Computer program code, i.e., instructions, for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, Python, C++, or the like, conventional procedural programming languages, such as the “C” programming language or similar programming languages, programming languages such as MATLAB or LabVIEW, or any of the machine learning software disclosed herein. The program code may execute entirely on the user's computer system, partly on the user's computer system, as a stand-alone software package, partly on the user's computer system (e.g., the computer system utilized for sorting) and partly on a remote computer system (e.g., the computer system utilized to train the machine learning system), or entirely on the remote computer system or server. In the latter scenario, the remote computer system may be connected to the user's computer system through any type of network, including a local area network (“LAN”) or a wide area network (“WAN”), or the connection may be made to an external computer system (for example, through the Internet using an Internet Service Provider). As an example of the foregoing, various aspects of the present disclosure may be configured to execute on one or more of the computer system 107, automation control system 108, and the vision system 110.
These program instructions may also be stored in a computer readable storage medium that can direct a computer system, other programmable data processing apparatus, controller, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The program instructions may also be loaded onto a computer, other programmable data processing apparatus, controller, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
One or more databases may be included in a host for storing and providing access to data for the various implementations. One skilled in the art will also appreciate that, for security reasons, any databases, systems, or components of the present disclosure may include any combination of databases or components at a single location or at multiple locations, wherein each database or system may include any of various suitable security features, such as firewalls, access codes, encryption, de-encryption and the like. The database may be any type of database, such as relational, hierarchical, object-oriented, and/or the like. Common database products that may be used to implement the databases include DB2 by IBM, any of the database products available from Oracle Corporation, Microsoft Access by Microsoft Corporation, or any other database product. The database may be organized in any suitable manner, including as data tables or lookup tables.
Association of certain data (e.g., for each of the scrap pieces processed by a sorting system described herein) may be accomplished through any data association technique known and practiced in the art. For example, the association may be accomplished either manually or automatically. Automatic association techniques may include, for example, a database search, a database merge, GREP, AGREP, SQL, and/or the like. The association step may be accomplished by a database merge function, for example, using a key field in each of the manufacturer and retailer data tables. A key field partitions the database according to the high-level class of objects defined by the key field. For example, a certain class may be designated as a key field in both the first data table and the second data table, and the two data tables may then be merged on the basis of the class data in the key field. In these embodiments, the data corresponding to the key field in each of the merged data tables is preferably the same. However, data tables having similar, though not identical, data in the key fields may also be merged by using AGREP, for example.
Reference is made herein to “configuring” a device or a device “configured to” perform some function. It should be understood that this may include selecting predefined logic blocks and logically associating them, such that they provide particular logic functions, which includes monitoring or control functions. It may also include programming computer software-based logic of a retrofit control device, wiring discrete hardware components, or a combination of any or all of the foregoing. Such configured devises are physically designed to perform the specified function or functions.
In the descriptions herein, numerous specific details are provided, such as examples of programming, software modules, user selections, network transactions, database queries, database structures, hardware modules, hardware circuits, hardware chips, controllers, etc., to provide a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the disclosure may be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In other instances, well-known structures, materials, or operations may be not shown or described in detail to avoid obscuring aspects of the disclosure.
With reference now to
The user interface adapter 3412 may provide a connection for a keyboard 3413 and a mouse 3414, modem (not shown), and additional memory (not shown). The I/O adapter 3430 may provide a connection for a hard disk drive 3431, a tape drive 3432, and a CD-ROM drive (not shown).
An operating system may be run on the one or more processors 3415 and used to coordinate and provide control of various components within the computer system 3400. In
Those of ordinary skill in the art will appreciate that the hardware in
As another example, the computer system 3400 may be a stand-alone system configured to be bootable without relying on some type of network communication interface, whether or not the computer system 3400 includes some type of network communication interface. As a further example, the computer system 3400 may be an embedded controller, which is configured with ROM and/or flash ROM providing non-volatile memory storing operating system files or user-generated data.
The depicted example in
Referring to
The Zorba may then be separated from the junk materials, for example, by utilization of a well-known eddy current method. The Zorba may include one or more of various metals (e.g., copper, brass, zinc, stainless steel, aluminum (cast and/or wrought), lead, high-Z cast aluminum alloys (e.g., cast aluminum alloys 319 and 380), low-Z cast aluminum alloys (e.g., cast aluminum alloys 356 and 360), nickel alloys, and gold or silver (e.g., located within PCBs).
The Zorba may be sorted between heavier and lighter metals. This may be accomplished utilizing various separating or sorting technologies. For example, a heavy media (e.g., water made selectively dense with sand) may be utilized to separate the heavy metals (also referred to as Zebra or “Heavies”) from the lighter metals (e.g., Twitch).
Alternatively, a machine learning system configured in accordance with embodiments of the present disclosure may be utilized to sort the Zorba into the separate groups of Zebra and Twitch. Furthermore, certain embodiments of the present disclosure may be configured to sort out PCBs and/or “meatballs” and airbag canisters from ferrous scrap streams.
In another alternative embodiment, such a machine learning system may be utilized to sort out wrought aluminum from the Zorba. Applicants have discovered that typical Zorba (e.g., from shredded vehicles) can contain about 20% by weight and 50%-60% by volume of wrought aluminum. The wrought aluminum may be sorted out from the Zorba utilizing such a machine learning system (which has been trained to recognize wrought aluminum scrap pieces) at a relatively very high throughput rate (e.g., the conveyor belt operating at 350-500 feet per minute), which can reduce the number of scrap pieces in the lot by almost 60% before proceeding to a next sorting step.
Whether Twitch or just wrought aluminum is separated/sorted out from the Zorba, a next process may be performed to sort various metals from the Zebra. As shown in
Zebra scrap pieces 1601 may be conveyed (e.g., by a conveyor belt 1602) to be picked up by an inclined conveyor system 1603. Note that the scrap pieces 1601 are not depicted in
In a non-limiting example, the XRF or AI system 1610 may be configured to recognize and classify those scrap pieces composed of a threshold amount of copper. The conveyor system 1603 may be configured to operate at a sufficient speed in order to “throw” the scrap pieces not classified as copper onto a following inclined conveyor system 1604. Scrap pieces classified as composed of a threshold amount of copper are ejected by a sorting device 1620 onto a lower positioned conveyor system 1606. For example, such a sorting device 1620 may be an air jet nozzle such as described herein, which is actuated to eject a scrap piece classified as copper from the normal trajectory of scrap pieces being “thrown” from the end of the conveyor system 1603 onto the conveyor system 1604. The classified scrap pieces may be conveyed into a bin or receptacle 1630.
The scrap pieces not classified as copper may be conveyed past an XRF or AI system 1611, which may be configured to identify and classify those scrap pieces that contain a threshold amount of another material (e.g., a metal such as zinc, aluminum, brass, stainless steel, gold, silver, etc.). The conveyor system 1604 may be configured to operate at a sufficient speed in order to “throw” the scrap pieces not classified as this other material onto a following inclined conveyor system 1605. Scrap pieces classified as composed of a threshold amount of another material (e.g., a metal such as zinc, aluminum, brass, stainless steel, gold, silver, etc.) may be ejected by a sorting device 1621 onto a lower positioned conveyor system 1607. For example, such a sorting device 1621 may be an air jet nozzle such as described herein, which is actuated to eject a scrap piece classified as zinc from the normal trajectory of scrap pieces being “thrown” from the end of the conveyor system 1604 onto the conveyor system 1605. The classified scrap pieces may be conveyed into a bin or receptacle 1631.
The scrap pieces not classified as zinc, for example, may be conveyed past an XRF or AI system 1612, which may be configured to identify and classify those scrap pieces that contain a threshold amount of another material (e.g., a metal such as zinc, aluminum, brass, stainless steel, gold, silver, etc.). The conveyor system 1605 may be configured to operate at a sufficient speed in order to “throw” the scrap pieces not classified as this other material onto yet another conveyor system (not shown) or into a bin or receptacle 1633 designated for the remainder of the scrap pieces not previously classified and sorted. For example, scrap pieces classified as composed of a threshold amount of another material (e.g., a metal such as zinc, aluminum, brass, stainless steel, gold, silver, etc.) may be ejected by a sorting device 1622 onto a lower positioned conveyor system 1608. For example, such a sorting device 1622 may be an air jet nozzle such as described herein, which is actuated to eject a scrap piece classified as aluminum, for example, from the normal trajectory of scrap pieces being “thrown” from the end of the conveyor system 1605. The classified scrap pieces may be conveyed into a bin or receptacle 1632.
Note that the system and process 1600 is not limited to one line of conveyor systems, but may be expanded to multiple lines each ejecting classified scrap pieces onto multiple conveyor systems (e.g., conveyor systems 1606 . . . 1608). Likewise, one or more of the conveyor systems 1606 . . . 1608 may be implemented with an additional XRF or AI system to further classify those scrap pieces.
Advantages of sorting Heavies are that brass can be recycled for making brass utensils and fittings, zinc can be recycled for making zinc castings, and copper can be recycled for making copper wires and pipes, etc.
Returning to
As shown in
Furthermore, various cast aluminum alloys can be sorted by an XRF system as described herein. For example, cast aluminum alloy 319 has a single large copper peak observable in its XRF spectrum, cast aluminum alloy 356 does not have such a large copper peak, and cast aluminum alloy 380 has both large copper and zinc peaks. These large differences can be utilized by an XRF system to sort between these cast aluminum alloys with high accuracy.
Therefore, in accordance with certain embodiments of the present disclosure, a sorting system and process can first sort out wrought aluminum scrap pieces, then the remaining scrap pieces can be run through a sorting system implementing an XRF system to sort between various cast aluminum alloys.
Reference throughout this specification to “an embodiment,” “embodiments,” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least one embodiment of the present disclosure. Thus, appearances of the phrases “in one embodiment,” “in an embodiment,” “embodiments,” “certain embodiments,” “various embodiments,” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment. Furthermore, the described features, structures, aspects, and/or characteristics of the disclosure may be combined in any suitable manner in one or more embodiments. Correspondingly, even if features may be initially claimed as acting in certain combinations, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination can be directed to a sub-combination or variation of a sub-combination.
Benefits, advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced may be not to be construed as critical, required, or essential features or elements of any or all the claims. Further, no component described herein is required for the practice of the disclosure unless expressly described as essential or critical.
Those skilled in the art having read this disclosure will recognize that changes and modifications may be made to the embodiments without departing from the scope of the present disclosure. It should be appreciated that the particular implementations shown and described herein may be illustrative of the disclosure and its best mode and may be not intended to otherwise limit the scope of the present disclosure in any way. Other variations may be within the scope of the following claims.
While this specification contains many specifics, these should not be construed as limitations on the scope of the disclosure or of what can be claimed, but rather as descriptions of features specific to particular implementations of the disclosure. Headings herein may be not intended to limit the disclosure, embodiments of the disclosure or other matter disclosed under the headings.
Herein, the term “or” may be intended to be inclusive, wherein “A or B” includes A or B and also includes both A and B. As used herein, the term “and/or” when used in the context of a listing of entities, refers to the entities being present singly or in combination. Thus, for example, the phrase “A, B, C, and/or D” includes A, B, C, and D individually, but also includes any and all combinations and subcombinations of A, B, C, and D.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise.
The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below may be intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed.
As used herein with respect to an identified property or circumstance, “substantially” refers to a degree of deviation that is sufficiently small so as to not measurably detract from the identified property or circumstance. The exact degree of deviation allowable may in some cases depend on the specific context. As used herein, “significance” or “significant” relates to a statistical analysis of the probability that there is a non-random association between two or more entities. To determine whether or not a relationship is “significant” or has “significance,” statistical manipulations of the data can be performed to calculate a probability, expressed as a “p value.” Those p values that fall below a user-defined cutoff point are regarded as significant. In some embodiments, a p value less than or equal to 0.05, in some embodiments less than 0.01, in some embodiments less than 0.005, and in some embodiments less than 0.001, are regarded as significant. Accordingly, a p value greater than or equal to 0.05 is considered not significant.
As used herein, “adjacent” refers to the proximity of two structures or elements. Particularly, elements that are identified as being “adjacent” may be either abutting or connected. Such elements may also be near or close to each other without necessarily contacting each other. The exact degree of proximity may in some cases depend on the specific context.
As used herein, a plurality of items, structural elements, compositional elements, and/or materials may be presented in a common list for convenience. However, these lists should be construed as though each member of the list is individually identified as a separate and unique member. Thus, no individual member of such list should be construed as a defacto equivalent of any other member of the same list solely based on their presentation in a common group without indications to the contrary.
Unless defined otherwise, all technical and scientific terms (such as acronyms used for chemical elements within the periodic table) used herein have the same meaning as commonly understood to one of ordinary skill in the art to which the presently disclosed subject matter belongs. Although any methods, devices, and materials similar or equivalent to those described herein can be used in the practice or testing of the presently disclosed subject matter, representative methods, devices, and materials are now described.
Unless otherwise indicated, all numbers expressing quantities of ingredients, reaction conditions, and so forth used in the specification and claims are to be understood as being modified in all instances by the term “about.” Accordingly, unless indicated to the contrary, the numerical parameters set forth in this specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by the presently disclosed subject matter. As used herein, the term “about,” when referring to a value or to an amount of mass, weight, time, volume, concentration or percentage is meant to encompass variations of in some embodiments ±20%, in some embodiments ±10%, in some embodiments ±5%, in some embodiments ±1%, in some embodiments ±0.5%, and in some embodiments ±0.1% from the specified amount, as such variations are appropriate to perform the disclosed method.
This application is a continuation of U.S. patent application Ser. No. 16/375,675 (issued as U.S. Pat. No. 10,722,922), which is a continuation-in-part of U.S. patent application Ser. No. 15/963,755 (issued as U.S. Pat. No. 10,710,119), which claims priority to U.S. Provisional Application Ser. No. 62/490,219, and which is a continuation-in-part of U.S. patent application Ser. No. 15/213,129 (issued as U.S. Pat. No. 10,207,296), which claims priority to U.S. Provisional Patent Application Ser. No. 62/193,332, which are all hereby incorporated by reference herein.
This disclosure was made with U.S. government support under Grant No. DE-AR0000422 awarded by the U.S. Department of Energy. The U.S. government may have certain rights in this disclosure.
| Number | Name | Date | Kind |
|---|---|---|---|
| 2194381 | Cadman | Sep 1937 | A |
| 2417878 | Luzietti et al. | Feb 1944 | A |
| 2942792 | Anderson et al. | Jul 1957 | A |
| 2953554 | Miller et al. | Sep 1960 | A |
| 3512638 | Chengges et al. | May 1970 | A |
| 3662874 | Muller | May 1972 | A |
| 3791518 | Vanderhoof | Feb 1974 | A |
| 3955678 | Moyer | May 1976 | A |
| 3973736 | Nilsson | Aug 1976 | A |
| 3974909 | Johnson | Aug 1976 | A |
| 4004681 | Clewett et al. | Jan 1977 | A |
| 4031998 | Suzuki et al. | Jun 1977 | A |
| 4044897 | Maxted | Aug 1977 | A |
| 4253154 | Russ et al. | Feb 1981 | A |
| 4317521 | Clark et al. | Mar 1982 | A |
| 4413721 | Bollier | Nov 1983 | A |
| 4488610 | Yankloski | Dec 1984 | A |
| 4572735 | Poetzschke et al. | Feb 1986 | A |
| 4586613 | Horii | May 1986 | A |
| 4726464 | Canziani | Feb 1988 | A |
| 4834870 | Osterberg et al. | May 1989 | A |
| 4848590 | Kelly | Jul 1989 | A |
| 5054601 | Sjogren et al. | Oct 1991 | A |
| 5114230 | Pryor | May 1992 | A |
| 5236092 | Krotkov et al. | Aug 1993 | A |
| 5260576 | Sommer, Jr. et al. | Nov 1993 | A |
| 5410637 | Kern et al. | Apr 1995 | A |
| 5433311 | Bonnet | Jul 1995 | A |
| 5462172 | Kumagai et al. | Oct 1995 | A |
| 5570773 | Bonnet | Nov 1996 | A |
| 5663997 | Willis et al. | Sep 1997 | A |
| 5676256 | Kumar et al. | Oct 1997 | A |
| 5733592 | Wettstein et al. | Mar 1998 | A |
| 5738224 | Sommer, Jr. et al. | Apr 1998 | A |
| 5836436 | Fortenbery et al. | Nov 1998 | A |
| 5911327 | Tanaka et al. | Jun 1999 | A |
| 6076653 | Bonnet | Jun 2000 | A |
| 6100487 | Schultz et al. | Aug 2000 | A |
| 6148990 | Lapeyre et al. | Nov 2000 | A |
| 6266390 | Sommer, Jr. et al. | Jul 2001 | B1 |
| 6273268 | Axmann | Aug 2001 | B1 |
| 6313422 | Anibas | Nov 2001 | B1 |
| 6313423 | Sommer | Nov 2001 | B1 |
| 6412642 | Charles et al. | Jul 2002 | B2 |
| 6457859 | Lu et al. | Oct 2002 | B1 |
| 6519315 | Sommer, Jr. et al. | Feb 2003 | B2 |
| 6795179 | Kumar | Sep 2004 | B2 |
| 6888917 | Sommer, Jr. et al. | May 2005 | B2 |
| 6983035 | Price et al. | Jan 2006 | B2 |
| 7073651 | Costanzo et al. | Jul 2006 | B2 |
| 7099433 | Sommer et al. | Aug 2006 | B2 |
| 7200200 | Laurila et al. | Apr 2007 | B2 |
| 7341154 | Boer | Mar 2008 | B2 |
| 7564943 | Sommer, Jr. et al. | Jul 2009 | B2 |
| 7616733 | Sommer et al. | Nov 2009 | B2 |
| 7674994 | Valerio | Mar 2010 | B1 |
| 7763820 | Sommer, Jr. et al. | Jul 2010 | B1 |
| 7848484 | Sommer, Jr. et al. | Dec 2010 | B2 |
| 7886915 | Shulman | Feb 2011 | B2 |
| 7903789 | Morton et al. | Mar 2011 | B2 |
| 7978814 | Sommer et al. | Jul 2011 | B2 |
| 7991109 | Golenhofen | Aug 2011 | B2 |
| 8073099 | Niu et al. | Dec 2011 | B2 |
| 8144831 | Sommer, Jr. et al. | Mar 2012 | B2 |
| 8172069 | Prakasam | May 2012 | B2 |
| 8429103 | Aradhye et al. | Apr 2013 | B1 |
| 8433121 | Kosarev | Apr 2013 | B2 |
| 8476545 | Sommer et al. | Jul 2013 | B2 |
| 8553838 | Sommer et al. | Oct 2013 | B2 |
| 8567587 | Faist et al. | Oct 2013 | B2 |
| 8576988 | Lewalter et al. | Nov 2013 | B2 |
| 8654919 | Sabol et al. | Feb 2014 | B2 |
| 8855809 | Spencer et al. | Oct 2014 | B2 |
| 8903040 | Maeyama et al. | Dec 2014 | B2 |
| 9316596 | Levesque | Apr 2016 | B2 |
| 9785851 | Torek et al. | Oct 2017 | B1 |
| 20030038064 | Harbeck et al. | Feb 2003 | A1 |
| 20030147494 | Sommer, Jr. et al. | Aug 2003 | A1 |
| 20040151364 | Kenneway et al. | Aug 2004 | A1 |
| 20060239401 | Sommer, Jr. et al. | Oct 2006 | A1 |
| 20080029445 | Russcher et al. | Feb 2008 | A1 |
| 20080041501 | Platek | Feb 2008 | A1 |
| 20080092922 | Dick | Apr 2008 | A1 |
| 20080257795 | Shuttleworth | Oct 2008 | A1 |
| 20100017020 | Hubbard-Nelson et al. | Jan 2010 | A1 |
| 20100195795 | Golenhofen | Aug 2010 | A1 |
| 20100264070 | Sommer, Jr. et al. | Oct 2010 | A1 |
| 20100282646 | Looy et al. | Nov 2010 | A1 |
| 20110083871 | Lalancette et al. | Apr 2011 | A1 |
| 20110247730 | Yanar | Oct 2011 | A1 |
| 20120148018 | Sommer, Jr. et al. | Jun 2012 | A1 |
| 20120288058 | Maeyama et al. | Nov 2012 | A1 |
| 20130028487 | Stager | Jan 2013 | A1 |
| 20130079918 | Spencer et al. | Mar 2013 | A1 |
| 20130092609 | Andersen | Apr 2013 | A1 |
| 20130126399 | Wolff et al. | May 2013 | A1 |
| 20130229510 | Killmann | Sep 2013 | A1 |
| 20130264249 | Sommer, Jr. et al. | Oct 2013 | A1 |
| 20130304254 | Torek et al. | Nov 2013 | A1 |
| 20150092922 | Liu et al. | Apr 2015 | A1 |
| 20150170024 | Chatterjee et al. | Jun 2015 | A1 |
| 20160299091 | Bamber et al. | Oct 2016 | A1 |
| 20170014868 | Kumar et al. | Jan 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 2893877 | Dec 2015 | CA |
| 200953004 | Sep 2007 | CN |
| 201440132 | Apr 2010 | CN |
| 201464390 | May 2010 | CN |
| 101776620 | Jul 2010 | CN |
| 201552461 | Jul 2010 | CN |
| 103745901 | Apr 2014 | CN |
| 101776620 | Jun 2014 | CN |
| 103955707 | Jul 2014 | CN |
| 203688493 | Jul 2014 | CN |
| 204359695 | May 2015 | CN |
| 204495749 | Jul 2015 | CN |
| 204537711 | Aug 2015 | CN |
| 204575572 | Aug 2015 | CN |
| 202009006383 | Sep 2009 | DE |
| 0011892 | Nov 1983 | EP |
| 0074447 | Jan 1987 | EP |
| 0433828 | Dec 1990 | EP |
| 0351778 | Oct 1993 | EP |
| 2243089 | Oct 2010 | EP |
| 5083196 | Nov 2012 | JP |
| 2004101401 | Feb 2005 | RU |
| 2006136756 | Apr 2008 | RU |
| 2339974 | Nov 2008 | RU |
| 2361194 | Jul 2009 | RU |
| WO2001022072 | Mar 2001 | WO |
| WO2009039284 | Mar 2009 | WO |
| WO2011159269 | Dec 2011 | WO |
| WO2012094568 | Jul 2012 | WO |
| WO2013033572 | Mar 2013 | WO |
| WO2013180922 | Dec 2013 | WO |
| WO2015195988 | Dec 2015 | WO |
| WO2016199074 | Dec 2016 | WO |
| WO2017001438 | Jan 2017 | WO |
| WO 2017221246 | Dec 2017 | WO |
| Entry |
|---|
| International Alloy Designations and Chemical Composition Limits for Wrought Aluminum and Wrought Aluminum Alloys, The Aluminum Association, Inc., revised Jan. 2015, 38 pages. |
| International Searching Authority, International Search Report and the Written Opinion, International Application No. PCT/US2016/042850, dated Sep. 28, 2016. |
| R. Sitko et al., “Quantification in X-Ray Fluorescence Spectrometry,” X-Ray Spectroscopy, Dr. Shatendra K Sharma (Ed.), ISBN: 978-953-307-967-7, InTech, 2012, pp. 137-163; Available from: http://www.intechopen.com/books/x-ray-spectroscopy/quantification-in-x-ray-fluorescence-spectrometry, Feb. 1, 2012. |
| Scrap Specifications Circular, Institute of Scrap Recycling Industries, Inc., effective Jan. 21, 2016, 58 pages. |
| The International Bureau of WIPO, International Preliminary Report on Patentability, International Application No. PCT/US2016/42850, dated Jan. 25, 2018. |
| A. Lee, “Comparing Deep Neural Networks and Traditional Vision Algorithms in Mobile Robotics,” Swarthmore College, 9 pages, downloaded from Internet on May 1, 2018. |
| C. K. Lowe et al., “Data Mining With Different Types of X-Ray Data,” JCPDS-International Centre for Diffraction Data 2006, ISSN 1097-0002, pp. 315-321. |
| M. Razzak et al., “Deep Learning for Medical Image Processing: Overview, Challenges and Future,” 30 pages, downloaded from Internet on May 1, 2018. |
| J. Schmidhuber et al., “Deep Learning in Neural Networks: An Overview,” The Swiss AI Lab IDSIA, Technical Report IDSIA-03-14/arXiv:1404.7828 v4 [cs.NE], Oct. 8, 2014, 88 pages. |
| M. Singh et al., “Transforming Sensor Data to the Image Domain for Deep Learning—an Application to Footstep Detection,” International Joint Conference on Neural Networks, Anchorage, Alaska, 8 pages, May 14-19, 2017. |
| K. Tarbell et al., “Applying Machine Learning to the Sorting of Recyclable Containers,” University of Illinois at Urbana-Champaign, Urbana, Illinois, 7 pages, downloaded from Internet on May 1, 2018. |
| Wikipedia, Convolutional neural network, 18 pages https://en.wikipedia.org/w/index.php?title=Convolutional_neural_network, downloaded from Internet on May 1, 2018. |
| Wikipedia, TensorFlow, 4 pages https://en.wikipedia.org/w/index.php?title=TensorFlow&oldid=835761390, downloaded from Internet on May 1, 2018. |
| The United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 15/213,129, dated Oct. 6, 2017. |
| International Searching Authority, International Search Report and the Written Opinion, International Application No. PCT/US2018/029640, dated Jul. 23, 2018. |
| European Patent Office; Extended Search Report for 16825313.6; dated Jan. 28, 2019; 12 pages; Munich, DE. |
| The United States Patent and Trademark Office, Non-Final Office Action, U.S. Appl. No. 16/375,675, filed Jun. 28, 2019. |
| The United States Patent and Trademark Office, Final Office Action, U.S. Appl. No. 16/375,675, filed Jan. 17, 2020. |
| “Alloy Data: Aluminum Die Casting Alloys,” MES, Inc., 4 pages, downloaded from the Internet Mar. 28, 2019, www.mesinc.com. |
| C.O. Augustin et al., “Removal of Magnesium from Aluminum Scrap and Aluminum-Magnesium Alloys,” Bulletin of Electrochemistry 2(6), Nov.-Dec. 1986, pp. 619-620. |
| E.A. Vieira et al., “Use of Chlorine to Remove Magnesium from Molten Aluminum,” Materials Transactions, vol. 53, No. 3, pp. 477-482, Feb. 25, 2012. |
| India Patent Office; Office Action issued for corresponding India Application Serial No. 201937044046; dated Jun. 4, 2020; 7 pages; IN. |
| European Patent Office; Extended European Search Report for corresponding EP 19792330.3; dated Apr. 30, 2021; 7 pages; Munich, DE. |
| India Patent Office; Office Action issued for corresponding India Application Serial No. 201817002365; dated Mar. 12, 2020; 6 pages; IN. |
| International Searching Authority, International Search Report and the Written Opinion, International Application No. PCT/US2019/022995, dated Jun. 5, 2019; 10 pages; Alexandria, VA; US. |
| T. Miller et al., “Elemental Imaging for Pharmaceutical Tablet Formulations Analysis By Micro X-ray Fluorescence,” International Centre for Diffraction Data, 2005, Advances in X-ray Analysis, vol. 48, pp. 274-283. |
| T. Moriyama, “Pharmaceutical Analysis (5), Analysis of trace impurities in pharmaceutical products using polarized EDXRF spectrometer NEX CG,” Rigaku Journal, vol. 29, No. 2, 2013, pp. 19-21. |
| U.S. Appl. No. 15/213,129, filed Jul. 18, 2016. |
| M. Baudelet et al., “The first years of laser-induced breakdown spectroscopy,” J. Anal. At. Spectrom., Mar. 27, 2013, 6 pages. |
| P. R. Schwoebel et al., “Studies of a prototype linear stationary x-ray source for tomosynthesis imaging,” Phys. Med Biol. 59, pp. 2393-2413, Apr. 17, 2014. |
| International Searching Authority, International Search Report and the Written Opinion of The International Searching Authority, International Application No. PCT/US2016/45349, dated Oct. 17, 2016. |
| J. McComb et al., “Rapid screening of heavy metals and trace elements in environmental samples using portable X-ray fluorescence spectrometer, A comparative study,” Water Air Soil Pollut., Dec. 2014, 225(12): doi:10.1007/s11270-014-2169-5. |
| J. Mondia, “Using X-ray fluoresence to measure inorganics in biopharmaceutical raw materials,” Anal. Methods, Mar. 18, 2015, vol. 7, pp. 3545-3550. |
| L. Goncalves, “Assesment of metal elements in final drug products by wavelength dispersive X-ray fluorescence spectrometry,” Anal. Methods, May 19, 2011, vol. 3, pp. 1468-1470. |
| L. Hutton, “Electrochemical X-ray Fluorescence Spectroscopy for Trace Heavy Metal Analysis: Enhancing X-ray Fluorescence Detection Capabilities by Four Orders of Magnitude,” Analytical Chemistry, Apr. 4, 2014, vol. 86, pp. 4566-4572. |
| L. Moens et al., Chapter 4, X-Ray Fluorescence, Modern Analytical Methods in Art and Archaeology, Chemical Analysis Series, vol. 155, pp. 55-79, copyright 2000. |
| H. Rebiere et al., “Contribution of X-Ray Fluorescence Spectrometry for the Analysis of Falsified Products,” ANSM, The French National Agency for Medicines and Health Products Safety, Laboratory Controls Division, France, 1 page, Mar. 2017. |
| B. Shaw, “Applicability of total reflection X-ray fluorescence (TXRF) as a screening platform for pharmaceutical inorganic impurity analysis,” Journal of Pharmaceutical and Biomedical Analysis, vol. 63, 2012, pp. 151-159. |
| Briefing Elemental Impurities-Limits, Revision Bulletin, The United States Pharmacopeial Convention, Feb. 1, 2013, 3 pp. |
| Chapter 6, Functional Description, S2 Picofox User Manual, 2008, pp. 45-64. |
| D. Bradley, “Pharmaceutical toxicity: AAS and other techniques measure pharma heavy metal,” Ezine, May 15, 2011, 2 pages. |
| E. Margui et al., “Determination of metal residues in active pharmaceutical ingredients according to European current legislation by using X-ray fluorescence spectrometry,” J. Anal. At. Spectrom., Jun. 16, 2009, vol. 24, pp. 1253-1257. |
| Elemental Impurity Analysis in Regulated Pharmaceutical Laboratories, A Primer, Agilent Technologies, Jul. 3, 2012, 43 pages. |
| Exova, X-ray fluorescence: a new dimension to elemental analysis, downloaded from www.exova.com on Jul. 26, 2016, 3 pages. |
| G. O'Neil, “Direct Identification and Analysis of Heavy Metals in Solution (Hg, Cu, Pb, Zn, Ni) by Use of in Situ Electrochemical X-ray Fluorescence,” Analytical Chemistry, Feb. 2015, 22 pages. |
| Guideline for Elemental Impurities, Q3D, International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use, ICH Harmonised Guideline, Current Step 4 version, Dec. 16, 2014, 77 pages. |
| Skpecim Spectral Imaging; Hyperspectral Technology vs. RGB; at least as early as Mar. 9, 2021; 3 pages; Oulu, Finland. |
| Number | Date | Country | |
|---|---|---|---|
| 20200368786 A1 | Nov 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62490219 | Apr 2017 | US | |
| 62193332 | Jul 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16375675 | Apr 2019 | US |
| Child | 16939011 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15963755 | Apr 2018 | US |
| Child | 16375675 | US | |
| Parent | 15213129 | Jul 2016 | US |
| Child | 15963755 | US |
