The present invention relates to design and manufacturing systems and processes and, in particular, to systems and processes that minimize wastage.
In the manufacturing and building industries, materials wastage can be a significant problem. From an entity perspective, wastage reduces profits by not efficiently utilizing purchased resources and by requiring storage or disposal of remnant materials. Time may also be spent in sourcing additional materials unnecessarily. From an environmental perspective, there can be a carbon footprint cost to not utilizing materials as efficiently as possible as well as a landfill or processing cost for disposing of waste materials.
Some entities attempt to minimize wastage by maintaining a store of remnants, offcuts, etc. that can be used in subsequent designs and manufacturing processes. However, these processes tend to be ad hoc and often the entity does not have sufficient knowledge of its store of remnants for those remnants to be incorporated into subsequent design and manufacturing processes.
What is required is a system and process for managing remnants that can facilitate the use of remnants in subsequent design and manufacturing processes.
The various embodiments of the present invention may, but do not necessarily, achieve one or more of the following advantages:
These and other advantages may be realized by reference to the remaining portions of the specification, claims, and abstract.
In one aspect, there is provided a method for managing remnant materials from a manufacturing process. In the method, a digital remnant image is obtained and processed to calculate size and shape data for at least one remnant in the digital remnant image. A remnant ID is created and a computer aided design file pertaining to the remnant is created that comprises size and shape data for the remnant. The computer aided design file is stored in a searchable database of remnant files.
In one aspect, there is provided a project design method comprising determining material items required for a project, referencing a remnant library of computer aided design files that describe size and shape of remnants available for use in the project design to determine one or more remnants that meet the material items requirements, and generating a fabrication schedule that accounts for remnants that are available for use that meet the materials items requirements.
In one aspect, there is a provided a non-transitory computer readable medium comprising instructions, that when executed by a processor, cause the processor to perform obtaining a digital remnant image, processing the digital remnant image to calculate size and shape data for at least one remnant in the digital remnant image, creating a remnant ID, creating a computer aided design file pertaining to the remnant that comprises size and shape data, and storing the computer aided design file in a searchable database of remnant files.
In one aspect, there is provided a system comprising at least one processor and at least one memory operatively associated with the processor. The processor may be programmed to execute a method. In the method, a digital remnant image is obtained and processed to calculate size and shape data for at least one remnant in the digital remnant image. A remnant ID is created and a computer aided design file pertaining to the remnant is created that comprises size and shape data for the remnant. The computer aided design file is stored in a searchable database of remnant files.
In one aspect, there is provided an electronic device comprising at least one processor and at least one memory operatively associated with the processor. Remnant processing software may be stored by the at least one memory and executable by the at least one processor. The remnant processing software is programmed to process a digital remnant image to calculate size and shape data for at least one remnant in the digital remnant image, create a remnant ID, create a computer aided design file pertaining to the remnant, the computer aided design file comprising size and shape data, and store the computer aided design file in a searchable database of remnant files.
The above description sets forth, rather broadly, a summary of one embodiment of the present invention so that the detailed description that follows may be better understood and contributions of the present invention to the art may be better appreciated. Some of the embodiments of the present invention may not include all of the features or characteristics listed in the above summary. There are, of course, additional features of the invention that will be described below and will form the subject matter of claims. In this respect, before explaining at least one preferred embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of the construction and to the arrangement of the components set forth in the following description or as illustrated in the drawings. The invention is capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting.
In the following detailed description of the preferred embodiments, reference is made to the accompanying drawings, which form a part of this application. The drawings show, by way of illustration, specific embodiments in which the invention may be practiced. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
Embodiments of the present disclosure will illustrate systems and methods that can be used to manage leftover material from a manufacturing process. In various embodiments, computer vision is used to compare leftover material to an object of known dimensions to determine size and shape data for the leftover material. The dimensions and other characteristics, such as product type, material, etc. are stored in a database or remnant library. A barcode sticker or similar identifying tag, is generated and applied to the leftover material for identifying and tracking the leftover material. The remnant library is then referenced during subsequent manufacturing jobs to find remnants of suitable size and material.
A method in accordance with an embodiment of the invention is depicted in the flowchart 100 of
The above method expands on remnant logging by using computer vision techniques to ascertain the size and shape of any remnants to produce a 3D shape and dimension file. This allows CAD-type images of the remnants to be produced which can then be used for nesting or otherwise working the remnant into subsequent design and manufacturing processes for new pieces.
In one embodiment, the computer vision techniques may utilize open source Python libraries to perform image processing including detect object edges, filter out edges/contours that are too small to register, compare the object of known size to the object being measured, and calculate the dimensions of each edge of the object being measured. A particular image processing technique is depicted in the flowchart 300 of
Size and shape data may be ascertained using an object of known size, as described above. Alternatively or in addition, LiDAR can be used to determine distances and dimensions of the remnant, and to identify features of the remnant so that they are automatically included in the digital shape file. In one embodiment, stereo cameras can be used to determine distances and dimensions of the remnant. Camera calibration techniques, where the zoom factor and distance from the camera to the object is known, can also be used to determine dimensions of the remnant. In one embodiment, photography techniques to create images that are optimized for the digital processes with which the image is processed may be employed to improve the output of the process. These may include lighting techniques to control or eliminate shadows, and choice of background to create higher contrast. The general idea is to create an image in which the remnant and object of known size are shown with easily identifiable edges, and no intersection of shadows or other obscuring objects or features that may interfere with the computer vision application classifying those edges and reading or applying the correct dimensions to them.
A dimension may be measured manually and applied to the corresponding edge or part of a photo of the remnant, and then the same dimensioning algorithm that compares the object of known size to the remnant and calculates dimensions of the remnant can be used to calculate the dimensions of the remaining edges or parts of the remnant.
Manually drawing the remnant using a custom application, a 3rd party or existing app, may also be provided. This will allow a user to manually measure the dimensions of the remnant and draw the shape of the remnant line by line, and apply the measurements of each edge or part of the remnant to the associated edge or part of the digital shape file as well as assign other parameters such as material data, features, ID tag, location in a way that makes the shape usable as a digitally stored remnant file.
The CAD-type representation of the remnant allows the remnant to be catalogued in a remnant database or library. The remnant may be assigned an identifier. In one embodiment, the identifier may be a barcode, QR code, RF ID tag, or any other suitable identifier. Machine readable tags have particular advantages for location tracking, inventory management, etc. The identifier may be physically attached to the remnant so that the remnant can be permanently identified and its location known up until use. A remnant file may be created that includes the ID, the CAD-type file describing the remnant, the physical storage location of the remnant, and any other relevant information, such as the material, approximate price or value, product category (e.g. sheet, pipe, fabric), etc. The remnant file may be stored in a database, such as a remnant library. The parameters of the remnant file may be searchable.
Because the parameters of the remnant are stored in a CAD-type file, the remnant may be incorporated into subsequent design and manufacturing projects using CAD programs. Thus, a user may design a product and then search the remnant library to determine available remnants that can be used during fabrication of a new piece.
Taken as a whole this approach can improve material usage efficiency, while saving time and manpower, thus saving money and increasing profits in multiple ways. This can be applied to a variety of materials in addition to sheet goods, such as plumbing materials (e.g. different types of pipe) and materials used in electrical applications (conduit and Unistrut). Most any type of material that is purchased in fixed standard dimensions and then cut or resized as part of a fabrication process to meet the requirements of a job or customer could benefit from this process to increase material usage efficiency and reduce the time and labor spent searching for remnant pieces.
The systems and methods apply to both single-run items as well as multi-run manufacturing processes. That is, a first multi-run process may produce many equal remnants. A second multi-run process may be designed to utilize as many of these remnants as feasible.
The methods described herein may be embodied as one or more software instruction sets stored as one or more applications in the memory of a computing device(s) and executable by a processor of the computing device.
In one embodiment, the software application may be configured with a viewer application. The viewer application may enable a user to interact with the image/photo of a remnant object needing to be dimensioned, in order to indicate locations of defects and/or features in the material. Those areas with defects can then be excluded from the digital shape file so that they do not impact the parts that will be made from the remnant, or the digital shape file profile can be modified so that the defective area is not included. Defects may be aesthetic defects, e.g. markings, blemishes, scratches, etc. or defects may be structural defects, e.g. holes, rust, rotten sections, weakened sections, etc. Features that are part of the material can be included in the digital shape file so that parts can be nested on the remnant in a way that makes optimal use of those features. These features may include items such as grain direction, shiplap or tongue-in-groove edge conditions, color or surface conditions. For example, the wood remnant 210 shown in
The remnant processing software application, or remnant processing engine, may include an API that provides access to a remnant library for a user or set of users. The API may be customized for each remnant processing engine utilizing the remnant library. The specific type of access utilized may also be dictated by the database in which the remnant library is stored.
The database(s) in which the remnant library is stored for each user or set of users may be supplied as part of a package by the provider of the remnant processing engine, or provided by the user on a local basis. For example, in some cases the provider of the remnant processing engine may also provide the database in which the remnant library is stored through associated cloud services, or the library may be stored on a local machine or network. In either case access for both uploading and retrieving information about the remnants is available through the application and can be utilized by the remnant processing engine and any other necessary users.
In one embodiment, date/time information can be added to each stored remnant, indicating the time and date that the remnant was created. This can be useful in valuing remnants based on time, for materials that have an expiration date or to simply ensure the utilization of remnants in a timely manner. For example, as a remnant ages the remnant processing engine can utilize less stringent constraints around the efficiency of material utilization in order to make the selection of that remnant more likely for any given part or series of parts needing to be cut. The same applies for materials with an expiration date: as a remnant approaches its expiration date, the remnant processing engine has fewer constraints around the efficiency of material utilization in order to ensure that some value is realized from the storing and use of the remnant. An example of this could be that for each week that has passed since a remnant was created, an additional 10% of material waste is allowed in the usage of a part or series of parts, in order to make the selection of that remnant more likely. These changing constraints based on the age of the remnant can be registered and monitored as part of each remnant file and taken into account as part of the remnant utilization process.
In one embodiment, dimension data of scanned items may be used to generate a regularly shaped (consistent length, height, and width) 3D shape file for use in nesting programs. For example, through reconstruction of the dimensions based on a digital measuring of two of the surfaces of an item, a 3D shape file, e.g. rectangle, may be generated. This could be achieved with both LiDAR and/or photogrammetry techniques, as detailed previously. Those 3D shape files can then be used in nesting processes to achieve greater efficiency in arranging objects in three dimensional spaces, e.g. filling a truck or aircraft more quickly and with less wasted space. For example, if a conveyor belt is running with a series of packages on it, it can run past a station where two of the surfaces of the package get digitally measured. From the digital images, a reconstruction of the entire package can be developed as a digital 3D shape file for use in nesting multiple packages into a vessel or other conveyance with a minimum of wasted space and wasted time. If a barcode, QR code, RFID tag or other identification device is present on the package, that identification data can be associated with the digital shape file for use later in the nesting process. This can facilitate the automation of arranging and placing the packages into the available 3D space, using robotics or other automation equipment to manipulate the packages into the correct orientation and move them into the indicated location to maximize the use of space in a highly efficient manner.
Remnants can be materials other than sheet goods, and still be used in applications that include nesting parts to be cut for fabrication to increase material and time efficiency. In instances where the required dimension data for a remnant is primarily length, the data may be stored in a table or other type of text file rather than a digital shape file. This may include pipe or conduit used for mechanical, electrical or plumbing fabrication, hanger material (such as unistrut or all thread), lumber or other composite or laminated material, or any other rough stock material which gets cut into prescribed lengths for fabrication or other purposes. The table or text file containing the length data may also contain other types of data, such as the material type, width or diameter information, remnant tracking information (such as a barcode, QR code or RFID information), storage location information, or anything else that facilitates the storage, location and consumption of the remnant later to be nested upon for greater efficiency. This data can also be input through the app and stored in a format that makes it available for nesting applications and facilitates the location and use of the remnants in a manner similar to what is described above for sheet goods.
Storage locations can be created digitally and have an ID tag associated with the physical and digital location, so that when a remnant is placed it a storage location, the ID tag of the remnant is scanned and then the ID tag of the storage location is scanned (or vice versa) so that the remnant is associated with the storage location and that storage location can be indicated as where the remnant is stored when the remnant is called for by the nesting algorithm for subsequent jobs. Each storage location may have a substantial number of remnants identified by barcodes, QR codes, RFID tags, or other methods used to identify and track these remnants. In one embodiment, an application using the camera of a smartphone or tablet, or other features (for reading RFID tags) allows a user to scan a series of these ID tags so that the correct one can be identified and indicated, facilitating the location of the specific remnant called for by the nesting algorithm for the upcoming job. Once the correct remnant has been identified, located and transported to the workstation where it will be cut, the ID tag can be scanned again, and the name of the associated nested cut file will be pulled up to facilitate the cutting of the remnant.
Analytics and material quantity tracking may be added as part of the app. These may include systems to facilitate tracking of quantities of remnant material (square footage or linear footage) by material type, including associated features. This will simplify any accounting activities that may include remnant material, as well as any other business activities, such as inventory tracking, which may be achieved by making data from the app available to other business management software, such as an ERP system, through direct connection (API's) or other types of data exchanges.
In one embodiment, a dynamic nesting algorithm may include the capability to nest in a more dynamic fashion, taking the size and dimension data as it is generated and outputting a placement for the packages, taking into account the order in which they arrive at the packing location. This allows the algorithm to adapt when not all of the elements to be placed are known in advance of the nesting being started. As time may be a consideration in the packing of the containers, the sequence in which the packages arrive may be a critical part of the nesting process, so the nesting will need to reflect that order in its placement and orientation output. This may result in a less optimal nest in terms of space utilization, but in scenarios where time is of the essence and multiple iterations to arrive at an optimized nest are not possible, value will still be provided and improvement over placing packages without considering the arrangement is almost certain. This dynamic nesting provides the advantage of greater speed while still improving space utilization.
Machine learning may be applied to the above-described dynamic nesting algorithm, in order to improve the process based on accumulated data around the sizes, shapes and quantities (percentages) of the parcels that have been run through the system previously. Once a database of the package information is available, the machine learning model may be run repeatedly based on that data. This will accelerate the improvement of the algorithm by allowing iterations of the nesting process to take place virtually, but still based on actual package data, rather than in real time as the packages are going through the process.
A custom application may be developed to aid in the capture of the size and shape data, as the packages move by on a conveyor belt. This may involve the use of multiple sensors and the reconstruction of the packages into 3D shape files based on Iterative Closest Point or similar algorithms. This may allow for reconstruction of the entire package with the capture of only two adjacent sides in the case of regularly shaped parcels, or the development of a 3D shape file from a more complete scanning of the parcel in the case of irregularly shaped packages.
For scenarios in which the packages will be placed manually into the container following instructions output by the nesting algorithm, the nesting may be output in multiple different formats, including an animation that can be displayed on a screen, or an augmented/extended reality application that would be available through AR/XR goggles or glasses.
Vacuum lifts, robotic arms, or other equipment may also be used to lift, orient and place the packages, directed either through the above-described methods for manual placement, or with varying levels of automation.
Otherwise, if manual packing is to be performed, at step 1120, human followable instructions may be provided, e.g. by printout, or by display on viewable screen. Alternatively or in addition, audible instructions may be provided. The human packer may follow the instructions to locate and retrieve each sequenced package from the staging area and load the package into the appropriate section of the container. The packing instructions may provide detailed loading instructions, including how a package is to be oriented within the container. As for the automated method, barcode scanning of a loaded package may trigger the display of instructions for the next package.
A combination of automation and manual packing methods may be employed. For example, as shown in the depicted staging area 1200 of
By utilizing nesting algorithms as described herein, packing of containers can be performed efficiently with minimal wastage of space.
Although the description above contains many specifications, these should not be construed as limiting the scope of the invention but as merely providing illustrations of some of the embodiments of this invention. Thus, the scope of the invention should be determined by the appended claims and their legal equivalents rather than by the examples given.
This application claims priority to U.S. Provisional Application No. 63/338,171 filed on 4 May 2022 and U.S. Provisional Application No. 63/455,373 filed on 29 Mar. 2023, the entire contents of each of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
63338171 | May 2022 | US | |
63455373 | Mar 2023 | US |