The invention generally relates to storage and retrieval systems, and relates in particular to automated storage and retrieval systems that are used with systems for processing objects.
Automated storage and retrieval systems (AS/RS) generally include computer controlled systems of automatically storing (placing) and retrieving items from defined storage locations. Traditional AS/RS typically employ totes (or bins), which are the smallest unit of load for the system. In these systems, the totes are brought to people who pick individual items out of the totes. When a person has picked the required number of items out of the tote, the tote is then re-inducted back into the AS/RS.
In these traditional systems, the totes are brought to a person, and the person may either remove an item from the tote or add an item to the tote. The tote is then returned to the storage location. Such systems, for example, may be used in libraries and warehouse storage facilities. The AS/RS involves no processing of the items in the tote, as a person processes the objects when the tote is brought to the person. This separation of jobs allows any automated transport system to do what it is good at—moving totes—and the person to do what the person is better at—picking items out of cluttered totes. It also means the person may stand in one place while the transport system brings the person totes, which increases the rate at which the person can pick goods.
There are limits however, on such conventional systems in terms of the time and resources required to move totes toward and then away from each person, as well as how quickly a person can process totes in this fashion in applications where each person may be required to process a large number of totes. There remains a need therefore, for an AS/RS that stores and retrieves objects more efficiently and cost effectively, yet also assists in the processing of a wide variety of objects.
In accordance with an embodiment, the invention provides a storage, retrieval and processing system for processing objects. The system includes a plurality of bins including objects to be distributed by the processing system, said plurality of bins being provided in at least a partially generally circular arrangement, a programmable motion device that includes an end effector for grasping and moving any of the objects, said programmable motion device being capable of reaching any of the objects within the plurality of bins, and a plurality of destination containers for receiving any of the objects from the plurality of bins, said plurality of destination containers being provided in a region that is generally within the at least partially generally circular arrangement of the plurality of bins.
In accordance with another embodiment, the invention provides a storage, retrieval and processing system for processing objects that includes a plurality vertically stacked levels of a plurality of bins including objects to be distributed by the processing system, a programmable motion device, and at least one destination container for receiving any of the objects from the plurality of levels of the plurality of bins. The plurality of bins is provided in at least a partially generally circular arrangement. The programmable motion device includes an end effector for grasping and moving any of the objects, and is capable of reaching any of the objects within the plurality of levels of the plurality of bins. The at least one destination container is provided in a region that is generally within the at least partially generally circular arrangement of the plurality of bins and is movable with the programmable motion device.
In accordance with a further embodiment, the invention provides a method of storing, retrieving and processing objects. The method includes the steps of providing a plurality of bins including objects to be processed, said plurality of bins being provided in at least a partially circular arrangement, receiving at least one destination container within an area at least partially enclosed by the at least partially circular arrangement of the plurality of bins, moving the end effector of the programmable motion device toward the at least one bin of the plurality of bins, grasping an object from the at least one bin using the end effector, moving the object with the end effector toward the at least one destination container, and placing the object in the at least one destination container with the end effector.
The following description may be further understood with reference to the accompanying drawings in which:
The drawings are shown for illustrative purposes only.
In accordance with an embodiment, the invention provides a storage, retrieval and processing system that includes a plurality of bins, where each bin includes objects to be distributed by the system. The plurality of bins are provided in at least a partially generally circular arrangement. The programmable motion device includes an end effector for grasping and moving any of the objects, and the programmable motion device is capable of reaching any of the objects within the plurality of bins. The storage and retrieval system also provides a plurality of destination containers for receiving any of the objects from the plurality of bins, and the plurality of destination containers are provided in a region that is generally within the at least partially generally circular arrangement of the plurality of bins.
In accordance with certain embodiments, the invention automates the picking and the storage and retrieval operations. The system provides an automated storage and retrieval system that instead of picking and moving entire totes out of storage, is able to pick only the required number of individual items out of storage. In some embodiments, the system works by having a robot coupled to a movable platform that is able to go to storage bins and drawers, and to use a programmable motion device (e.g., a robot) to recognize and separate individual items in those drawers so that it may automatically pick desired individual items out of the bins or drawers.
In certain embodiments, the system further works by optionally having the robot carry with it a number of destination bins, so that those items need not be re-sorted later. Instead they are carried in a number of separate bins so that they may remain separated and not mixed up with other retrieved items.
Further, the system has, in certain embodiments, a range of applications including the ability to replenish retail stores with stock as is done in many distribution centers (DCs) today. In this break-pack process, items sold at stores are replenished by distribution centers, and systems of the invention in a DC enables the picking of those items needed to be picked from stores so as to replenish stores. The system therefore reduces the amount of labor required to do this compared with other systems.
With reference to
With reference to
The perception system 50 is mounted above the bins of objects to be processed next to the base of the articulated arm 20, looking down. In the event that the perception system 50 is unable to sufficiently see into the bins 12 when open, the system may employ additional perception systems 52 mounted to the support structure 22, at least one of which may provide a better view of any objects in a bin 12. The perception system 50, for example and as shown in
If an object cannot be fully perceived by the detection system, the perception system considers the object to be two different objects, and may propose more than one candidate grasp of such two different objects. If the system executes a grasp at either of these bad grasp locations, it will either fail to acquire the object due to a bad grasp point where a vacuum seal will not occur (e.g., on the right), or will acquire the object at a grasp location that is very far from the center of mass of the object (e.g., on the left) and thereby induce a great deal of instability during any attempted transport. Each of these results is undesirable.
If a bad grasp location is experienced, the system may remember that location for the associated object. By identifying good and bad grasp locations, a correlation is established between features in the 2D/3D images and the idea of good or bad grasp locations. Using this data and these correlations as input to machine learning algorithms, the system may eventually learn, for each image presented to it, where to best grasp an object, and where to avoid grasping an object.
As shown in
The invention provides therefore in certain embodiments that grasp optimization may be based on determination of surface normal, i.e., moving the end effector to be normal to the perceived surface of the object (as opposed to vertical or gantry picks), and that such grasp points may be chosen using fiducial features as grasp points, such as picking on a barcode, given that barcodes are almost always applied to a flat spot on the object.
With reference to
With reference to
In certain embodiments that provide the bins 12 as actuatable drawers, as the platform is raised to a level, the system (knowing which drawers will need to be accessed at that level) will cause the selected drawers to automatically open when the platform reaches each respective layer. The system will also know which destination bin is carried by each carrier, and will know where each carrier is located at all times. A central processor (e.g., located within the support structure 22 or at a physically separate location) 60, may communicate with the articulated arm 20 including the end effector, will communicate with each actuator 6, and communicate with each of the automated carriers 16. As shown in
In accordance with a further embodiment, the invention provides a further processing system for processing objects that includes a plurality of levels of a plurality of bins including objects to be distributed by the processing system, the plurality of bins being provided in at least a partially generally circular arrangement. The processing system also includes a programmable motion device that includes an end effector for grasping and moving any of the objects, and the programmable motion device is capable of reaching any of the objects within the plurality of levels of the plurality of bins. The processing system further includes at least one destination container for receiving any of the objects from the plurality of levels of the plurality of bins, the at least one destination containers being provided in a region that is generally within the at least partially generally circular arrangement of the plurality of bins of a level of the plurality of bins.
In accordance with an embodiment, for example, the tracks may be provided by paint with a particular reflective characteristic, and sensors on the bottom of the carrier 126 may be programmed to follow the painted track. Further sensors may cause the carrier to change direction when, for example, a sensor or indicia 122 is encountered. The carriers may still be able to run without a track, for example, to and from the stacks 108 without tracks, but the use of the tracks may reduce computation expenses.
For example,
In accordance with certain embodiments therefore, the invention provides a plurality of mobile carriers that may include swivel mounted wheels that rotate ninety degrees to cause each mobile carrier to move forward and backward, or to move side to side. When placed on a grid, such mobile carriers may be actuated to move to all points on the grid.
Each carrier 230 also includes a pair of opposing rails 242, 244 for retaining a bin, as well as a raised center portion 246 and stands 243, 245 on which a bin may rest. A pair of independently actuated paddles 248, 250 are also provided. Each paddle 248, 250 may be rotated upward (as shown at B in
Note that the orientation of the carrier 230 (also a bin on the carrier) does not change when the carrier changes direction. Again, a bin may be provided on the top side of the carrier, and may be contained by bin rails 242, 244 on the sides, as well actuatable paddles 248, 250. As will be discussed in further detail below, each paddle 248, 250 may be rotated 180 degrees to cither urge a bin onto or off of a shelf, or (if both are actuated) to retain a bin on the carrier during transport. Each paddle may therefore be used in concert with movement of the carrier to control movement of the bin with respect to the carrier 230. For example, when a paddle is flipped into an upward position, it may be used to urge the bin onto a shelf or rack while the carrier is moving toward the shelf or rack. Each carrier may also include one or more emergency stop switches 252 for a person to use to stop the movement of a carrier in an emergency, as well as handles 254 to enable a person to lift the carrier if needed.
The movement of the carrier 230 about an array of track sections is further discussed below with regard to
Systems of the invention therefore provide for binary steering of the automated carrier, allowing only bidirectional column and row travel in a grid. One pivot motor may be used for each pair of wheels, with a linkage to pivot the wheel modules. On other embodiments, one pivot motor and linkage could be used for all four wheels, or each wheel may have an independent pivot actuator. The system allows the wheels to follow square track sections by pivoting around rounded corners of the square track sections. The system does not require differential drive line/trajectory following, and keeps the orientation of the carrier fixed throughout all operations.
As shown in
Generally, adding more levels (and more bins) increases the object (SKU) capacity, and adding more towers (and articulated arms) increases the throughput. With reference to
As further shown with reference to
Those skilled in the art will appreciate that numerous modifications and variations may be made to the above disclosed embodiments with departing from the spirit and scope of the present invention.
The present application is a continuation of U.S. patent application Ser. No. 16/825,411, filed Mar. 20, 2020, now U.S. Pat. No. 11,554,916, issued Jan. 17, 2023, which is a continuation of U.S. patent application Ser. No. 15/922,310, filed Mar. 15, 2018, now U.S. Pat. No. 10,649,445, issued May 12, 2020, which claims priority to U.S. Provisional Patent Application Ser. No. 62/471,656 filed Mar. 15, 2017, the disclosures of which are hereby incorporated by reference in their entireties.
Number | Name | Date | Kind |
---|---|---|---|
3554391 | Goodell | Jan 1971 | A |
4678390 | Bonneton et al. | Jul 1987 | A |
4722653 | Williams et al. | Feb 1988 | A |
4846619 | Crabtree | Jul 1989 | A |
4869813 | Bailey | Sep 1989 | A |
5281081 | Kato | Jan 1994 | A |
5595263 | Pignataro | Jan 1997 | A |
6011998 | Lichti et al. | Jan 2000 | A |
6036812 | Williams | Mar 2000 | A |
6377867 | Bradley et al. | Apr 2002 | B1 |
6390756 | Isaacs et al. | May 2002 | B1 |
6505093 | Thatcher et al. | Jan 2003 | B1 |
6579053 | Grams et al. | Jun 2003 | B1 |
6685031 | Takizawa | Feb 2004 | B2 |
7861844 | Hayduchok et al. | Jan 2011 | B2 |
8718814 | Clark et al. | May 2014 | B1 |
8952284 | Wong et al. | Feb 2015 | B1 |
8972045 | Mountz et al. | Mar 2015 | B1 |
9020632 | Naylor | Apr 2015 | B2 |
9120622 | Elazary et al. | Sep 2015 | B1 |
9481518 | Neiser | Nov 2016 | B2 |
9694977 | Aprea et al. | Jul 2017 | B2 |
9751693 | Battles | Sep 2017 | B1 |
9821464 | Stiernagle et al. | Nov 2017 | B2 |
10029865 | McCalib, Jr. | Jul 2018 | B1 |
10649445 | Wagner | May 2020 | B2 |
11554916 | Wagner | Jan 2023 | B2 |
20020092801 | Dominguez | Jul 2002 | A1 |
20020134056 | Dimario et al. | Sep 2002 | A1 |
20020179502 | Cerutti et al. | Dec 2002 | A1 |
20030038065 | Pippin et al. | Feb 2003 | A1 |
20030075051 | Watanabe | Apr 2003 | A1 |
20050002772 | Stone | Jan 2005 | A1 |
20050220600 | Baker et al. | Oct 2005 | A1 |
20060045672 | Maynard | Mar 2006 | A1 |
20080181753 | Bastian | Jul 2008 | A1 |
20080269960 | Kostmann | Oct 2008 | A1 |
20110238207 | Bastian, II | Sep 2011 | A1 |
20110243707 | Dumas | Oct 2011 | A1 |
20120328397 | Yamashita | Dec 2012 | A1 |
20130334158 | Koch | Dec 2013 | A1 |
20140086714 | Malik | Mar 2014 | A1 |
20140244026 | Neiser | Aug 2014 | A1 |
20140277693 | Naylor | Sep 2014 | A1 |
20140364998 | Neiser et al. | Dec 2014 | A1 |
20150098775 | Razumov | Apr 2015 | A1 |
20150114799 | Hansl | Apr 2015 | A1 |
20150203297 | Manning | Jul 2015 | A1 |
20160176638 | Toebes | Jun 2016 | A1 |
20160325934 | Stiernagle | Nov 2016 | A1 |
20170043953 | Battles et al. | Feb 2017 | A1 |
20170080846 | Lord | Mar 2017 | A1 |
20170121114 | Einav | May 2017 | A1 |
20170174431 | Borders | Jun 2017 | A1 |
20170305668 | Bestic et al. | Oct 2017 | A1 |
20170322561 | Stiernagle | Nov 2017 | A1 |
20180085788 | Engel et al. | Mar 2018 | A1 |
20180244473 | Mathi | Aug 2018 | A1 |
20180265298 | Wagner et al. | Sep 2018 | A1 |
20190033837 | Zanger | Jan 2019 | A1 |
20200218246 | Wagner et al. | Jul 2020 | A1 |
20210371203 | O'Brien et al. | Dec 2021 | A1 |
Number | Date | Country |
---|---|---|
2985166 | Dec 2016 | CA |
3056415 | Jan 2024 | CA |
102016611 | Apr 2011 | CN |
102365661 | Feb 2012 | CN |
104495181 | Apr 2015 | CN |
105692028 | Jun 2016 | CN |
205555214 | Sep 2016 | CN |
106395225 | Feb 2017 | CN |
110582454 | Dec 2019 | CN |
113460553 | Oct 2021 | CN |
957200 | Jan 1957 | DE |
19857282 | Jun 2000 | DE |
20011842 | Mar 2001 | DE |
102007023909 | Nov 2008 | DE |
102014111396 | Feb 2016 | DE |
0235488 | Apr 1986 | EP |
0767113 | Apr 1997 | EP |
1695927 | Aug 2006 | EP |
2062837 | May 2009 | EP |
3000773 | Mar 2016 | EP |
3112295 | Apr 2017 | EP |
2036682 | Dec 1970 | FR |
2174163 | Oct 1973 | FR |
2539562 | Dec 2016 | GB |
54131278 | Oct 1979 | JP |
S54131278 | Oct 1979 | JP |
63310406 | Dec 1988 | JP |
0395001 | Apr 1991 | JP |
H08157016 | Jun 1996 | JP |
2003067053 | Mar 2003 | JP |
2007182286 | Jul 2007 | JP |
2008037567 | Feb 2008 | JP |
2014141313 | Aug 2014 | JP |
20150758 | Dec 2016 | NO |
03095339 | Nov 2003 | WO |
2005118436 | Dec 2005 | WO |
2007007354 | Jan 2007 | WO |
2008091733 | Jul 2008 | WO |
2010017872 | Feb 2010 | WO |
2011128384 | Oct 2011 | WO |
2015140216 | Sep 2015 | WO |
2016198565 | Dec 2016 | WO |
2017081281 | May 2017 | WO |
2017148939 | Sep 2017 | WO |
2018170277 | Sep 2018 | WO |
Entry |
---|
Communication pursuant to Rules 161(1) and 162 EPC issued by the European Patent Office on Oct. 22, 2019 in related European Patent Application No. 18715404.2, 3 pages. |
Examiner's Report issued by the Innovation, Science and Economic Development Canada in related Canadian Patent Application No. 3,056,415 on Dec. 3, 2020, 4 pages. |
Examiner's Report issued by the Innovation, Science and Economic Development Canada in related Canadian Patent Application No. 3,056,415 on Jul. 28, 2021, 5 pages. |
Examiner's Report issued by the Innovation, Science and Economic Development Canada (Canadian Intellectual Property Office) in related Canadian Patent Application No. 3,056,415 on Mar. 31, 2022, 7 pages. |
Examiner's Report issued by the Innovation, Science and Economic Development Canada (Canadian Intellectual Property Office) in related Canadian Patent Application No. 3,056,415 on Jan. 10, 2023, 3 pages. |
Final Office Action issued by the U.S. Patent and Trademark Office on Oct. 17, 2019 in related U.S. Appl. No. 15/922,310, 24 pages. |
International Preliminary Report on Patentability for International Application No. PCT/US2018/022654 on Sep. 17, 2019, 11 pages. |
International Search Report and Written Opinion for International Application No. PCT/US2018/022654 on Jun. 5, 2018, 14 pages. |
Non-Final Office Action issued by the U.S. Patent and Trademark Office on Feb. 28, 2019 in related U.S. Appl. No. 15/922,310, 24 pages. |
Non-Final Office Action issued by the U.S. Patent and Trademark Office in related U.S. Appl. No. 16/825,411 on Mar. 24, 2022, 12 pages. |
Notice of First Office Action and First Office Action, along with its English translation, issued by the China Intellectual Property Administration, P.R.C in related China Patent Application No. 201880018258.0 on Sep. 15, 2020, 31 pages. |
Notice of First Office Action and First Office Action, along with its English translation, issued by the China Intellectual Property Administration, P.R.C in related China Patent Application No. 202110778763.9 on Jul. 6, 2022, 11 pages. |
Second Office Action issued by the National Intellectual Property Administration, P.R.C in related Chinese Patent Application No. 202110778763.9 on Mar. 1, 2023, 15 pages. |
Communication pursuant to Article 94(3) EPC issued by the European Patent Office in related European Patent Application No. 18715404.2 on Mar. 1, 2023, 4 pages. |
Third Office Action, along with its English translation, issued by the National Intellectual Property Administration, P.R.C in related Chinese Patent Application No. 202110778763.9 on Jul. 18, 2023, 15 pages. |
Number | Date | Country | |
---|---|---|---|
20230088771 A1 | Mar 2023 | US |
Number | Date | Country | |
---|---|---|---|
62471656 | Mar 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16825411 | Mar 2020 | US |
Child | 17991336 | US | |
Parent | 15922310 | Mar 2018 | US |
Child | 16825411 | US |