The present invention relates to the technical field of robotics.
Robots may be used to reduce costs in many industries and sectors by automating various manually performed tasks. Robots are especially effective at performing repeat mundane tasks.
Warehouse management and/or inventory management can greatly benefit from automation. Warehouse management and/or inventory management may include repeated tasks such as receiving and storing new inventory. Other repeated tasks may include order retrieval, fulfillment, and packaging. These are examples of some tasks that currently have high rates of manual or human execution.
Automating one or more of these tasks may require special purpose robots that have the functionality to perform the tasks, and that are also programmed to perform the tasks. Automation of these and other tasks may lead to lower error rates, higher throughout via continuous operation of the robots, and lower operating costs.
The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements.
Systems and/or methods, as described herein, automate various tasks performed in a warehouse. The tasks may be automated via a set of autonomous robots that include specialized functionalities and methods of operation for performing one or more tasks without human assistance or involvement. In some embodiments, the robots may automate depalletizing tasks for transferring inventory that arrive on palettes to different storage locations within a warehouse.
Depalletizing tasks are difficult to automate because of the different stacked arrangements for objects on different palettes. As such, robots cannot simply perform the same operations when depalletizing different palettes, and may be required to dynamically adjust their operations based on how the objects are stacked or arranged on different palettes, and also based on the different sizes and weights of the objects on the different palettes. For instance, a robot cannot simply retrieve the first object it finds in the palette because doing so may cause other objects stacked atop the first object to fall over and/or be damaged. Similarly, a palette may contain objects of different sizes and shapes. In such cases, the robot has to adjust its operation for retrieval of each different object to ensure that the object and/or neighboring objects are not damaged.
Accordingly, some embodiments provide one or more depalletizing robots that include specialized functionality (e.g., sensors, actuators, and/or other mechanical elements), and specialized methods of operation to safely retrieve objects of different sizes and weights from stacked arrangements of different heights, depths, and/or widths on different palettes without damaging the items or the arrangements. The depalletizing robots may also transfer the retrieved objects to different storage configurations (e.g., stored atop one another, arranged in rows, and/or placed on shelfs, racks, or other storage units) within the warehouse.
The depalletizing robots and resulting automation may provide various advantages over humans that manually perform the depalletizing tasks. For instance, the robots may reach objects on taller stacks or palettes that humans may be unable to access without a ladder or lift. The robots may also provide more careful handling of the objects, verify correct placement of the objects in storage, operate all hours of the day, and/or retrieve objects that may be too heavy or large for humans to safely retrieve. Other advantages of the robot-based automated depalletizing may include optimizing the storage of objects by dynamically selecting storage locations for the objects based on demand and/or inventory on hand.
Robot 110 may align (at 2) the positioning of its base and/or a platform that is atop an actuated lift with a position of a topmost object in the stacked arrangement on palette 120. When multiple objects are at the same height on palette 120, robot 110 may align the platform with the topmost object that is also closest or frontmost to robot 110.
The alignment (at 2) may involve at least two operations. A first alignment operation may involve robot 110 raising the lift to align a height of the platform with a height of the topmost object. Robot 110 may use various cameras and/or other sensors located about the platform to identify the topmost object, and to determine the height at which the topmost object rests atop other objects. A second alignment operation may involve robot 110 repositioning the platform to be horizontally aligned with a position of the topmost object. In some embodiments, robot 110 may use one or more sensors (e.g., a camera) about the platform to align left and right sides of the platform to left and right sides of the topmost object. In some embodiments, robot 110 may use the one or more sensors about the platform to align left and right sides of the platform with a center of the topmost object.
Aligning (at 2) the platform with the topmost object is performed for safe retrieval of the topmost object. In particular, the alignment (at 2) of the platform with the topmost object allows robot 110 to retrieve the topmost object while supporting the topmost object about its center and from below. This manner of retrieval may prevent the topmost object from being damaged by minimizing the possibility of the topmost object falling off to a side when retrieved, and/or underneath objects from being damaged because the platform of robot 110 is used to support the weight of the topmost object as it is being retrieved from palette 120. Achieving the desired alignment therefore requires using specialized functionalities and programming of robot 110 that are described below.
Once alignment (at 2) is achieved, robot 110 may extend (at 3) a retriever to engage the topmost object. In some embodiments, the retriever may be moved across the platform by an actuator. The retriever may use one or more of a grasping, suction, and/or magnetic mechanism to engage the topmost object.
Robot 110 may then retract (at 4) the retriever that has engaged the topmost object. Retracting the retriever causes the topmost object to slide and/or lift off the stacked arrangement and onto the platform of robot 110.
Robot 110 may lower (at 5) the lift once the topmost object is safely on the platform. Lowering the lift that retains the weight of the topmost object may improve robot's 110 center of gravity, thereby allowing robot 110 to transfer the topmost object to a different location more quickly and safely.
In some embodiments, robot 110 may scan an identifier associated with the topmost object and/or palette 120 after retrieving the topmost object from palette 120. The scanned identifier may be wirelessly transmitted to an inventory management system and/or other robots to identify the extraction of the object from palette 120, and to track the inventory as palette 120 is depalletized.
In some embodiments, multiple robots 110 may perform the automated depalletizing that is illustrated in
Based on the provided (at 1) identifiers, robot 110 may identify a path to palette 120, and may move to palette 120 via the identified path. For instance, robot 110 may store a map of the warehouse, and may plot a path to the location associated with the second identifier based on the stored map. In some embodiments, a centralized robotic control system may receive the identifiers and provide the path to robot 110. The centralized robotic control system may track a position of robot 110 in the warehouse, may identify the location of palette 120 based on the provided identifiers, and may generate a path for robot 110 to arrive before palette 120.
After navigating to palette 120, robot 110 may use an onboard scanner, camera, or other sensor to scan (at 2) an identifier of palette 120, and confirm that robot 110 is before the correct palette. The scanner or sensor may be located at the base of robot 110 or on the platform or retriever of robot 110. Robot 110 verifies it is at the correct palette 120 based on the scanned (at 2) identifier from palette 120 matching to the first identifier provided (at 1) to robot 110.
Robot 110 may commence the object extraction after successfully verifying it has arrived before palette 120. To perform the object extraction, robot 110 may first identify a next object to retrieve from palette 120. As noted above, selection of an incorrect object could result in damaging one or more of the objects, robot 110 being unable to retrieve the object, and/or modifying the stacked arrangement of objects on palette 120 such that the retrievals of subsequent objects become more challenging.
As shown in
Robot 110 may lower the lift back down until the platform is aligned with the topmost object. In some embodiments, robot 110 may determine when the platform is aligned with the topmost object via the sensor on the platform. For instance, the sensor may detect (at 4) a gap or space between the topmost object and the underneath object, and robot 110 may align the platform height with the detected (at 4) gap. In some embodiments, the sensor may detect (at 4) the bottom of the topmost object and the top of the underneath object via feature matching or image processing. In some embodiments, the sensor may detect (at 4) the edges of the topmost object so that the robot 110 may align the platform height to the bottom of the topmost object based on the sensor output. In some embodiments, robot 110 may store and/or obtain a size of each object on the palette. For instance, from scanning (at 2) palette 120 identifier, robot 110 may submit the scanned identifier to an inventory management system that then provides robot 110 with the dimensions of the objects on palette 120. Once the platform is raised above the topmost object, robot 110 may lower the platform by a height equal to one object on the platform.
Upon aligning the platform height to the bottom of the topmost object on palette 120, robot 110 may activate the retriever on the platform to engage the topmost object. The retriever element may include a sensor to determine (at 5) when contact is made with the topmost object. The retriever may engage the topmost object upon contacting the topmost object. As noted above, the retriever may engage the topmost object using one or suction, magnet, or grasping mechanism. The retriever may retract to a backmost position on the platform, thereby ensuring that the topmost object is entirely on the platform.
Upon arriving before palette 120, robot 110 may scan an identifier of palette 120 to verify the scanned identifier matches with the identifies that was provided to robot 110. A match indicates that robot 110 is before the correct palette. Robot 110 may obtain information about objects on palette 120 as part of receiving the provided identifier. Alternatively, robot 110 may obtain information about objects on palette 120 in response to scanning the identifier of palette 120 and either querying memory using the scanned identifier for the object information, or submitting the scanned identifier to a remote server and receiving the object information from the remote server. In some embodiments, robot 110 may obtain object information including fiducials and/or visual features that can be used to differentiate the objects on palette 120, the number of objects in the stacked arrangement, dimensions of the objects, and/or other data that robot 110 may use to more efficiently identify the topmost object on palette 120.
For instance,
Robot 110 may continue to raise (at 5) the platform over the topmost object until no more objects are detected. Robot 110 may lower (at 6) the platform until the visual feature of the topmost object is once again scanned. From identifying the visual feature and the obtained information about the positioning of the visual feature, robot 110 may determine (at 7) an additional distance to lower (at 8) the platform in order to align the platform with the bottom of the topmost object. For instance, robot 110 may scan a fiducial and/or image a particular visual feature of the topmost object, and may lower the platform one additional foot when the fiducial or the particular visual feature is positioned one foot above the bottom of the object.
Once the platform is aligned with the bottom of the topmost object, robot 110 may retrieve (at 9) the topmost object onto the platform, lower the platform, and return the retrieved object to storage. Additionally, robot 110 may provide (at 10) a remote server with the identified fiducial or visual feature of the retrieved object, and the remote server may update an inventory record and/or a record of objects remaining on palette 120.
In some embodiments, robot 110 may obtain additional information about objects on palette 120 prior to extracting the objects from palette 120. The additional information may be used to make the identification and extraction of the topmost object more efficient.
In
Robot 110 may then raise its platform while a sensor about the platform scans (at 3) and/or identifies fiducials and/or visual features of the objects on palette 120. Robot 110 may compare each scanned fiducial or identified visual feature against the object list and ordering in order to determine (at 4) if the topmost object has been reached. For instance, robot 110 may determine if a scanned fiducial or identified visual feature is unique to the topmost object on palette 120, or may determine whether it has scanned a particular number of fiducials or identified a particular of visual features to have reached the topmost object on palette 120. Robot 110 continues to raise the platform until robot 110 scans (at 5) a fiducial and/or identifies a visual feature and determines (at 6), based on the obtained additional information about the object on palette 120, that the fiducial and/or visual feature identifies the topmost object on palette 120.
As shown in
Robot 110 may then use its retriever (at 8) to engage and extract the topmost object from palette 120, before lowering the platform, and placing the retrieved object in storage. Robot 110 may also notify the remote server of the removal of the topmost object by sending (at 9) the fiducial, visual feature, and/or other identifier associated with the topmost object to the remote server. The remote server may then update (at 10) the information for palette 120 so that if another robot is used to extract the next topmost object, the robot is provided with updated information as to the objects remaining on palette 120.
The use of robot's 110 onboard sensor enables the specialized methods of operation by which robot 110 is able to autonomously depalletize objects from palette 120, and still be able to depalletize objects from other palettes that may have different stacked arrangements and/or objects of different sizes, shapes, weights, and/or other dimensions. In other words, the robot 110, via the specialized methods of operation illustrated in the figures above, dynamically adjusts its operations based on detected palette configurations and detected objects on the palettes.
Some embodiments perform the automated depalletizing based on the coordinated and synchronized operation of two or more robots. The coordinated and synchronized operation may use two or more robots to expedite the extraction of objects from a palette by partitioning the depalletizing tasks between the two or more robots.
As shown in
As shown in
The sequence of concerted operations may further include robot 510 moving (at 3) the engaged topmost object on the platform of robot 110. In some embodiments, the sequence of concerted operations may cause robot 510 to delay moving the engaged topmost object until the platform of robot 110 is aligned with the topmost object. Coordinating the operations and timing of robots 110 and 510 may prevent the topmost object and/or other objects on palette 120 from being damaged when robot 510 slides the topmost object from palette 120 onto the platform of robot 110, and/or lifts and places the topmost object from palette 120 onto the platform of robot 110. For instance, robot 510 may be unable to reach the platform of robot 110 if the platform is not aligned with palette 120, or robot 510 may use the platform to support some of the weight of the topmost object and, if the platform is not aligned, the topmost object may be dropped or otherwise damaged. Accordingly, robot 110 may wirelessly signal robot 510 when the platform is aligned. In some embodiments, robot 510 may detect when the platform of robot 110 is properly aligned in order to move (at 3) the engaged topmost object onto the platform.
Robot 510 may wirelessly signal (at 4) robot 110, via one or more wireless networks, once the topmost object has been placed onto the platform and/or robot 510 has disengaged the topmost object. In some embodiments, robot 110 may use one or more sensors about its platform to detect placement of the object on the platform. For instance, the platform may include load cells that can detect the weight of the object, and/or cameras to detect when the object is properly placed on the platform and disengaged by robot 510. Robot 110 may begin transferring (at 4′) the object into storage. Another robot 110 may then position itself before palette 120, thereby triggering robot 510 to retrieve the next topmost object from palette 120.
In
In some embodiments, a temporary storage location is used to allow for unsynchronized depalletizing of palette 120 by two or more robots.
As shown in
As robot 110 moves (at 2′) to temporary storage 610, and before robot 110 arrives at temporary storage 610, robot 510 may transfer (at 2) one or more objects from palette 120 onto temporary storage 610. Upon robot 110 arriving and repositioning (at 3) before temporary storage 610, one or more objects from palette 120 may already have been transferred (at 2) to temporary storage 610. Consequently, robot 110 may retrieve (at 4) an object from temporary storage 610 as robot 510 continues to transfer (at 4′) other objects from palette 120 to temporary storage 610. Robot 510 need not wait for robot 110 in order to perform its subset of depalletizing tasks. Similarly, robot 110 can perform its different subset of depalletizing tasks while robot 510 is performing other tasks. In this manner, robots 110 and 510 in
In some embodiments, the unsynchronized operation may increase efficiency of robots 110 and 510. For instance, one robot may complete its tasks faster than the other robot. The unsynchronized operation allows the faster robot to continue operating without stalling for the slower robot to complete its tasks. The unsynchronized operation also allows multiple instances of the slower robot to be used to keep up with the speed of the faster robot. Assume, for example, that in
In some embodiments, different instances of the same robot (e.g., the first set of robots or robot 110) can be used to perform different portions of the automated depalletizing. Reusing the same robot for different portions of the automated depalletizing may lead to reduced costs as less time and money is devoted to robot development.
In
Upon robot 110 arriving before palette 120, robot 710 may have completed retrieving (at 2) the object, and may commence the transfer (at 3) of the retrieved object to robot 110. Transferring (at 3) the retrieved object may involve additional coordinated activity by robots 110 and 710. In particular, robot 710 may turn to face robot 110, and may lower its lift to a preset height at which the transfer occurs. Meanwhile, robot 110 may align its positioning so that its platform is at the same height and/or is centered with the platform of robot 710. Robots 110 and 710 may have sensors about their respective platforms to achieve the alignment for safe and coordinated transfer of the object from robot 710 to robot 110.
Transferring (at 3) may further include robot 110 extending its retriever towards robot 710 while robot 710 uses its retriever to push the retrieved object closer to robot 110. Robot 110 may use its retriever to engage the object, and assist in the transfer of the object on the platform of robot 110. For instance, robot 710 may push the object halfway onto the platform of robot 110 at which point robot 110 engages the object with its retriever and retracts the retriever to pull the object further onto the platform of robot 110.
In some embodiments, robot 110 may provide (at 1″) a first message to robot 710 when robot 110 is a first distance from palette 120 and is approaching palette 120. In response to receiving (at 1″) the first message, robot 710 may commence retrieval (at 1) of the topmost object from palette 120. Robot 110 may subsequently provide (at 2′) a second message to robot 710 when robot 110 is a closer second distance from palette 120. In response to receiving the second message, robot 710 may transfer (at 3) the retrieved object to robot 110. Robot 110 may then enter the object into storage while robot 710 retrieves a next topmost object from palette 120 for another robot that is queuing near palette 120.
As shown in
Robot 110 may identify (at 4) an empty location about storage rack 810 where the depalletized object is to be stored (e.g., with other units of the same object). For instance, storage rack 810 may be used to store the retrieved object and/or other units of the same object at a designated location about rack 810, or may set a designated location for the retrieved object. The identifier mapping (at 2) may identify the designated location, and robot 110 may identify and/or create an empty space at that designated location. In a dynamic storage scenario, rack 810 may store different objects in different spaces. Robot 110 may select (at 2′) storage rack 810, and may identify (at 4) an empty location upon arriving at rack 810 by scanning for the empty location. To scan for the empty location, robot 110 may raise its lift and use a sensor about the platform atop the lift to identify (at 4) the empty location to store the retrieved object. In some embodiments, robot 110 and/or an inventory management system may track empty locations about different racks 810 may direct robot 110 to a particular location about rack 810 in response to robot 110 scanning (at 1) the object identifier, and wirelessly providing the scanned identifier to the inventory management system. Robot 110 may determine the empty location using a camera and/or other sensors. The empty location may correspond to an empty space next to, in front of, or above another unit of the same object at rack 810. Alternatively, robot 110 may create the empty location by pushing the object into other objects in rack 810 when rack 810 is organized for last in first out access.
To transfer the object to the empty location, robot 110 may align (at 5) the object with the identified empty location. Once again, robot 110 may perform a two-stage alignment by manipulating a lift that raises or lowers the platform on which the object rests to a height of the empty location, and by positioning the platform to be parallel to and centered about the empty location. Once robot 110 is properly aligned, robot 110 may enter (at 6) the object to the storage location by pushing or otherwise transferring the object from the platform to the empty location on rack 810.
Robot 110 may scan (at 7) a first identifier corresponding to the storage location that the object now occupies (e.g., a fiducial at the storage location), and/or a second identifier that is associated with the stored object (e.g., a fiducial on the object). The first identifier may be used to confirm that the object is stored to the correct rack and/or storage location (e.g., rack 810).
Robot 110 may wirelessly transmit (at 7) the first identifier and/or the second identifier to an inventory management system or database in order to update a record that is used to track the object in the warehouse. In particular, the first and second identifiers may be used to map the object to the corresponding storage location. The scanned identifiers may also be used to updated a quantity of the object that is stored in the warehouse.
In some embodiments, robot 110 may store a depalletized object in a storage location that includes other objects. For instance, robot 110 may place an object on a storage rack that includes other items of the same object. The objects may have a particular arrangement on the storage rack. For instance, the objects may be placed in front of one another, next to one another, or atop one another. When the objects at a storage location are placed in front of one another, robot 110 may identify the frontmost object, align its positioning (e.g., the platform with a retrieved object) with the frontmost object, and may push a retrieved object from its platform, using the retriever, into the frontmost object. The other objects may be pushed back into the storage location with the retrieved object being placed as the new frontmost object. When the objects at a storage location are placed atop one another, robot 110 may identify the topmost object, align its platform with a top face of the topmost object, and may place the retrieved object from its platform onto the topmost object.
The coordinated depalletizing operation of two instances of the same robot, as shown in
As shown in
Rather than wait for robot 110 to arrive to receive the first object, robot 710 places the first object to temporary storage 910, and begins retrieval (at 2) of a second object from palette 120. Upon arriving at temporary storage 910, robot 110 may retrieve (at 3) the first object from temporary storage 910 while robot 710 contemporaneously places the second object to temporary storage 910. Here, as in
Process 1000 may include moving (at 1020) robot 110 to the location of the palette that is identified from the second identifier. In some embodiments, robot 110 may store a map of the site in order to autonomously navigate to the palette location upon receiving the second identifier.
Process 1000 may include scanning (at 1030) the first identifier that is associated with the palette using a sensor of robot 110 when robot 110 arrives at the palette location. The scanning and matching of the scanned palette identifier with the first identifier that was received (at 1010) with the notification verifies (at 1035) that robot 110 has located the correct palette.
Process 1000 may also include detecting (at 1040) one or more properties of the objects on the palette based on the scanning (at 1030) of the first identifier. For instance, the first identifier may be used to lookup size, weight, shape, order history, demand, and/or other properties associated with the objects.
Robot 110 may adjust its retrieval operation based on the detected size, weight, shape, and/or other dimensions of the objects, and may select (at 1050) storage locations in the site for the palette objects based on the dimensions and/or demand for the objects. For instance, larger objects with low demand may be stored further from order fulfillment stations such that closer locations may be used to store and more quickly transfer smaller and high demand objects from the closer locations to the order fulfillment stations.
Process 1000 may then include controlling (at 1060) robot 110 in retrieving each object from the palette, and transferring each object to a selected (at 1050) storage location for that object. The retrieval may be performed according to any of the automated depalletizing procedures illustrated in
Robot 110 may activate and deactivate various actuators, motors, and/or other mechanical elements to retrieve and transfer the objects. Robot 110 may use an onboard processor and various sensors to determine how to manipulate the actuators, motors, and/or other mechanical elements for depalletizing and inventory storage.
Atop motorized base 1120 is lift 1130 that raises and lowers platform 1140. As shown, lift 1130 may include a collapsing and expanding structure. In some embodiments, lift 1130 may include a pneumatic piston or other means for raising and lowering platform 1140.
Platform 1140 may include an elongated surface onto which objects retrieved by robot 1110 may be retained during transport. Platform 1140 may also include a mechanical retriever for retrieving containers and/or other objects onto platform 1140. The mechanical retriever may include at least one motor for moving a retrieval element. The retrieval element may include a vacuum that uses suction to engage containers and/or other objects. The vacuum may be located at a distal end of a telescoping or other expandable element that can position the vacuum at different lengths from the robot. For instance, the expandable element may expand several feet in front of robot 1110 in order to place the vacuum at the distal end against an object that is recessed within a storage location. In some embodiments, the retrieval element may alternatively include a gripper, articulating mechanical arm, or other means to grab or otherwise engage containers and/or objects.
Robot 1110 may use one or more onboard processors to coordinate operations with other robots and/or perform the specialized methods of operation for depalletizing objects from a palette. For instance, the processor may activate and control one or more actuators and sensors of robot 1110 to navigate to a first location of a palette, align positioning for extract of a topmost object, retrieve the topmost object, and deliver the topmost object to a storage location in a warehouse.
Robot 1110 is presented as one example of an autonomous robot that may perform automated depalletizing. Other robot embodiments and the operations performed by the other robot embodiments may similarly be coordinated and controlled for automated depalletizing according to the methodologies presented herein.
The foregoing description of implementations provides illustration and description, but is not intended to be exhaustive or to limit the possible implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of the implementations.
The actual software code or specialized control hardware used to implement an embodiment is not limiting of the embodiment. Thus, the operation and behavior of the embodiment has been described without reference to the specific software code, it being understood that software and control hardware may be designed based on the description herein.
Some implementations described herein may be described in conjunction with thresholds. The term “greater than” (or similar terms), as used herein to describe a relationship of a value to a threshold, may be used interchangeably with the term “greater than or equal to” (or similar terms). Similarly, the term “less than” (or similar terms), as used herein to describe a relationship of a value to a threshold, may be used interchangeably with the term “less than or equal to” (or similar terms). As used herein, “exceeding” a threshold (or similar terms) may be used interchangeably with “being greater than a threshold,” “being greater than or equal to a threshold,” “being less than a threshold,” “being less than or equal to a threshold,” or other similar terms, depending on the context in which the threshold is used.
No element, act, or instruction used in the present application should be construed as critical or essential unless explicitly described as such. An instance of the use of the term “and,” as used herein, does not necessarily preclude the interpretation that the phrase “and/or” was intended in that instance. Similarly, an instance of the use of the term “or,” as used herein, does not necessarily preclude the interpretation that the phrase “and/or” was intended in that instance. Also, as used herein, the article “a” is intended to include one or more items, and may be used interchangeably with the phrase “one or more.” Where only one item is intended, the terms “one,” “single,” “only,” or similar language is used. Further, the phrase “based on” is intended to mean “based, at least in part, on” unless explicitly stated otherwise
In the preceding specification, various preferred embodiments have been described with reference to the accompanying drawings. It will, however, be evident that various modifications and changes may be made thereto, and additional embodiments may be implemented, without departing from the broader scope of the invention as set forth in the claims that follow. The specification and drawings are accordingly to be regarded in an illustrative rather than restrictive sense.