An industrial robot is an electro-mechanical machine that is controlled by a computer program, electronic circuits, or both. The industrial robot may be either stationary or mobile (e.g., capable of navigating from one location to another location). For example, the industrial robot may have wheels (or another form of conveyance) to enable the industrial robot to navigate to different locations. Industrial robots that can navigate independently of each other may be referred to as mobile drive units (MDUs). The MDUs may be capable of performing activities using one or more arm-like mechanisms to grasp an item, release the item, etc. Based on the type of task that is to be performed, two or more MDUs may coordinate their respective activities to perform a task.
In an area (e.g., a factory, a warehouse, a materials handling facility or similar type of setting) where multiple MDUs are performing activities, under some circumstances, humans may enter the area. For example, plastic wrap used to cover a load of items may foul the wheels of an MDU. As another example, an item from the load of items may fall and obstruct the path of an MDU or partially damage an MDU. Under such circumstances, a human may enter the area to perform an activity such as removing the plastic wrap from the wheels of the MDU, removing an item obstructing the path of the MDU, or repairing the MDU. The MDUs may be instructed to perform one or more activities, such as transporting items between locations in a materials handling facility, transporting a shelving unit from one location to another, docking with a charging unit, handing off a trash container to a dumper unit, etc. When a human enters an area in which multiple MDUs have been instructed to perform one or more activities, the human may risk being inadvertently injured by one or more of the MDUs as the MDUs perform their activities.
The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same reference numbers in different figures indicate similar or identical items.
The systems and techniques described herein may be used to provide a functionally safe environment for humans in an area in which mobile drive units (MDUs) are performing activities. For example, when a human is detected within an area in which MDUs are performing activities, a safety management device may instruct at least some of the MDUs to temporarily cease performing activities. As used herein, the term activity refers to physical activity, e.g., physical movement. Thus, during the time that the MDUs cease performing activities, the MDUs may continue to receive signals, transmit signals, perform computations, and perform other non-physical activities.
The human may wear a locator device that the safety management device or an MDU uses to determine a location of the human. When the safety management device or one of the MDUs determines that the human is located in or near an area in which MDUs are performing activities, MDUs within a first distance from the human may be instructed to temporarily cease performing a set of activities. In some cases, MDUs within a second distance from the human may be instructed to reduce their speed. Additionally, some of the MDUs may be instructed to navigate to a new location and then temporarily stop performing any activity. Thus, when the presence of a human is detected, a first set of MDUs may temporarily stop performing any activity, a second set of MDUs may reduce their speed of travel, and/or a third set of MDUs may retreat (e.g., navigate to a new location that is further away from the human) and then temporarily stop performing any activity.
An MDU may be a robotic (e.g., electro-mechanical) device that can be instructed to perform a set of activities and may be capable of navigating to different locations using a drive mechanism, such as wheels or other conveyance mechanism. The MDUs may be instructed to perform a set of activities. For example, each MDU may be instructed to receive a listing of items to be shipped to a particular address, retrieve the items from the listing from multiple locations (e.g., multiple bins of items), place the retrieved items in a container for shipment to the particular address, perform another type of task, or any combination thereof.
The location of the human may be determined using a variety of techniques. For example, the human may wear a locator device that transmits a signal, such as a radio frequency identifier (RFID). As another example, the human may wear a locator device that determines a position of the device (e.g., using a triangulation method, global positioning satellites (GPS), or the like) and sends the location information to the MDUs and/or to a management device that controls the MDUs. As a further example, the human may wear a device that transmits (e.g., broadcasts) a signal that may be triangulated using antennas placed at various locations within the area in which the MDUs are performing activities. As yet another example, the human may wear a device that reads (e.g., using optical recognition, RFID, etc.) identifiers, such as fiducial markers, that have been distributed throughout the area and sends data associated with the identifiers to enable the location of the human to be determined. As yet another example, imaging devices, such as cameras, placed at various locations in an area may be used to optically or visually determine a location of the human. As a further example, sensors (e.g., floor sensors, heat sensors, motion sensors, etc.) may be placed at various locations in an area to determine a location of the human. Of course, any combination of the previously mentioned techniques, potentially in combination with other location determination techniques, may be used to determine the location of the human.
The safety management device may track the locations of humans and the locations of MDUs. The safety management device may use various techniques to create a functionally safe environment for humans. For example, the safety management device may create one or more fixed (e.g., immovable) zones and track the location of humans entering and leaving the fixed zones. In some cases, the safety management device may not track the location of the humans within the fixed zones while in other cases the safety management device may track the location of the humans within the fixed zones. In some implementations, the safety management device may create a moveable zone around a human. For example, the safety management device may continually monitor a location of each human in an area, each MDU in the area, determine a distance of each MDU from each human, and then instruct the MDUs to perform a command (e.g., stop performing physical activities, reduce speed, move to a new location, etc.) based on each MDU's distance from the human. To illustrate, the human may wear a locator device that includes a reader device to scan identifiers, such as fiducial markers, placed at various locations within an area. To illustrate, the identifiers may be placed on the floor or at a certain height to enable the reader to automatically scan the identifiers and transmit the read information to the safety management device. In some cases, the information read from the identifiers may include location information associated with a corresponding location of each of the identifiers.
As another example, the humans may wear a locator device that includes a radio frequency identifier (RFID) reader to read RFID tags placed at various locations (e.g., on the floor, at a particular height, in fiducial markers, etc.) within an area. As yet another example, individual MDUs may detect the presence of a human by receiving a signal transmitted (e.g., broadcast) by a locator device that is worn by the human. To illustrate, each human may wear a locator device that transmits or broadcasts a signal, such as an RFID signal or other type of signal. In this example, the MDUs may detect the presence of humans by detecting the signal (e.g., RFID or similar signal) that is being transmitted or broadcast by the locator device worn by each human. As a further example, an indoor positioning system may be used to track the location of each human that enters an area in which one or more MDUs are performing activities. To illustrate, antennas placed at various locations in the area may be used to determine (e.g., using triangulation) a location of each locator device worn by each human. The locator device may transmit or broadcast using one or more frequencies to enable the location to be determined relatively quickly.
When a safety management device detects that a human has entered an area in which MDUs are performing activities, the safety management device may create a safe zone by instructing MDUs within a predetermined distance from the human to stop performing any physical activities. The safety management device may instruct MDUs that are more than the predetermined distance from the human to avoid entering the safe zone. As the human moves within the area, the safety management device may track the location of the human and the locations of the MDUs. Based on the distance of the MDUs from the human, the safety management device may instruct at least some of the MDUs to either (i) stop performing any physical activity and/or (ii) avoid a portion of the area (e.g., the safe zone).
When the safety management device instructs an MDU to cease performing physical activities, in some cases the instruction may cause the connection of a portion of the MDU to a power source to be interrupted. For example, the instruction to cease performing physical activities may cause the connection that provides power to the wheels (or other means of conveyance for the MDU) to be temporarily interrupted. As another example, the instruction to cease performing physical activities may cause the connection that provides power to the various electronic components of the MDU to be temporarily interrupted.
Thus, when the presence of a human is detected in or near (e.g., within a predetermined distance from) an area in which MDUs are performing activities, the MDUs may temporarily stop performing the activities. In some cases, the MDUs may perform another activity, such as navigating to a new location. For example, the MDUs may move to a location that is greater than a predetermined distance from the estimated path of the human and then temporarily stop performing any activity. The presence of the human may be detected by one or more MDUs and then transmitted or broadcast to other MDUs in the area and/or a management device. The presence of the human may be detected by a management device and transmitted or broadcast to at least one of the MDUs in the area. The presence of the human may be detected using one or more techniques, such as (1) sensors interspersed throughout the area, (2) imaging devices capable of capturing images of the area, (3) a device worn by the human that receives and/or sends location information, and/or (4) other means of detection.
Mobile Drive Units Instructed Based on a Distance from a Human
The area 102 may include one or more mobile drive units (MDU) 106, such as the representative MDUs 106(1), 106(2), 106(3) and 106(4). One or more of the MDUs 106 may be airborne, e.g., capable of travelling through three dimensional space. Individual mobile drive units of the MDUs 106 may be instructed to perform a set of activities, such as placing items onto one or more of the fixed objects 104, selecting and removing one or more items from the fixed objects 104, moving between the fixed objects 104 to perform the set of activities, moving items from one of the fixed objects 104 to another of the fixed objects 104, etc.
An operational management device 108 may be used to control the operations or activities of the MDUs 106. For example, the operational management device 108 may instruct individual mobile drive units of the MDUs 106 to perform a particular set of activities. For example, the operational management device 108 may wirelessly transmit a first command (e.g., to perform a first set of activities) to the MDU 106(1), wirelessly transmit a second command (e.g., to perform a second set of activities) to the MDU 106(2), and so on.
A safety management device 110 may control the MDUs 106 to provide a functionally safe environment for humans in the area 102. For example, each of the MDUs 106 may periodically, at an interval of N milliseconds (where N>0), send a query message asking if each MDU can perform (or continue performing) the set of activities that the operational management device 108 has instructed the MDUs 106 to perform. Each query message may include (i) a unique identifier and (ii) an identity of the sending mobile drive unit. For example, a query message sent by MDU 106(1) may indicate that the query message was sent by MDU 106(1). In some cases, the query message may include a time stamp. For example, the unique identifier may include a time stamp that includes a date and time that the query message was sent along with an identity of the sending mobile drive unit. The safety management device 110 may respond to each query message that the safety management device 110 receives from the MDUs 106. For example, a response message to a query message may instruct a particular one of the MDUs 106 to (i) continue performing a set of activities, (ii) temporarily stop performing the set of activities, (iii) reduce a speed of the particular MDU when moving from one location to another location, (iv) move to a new location, (v) move to a new location and temporarily not perform any physical activities, and so on. Thus, a particular mobile drive unit of the MDUs 106 may perform (or continue performing) the set of activities when the particular mobile drive unit has a received a response to a most recently sent query message instructing the particular mobile drive unit to continue performing the set of activities. A particular mobile drive unit of the MDUs 106 may stop performing the set of activities when the particular mobile drive unit fails to receive a response to a most recently sent query message or when the particular mobile drive unit receives an instruction to stop performing any physical activity. In some cases, a particular mobile drive unit of the MDUs 106 may stop performing the set of activities when the particular mobile drive unit fails to receive more than M response messages (where M>0).
In some implementations, each of the MDUs 106 may periodically, at an interval of N milliseconds (where N>0), receive a message from the safety management device 110 without the MDUs 106 periodically sending query messages to the safety management device 110. For example, the safety management device 110 may periodically send an instructional message to each of the MDUs 106, instructing each of the MDUs 106 to (i) continue performing a set of activities, (ii) temporarily stop performing the set of activities, (iii) reduce a speed of the particular MDU when moving from one location to another location, (iv) move to a new location, or (v) move to a new location and temporarily not perform any physical activities. Thus, in such implementations, the safety management device 110 may send instructional messages rather than responses to query messages sent by the MDUs 106.
Various types of techniques may be used to track the location of each of the MDUs 106 and the location of humans, such as the human 118. One or more imaging devices 112 (e.g. cameras), such as representative imaging devices 112(1), 112(2), 112(3) and 112(4), may be placed at various locations in the area 102 to provide information used to track mobile drive units and humans. The cameras 112 may provide image data to enable the operational and safety management devices 108, 110 to track the movement and determine a location of each of the MDUs 106 and the humans in the area 102. One or more sensors 114, such as representative sensors 114(1), 114(2), 114(3) and 114(4), may be placed at various locations in the area 102 to provide sensor data to track the movement and determine a location of each of the MDUs 106 and the humans in the area 102. The sensors 114 may include motion sensors, heat sensors, infrared sensors, pressure sensors, another type of sensor, or any combination thereof.
Identifiers 116 (e.g., fiducial markers), such as representative identifiers 116(1), 116(2), 116(3) and 116(4), may be placed at various locations in the area 102. The identifiers 116 may be read by (i) a locator device worn by a human, such as a representative human 118, or (ii) a locator device mounted on each of the MDUs 106. In
The safety management device 110 may determine a location of each of the MDUs 106. In some cases, when a human is determined to be present in or near the area 102, the safety management device 110 may instruct all the MDUs 106 to temporarily stop performing any physical activities. If one or more of the MDUs 106 are airborne, the airborne MDUs may be instructed to land in a controlled manner and then stop performing any physical activities. In other cases, when humans are present in or near the area 102, the safety management device 110 may determine a location of each of the humans, such as a location of the human 118. When the safety management device 110 determines that a human is in (or near) the area 102, the safety management device 110 may determine a location of each of the MDUs 106 and instruct the MDUs 106 to perform a command, e.g., based on the distance of a particular MDU from the human 118. The commands to the MDUs 106 may include stop performing physical activities, change from a faster speed to a slower speed when moving from one location to another location, move to a new location, etc. For example, the safety management device 110 may determine that an MDU, such as the MDU 106(1), is within a first distance 122 from the human 118 and instruct the MDU to stop performing physical activities (e.g., to ensure the safety of the human 118). As another example, the safety management device 110 may determine that an MDU, such as the MDU 106(2), is within a second distance 124 (e.g., greater than the first distance 122) from the human 118 and instruct the MDU to change from a faster speed to a slower speed when moving from one location to another location. In this example, the safety management device 110 may determine that the MDU 106(2) is within the second distance 124 from the human 118, but will not travel within the first distance 122 from the human 118, and may thus instruct the MDU 106(2) to reduce speed, rather than stop all physical activities. Alternatively or additionally, the safety management device 110 may instruct the MDU 106(2) within the second distance 124 from the human 118 to navigate away from the location of the human 118 until the MDU 106(2) is outside the second distance 124 from the human, for example, and then continue performing a set of activities while maintaining at least the second distance 124 from the human, or stop all physical activities. The safety management device 110 may instruct MDUs within a remaining portion 126, e.g., outside the second distance 124 from the human 118, of the area 102, such as the MDU 106(3) and MDU 106(4), to each continue performing a set of activities. Alternatively or additionally, the safety management device 110 may instruct the MDUs 106(3) and 106(4) to navigate further away from the location of the human 118 and then continue performing a set of activities while maintaining a further specified distance from the human, or stop all physical activities. If one or more of the MDUs 106 are airborne, the airborne MDUs 106 may be instructed to land in a controlled manner. For example, the airborne MDUs 106 may be instructed to land in such a way that after landing, the previously airborne MDUs 106 are at least the first distance 122 from the human 118. To illustrate, the airborne MDUs 106 may be instructed to land in a controlled manner in a portion of the area 102 that is greater than the first distance 122 but may be less than the second distance 124. After landing, the previously airborne MDUs 106 may be instructed to stop performing all physical activities. In some cases, if the airborne MDUs 106 are within the first distance 122 from the human 118, the airborne MDUs 106 may be instructed to drop to the ground (e.g., by cutting power to the mechanism that is keeping the MDUs 106 airborne) or land in a controlled manner. Airborne MDUs 106 that are the second distance 124 (or greater) from the human 118 may be instructed to land in a controlled manner, navigate to a new location that is a greater that the second distance 124 from the human 118, stop performing any physical activities, or any combination thereof.
The safety management device 110 may effectively create a moveable zone 128 by tracking the movement of the human 118 in the area 102 in real-time and instructing the MDUs 106 accordingly. For example, if the human 118 moves towards the MDU 106(2), the safety management device 110 may determine that the MDU 106(2) is within the first distance 122 from the human 118 and instruct the MDU 106(2) to stop performing any physical activities. The safety management device 110 may determine that the MDU 106(3) is within the second distance 124 from the human 118 and instruct the MDU 106(3) to reduce speed. The safety management device 110 may continue tracking the movement of the human 118 in real-time and instructing the MDUs 106 accordingly until the safety management device 110 determines that the human 118 is no longer in the area 102.
For illustration purposes, the moveable zone 128 is shown as being circular in
The safety management device 110 may include a redundant architecture such that the safety management device 110 can continue to function by instructing the MDUs 106 even after the failure of a hardware component or a software component. For example, when a hardware component fails, the safety management device 110 may detect the failure and switch to using a backup hardware component.
In some implementations, the function of the management devices 108, 110 may be distributed among the MDUs 106. For example, a mobile drive unit (e.g., MDU 106(1)) that is closest to the human 118 may detect the presence of the human 118, and send instructions to the other MDUs 106 (e.g., MDU 106(2), MDU 106(3), and MDU 106(4)) to perform various actions, such as reducing speed or navigating to a new location.
When the safety management device 110 or one (or more) of the MDUs 106 determines that the human 118 has exited (e.g., is no longer present in) the area 102, individual drive units of the MDUs 106 may resume performing a set of activities. In some cases, at least some of the MDUs 106 may resume the activities that were being performed before the presence of the human 118 was detected in the area 102. In other cases, at least some of the MDUs 106 may perform a different set of activities as compared to the set of activities that were being performed before the presence of the human 118 was detected in the area 102.
Thus, when the presence of a human is detected in an area, a safety management device may continually monitor in real-time a location of the human, a location of individual mobile drive units, and/or a distance of the mobile drive units from the human. In some implementations, based on the distance of the individual mobile drive units from the human, the safety management device may continually send updated instructions to the mobile drive units.
Creating a Moveable Zone
The safety management device 110 may continually monitor the location of the human 118 within the area 102, continually monitor the location of each of the MDUs 106 within the area 102, and instruct individual ones of the MDUs 106 to perform a command based on the distance of the MDUs 106 from the human 118. For example, when the human 118 moves from the first location 202 to a second location 204 in the area 102, the safety management device 110 may determine that the MDU 106(3) is within the first distance 122 from the human 118 at the second location 204 and instruct the MDU 106(3) to temporarily stop performing any physical activities.
In some cases, at least one of the MDUs 106 may detect the presence of the human 118 in the area 102 and alert the safety management device 110, the other MDUs 106, or both as to the presence of the human 118. When a particular MDU of the MDUs 106 detects the presence of the human 118, the particular MDU may determine a distance between the particular MDU and the human 118 and automatically perform an action, such as temporarily stopping all physical activities.
When the management device 108 and/or at least one (or all) of the MDUs 106 determines that the human 118 is no longer present in the area 102, individual drive units of the MDUs 106 may resume performing a set of activities. In some cases, at least some of the MDUs 106 may resume the activities that were being performed before the presence of the human 118 was detected in the area 102. In other cases, at least some of the MDUs 106 may perform a different set of activities as compared to the set of activities that were being performed before the presence of the human 118 was detected in the area 102.
The presence or absence of the human 118 in the area 102 may be determined using the locator device 120, the imaging devices 112, the sensors 114, the identifiers 116, the MDUs 106, using another technique, or any combination thereof.
Thus, when the presence of a human is detected in an area in which MDUs are performing a set of activities, the MDUs may temporarily stop performing the set of activities. When a determination is made that the human is no longer present in the area, the MDUs may resume performing the set of activities. In this way, the MDUs may provide a functionally safe environment to prevent the human from being inadvertently injured by the MDUs.
Creating a Fixed Zone
To create such an area, the human 118 may instruct the safety management device 110 to create a fixed zone 302. For example, the human 118 may specify a location and a size of the fixed zone 302. The fixed zone 302 may be created using barriers 304. The barriers 304 may include virtual barriers, physical barriers, or both.
To create the fixed zone 302 using virtual barriers 304, the safety management device 110 may instruct the MDUs 106 to avoid entering a portion of the area 102 that includes the fixed zone 302. In some cases, the safety management device 110 may instruct one or more of the MDUs 106 to place transmitters (e.g., light curtains or similar devices) along a perimeter of the fixed zone 302. Alternatively, the human 118 may place transmitters along a perimeter of the fixed zone 302. The transmitters may broadcast a signal that causes the MDUs 106 to avoid entering a portion of the area 102 that includes the fixed zone 302.
To create the fixed zone 302 using physical barriers, the safety management device 110 may instruct the MDUs 106 to place the (physical) barriers 304 to mark the boundary of the safe zone 302. Alternatively, the human 118 may place transmitters along a perimeter of the fixed zone 302. The MDUs 106 may each include one or more sensors that are capable of identifying the (physical) barriers 304. For example, the MDUs 106 may sense the (physical) barriers 304 as walls (or other fixed objects) that are to be avoided when navigating the area 102. In some implementations, the physical barriers 304 may include transmitters that transmit a signal that instructs the MDUs 106 to avoid a portion of the area 102 that includes the fixed zone 302. In such an implementation, the barriers 304 may include both physical barriers and virtual barriers. If the virtual barrier fails (e.g., a particular MDU attempts to enter the fixed zone 302 because a transmitter failed or because the particular MDU's sensor failed), the physical barrier may prevent the particular MDU from entering the fixed zone 302.
During the time that the fixed zone 302 is created, the MDUs 106 may avoid coming within a specified (e.g., predetermined) distance of the fixed zone 302. When the safety management device 110 determines that the human 118 is no longer present in the area 102, the safety management device 110 may instruct the MDUs 106 to resume performing a set of activities, including activities that involve entering the portion of the area 102 that was used to create the fixed zone 302. If physical barriers were used to create the fixed zone 302, after the human has left the area 102, the safety management device 110 may instruct the MDUs 106 to remove the physical barriers. Alternatively, the human 118 may remove the physical barriers from the fixed zone 302.
In some cases, as a further safety measure, individual ones of the MDUs 106 that come within a predetermined distance of the fixed zone 302 (or the barriers 304) may perform an action, e.g., similar to the moveable zone 128 of
Thus, a fixed zone that is functionally safe may be created to enable a human to perform actions without risking injury by an MDU. The fixed zone may be created using physical barriers, virtual barriers, or a combination of both.
Configurable Zones
The architecture 400 illustrates how an area, such as the area 102, may include multiple zones in which each zone can be configured or reconfigured as desired to be one of the zones described in
Each of the zones 402 and 404 may be configurable and the behavior of the MDUs 106 that are present may depend on various factors, including a setting of the locator device 120, a current time and/or date, other factors, or any combination thereof. For example, when the presence of the human 118 is detected in the first zone 402, the MDUs 106 may slow down or stop performing physical activities (e.g., as illustrated in
In some cases, the locator devices 120, 408 may include settings that specify the behavior of the MDUs 106. For example, a first setting may cause MDUs 106 within a predetermined distance from the humans 118, 406 to perform a first command (e.g., stop performing physical activities). A second setting may cause MDUs 106 within a first distance from the humans 118, 406 to perform a first command (e.g., stop performing physical activities) and may cause MDUs 106 within a second distance to perform a second command (e.g., reduce speed when moving to a new location).
Thus, an area may include more than one zone and the behavior of MDUs in each zone may be configurable depending on various factors. For example, the human may wear a locator device that has different settings that determine the behavior of the MDUs when the human's presence (e.g., the locator device's presence) is detected. In this way, humans can specify the behavior of the MDUs in each zone. Other factors, such as time of day, a particular zone that the human has entered, and the like may also be used by the safety management device 110 to determine the behavior of the MDUs. In this way, the MDUs may comply with safety regulations to provide a functionally safe environment for humans.
Illustrative Architectures
Each mobile drive unit 106 may include one or more processors 502, one or more memory devices (e.g., computer readable media 504), one or more batteries (or other power sources) 506, a drive unit safety controller 508, a transceiver 510, an MDU locator 512, one or more drive mechanisms, such as motors 514, or any combination thereof. The computer readable media 504 may include non-transitory media to store instructions 516 that are executable by the processors 502 to perform the various functions of the MDU 106. The drive unit safety controller 508 may govern the behavior of the MDU 106 to prevent the MDU 106 from causing injury to the human 118. The transceiver 510 may be capable of transmitting and receiving messages using the network 105. The MDU locator 512 may be used to transmit a location of each MDU 106(1) through 106(N) to the management devices 108, 110 using the transceiver 510.
The operational and safety management devices 108, 110 may include one or more processors 518, one or more memory devices, such as computer readable media 520, a messaging controller 522, a main safety controller 524, an input/output interface 526, an alarm system 528, a transceiver 530, or any combination thereof. The computer readable media 520 may include instructions 532 that are executable by the processors 518 to perform the various functions of the safety management device 110. The messaging controller 522 may determine which particular messages are to be sent to particular MDUs 106. The main safety controller 524 may provide various safety instructions including determining when to instruct the MDU's 106 to stop performing any physical activity, when to reduce speed, when to navigate away from a human, etc. The input/output interface 526 may include various input and output devices, such as a keyboard a mouse, a trackball, a display device, other input/output devices, and the like. The alarm system 528 may cause an alarm to sound or be displayed in an area, such as the area 102, to alert human(s) that are in the area to exit the area etc. The transceiver 530 may be used to send messages to and receive messages from the MDUs 106.
The human 118 may be associated with (e.g., by wearing) the locator device 120. For example, the locator device 120 may be incorporated into an identification badge, a hard hat, safety glasses, work boots, protective suit, or any other item that can be worn or carried by the human 118. The locator device 120 may include a transceiver 534 to send messages to or receive messages from the operational and safety management devices 108, 110, the MDUs 106, or both. For example, the transceiver 534 may send a message that includes location data 536 to enable the management devices 108, 110, the MDUs 106, or both to determine a location of the human 118.
In some implementations, each of the MDUs 106 may send, at a predetermined interval (e.g., every M milliseconds, where M>0) a query message 538 (e.g., “continue operating?”) to the safety management device 110. In response to receiving the query message 538, the safety management device 110 may send a response message to individual ones of the MDUs 106. For example, when the safety management device 110 determines that no human is present, the response message may be an activity message 540 that instructs an MDU to continue performing a set of activities. When the safety management device 110 determines that a human is present, the response message may be a stop message 542 that instructs an MDU to temporarily (e.g., while the human 118 is present) stop performing any physical activities, or the response message may be a slow speed message 544 that instructs an MDU to temporarily (e.g., while the human 118 is present) reduce a speed of the MDU when navigating to a new location. Other response messages when a human is present are also possible, e.g., a response message that instructs an MDU to navigate away from the human 118, or combinations of the various response messages when a human is present.
The query message 538 may include an identifier 546 that uniquely identifies each query message that the safety management device 110 receives from each MDU. For example, the identifier 546 may include an identity of the MDU 106 that is sending the query message 538 and a timestamp that includes a date and time that the query message 538 was created. If the query message 538 includes the identifier 546, the response message (e.g., one of the messages 540, 542, or 544) sent by the safety management device 110 may include the identifier 546 to identify the response message as corresponding to a particular query message. If a particular MDU of the MDUs 106 fails to receive a response message that includes the identifier 546 of a most recently sent query message, the particular MDU may stop performing any physical activities until a response message including the identifier 546 is received, and/or one of the management devices 108, 110 instructs the particular MDU otherwise.
In other implementations, the MDUs 106 may not send the query message 538. When no human is detected, the safety management device 110 may periodically broadcast (e.g., send) the activity message 540 to the MDUs 106 to instruct each of the MDUs 106 to perform (or continue performing) a set of activities. In response to detecting the presence of the human 118, the safety management device 110 may stop sending the activity message 540 to the MDUs 106 and/or instead periodically broadcast the stop message 542, the slow speed message 544 or other appropriate messages when a human is present. After determining that the human 118 has left the area in which the MDUs 106 were performing activities, the safety management device 110 may resume broadcasting the activity message 540 to the MDUs 106 to instruct the MDUs 106 to resume performing the set of activities and/or perform a different set of activities.
As previously mentioned, if one of the MDUs 106, such as MDU 106(1), fails to receive the activity message 540, the MDU 106(1) may cease performing any physical activity until the MDU 106(1) receives the activity message 540. For example, in situations where the network 105 malfunctions, the MDUs 106 move to a location where commands from the operational management device 108 and/or the safety management device 110 cannot be received, or other situations where the MDUs 106 do not receive the activity message 540, the MDUs 106 may cease performing any physical activity until the activity message 540 is received, and/or until instructed otherwise. Thus, the activity message 540 may serve as a “heartbeat” such that if the MDUs 106 do not detect the heartbeat (e.g., receive the activity message 540), then the MDUs 106 may perform a default action, such as ceasing to perform any physical activity. The MDUs 106 may resume performing a set of actions when the MDUs 106 resume periodically receiving the activity message 540.
Thus, the MDUs 106 may perform a set of activities in an area (or zone) when they periodically receive the activity message 540 from the safety management device 110 instructing them to perform the set of activities. If the safety management device 110 detects the human 118 in the area (or zone), the safety management device 110 may determine a distance of each of the MDUs 106 from the human 118 and send the stop message 542 or the slow speed message 544 (or other messages) to each of the MDUs 106, e.g., based on the distance. The MDUs 106 may cease performing any physical activity if the MDUs 106 do not periodically receive the activity message 540.
Each of the MDUs 106(1) through 106(N) may include an imaging device, such as a scanner 604, that is capable of scanning (e.g., reading) the identifiers 602. Each time a particular one of the MDUs 106 passes by or over one of the identifiers 116, the scanner 604 may scan one of the identifiers 602 and send MDU location data 606 to the management devices 108, 110. For example, the MDU location data 606 may include a unique identifier provided by each of the identifiers 602. The management devices 108, 110 may determine a location of each of the MDUs 106 after receiving the MDU location data 606. For example, MDU 106(1) may send the MDU location data 606 that includes the identifier 602(1) associated with the identifier 116(1). The management devices 108, 110 may receive the MDU location data 606, determine that the identifier 602(1) is associated with the identifier 116(1), and determine a location of the identifier 116(1) to determine the location of the MDU 106(1).
Each human, such as the human 118, in an area (e.g., the area 102) may wear the locator device 120 that includes an imaging device, such as a scanner 608, that is capable of scanning (e.g., reading) the identifiers 602. Each time the human 118 passes near one of the identifiers 116, the scanner 608 may scan one of the identifiers 602 and send the location data 536 to the management devices 108, 110. For example, the location data 536 may include a unique identifier provided by one of the identifiers 602. The management device 108 may determine a location of the human 118 after receiving the location data 536. For example, the human 118 may send the location data 536 that includes the identifier 602(1) associated with the identifier 116(1). The management devices 108, 110 may receive the location data 536, determine that the identifier 602(1) is associated with the identifier 116(1), and determine a location of the identifier 116(1) to determine the location of the human 118.
The scanners 604, 608 (e.g., imaging devices) may be designed to scan each of the identifiers 602 of the identifiers 116. For example, when the identifiers 602 are optically scannable or readable, the scanners 604, 608 may be cameras or another type of imaging device. When the identifiers 602 are RFID tags, the scanners 604, 608, may be RF scanners (e.g., RFID readers).
Thus, identifiers, such as fiducial markers, where each fiducial marker has a unique corresponding identifier, may be used to determine a location of the MDUs 106, the human 118, or both. The location data 536 may enable the management devices 108, 110 to determine when the human 118 is in or near an area 102 in which the MDUs 106 are performing a set of activities. In response to determining that the human 118 is in or near the area 102, the management devices 108, 110 may send one or more commands 610 instructing the MDUs 106 to temporarily cease performing the set of activities. The one or more commands 610 may instruct the MDUs 106 to move to a new location, cease performing any activity, navigate away from the human, or any combination thereof. In response to detecting that the human 118 is no longer in or near the area (e.g., at least a predetermined distance from the area), the management devices 108, 110 may send additional commands instructing the MDUs 106 to resume performing the set of activities and/or perform a different set of activities.
In some situations, the management devices 108, 110 may send directions 612 to the human 118. For example, the human 118 may be unfamiliar with the layout of an area and the management devices 108, 110 may send the directions 612 to enable the human 118 to reach a particular location (e.g., a safe zone), to avoid a zone in which MDUs are performing activities, to exit an area to enable the MDUs to resume performing activities, etc. The directions 612 may include text messages to be displayed on a mobile communication device or on the locator device 120 associated with the human 118. The directions 612 may include multimedia (e.g., audio, video, or both) files to be played back on a mobile communication device or on the locator device 120 associated with the human 118.
The locator device 120 may include one or more processors 704 (or another type of logic execution mechanism) and one or more memory devices, such as computer readable media 706, to store instructions 708 that are executable by the one or more processors 704 (or logic) to perform the functions of the locator device 120. The locator device 120 may periodically send (e.g., broadcast) the presence data 702.
In some cases, in response to detecting the presence data 702, one or more of the MDUs 106 may notify the management device 108 that a human is present while in other cases one of the MDUs 106 may notify other MDUs 106 that a human is present. For example, the MDU 106(1) may receive the presence data 702 and determine that the human 118 is in or near an area in which the MDUs 106 are performing a set of activities. In response, the MDU 106(1) may (i) send a message to the management device 108 indicating that the human 118 is in or near the area, (ii) send a message to the other MDUs 106 (e.g., MDU 106(2) to MDU 106(N)) indicating that the human 118 is in or near the area, or both. In response to receiving the message from the MDU 106(1) indicating that the human 118 is in or near the area, the management device 108 may send a message to the other MDUs 106 (e.g., MDU 106(2) to MDU 106(N)) indicating that the human 118 is in or near the area.
Thus, an MDU may detect the presence of a human using presence data broadcast by a locator device that is worn by the human. The MDU may notify other MDUs of the presence of the human and/or the MDU may notify a management device and the management device may notify the other MDUs that the human is present in the area. In response to being notified of the presence of the human in the area, the MDUs may temporarily cease performing a set of activities, move to a new location, cease performing any activity, reduce speed, navigate away from the human, or any combination thereof. The MDUs may resume performing the set of activities (or perform a different set of activities) after receiving a message from a particular management device that the human is no longer in the area (e.g., the human is at least a predetermined distance from the area).
Example Processes
In the flow diagrams of
At 802, a query message may be received from individual mobile drive units (of one or more mobile drive units) requesting permission to continue performing a set of activities in a physical area. For example, in
At 804, one or more drive unit locations corresponding to one or more mobile drive units may be determined. For example, in
At 806, an activity message may be sent to the individual mobile drive units instructing the individual mobile drive units to continue performing the set of activities. For example, in
At 808, if a human is detected at a first location within the physical area, a stop message is sent to at least a first mobile drive unit that is within a first distance from the human. For example, in
At 810, a slow speed message may be sent to at least a second mobile drive unit that is within a second distance from the human. For example, in
At 812, if the human moves to a second location within the physical area, a stop message is sent to at least a third mobile drive unit that is within the first distance from the human. For example, in
At 814, if the human moves to a third location that is outside the physical area, the activity message is sent to the one or more mobile drive units. For example, in
At 902, a request may be received to create a fixed zone inside an area in which mobile drive units are performing a set of activities. For example, in
At 904, the mobile drive units may be instructed to place physical barriers around a perimeter of the fixed zone. For example, in
At 906, the mobile drive units may be instructed to place transmitters around a perimeter of the fixed zone. For example, in
At 908, the mobile drive units may be instructed to avoid entering a portion of the area that includes the fixed zone. For example, in
At 910, the mobile drive units may be instructed to remove the physical barriers from the perimeter of the fixed zone or remove or turn off the transmitters if a human is no longer present in the fixed zone 302 and/or the fixed 302 is no longer needed. For example, in
At 912, the mobile drive units may be instructed to resume performing the set of activities in the area. For example, in
Conclusion
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as illustrative forms of implementing the claims.
This application is a continuation of and claims priority to U.S. application Ser. No. 14/472,717, filed on Aug. 29, 2014, now U.S. Pat. No. 9,927,797 issued on Mar. 27, 2018, and entitled “Safety Compliance for Mobile Drive Units,” the entirety of which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
20040111295 | Crane | Jun 2004 | A1 |
20040148039 | Farchmin et al. | Jul 2004 | A1 |
20050171637 | Tani et al. | Aug 2005 | A1 |
20060161303 | Wang et al. | Jul 2006 | A1 |
20090043440 | Matsukawa et al. | Feb 2009 | A1 |
20100114373 | Hale et al. | May 2010 | A1 |
20100222954 | Ichinose | Sep 2010 | A1 |
20110093134 | Emanuel et al. | Apr 2011 | A1 |
20110121068 | Emanuel et al. | May 2011 | A1 |
20110184558 | Jacob et al. | Jul 2011 | A1 |
20110264266 | Kock | Oct 2011 | A1 |
20120143427 | Hoffman | Jun 2012 | A1 |
20120166034 | Wragg | Jun 2012 | A1 |
20120327190 | Massanell et al. | Dec 2012 | A1 |
20130245821 | Nakamura et al. | Sep 2013 | A1 |
20140067121 | Brooks et al. | Mar 2014 | A1 |
20140277691 | Jacobus | Sep 2014 | A1 |
20140277723 | Nishimura et al. | Sep 2014 | A1 |
20140277724 | Suyama et al. | Sep 2014 | A1 |
20140277725 | Kouno et al. | Sep 2014 | A1 |
20140350725 | LaFary et al. | Nov 2014 | A1 |
20150273697 | Abdullah | Oct 2015 | A1 |
20160062345 | Stubbs et al. | Mar 2016 | A1 |
Number | Date | Country |
---|---|---|
2639019 | Sep 2013 | EP |
WO2006065563 | Jun 2006 | WO |
Entry |
---|
Office Action for U.S. Appl. No. 14/472,717, dated Dec. 2, 2016, Ward et al., “Safety Compliance for Mobile Drive Units”, 20 pages. |
Office Action for U.S. Appl. No. 14/472,717, dated Jul. 3, 2017, Ward et al., “Safety Compliance for Mobile Drive Units”, 25 pages. |
The PCT Search Report and Written Opinion dated Dec. 9, 2015 for PCT application No. PCT/US2015/047024, 10 pages. |
Number | Date | Country | |
---|---|---|---|
20180181104 A1 | Jun 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14472717 | Aug 2014 | US |
Child | 15901206 | US |