Not Applicable.
For particular environments of use, some material handling vehicles employ object detection systems. An object detection system as applied to a material handling vehicle is a supplemental system that scans for the presence of objects within the field of view of the object detection system, and can control travel speed or other travel characteristics as a function of objects detected in the path of the material handling vehicle. A supplemental system such as an object detection system can serve as a training reinforcement and supervisory tool.
For certain types of vehicles that are manually operated, there are training requirements imposed by various government agencies, laws, rules and regulations. For example, the United States Department of Labor Occupational Safety and Health Administration (OSHA) imposes a duty on employers to train and supervise operators of various types of material handling vehicles. Recertification every three years is also required. In certain instances, refresher training in relevant topics shall be provided to the operator when required. In all instances, the operator remains in control of the material handling vehicle during performance of any actions. Further, a warehouse manager remains in control of the fleet of material handling vehicles within the warehouse environment.
The present disclosure relates generally to material handling vehicle travel control, and, more specifically, to systems and methods for material handling vehicle travel control based on intrinsic aspects of the material handling vehicle and the material handling vehicle's object detection system.
In some aspects, a travel control system can augment a supplemental object detection system of a material handling vehicle. The system can include a material handling vehicle, a steer angle sensor, a speed sensor, a motor control unit, and a processor. The processor can be operatively connected to the steer angle sensor, the speed sensor, and the motor control unit. The processor can be configured to determine, based on intrinsic information of the material handling vehicle, a first speed limit associated with a first breakpoint angle. The processor can receive, from the steer angle sensor, a first steer angle. The processor can receive, from the speed sensor, a first vehicle speed. When the first steer angle exceeds the first breakpoint angle, and the first speed exceeds the first speed limit, the processor can generate a signal to the motor control unit to decrease a speed of the material handling vehicle.
In some aspects, a method in a computer-implemented system for controlling travel of a material handling vehicle, can include receiving at a control system of the material handling vehicle, intrinsic aspects of the material handling vehicle. Based on the intrinsic aspects of the material handling vehicle and a configuration of a scanner mounted on the material handling vehicle at least one speed limit associated with at least one steering angle range of the material handling vehicle can be determined. The control system can receive a speed of the material handling vehicle. The control system can further receive a current steering angle of the material handling vehicle. When the current steering angle is within the at least one steering angle range and the current speed exceeds the at least one speed limit associated with the at least one steering angle range, a signal can be generated to a motor control unit to reduce a speed of the material handling vehicle.
In some aspects, a computerized control system for a material handling vehicle can comprise an object detection system of the material handling vehicle. The material handling vehicle can include at least one scanner having a field of view defined between a first boundary and a second boundary. The material handling vehicle can further include a motor control unit, one or more processors, and a memory storing one or more programs for execution by the one or more processors. The one or more programs can include instructions for performing a method for controlling a travel of the material handling vehicle. The method can include receiving at the one or more processors a current speed of the material handling vehicle and a current steering angle of the material handling vehicle. Based at least in part on the current speed and current steering angle, a stopping distance of the material handling vehicle can be determined. The method can determine if the stopping distance is within the scanner field of view. If the stopping distance is outside of the scanner field of view, a signal can be generated to the motor control unit to reduce a speed of the material handling vehicle.
The foregoing and other aspects and advantages of the disclosure will appear from the following description. In the description, reference is made to the accompanying drawings which form a part hereof, and in which there is shown by way of illustration a preferred configuration of the disclosure. Such configuration does not necessarily represent the full scope of the disclosure, however, and reference is made therefore to the claims and herein for interpreting the scope of the disclosure.
The invention will be better understood and features, aspects and advantages other than those set forth above will become apparent when consideration is given to the following detailed description thereof. Such detailed description makes reference to the following drawings.
Before any aspects of the invention are explained in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The invention is capable of other aspects and of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless specified or limited otherwise, the terms “mounted,” “connected,” “supported,” and “coupled” and variations thereof are used broadly and encompass both direct and indirect mountings, connections, supports, and couplings. Further, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings.
The following discussion is presented to enable a person skilled in the art to make and use embodiments of the invention. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the generic principles herein can be applied to other embodiments and applications without departing from embodiments of the invention. Thus, embodiments of the invention are not intended to be limited to embodiments shown but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of embodiments of the invention. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of embodiments of the invention.
It is also to be appreciated that material handling vehicles are designed in a variety of classes and configurations to perform a variety of tasks. It will be apparent to those of skill in the art that the present disclosure is not limited to any specific material handling vehicle, and can also be provided with various other types of material handling vehicle classes and configurations, including for example, lift trucks, forklift trucks, reach trucks, SWING REACH® vehicles, turret trucks, side loader trucks, counterbalanced lift trucks, pallet stacker trucks, order pickers, transtackers, and man-up trucks, and can be commonly found in warehouses, factories, shipping yards, and, generally, wherever pallets, large packages, or loads of goods can be required to be transported from place to place. The various systems and methods disclosed herein are suitable for any of operator controlled, pedestrian controlled, remotely controlled, and autonomously controlled material handling vehicles.
Embodiments of the disclosure can include an object sensing system to provide onboard object sensing to the material handling vehicle. The object sensing system can add support for and reinforce operator training and supervision on a manned material handling vehicle. The object sensing system can include an onboard object sensing unit and a processing unit to initiate material handling vehicle operator indications as training reinforcement and potentially controlling material handling vehicle functionality under defined operating conditions. In some embodiments, the processing unit can comprise a telematics system, for example the iWAREHOUSE® material handling vehicle fleet management system from The Raymond Corporation.
The object sensing system can serve as a training reinforcement tool to among other things provide notice regarding a material handling vehicle's proximity to other objects that is consistent with customer facility rules in the warehouse environment. It is not intended as a replacement for the training requirements that an operator always look in the direction of travel, be aware of his or her proximity to other objects at all times, assume and maintain a proper operator position and follow various aspects of their operator training.
The object sensing system can use a scanner (can also be referred to as a sensor) to detect objects within a warehouse, e.g., within an aisle and outside of aisles of a warehouse, while the material handling vehicle is traveling in the tractor first direction, and in some embodiments, while the material handling vehicle is traveling in the fork first direction. If an object is detected, the material handling vehicle equipped with the object sensing system can provide an indication to the operator, such as displaying “Sensor Stop” on the material handling vehicle operator display, an audible tone can sound, and/or a haptic feedback can be initiated, or any combination. The indication(s) to the operator can be provided in a multi-tiered fashion, e.g., first a message can be displayed, then an audible tone can sound, and next a haptic feedback can be initiated. One or more of these indications to the operator can be initiated allowing the operator to initiate a material handling vehicle command to decelerate to a slower speed, or to a stop depending on the distance to the detected object, and if neither occurs, then the material handling vehicle will systematically be put in a similar state (slow or stop). If the material handling vehicle slows or stops, not all indications to the operator may be initiated. For example, if the material handling vehicle slows or stops before the haptic feedback is provided, the haptic feedback may not be provided to the operator. The operator will maintain full control of the material handling vehicle equipped with object sensing system at all times.
In some embodiments, a warehouse management system, or a facilities manager, in exercising their duty to supervise operation of their forklift fleet, may be able to adjust the functionality of the object sensing system to meet operational conditions resident in their facility. For example, the facilities manager could set a minimum and a maximum desired speed for use by the object sensing system when the object sensing system is sensing an object to initiate a slower travel condition.
In some embodiments, the scanner can be a two dimensional scanner. In some embodiments, the scanner can have more than one sensing field. In some embodiments, more than one scanner can be included to provide more than one sensing field. Thus, the scanner can be a first scanner, and the object sensing system can further include a second scanner, a third scanner, or any number of scanners to achieve a desired combined field of view for the object sensing system. In some embodiments, a three dimensional scanner can be used. In some embodiments, a spatial scanner can be used. Each of the various scanner options can be used in any combination and can allow the scanner or scanners to be configured using scanner supplier supported software tools.
In some embodiments, the object sensing system can implement various scanner types, including R2100 (Multi-Ray LED Scanner (2-D LiDAR sensor)), SICK TIM 781-2174101 2-D LiDAR sensor or similar, and Radar, as non-limiting examples. In some embodiments, the object sensing system using any of the exemplary scanner types identified above, can support the rPORT™ technology from The Raymond Corporation, which allows for an open architecture with a standardized interface. In other embodiments, a discrete I/O implementation can also be used.
In some embodiments, raw data of the object sensing system can be processed to produce granularity that can improve an accuracy and performance of the object sensing system, relative to conventional scanner systems. This can provide a more robust object sensing system relative to conventional systems that can rely on processing systems provided by a vendor of a scanner. For example, a field of view, the disclosed scanner can sense fields correlating to a speed from 0 to 9 miles per hour in tenth of a mile intervals and can scan sections of the field of view in an interval of hundredths of a degree. Thus, fields can be generated for a scanner to more accurately sense an object, and the number of possible fields can be the product of the number of angular sections in hundredths of degrees of the viewing angle, and the number of speed intervals (e.g., 10 times 9).
In addition to, or in place of possible placement of the scanner as shown in the various figures, the scanner(s) can be mounted in various locations on the material handling vehicle.
The present disclosure can function as training reinforcement for operator driven material handling vehicles. The present disclosure can function to augment the functionality of a supplemental object detection system on a manned or unmanned material handling vehicle by controlling components affecting vehicle travel based on intrinsic aspects of the material handling vehicle and/or the material handling vehicle operating environment. Intrinsic aspects of a material handling vehicle can include vehicle weight, vehicle height, vehicle width, drive wheel location, and non-drive wheel locations, as non-limiting examples. Intrinsic aspects of an object detection system on a material handling vehicle can include sensing range, sensing view angle, sensing height, shape of the detection zone, and physical position of the scanner, as non-limiting examples.
A travel control system can be integrated with the supplemental object detection system as an object detection augmentation, and can assist in controlling any combination of aspects of vehicle travel including speed, steer angle, load handling devices and attachments, and/or mast height, based on the intrinsic aspects of the object detection system on the material handling vehicle including sensing range, sensing view angle, sensing height, shape of the detection zone, and physical position of the scanner.
In some embodiments, the travel control system can make a distinction for a material handling vehicle pivoting on or about a point. The pivot behavior can be customizable to enable maneuverability with the travel control system.
The operator compartment 20 may include a control handle 22 configured to provide a user interface for an operator and to allow the operator to control a speed and direction of travel of the material handling vehicle 10. In some non-limiting examples, the control handle 22 may be configured to manually steer and control power to the traction wheel 14. In the illustrated non-limiting example shown in
The material handling vehicle 10 can be operated by an operator and can be capable of picking, placing, transporting, or otherwise manipulating a load, possibly including a pallet. In various examples, the operator controls the material handling vehicle 10 so that the forks 24 engage a pallet carrying a load. In so doing, the operator may extend or retract actuators (not shown) to pick, place, engage, or otherwise manipulate the load. Once the load is situated on the forks 24, the operator can move the load to another location as needed. In some non-limiting examples, a human operator may be replaced with an automated controller to comprise a fully-automated system (i.e., an autonomously guided material handling vehicle).
Material handling vehicles, including the material handling vehicle 10 illustrated in
The LiDAR scanner 114 may be housed within the lower portion 116, and the mounting plate 112 can provide a protective covering for the scanner 114. As illustrated in
In other embodiments, including as illustrated in
When a trajectory of the material handling vehicle changes, as, for example, when the steering angle changes, a field of view of an object detection sensor or scanner of the vehicle may change. In some instances, when a steering angle of a material handling changes, this change can bring a previously undetected object into a path of the material handling vehicle, and, in some instances, absent system correction, the material handling vehicle may be travelling too quickly to avoid contact with the undetected object. Further, when a field of view changes, an object detection system may require an amount of time to scan the new field of view for objects that may impede travel. Thus, systems can be provided for a material handling vehicle that can limit a speed of the material handling vehicle in response to a change in trajectory, to mitigate possible contact with previously undetected objects.
At step 204, properties of a material handling vehicle can be obtained. Information obtained at step 204 can include physical properties of the material handling vehicle 100, and can be used to determine speed limits, allowed and disallowed paths of the material handling vehicle 100 for different dynamic conditions, such as a steer angle or range of steering angles. For example, the information can include intrinsic aspects of the material handling vehicle 100, which can include vehicle weight, vehicle height, vehicle width, drive wheel location, and non-drive wheel locations, as non-limiting examples. This information can be received at a processor 152 of control system 150 of the material handling vehicle and used to calculate maximum speed limits for different conditions of operation of the material handling vehicle.
As illustrated in
In some embodiments, communications systems 158 can include any suitable hardware, firmware, and/or software for communicating information over communication network 302 and/or any other suitable communication networks. For example, communications systems 158 can include one or more transceivers, one or more communication chips and/or chip sets, etc. In a more particular example, communications systems 158 can include hardware, firmware and/or software that can be used to establish a Wi-Fi connection, a Bluetooth connection, a cellular connection, an Ethernet connection, etc.
In some embodiments, memory 160 can include any suitable storage device or devices that can be used to store instructions, values, etc., that can be used, for example, by processor 152. Memory 160 can include any suitable volatile memory, non-volatile memory, storage, or any suitable combination thereof. For example, memory 160 can include random access memory (RAM), read-only memory (ROM), electronically-erasable programmable read-only memory (EEPROM), one or more flash drives, one or more hard disks, one or more solid state drives, one or more optical drives, etc. In some embodiments, memory 260 can have encoded thereon a computer program for controlling operation of material handling vehicle 100, including by implementing all or part of the travel control system 200 illustrated in
In some embodiments, sensing elements and control units of the material handling vehicle can be operatively included in the control system 150. For example, a control system 150 can include steer angle sensors 164 for sensing a current steer angle of the vehicle, and the steer angle sensor 164 can produce a signal indicative of a steer angle which can be provided to the processor 152. In some embodiments, the steer angle can be sensed through a sensor 164 at a steering element (e.g., control handle 22 of material handling vehicle 10). The sensor 164 can be any sensor known in the art for measuring a steering angle of a vehicle, which in some non-limiting examples can include gyroscopes or accelerometers. In other embodiments, a steer angle can be calculated from an orientation of the material handling vehicle 100, which can be obtained through visual sensors, such as cameras, for example. Speed sensors 162 can also be provided for the material handling vehicle to sense a speed and communicate the speed to the processor 152. The speed sensor 162 can be any sensor known in the art for measuring a speed of a vehicle, including, but not limited to accelerometers or gyroscopes. A motor control unit 166 can be provided in the control system 150. The motor control unit 166 can be in communication with the processor 152 and can reduce a speed of a motor of the material handling vehicle 100 or set a limit on the speed of the material handling vehicle 100 based on a signal received from 152.
The elements of the control system 150 can communicate using standardized communication protocols. For example, the elements of a control system 150 can communicate over a controller area network (“CAN”) bus 168, which can provide for communication between elements without the need for specific wired connections between each element in communication with other elements of the control system 250. Messages can be provided from a given element to the CAN 168, which each of the other elements are connected to, and the messages can be of a format to be consumed by the element for which it is intended. Thus, signals between elements, for example signals from the scanner 114 to the processor 152, or from the processor 152 to the motor control unit 166 can be contained in a message provided on the CAN bus 168.
In some embodiments, the control system 150 can be operatively connected to computing device 304 through a communication network 302. In some embodiments, the communications network 302 can be a local area network, a wide area network, etc. The computing device 304 can include processor 306, display 308, inputs 310, communication system 312, and memory 314 which can be similar to the corresponding components of control device 150. The memory 314 can include persistent memory which can store information about a material handling vehicle (e.g., material handling vehicle 100) or multiple material handling vehicles. Upon a request (e.g., a request received at communication system 312), the computing device 304 can return the information to the control system 150 of material handling vehicle 100 for use in object detection systems of the material handling vehicle 100. This information can be provided to the processor 152 directly via the CAN bus 168. Additionally or alternatively, the information can be provided from the communication system 158 to the memory 160 through messages sent on the CAN bus 168.
Referring back to
Referring again to
Speed limits for a material handling vehicle can be generated for certain dynamic conditions of the material handling vehicle, including steer angle. Although limiting the speed of a material handling vehicle can increase vehicle path travel time, the speed limit can allow a scanner (e.g., scanner 114) enough time to react to an object during a steering maneuver. As illustrated in the input-output diagram of
The material handling vehicle dynamics model input at 352 can include the material handling information obtained at step 204 of the travel control system 200. For example, determining a speed limit for a given steering angle can require calculating a path of the vehicle, to determine a probability of a portion of the material handling vehicle contacting an object.
Referring to
The dimensions of the material handling vehicle 100 can be combined with other aspects of the material handling vehicle 100 in a dynamics model for calculating a speed limit for the material handling vehicle for a given steering angle or range of steering angles. In some embodiments, a speed limit for a given steering angle can be determined in part based on a stopping distance for a given trajectory. In this regard,
In some embodiments, the scanner location, field of view, and range can also be used as an input in determining speed limits for a material handling vehicle. In this regard,
Referring back to
In some embodiments, a speed limit calculated for speed in steer algorithm 350 can be calculated according to a series of equations that can use the inputs 352, 354, 356, 358. For example, a first equation or set of equations representing the travel paths of points 140, 144 along the arcs of concentric circles can have a general form R{circumflex over ( )}2. The combined scanner view angle A can be constrained in a second equation or set equations, which can include one or more linear equations. Solving for the first equation and inserting the results into the second equation can produce a third equation, which is a quadratic equation. Aspects of the third equation can represent the intersect point of the travel path and scanner view angle (e.g., scanner view angles A and/or B). A fourth equation can represent a line drawn from the material handling vehicle reference location to the intersect point with a boundary (e.g., boundaries 126, 128), with the magnitude or length of the line representing the derived stopping distance for a given steer angle. The stopping distance (e.g., a distance from the material handling vehicle 100 to stopping distance 172) can be expressed in a fifth equation, which is in the form of quadratic equation. Aspects of the fifth equation can represent a material handling vehicle speed limit for a given steer angle.
As shown in
In some embodiments, a speed limit table of a travel control system can include speed limits that are associated with specific maneuvers of a material handling vehicle, and these speed limits can be static, rather than being generated by an algorithm (e.g., algorithm 350). For example, two frequent steering maneuvers include right angle turns (i.e., a 90 degree turn), and a pivot (e.g., a 180 degree), as illustrated in
Referring back to
At step 212, a speed and steer angle of material handling vehicle 100 can be sampled at a given time interval. The speed can be obtained from sensors of a material handling vehicle, which can include, for example, accelerometers, gyroscopes, or some other sensing devices known to those of ordinary skill in the art. The speed and steer angle of a material handling vehicle (e.g., material handling vehicle 100, 10) can be sampled or obtained at set time intervals. In some non-limiting examples, speed and steer angle can be sampled, once per millisecond, or once every 10 milliseconds, or once every 100 milliseconds, once every second, or once every 5 seconds, or once every 10 seconds. In other embodiments, the speed and steer angle of a material handling vehicle can be sampled upon completion of steps 214, 216, 218, and 220. In some embodiments, a polling or sampling interval can be configured by a user.
At step 214, the travel control process can evaluate whether the speed of the material handling vehicle 100, obtained at step 212, exceeds the speed limit generated at step 208 for the current steer angle of the material handling vehicle. When the speed of the material handling vehicle 100 exceeds the speed limit for the current steer angle of the material handling vehicle, a speed of the material handling vehicle can be reduced at step 216. Reducing the speed of the material handling vehicle can reduce the risk of contact with an object, as described above, and can also be beneficial in providing additional time for the scanner to adjust to the changed angle of the material handling vehicle 100, and scan for additional potential objects in the path of the material handling vehicle 100. The speed of the material handling vehicle 100 can be reduced by a predetermined increment (e.g., 0.1 mph) which can slow the material handling vehicle 100 without producing an unnecessarily uncomfortable change in acceleration, or deceleration. For example, using the representative speed limit table above, as the material handling vehicle 100 is traveling at 5 mph and steers beyond the +/−10 degree breakpoint, the travel control system 200 can bring the material handling vehicle 100 to the next speed set point (e.g., 4 mph) in predetermined increments, e.g., 0.1 mph, therefore expanding the viewing range of the object sensor system. If the operator continues to steer and increases the steer angle, the travel control system 200 can continue to adjust the material handling speed within the speed limit table ranges to maintain maximum viewing range. In some embodiments, including as shown in
If the speed of the material handling vehicle is beneath a speed limit for the given steer angle, the system analysis can be completed at step 218, and normal operation of the material handling vehicle 100 can resume at step 220. Normal operation can include unrestricted operation, for example, where the system is not reducing a speed of the material handling vehicle 100 or otherwise overriding operating parameters of the material handling vehicle 100.
In some embodiments, operation of the material handling vehicle 100 can be halted or paused if the system encounters an error 222 and a step cannot be completed. For example, as shown in
While various spatial and directional terms, such as top, bottom, lower, mid, lateral, horizontal, vertical, front, and the like may be used to describe examples of the present disclosure, it is understood that such terms are merely used with respect to the orientations shown in the drawings. The orientations may be inverted, rotated, or otherwise changed, such that an upper portion is a lower portion, and vice versa, horizontal becomes vertical, and the like.
Within this specification, embodiments have been described in a way which enables a clear and concise specification to be written, but it is intended and will be appreciated that embodiments may be variously combined or separated without parting from the invention. For example, it will be appreciated that all preferred features described herein are applicable to all aspects of the invention described herein.
Thus, while the invention has been described in connection with particular embodiments and examples, the invention is not necessarily so limited, and that numerous other embodiments, examples, uses, modifications and departures from the embodiments, examples and uses are intended to be encompassed by the claims attached hereto. The entire disclosure of each patent and publication cited herein is incorporated by reference, as if each such patent or publication were individually incorporated by reference herein.
Various features and advantages of the invention are set forth in the following claims.
This application is based on, claims priority to, and incorporates herein by reference in its entirety, U.S. Provisional Patent Application No. 63/195,125, filed on May 31, 2021, and entitled “Systems and Methods for Material Handling Vehicle Travel Control Based on Object Detection Systems.”
Number | Date | Country | |
---|---|---|---|
63195125 | May 2021 | US |