This disclosure is directed toward power machines. More particularly, this disclosure is directed to object detection and related arrangements of object detection devices for a power machine. Power machines, for the purposes of this disclosure, include any type of machine that generates power to accomplish a particular task or a variety of tasks. One type of power machine is a work vehicle. Work vehicles are generally self-propelled vehicles that have a work device, such as a lift arm (although some work vehicles can have other work devices) that can be manipulated to perform a work function. Work vehicles include loaders, excavators, utility vehicles, tractors, and trenchers, to name a few examples.
The discussion above is merely provided for general background information and is not intended to be used as an aid in determining the scope of the claimed subject matter.
According to some examples of the disclosure, object detection systems can be configured to monitor areas around a power machine to detect objects (e.g., static or moving entities or obstructions including pipes, barrels, poles, spoil piles, trees or stumps, rocks, other power machines or equipment, etc.). Operation of the power machine can then be automatically controlled based on the detected objects. In particular, some examples include one or more radar sensors or other object detection sensors that are configured to monitor an area that is opposite a primary lift arm, implement interface, or other work element of a power machine. Accordingly, automatic travel toward the monitored area ― i.e., in a direction that is generally opposite the primary lift arm, implement interface, or other work element ― can be controlled based on detection of objects by the sensor(s). In some cases, the monitored area and a corresponding direction of automatic travel of the power machine can be in a rearward direction for the power machine, relative to a default orientation of an operator station or other reference frame. In some cases, travel in such a direction can correspond to a primary path of automatic travel for the power machine.
According to some aspects of the disclosure, a power machine can include a main frame, and a lift arm pivotally secured to the main frame, the lift arm extending in a first direction away from main frame in a fully lowered configuration so that an implement interface secured to the lift arm is spaced apart from the main frame in the first direction. An object detection system can include an object detection sensor mounted to the power machine. The object detection sensor can be configured to monitor a detection zone for objects along a path of automatic travel that extends in a second direction that is opposite the first direction. A control device can be configured to execute automatic travel operations for the power machine based on signals from the object detection sensor.
In some examples, a sensor can be mounted to a movable tailgate of a power machine. A power machine can include a tailgate position sensor and a control device can be configured to execute automatic travel operations based on the tailgate position sensor sensing a current position of the movable tailgate. In some examples, a sensor can be mounted to a bumper of the power machine.
In some examples, a detection zone can extend from an apex of the detection zone located at the object detection sensor, along and around an object detection sensor axis extending from the apex. A cross-section of the detection zone at any of a plurality of locations along the object detection sensor axis can define a corresponding shape with a lower boundary. A sensor can be mounted to the power machine so that, with the power machine on level ground, a line extending from the apex through a plurality of the lower boundaries extends parallel with the level ground. In some examples, a sensor detection zone can form an elliptical cone. In some examples, with the power machine on level ground, a line extending from an apex through a plurality of lower boundaries of cross-sections of detection zones can be between 20 inches and 30 inches above the level ground.
In some example, the object detection sensor can be a first object detection sensor defining a first detection zone that extends from a first apex at the first object detection sensor, along and symmetrically around a first axis extending from the first apex. A power machine can include a second object detection sensor mounted to the power machine, the second object detection sensor defining a second detection zone that extends from a second apex at the second object detection sensor, along and symmetrically around a second axis, the second object detection sensor being configured to monitor a second detection zone for objects along the path of automatic travel in the second direction. A control device can be further configured to execute automatic travel operations for the power machine based on signals from the second object detection sensor.
In some examples, a first detection zone can overlap with a second detection zone. In some examples, at least one of a first detection-zone axis or a second detection-zone axis can extend at an oblique angle relative to a path of automatic travel. In some examples, the oblique angle can be about 15 degrees. In some examples, the first and second detection zones can collectively define opposed lateral boundaries of an object detection system, the opposed lateral boundaries extending outwardly from a main frame of a power machine, obliquely to a path of automatic travel.
In some examples, the object detection sensor can be a radar sensor. In some examples, a power machine can further include an ultrasonic sensor configured to detect obstacles in a non-detection zone for the radar sensor.
According to some aspects of the disclosure, a control system for a power machine can include an object detection sensor configured to monitor a detection zone for objects along a primary path of travel (e.g., automatic travel) that extends from the power machine in a first direction that extends opposite a primary implement interface of the power machine. A control device can be configured to execute operations including: when the power machine is moving or is commanded to move in the first direction, receiving signals from the object detection sensor that indicate detected objects in the detection zone; and providing an indication of the detected objects to an operator of a power machine.
In some examples, the control device can be further configured to control the travel of a power machine along a primary path of travel based on received signals from an object detection sensor that indicate detected objects. In some examples, the control of the travel of the power machine based on the received signals includes selective operation of the power machine in any one of a plurality of operating modes. The plurality of operating modes can include at least one of: a first operating mode that includes, based on the received signals that indicate the detected objects, reducing a current power machine speed relative to a commanded speed or relative to a maximum possible power machine speed; or a second operating mode that includes, based on the received signals that indicate the detected objects, causing the power machine to stop movement along the primary path of automatic travel.
In some examples, control of travel of a power machine based on received signals that indicate detected objects can include operation in a first operating mode that includes, based on the received signals that indicate the detected objects, reducing a current power machine speed relative to a commanded speed or relative to a maximum possible power machine speed. The reduction of the current power machine speed can be non-linear relative to changes in distance between the power machine and one or more of the detected objects.
In some examples, a control device can be further configured to provide an indication of detected objects by providing one or more of an auditory alert, a visual-display alert, or a tactile alert to the operator of the power machine, corresponding to at least one of the detected objects.
In some examples, a control system can include an object detection display. A control system can be configured to provide an indication of detected objects to an operator by providing a visual representation on the object detection display of a location and a distance of one or more of the detected objects relative to the power machine.
In some examples, a range of object detection for the object detection sensor can be controllable by an operator.
According to some aspects of the disclosure, a method is provided for method of controlling a power machine with an implement interface. The power machine can be automatically moved along a direction of travel opposite the implement interface. An object detection sensor can monitor for objects within a detection zone that extending in the direction of travel. If an object is detected in the detection zone, as indicated by the object detection sensor, the power machine can be automatically operated in an object-detected mode, including automatically controlling travel of the power machine along the direction of travel based on further monitoring of the object using the object detection sensor.
In some examples, operating a power machine in an object-detected mode can include automatically reducing a travel velocity of the power machine based on the detected object. In some examples, operating an object-detected mode can include automatically stopping the power machine based on detecting the detected object.
In some examples, operating a power machine in an object-detected mode can be overridden based on one or more of an actual travel speed or a commanded travel speed of the power machine being at or below a speed threshold. In some examples, the speed threshold can be 25% of a maximum power machine speed, or 10% of a maximum power machine speed.
According to some aspects of the disclosure, a control system for a power machine can include an object detection sensor configured to monitor a detection zone for objects along a primary path of travel. A control device can be configured to execute operations that include, when the power machine is moving or is commanded to move along the primary path of travel, receiving signals from the object detection sensor that indicate detected objects in the detection zone. The control device can also be configured to execute operations that include selecting an operational mode from among: a first operational mode configured slow the power machine to a stop when an object is detected in the detection zone; a second operational mode configured to slow but not stop the power machine when an object is detected in the detection zone; and a third operational mode configured to provide an alert to an operator of the power machine when an object is detected in the detection zone. The control device can also be configured to execute operations that include controlling the power machine during travel along the primary path of travel based on the received signals that indicate the detected objects and the selected operational mode.
In some examples, a control device can be further configured to determine, based on operator input, one or more of: a deceleration profile for first or second operational modes; or a minimum stopping distance for a first operational mode.
According to some aspects of the disclosure, retrofit kit for a power machine, the kit can include a detection module, and a control module. The detection module can be configured to be removably secured to the power machine to detect objects around the power machine. The control module can be configured to be installed in electronic communication with the detection module and a display module. A power module can be configured to be removably engaged with a power connection of the power machine to receive power from a power source of a power machine to power one or more of the detection module or the control module. The control module can be configured to receive object data from the detection module and communicate with the display module based on the radar data to provide one or more indicators of an object detected by the detection module.
In some examples, a retrofit kit can include a display module configured to be removably installed on a power machine. A display module can include an LED module configured to provide a plurality of light signals corresponding to a position of the detected object relative to the power machine. An LED module can include a one-dimensional LED array, and a control module can be configured to illuminate one or more select LEDs along the one-dimensional LED array to indicate a lateral position of a detected object or a proximity distance of the detected object. In some examples, a control module can be configured to illuminate one or more select LEDs with selected one or more colors of a plurality of colors to indicate a proximity distance and to illuminate the one or more select LEDs at selected one or more location along the one-dimensional LED array to indicate a lateral position. In some examples, a control module can be configured to select one or more colors to indicate a proximity distance based on a rated speed of a power machine.
In some examples, a detection module can include a magnetic coupler to magnetically secure the detection module to the power machine.
According to some aspects of the disclosure, a control system for a power machine can include an object detection sensor arranged to monitor a detection zone for objects along a path of travel of the power machine. A control device can be configured to execute operations including, when the power machine is moving along the path of travel, receiving signals from the object detection sensor that indicate detected objects in the detection zone. The control device can be further configured to execute operations including selectively providing an alert to an operator of the power machine for one or more of the detected objects, including: determining, based on the received signals, a direction of movement of a plurality of detected objects relative to the power machine; and providing the alert for the one or more detected objects based on the determined direction.
In some examples, a control module can be configured to provide a first alert based on a determined one or more directions of movement for one or more detected objects corresponding to a decreasing distance between the one or more objects and a power machine and not to provide the first alert based on the determined one or more directions corresponding to an increasing distance between the one or more objects and the power machine.
According to some aspects of the disclosure, a method of retrofitting a power machine is provided. A detection module can be secured to the power machine, with the detection module aligned to detect objects along a direction of travel of the power machine in electronic communication with a control module. A power module can be installed to be engaged with a power connection of the power machine to receive power from a power source of a power machine to power one or more of the detection module or the control module. The detection module can be thus arranged in communication with the control module so as to provide signals corresponding to objects detected by the detection module, and the control module can be configured to provide to an operator of the power machine one or more indicators of an object detected by the detection module.
In some examples, a power module can be removably installed on a power machine. Removably installing a power module can include removably engaging the power module with an auxiliary power connector of the power machine.
In some examples, the detection module can be removably secured to the power machine. Removably securing a detection module to a power machine can include magnetically securing the detection module at a rear of the power machine.
In some examples, a method of retrofitting a power machine can include installing a display module on the power machine in electronic communication with a control module. In some examples, a display module can be removably installed on a power machine. In some examples, removably installing a display module can include removably installing a one-dimensional LED array in an operator station of the power machine, or removably installing a display screen to display the one or more indicators within an operator station of the power machine
This Summary and the Abstract are provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor are they intended to be used as an aid in determining the scope of the claimed subject matter.
The concepts disclosed in this discussion are described and illustrated by referring to particular examples. These concepts, however, are not limited in their application to the details of construction and the arrangement of components in the illustrative examples and are capable of being practiced or being carried out in various other ways. The terminology in this document is used for the purpose of description and should not be regarded as limiting. Words such as “including,” “comprising,” and “having” and variations thereof as used herein are meant to encompass the items listed thereafter, equivalents thereof, as well as additional items.
Also as used herein, unless otherwise expressly limited or defined, the term “about” refers to a numerical value that is within ±10% of a reference value, inclusive (e.g., within ±8% or ±6%). For example, “about 100” refers to a range of values between 90 and 100, inclusive. Similarly, the term “substantially equal” refers to a numerical value that is within ±5% of a reference value, inclusive (e.g., within ±3% or ±1%). For example, “substantially equal to 100” refers to a range of values between 95 and 105, inclusive. In contrast, the term “substantially different” (e.g., expressed as “substantially more” or “substantially less”) refers to a numerical value that is more than 15% different (e.g., 15% more or 15% less) of a reference value, inclusive (e.g., more than 20% different or more than 30% different). For example, “substantially different from 100” refers to ranges of values that are more than 115 and less than 85, inclusive.
Also as used herein, unless otherwise expressly limited or defined, the term “automatic operations” (and the like) refers to operations that are at least partly dependent on electronic application of computer algorithms for decision-making without human intervention. In this regard, unless otherwise expressly limited or defined, “automatic travel” refers to travel of a power machine or other vehicle in which at least some decisions regarding steering, speed, distance, or other travel parameters are made without direct intervention by a human operator. Relatedly, the term “automated operations” (and the like), unless otherwise expressly limited or defined, refers to a subset of automatic operations for which no intervention by a human operator is required. For example, automated travel can refer to automatic travel of a power machine or other vehicle during which steering, speed, distance, or other travel parameters are determined in real time without operator input. In this regard, however, operator input may sometimes be received to start, stop, interrupt, or define parameters (e.g., top speed) for automated travel or other automated operations.
Also as used herein, unless otherwise expressly limited or defined, a “primary path of travel” of a power machine refers to a path of travel along which the power machine, during normal operation, is configure to travel at substantially full speeds (i.e., speeds substantially equal to a maximum permitted or possible speed for the power machine under a particular operating condition (e.g., with a fully loaded bucket, with an engine at maximum speed or power, on sloped terrain, with an experienced operator, etc.)). In this regard, for example, a primary path of travel may not be considered to extend in a backward direction for a power machine if the top speed of the power machine for any particular mode of operation in the backward direction (e.g., automatic, automated, or fully operator-controlled backward travel) is substantially less than the top speed of the power machine for the same particular mode of operation relative to travel in a forward direction. However, if a power machine can move in the backward direction at a top speed that is substantially similar to a top speed in the forward direction, movement in the rearward direction can be a primary path of travel (as well as the forward direction). Similarly, unless otherwise expressly limited or defined, a “primary” work element refers to a work element (e.g., an implement interface) that is oriented to the front of an operator station of a power machine or that is configured to be moved with a main (e.g., maximally powered) work actuator of a power machine.
Some of the discussion below describes object detection systems for power machines and related methods for operating a power machine. In some examples, an object detection system can be configured to detect objects along a path of travel of the power machine, wherein the path of travel is oriented in a direction that extends opposite an implement interface of a power machine. For example, the path of travel and the direction of detection of objects can extend to a rearward side of a power machine with an operator station, or otherwise opposite a primary lift arm, implement interface, or another workgroup component.
Generally, object detection systems for power machines can provide additional information to an operator of the power machine to improve the operation thereof. For example, object detection equipment can alert an operator to one or more objects that may be in the path of the power machine, and can thereby potentially provide the operator with additional time to alter the travel of the power machine or stop the power machine completely prior to making contact with the object. Further, object detection systems can generally assist in automatic (e.g., autonomous) travel operations, including to help guide automatic travel of a power machine across terrain.
In some examples, improved placement of object detection sensors or other components of object detection systems can result in substantially improved performance, including for automatic travel. For example, power machines often include lift arms, associated (or other) implement interfaces, or other workgroup components for digging, grading, loading, and other operations, with a conventional primary direction of travel that extends in the same direction as the lift arms, etc. (e.g., to the front of a loader with a lift arm and a rigidly supported, forward-facing operator station). In these and other cases, object detection devices that are located on the same side of the power machine as the lift arms, implement interfaces, or other workgroup components, or that are otherwise arranged to monitor for objects on that same side of the power machine, can exhibit somewhat limited ranges or confidence levels for detection of objects, including due to the intervening presence of the lift arms, etc.
Accordingly, in some examples, one or more object detection sensors or other components of an object detection system can be arranged to monitor for the presence of objects in a direction that is opposite a lift arm, implement interface, or other workgroup component of a power machine (e.g., a direction that is opposite a primary lift arm structure or implement interface for a loader). Thus, for example, objects may be detected by the object detection system without substantial interference from the lift arm, implement interface, or other workgroup component, such that ranges and confidence levels for object detection may be maintained at a relatively high level. Correspondingly, in some examples, a primary direction for automatic travel for a power machine may be a direction that is opposite a lift arm, implement interface, or other workgroup component (e.g., opposite a primary lift arm structure for a loader). In some cases, this may correspond to backward travel relative to an operator station of the power machine.
In some examples, an object detection system can include at least one object detection sensor that defines a detection zone (i.e., a volume within a field of view (FOV) of the object detection sensor in which the probability of object detection is of suitable confidence to inform detection of objects). In some examples, an axis of a detection zone (e.g., a central axis of an elliptical detection cone) can be angled obliquely outwardly relative to a relevant path of travel (e.g., a rearward-directed primary path of automatic travel). In some examples, an axis of a detection zone can be angled obliquely upwardly relative to level ground, including so that a lower boundary of the detection zone is substantially parallel to the level ground (i.e., is within ±5 degrees of parallel) at an optimal height (e.g., about 20 to about 30 inches).
As generally noted above, automatic travel of a power machine, as well as other automatic operations, can sometimes be controlled based on objects detected by an object detection system. In some examples, a control device can be configured to alter the velocity of a power machine or to provide an alert to an operator of the power machine, based on detection of an object within a detection zone. For example, depending on the location of an object within a detection zone, relative to the path of travel and the power machine, a control device can be configured to reduce speed for a power machine (e.g., fully stop movement of the power machine along the path of travel) or to provide an audio, visual, or tactile feedback to an operator. In some examples, detection of an object along a path of travel can result in automatic operation of the power machine in an object-detected mode, which can correspond to reductions in velocity, control of steering, or other automatically controlled operations.
These concepts can be practiced on various power machines, as will be described below. A representative power machine on which the disclosed technology can be practiced is illustrated in diagram form in
Certain work vehicles have work elements that can perform a dedicated task. For example, some work vehicles have a lift arm to which an implement such as a bucket is attached such as by a pinning arrangement. The work element, i.e., the lift arm can be manipulated to position the implement to perform the task. The implement, in some instances can be positioned relative to the work element, such as by rotating a bucket relative to a lift arm, to further position the implement. Under normal operation of such a work vehicle, the bucket is intended to be attached and under use. Such work vehicles may be able to accept other implements by disassembling the implement/work element combination and reassembling another implement in place of the original bucket. Other work vehicles, however, are intended to be used with a wide variety of implements and have an implement interface such as implement interface 170 shown in
On some power machines, implement interface 170 can include an implement carrier, which is a physical structure movably attached to a work element. The implement carrier has engagement features and locking features to accept and secure any of a number of different implements to the work element. One characteristic of such an implement carrier is that once an implement is attached to it, it is fixed to the implement (i.e. not movable with respect to the implement) and when the implement carrier is moved with respect to the work element, the implement moves with the implement carrier. The term implement carrier as used herein is not merely a pivotal connection point, but rather a dedicated device specifically intended to accept and be secured to various different implements. The implement carrier itself is mountable to a work element 130 such as a lift arm or the frame 110. Implement interface 170 can also include one or more power sources for providing power to one or more work elements on an implement. Some power machines can have a plurality of work element with implement interfaces, each of which may, but need not, have an implement carrier for receiving implements. Some other power machines can have a work element with a plurality of implement interfaces so that a single work element can accept a plurality of implements simultaneously. Each of these implement interfaces can, but need not, have an implement carrier.
Frame 110 includes a physical structure that can support various other components that are attached thereto or positioned thereon. The frame 110 can include any number of individual components. Some power machines have frames that are rigid. That is, no part of the frame is movable with respect to another part of the frame. Other power machines have at least one portion that can move with respect to another portion of the frame. For example, excavators can have an upper frame portion that rotates with respect to a lower frame portion. Other work vehicles have articulated frames such that one portion of the frame pivots with respect to another portion for accomplishing steering functions.
Frame 110 supports the power source 120, which is configured to provide power to one or more work elements 130 including the one or more tractive elements 140, as well as, in some instances, providing power for use by an attached implement via implement interface 170. Power from the power source 120 can be provided directly to any of the work elements 130, tractive elements 140, and implement interfaces 170. Alternatively, power from the power source 120 can be provided to a control system 160, which in turn selectively provides power to the elements that capable of using it to perform a work function. Power sources for power machines typically include an engine such as an internal combustion engine and a power conversion system such as a mechanical transmission or a hydraulic system that is configured to convert the output from an engine into a form of power that is usable by a work element. Other types of power sources can be incorporated into power machines, including electrical sources or a combination of power sources, known generally as hybrid power sources.
Power machine 100 includes an operator station 150 that includes an operating position from which an operator can control operation of the power machine. In some power machines, the operator station 150 is defined by an enclosed or partially enclosed cab. Some power machines on which the disclosed examples may be practiced may not have a cab or an operator compartment of the type described above. For example, a walk behind loader may not have a cab or an operator compartment, but rather an operating position that serves as an operator station from which the power machine is properly operated. More broadly, power machines other than work vehicles may have operator stations that are not necessarily similar to the operating positions and operator compartments referenced above. Further, some power machines such as power machine 100 and others, whether or not they have operator compartments or operator positions, may be capable of being operated remotely (i.e., from a remotely located operator station) instead of or in addition to an operator station adjacent or on the power machine. This can include applications where at least some of the operator controlled functions of the power machine can be operated from an operating position associated with an implement that is coupled to the power machine. Alternatively, with some power machines, a remote-control device can be provided (i.e., remote from both of the power machine and any implement to which is it coupled) that is capable of controlling at least some of the operator controlled functions on the power machine.
Loader 200 is one particular example of the power machine 100 illustrated broadly in
Loader 200 includes frame 210 that supports a power system 220, the power system being capable of generating or otherwise providing power for operating various functions on the power machine. Power system 220 is shown in block diagram form, but is located within the frame 210. Frame 210 also supports a work element in the form of a lift arm assembly 230 that is powered by the power system 220 and that can perform various work tasks. As loader 200 is a work vehicle, frame 210 also supports a traction system 240, which is also powered by power system 220 and can propel the power machine over a support surface. The lift arm assembly 230 in turn supports an implement interface 270, which includes an implement carrier 272 that can receive and secure various implements to the loader 200 for performing various work tasks and power couplers 274, to which an implement can be coupled for selectively providing power to an implement that might be connected to the loader. Power couplers 274 can provide sources of hydraulic or electric power or both. The loader 200 includes a cab 250 that defines an operator station 255 from which an operator can manipulate various control devices 260 to cause the power machine to perform various work functions. Cab 250 can be pivoted back about an axis that extends through mounts 254 to provide access to power system components as needed for maintenance and repair.
The operator station 255 includes an operator seat 258 and a plurality of operation input devices, including control levers 260 that an operator can manipulate to control various machine functions. Operator input devices can include buttons, switches, levers, sliders, pedals and the like that can be stand-alone devices such as hand operated levers or foot pedals or incorporated into hand grips or display panels, including programmable input devices. Actuation of operator input devices can generate signals in the form of electrical signals, hydraulic signals, and/or mechanical signals. Signals generated in response to operator input devices are provided to various components on the power machine for controlling various functions on the power machine. Among the functions that are controlled via operator input devices on power machine 200 include control of the tractive elements 219, the lift arm assembly 230, the implement carrier 272, and providing signals to any implement that may be operably coupled to the implement.
Loaders can include human-machine interfaces including display devices that are provided in the cab 250 to give indications of information relatable to the operation of the power machines in a form that can be sensed by an operator, such as, for example audible and/or visual indications. Audible indications can be made in the form of buzzers, bells, and the like or via verbal communication. Visual indications can be made in the form of graphs, lights, icons, gauges, alphanumeric characters, and the like. Displays can be dedicated to providing dedicated indications, such as warning lights or gauges, or dynamic to provide programmable information, including programmable display devices such as monitors of various sizes and capabilities. Display devices can provide diagnostic information, troubleshooting information, instructional information, and various other types of information that assists an operator with operation of the power machine or an implement coupled to the power machine. Other information that may be useful for an operator can also be provided. Other power machines, such walk behind loaders may not have a cab nor an operator compartment, nor a seat. The operator position on such loaders is generally defined relative to a position where an operator is best suited to manipulate operator input devices.
Various power machines that can include and/or interacting with the examples discussed below can have various different frame components that support various work elements. The elements of frame 210 discussed herein are provided for illustrative purposes and frame 210 is not the only type of frame that a power machine on which the examples can be practiced can employ. Frame 210 of loader 200 includes an undercarriage or lower portion 211 of the frame and a mainframe or upper portion 212 of the frame that is supported by the undercarriage. The mainframe 212 of loader 200, in some examples is attached to the undercarriage 211 such as with fasteners or by welding the undercarriage to the mainframe. Alternatively, the mainframe and undercarriage can be integrally formed. Mainframe 212 includes a pair of upright portions 214A and 214B located on either side and toward the rear of the mainframe that support lift arm assembly 230 and to which the lift arm assembly 230 is pivotally attached. The lift arm assembly 230 is illustratively pinned to each of the upright portions 214A and 214B. The combination of mounting features on the upright portions 214A and 214B and the lift arm assembly 230 and mounting hardware (including pins used to pin the lift arm assembly to the mainframe 212) are collectively referred to as joints 216A and 216B (one is located on each of the upright portions 214) for the purposes of this discussion. Joints 216A and 216B are aligned along an axis 218 so that the lift arm assembly is capable of pivoting, as discussed below, with respect to the frame 210 about axis 218. Other power machines may not include upright portions on either side of the frame or may not have a lift arm assembly that is mountable to upright portions on either side and toward the rear of the frame. For example, some power machines may have a single arm, mounted to a single side of the power machine or to a front or rear end of the power machine. Other machines can have a plurality of work elements, including a plurality of lift arms, each of which is mounted to the machine in its own configuration. Frame 210 also supports a pair of tractive elements in the form of wheels 219A-D on either side of the loader 200.
The lift arm assembly 230 shown in
The lift arm assembly 230 has a pair of lift arms 234 that are disposed on opposing sides of the frame 210. A first end 232A of each of the lift arms 234 is pivotally coupled to the power machine at joints 216 and a second end 232B of each of the lift arms is positioned forward of the frame 210 when in a lowered position as shown in
Each of the lift arms 234 has a first portion 234A of each lift arm 234 is pivotally coupled to the frame 210 at one of the joints 216 and the second portion 234B extends from its connection to the first portion 234A to the second end 232B of the lift arm assembly 230. The lift arms 234 are each coupled to a cross member 236 that is attached to the first portions 234A. Cross member 236 provides increased structural stability to the lift arm assembly 230. A pair of actuators 238, which on loader 200 are hydraulic cylinders configured to receive pressurized fluid from power system 220, are pivotally coupled to both the frame 210 and the lift arms 234 at pivotable joints 238A and 238B, respectively, on either side of the loader 200. The actuators 238 are sometimes referred to individually and collectively as lift cylinders. Actuation (i.e., extension and retraction) of the actuators 238 cause the lift arm assembly 230 to pivot about joints 216 and thereby be raised and lowered along a fixed path illustrated by arrow 237. Each of a pair of control links 217 are pivotally mounted to the frame 210 and one of the lift arms 232 on either side of the frame 210. The control links 217 help to define the fixed lift path of the lift arm assembly 230.
Some lift arms, most notably lift arms on excavators but also possible on loaders, may have portions that are controllable to pivot with respect to another segment instead of moving in concert (i.e., along a pre-determined path) as is the case in the lift arm assembly 230 shown in
An implement interface 270 is provided proximal to a second end 232B of the lift arm assembly 234. The implement interface 270 includes an implement carrier 272 that is capable of accepting and securing a variety of different implements to the lift arm 230. Such implements have a complementary machine interface that is configured to be engaged with the implement carrier 272. The implement carrier 272 is pivotally mounted at the second end 232B of the arm 234. Implement carrier actuators 235 are operably coupled the lift arm assembly 230 and the implement carrier 272 and are operable to rotate the implement carrier with respect to the lift arm assembly. Implement carrier actuators 235 are illustratively hydraulic cylinders and often known as tilt cylinders.
By having an implement carrier capable of being attached to a plurality of different implements, changing from one implement to another can be accomplished with relative ease. For example, machines with implement carriers can provide an actuator between the implement carrier and the lift arm assembly, so that removing or attaching an implement does not involve removing or attaching an actuator from the implement or removing or attaching the implement from the lift arm assembly. The implement carrier 272 provides a mounting structure for easily attaching an implement to the lift arm (or other portion of a power machine) that a lift arm assembly without an implement carrier does not have.
Some power machines can have implements or implement like devices attached to it such as by being pinned to a lift arm with a tilt actuator also coupled directly to the implement or implement type structure. A common example of such an implement that is rotatably pinned to a lift arm is a bucket, with one or more tilt cylinders being attached to a bracket that is fixed directly onto the bucket such as by welding or with fasteners. Such a power machine does not have an implement carrier, but rather has a direct connection between a lift arm and an implement.
The implement interface 270 also includes an implement power source 274 available for connection to an implement on the lift arm assembly 230. The implement power source 274 includes pressurized hydraulic fluid port to which an implement can be removably coupled. The pressurized hydraulic fluid port selectively provides pressurized hydraulic fluid for powering one or more functions or actuators on an implement. The implement power source can also include an electrical power source for powering electrical actuators and/or an electronic controller on an implement. The implement power source 274 also exemplarily includes electrical conduits that are in communication with a data bus on the excavator 200 to allow communication between a controller on an implement and electronic devices on the loader 200.
Frame 210 supports and generally encloses the power system 220 so that the various components of the power system 220 are not visible in
The arrangement of drive pumps, motors, and axles in power machine 200 is but one example of an arrangement of these components. As discussed above, power machine 200 is a skid-steer loader and thus tractive elements on each side of the power machine are controlled together via the output of a single hydraulic pump, either through a single drive motor as in power machine 200 or with individual drive motors. Various other configurations and combinations of hydraulic drive pumps and motors can be employed as may be advantageous.
The power conversion system 224 of power machine 200 also includes a hydraulic implement pump 224C, which is also operably coupled to the power source 222. The hydraulic implement pump 224C is operably coupled to work actuator circuit 238C. Work actuator circuit 238C includes lift cylinders 238 and tilt cylinders 235 as well as control logic to control actuation thereof. The control logic selectively allows, in response to operator inputs, for actuation of the lift cylinders and/or tilt cylinders. In some machines, the work actuator circuit also includes control logic to selectively provide a pressurized hydraulic fluid to an attached implement. The control logic of power machine 200 includes an open center, 3 spool valve in a series arrangement. The spools are arranged to give priority to the lift cylinders, then the tilt cylinders, and then pressurized fluid to an attached implement.
The description of power machine 100 and loader 200 above is provided for illustrative purposes, to provide illustrative environments on which the examples discussed below can be practiced. While the examples discussed can be practiced on a power machine such as is generally described by the power machine 100 shown in the block diagram of
The loader 300 also has a cab, with an enclosed operator station 355 (see
The loader 300 also includes an object detection system 378. As generally discussed above, object detection systems according to this disclosure generally include at least one object detection sensor that is configured to interoperate with a control device (e.g., a special or general purpose computing device) in order to monitor the environment of a power machine for objects and to control operations of the power machine accordingly. In particular, in the example provided in
The first and second object detection sensors 380A, 380B are mounted to the loader 300 (shown in
In some cases, the detection zones 392A, 392B of the first and second object detection sensors 380A, 380B can be defined as a volume within the respective object detection sensor 380A, 380B FOV in which the object detection sensors 380A, 380B can detect an object with a probability of about 95% and higher. In other cases, detection zones can be otherwise defined, including according to whether a confidence of detection of presence of an object is sufficiently high to be used for control of power machine operations (e.g., as based on manufacturer specifications for a particular object detection sensor).
In some examples, the object detection system 378 can include more or fewer object detection sensors than shown in
In some examples, the FOV of one or both of the object detection sensors 380A, 380B can be in the shape of an elliptical cone, with the detection zones 392A, 392B thus defining a minor angle 344A, 344B (shown in
In examples with a single object detection sensor, for example only the object detection sensor 380A, the detection zone (e.g., the zone 392A) can be shaped similarly to the sensor FOV. However, when more than one object detection sensor is used, for example, both of the object detection sensors 380A, 380B as shown in
The outer boundary of a combined detection zone (e.g., the detection zone 392) can generally be defined by the specifications of the relevant object detection sensors (e.g., the sensors 380A, 380B), including the shape and range of the relevant FOVs, as well as by the mounting orientation (e.g., position and angle) of each of the object detection sensors. Accordingly, a detection zone can be optimized, as appropriate, for the particular characteristics or intended use of a particular power machine, job site, operation profile, etc. For example, as further detailed below, one or more object detection sensors can be arranged to provide a combined detection zone with outer lateral boundaries that extend at particular (e.g., oblique) angles relative to a primary direction of travel of a power machine (e.g., rearward for the power machine 300), with vertical boundaries that extend at particular angles relative level ground (e.g., to be about parallel with the level ground at a lower vertical boundary), or with other characteristics appropriate for a particular task. In this regard, as similarly described above, a placement of object detection sensors to monitor for objects opposite a primary implement interface or other work element (e.g., facing generally rearward relative to an operator station) may be particularly useful, including because this arrangement may maximize an available detection zone without substantial interference from one or more work elements of the power machine.
In some examples, as shown in
In some examples, orienting one or more object detection sensors to define lower boundaries of detection zones that are substantially parallel to a ground plane (e.g., as described above) can help to reduce the likelihood of detection of objects that do not effectively provide obstacles to power machine operation or to reduce the likelihood of a false detection of the ground itself as a detected object. Further, in some cases, one or more object detection sensors can be oriented so that a lower boundary of the relevant detection zone(s) is located at an optimal height relative to a ground plane. For example, the object detection sensors 380A, 380B can be oriented so that a lower boundary height 364 for the detection zones 392A, 392B (and the combined detection zone 392) can be set to between about 20 and about 30 inches (e.g., at no less than about 25 inches) from the lowest part of the loader 300. Depending on the use case, however, other lower boundary heights can also be set.
In examples in which there is more than one object detection sensor, it may be useful to orient the object detection sensors with particular yaw angles, relative to a direction of a primary path of travel (e.g., a rearward direction for the power machine 300) so as to obtain optimal detection coverage. For example, as illustrated in
In an example arrangement, as shown in
In this regard, generally, although the illustrated angular orientations of the object detection sensors 380A, 380B and the ranges (and overlap) of the detection zones 392A, 392B may be particularly suitable for some power machines or work operations, a variety of other configurations are possible. Further, in some cases, one or more object detection sensors can be configured to be dynamically adjusted, including so that an angular range or orientation of a particular object detection sensor can be expanded or contracted depending on a current operation, a current operating profile, a current job site, or other factors.
In some examples, as also generally discussed above, it may be useful for object detection sensors to provide detection zones that extend opposite a lift arm, implement interface, or other primary work element of a power machine. In some cases, accordingly, one or more object detection sensors can be mounted to a power machine opposite a relevant work element (e.g., opposite a lift arm or implement interface), including to structures at a rear side of a particular power machine (e.g., as defined by an attached operator station or primary lift arm).
Referring again to a
Generally, orientation of object detection sensors to detect objects in an opposite direction from an implement interface (e.g., on a primary lift arm) can sometimes result in configuration of power machines for travel along primary paths of automatic travel that may be different from primary paths of non-automatic travel. For example, relative to power machines with operator stations that define a front and rear of the power machines, use of object detection sensors and related control systems as disclosed herein can allow for rapid automatic travel (e.g., full-speed automated travel) of the power machines in a rearward direction, thus allowing for effective and rapid navigation relative to obstacles with substantially reduced potential for interference with object detection due to the orientation of a lift arm or other primary work element. Similarly, in other cases, a primary path of travel (e.g., automatic travel) of a power machine that extends opposite a primary work element (e.g., a main lift arm) of the power machine can be enabled by configuration of object detection sensors as disclosed herein.
In some cases, if an object detection sensor is mounted to a movable component, a particular (e.g., different) sensor can be configured to determine an orientation of the movable component to inform appropriate use of data from the object detection sensor. For example, in the implementation shown, in which the object detection sensors 380A, 380B are mounted to the movable tailgate 382, a tailgate position sensor 388 can sometimes be provided. Further, the control device 390 can be configured to execute automatic travel operations based on the tailgate position sensor 388 sensing a current position of the tailgate, as well as based on signals from the object detection sensors 380A, 380B. For example, if the tailgate position sensor 388 senses that the current position of the tailgate is a closed (or locked) position, then the control device 390 can execute automatic travel operations based on signals from the object detection sensors 380A, 380B. However, if the tailgate position sensor 388 senses that the current position of the tailgate is not a closed (or locked) position, the control device 390 can be configured to limit all or some automatic travel operations of the loader 300 (e.g., because the object detection sensors 380A, 380B may not be appropriately oriented to detect obstacles along the path of travel 342 (see
Referring again to
As also noted above, the object detection system 378 also includes the control device 390, which is generally configured to execute automatic travel (or other) operations for the power machine based on signals from the object detection sensors 380A, 380B (and, as applicable, from other sensors, including the ultrasonic sensor 352). For example, when the loader 300 is moving or is commanded to move along the path of travel 342 opposite the implement interface 370, the control device 390 can receive signals from the object detection sensors 380A, 380B that indicate the presence of objects 10, 12 (shown in
In some examples, control of power machine travel based on detected objects can include selective operation of a power machine (e.g., the loader 300) in any one of a plurality of operating modes. One example operating mode can include a mode in which the control device 390 sets a maximum allowed power machine speed that is less than a maximum possible power machine speed. Thus, for example, upon detection of a particular object, the control device 390 can effectively de-rate a top speed of a power machine to provide for more finely controlled travel relative to the detected object, or can otherwise modify operator input commands to reduce corresponding tractive actuator commands. In some cases, alteration of the speed of a power machine can be non-linear relative to changes in distance between the power machine and one or more of the detected objects. For example, de-rating of speed may increase exponentially as the detected distance of an object from a power machine decreases. As another example, some operating modes can include causing a full stop of the power machine based on detection of a particular object. For example, detection of an object with a particular proximity to a power machine along a path of travel can sometimes result in the control device 390 causing the power machine to stop movement along the path of travel, in some cases despite operator commands to the contrary.
As still another example, another operating mode can include providing one or more of an auditory alert, a visual-display alert, or a tactile alert to an operator of the power machine. In some cases, an alert may be relatively non-specific (e.g., may be a single tone to indicate a proximate object). In some cases, an alert may represent more detailed information. In some cases, a visual display for an operator may specifically or generally indicate a location of a detected object relative to a power machine (e.g., on a two-axis display), or may specifically or generally indicate a proximity of a detected object to a power machine.
Different display modules can be used in different examples. For example, an object detection display can include a first (e.g., vertical) set of light emitting diodes (LEDs) and a second (e.g., horizontal) set of LEDs. The first set of LEDs can represent a distance an object along a path of travel with respect to a power machine (e.g., a distance rearward of the loader 300). For example, objects that are within a detection zone (e.g., the zone 392) and farther from the power machine can be indicated by LEDs toward the bottom of the vertical set of LEDs and objects that are within a detection zone and closer to the power machine can be indicated by LEDs toward the top of the vertical set. In contrast, the second set of LEDs can represent a lateral location of the object perpendicularly to the path of travel (e.g., to the right or left hand side of the loader 300). For example, objects within a detection zone (e.g., the zone 392) and closer to lateral outer boundaries thereof can be indicated by LEDs toward the outer end of the horizontal set of LEDs and objects within a detection zone and closer to the path of travel can be indicated by LEDs toward the center of the horizontal set of LEDs. In some examples, an object detection display can be integrated into a visual display of a power machine (e.g., a touchscreen of the loader 300) that is used to display other power machine information.
In some examples, an object detection display can be a separate (e.g., standalone) display, including, for example, a display integrated or connected to a window or door in the cab. Such a display can include a screen and/or various lights and indicators. Similarly, an audible indicator can be provided (such as a buzzer or the like) to draw an operator’s attention to the display. In some examples, including as further discussed below, a display module can be installed as part of installation of a retrofit kit for object detection (e.g., mechanically secured as a display device in an operator station, or installed as an update to software for an already-installed display system).
In some examples, a control system can be further configured to control travel of a power machine based on at least temporarily monitoring an object only passively (i.e., by at least temporarily monitoring an object location or distance, but not actively controlling one or more power machine operations on that basis). In some examples, passive monitoring can be implemented based on operator input or based on an operating characteristic of a power machine (e.g., a power machine speed). For example, if an operator input commands movement of the loader 300 away from a detected object (e.g., the object 12 in
In some examples, operation of object detection systems can be otherwise modified based on operator input. For example, in some cases, the range of object detection for one or more object detectors can be modified based on operator input. Referring again to
In some examples, selection of an operating mode can be made via a button or a plurality of buttons on a joystick (e.g., a button (not shown) on the control levers 260 of
In some examples, upon detection of an object, one of a plurality of selectable operating modes can slow a power machine to a stop at a predetermined (e.g., default) deceleration rate or over a predetermined (e.g., default) stopping distance. Another of the selectable operating modes can slow a power machine down but not automatically stop the power machine based upon detecting an object. In both of these modes, it is contemplated that various deceleration rates can be used, including as a result of an operator selecting a deceleration rate, and stopping distances can be similarly varied as applicable. For example, a deceleration rate can be selected from a predetermined number (e.g., two) of operator-selectable deceleration profiles or otherwise customized based on operator input or other factors. Similarly, for example, an operator can customize a minimum stopping distance, including by selecting from a set of predetermined minimum stopping distances (e.g., 2.5 feet, 10 feet, 12 feet, or 15 feet, and other values in this range).
In some examples, one of a plurality of selectable operating modes can cause a power machine to issue an alert upon detection of an object, including, for example, an auditory alert, a visual-display alert, or a tactile alert, as discussed previously, to be activated when an object is detected in the path of travel of the power machine. An alert can generally be provided as a standalone feature, including as a main (e.g., only) response to a detected object in some operational modes. In some examples, an alert can be provided as part of selectable operating modes that also include other functionality, including for slowing or stopping a power machine as discussed above. In some examples, an operating mode with an alert can be implemented on a mechanically controlled power machine, in which mechanical control of the power machine (e.g., via cables, mechanical actuation of a pilot valve for pilot-operated hydraulic controls, or a mechanical linkage between a joystick and a pump), may preclude certain kinds of automatic control. Generally, any of the object detection systems, modes, and features described herein can assist in automatic (e.g., autonomous or semi-autonomous) travel operations, as discussed above, and in power machines that are fully human operated.
In some implementations, devices or systems disclosed herein can be utilized or installed using methods embodying aspects of the disclosed technology. Correspondingly, description herein of particular features or capabilities of a device or system is generally intended to inherently include disclosure of a method of using such features for intended purposes and of implementing such capabilities. Similarly, express discussion of any method of using a particular device or system, unless otherwise indicated or limited, is intended to inherently include disclosure, as examples of the disclosed technology, of the utilized features and implemented capabilities of such device or system.
In this regard, for example,
At block 404, the method 400 can include using an object detection sensor (e.g., a radar device) to monitor for objects as the power machine moves in the direction of travel ― or at other times, as appropriate (e.g., before operations at the block 402 for automatic travel). In some cases, also as discussed above, a relevant object detection sensor can be oriented to primarily detect objects in a primary direction of travel. In some cases, a primary direction of automatic travel may be different from a primary direction of non-automatic travel or from a primary direction for execution of work operations. For example, as generally discussed above relative to the loader 300 (see
At block 406, the method 400 can further include, if an object is detected in the detection zone, automatically operating the power machine in an object-detected mode. In some cases, operations under the block 406 can thus include automatically controlling travel of a power machine along the direction of travel based on further monitoring of the object using the object detection sensor. For example, as also discussed above, a location of an object or a distance of an object from a power machine can be monitored based on signals from one or more object detection sensors and controlling travel speed or other operations of a power machine accordingly. Thus, for example, the method 400 can include automatically reducing a travel velocity of the power machine based on the detected object (see block 408), automatically stopping the power machine based on the detected object (see block 410), or providing a relevant alert (see block 412).
In some cases, at block 414, the method 400 can further include overriding one or more aspects of an object-detected mode. For example, as also discussed above, a required reduction in travel speed can sometimes be overridden if an actual travel speed or a commanded travel speed of the power machine is at or below a speed threshold (e.g., 10% of a maximum rated power machine speed), or based on other relevant conditions or inputs.
In some cases, an object detection system can be installed as a kit for a power machine, including as may be used to retrofit a power machine for expanded operational capabilities. For example, some implementations can include a retrofit kit that can operate alongside (or cooperatively with) a pre-existing control system of a power machine to provide expanded object detection capabilities for the power machine.
For example, as illustrated in
In some examples, a detection (or other) module of a kit can be magnetically secured to a power machine. For example, a radar module or other sensor-based object detection module can be temporarily magnetically secured to a tailgate, a bumper, or another structure of a power machine so as to be oriented to detect objects in a relevant detection zone. In some examples, a module of a kit can be instead (or additionally) be secured with other fasteners, including threaded fasteners, hooks, clasps, pins, specialized brackets, etc. Further, although dedicated or preferred locations for a module can be specified in some cases (e.g., with positioning of a radar module according to discussion above), some modules can be configured to be selectively secured at any variety of customized locations on a power machine.
In some cases, securing a detection (or other) module of a kit can include connecting the module to a CAN bus or other integrated communication and control architecture of the power machine. In some cases, securing a module of a kit fo a power machine can include otherwise connecting the module for communication with the power machine (e.g., via a control device of the kit, as further discussed below).
At block 502, a detection module of a kit can generally be secured to a power machine so as to be aligned to detect objects along a direction of travel of the power machine. For example, a radar module can be aligned to detect objects that are primarily rearward, forward, or laterally to either side of a power machine, as appropriate. In some examples, multiple detection modules can be secured to a power machine at block 502 to provide object detection relative to multiple directions (e.g., rearward and forward). A detection module can also generally be installed at block 502 to be in electronic communication with a controller (e.g., a separate component of the kit to be secured to the power machine, or a module of an integrated control system of the power machine).
Any variety of known electronic communication protocols or channels can be used, as appropriate, for communication between a detection module, a controller, and various other components of an object detection kit or power machine. Further, in some examples, the various modules of a detection system as discussed herein can be in direct or indirect electronic communication with external controllers or other external computing devices, including mobile remote control devices and fixed-location remote control servers). For example, a control module for an object detection system can be in communication with a remote control device configured to display indicators of detected objects, or with a remote automatic-control system configured to direct automatic operations of a power machine.
At block 504, the method 500 can include removably installing a display module on the power machine in electronic communication with the detection module or various other electronic systems of the kit or the power machine. In some cases, installing a display module can include securing a display screen or other display device to be viewed by an operator in an operator station of a power machine. For example, using suction mounts that engage a viewing window (see, e.g.,
At block 506, the method 500 can include connecting one or more component of an object detection kit to a power source. In some cases, operations at block 506 can include removably installing a power module to be engaged with a power connection of the power machine. The power module can thereby receive power from a power source of a power machine, so as to power one or more of an associated object detection module, display module, control module, etc. In some cases, a power module can include a connector for temporary engagement with an auxiliary power connector of the relevant power machine (e.g., a socket, plug, or other connector for a 12 volt power source). In some cases, a power module can include or be included in a wiring harness for providing electronic communication between detection, control, and other modules of an object detection kit. In some cases, a power module can be integrated with another component of an object detection kit (e.g., as a battery in a display module, a detection module, etc.).
In some examples, the method 500 can also include installing a control module in communication with a detection module and a display module, so that the control module can control the display module based on signals from the detection module to provide relevant alerts to an operator based on detection of objects by the detection module. In some examples, installing a control module can include installing a software or other update to a control system of the relevant power machine. In some examples, a control module can be provided as a component of a kit to be mechanically installed onto a power machine (e.g., as a standalone control device, or a control device integrated into a temporarily secured detection module or display module).
With a kit installed, the method 500 can include, at block 514, operating the power machine, with the kit providing obstacle detection functionality for the power machine. For example, a radar module temporarily secured to power machine as part of a retrofit kit can interoperate with a similarly installed display module so that an operator can be alerted to one or more detected characteristics of one or more objects during operation of the power machine (e.g., to indicate relative object location or movement of the object relative to the frame of reference of the power machine).
In the illustrated example, the retrofit kit includes a detection module 550, which can be removably secured to the power machine 540 to detect objects near the power machine 540. As also noted above, a detection module can include one or more sensors of a variety of configurations and in some cases can include a radar system as can detect objects within a detection zone that extends across part of the area that surrounds the power machine. In some examples, a detection module can be magnetically secured by a magnet connector 552 (e.g., a rare earth or other magnet and an associated bracket to secure the magnet to the detection module). In other examples, a module can be otherwise attached, including using brackets, threaded or other non-threaded fasteners, adhesives, etc.
In the illustrated example, the detection module 550 is secured to a rear of the power machine 540 so as to detect objects in a rearward direction. For example, as shown in
Still referring to
To coordinate object detection and associated alerts, a control module can be generally arranged in electronic communication with a detection module and a display module. In some examples, a control module can utilize pre-existing control systems of a power machine (e.g., after installation of associated software or firmware updates to configure the control module for object-detection functionality). In some examples, a dedicated control device can be included in a retrofit kit and can be secured to power machine during installation of the kit. For example, as shown in
In some examples, a kit for object detection can include a power module, as can ensure that operational power is provided to a detection module, a display module, or a control module, as needed. In some cases, a power module can be configured to provide stand-alone power. For example, a power module can include an integrated battery or other integrated power source for the kit that can provide power independently of the power machine. In some cases, a power module can be configured to connect a kit to a power source of a power machine. For example, as illustrated in
Thus, for example, the control module 556 can receive object-detection data (e.g., radar data) from the detection module 550, and can control the display module 554 based on the object-detection data to provide, via the display module 554, one or more indicators of an object detected by the detection module 550 (e.g., as similarly detailed above). In this regard, a display module can provide alerts using various auditory or visual formats to provide operators with useful information about the presence of objects near the power machine 540.
As also noted above, a display module can take a variety of forms. As shown in
In some cases, a display module can be configured to receive user input, including as can respond to particular alerts or customize operation of a particular object detection system (e.g., a retrofit kit). As also shown in
Referring again to the example configuration of
In some cases, a lighting assembly can be configured to provide object-detection information along a one-dimensional array by varying multiple (e.g., two) lighting characteristics along a particular direction. For example, the lighting assembly 554B can be controlled to indicate both position and proximity of multiple detected objects using a one-dimensional LED array. In particular, individual lighting units (e.g., LED dies) of the lighting assembly 554B can be illuminated to spatially indicate detection of objects at particular lateral locations relative to the power machine, and can be illuminated with a particular light type (e.g., a particular brightness or color) to indicate a proximity distance of the relevant particular object(s) to the power machine (i.e., a relative or absolute distance between the object(s) and the power machine along a direct path or a direction of current or primary travel for the power machine). Thus, in the object-detection state illustrated in
In some examples, a user can customize a display module to indicate objects at particular locations in particular ways. For example, discrete lighting sections on a one-dimensional lighting array (e.g., the lighting assembly 554B) can be customizably associated with particular real-world spatial ranges (e.g., so that particular spatial ranges f LEDs correspond to particular real-world spatial ranges), including as can be customized based on size or other characteristics of a relevant power machine, operator, or operation. Similarly, customized thresholds or other criteria can be established (e.g., input by users) for illuminating particular lighting sections with particular types of light. For example, a first light color (e.g., green) can be used for particular lighting sections to indicate that a detected object is relatively far away, and other light colors (e.g., yellow, red, etc.) can be used to indicate that a detected object for a particular lighting section is relatively close to the power machine. Again, these criteria can be customized for particular power machines, operators, or users (e.g., including as may correspond to different modes discussed above), including via operator inputs at the display screen 554A.
In some examples, alerts based on proximity can be provided based on a distance of a detected object from a power machine and based on a travel speed (e.g., present or maximum travel speed) of the power machine. For example, to determine a particular type (e.g., color) of light to be displayed for a particular object by a display module of a power machine, the proximity distance of the object relative to the power machine can be determined and compared to a current travel speed of the power machine or to another reference travel speed (e.g., a maximum rated travel speed in the relevant travel direction). The type of light for the particular object can then be selected accordingly, i.e., based on the scaled proximity distance. This scaling of distance by travel speed can allow operators to be provided with alerts that relate not only to how distant detected objects may be but also to how quickly the objects might approach (or are approaching) the power machine.
Although examples above discuss lateral position (e.g., based on position relative to a centerline of a power machine) and proximity (e.g., based on distance from a power machine along a present direction of travel), indicators based on other criteria are also possible. Further, in some cases, object detection systems can be automatically (or otherwise) update alert parameters based on characteristics of the particular power machines on which the systems are installed. For example, upon installation of an object detection kit on a power machine, communication between the kit and the power machine can inform the object detection kit of a maximum rated speed, lateral width, or other relevant parameter for the power machine, as can inform customized provision of alerts for detected objects. Thus, for example, alerts as to object proximity and lateral location can be appropriately matched to the particular characteristics of a particular power machine, even though a relevant kit can be installed on a wide variety of different power machines (e.g., with a variety of widths and rated top speeds).
In some examples, an object detection system can analyze data that indicates one or more detected objects to determine whether a power machine is traveling toward a particular object, and an alert can be provided (or not provided) to an operator accordingly. For example, upon receiving detection data for a plurality of objects (or object points), a control device can the detection data (e.g., relative to changes over time) to determine a direction of movement of a particular object ― or of detected objects on average ― and thereby determine whether the relevant objects are moving toward or away from a power machine. Correspondingly, a system can sometimes be configured to provide alerts only when a relevant object has been determined to be moving toward the power machine (e.g., for a stationary object, because the power machine is moving toward the object), whereas alerts may not be provided for objects that are close to the power machine but moving farther away. For example, upon determining that a distance between a power machine and a detected object is decreasing, a system can provide a visual or auditory indicator to an operator to alert the operator of this determination. In contrast, if the distance is instead increasing, the system may sometimes not provide such a visual or auditory indicator.
In some examples, aspects of the disclosed technology, including computerized implementations of methods according to the disclosed technology, can be implemented as a system, method, apparatus, or article of manufacture using standard programming or engineering techniques to produce software, firmware, hardware, or any combination thereof to control a processor device (e.g., a serial or parallel general purpose or specialized processor chip, a single-or multi-core chip, a microprocessor, a field programmable gate array, any variety of combinations of a control unit, arithmetic logic unit, and processor register, and so on), a computer (e.g., a processor device operatively coupled to a memory), or another electronically operated controller to implement aspects detailed herein. Accordingly, some examples of the disclosed technology can be implemented as a set of instructions, tangibly embodied on a non-transitory computer-readable media, such that a processor device can implement the instructions based upon reading the instructions from the computer-readable media. Some examples of the disclosed technology scan include (or utilize) a control device such as an automation device, a special purpose or general purpose computer including various computer hardware, software, firmware, and so on, consistent with the discussion below. As specific examples, a control device can include a processor, a microcontroller, a field-programmable gate array, a programmable logic controller, logic gates etc., and other typical components that are known in the art for implementation of appropriate functionality (e.g., memory, communication systems, power sources, user interfaces and other inputs, etc.).
The term “article of manufacture” as used herein is intended to encompass a computer program accessible from any computer-readable device, carrier (e.g., non-transitory signals), or media (e.g., non-transitory media). For example, computer-readable media can include but are not limited to magnetic storage devices (e.g., hard disk, floppy disk, magnetic strips, and so on), optical disks (e.g., compact disk (CD), digital versatile disk (DVD), and so on), smart cards, and flash memory devices (e.g., card, stick, and so on). Additionally it should be appreciated that a carrier wave can be employed to carry computer-readable electronic data such as those used in transmitting and receiving electronic mail or in accessing a network such as the Internet or a local area network (LAN). Those skilled in the art will recognize that many modifications may be made to these configurations without departing from the scope or spirit of the claimed subject matter.
Certain operations of methods according to the disclosed technology, or of systems executing those methods, may be represented schematically in the FIGS. or otherwise discussed herein. Unless otherwise specified or limited, representation in the FIGS. of particular operations in particular spatial order may not necessarily require those operations to be executed in a particular sequence corresponding to the particular spatial order. Correspondingly, certain operations represented in the FIGS., or otherwise disclosed herein, can be executed in different orders than are expressly illustrated or described, as appropriate for particular examples of the disclosed technology. Further, in some examples, certain operations can be executed in parallel, including by dedicated parallel processing devices, or separate computing devices configured to interoperate as part of a large system.
As used herein in the context of computer implementation, unless otherwise specified or limited, the terms “component,” “system,” “module,” “block,” and the like are intended to encompass part or all of computer-related systems that include hardware, software, a combination of hardware and software, or software in execution. For example, a component may be, but is not limited to being, a processor device, a process being executed (or executable) by a processor device, an object, an executable, a thread of execution, a computer program, or a computer. By way of illustration, both an application running on a computer and the computer can be a component. One or more components (or system, module, and so on) may reside within a process or thread of execution, may be localized on one computer, may be distributed between two or more computers or other processor devices, or may be included within another component (or system, module, and so on).
Also as used herein, unless otherwise limited or defined, “or” indicates a non-exclusive list of components or operations that can be present in any variety of combinations, rather than an exclusive list of components that can be present only as alternatives to each other. For example, a list of “A, B, or C” indicates options of: A; B; C; A and B; A and C; B and C; and A, B, and C. Correspondingly, the term “or” as used herein is intended to indicate exclusive alternatives only when preceded by terms of exclusivity, such as “either,” “one of,” “only one of,” or “exactly one of.” For example, a list of “one of A, B, or C” indicates options of: A, but not B and C; B, but not A and C; and C, but not A and B. A list preceded by “one or more” (and variations thereon) and including “or” to separate listed elements indicates options of one or more of any or all of the listed elements. For example, the phrases “one or more of A, B, or C” and “at least one of A, B, or C” indicate options of: one or more A; one or more B; one or more C; one or more A and one or more B; one or more B and one or more C; one or more A and one or more C; and one or more of A, one or more of B, and one or more of C. Similarly, a list preceded by “a plurality of” (and variations thereon) and including “or” to separate listed elements indicates options of multiple instances of any or all of the listed elements. For example, the phrases “a plurality of A, B, or C” and “two or more of A, B, or C” indicate options of: A and B; B and C; A and C; and A, B, and C.
Although the present technology has been described by referring preferred examples, workers skilled in the art will recognize that changes may be made in form and detail without departing from the scope of the discussion.
This application claims priority to U.S. Provisional Pat. Application no. 63/223,241 filed Jul. 19, 2021, U.S. Provisional Pat. Application No. 63/278,278 filed Nov. 11, 2021, and U.S. Provisional Pat. Application No. 63/349,169 filed Jun. 6, 2022, the entirety of each of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
63223241 | Jul 2021 | US | |
63278278 | Nov 2021 | US | |
63349169 | Jun 2022 | US |