N/A
The present disclosure relates to a system and apparatus for a sensor-augmented work machine.
In the construction industry, various work machines, such as articulated dump trucks, may be utilized in the hauling of loads over rough terrain. In certain examples, the articulated dump truck includes a frame with a load bin pivotally coupled to the frame. The articulated dump truck generally traverses hills where when going uphill, the transmission often needs to downshift or the engine speed needs to increase to retain a consistent work machine speed. On downhills, an operator may improperly operate the work machine causing it to achieve too much speed, thereby causing excess wear and abuse of some drivetrain components, as well as fuel burning inefficiencies. Additionally, if an operator inappropriately attempts sharp turns with large payloads at high speeds, tipping may become an issue. The following selection of concepts addresses these issues.
This summary is provided to introduce a selection of concepts that are further described below in the detailed description and accompanying drawings. This summary is not intended to identify key or essential features of the appended claims, nor is it intended to be used as an aid in determining the scope of the appended claims.
The present disclosure includes a sensor-augmented guidance system and apparatus which allows for the optimization of the operating parameters of a work machine.
According to an aspect of the present disclosure, the work machine may comprise a front portion including a front frame, a front wheel assembly operably coupled to the front frame to support the front portion, a trailer portion including a rear frame and a bin supported by the rear frame where the bin is configured to support a payload. A first and second rear wheel assemblies may be operably coupled to the rear frame to support the trailer portion. A frame coupling may be positioned between the front frame and the rear frame, the frame coupling being configured to provide a pivoting movement between the front frame and the rear frame.
The sensor-augmented guidance system may comprise of a sensor coupled to the front frame of the work machine wherein the sensor faces a forward direction. The sensor may be configured to collect image data in a field of view of the sensor. The system may further comprise of a sensor processing unit communicatively coupled with the sensor wherein the sensor processing unit is configured to receive the image data from the sensor, and identify either an upcoming terrain or an upcoming travel path based on the image data. The system may further comprise a weight detector positioned to calculate a measured weight of the payload supported by the bin. The system may also comprise a vehicle control unit communicatively coupled with the sensor processing unit and the weight detector, wherein the vehicle control unit is configured to modify the operating parameter of the work machine in response to a predictive load based on the measured weight, and either the upcoming terrain or upcoming travel path.
The system may further comprise an inclination data sensor communicatively coupled to the vehicle control unit. The inclination data sensor may be configured to measure a real-time inclination of the work machine, wherein the vehicle control unit modifies the operating parameter of the work machine in response to the predictive load based on a predictive rate of change of the inclination. The predictive rate of change of the inclination may be calculated from a ground speed and a rate of change of a moving horizon from the image data. Alternatively, the predictive rate of change of the inclination may be based on a moving average of a real-time inclination over a measured distance.
The system may further comprise an attitude data sensor communicatively coupled to the vehicle control unit. The attitude data sensor may be configured to measure a real-time attitude of the work machine. The vehicle control unit may modify the operating parameter of the work machine in response to the predictive load based on the predictive rate of change of the attitude of the work machine. The predictive rate of change of the attitude may be calculated from a ground speed and an angular change of the upcoming travel path.
The sensor processing unit further comprises an edge detection unit. The edge detection unit may identify discontinuities in either the pixel color and pixel intensity of the image data to identify edges of the upcoming terrain or the travel path.
An operating parameter of the work machine may comprise a resistance to movement of a steering wheel in response to the travel path.
An operating parameter of the work machine may also comprise an engine speed, a transmission ration, a hydraulic flow rate, a hydraulic pressure, a rimpull ratio, or a valve position.
An operating parameter of the work machine may also comprise a retarder configured to apply a braking force to either the engine, the transmission, or the drive shaft.
These and other features will become apparent from the following detailed description and accompanying drawings, wherein various features are shown and described by way of illustration. The present disclosure is capable of other and different configurations and its several details are capable of modification in various other respects, all without departing from the scope of the present disclosure. Accordingly, the detailed description and accompanying drawings are to be regarded as illustrative in nature and not as restrictive or limiting.
The embodiments disclosed in the above drawings and the following detailed description are not intended to be exhaustive or to limit the disclosure to these embodiments. Rather, there are several variations and modifications which may be made without departing from the scope of the present disclosure.
As used herein, the term unit refers to any hardware, software, firmware, electronic control component, processing logic, and/or processor device, individually or in any combination, including without limitation: application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Embodiments of the present disclosure may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of the present disclosure may employ various integrated circuit components, e.g. memory elements, digital processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that embodiments of the present disclosure may be practiced in conjunction with any number of systems, and that the articulated dump truck described herein is merely one exemplary embodiment of the present disclosure.
For the sake of brevity, conventional techniques related to signal processing, data transmission, signaling, control, and other functional aspects of the systems and the individual operating components of the systems) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in an embodiment of the present disclosure.
The following describes one or more example implementations of the disclosed sensor-augmented guidance system for optimizing the operating parameters of a work machine by modifying the operating parameters and/or work machine movement based on image data received from the sensor, as shown in the accompanying figures of the drawings described briefly above. Generally, the disclosed control systems (and work vehicles in which they are implemented) provide for improved operating parameters by reducing damage to drivetrain components and reducing fuel waste by anticipating a predictive load on the work machine based on image data of the upcoming terrain or travel path, thereby protecting the work machine and its components from an overrun condition. Although the disclosed control systems are described as applied to an articulated dump truck (ADT) 14, several other work machines may use such systems. These include, but are not limited to, dump trucks, feller bunchers, tractors, loaders, trucks with a payload, to name a few.
With reference to the embodiment in
One or more hydraulic cylinders 70 are mounted to the rear frame 40 and to the bin 45, such that hydraulic cylinders 70 may be driven or actuated to pivot the bin 45 about coupling pins (80, 85). Generally, the work machine 10 includes two hydraulic cylinders 70, one on a left side of the bin 45 and one on a right side of the bin 45. It should be noted, however, that the work machine 10 may have any number of hydraulic cylinders, such as one, three, etc. Each of the hydraulic cylinders 70 includes an end mounted to the rear frame 40 at a pin 80 and an end mounted to the bin 45 at a pin 85. Upon activation of the hydraulic cylinders 70, the bin 45 may be moved from a lowered, loaded position to a raised, unloaded position to dump a payload 65 contained within the bin 45. It should be noted that the “loaded position” is generally a position in which the work machine 10 may carry a payload 65, for transport for example, and the “unloaded position” is generally a position in which the work machine 10 may dump a payload 65 or unload the payload 65 at a work site.
Thus, in the embodiment depicted, the bin 45 is pivotable vertically relative to a horizontal axis by the one or more hydraulic cylinders 70. In other configurations, other movements of bin 45 in alternate directions may be possible for weight stabilization. Further, in some embodiments, a different number or configurations of hydraulic cylinders 70 or other actuators may be used. In another embodiment, such as an ejector bin dump truck (not shown), hydraulic cylinders 70 may be positioned inside the receptacle of the bin 45 wherein the hydraulic cylinders 70 move a wall within the receptacle or a wall forming a portion of the receptacle to unload a payload 65 by pushing the payload out of the bin 45 as opposed to pivoting vertically relative to a horizontal axis. It will be understood that the configuration of the work machine 10 is presented as an example only.
The work machine 10 includes a source of propulsion, such as an engine 95. The engine 95 supplies power to a transmission 110. In one example, the engine is an internal combustion engine, such as the diesel engine, that is controlled by an engine control unit 100. As will be discussed herein, the engine control unit 100 receives one or more control signals or control commands from a vehicle control unit 105 to adjust a power output of the engine 95. It should be noted that the use of an internal combustion engine is merely an example, as the propulsion device can be a fuel cell, an electric motor, a hybrid-gas electric motor, etc., which is responsive to one or more control signals form the vehicle control unit 40 to reduce a power output by the propulsion device.
The transmission 110 transfers the power from the engine 95 to a suitable drivetrain coupled to one more driven wheel assemblies (30, 50, 55) of the work machine 10 to enable the work machine to move. As is known to one skilled in the art, the transmission 110 can include a suitable gear transmission, which can be operated in a variety of ranges containing one or more gears, including but not limited to a park range, a neutral range, a reverse range, a drive range, a low range, etc. A current range of the transmission 110 may be provided by a transmission control unit 115 in communication with the vehicle control unit 105, or may be provided by a sensor that observes a range shifter or range selection unit associated with the transmission 110, as known to one of skill in the art. As will be discussed, the vehicle control unit 105 may output one or more control signals or control commands to the transmission 110 or transmission control unit 115 to limit the ranges available for the operation of the transmission 110.
The work machine 10 may further include one or more speed retarders 117 configured to apply a slowing or braking force to at least one the engine 95, the transmission 110, or the drive shaft 118. A transmission retarder 119 is configured to slow the rotational speed of the transmission 110 and other drivetrain components (such as the drive shaft 118) under certain operating conditions. The transmission retarder 119 may be a hydraulic or hydrodynamic retarder, although other types of retarders may be used. In one embodiment (not shown), the transmission retarder 119 includes a plurality of vanes coupled to a shaft of the transmission and contained within a chamber of transmission retarder. Oil or other suitable fluid is introduced into the chamber of transmission retarder and may interact with the moving vanes to absorb the energy of the drive shaft and to slow the work machine or maintain a steady speed as the machine travels down an incline.
A few more examples of a speed retarder 117 include an exhaust brake and/or an engine brake (collectively referred to as engine retarder 121) to facilitate speed reduction of a work machine 10. For example, an exhaust brake may be mounted in the exhaust of a work machine for restricting airflow and slowing the engine. An engine brake may include an engine valve brake configured to increase compression in the engine 95 to slow the engine. In another embodiment, an electromagnetic retarder may be coupled to a drive shaft 118 to reduce the speed of the engine 95 and transmission 110 (referred to as a driveshaft retarder 122). The vehicle control unit 105 is communicatively coupled to and configured to adjust the strength of one or more speed retarders 117 during a modulation or shift of transmission based on the load condition and inclination of the work machine 10. This improves the shift quality of transmission 110 by providing an input into the transmission control unit 115 configured to facilitate a smoother downhill descent of the work machine as the transmission shifts between gears. As will be discussed below with respect to the sensor-augmented guidance system 90, utilizing a predictive load 235 and the image data 180 from the sensor 175, the vehicle control unit 105 may adjust the strength of speed retarders 117 prior to or during and upshift of downshift of the transmission 110.
The work machine 10 also includes one or more pumps 120, which may be driven by the engine 95 of the work machine 10. Flow from the pumps 120 may be routed through various control valves 125 and various conduits (e.g. flexible hoses) to drive the hydraulic cylinders 70. Flow from the pumps 120 may also power various other components of the work machine 10, aside from mere movement of bin 45 relative to the rear frame 40 of the work machine 10. The flow from the pumps 120 may be controlled in various ways (e.g. through control of the various controls valves 125), to cause movement of the hydraulic cylinders 70, controlling the steering of the ADT, driving a cooling/lubrication system for the transmission 110, engaging speed retarders 117 or hydraulically actuating brakes, e.g.
Generally, a vehicle control unit 105 (or multiple control units) may be provided, for control of various aspects of the operation of the work machine 10, in general. The vehicle control unit 105 (or others) may be configured as a computing device with associated processor devices and memory architectures, as a hard-wired computing circuit (or circuits), as a program-mable circuit, as a hydraulic, electrical or electro-hydraulic controller, or otherwise. As such, the vehicle control unit 105 may be configured to execute various computational and control functionality with respect to the work machine 10 (or other machinery). In some embodiments, the vehicle control unit 40 may be configured to receive input signals in various formats (e.g., as hydraulic signals, voltage signals, current signals, and so on), and to output command signals in various formats (e.g., as hydraulic signals, voltage signals, current signals, mechanical movements, and so on). In some embodiments, the vehicle control unit 105 (or a portion thereof) may be configured as an assembly of hydraulic components (e.g., valves, flow lines, pistons, cylinders, and so on), such that control of various devices (e.g., pumps or motors) may be affected with, and based on, hydraulic, mechanical, or other signals and movements.
The vehicle control unit 105 may be in electronic, hydraulic, mechanical, or other communication with various other systems or devices of the work machine 10 (or other machinery or remote systems). For example, the vehicle control unit 105 may be in electronic or hydraulic communication with various actuators, sensors, and other devices within (or outside of) the work machine 10, including various devices associated with the pumps 120, control valves 125, and so on. The vehicle control unit 105 may communicate with other systems or devices (including other controllers) in various known ways, including via a CAN bus (not shown) of the work machine 10, via wireless or hydraulic communication means, or otherwise. An example location for the vehicle control unit 105 is depicted in
In some embodiments, the vehicle control unit 105 may be configured to receive input commands and to interface with an operator via a human-machine interface 135, which may be disposed inside a cab 130 of the work machine 10 for easy access by the operator. The human-machine interface 135 may be configured in a variety of ways. In some embodiments, the human-machine interface 135 may include one or more joysticks 137, various switches or levers, one or more buttons, a touchscreen interface that may be overlaid on a display 140, a keyboard, a speaker, a microphone associated with a speech recognition system, a steering wheel 136, or various other human-machine interface devices.
With continued reference to
Various sensors may also be provided to observe various conditions associated with the work machine 10. In some embodiments, hydraulic sensors 145 (e.g., pressure, flow, or other sensors) may be disposed near the pumps 120 and control valves 125, or elsewhere on the work machine 10. For example, hydraulic sensors 145 may include one or more pressure sensors that observe a pressure within the hydraulic circuit, such as a pressure associated with at least one of the one or more hydraulic cylinders 70. The hydraulic sensors 145 may also observe a pressure associated with the pumps 120. The hydraulic sensors 145 may comprise weight detectors 150 that may be disposed on or coupled near the bin 45 to measure parameters including the payload 65 supported by the bin 45.
With respect to weight detectors 150, in some embodiments, the weight detectors 150 may include onboard weight (OBW) sensors, etc. In addition, the weight detectors 150 may be coupled to various locations on the work machine 10, such as one or more struts (not shown) of the work machine 10, to measure a load of the work machine 10. Thus, the weight detectors 150 observe a payload 65 of the work machine 10, which may be indicative of the load in the bin 45 or the load of the work machine 10, from which the payload 65 of the bin 45 may be extracted based on a known load of an empty work machine 10.
Other sensors may also be disposed on or near the rear frame 40 to measure parameters, such as an incline or slope of the rear frame 40, and so on. In some embodiments, the sensors may include an incline data sensor or inclination data sensor 160 coupled to or near the rear frame 40 to measure a real-time inclination of the work machine 10. In certain embodiments, the sensor may be an inertial movement unit sensors (IMU) that observe a force of gravity and an acceleration associated with the work machine. In addition, attitude data sensors 155 may be disposed near the rear frame 40 to observe an orientation of the work machine 10 relative to the direction of travel. In some embodiments, the attitude data sensors 155 include angular position sensors coupled between the rear frame 40 and the bin 45 to detect the angular orientation of the rear frame 40 relative to the ground surface 165.
For example, when the work machine 10 is positioned on a slope, the payload 65 detected at rear wheel assemblies (50, 55) may not be representative of the actual payload 65. With the work machine 10 positioned down a slope with the front wheel assembly 30 lower than the rear wheel assemblies (50,55), the work machine may experience a weight transfer toward the front of the work machine, and the detected payload weight may be less than the actual payload weight. Similarly, with the work machine positioned up a slope with the front wheel assembly 30 higher than the rear wheel assembly (50,55), the work machine 10 may experience a weight transfer toward the back of the work machine, and the detected payload weight may be more than the actual payload weight. To reduce the likelihood of a weight calculation error, the vehicle control unit 105 is configured to adjust the detected payload weight based on the detected slope or inclination angle. For example, the vehicle control unit 105 may calculate the actual payload weight (may also be referred to hereinafter as measured weight 170) based on the weight detected at rear wheel assemblies (50,55) with weight detectors 150 and the ground slope angle detected with an inclination data sensor 160.
The work machine 10 also comprises steering inputs as part of the human-machine interface 135 such as a steering wheel 136 or joystick 137. To turn the work machine 10 to the right, the operator rotates the steering wheel 136 in a clockwise direction or moves the joystick 137 in a right direction. Similarly, to turn the work machine to the left, the operator rotates the steering wheel 136 in a counterclockwise direction or moves the joystick 137 in a left direction. The vehicle control unit 105 receives signals from a steering sensor 138 positioned to detect movement of the steering wheel 136 or joystick 137. Based on these signals, the vehicle control unit 105 instructs fluid control provide hydraulic cylinders 70 with the appropriate rate and direction of flow to turn the work machine 10 to the right or to the left. The vehicle control unit 105 provides gain or a relationship between the number of turns of the steering wheel 136 required to turn the work machine 10. This gain, also known as steering resistance 139, may be adjusted by the vehicle control unit 105 based on the speed of the work machine 10 and the measured weight 170 from the weight detector 150 which is variable based on the payload 65. For example, when working at slow speeds, fewer turns of the steering wheel 136 are required to turn a certain angle. When operating in relatively tight conditions such as a quarry, the vehicle control unit 105 may provide a relatively higher gain, or greater sensitivity to wheel turns. Alternatively, when the work machine 10 is on the road and traveling at high speeds, the vehicle control unit 105 may provide a lower gain requiring more turns to turn a certain angle. Detection of the ground speed 270 and measured weight 170 in conjunction with the predictive load 235, to be discussed in detail below, based on the upcoming terrain 185 and the upcoming travel 190 path will be inputs for modifying an operating parameter 230 such as the steering resistance 139. Anticipating large changes in gradient and upcoming sharp turns in the travel path 190 may impact the steering resistance 139 to advantageously prevent the work machine 10 from tipping over.
Now turning to other aspects of the feed forward guidance aspect in the sensor-augmented guidance system 90. The work machine 10 comprises a sensor 175 facing in a generally forward direction (as indicated by the arrow in
Now turning to
The linear Hough transformer receives edge data 275 (e.g. an edge strength indicator) related to the upcoming terrain 185, objects 183, and travel path 190, and identifies the estimated angle and offset of the strong line segments, curved segments or generally linear edges in the image data 180. The linear Hough transformer comprises a feature extractor for identifying line segments of objects with certain shapes from the image data 180. For example, the linear Hough transformer identifies the line equation parameters or ellipse equation parameters of objects in the image data 180 from the edge data 275 outputted by the edge detector, or Hough transformer classifies the edge data 275 as a line segment, an ellipse, or a circle. Thus, it is possible to detect the sub-components such large boulders, divots in the ground, trees, persons, signs, lane marking, or man-made materials such as pipes, each of which may have generally linear, rectangular, elliptical or circular features. Alternatively, the edge detection unit 100 may simply identifying an estimated outline of objects.
The edge detection unit may also identify an upcoming slope for example by tracking movement of an identified horizon 210 (i.e. where the sky meets the earth) using the edge detection unit 215 of the sensor processing unit 205, and measure a change in the horizon 210 in conjunction with the ground speed 270, gradient from the incline data sensor 160, measured weight 170 from the weight detector 170 and attitude from the attitude data sensor 155 of the work machine 10 to identify upcoming terrain 185 and/or the upcoming travel path 190 and calculate a predictive load 235. The sensor 175 (also may be referred to hereinafter as the image data sensor) may operate in the visible spectrum. Devices such as infrared cameras, cameras which utilize movement of the work machine to improve image recognition, RADAR systems, and scanning LIDAR systems may also be used to recognize gradients and/or obstacles. Having recognized a gradient, an obstacle, or the severity of the slope or obstacle and calculating the approximate time when such a gradient or obstacle will be encountered, the vehicle control unit 105 may select to modify one of several operating parameters 230 (shown in
Now turning to
The vehicle control unit 105 also outputs one or more control signals 225 or control commands to the engine control unit 100 to modify a speed of the engine 95 based on the predictive load 235 calculated from one or more of the sensor signals received from the sensors 145, 150, 155, 160, 270, 138, and 175, and input received from the human-machine interface 135. The vehicle control unit 105 may further output one or more control signals 225 or control commands to the transmission control unit 115 to reduce the number of ranges available for the transmission 110 based on one or more of the sensor signals received from the sensors 145, 150, 155, 160, 270, 138, and 175, and input received from the human-machine interface 135. The reduction in the number of ranges available slows or reduces the speed of the work machine 10. On the contrary, increasing the number of ranges available increases the speed of the work machine 10. Additionally, other operating parameters 230 affected may be a speed retarder 117, driveshaft 118 (or other drivetrain components), and rimpull 280.
Returning to
Alternatively, or in conjunction with the above, the image processing unit 255 may identify a set of two-dimensional or three-dimensional points (e.g. Cartesian coordinates or Polar coordinates) in the collected image data 180 that define a shrub, an aggregate of points defining shrubs, or both. The set of two-dimensional or three-dimensional points may correspond to pixel positions in images collected by the sensor 175 (for a non-stereoscopic device image analysis). The image processing unit 255 may rectify the image data 180 to optimize analysis. The image processing unit 255 may use color discrimination, intensity discrimination, or texture discrimination to identify pixels from one or more object pixels from the image data 62 and associate them with pixel patterns, pixel attributes (e.g. color or color patterns like Red Green Blue (RGB) pixel values), pixel intensity patterns, texture patterns, luminosity, brightness, hue, or reflectivity to identify the upcoming terrain 185 (examples of which were previously discussed) and the travel path 190, and the spatial offset 260 from the sensor 175 with a calculated or measured spatial offset 260 of the object, upcoming ascending travel path or descending travel path from the sensor 175 based on a change in the horizon 210 (designated by the dotted line 210′ and solid horizontal line 210 in
One or more of the steps or operations in any of the processes, or systems discussed herein may be omitted, repeated, or re-ordered and are within the scope of the present disclosure.
While the above describes example embodiments of the present disclosure, these descriptions should not be viewed in a restrictive or limiting sense. Rather, there are several variations and modifications which may be made without departing from the scope of the appended claims.