The present invention relates to an intrusion monitoring control system and a work machine.
For example, it is required to control operation of a work machine such as a hydraulic excavator such that the work machine and an obstacle such as a worker or another work machine do not interfere with each other when the obstacle has intruded into a work range.
As a technology related to such control of a work machine in relation to obstacles, for example, Patent Document 1 discloses a stop control method to be performed regarding an intrusion prohibited area for a work vehicle (work machine) in which an intrusion prohibited area is preset around the work vehicle (work machine), the position of an intruding object such as an worker having intruded into a work area is sensed, and when the intruding object has entered the set intrusion prohibited area, the work vehicle (work machine) is stopped. In the stop control method to be performed regarding the intrusion prohibited area of the work vehicle (work machine), the intrusion prohibited area can be changed according to the work contents of the intruding object such as the worker.
However, in the conventional technology described above, a relation between the intrusion prohibited area set according to an operation range of the work machine and a monitoring range of a monitoring apparatus is not necessarily taken into consideration sufficiently, and there is concern over the occurrence of problems like the ones below. That is, in the conventional technology described above, for example, when the intrusion prohibited area where intrusion by an intruding object such as an worker is prohibited is set around the work machine, if the intrusion prohibited area is set such that it includes an area outside the monitoring range of the monitoring apparatus, an intruding object cannot be detected in the intrusion prohibited area set outside the monitoring range of the monitoring apparatus. In addition, in the conventional technology, since it is not supposed a case where a plurality of monitoring apparatuses are used, if coordination among these monitoring apparatuses is not ensured where the monitoring ranges of the monitoring apparatuses are arranged so as to overlap each other, there has been a fear that a structure included in the work machine is erroneously detected as an intruding object by any one of the monitoring apparatuses undesirably.
The present invention has been made in view of the description above, and an object of the present invention is to provide an intrusion monitoring control system and a work machine that make it possible to appropriately set an intrusion prohibited area, and reduce detection failures and detection errors.
The present application includes a plurality of means for solving the problems described above, and an example thereof is an intrusion monitoring control system including: a monitoring apparatus that detects an obstacle located around a work machine, and outputs obstacle information; and a controller that is configured to calculate an operation limiting command for limiting operation of the work machine in accordance with an intrusion prohibited area set on the basis of a result of comparison between a movable range of the work machine and a monitoring range of the monitoring apparatus and in accordance with the obstacle information from the monitoring apparatus.
According to the present invention, it is possible to appropriately set an intrusion prohibited area, and reduce detection failures and detection errors.
Embodiments of the present invention are explained below with reference to the figures.
Note that although a hydraulic excavator including a work implement (front work implement) is explained as an example of a work machine in the present embodiments, for example, the present invention can be applied also to a road machine such as a road roller, a crane, and the like in addition to another work machine such as a wheel loader.
In addition, although alphabetical characters are given at the ends of reference characters (numbers) in some cases when there are a plurality of identical constituent elements in the explanation below, the plurality of constituent elements are written collectively by omitting the alphabetical characters in some cases. For example, if there are four inertial measurement units 13a to 13d, these are collectively denoted as inertial measurement units 13 in some cases.
A first embodiment of the present invention is explained in detail with reference to
The present embodiment relates to an intrusion monitoring control system that detects obstacles located around a work machine (e.g. a hydraulic excavator M1) by one or more monitoring apparatuses N1, . . . , and Nn (n: positive integer) (see
In
The base end of the boom 11 of the front work implement 15 is vertically pivotably supported at a front portion of the upper swing structure 10, one end of the arm 12 is vertically pivotably supported at the tip of the boom 11, and a bucket 8 is vertically pivotably supported at another end of the arm 12 via a bucket link 8a.
The boom 11, the arm 12, the bucket 8, the upper swing structure 10, and the lower travel structure 9 are driven by a boom cylinder 5, an arm cylinder 6, a bucket cylinder 7, a swing hydraulic motor 4, and left and right travel hydraulic motors 3 (only the left side 3b is depicted), respectively, which are hydraulic actuators. The travel hydraulic motors 3 function as a moving apparatus by driving a pair of left and right crawlers.
In an operation room 16 which an operator gets on, a right operation lever device 1c and a left operation lever device 1d that output operation signals for operating the hydraulic actuators 5 to 7 of the front work implement 15 and the swing hydraulic motor 4 of the upper swing structure 10, a travel right operation lever device 1a and a travel left operation lever device 1b that output operation signals for operating the left and right travel hydraulic motors 3 of the lower travel structure 9, and a controller (controller) 100 are provided.
The operation lever devices 1a, 1b, 1c, and 1d are electric operation lever devices that output electric signals as operation signals, and have operation levers that are operated to be inclined forward/backward and leftward/rightward by the operator, and electric signal generating sections that generate electric signals according to the inclination directions and inclination amounts (lever operation amounts) of the operation levers. Electric signals output from the operation lever devices 1c and 1d are input to the controller 100 via electric wires. In the present embodiment, forward/backward operation and leftward/rightward operation of the operation lever of the right operation lever device 1c corresponds to operation of the boom cylinder 5 and operation of the bucket cylinder 7, respectively. On the other hand, forward/backward operation and leftward/rightward operation of the operation lever of the left operation lever device 1d correspond to operation of the swing hydraulic motor 4 and operation of the arm cylinder 6, respectively.
Operation control of the boom cylinder 5, the arm cylinder 6, the bucket cylinder 7, the swing hydraulic motor 4, and the left and right travel hydraulic motors 3 is performed by controlling, by using a control valve 20, the direction and flow rate of a hydraulic working fluid supplied from a hydraulic pump apparatus 2 driven by a prime mover (an engine 14 in the present embodiment) such as an engine or an electric motor to the hydraulic actuators 3 and 4 to 7.
Operation of the control valve 20 is controlled by operation control signals output from the controller 100. For example, the control valve 20 has a plurality of solenoid proportional valves as a functionality to generate pilot pressures on the basis of the operation control signals, the control valve 20 is driven by the pilot pressures generated on the basis of the operation control signals, and the direction and flow rate of the hydraulic working fluid supplied from the hydraulic pump apparatus 2 to the hydraulic actuators 3 and 4 to 7 are controlled.
By the operation control signals being output from the controller 100 to the control valve 20 on the basis of operation of the travel right operation lever device 1a and the travel left operation lever device 1b, operation of the left and right travel hydraulic motors 3 of the lower travel structure 9 is controlled. In addition, by the operation control signals being output from the controller 100 to the control valve 20 on the basis of the operation signals from the operation lever devices 1c and 1d, operation of the hydraulic actuators 4 to 7 is controlled. The extension and contraction of the boom cylinder 5 pivots the boom 11 vertically relative to the upper swing structure 10, the extension and contraction of the arm cylinder 6 pivots the arm 12 upward/downward and forward/backward relative to the boom 11, and the extension and contraction of the bucket cylinder 7 pivots the bucket 8 upward/downward and forward/backward relative to the arm 12.
Inertial measurement units (IMUs: Inertial Measurement Units) 13a to 13d as posture information acquiring devices for acquiring posture information are arranged near a coupling portion of the boom 11 with the upper swing structure 10, near a coupling portion of the arm 12 with the boom 11, at the bucket link 8a, and at the upper swing structure 10, respectively. The inertial measurement unit 13a is a posture information acquiring device (boom posture sensor) that senses the angle (boom angle) of the boom 11 relative to the horizontal plane, the inertial measurement unit 13b is a posture information acquiring device (arm posture sensor) that senses the angle (arm angle) of the arm 12 relative to the horizontal plane, and the inertial measurement unit 13c is a posture information acquiring device (bucket posture sensor) that senses the angle of the bucket link 8a relative to the horizontal plane. In addition, the inertial measurement unit 13d is a posture information acquiring device (machine body posture sensor) that senses the inclination angles (the roll angle and pitch angle) of the upper swing structure 10 relative to the horizontal plane.
The inertial measurement units 13a to 13d measure angular velocities and accelerations. Supposing that the upper swing structure 10 and the driven members (the bucket (work tool) 8, the boom 11, and the arm 12) having the inertial measurement units 13a to 13d arranged thereon are stationary, the angles of the upper swing structure 10 and the driven members (the bucket (work tool) 8, the boom 11, and the arm 12) relative to the horizontal plane can be sensed on the basis of the directions (i.e. the vertically downward direction) of gravitational accelerations in IMU coordinate systems set for the inertial measurement units 13a to 13d, and the attachment states of the inertial measurement units 13a to 13d (i.e. each relative positional relation between one of the inertial measurement units 13a to 13d and a corresponding one of the upper swing structure 10 and the driven members (the bucket (work tool) 8, the boom 11, and the arm 12). Here, the inertial measurement units 13a to 13c are included in a posture information acquiring device that acquires posture information (an angle signal) of each of the boom 11, the arm 12, and the bucket (work tool) 8.
Note that the posture information acquiring device may use not only the inertial measurement units (IMUs), but may instead be configured to acquire posture information by using inclination angle sensors, for example. In addition, potentiometers may be arranged at the coupling portions of the driven members (the bucket (work tool) 8, the boom 11, and the arm 12), relative directions (posture information) of the upper swing structure 10 and the driven members (the bucket (work tool) 8, the boom 11, and the arm 12) may be sensed, and the postures (angles relative to the horizontal plane) of the driven members (the bucket (work tool) 8, the boom 11, and the arm 12) may be determined from the sensing results. In addition, stroke sensors may be arranged at the boom cylinder 5, the arm cylinder 6, and the bucket cylinder 7, relative directions (posture information) at connecting portions of the upper swing structure 10 and the driven members (the bucket (work tool) 8, the boom 11 and the arm 12) may be calculated from stroke change amounts, and the postures (angles relative to the horizontal plane) of the driven members (the bucket (work tool) 8, the boom 11, and the arm 12) may be determined from the results of the calculation, in another possible configuration.
On the upper swing structure 10, positioning apparatuses 18a and 18b as position information acquiring apparatuses that acquire machine position information which is information about the position of the machine body are provided. The positioning apparatuses 18a and 18b are global navigation satellite systems (GNSSs), for example. A GNSS is a satellite positioning system that receives signals from a plurality of satellites, and finds its position on the Earth. The positioning apparatus 18a and 18b receive signals (electric waves) from a plurality of GNSS satellites (not depicted) positioned in the space above the Earth, and by performing computations on the basis of the obtained signals, acquire the positions of the positioning apparatuses 18a and 18b in the terrestrial coordinate system. Relative mounting positions of the positioning apparatuses 18a and 18b relative to the hydraulic excavator M1 are known in advance from design information or the like, and thus by acquiring the positions of the positioning apparatuses 18a and 18b in the terrestrial coordinate system, the position and direction (azimuth) of the hydraulic excavator M1 relative to reference points of a construction site can be acquired as machine position information. Note that it is supposed in the present embodiment that the machine position information is represented in a local coordinate system set for the construction site.
The controller 100 receives, as input, the operation signals from the operation lever devices 1a to 1d, the posture information from the inertial measurement units 13a to 13d, the machine position information from the positioning apparatuses 18a and 18b, and monitoring range information (mentioned later) and obstacle information (mentioned later) from the monitoring apparatuses N1, . . . , and Nn received via a communication apparatus 101, and the controller 100 outputs the operation control signals on the basis of the input, and drives the control valve 20. Note that the number of the monitoring apparatuses N1, . . . , and Nn may be one or greater than one, and when there are a plurality of the monitoring apparatuses N1, . . . , and Nn, obstacle information and monitoring range information are input separately from each of the monitoring apparatuses N1, . . . , and Nn.
In
The sensing section N11 can sense the position of an object such as an obstacle having intruded into the inside of a preset monitoring range Q1. The monitoring range Q1 is set as specifications in advance, and is stored on a storage section of the monitoring apparatus N1 which is not depicted. The sensing section N11 senses, as obstacle information, the position of an object in a coordinate system set for the monitoring apparatus N1.
For example, the positioning apparatus N12 includes a global navigation satellite system (GNSS) and an azimuth measuring apparatus (e.g. an electromagnetic compass using a geomagnetic sensor or the like), and can sense the position and direction (azimuth) of the monitoring apparatus N1.
The communication section N13 transmits the monitoring range information and the obstacle information from the monitoring apparatus N1 to the communication apparatus 101 of the hydraulic excavator M1.
The monitoring apparatus N1 has a functionality of converting the monitoring range Q1 and obstacle information into a monitoring range Q1 and obstacle information in the local coordinate system set for the construction site on the basis of the position and azimuth of the positioning apparatus N12, and transmits, from the communication section N13 to the hydraulic excavator M1, the converted monitoring range Q1 in the local coordinate system as monitoring range information, along with the converted obstacle information in the local coordinate system. That is, in the present embodiment, the obstacle information and the monitoring range information are both represented in the local coordinate system set for the construction site.
Note that although the monitoring apparatus N1 includes the positioning apparatus N12 in the configuration depicted as an example explained in the present embodiment, this is not the sole example, and, for example, the position and azimuth of the monitoring apparatus N1 in the local coordinate system may be measured in advance, and input to (stored on) the monitoring apparatus N1 in advance, in another possible configuration.
In
The movable range acquiring section 110 computes a movable range of the hydraulic excavator M1 on the basis of the machine position information from the positioning apparatuses 18a and 18b, and outputs the movable range to the intrusion prohibited area setting section 130 and the operation limiting control section 140. For example, the movable range may be the maximum swing radius of the hydraulic excavator M1. Alternatively, the posture information also may be input to the movable range acquiring section 110, and an operation range where the hydraulic excavator M1 at its current position and posture can reach within a predetermined length of time may be computed as the movable range. The maximum swing radius of the hydraulic excavator M1 is used as the movable range in the case explained as an example in the following explanation.
The monitoring range acquiring section 120 computes, on the basis of the monitoring range information from the monitoring apparatuses N1, . . . , and Nn, a monitoring range as a range where any one of the monitoring apparatuses N1, . . . , and Nn can perform monitoring, and outputs the monitoring range to the intrusion prohibited area setting section 130 and the operation limiting control section 140.
The intrusion prohibited area setting section 130 computes an intrusion prohibited area on the basis of the movable range from the movable range acquiring section 110 and the monitoring range from the monitoring range acquiring section 120, and outputs the intrusion prohibited area to the operation limiting control section 140. Note that the computation of the intrusion prohibited area at the intrusion prohibited area setting section 130 is mentioned later.
The operation limiting control section 140 computes an operation limiting command on the basis of the movable range from the movable range acquiring section 110, the monitoring range from the monitoring range acquiring section 120, the intrusion prohibited area from the intrusion prohibited area setting section 130, and the obstacle information from the monitoring apparatuses N1, . . . , and Nn, and outputs the operation limiting command to the operation limiting section 150. Note that the computation of the operation limiting command at the operation limiting control section 140 is mentioned later.
The machine control section 160 computes an operation control signal on the basis of the operation signals from the operation lever devices 1a to 1d and the posture information from the inertial measurement units 13a to 13d, and outputs the operation control signal to the control valve 20 via the operation limiting section 150.
The operation limiting section 150 limits the transfer, to the control valve 20, of the operation control signal output from the machine control section 160, on the basis of the operation limiting command from the operation limiting control section 140. That is, the operation limiting section 150 stops driving of the control valve 20 by interrupting the operation control signal output from the machine control section 160 to the control valve 20 and stops (limits) operation of the hydraulic actuators 4 to 7 when an operation stop command (mentioned later) is being output as the operation limiting command from the operation limiting control section 140. In addition, the operation limiting section 150 limits driving of the control valve 20 by limiting the operation control signal output from the machine control section 160 to the control valve 20 (e.g. reducing the signal at a rate) and limits the velocities of the hydraulic actuators 4 to 7 when a velocity limiting command (mentioned later) is being output as the operation limiting command from the operation limiting control section 140. In addition, the operation limiting section 150 permits the transfer, to the control valve 20, of the operation control signal output from the machine control section 160 when the operation limiting command is not being output from the operation limiting control section 140.
In
Next, as depicted in
Next, as depicted in
Next, as depicted in
Next, as depicted in
In
Note that in addition to deciding an intruding object as an obstacle in a case where the intruding object has entered the intrusion prohibited area P1, a part of the hydraulic excavator M1 is decided as an obstacle also in a case where the part of the hydraulic excavator M1 has entered the intrusion prohibited area, and operation of the hydraulic excavator M1 is stopped. By performing control in this manner, in addition to being able to stop the hydraulic excavator M1 in a case where an intruding object has entered the intrusion prohibited area P1, it is also possible to prevent the hydraulic excavator M1 from going out of the intrusion prohibited area P1.
Next, the movable range of the hydraulic excavator M1 and the monitoring ranges Q1 and Q2 of the monitoring apparatuses N1 and N2 are compared with each other, and it is decided whether or not the entire movable range is included in the monitoring ranges Q1 and Q2 (Step S210). When the result of the decision at Step S210 is NO, that is, when at least a part of the movable range is not included in the monitoring ranges Q1 and Q2, the operation limiting control section 140 outputs, to the operation limiting section 150, the velocity limiting command as the operation limiting command, limits the operation velocity of the hydraulic excavator M1 (Step S211), and ends the process. An example of the case where at least a part of the movable range is not included in the monitoring ranges Q1 and Q2 is, for example, a case where an area W1x which is a part of a movable area W1 is not included in the monitoring ranges Q1 and Q2, as depicted in
By limiting the velocity of the hydraulic excavator M1 in a case where even a part of the movable range is not included in the monitoring ranges Q1 and Q2 in this manner, the velocity of the hydraulic excavator M1 can be limited in advance also in a case where there is a possibility that the hydraulic excavator M1 goes out of the intrusion prohibited area P1, and it is possible to more surely prevent the hydraulic excavator M1 from going out of the intrusion prohibited area P1. Note that in order to more surely prevent the hydraulic excavator M1 from going out of the intrusion prohibited area P1, the extent of reduction of the velocity of the hydraulic excavator M1 may be increased as the area size of the area W1x increases, in another possible configuration.
Advantages of the thus configured present embodiment are explained by using
In conventional technologies, a relation between a monitoring range of a monitoring apparatus and an intrusion prohibited area set according to an operation range of a work machine is not necessarily taken into consideration sufficiently. For example, there are possibilities that an intruding object cannot be detected when the intrusion prohibited area is set outside the monitoring range of the monitoring apparatus, that the work machine is erroneously detected as an intruding object undesirably when a plurality of monitoring ranges are set so as to overlap each other, and so on. That is, for example, when the surroundings of a work machine M1 is set as the intrusion prohibited area P1 as depicted in
In contrast to this, in the present embodiment, since the configuration includes: the monitoring apparatuses N1 and N2 that detect an obstacle located around the hydraulic excavator M1, and output the obstacle information; and the controller 100 that calculates the operation limiting command for limiting operation of the hydraulic excavator M1 in accordance with the obstacle information from the monitoring apparatuses N1 and N2, and the intrusion prohibited area P1 set on the basis of a result of comparison between the movable range of the hydraulic excavator M1 and the monitoring ranges of the monitoring apparatuses N1 and N2, it is possible to appropriately set the intrusion prohibited area, and reduce detection failures and detection errors.
A second embodiment of the present invention is explained with reference to
The present embodiment includes a warning notification control section 240 that outputs a warning notification command, in addition to the operation limiting control section 140 in the first embodiment.
In
The warning notification control section 240 computes a warning notification command on the basis of the intrusion prohibited area from the intrusion prohibited area setting section 130, and the obstacle information from the monitoring apparatuses N1, . . . , and Nn, and outputs the warning notification command to a notification device 200. Note that the computation of the warning notification command at the warning notification control section 240 is performed similarly to the computation of the operation limiting command at the operation limiting control section 140 in the first embodiment. That is, the warning notification control section 240 decides, in addition to deciding an intruding object as an obstacle when the intruding object has entered the intrusion prohibited area P1, a part of the hydraulic excavator M1 as an obstacle also when the part of the hydraulic excavator M1 has entered the intrusion prohibited area, and causes the notification device 200 to give a warning by outputting the warning notification command to the notification device 200.
The configuration of the second embodiment is similar to the first embodiment in other respects.
In the thus configured present embodiment also, advantages similar to the first embodiment can be attained.
Next, features of each embodiment described above are explained.
(1) In the embodiments described above, monitoring apparatuses N1, . . . , and Nm that detect an obstacle located around a work machine (e.g. the hydraulic excavator M1), and outputs obstacle information; and a controller (e.g. the controller 100; 100A) that calculates an operation limiting command for limiting operation of the work machine in accordance with an intrusion prohibited area P1 set on the basis of a result of comparison between a movable range of the work machine and monitoring ranges of the monitoring apparatuses and in accordance with the obstacle information from the monitoring apparatuses are included.
Thereby, it is possible to appropriately set an intrusion prohibited area, and reduce detection failures and detection errors.
(2) In addition, in the embodiments described above, in the intrusion monitoring control system according to (1), the work machine (e.g. the hydraulic excavator M1) includes the controller (e.g. the controller 100; 100A), and the controller limits the operation of the work machine on the basis of the obstacle information from the monitoring apparatuses N1, . . . , and Nn.
(3) In addition, in the embodiments described above, in the intrusion monitoring control system according to (1), the monitoring apparatuses N1, . . . , and Nn include the controller (e.g. the controller 100; 100A), and the work machine (e.g. the hydraulic excavator M1) limits the operation thereof on the basis of the operation limiting command from the controller.
(4) In addition, in the embodiments described above, in a work machine (e.g. the hydraulic excavator M1) that operates at a construction site, and includes a controller (e.g. the controller 100; 100A) that controls operation of the work machine, the controller is configured to calculate an operation limiting command for limiting the operation of the work machine in accordance with an intrusion prohibited area P1 set on the basis of a result of comparison between monitoring ranges of monitoring apparatuses N1, . . . , and Nn that detect an obstacle located around the work machine and output obstacle information and a movable range of the work machine and in accordance with the obstacle information from the monitoring apparatuses, and limits the operation of the work machine according to the operation limiting command.
<Notes>
Note that the present invention is not limited to the embodiments described above, and includes various modification examples and combinations within the scope not deviating from the gist of the present invention. In addition, the present invention is not limited to ones including all configurations explained in the embodiments described above, and includes ones from which some of the configurations are deleted. In addition, the configurations, functionalities, and the like described above may partially or entirely be realized by designing them on an integrated circuit, and so on, for example. In addition, the configurations, functionalities, and the like described above may be realized by software by a processor interpreting and executing a program to realize the functionalities.
In addition, although the controllers 100 and 100A are mounted on the hydraulic excavator M1 in the configuration explained in the present embodiment, for example, a control system of the hydraulic excavator (work machine) M1 that includes the controller 100 arranged separately from the hydraulic excavator M1 and enables remote operation of the hydraulic excavator M1 may be configured. In addition, in another possible configuration, functional sections of the controllers 100 and 100A other than the operation limiting section 150 and the machine control section 160 may be separated from the hydraulic excavator M1, and arranged in the monitoring apparatuses N1, . . . , and Nn, for example.
Number | Date | Country | Kind |
---|---|---|---|
2019-184054 | Oct 2019 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2020/037280 | 9/30/2020 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2021/066057 | 4/8/2021 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20080122604 | Hattori | May 2008 | A1 |
20180274206 | Kozui et al. | Sep 2018 | A1 |
20190194913 | Petrany et al. | Jun 2019 | A1 |
Number | Date | Country |
---|---|---|
2716821 | Apr 2014 | EP |
09-125466 | May 1997 | JP |
2003-105807 | Apr 2003 | JP |
2012-203677 | Oct 2012 | JP |
2016194481 | Nov 2016 | JP |
2018-159194 | Oct 2018 | JP |
2020-173524 | Oct 2020 | JP |
Entry |
---|
English Translation for JP-2016194481-A (Year: 2024). |
Extended European Search Report received in corresponding European Application No. 20870529.3 dated Aug. 14, 2023. |
International Search Report of PCT/JP2020/037280 dated Dec. 22, 2020. |
International Preliminary Report on Patentability received in corresponding International Application No. PCT/JP2020/037280 dated Apr. 14, 2022. |
Number | Date | Country | |
---|---|---|---|
20220316184 A1 | Oct 2022 | US |