The present invention relates to a system which controls a work machine from a remote place, and particularly to a system in which a machine controls the traveling work machine from a remote place.
A work machine such as a construction machine and a transportation machine is generally configured such that an operator gets thereon and operates various types of levers and a handle to realize a desired work. In a case where these work machines are used at a place where a hill may be collapsed for example, there may be used a remote control unit such as an unmanned work machine which is controlled by the operator using a control facility installed at a remote place.
In the remote control of the work machine, an image captured by a camera attached in the work machine is transmitted to the control facility at the remote place in a wired or wireless manner, and the image is displayed on a monitor in the control facility. The operator operates an input device such as a control lever in the control facility while watching the image on the monitor and transmits an operation signal instructed by the input device to the work machine. Therefore, the work machine is operated in accordance with the instruction of the operator, and the control of the work machine from the remote place is realized.
Regarding typical remote control of such a work machine, PTLs 1 and 2 disclose remote control systems which provide information other than the image to the operator.
PTL 1 discloses a system for controlling a tower crane at a remote place, and an omniazimuth camera, a revolving sensor which detects a revolving position of a boom, and an inclination sensor which detects an inclination state of a virtual control seat in the tower crane are provided in the tower crane. Information obtained from these sensors are transmitted to a remote control room, and the control seat where an actual operator sits is rotated and inclined in synchronization with the revolving position of the boom and an inclination angle of a virtual control seat. With such a configuration, a state where the operator sits on the original control seat can be realized in real time even in the case of the remote control. The tower crane can be remotely operated without any uncomfortable feeling as usual.
In PTL 2, an operation force (excavating force and torsion) of the hydraulic shovel is detected by an operation force detector, and transmitted to a control device at the remote place. In the control device, the excavating force and the torsion are converted to have magnitudes of two sinusoidal waves by a controller, a seat where the operator sits is vibrated in the vertical direction using the sinusoidal wave based on the excavating force, and rotated using the sinusoidal wave based on the torsion. With such a configuration, it is possible to give a sense of realism so that the operator can feel the operation force. Furthermore, the workability can be improved.
PTL 1: Japanese Patent Application Laid-Open No. 2013-116773
PTL 2: Japanese Patent Application Laid-Open No. H9-217382
As disclosed in these literatures, the information, which the operator feels other than visual sense at the time of sitting in the machine, such as the inclination, the rotation, and the operation force of the machine as well as the image are provided in the remote control of the work machine as sensible information such as moving the seat where the operator sits even to a remote control facility. Therefore, the operator can make an operation without any uncomfortable feeling but just as a normal pattern. Further, since an obtained information amount is increased, an improvement in safety and workability can be expected.
However, when the sensible vibration and shaking such as the movement of the seat is transferred to the operator, the operator may feel fatigue. Therefore, the information less important for the work among the feeling information such as the inclination and the rotation of the machine may be not provided to the operator, so that the fatigue of the operator is reduced when the seat moves as less as possible by narrowing only the necessary information. An object of the invention is to provide a remote control system which provides sensible information to the operator by moving the seat in order to realize a reduction in fatigue of the operator without affecting on safety and workability.
In order to solve the above issue, according to the present invention, there is provided a remote control system for a work machine which is controlled by an operator from a remote control facility installed at a remote place, wherein the work machine includes a traveling unit, and an inclination detection unit that detects an inclination direction and an inclination amount of the machine, the remote control facility includes a seat on which the operator sits, and an inclination driving unit that inclines the seat, the inclination driving unit inclines the seat such that the seat is synchronized with the inclination direction and the inclination amount detected by the inclination detection unit when the work machine is traveling, and the inclination of the seat is controlled to keep a certain inclination amount when the work machine is not traveling.
In addition, according to the present invention, in the remote control system of the work machine, the seat is inclined to be synchronized with a low frequency component of the inclination amount detected by the inclination detection unit when the work machine is not traveling.
In addition, according to the present invention, in the remote control system of the work machine, the work machine includes a traveling state detection unit that detects whether the work machine is traveling or stopped, the inclination driving unit inclines the seat to be synchronized with the inclination direction and the inclination amount detected by the inclination detection unit during a period when the traveling state detection unit detects that the work machine is traveling, and the inclination of the seat is controlled to be kept in an inclination amount detected by the inclination detection unit at the time when the traveling state detection unit is switched from a traveling state to a stopped state during a period when the traveling state detection unit detects that the work machine is stopped.
In addition, according to the present invention, in the remote control system of the work machine, the work machine is configured by a traveling body and a revolving body that is supported to be rotatably about a vertical axis with respect to the traveling body, and includes a revolving detection unit that detects a rotation amount of the revolving body with respect to the traveling body, and when the work machine is not traveling, an inclination direction of the traveling body is directly or indirectly acquired by the inclination detection unit, an inclination direction of the revolving body is derived on the basis of the rotation amount detected by the revolving detection unit with respect to the inclination direction of the traveling body, and the seat is inclined to be synchronized with the revolving body in the inclination direction.
In addition, according to the present invention, in the remote control system of the work machine, the work machine includes an image detection unit that detects an image viewed from the machine, the remote control facility includes an image output unit that indicates an image to the operator, the image detected by the image detection unit is output to the image output unit without any change when the work machine is traveling, and when the work machine is not traveling, a vibration component in the image detected by the image detection unit caused by an inclination vibration of the machine is removed and then output by the image output unit.
According to the invention, inclination information of the machine is provided to the operator to be sensible by moving the seat when the work machine is traveling. However, when the work machine is not traveling and doing the work such as excavating, loading, and transporting, the inclination information of the machine is not provided to the operator.
In general, a static inclination angle of the work machine is changed in a case where there is a step or a slope way in the ground surface where the work machine is placed. When the work machine is not traveling, the static inclination angle is not changed. In addition, the inclination information is necessary for the operator in real time when the work machine is traveling. In a case where the work machine runs over on a slope way, a step, or at a sunken place, there is a need to know whether the inclination angle is sufficiently safe for the machine not to be overturning. On the other hand, the machine is basically not traveling but stopped during the work such as excavating, loading, and transporting, and various mechanisms are operated for the work. At this time, the machine may be vibrated by a specific operation such as an emergency stop of the mechanisms and thus a dynamic inclination angle may be changed. The information on a dynamic inclination angle such as a vibration of the machine is not necessary when the operator is doing work, and may accumulate fatigue on the operator.
According to the invention, the operator can be known about the inclination information necessary during the traveling of the machine in real time, and the safety is increased. Further, the operator is not affected by the vibration of the machine occurring at the time of actual working, and thus the workability is improved. In addition, it is possible to reduce the fatigue of the operator.
Hereinafter, embodiments of the invention will be described with reference to the drawings.
The entire configurations of a remote control system of a work machine according to the first embodiment will be described using
The remote control system of the hydraulic shovel according to the first embodiment mainly includes a hydraulic shovel 1 which is a remote control target, and a remote control facility 3 which is installed at a remote place and includes various parts necessary for an actual control of an operator.
Similarly to a typical hydraulic shovel, the hydraulic shovel 1 is configured by a revolving superstructure 11, a lower structure 12 including a crawler, a boom 13 forming a front portion for excavating work, an arm 14, a bucket 15, a boom cylinder 16 which drives the boom 13, an arm cylinder 17 which drives the arm 14, a bucket cylinder 18 which drives the bucket 15, and a driver seat 19 which is provided in the revolving superstructure 11.
The revolving superstructure 11 is rotatably supported to the lower structure 12, and the revolving superstructure 11 is rotatably driven relatively to the lower structure 12 by a revolving motor (not illustrated). One end of the boom 13 is rotatably supported to the revolving superstructure 11, and the boom 13 is rotatably driven relatively to the revolving superstructure 11 according to the stretching of the boom cylinder 16. One end of the arm 14 is rotatably supported to the boom 13, and the arm 14 is rotatably driven relatively to the boom 13 according to the stretching of the arm cylinder 17. The bucket 15 is rotatably supported to the arm 14, and the bucket 15 is rotatably driven relatively to the arm 14 according to the stretching of the bucket cylinder 18. The hydraulic shovel 1 having such a configuration controls the bucket 15 to an arbitrary position and to a posture by driving the revolving motor, the boom cylinder 16, the arm cylinder 17, and the bucket cylinder 18 to be at appropriate positions, so that a desired work can be performed. The revolving motor and the respective cylinders are controlled by a vehicle control unit 26, and can move the revolving motor and the respective cylinders by sending a lever signal indicating a control of each part to the vehicle control unit 26.
Further, the driver seat 19 is disposed in the hydraulic shovel 1 in this embodiment, but the driver seat 19 is not necessarily required since the hydraulic shovel is a remote controlled machine. However, it is sufficiently considered that an operator partially gets on even when the hydraulic shovel is an actual target machine to be remotely controlled. In addition, since there is a low necessity to intentionally exclude the driver seat, the driver seat 19 is disposed in the hydraulic shovel 1 in this embodiment.
Besides these configurations, the hydraulic shovel 1 in this embodiment includes a camera 20 which is disposed in the revolving superstructure 11 and serves as an image detection unit to detect an image viewed from the machine, an inclination sensor 21 which is disposed in the revolving superstructure 11 and serves as an inclination detection unit to detect an inclination direction and an inclination amount of the machine, a revolving sensor 22 which serves as a revolving detection unit to detect a rotation amount of the revolving superstructure 11 with respect to the lower structure 12, a traveling rotation sensor 23 which serves as a traveling state detection unit to detect a rotation frequency of a traveling motor, a vehicle-side remote control unit 25 which acquires and processes signals from these sensors, and a wireless communication antenna 24. Further, the revolving detection unit may have a function of detecting each angular speed of the revolving superstructure 11 and integrating the detected angular speed to obtain the rotation amount as well as acquiring a relative rotation amount between the lower structure 12 and the revolving superstructure 11. In addition, the traveling state detection unit may have a function of determining whether the traveling is kept on by an instruction from a control signal of the operator as well as detecting the rotation frequency of the traveling motor.
With this configuration, the image viewed from the machine, the inclination direction and the inclination amount of the machine, the revolving amount, and the traveling speed are acquired by the respective sensors and subjected to an appropriate process by the vehicle-side remote control unit 25. Then, the information can be transmitted to the remote control facility 3 through the wireless communication antenna 24.
Further, this embodiment is configured such that the information is exchanged between the remote control target machine and the control facility using the wireless communication. However, a wired communication may be used when a distance between the machine and the control facility is small. In that case, a transmittable information amount is increased, so that it is possible to transmit or receive an image having a lesser time delay and an image having a higher resolution.
The remote control facility 3 includes a seat 31 on which the operator sits, a front control lever 32 through which movements of the revolving motor and various cylinders are input, a traveling control lever 33 through which a movement of the traveling motor is input, a monitor 34 in which an image captured by the camera 20 is displayed, a pedestal 37 on which the seat 31, the traveling control lever 33, and the monitor 34 are placed, an actuator 35 which drives the pedestal 37 to be inclined, a connection portion 36 which connects the actuator 35 and the pedestal 37, a control box 40, and a wireless communication antenna 42. In the control box 40, there is disposed a control-side remote control unit 43 which performs information communication with the vehicle-side remote control unit 25 through the wireless communication antenna 42, information acquisition of the control levers 32 and 33, outputting of image information to the monitor 34, and control of the actuator 35. The remote control unit 43 is electrically connected to the control levers 32 and 33, the monitor 34, and the actuator 35 through a cable 41.
The monitor 34 is configured by three monitors (a right monitor 34a, a left monitor 34b, and a front monitor 34c) to widen a view angle and to give immersion feeling, so that a view angle nearly equal to an actual machine is obtained compared to a case where one front monitor is configured.
The remote control facility 3 can send the image transmitted from the hydraulic shovel 1, the inclination direction, the inclination amount, the revolving amount, and the traveling speed to the control-side remote control unit 43 through the wireless communication antenna 42. In addition, the control-side remote control unit 43 outputs the image to the monitor 34 and appropriately drives the actuator 35 to control the pedestal 37 to have the same inclination angle of the machine, and acquires operation amount signals of the front control lever 32 and the traveling control lever 33 to transmit the signals to the vehicle-side remote control unit 25 through the wireless communication antenna 42. The vehicle-side remote control unit 25 outputs the operation amount signals of the respective control levers transmitted from the control-side remote control unit 43 through the wireless communication antenna 24 toward the vehicle control unit 26. The vehicle control unit 26 appropriately controls the revolving motor and the respective cylinders on the basis of the obtained operation amount signals.
With such a configuration, the operator sits on the seat 31 in the remote control facility 3, watches the image displayed in the monitor 34, and at the same time operates the respective control levers 32 and 33 while feeling the inclination information of the machine through the inclined seat 31, so that the operator can control the hydraulic shovel 1 at a remote place with feeling nearly equal to that in the actual machine.
Next, an inclination driving structure of the pedestal 37 will be described using
With such a configuration, the pedestal 37 is disposed to be in an arbitrary inclination direction and have an arbitrary inclination amount by appropriately controlling the stretching of the cylinder rods of three actuators 35. Therefore, the pedestal 37 and the seat 31 disposed therein can be inclined. In addition, the pedestal 37 can also be translationally driven in the vertical direction, and vertical vibration of the machine can be realized by the seat 31.
Next, the entire control flow of the remote control system performed in this embodiment will be described using
First, a process flow of the vehicle will be described. In the vehicle, first, the vehicle-side remote control unit 25 acquires the up-to-date data such as a camera image Img, an inclination direction θ, an inclination amount R, a revolving amount φ, and a traveling speed ω from the camera 20, the inclination sensor 21, the revolving sensor 22, and the traveling rotation sensor 23. Then, the vehicle-side remote control unit transmits these sensor signals to the control-side remote control unit 43 through wireless communication. Operation amount signals Pn of the control levers 32 and 33 are received from the control-side remote control unit 43, and transmitted to the vehicle control unit 26. In the vehicle control unit, the revolving motor, the boom cylinder 16, the arm cylinder 17, or the bucket cylinder 18 is driven on the basis of the received operation amount signal Pn.
Subsequently, a process flow of the remote control machine will be described using a flowchart of
Through such a process, only when the hydraulic shovel 1 is traveling, the pedestal 37 and the seat 31 disposed therein are controlled in real time to be the inclination direction and the inclination amount obtained by the inclination sensor 21. In a case where the hydraulic shovel 1 is not in traveling, the seat 31 is controlled to hold the same inclination amount. In addition, when the revolving superstructure 11 is revolved with respect to the lower structure 12 in a state where the hydraulic shovel 1 is not in traveling, the inclination direction of the revolving superstructure 11 is calculated in accordance with the revolving angle.
The description will be made about the effects of the remote control system configured as described. First, the seat where the operator sits is inclined in accordance with the inclination information of the machine in order to prevent an accident such as overturning due to a false recognition on the inclination angle of the machine at the time of traveling. Therefore, the inclination information of the machine is provided to the operator to be sensible, and it is possible to improve safety. On the other hand, when the boom, the arm, and the bucket are violently operated for work in the case of the hydraulic shovel for example, the machine may vibrate severely. The vibration is less necessary for the work of the operator, and becomes one of factors causing fatigue of the operator. In general, the machine stops traveling at the time of working, and the inclination amount of the machine is less changed at the time of traveling stop. Therefore, at the time of traveling stop, the inclination amount of the machine is kept to be the last inclination amount (almost the same as the inclination amount at the moment of traveling stop) at the time of traveling. In a case where the inclination direction is changed by the revolving at the time of traveling stop, the inclination direction during or after the revolving is calculated from the kept inclination direction and the revolving amount. Therefore, it is possible to control the seat such that the seat where the operator sits does not come into synchronization with the vibration of the machine generated by the work. With such a configuration, it is possible to prevent the vibration of the machine causing the fatigue from being transferred to the operator, reduce the fatigue of the operator, and improve the workability.
In this embodiment, the description has been made about the hydraulic shovel as the work machine. Therefore, the inclination direction may be changed by the revolving amount even at the time of traveling stop. While there is performed the calculation process of the inclination direction due to the revolving amount, such a calculation process of the inclination direction due to the revolving amount is not necessary when the inclination sensor is disposed in the lower structure even in the work machine which does not revolve like a wheel loader for example or the hydraulic shovel. Further, the revolving sensor is also not necessary. In addition, in this embodiment, a branching process of determining whether it is in traveling or the calculation process in the inclination direction after the branching is performed by the control-side remote control unit 43. However, these processes may be performed by the vehicle-side remote control unit 25. In a case where these processes are performed by the control-side remote control unit 43, the amount of calculation performed by the vehicle-side remote control unit 25 is reduced. Therefore, it is possible to mount a small-scale or inexpensive control unit in the vehicle. On the other hand, in a case where these processes are performed by the vehicle-side remote control unit 25, the information of the revolving amount and the traveling speed is not necessarily transmitted to the control-side remote control unit. Therefore, the amount of communication can be reduced.
Next, a remote control system of a work machine according to the second embodiment of the invention will be described using
The flowchart of
A processing content in the control-side remote control unit 43 in the second embodiment is different from that of the first embodiment; that is, the variables θa and Ra for keeping the inclination information are not used. Therefore, a process in which the values of θa and Ra are updated during the traveling, or the inclination information at the moment of stop is kept on at the time of traveling stop is not performed. Alternatively, the following process is performed during the traveling stop. In other words, the revolving amount φ is added to the inclination direction θ, θ and R after addition are subjected to a low pass filter, and the revolving amount φ is subtracted from the filtered θ. When the revolving amount φ is added to the inclination direction θ in a case where the traveling is stopped in a state where the revolving amount is “φ”, the inclination direction after addition is matched to the inclination direction of the lower structure. When the result value is subjected to the low pass filter, the vibration component generated in the work can be removed. The inclination direction after the low pass filtering process and an inclination direction θa at the moment of traveling stop in the first embodiment become almost the same value. While θa and Ra are not changed at all in the middle of traveling stop, θ and R after being subjected to the low pass filtering process of this embodiment are set to change the inclination direction and the inclination amount of the machine even in the middle of traveling stop in order to prevent the machine from being inclined when the ground surface is collapsed for example. In this case, the inclination information can be extracted. The operator can be correctly provided with the inclination information of the machine at the revolving amount φ by subtracting the revolving amount φ from the inclination direction after the low pass filtering process.
In a series of processes in the middle of the traveling stop of this embodiment, the calculation is performed by the revolving amount on a low frequency component of the inclination information while the inclination information at the moment of traveling stop is kept on and the calculation is performed by the revolving amount in the first embodiment. Through such a process, it is possible to cope with a case where the inclination direction and the inclination amount of the machine are changed even in the middle of traveling stop. In addition, when the inclination direction θ is simply subjected to the low pass filtering process, a phase delay is generated and there is a strong possibility that the synchronization does not occur with the change in the inclination direction caused by the revolving. On the other hand, in the process of this embodiment, there is a possibility that the synchronization occurs with the change in the inclination direction caused by the revolving.
With such a configuration, the inclination information of the machine which changes even in the time of traveling stop can be provided toward the operator in addition to the effect of the invention in the first embodiment. For example, it is possible to cope with even a situation that the machine is inclined when a hill is collapsed in the middle of traveling stop. Further, it is possible to improve the safety still more.
Another difference in the processing content of the control-side remote control unit 43 in the second embodiment from that of the first embodiment is that the vibration component in the image Img obtained from the camera 20 caused by the vibration of the machine is removed only at the time of traveling stop. Therefore, the process of transmitting the image Img to the control-side remote control unit is added. As a method of removing the vibration component of the image Img, the image may be shifted on the basis of the information of the inclination direction θ and the inclination amount R obtained from the inclination sensor 21.
With such a configuration, both the inclination amount and the image of the seat to be provided to the operator do not contain the vibration component at the time of traveling stop, and the movement and the image of the seat can be synchronized. With such a configuration, it is possible to reduce the fatigue of the operator caused by a deviation between feeling information and visual information.
Further, even in this embodiment, the branching process of determining whether it is in traveling or the process after the branching may be performed by the vehicle-side remote control unit 43 similarly to the first embodiment.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2014/060237 | 4/9/2014 | WO | 00 |