The present disclosure relates to an assistance apparatus and an assistance method.
In the landscaping industry and the like, there are cases where a plurality of workers perform work such as lawn mowing on a team. When a plurality of workers perform work using different types of work machines, the workers need to corporate in terms of areas to which they are assigned for performing work, the order in which they perform work, and the like. Japanese Patent Laid-Open No. 2016-12243 proposes a system that enables workers to share the positions thereof and the progress of work.
In the system described in Japanese Patent Laid-Open No. 2016-12243, the coordination of workers is left to their voluntary behaviors. Therefore, there has been room for improvement in the cooperation between workers. Some aspects of the present disclosure provides a technique for improving the cooperation between a plurality of workers. In an embodiment, an assistance apparatus for assisting work that is performed using a plurality of work machines that include a travelling work machine is provided. The apparatus includes at least one processor circuit with a memory comprising instructions, that when executed by the processor circuit, cause the processor circuit to at least: specify a target area in which a work machine other than the travelling work machine is to perform work, based on information from a sensor related to the travelling work machine; and request to perform work in the target area. A work machine that is to perform work in the target area is determined based on the information from the sensor.
Further features of the present disclosure will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).
Embodiments of the present disclosure will be described below with reference to the accompanying drawings. Some embodiments of the present disclosure relate to a technique for assisting work that is performed using a plurality of work machines that include a travelling work machine. In the following examples, landscaping work is handled as an example of work. Landscaping work includes lawn mowing and blowing of reaped lawn grass. Here, landscaping work is handled as an example of work, but there is no limitation to landscaping work, and the present disclosure may also be applied to agricultural work, snow-plowing work, and the like, and, in this case, examples of the travelling work machine include a cultivator and a snowplow, and there is no limitation to a lawnmower.
An environment in which some embodiments of the present disclosure are applied will be described with reference to
The ride-on lawn mower 110 is a work machine for a worker to ride on and perform lawn mowing. The ride-on lawn mower 110 is an example of a work vehicle. The hand-held lawn mower 120 is a work machine for a worker to perform lawn mowing while walking. The robot lawn mower 130 is a work machine that can perform work automatically (i.e., without being operated by the worker). The robot lawn mower 130 may be capable of performing work in accordance with a remote operation performed by the worker. The blower 140 is a work machine for the worker to perform blowing of lawn grass while walking.
The work area 100 includes an area in which a work machine other than the ride-on lawn mower 110 needs to perform work. Specifically, the work area 100 includes an area 101 (area in which work cannot be performed) that the ride-on lawn mower 110 cannot enter due to the presence of an obstacle such as a tree 102, an area 105 (area in which it is difficult to perform work) in which it is difficult for the ride-on lawn mower 110 to travel due to the state of ground with lawn, for example, the ground being muddy due to rain or the like, and an area 103 (area unsuitable for work) that is steeply inclined and in which work that is performed by the ride-on lawn mower 110 involves risk. The positions of these areas 101 and 103 are determined in advance, and the position of the area 105 is determined while work is being performed. In addition, the work area 100 includes an area 104 in which blowing is performed by the blower 140 when reaped lawn grass is gathered. The position of this area is determined in accordance with a work situation.
When an area (for example, the area 101, 103, or 104) in which another work machine needs to perform work is specified while the ride-on lawn mower 110 is performing work, an assistance system to be described later requests that the other work machine perform work in the area. Upon receiving this request, the other work machine, namely the hand-held lawn mower 120, the robot lawn mower 130, or the blower 140 performs work in this area.
A configuration example of an assistance system 200 according to some embodiments of the present disclosure will be described with reference to
A configuration example of the vehicle assistance apparatus 202 and the ride-on lawn mower 110 according to some embodiments of the present disclosure will be described with reference to
The vehicle assistance apparatus 202 includes a processor 301, a memory 302, an input unit 303, an output unit 304, a communication unit 305, and a positioning unit 306. The processor 301 performs overall processing of the vehicle assistance apparatus 202. Specific processing content will be described later. The processor 301 may be a single processor, or may also be a plurality of separate processors. The processor 301 functions as a CPU or a GPU, for example. The memory 302 stores programs and data used for processing performed by the vehicle assistance apparatus 202. The memory 302 is constituted by a ROM, a RAM, an SSD, and the like.
The input unit 303 is an apparatus for receiving input from the worker of the ride-on lawn mower 110, and is constituted by push buttons, a touch pad, a keypad, and the like. The output unit 304 is an apparatus for outputting information to the worker of the ride-on lawn mower 110, and is constituted by a display, a speaker, and the like. The input unit 303 and the output unit 304 may also be constituted by a touch screen. Alternatively, the output unit 304 may also be configured using AR (Augmented Reality).
The communication unit 305 is an apparatus for the vehicle assistance apparatus 202 to communicate with another apparatus (for example, the ride-on lawn mower 110 and the assistance server 201). If the communication unit 305 performs wired communication, the communication unit 305 is constituted by a communication port, a network card, and the like. If the communication unit 305 performs wireless communication, the communication unit 305 is constituted by an antenna and a baseband processing circuit. The positioning unit 306 is an apparatus for measuring the geographical location of the vehicle assistance apparatus 202. The positioning unit 306 is constituted by a GPS (Global Positioning System) receiver, for example. The vehicle assistance apparatus 202 is held by the worker of the ride-on lawn mower 110, or incorporated in the ride-on lawn mower 110, and thus the geographical location of the vehicle assistance apparatus 202 can be regarded as the position of the ride-on lawn mower 110.
The ride-on lawn mower 110 includes a communication unit 311, a camera 312, and an inclination angle sensor 313 in addition to a configuration specific to the ride-on lawn mower 110. The communication unit 311 is an apparatus for communicating with the vehicle assistance apparatus 202. The camera 312 is a sensor for capturing the surroundings of the ride-on lawn mower 110. The camera 312 may be attached so as to capture an image on the front side of the ride-on lawn mower 110, or may also be attached so as to capture an image on a side or on the rearward side in addition to the front side. In addition, a camera 312 may be attached so as to capture images of the states of ground before and after the ride-on lawn mower 110 performs lawn mowing. The inclination angle sensor 313 is a sensor for measuring the inclination angle of ground on which the ride-on lawn mower 110 is placed. The ride-on lawn mower 110 may also include a slip detection apparatus.
If the vehicle assistance apparatus 202 is incorporated in the ride-on lawn mower 110, the communication unit 311 may be omitted. Instead of or in addition to the camera 312 being included in the ride-on lawn mower 110, the vehicle assistance apparatus 202 may include a camera. The vehicle assistance apparatus 202 is installed at a position where the camera of the vehicle assistance apparatus 202 can capture an image on the front side of the ride-on lawn mower 110 and the like when the ride-on lawn mower 110 is performing work. Similarly, instead of or in addition to the inclination angle sensor 313 being included in the ride-on lawn mower 110, the vehicle assistance apparatus 202 may also include an inclination angle sensor. In addition, instead of or in addition to the positioning unit 306 being included in the vehicle assistance apparatus 202, the ride-on lawn mower 110 may also include a positioning unit.
A configuration example of the walk assistance apparatus 203 according to some embodiments of the present disclosure will be described with reference to
A configuration example of the robot assistance apparatus 204 and the robot lawn mower 130 according to some embodiments of the present disclosure will be described with reference to
The robot assistance apparatus 204 includes a processor 501, a memory 502, a communication unit 503, and a positioning unit 504. The configurations of the processor 501, the memory 502, the communication unit 503, and the positioning unit 504 may be respectively similar to the configurations of the processor 301, the memory 302, the communication unit 305, and the positioning unit 306 of the vehicle assistance apparatus 202, and thus a description thereof is omitted.
The robot lawn mower 130 includes a communication unit 511 in addition to a configuration specific to the robot lawn mower 130. The communication unit 511 is an apparatus for communicating with the robot assistance apparatus 204. If the robot assistance apparatus 204 is incorporated in the robot lawn mower 130, the communication unit 511 can be omitted.
A configuration example of the assistance server 201 according to some embodiments of the present disclosure will be described with reference to
An operation example of the assistance system 200 will be described with reference to
In step S701, the vehicle assistance apparatus 202 collects information from sensors related to the ride-on lawn mower 110. The sensors related to the ride-on lawn mower 110 include the sensors mounted in the ride-on lawn mower 110 (the camera 312 and the inclination angle sensor 313) and the sensor (the positioning unit 306) mounted in the vehicle assistance apparatus 202 allocated for the ride-on lawn mower 110. Images of the surroundings of the ride-on lawn mower 110 are collected from the camera 312. The inclination angle of ground on which the ride-on lawn mower 110 is placed is collected from the inclination angle sensor 313. The geographical location of the ride-on lawn mower 110 is collected from the positioning unit 306.
In step S702, the vehicle assistance apparatus 202 specifies a target area in which a work machine other than the ride-on lawn mower 110 is to perform work, based on the information collected from the sensors in step S701. Specifically, the information from the camera 312 includes information regarding an obstacle such as a tree 102 in
In step S703, the vehicle assistance apparatus 202 determines the degree of urgency of work. Specifically, the vehicle assistance apparatus 202 references a work schedule set by the worker in advance and stored the memory 302, and, if a scheduled end-of-work time in the target area has been determined, the degree of urgency of work is determined based on the remaining period of time until this scheduled end-of-work time. A configuration may also be adopted in which the vehicle assistance apparatus 202 calculates a remaining work ratio or work area dimension out of the entire work, and if the work ratio or work area dimension is smaller than or equal to a threshold, the vehicle assistance apparatus 202 sets the degree of urgency higher. When it is not necessary to determine the degree of urgency of work, the vehicle assistance apparatus 202 may omit this step.
In step S704, the vehicle assistance apparatus 202 requests that work be performed in the target area. Specifically, prior to transmission of the request, the vehicle assistance apparatus 202 determines the geographical location of the target area, based on the information from the positioning unit 306 and the information from the camera 312. The vehicle assistance apparatus 202 then transmits the geographical location of the target area as the request, to the assistance server 201. Also, the vehicle assistance apparatus 202 adds, to this request, the information collected from the sensor in step S701. The assistance server 201 recognizes that it has been requested that work be performed in this target area, in accordance with the geographical location having been transmitted from the vehicle assistance apparatus 202. If the degree of urgency of work is determined in step S703, the vehicle assistance apparatus 202 may add the degree of urgency of work to this request.
In step S705, the assistance server 201 makes a determination on a work machine that is to perform work in the target area, based on the information collected from the sensor in step S701. Specifically, the assistance server 201 makes a determination on a work machine based on the image of the target area obtained from the camera 312 and the geographical location of the target area collected from the positioning unit 306.
The assistance server 201 may make a determination on a work machine that is to perform work in the target area, based further on the positions of work machines other than the ride-on lawn mower 110 that has made the request. The assistance server 201 periodically (for example, every minute) collects the current positions of the work machines. The assistance server 201 then makes a determination on a work machine that is closest to the target area or a work machine included in a predetermined range from the target area, as a work machine that is to perform work target. This makes the moving distance of a work machine shorter, and thus the work efficiency further improves.
The assistance server 201 may make a determination on a work machine that is to perform work in the target area, based further on the types of work machines other than the ride-on lawn mower 110 that has made the request. Types of work machines are stored in the memory 602 of the assistance server 201 by the worker in advance. For example, the assistance server 201 selects the hand-held lawn mower 120 as a work machine that is to perform work in the target area, by analyzing the image of the target area (for example, the area 101) collected from the camera 312. In another case, the assistance server 201 selects the blower 140 as a work machine that is to perform work in the target area, by analyzing the image of the target area (for example, the area 104) collected from the camera 312. Furthermore, the assistance server 201 analyzes the image of the target area collected from the camera 312, and if it is determined that there is no need for delicate work that is to be manually performed, the assistance server 201 selects the robot lawn mower 130 as a work machine that is to perform work in the target area. If it is determined that the state of the ground of the target area is a state where it is difficult for the ride-on lawn mower to travel, based on analysis of the image of the target area collected from the camera 312, or information obtained from the slip detection mechanism of the ride-on lawn mower 110, the assistance server 201 selects the hand-held lawn mower 120 as a work machine that is to perform work in the target area. Accordingly, it is possible to select only an appropriate type of work machine, and directs the selected work machine toward the target area, and thus the work efficiency further improves.
The assistance server 201 may also make a determination on a work machine that is to perform work in the target area, based further on the degree of urgency determined in step S703. For example, when the degree of urgency is high, the assistance server 201 may select the hand-held lawn mower 120, even if the robot lawn mower 130 can perform work in the target area. Accordingly, work can be performed at a pace that is based on the degree of urgency, in accordance with a determination made by the worker.
In step S706, the assistance server 201 notifies the work machine determined in step S705 of a work instruction. This work instruction includes the geographical location of the target area. In addition, if the degree of urgency of work has been determined in step S703, the work instruction may also include the degree of urgency of work. Accordingly, the worker assigned with the work machine can be aware of the degree of urgency. Furthermore, the work instruction may include the information collected from the sensor in step S701.
In step S707, the assistance apparatus (the walk assistance apparatus 203 and/or the robot assistance apparatus 204) notified of the work instruction responds to the work instruction. For example, the walk assistance apparatus 203 notifies the worker of the geographical location of the target area through the output unit 404, and prompts the worker to perform work. In addition, if the work instruction includes information from a sensor or the degree of urgency, the walk assistance apparatus 203 may also present such information. The robot assistance apparatus 204 performs route setting thereof so as to perform work in the target area.
In the above-described operation example, the target area is notified from the vehicle assistance apparatus 202 to another assistance apparatus via the assistance server 201, but the target area may be directly notified from the vehicle assistance apparatus 202 to another assistance apparatus. In this case, functions of the assistance server 201 may be incorporated in the vehicle assistance apparatus 202. In addition, at least some of the operations in steps S702 and S703 that are performed by the vehicle assistance apparatus 202 may be performed by the assistance server 201.
In the above-described operation example, based on information from a sensor related to the ride-on lawn mower 110 that is an example of a work vehicle, the vehicle assistance apparatus 202 specifies a target area in which a work machine other than the ride-on lawn mower 110 is to perform work, and requests that work be performed in this target area. Alternatively, the robot assistance apparatus 204 may specify a target area in which a work machine other than the robot lawn mower 130 is to perform work, based on information from the sensor related to the robot lawn mower 130, and requests that work be performed in this target area. Both the ride-on lawn mower 110 and the robot lawn mower 130 are examples of a travelling work machine.
1. An assistance apparatus (201, 204) for assisting work that is performed using a plurality of work machines (110, 120, 130, 140) that include a travelling work machine, the apparatus comprising at least one processor circuit with a memory comprising instructions, that when executed by the processor circuit, cause the processor circuit to at least:
specify a target area (101, 103, 104) in which a work machine (120, 130, 140) other than the travelling work machine is to perform work, based on information from a sensor (306, 312, 313) related to the travelling work machine; and
request to perform work in the target area,
wherein a work machine that is to perform work in the target area is determined based on the information from the sensor.
According to this configuration, a determination is made on a work machine that is to perform work in the target area, based on information from a sensor related to the travelling work machine, and thus it is possible to make a determination on an appropriate work machine, and the work efficiency improves.
2. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine.
According to this configuration, for example, it is possible to determine a work machine that is closest to the target area, as a work machine that is to perform work in the target area, and thus the work efficiency further improves.
3. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine.
According to this configuration, a type of work machine that is appropriate for performing work in the target area, for example, is determined, and thus the work efficiency further improves.
4. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine, and
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine.
According to this configuration, a type of work machine that is appropriate for performing work in the target area, for example, is determined, and thus the work efficiency further improves.
5. The assistance apparatus according to 1, wherein
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field.
According to this configuration, a determination is made on a work machine based on an appropriate factor, for example, and thus the accuracy for determination on a work machine improves.
6. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine, and
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field.
According to this configuration, a determination is made on a work machine based on an appropriate factor, for example, and thus the accuracy for determination on a work machine improves.
7. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine, and
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field.
According to this configuration, a determination is made on a work machine based on an appropriate factor, for example, and thus the accuracy for determination on a work machine improves.
8. The assistance apparatus according to 1, wherein
a work instruction that is notified to the work machine that is to perform work in the target area includes a degree of urgency of work.
According to this configuration, work can be completed in the target area at the same time as the travelling work machine, and thus the work efficiency further improves.
9. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine, and
a work instruction that is notified to the work machine that is to perform work in the target area includes a degree of urgency of work.
According to this configuration, work can be completed in the target area at the same time as the travelling work machine, and thus the work efficiency further improves.
10. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine, and
a work instruction that is notified to the work machine that is to perform work in the target area includes a degree of urgency of work.
According to this configuration, work can be completed in the target area at the same time as the travelling work machine, and thus the work efficiency further improves.
11. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine,
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field, and
a work instruction that is notified to the work machine that is to perform work in the target area includes a degree of urgency of work.
According to this configuration, work can be completed in the target area at the same time as the travelling work machine, and thus the work efficiency further improves.
12. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a degree of urgency of work that is to be performed in the target area.
According to this configuration, work in the target area can be completed in accordance with the progress of work of the travelling work machine, and thus the work efficiency further improves.
13. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine, and
a work machine that is to perform work in the target area is determined based further on a degree of urgency of work that is to be performed in the target area.
According to this configuration, work in the target area can be completed in accordance with the progress of work of the travelling work machine, and thus the work efficiency further improves.
14. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine, and
a work machine that is to perform work in the target area is determined based further on a degree of urgency of work that is to be performed in the target area.
According to this configuration, work in the target area can be completed in accordance with the progress of work of the travelling work machine, and thus the work efficiency further improves.
15. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine,
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field, and
a work machine that is to perform work in the target area is determined based further on a degree of urgency of work that is to be performed in the target area.
According to this configuration, work in the target area can be completed in accordance with the progress of work of the travelling work machine, and thus the work efficiency further improves.
16. The assistance apparatus according to 1, wherein
a work machine that is to perform work in the target area is determined based further on a position of a work machine other than the travelling work machine,
a work machine that is to perform work in the target area is determined based further on a type of a work machine other than the travelling work machine,
the information from the sensor includes information regarding at least one of an obstacle, an inclination angle, a state of a work target, or a state of a work field,
a work instruction that is notified to the work machine that is to perform work in the target area includes a degree of urgency of work, and
a work machine that is to perform work in the target area is determined based further on a degree of urgency of work that is to be performed in the target area.
According to this configuration, work in the target area can be completed in accordance with the progress of work of the travelling work machine, and thus the work efficiency further improves.
17. A method for assisting work that is performed using a plurality of work machines that include a travelling work machine (110, 120, 130, 140), the method comprising:
specifying a target area (101, 103, 104) in which a work machine other than the travelling work machine is to perform work, based on information from a sensor (306, 312, 313) related to the travelling work machine; and
requesting to perform work in the target area,
wherein a work machine that is to perform work in the target area is determined based on the information from the sensor.
According to this configuration, since a determination is made on a work machine that is to perform work in the target area, based on information from a sensor related to the travelling work machine, a determination can be made on an appropriate work machine, and the work efficiency improves.18.
18. A storage medium storing a computer program for causing a processer circuit to at least:
specify a target area (101, 103, 104) in which a work machine (120, 130, 140) other than the travelling work machine is to perform work, based on information from a sensor (306, 312, 313) related to the travelling work machine; and
request to perform work in the target area,
wherein a work machine that is to perform work in the target area is determined based on the information from the sensor.
According to this configuration, an assistance apparatus can be provided in the form of a program.
While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application is a continuation of International Patent Application No. PCT/JP2018/048168 filed on Dec. 27, 2018, the entire disclosure of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2018/048168 | Dec 2018 | US |
Child | 17342727 | US |