The present invention relates to an automated work system that performs automated work in a rental farm.
PTL 1 discloses a configuration of a work management system in which operation data of agricultural machines is transmitted to a server and the server specifies the maintenance interval of each agricultural machine on the basis of the operation data.
However, in a field rental service (hereinafter, “rental farm”) for enjoying vegetable cultivation by renting a field, use of an automated work machine that automatically performs predetermined work creates a need for scheduling of work performed by the automated work machine rather than scheduling of the maintenance interval in which the automated work machine does not perform work.
For example, in confliction between the scheduled work time during which the user arrives at the work area of the rental farm and performs work in the work area and the work time during which the automated work machine performs work, even if the user visits the rental farm, the user may fail to perform the work in a situation where the automated work machine is at work in the work area.
The present invention has been made in view of the above issues, and an object of the present invention is to provide an automated work technique enabling generation of a schedule on the basis of a scheduled work time during which a user arrives at a work area and performs work in the work area or a time slot during which the user is not in the work area.
An automated work system according to one aspect of the present invention includes a control apparatus capable of controlling an automated work machine that performs work in a work area, the automated work system including: a generation unit configured to generate a schedule for the work, wherein the generation unit generates the schedule based on a scheduled work time during which a user arrives at the work area and performs work in the work area or a time slot during which the user is not in the work area.
The present invention enables generation of a schedule on the basis of a scheduled work time during which a user arrives at a work area and performs work in the work area or a time slot during which the user is not in the work area.
The accompanying drawings illustrating an embodiment of the present invention constitute a part of the specification, and are used together with the description to describe the present invention.
Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the following embodiment does not limit the present invention according to the claims, and thus all combinations of features described in the present embodiment are not necessarily essential to the present invention.
(Overview of Automated Work System)
The work area is, for example, a work area of a rental farm in a rental service, and in
The automated work machine 10 can function as, for example, a lawn mower, a snow blower, or a cultivator that performs work while autonomously traveling within a work area. However, the examples of the automated work machine are merely exemplified, and thus the present invention is applicable to other types of work machines. In the following description, the embodiment of the present invention will be described with the configuration of a lawn mower as an example.
(Overview of Automated Work Machine)
As illustrated in
The camera 11 that captures the outside of the automated work machine 10 includes a plurality of cameras (left camera 11L, right camera 11R) capable of capturing a situation around the automated work machine 10. Information regarding the distance between an object present ahead of the automated work machine 10 (for example, agricultural product in the work area) and the automated work machine 10 can be calculated and acquired with an image captured by the camera 11 (left camera 11L, right camera 11R). In
The camera 11 (left camera 11L, right camera 11R) is held by a pan-angle adjustment mechanism l lb that adjusts the angle in the horizontal direction and a tilt-angle adjustment mechanism 11c that adjusts the angle in the up-and-down direction. The ECU 44 controls at least either the pan-angle adjustment mechanism 11b or the tilt-angle adjustment mechanism 11c, so that the angle of the camera 11 can be controlled.
The vehicle body 12 of the automated work machine 10 includes a chassis 12a and a frame 12b attached to the chassis 12a. The front wheel 14 includes two left and right wheels (left front wheel 14L, right front wheel 14R) each having a smaller diameter and secured to the front side of the chassis 12a through the stay 13 in the front-and-rear direction. The rear wheel 16 includes two left and right wheels (left rear wheel 16L, right rear wheel 16R) each having a larger diameter and attached to the rear side of the chassis 12a.
The blade 20 is a rotary blade for mowing work and is attached near the central position of the chassis 12a. The work motor 22 is an electric motor disposed above the blade 20. The blade 20 is connected to the work motor 22 and is rotationally driven by the work motor 22. The motor holding member 23 holds the work motor 22. The motor holding member 23 is restricted in rotation to the chassis 12a, and is allowed to move in the up-and-down direction by, for example, a combination of a guide rail and a slider that is guided by the guide rail and is movable up and down.
The blade-height adjustment motor 100 is a motor for adjusting the height in the up-and-down direction of the blade 20 to the ground surface GR. The translation mechanism 101 is connected to the blade-height adjustment motor 100, and is a mechanism for converting rotation of the blade-height adjustment motor 100 into translation in the up-and-down direction. The translation mechanism 101 is also connected to the motor holding member 23 that holds the work motor 22.
The rotation of the blade-height adjustment motor 100 is converted into the translation (movement in the up-and-down direction) by the translation mechanism 101, and the translation is transmitted to the motor holding member 23. Due to the translation (movement in the up-and-down direction) of the motor holding member 23, the work motor 22 held by the motor holding member 23 also is translated (moves in the up-and-down direction). Due to the movement in the up-and-down direction of the work motor 22, the height of the blade 20 to the ground surface GR can be adjusted.
The travel motor 26 includes two electric motors (prime movers) (left travel motor 26L, right travel motor 26R) attached to the chassis 12a of the automated work machine 10. The two electric motors are connected one-to-one to the left and right rear wheels 16. Independent rotation of the left and right wheels forward (rotation in the forward direction) or rearward (rotation in the rearward direction) with the front wheel 14 as a driven wheel and the rear wheel 16 as a drive wheel allows the automated work machine 10 to move in various directions.
The charging terminal 34 is a charging terminal provided at the front-end position in the front-and-rear direction of the frame 12b, and is connected to the corresponding charging terminal of a charging station to receive power supplied from the charging station. The charging terminal 34 is connected to the charging unit 30 through wiring, and the charging unit 30 is connected to the battery (battery) 32. In addition, the work motor 22, the travel motor 26, and the blade-height adjustment motor 100 are connected to the battery 32, and are supplied with power from the battery 32.
The ECU 44 is an electronic control unit including a microcomputer provided on a circuit board, and controls the operation of the automated work machine 10. Details of the ECU 44 will be described below. In a case like occurrence of abnormality in the automated work machine 10, the notification unit 35 issues a notification of the fact. For example, the notification can be issued with voice or display. Alternatively, the occurrence of abnormality can be output to an external device wirelessly connected to the automated work machine 10. The user can know the occurrence of abnormality through the external device.
(Control Block Diagram)
The memory 44c stores information regarding a work timetable (schedule) and a work area of the automated work machine 10, various programs for controlling the operation of the automated work machine 10, and an area map indicating the shape of the work area. The automated work machine 10 is capable of performing predetermined work while autonomously traveling within the work area on the basis of the area map of the work area. In order to operate each processing unit for achieving the present invention, the ECU 44 reads and executes a program stored in the memory 44c.
The ECU 44 is connected to the group of various sensors S. The sensor group S includes a direction sensor 46, a global positioning system (GPS) sensor 48, a wheel-velocity sensor 50, an angular-velocity sensor 52, an acceleration sensor 54, a current sensor 62, a blade-height sensor 64, a magnetic sensor 66, and the like.
The GPS sensor 48 and the direction sensor 46 are sensors for acquiring information regarding the position and orientation of the automated work machine 10. The direction sensor 46 detects the direction in accordance with geomagnetism. The GPS sensor 48 receives radio waves from a GPS satellite and detects information indicating the current position (latitude, longitude) of the automated work machine 10.
The wheel-velocity sensor 50, the angular-velocity sensor 52, and the acceleration sensor 54 are sensors for acquiring information regarding the movement state of the automated work machine 10. The wheel-velocity sensor 50 detects the wheel velocity of the left and right rear wheels 16. The angular-velocity sensor 52 detects an angular velocity around the axis in the up-and-down direction (z axis in the vertical direction) of the position of the center of gravity of the automated work machine 10. The acceleration sensor 54 detects accelerations in the orthogonally triaxial directions of x, y, and z axes acting on the automated work machine 10.
The current sensor 62 detects the current consumption (amount of power consumption) of the battery 32. The detection result of the current consumption (amount of power consumption) is stored in the memory 44c of the ECU 44. In a case where a predetermined amount of power is consumed and the amount of power stored in the battery 32 becomes not more than a threshold, the ECU 44 controls such that the automated work machine 10 returns to the charging station for charging.
The blade-height sensor 64 detects the height of the blade 20 to the ground surface GR. The detection result of the blade-height sensor 64 is output to the ECU 44. On the basis of the control of the ECU 44, the blade-height adjustment motor 100 is driven and the blade 20 moves up and down in the up-and-down direction to adjust the height from the ground surface GR.
The magnetic sensor 66 includes a left magnetic sensor 66L and a right magnetic sensor 66R that are disposed at symmetrical positions in the left-and-right direction of the automated work machine 10 and output signals indicating the strength of magnetic field (intensity of magnetic field) to the ECU 44.
Outputs of the group of various sensors S are input to the ECU 44 through the I/O 44b. On the basis of the outputs of the group of various sensors S, the ECU 44 supplies power from the battery 32 to the travel motor 26, the work motor 22, and the height adjustment motor 100. The ECU 44 outputs a control value through the I/O 44b and controls the travel motor 26, so that traveling of the automated work machine 10 is controlled. The ECU 44 also outputs a control value through the I/O 44b and controls the height adjustment motor 100, so that the height of the blade 20 is adjusted. The ECU 44 further outputs a control value through the I/O 44b and controls the work motor 22, so that rotation of the blade 20 is controlled. Here, the I/O 44b can function as a communication interface (communication unit), and is wirelessly communicable with the control apparatus (information processing apparatus SV, information terminal apparatus TM) through the network NET.
The information processing apparatus SV (server) stores a work-schedule-information database SD that stores scheduled-work information of the user. The work-schedule-information database SD is a database stored in the server 350, and stores a scheduled work time during which the user arrives at a work area and performs work in the work area (for example, the user is scheduled to arrive at ∘o'clock AM on day D, month M, year Y and is scheduled to work in the work area for Δ hours) or a time slot during which the user is not in the work area.
The I/O 44b (communication unit) of the automated work machine 10 can store (download) the information in the work-schedule-information database SD from the information processing apparatus SV into the memory 44c. The CPU 44a is capable of executing various types of processing with reference to the scheduled work time stored in the memory 44c.
An acquisition unit SD2 included in the information processing apparatus SV acquires, through the network NET, the scheduled work time during which the user arrives at the work area and performs work in the work area or the time slot during which the user is not in the work area. For example, the user can input information regarding the scheduled work time from an input unit UI included in the information terminal apparatus TM, and the acquisition unit SD2 acquires the information regarding the scheduled work time of the user and the like through communication with the information terminal apparatus TM and registers the information in the scheduled-work-time information database SD.
The user may register the information regarding the scheduled work time and the like in advance from the input unit UI of the information terminal apparatus TM to the work-schedule-information database SD1 of the information processing apparatus SV, or may directly transmit the information regarding the scheduled work time and the like to the automated work machine 10.
Note that the I/O 44b (communication unit) of the automated work machine 10 can also acquire predetermined data with reference to the database (work-schedule-information database SD) on the information processing apparatus SV through wireless communication with the information processing apparatus SV, without downloading the work-schedule-information database SD from the information processing apparatus SV (server).
The ECU 44 reads and executes various programs stored in the memory 44c, so that the CPU 44a functions as a generation unit C1, a communication unit C2, and a control unit C3 for achieving the present invention.
(Schedule Generation)
The generation unit C1 generates a schedule for the automated work machine 10 in a work area. The generation unit C1 generates the schedule on the basis of a scheduled work time during which the user arrives at the work area and performs work in the work area or a time slot during which the user is not in the work area.
In step S502, the generation unit C1 generates a schedule on the basis of the scheduled work time during which the user arrives at a work area and performs work in the work area or the absent time slot during which the user is not in the work area. The generation unit C1 specifies the absent time slot from the information acquired in S501, and generates the schedule such that work is performed in a time slot that does not overlap with the scheduled work time. That is, the generation unit C1 generates the schedule such that work is performed in a time slot during which the user is not in the work area (in the absent time slot).
In step S601, the generation unit C1 determines whether work to be performed includes a plurality of steps, and in a case where the work to be executed includes a single step (S601-No), the generation unit C1 advances the processing to step S605.
Otherwise, in determination in step S601, in a case where the work to be executed includes a plurality of steps (S601-Yes), the generation unit C1 advances the processing to step S602.
In step S602, the generation unit C1 determines whether or not the work including a plurality of steps is completable before arrival of the scheduled work time of the user. In a case where the work is not completable (S602-No), in step S603, the generation unit C1 specifies the number of steps completable before arrival of the scheduled work time and generates a schedule such that the work having the number of specified steps is performed.
Then, in step S604, the generation unit generates a schedule such that work including a step different from a step completed among the plurality of steps is performed after end of the scheduled work time.
For example, as illustrated in
Meanwhile, in a case where the work to be executed includes a single step, in step S605, when the generation unit C1 determines whether or not the work is completable before arrival of the scheduled work time of the user and the work is not completable (S605-No), in step S608, the generation unit C1 generates a schedule such that the work is performed after end of the scheduled work time of the user (in the time slot B during which the user is not in the work area). Otherwise, in a case where the work is completable before arrival of the scheduled work time of the user (S605-Yes), in step S607, the generation unit C1 generates a schedule such that the work is performed before the scheduled work time of the user (in the time slot A during which the user is not in the work area).
Furthermore, in response to setting of attribute information indicating a work attribute (for example, maintenance of a work machine, repair work thereof, pest control, seeding, or harvest work) of the user in the work area, the generation unit C1 can also acquire the scheduled work time corresponding to the attribute information and can generate a schedule.
Moreover, in a case where the work area includes a plurality of divided areas, the generation unit C1 can also generate, on the basis of a work schedule of the user who performs the work in one divided area among the plurality of divided areas, a schedule such that the work is performed in another divided area excluding the one divided area. For example, in a case where there is a plurality of work areas A (for example, areas A1, A2, and A3) and the work schedule of the user is for the area A1, a schedule can be generated such that the automated work machine 10 performs the work in the remaining area A2 or A3.
(Display of Captured Image by Camera)
The communication unit C2 of the automated work machine 10 distributes an image captured by the image capturing unit (camera 11) that captures images of a work area, to the control apparatus (information processing apparatus SV and information processing terminal TM). In addition, the control apparatus (information processing apparatus SV and information processing terminal TM) includes a display unit (SD3, TM2) that can display the image distributed from the automated work machine 10, as an image browsable online by the user. Moreover, the work area is provided with an image capturing device (fixed camera) that captures an image of the work area and distributes the captured image to the control apparatus, and the display unit (SD3, TM2) included in the control apparatus (information processing apparatus SV and information processing terminal TM) can also display the image distributed from the image capturing device (fixed camera), as an image browsable online by the user.
(Camera Control in Automated Work Machine)
The control apparatus (information processing apparatus SV and information processing terminal TM) includes an operation control unit (SD4, TM3) that generates control information on the basis of an instruction of the user, and the control unit C3 of the automated work machine 10 controls the automated work machine 10 and the image capturing unit (the camera 11) on the basis of the control information generated by the control apparatus. In response to input of the control information for capturing a specific part (for example, a specific part of an agricultural product) in a work area, the control unit C3 of the automated work machine 10 controls movement of the automated work machine 10 on the basis of the control information and controls the capturing angle and the capturing direction of the image capturing unit (camera 11) in accordance with the part.
(Image Processing on Captured Image)
The control apparatus (information processing apparatus SV and information processing terminal TM) includes an image processing unit (SD5, TM4) that performs predetermined image processing on an image captured by the image capturing unit (camera 11) of the automated work machine 10 or the image capturing device (fixed camera) provided in the work area.
The image processing unit (SD5, TM4) acquires, from the image including an agricultural product captured in a cultivation process in the work area, at least any one piece of feature information from color information indicating the height, the amount of thick growth, and the level of growth of the agricultural product, and estimates the harvest timing of the agricultural product on the basis of the feature information. For example, the image processing unit (SD5, TM4) holds, as a reference model, color information that is obtained by modeling the reference growing level and indicates the height, the amount of thick growth, and the level of growth change in accordance with the elapse of time, for the type (item) of an agricultural product in cultivation. The image processing unit (SD5, TM4) can estimate the harvest timing of the agricultural product by comparison between information regarding the reference model and the feature information acquired from the captured image.
The control apparatus (information processing apparatus SV and information processing terminal TM) further includes a growth-level database (SD6, TM5) as a storage unit that stores a table in which the feature information acquired from the captured image (color information acquired from the image) is in association with the level of growth of the agricultural product. The image processing unit (SD5, TM4) can also estimate the harvest timing of the agricultural product with reference to the table in the growth-level database (SD6, TM5). Here, the feature information acquired from the captured image (color information acquired from the image) includes information regarding hue, saturation, and brightness.
The control apparatus (information processing apparatus SV and information processing terminal TM) includes a notification unit (SD7, TM6) that notifies the user of the harvest timing. In a case where the color information acquired from the image is the color information A or the color information B, the notification unit (SD7, TM6) displays, on the display unit (SD3, TM2), that the agricultural product in cultivation is harvestable, and notifies the user of the fact. The generation unit C1 can generate a schedule such that a scheduled time at which the user visits the work area does not overlap the harvest timing.
In addition, a program for achieving each function of one or more automated work machines described in the embodiment is supplied to the system or apparatus through the network or a storage medium, and one or more processors in a computer of the system or apparatus can read and execute the program. The present invention is also achievable by such an aspect.
Configuration 1. An automated work system according to the above embodiment serves as:
an automated work system (for example, STM in
a generation unit (C1 in
the generation unit (C1) generates the schedule based on a scheduled work time during which a user arrives at the work area and performs work in the work area or a time slot during which the user is not in the work area.
The automated work system according to Configuration 1 enables the generation of the schedule based on the scheduled work time during which the user arrives at the work area and performs the work in the work area or the time slot during which the user is not in the work area.
Configuration 2. In the automated work system (STM) according to the above embodiment, the control apparatus (SV, TM) further includes
an acquisition unit (for example, SD2 in
the generation unit (C1) generates the schedule such that work is performed in the time slot that does not overlap the scheduled work time.
The automated work system according to Configuration 2 enables the generation of the schedule based on the scheduled work time during which the user arrives at the work area and performs the work in the work area or the time slot during which the user is not in the work area.
Configuration 3. In the automated work system (STM) according to the above embodiment, the generation unit (C1) determines whether or not the work including a plurality of steps is completable before arrival of the scheduled work time, and
in a case where the work is not completable, the generation unit (C1) specifies a number of steps completable before arrival of the scheduled work time and generates the schedule such that the work having the number of steps specified is performed.
The automated work system according to Configuration 3 enables the completion of the work having the predetermined number of steps before arrival of the scheduled work time of the user (before the visit time).
Configuration 4. In the automated work system (STM) according to the above embodiment, the generation unit (C1) generates the schedule such that the work including a step different from a step completed among the plurality of steps is performed after end of the scheduled work time.
The automated work system according to Configuration 4 enables the performing of the work including the step different from the step completed among the plurality of steps after end of the scheduled work time of the user.
Configuration 5. In the automated work system (STM) according to the above embodiment, the automated work machine (10) further includes:
an image capturing unit (for example, camera 11 in
a communication unit (for example, C2 in
the control apparatus (SV, TM) further includes:
a display unit (for example, SD3, TM2 in
The automated work system according to Configuration 5 enables the user to browse online the image distributed.
Configuration 6. In the automated work system (STM) according to the above embodiment, the work area is provided with an image capturing device that captures an image of the work area and distributes the image captured to the control apparatus (SV, TM).
The automated work system according to Configuration 6 enables the distribution of the image captured by the image capturing device (fixed camera) to the control apparatus.
Configuration 7. In the automated work system (STM) according to the above embodiment, the control apparatus (SV, TM) further includes: an operation control unit (for example, SD4, TM3 in
the automated work machine (10) further includes:
a control unit (for example, C3 in
The automated work system according to Configuration 7 enables the control of the automated work machine from the control apparatus by remote control.
Configuration 8. In the automated work system (STM) according to the above embodiment, in response to input of the control information for capturing a specific part in the work area, the control unit (C3) of the automated work machine (10)
controls movement of the automated work machine (10), based on the control information and controls a capturing angle and a capturing direction of the image capturing unit (camera 11) in accordance with the part.
The automated work system according to Configuration 8 enables the control of the automated work machine from the control apparatus by remote control and the capturing (for example, pinpoint capturing) of the specific part in the work area.
Configuration 9. In the automated work system (STM) according to the above embodiment, the control apparatus (SV, TM) further includes:
an image processing unit (for example, SD5, TM4 in
the image processing unit (SD5, TM4)
acquires, from the image including an agricultural product captured in a cultivation process in the work area, at least any one piece of feature information from color information indicating a height, an amount of thick growth, and a level of growth of the agricultural product, and estimates a harvest timing of the agricultural product, based on the feature information.
The automated work system according to Configuration 9 enables the estimation of the harvest timing of the agricultural product for the type (item) of the agricultural product in cultivation by comparison between information regarding a reference model obtained by modeling the reference growing level and the feature information acquired from the captured image.
Configuration 10. In the automated work system (STM) according to the above embodiment, the control apparatus (SV, TM) further includes:
a storage unit (for example, SD6, TM5 in
the image processing unit (SDS, TM4) estimates the harvest timing of the agricultural product with reference to the table.
The automated work system according to Configuration 10 enables the estimation of the harvest timing of the agricultural product by comparison between the information in the table in which the color information is in association with the level of growth of the agricultural product with the color information acquired from the captured image.
Configuration 11. In the automated work system (STM) according to the above embodiment, the control apparatus (SV, TM) further includes:
a notification unit (for example, SD7, TM6 in
the generation unit (C1) generates the schedule such that a scheduled time at which the user visits the work area does not overlap the harvest timing.
The automated work system according to Configuration 11 enables the notification of the harvest timing to the user and the generation of the schedule for avoiding the overlap between the time at which the user visits and the harvest timing.
Configuration 12. In the automated work system (STM) according to the above embodiment, in response to setting of attribute information indicating a work attribute of the user in the work area, the generation unit (C1) acquires the scheduled work time corresponding to the attribute information and generates the schedule.
The automated work system according to Configuration 12 enables the generation of the schedule on the basis of the scheduled work time corresponding to the work attribute (for example, maintenance of a work machine, repair work thereof, pest control, seeding, or harvest work) of the user.
Configuration 13. In the automated work system (STM) according to the above embodiment, in a case where the work area includes a plurality of divided areas,
the generation unit (C1) generates, based on a work schedule of the user who performs the work in one divided area among the plurality of divided areas, the schedule such that the work is performed in another divided area excluding the one divided area.
The automated work system according to configuration 13 enables, based on the work schedule of the user who performs work in one divided area among the plurality of divided areas, the generation of the schedule such that the work is performed in another divided area excluding the one divided area.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Number | Date | Country | Kind |
---|---|---|---|
2019-032987 | Feb 2019 | JP | national |
This application is a continuation of International Patent Application No. PCT/JP2020/006591 filed on Feb. 19, 2020, which claims priority to and the benefit of Japanese Patent Application No. 2019-032987 filed on Feb. 26, 2019, the entire disclosures of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2020/006591 | Feb 2020 | US |
Child | 17370240 | US |