The present invention relates to a sensing action performed autonomously by a mobile body, and particularly relates to a mobile body control device and the like that are capable of controlling a mobile body to perform sensing quickly and reliably even when there is a location with insufficient sensing.
There is a trend that a sensing operation in a specific area is to be performed efficiently and safely by autonomously controlling a mobile body (such as an unmanned vehicle) to which a sensing device such as a sensor or a camera is mounted. For example, a flyable mobile body to which a camera is mounted is caused to perform searching and monitoring in an area such as a disaster area or a vast area where investigation by a human hand is difficult. One of requirements in a case where a mobile body is used is to perform sensing for an entire target area without an omission and to acquire information on the target area reliably and quickly. For example, this requirement is essential when an autonomously-operated mobile body is caused to search a disaster area for a missing person or the like reliably and quickly.
PTL 1 discloses a technique of reliably performing sensing and controlling in a target area. With this technique, a mobile operation robot moves while detecting a distance from a wall during moving near the wall, and thus generation of an unworked area such as a corner is prevented. PTL 2 discloses a similar technique. With this technique, when a plurality of sensing robots detect a target object, an omission in detecting the target object is prevented by changing a processing method in such a way as to improve sensing resolution according to a detection event. PTL 3 discloses a similar technique. With this technique, in order to cover a surface of an unknown area, moving within a map is performed according to information on an unsearched/searched state, while detecting an edge and expanding a target area. In addition to these, PTL 4 and NPL 1 are known as literatures relating to the present invention.
However, the techniques disclosed in PTLs 1 to 3 attempt to prevent an omission of a sensing cover area, based on an object (a target object, a wall, or the like) that is present in a fixed manner, and cannot quickly deal with a sudden and unpredictable omission of a sensing cover area. For example, in a case where an obstacle suddenly appears, when sensing is performed by a camera, an area behind the obstacle cannot be subjected to sensing. Further, when sensing is performed by a radar and a sonar, performance varies depending on an environment and a time, and sensing data may vary.
In view of the above-mentioned problem, an object of the present invention is to provide a mobile body control device and the like that are capable of controlling a mobile body and performing sensing reliably and quickly for the entire target area even when there is a location with insufficient sensing in the target area during sensing performed by the mobile body that is autonomously operated.
In view of the above-mentioned problem, a mobile body control device according to a first aspect of the present invention includes:
an arrangement control unit that controls arrangement of a mobile body for sensing in a target area being subjected to the sensing by the mobile body;
a completed-range calculation unit that, when the target area is constituted of a plurality of small areas and sensing is performed subsequently from the small area with a high priority level, calculates a sensing-completed range being constituted of one or more of the small areas in which the sensing is completed;
an uncompleted-range calculation unit that calculates a sensing-uncompleted range, on the basis of the calculated sensing-completed range and a reference range being subjected to the sensing, the sensing-uncompleted range being constituted of one or more of the small areas with the sensing being uncompleted in the target area; and
an update unit that performs update in such a way that the priority level of one or more of the small areas associated with the calculated sensing-uncompleted range is higher than that of the sensing-completed range.
A mobile body control system according to a second aspect of the present invention includes:
a plurality of mobile bodies each including the above-mentioned mobile body control device, wherein
a plurality of the mobile body control devices are communicable with each other via a wireless communication network.
A mobile body according to a third aspect of the present invention includes:
the above-mentioned mobile body control device;
a drive unit that causes the mobile body to move in a target area according to control from the mobile body control device; and
a sensor unit that performs sensing and transmits a performance result to the mobile body control device.
A mobile body control method according to a fourth aspect of the present invention includes:
controlling arrangement of a mobile body for performing sensing in a target area being subjected to the sensing by the mobile body, performing sensing subsequently from the small area with a high priority level, and calculating a sensing-completed range being constituted of one or more of the small areas in which the sensing is completed;
calculating a sensing-uncompleted range, on the basis of the calculated sensing-completed range and a reference range being subjected to the sensing, the sensing-uncompleted range being constituted of one or more of the small areas with the sensing being uncompleted in the target area; and
performing update in such a way that the priority level of one or more of the small areas associated with the calculated sensing-uncompleted range is higher than that of the sensing-completed range.
A mobile body control program according to a fifth aspect of the present invention causes a computer to perform:
controlling arrangement of a mobile body for performing sensing in a target area being subjected to the sensing by the mobile body, performing sensing subsequently from the small area with a high priority level, and calculating a sensing-completed range being constituted of one or more of the small areas in which the sensing is completed;
calculating a sensing-uncompleted range, on the basis of the calculated sensing-completed range and a reference range being subjected to the sensing, the sensing-uncompleted range being constituted of one or more of the small areas with the sensing being uncompleted in the target area; and
performing update in such a way that the priority level of one or more of the small areas associated with the calculated sensing-uncompleted range is higher than that of the sensing-completed range.
The mobile body control program may be stored in a non-temporal computer-readable storage medium.
According to the present invention, there can be provided a mobile body control device that are capable of controlling a mobile body and performing sensing reliably and quickly for the entire target area even when there is a location with insufficient sensing in the target area during sensing performed by the mobile body that is autonomously operated.
Now, with reference to the drawings, example embodiments of the present invention are described. In the following description of the drawings, identical or similar parts are denoted with identical or similar reference symbols. However, the drawings schematically illustrate the configurations of the example embodiments of the present invention. Further, the example embodiments of the present invention described below are merely examples, and can be changed as appropriate without departing from the essence.
As illustrated in
The mobile body 10 autonomously controls arrangement of the mobile body while following an operation, which is set in advance or is received via wireless communication, and acquiring information from the sensor unit 108. In each of the example embodiments of the present invention, a target area in which the mobile body 10 performs an operation is constituted of a plurality of small areas, and a priority level is associated with each of pieces of information that can specify the small areas. The mobile body 10 controls arrangement of the mobile body according to priority level values associated with the small areas. For example, the mobile body 10 moves its own location in such a way as to perform sensing first in a small area with a high priority level. For example, an arrangement method for a plurality of resources described in NPL 1 is applicable to this control. NPL 1 uses a case where a plurality of installations (for example, mail boxes and the like) are arranged optimally according to a population density of a city, and is applied to arrangement control of the mobile body 10 by replacing, for example, the population density with a priority level of a target area and the installations with the mobile body 10. The mobile body 10 performs sensing in the target area, but may be unable to perform sensing for the entire target area when a defect is caused in the sensor unit 108 or arrangement of the mobile body is changed due to an external factor such as a gust of wind.
The drive unit 107 is a drive device for changing arrangement of the mobile body 10, and is as an engine for rotating a propeller in a case of a flying device or a power mechanism and an engine for rotating a wheel in a case of a land-traveling device, for example.
The sensor unit 108 is a sensor for acquiring information on a peripheral condition of the mobile body 10, and is a sensing device such as a camera, a radar, and a sonar, for example.
As illustrated in
The completed-range calculation unit 101 is connected with the sensor unit 108 in a communicable manner, and causes the sensor unit 108 to perform sensing subsequently from a small area with a high priority level within the target area. Initial values of the priority level of the small areas are preferably set to the same value (for example, one) in such a way as to perform sensing all over the entire target area. After performing sensing, the completed-range calculation unit 101 calculates a sensing-completed range constituted of one or more small areas in which the sensing is completed.
The sensing reference shape storage unit 103 stores information relating to a reference range (sensing reference range) for determining whether sensing is performed effectively. Various shapes are exemplified as the sensing reference range. For example, as illustrated in
On the basis of the sensing reference range, which is stored in the sensing reference shape storage unit 103 and is subjected to sensing, and the sensing-completed range calculated by the completed-range calculation unit 101, the uncompleted-range calculation unit 102 calculates a range (sensing-uncompleted range) in which sensing is uncompleted, which is constituted of one or more small areas. Specifically, the uncompleted-range calculation unit 102 extracts a location (sensing-uncompleted range) where sensing is insufficient within the target area after completion of sensing.
The priority level storage unit 105 stores priority levels that are associated with each of the plurality of small areas in the target area. Note that the initial values of the priority level may be all the same (for example, one).
The update unit 104 updates the priority levels of the small areas according to a location with insufficient sensing. For example, the update unit 104 performs update in such a way that a priority level of one or more small areas associated with the sensing-uncompleted range is higher than that of the sensing-completed range (for example, when the initial value is one, the updated priority level is two).
The arrangement control unit 106 controls arrangement (movement) of the mobile body 10 in the target area being subjected to sensing by the mobile body 10. The arrangement control unit 106 is connected with the drive unit 107 in a communicable manner, and the drive unit 107 moves a location of the mobile body according to a control signal transmitted from the arrangement control unit 106. The above-mentioned method disclosed in NPL 1 may be used for the arrangement control. Note that the method for the arrangement control is not limited to this.
Next, processing for priority level update that is performed by the mobile body control device 100 mounted to the mobile body 10 is described with reference to a flowchart illustrated in
On the assumption, the sensor unit 108 of the mobile body control device 100 follows an instruction from the completed-range calculation unit 101, and performs sensing in the target area.
In Step S101, the completed-range calculation unit 101 calculates a sensing-completed range, on the basis of a result of performing the sensing that is received from the sensor unit 108. As a method for calculating the sensing-completed range, for example, when the sensor unit 108 is a camera, a method for obstacle detection is used, and it is determined that sensing is completed in a range captured by the camera. For example, when the sensor unit 108 is a radar or a sonar, it is determined that, among observation data acquired from the radar or the sonar, an area with a accuracy level (a threshold value for an error) lower than a predetermined value is a sensing-completed range. Note that the determination method is not limited to these.
In Step S102, on the basis of the sensing-completed range calculated in Step S101 and the reference range, which is stored in the sensing reference shape storage unit 103 and is subjected to sensing, the uncompleted-range calculation unit 102 calculates a location with insufficient sensing (uncompleted range). A shape being the sensing reference range is selected in advance and set, according to a property of the sensor unit 108 and characteristics of an operation performed by the mobile body 10.
As one example of the calculation method for an uncompleted range, there is known a method in which a target area is divided in a grid-like manner to form a plurality of sections (small areas) as a plurality of small areas and whether sensing is uncompleted is calculated for each of the small sections. For example, when the sensing reference shape is a fan-like shape (see
In Step S103, the update unit 104 changes a priority level of the sensing-uncompleted range A. As one specific example of changing a priority level, a method of changing a priority level of a section associated with the sensing-uncompleted range A is considered. Further, when a sensor with directivity is used, change may be made to a priority level of an area B at a location away from the mobile body 10 with respect to the sensing-uncompleted range A in a vector direction extending from the mobile body 10 to the sensing-uncompleted range A. This is because, when the mobile body 10 performs sensing in the area B as a target, the sensing-uncompleted range A is also subjected to sensing. As a method of changing a priority level of a small area (for example, a section), there are known a method of making change in all the small areas in a fixed manner (a priority level value is multiplied by a fixed ratio value and is increased), a method of making change gradually along elapse of time, and the like. When change is made along elapse of time, design may be made in such a way that a priority level of a location with insufficient sensing is gradually higher and a priority level of a location other than that is gradually lower.
Note that, when the small areas are associated with the sections, the uncompleted-range calculation unit 102 calculates a sensing-uncompleted range by allocating the sections to the sensing-completed range and the sensing reference range and extracting a section, the section being within the sensing reference range but not being included in the sensing-completed range.
With this, the processing for priority level update that is performed by the mobile body 10 is completed.
After the processing for priority level update that is performed by the mobile body 10 is completed, the sensor unit 108 of the mobile body 10 performs sensing in the sensing-uncompleted range according to the updated priority level. After performing the sensing, the mobile body control unit 100 repeats the processing again from Step S101. The series of processing is performed until a sensing-uncompleted range is absent.
According to the first example embodiment of the present invention, the mobile body control device 100 is capable of controlling the mobile body 10 and performing sensing reliably and quickly for the entire target area even when a location with insufficient sensing is generated at the time of sensing by the mobile body 10 that is autonomously operated in the target area. The reason for this is that the update unit 104 updates a priority level of one or more small areas associated with the sensing-uncompleted range in such a way that the priority level of the sensing-uncompleted range is higher than that of the sensing-completed range, that the completed-range calculation unit 101 performs sensing subsequently from a small area with a high priority level, and that the sensing-completed range constituted of the small areas where sensing is completed is calculated. With this, the mobile body control device 100 is capable of controlling the mobile body 10 to perform sensing again in the sensing-uncompleted range.
In the first example embodiment of the present invention, one mobile body performs sensing quickly and reliably for the entire target area by performing sensing again in an area with insufficient sensing. However, other mobile bodies present in the vicinity of the mobile body may perform sensing in the area with insufficient sensing. In a second example embodiment of the present invention, a method of performing sensing quickly and reliably for the entire target area with a plurality of mobile bodies is described.
As illustrated in
The mobile body 10a includes a mobile body control unit (mobile body control device) 100a, a drive unit 107, a sensor unit 108, and a communication unit 109. The mobile body control device 100a includes a completed-range calculation unit 101, an uncompleted-range calculation unit 102, a sensing reference shape storage unit 103, an update unit 104a, a priority level storage unit 105, an arrangement control unit 106, and a communication control unit 110.
The communication unit 109 is an antenna or the like that transmits and receives a radio wave for communicating with the other mobile bodies 10b and 10c via the communication network 20.
The communication control unit 110 controls the communication unit 109, and controls communication with the other mobile bodies 10b and 10c. The communication control unit 110 transmits information relating to a location of the sensing-uncompleted range and location information on the mobile body 10a to the other mobile bodies 10b and 10c (external devices). The communication control unit 110 receives location information on the sensing-uncompleted range and location information on the other mobile bodies 10b and 10c from the other mobile bodies 10b and 10c. The communication control unit 110 is connected with the uncompleted-range calculation unit 102 and the update unit 104a, and follows an instruction from the uncompleted-range calculation unit 102 or the update unit 104a and controls communication.
On the basis of the location information of the sensing-uncompleted range and the location information of the mobile body 10a, the update unit 104a determines a location of one or more small areas being subjected to priority level update. Further, on the basis of the location information of the sensing-uncompleted range and the location information of the external devices that are received from the external devices (other mobile bodies), the update unit 104a updates priority levels of the plurality of small areas for the mobile body 10a.
The other devices are similar to those described in the first example embodiment. Further, the other mobile bodies 10b and 10c have configurations similar to that of the mobile body 10a. Note that, in
Next, processing for priority level update performed by the mobile bodies 10a to 10c in the mobile body control system 200 is described with reference to a flowchart illustrated in
First, Steps S201 to S203 are similar to Steps S101 to S103 being the operation in the flowchart of the first example embodiment.
In Step S204, the update unit 104a issues a notification relating to completion of the priority level change to the communication control unit 110 and the uncompleted-range calculation unit 102. The uncompleted-range calculation unit 102 that receives the notification divides the information on the sensing-uncompleted range for each section, and generates sensing-uncompleted grid (section) identification information relevant to each section (see
The communication control unit 110 transmits transmission information (see
As one mode of reducing a size of the transmission information, in addition to the mobile body identification information and the information on a current location of the mobile body, the shape of the sensing-uncompleted range may be mapped in a simple figure, and information capable of identifying the figure may be transmitted.
The communication control unit 110 may perform transmission to all the other mobile bodies that are present in a communicable manner within the communication network 20, or may perform transmission to a specific mobile body. With this, the processing for priority level update that is performed by the mobile bodies 10a to 10c is completed.
Next, an operation of priority level update performed by the other mobile body 10b (or the mobile body 10c) having received the transmission information is described with reference to a flowchart illustrated in
In Step S301, the mobile body 10b receives the transmission information from the mobile body 10a via the communication unit 109. The communication control unit 110 of the mobile body 10b transmits the received transmission information to the update unit 104a.
In Step S302, the update unit 104a updates a priority level of the mobile body 10a according to the received transmission information. With this, the operation of priority level update performed by the mobile body 10b is completed.
After the processing for priority level update is completed, the sensor unit 108 of the mobile body 10b follows the updated priority level, and perform sensing in the sensing-uncompleted range.
According to the second example embodiment of the present invention, the mobile body control device 100a is capable of controlling the other mobile bodies 10b and 10c and performing sensing reliably and quickly for the entire target area even when a location with insufficient sensing is generated at the time of sensing by the mobile body 10a that is autonomously operated in the target area. Specifically, the mobile body control device 100a is capable of performing control in such a way that an omission of a sensing cover area of a mobile body can be covered quickly by another mobile body. The reason for this is that the mobile body 10a transmits the transmission information in which a priority level of the sensing-uncompleted range of the mobile body is set to be higher than that of the sensing-completed range, to the other mobile bodies 10b and 10c, and that the other mobile bodies 10b and 10c updates, on the basis of the transmission information, a priority level of a small area (section) associated with the sensing-uncompleted range, and performs sensing subsequently from a small area with a high priority level. With this, the mobile body control device 100a is capable of controlling the other mobile bodies 10b and 10c to perform sensing again in the range where sensing by the mobile body 10a is uncompleted.
According to the second example embodiment of the present invention, reliability and quickness of autonomous sensing in the target area can be enhanced more as compared to the first example embodiment in which a single mobile body performs sensing. The reason for this is that the information on the sensing-uncompleted range is shared by the plurality of mobile bodies, the priority levels in the area information on the plurality of mobile bodies are changed on the basis of the information, and the plurality of mobile bodies can be controlled to perform sensing again in the sensing-uncompleted range.
When the plurality of mobile bodies 10b and 10c are capable of performing sensing in the uncompleted range of the mobile body 10a, a mobile body arranged closer to the mobile body 10a may be first caused to perform sensing. In this case, the mobile body 10a also receives the transmission information from the plurality of mobile bodies 10b and 10c, compares the current location information on the mobile bodies 10b and 10c, which are contained in the transmission information, with the current location information on the mobile body 10a, and requests sensing to a mobile body arranged in a closer location. With this, the mobile bodies 10a to 10c cooperate with each other more easily, and idle motion of the mobile bodies 10a to 10c as a whole can be reduced.
As illustrated in
The arrangement control unit 301 controls arrangement of mobile bodies in a target area being subjected to sensing by the mobile bodies. The target area is constituted of a plurality of small areas.
The completed-range calculation unit 302 performs sensing subsequently from a small area with a high priority level, and calculates a sensing-completed range constituted of one or more small areas in which the sensing is completed.
On the basis of the calculated sensing-completed range and a reference range being subjected to sensing, the uncompleted-range calculation unit 303 calculates a sensing-uncompleted range in the target area, which is constituted of one or more small areas in which sensing is uncompleted.
The update unit 304 performs update in such a way that a priority level of one or more small areas associated with the calculated sensing-uncompleted range is higher than that of the sensing-completed range.
According to the third example embodiment of the present invention, the mobile body control device 300 is capable of controlling the mobile body and performing sensing reliably and quickly for the entire target area even when a location with insufficient sensing is generated at the time of sensing by the mobile body that is autonomously operated in the target area. The reason for this is that the update unit 304 updates a priority level of one or more small areas associated with the sensing-uncompleted range in such a way that the priority level of the sensing-uncompleted range is higher than that of the sensing-completed range, the completed-range calculation unit 302 performs sensing subsequently from a small area with a high priority level, and the sensing-completed range constituted of the small areas in which sensing is completed is calculated. With this, the mobile body control device 300 is capable of controlling the mobile body to perform sensing again in the sensing-uncompleted range.
In each of the above-mentioned example embodiments of the present invention, a part or the entirety of each of the constituent elements of the mobile body control device illustrated in
Each of the constituent elements of the mobile body control device according to each of the example embodiments of the present application is achieved when the CPU 501 acquires and executes the program 504 that achieves those functions. The program 504 for achieving the functions of the constituent elements of the mobile body control device is stored in the storage device 505 or the RAM 503 in advance, for example, and is read by the CPU 501 as needed. The program 504 may be supplied to the CPU 501 via the communication network 509.
Various modification examples are conceivable for a method of achieving each device. For example, the mobile body control device may be achieved by a freely-selected combination of an information processing device and a program, which is provided separately for each of the constituent elements. Further, the plurality of constituent elements included in the mobile body control device may be achieved by a freely-selected combination of one information processing device 500 and a program.
Further, a part or the entirety of each of the constituent elements of the mobile body control device is achieved by another all-purpose or dedicated circuit, a processor, or a combination of those. This may be constituted of a single chip or a plurality of chips connected via a bus.
A part or the entirety of each of the constituent elements of the mobile body control device may be achieved by a combination of the above-mentioned circuit or the like and a program.
When a part or the entirety of each of the constituent elements of the mobile body control device is achieved by a plurality of information processing devices, circuits, or the like, the plurality of information processing devices, circuits, or the like may be arranged in a centralized or decentralized manner.
While the invention has been particularly shown and described with reference to exemplary embodiments thereof, the invention is not limited to these embodiments. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2018/008762 | 3/7/2018 | WO | 00 |