This application claims priority to Japanese Patent Application No. 2020-201616 filed on Dec. 4, 2020, the entire disclosure of which is incorporated herein by reference.
The present disclosure relates to an autonomous travel system.
As a technique for estimating a state (e.g. positional information) of an automated vehicle, Simultaneous Localization and Mapping (SLAM) has been known. The SLAM is a technique that carries out a self-position estimation of a moving body and mapping of an environment simultaneously, which allows the moving body to create a map of an environment under a situation where the environment is unknown. The moving body carries out a specific task while avoiding an obstruct using the constructed map information.
As a technique that estimates a self-position of an autonomous travel vehicle using a road image, a technique disclosed in U.S. Pat. No. 8,725,413 has been known. In this technique, a camera capturing an image of a road surface is disposed on a lower surface of a vehicle body, and the autonomous travel vehicle estimates its position by comparing a feature of an image captured in advance (a map image) and a feature of an image of the road surface at a current time (an actual image).
However, the accuracy of a map decreases in a configuration in which a camera, an Inertial Measurement Unit (IMU), and a Global Positioning System (GPS) are mounted on an autonomous travel vehicle, images are captured at set distance intervals while the autonomous travel vehicle travels, and coordinates and positional information of the autonomous travel vehicle to be associated with the captured image are estimated based on the measurement information by the IMU, the GPS and the camera to create a map. Specifically, accuracy of the coordinates and the positional information of the autonomous travel vehicle to be associated with the image captured during the mapping is poor due to poor positioning accuracy of the IMU and the GPS. As a result, autonomous travelling of the autonomous travel vehicle becomes less precise due to the poor accuracy in the estimation of the coordinates and the positional information of the autonomous travel vehicle.
In accordance with an aspect of the present disclosure, there is provided an autonomous travel system including a road surface image acquisition device disposed on a lower surface of a vehicle body of an autonomous travel vehicle, and configured to acquire an image of a road surface below the vehicle body, a storage unit mounted on the autonomous travel vehicle, and configured to store a map image of the road surface with which coordinates and positional information of the autonomous travel vehicle are associated, an estimation unit mounted on the autonomous travel vehicle, and configured to estimate the coordinates and the positional information of the autonomous travel vehicle by comparing a feature extracted from the image of the road surface acquired by the road surface image acquisition device and a feature extracted from the map image, a ground satellite signal reception antenna installed on a ground where the autonomous travel vehicle travels, and configured to receive a radio wave from a satellite, a ground wireless communication device configured to transmit measurement information acquired through the ground satellite signal reception antenna to the autonomous travel vehicle wirelessly, a vehicle wireless communication device mounted on the autonomous travel vehicle, and configured to receive the measurement information from the ground wireless communication device, a vehicle satellite signal reception antenna mounted on the autonomous travel vehicle, and configured to receive the radio wave from the satellite, and a mapping unit mounted on the autonomous travel vehicle, and configured to create the map image of the road surface with which the coordinates and the positional information are associated, from the image of the road surface acquired by the road surface image acquisition device based on the measurement information acquired through the ground satellite signal reception antenna and the measurement information acquired through the vehicle satellite signal reception antenna, in mapping outdoors.
Other aspects and advantages of the disclosure will become apparent from the following description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the disclosure.
The disclosure, together with objects and advantages thereof, may best be understood by reference to the following description of the embodiments together with the accompanying drawings in which:
The following describes an embodiment of the present disclosure with reference to the accompanying drawings.
As illustrated in
As illustrated in
As illustrated in
As illustrated in
The moving body side apparatus (the vehicle side apparatus) 200 includes a control device 40. The control device 40 includes a processing unit 50, a storage unit 60, and a mapping unit 70. The processing unit 50 includes an estimation unit 51, and the estimation unit 51 includes a feature extraction unit 52 and a matching unit 53. The moving body side apparatus (the vehicle side apparatus) 200 includes a motor driver 80, a travel motor 81, a motor driver 83, a steering motor 84, a light source driver 86, vehicle Global Navigation Satellite System (GNSS) antennas 87, 88 as vehicle satellite signal reception antennas, a GNSS receiver 89, and wireless communication devices 91, 92.
The ground side apparatus 300 (the reference side apparatus) includes a ground GNSS antenna 100 as a ground satellite signal reception antenna, a GNSS receiver 101, a wireless communication device 102, a total station 110 as a measurement instrument, and a wireless communication device 111.
The wireless communication device 91 of the moving body side apparatus (the vehicle side apparatus) 200 and the wireless communication device 102 of the ground side apparatus (the reference side apparatus) 300 are wirelessly communicable therebetween. The wireless communication device 92 of the moving body side apparatus (the vehicle side apparatus) 200 and the wireless communication device 111 of the ground side apparatus (the reference side apparatus) 300 are wirelessly communicable therebetween.
As illustrated in
The storage unit 60 stores various programs to control the autonomous travel vehicle 20. The control device 40 may include a dedicated hardware executing at least a part of various processes, for example, an application specific integrated circuit (ASIC). The control device 40 may be constituted as at least one processor configured to operate in accordance with the computer program, at least one dedicated hardware circuit such as the ASIC, or a circuit including a combination of these. The processor includes a CPU and a memory such as a RAM and a ROM. The memory stores a program code or an instruction causing the CPU to execute the processes. The memory, i.e., a computer readable medium, includes any type of a memory accessible from a general purpose computer or a special purpose computer.
The control device 40 operates the autonomous travel vehicle 20 by controlling the travel motor 81 and the steering motor 84 in accordance with the programs stored in the storage unit 60. The autonomous travel vehicle 20 of the present embodiment is a vehicle that is controlled by the control device 40 to travel and be steered automatically without being operated by an operator.
The storage unit 60 stores a map image 61 of a road surface, that is, the map image 61 of the road surface Sr captured in advance. The map image 61 is an image of the road surface with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated.
The estimation unit 51 is configured to estimate the coordinates and the positional information of the autonomous travel vehicle 20 by comparing, for example, features (a point group) F1 to F5 extracted from the image of the road surface Sr captured (acquired) by the camera 30, as illustrated in
Specifically, the feature extraction unit 52 detects feature points from the image P1 corresponding to the image of the road surface at the current time (the actual image) as illustrated in
In storing the map image 61 in the storage unit 60 in advance, the coordinates and the positional information of a pattern of the road surface are stored as an environment map. The environment map is created with Simultaneous Localization and Mapping (SLAM). The SLAM is a technique that carries out localization of a moving body and mapping of its environment simultaneously, which allows the moving body to create a map of an unknown environment. A specific task is carried out using the created map information. The coordinates of the autonomous travel vehicle 20 are, more specifically, the coordinates indicating one point of the vehicle body 21 as illustrated in
The control device 40 controls the travel motor 81 and the steering motor 84 while estimating the coordinates and the positional information of the autonomous travel vehicle 20 on the map, thereby moving the autonomous travel vehicle 20 to a desired position.
As illustrated in
As illustrated in
As illustrated in
The positional information is measured as an angle of a direction with a satellite positioning (the positioning using the GNSS antennas 87, 88, 100).
As illustrated in
As illustrated in
As illustrated in
As illustrated in
The following will describe an operation of the present embodiment.
In mapping outdoors, the mapping unit 70 stores the image data acquired by the camera 30 at set distance intervals and the time data at Step S10 in
In creating the map image outdoors, various measurement data are acquired along a desired travel route while the autonomous travel vehicle 20 travels at a low speed. Alternatively, in creating the map image outdoors, various measurement data are acquired along the desirable travel route while the autonomous travel vehicle 20 travels and stops repeatedly.
The mapping unit 70 stores the acquired data and the time data from the ground GNSS antenna 100 and the vehicle GNSS antenna 87, 88 at Step S11 in
The mapping unit 70 searches for the data acquired through the ground GNSS antenna 100 and the vehicle GNSS antenna 87, 88 closest temporally (closest in terms of time) to the time when each of the images is captured by the camera 30, and associates the acquired data with their corresponding image data at Step S12 in. In
As a result, data are organized by time with all information (calculation values) inputted to one processing system (the control device 40).
In
Alternatively, instead of
Here, interferometric positioning, in which radio waves from the satellite are simultaneously observed by the ground GNSS antenna 100 corresponding to the known point and by the vehicle GNSS antenna 87 corresponding to the unknown point to observe the coordinates of the autonomous travel vehicle 20 corresponding to the unknown point, in particular, the Real Time Kinematic-Global Navigation Satellite System (RTK-GNSS) method is used to perform positioning. Similarly, interferometric positioning, in which radio waves from the satellite are simultaneously observed by the ground GNSS antenna 100 corresponding to the known point and by the vehicle GNSS antenna 88 corresponding to the unknown point to observe the coordinates of the autonomous travel vehicle 20 corresponding to the unknown point, in particular, the RTK-GNSS method is used to perform positioning. In this way, an error in estimation of the coordinates may be reduced by providing the satellite positioning instrument (the GNSS antennas 87, 88) on the vehicle and the satellite positioning instrument (the GNSS antenna 100) on the ground, sending the measurement information from the ground side (the reference side) to the moving body side (the vehicle side), and estimating the coordinates with the RTK-GNSS method. As a result, the accuracy in the self-position estimation and the precision in the autonomous travelling of the autonomous travel vehicle 20 may be improved due to the improvement of the accuracy of the map. Further, the positional information (the angle of the direction) may be calculated from the two points by providing two vehicle GNSS antennas.
Specifically, for example, the coordinates are estimated with interferometric positioning using the ground GNSS antenna 100 and the vehicle GNSS antenna 87. Further, the positional information (the angle of the direction) is estimated from two positions, one of which is estimated with the interferometric positioning using the ground GNSS antenna 100 and the vehicle GNSS antenna 87, and the other of which is estimated with interferometric positioning using the ground GNSS antenna 100 and the vehicle GNSS antenna 88.
It is noted that the wireless communication device may change its wireless communication method depending on the range of mapping, and a designated low power wireless communication is used if it is less than the radius of 500 meters and the LTE packet communication is used if it is equal to or greater than the radius of 500 meters.
In mapping indoors, the mapping unit 70 stores the image data acquired by the camera 30 at the set distance intervals and the time data at Step S20 in
In creating the map image indoor, various data are acquired along a desired travel route while the autonomous travel vehicle 20 travels at a low speed. Alternatively, in creating the map image indoors, various measurement data are acquired along the desired travel route while the autonomous travel vehicle 20 travels and stops repeatedly.
The mapping unit 70 stores the acquired data by the total station 110 and the time data at Step S21 in
The mapping unit 70 searches for the data acquired by the total station 110 closest temporally to the time when each of the images is captured by the camera 30, and associates the acquired data with their corresponding image data at Step S22 in
In this way, by executing Step S12 in
The above-described embodiment offers the following effects.
(1) The configuration of the autonomous travel system 10 includes the camera 30 as the road surface image acquisition device disposed on the lower surface 22 of the vehicle body 21 of the autonomous travel vehicle 20 and configured to acquire images of the road surface Sr below the vehicle body 21. The autonomous travel system 10 includes the storage unit 60 mounted on the autonomous travel vehicle 20 and configured to store the map image 61 of the road surface Sr associated with the coordinates and the positional information of the autonomous travel vehicle 20. The autonomous travel system 10 includes the estimation unit 51 mounted on the autonomous travel vehicle 20 and configured to estimate the coordinates and the positional information of the autonomous travel vehicle 20 by comparing the features F1 to F5 extracted from the image of the road surface Sr acquired by the camera 30 and the features extracted from the map image 61. The autonomous travel system 10 includes the ground GNSS antenna 100 as the ground satellite signal reception antenna installed on the ground where the autonomous travel vehicle 20 travels and configured to receive radio waves from the satellites 51 to S8. The autonomous travel system 10 includes the wireless communication devices 91, 102 for transmitting the measurement information acquired through the ground GNSS antenna 100 to the autonomous travel vehicle 20 wirelessly. The autonomous travel system 10 includes the vehicle GNSS antennas 87, 88 as the vehicle satellite signal reception antenna mounted on the autonomous travel vehicle 20 and configured to receive radio waves from the satellites S1 to S8. The autonomous travel system 10 includes the mapping unit 70 mounted on the autonomous travel vehicle 20 and configured to create the map image 61 of the road surface Sr with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated, from the images of the road surface Sr acquired by the camera 30, based on the measurement information by the ground GNSS antenna 100 and the measurement information by the vehicle GNSS antennas 87, 88, in mapping outdoors.
In this way, the GNSS antennas 87, 88 are mounted on the autonomous travel vehicle 20. The measurement information acquired through the ground GNSS antenna 100 installed on the ground is transmitted wirelessly to the autonomous travel vehicle 20. The mapping unit 70 mounted on the autonomous travel vehicle 20 creates the map image 61 of the road surface Sr with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated, from the images of the road surface acquired by the camera 30 based on the measurement information acquired through the ground GNSS antenna 100 and the measurement information acquired through the vehicle GNSS antennas 87, 88, in mapping outdoors.
This permits creating the map image 61 of the road surface Sr with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated, while minimizing an error. As a result, the accuracies of the coordinates and the positional information of the autonomous travel vehicle 20 to be associated with the acquired image may be improved.
That is, the coordinates (two dimensional coordinates) and the positional information of the autonomous travel vehicle 20 may be estimated more accurately with the interferometric positioning using the satellite signal reception antenna mounted on the autonomous travel vehicle 20 and the satellite signal reception antenna (the known point) installed on the ground as compared to with one-point positioning.
(2) The mapping unit 70 searches for the measurement information acquired through the ground GNSS antenna 100 and the measurement information acquired through the vehicle GNSS antenna 87, 88 closest temporally to the time when each of the images of the road surface Sr is acquired by the camera 30, and creates the map image 61 of the road surface Sr with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated. As a result, highly accurate positioning can be achieved.
(3) The camera 30 and the vehicle GNSS antenna 87 are disposed in the same vertical axis Axv in the autonomous travel vehicle 20. This arrangement of the position of the camera 30 and the position of the vehicle GNSS antenna 87 permits positioning with high accuracy.
(4) The autonomous travel system is provided with two vehicle GNSS antennas 87, 88. This configuration permits acquiring accurate positional information (the angle of the direction) of the autonomous travel vehicle 20 by using the two satellite signal reception antennas (the vehicle GNSS antennas 87, 88) mounted on the autonomous travel vehicle 20.
(5) The configuration of the autonomous travel system 10 includes the total station 110 as the measurement instrument installed on the ground to observe the coordinates and the positional information (the angle of the direction) of the autonomous travel vehicle 20. The autonomous travel system 10 includes the wireless communication devices 92, 111 as the wireless communication devices for the measurement instrument to transmit measurement information by the total station 110 to the autonomous travel vehicle 20 wirelessly. In mapping indoors, the mapping unit 70 creates the map image 61 of the road surface Sr with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated, from the images of the road surface Sr acquired by the camera 30 based on the measurement information by the total station 110.
Thus, the total station 110 is provided on the ground, and the measurement information regarding the coordinates and the positional information (the angle of the direction) of the autonomous travel vehicle 20 is transmitted to the autonomous travel vehicle 20 wirelessly. Then, the mapping unit 70 creates the map image 61 of the road surface Sr associated with the coordinates and the positional information of the autonomous travel vehicle 20 are associated, from the images of the road surface acquired by the camera 30 based on the measurement information by the total station 110, in mapping indoors.
As a result, the map image of the road surface with which the coordinates and the positional information of the autonomous travel vehicle 20 are associated may be created indoors.
(6) In the autonomous travel vehicle 20, the reflection member 90 reflecting the light wave from the total station 110, the camera 30, and the vehicle GNSS antenna 87 are disposed on the same vertical axis Axv. This arrangement of the position of the camera 30, the position of the vehicle GNSS antenna 87, and the position of the reflection member 90 permits positioning with high accuracy.
The present disclosure is not limited to the above-described embodiment, but may be modified in various manners, as exemplified below.
Although two vehicle GNSS antennas (the vehicle satellite signal reception antennas) 87, 88 are used in the above-described embodiment, only one vehicle GNSS antenna may be used.
In a case where the autonomous travel vehicle travels only outdoors, a positioning instrument (the total station) may be omitted, and a map may be created based on the coordinates and the positional information acquired through the GNSS antennas. This permits reducing the cost of the autonomous travel system.
In a case where the autonomous travel vehicle travels indoors and outdoors, a direction meter capable of finding a direction indoors such as a compass may be added. This improves the accuracy of the mapping indoors and outdoors.
Although the camera 30 is used as the road surface image acquisition device in the above embodiment, a device other than the camera may be used as the road surface image acquisition device. For example, a linear sensor (a linear image sensor) may be used as the road surface image acquisition device.
Although the ground GNSS antenna 100 is used as the ground satellite signal reception antenna and the vehicle GNSS antennas 87, 88 are used as the vehicle satellite signal reception antennas in the above-described embodiment, a ground GPS antenna and a vehicle GPS antenna may be used as the ground satellite signal reception antenna and the vehicle satellite signal reception antenna, respectively.
Number | Date | Country | Kind |
---|---|---|---|
2020-201616 | Dec 2020 | JP | national |