The present invention relates to an object identification device, a roadside apparatus, and an object identification method for identifying objects at the roadside.
The realization of automatic traveling is desired which uses a system equipped with artificial intelligence as a driver, in place of a human. In order to realize the automatic traveling, a map with a fast update cycle including various information such as movements of surrounding vehicles and people is required, instead of a map with a low update frequency in which roads, buildings, etc. are shown. Such a map with a fast update cycle, that is, a map including dynamic information is called a dynamic map. In the creation of a dynamic map, an update cycle of 100 ms or less is required. It is necessary in the creation of a dynamic map to collect information on observed positions of objects observed by a plurality of sensors such as radars installed at the roadside, identify the same object, and deliver information on the observed position. Patent Literature 1 discloses a technique to identify the same object in an aircraft using a tracking function by radar.
Patent Literature 1: Japanese Patent Application Laid-open No. 2006-153736
However, according to the above conventional technique, the identification of observed positions acquired at different times is determined based on whether a subsequent observed position is observed in an estimated error ellipsoid, assuming that an object has made a uniform linear motion from a previous observed position. Further, in order to continue identification when an object turns, it is necessary to calculate observed positions, considering all motion models such as left turning motion and right turning motion in addition to a uniform linear motion model. Consequently, there is a problem of high processing load in the identification of the same object.
The present invention has been made in view of the above. It is an object of the present invention to provide an object identification device capable of reducing the load of processing to identify objects.
In order to solve the problem described above and achieve the object, an object identification device of the present invention includes a map information storage unit that stores map information that is information on a road. The object identification device further includes a region determination unit that acquires observed position information indicating observed positions at which an object is observed from a plurality of sensors, and determines whether each observed position is in any one of regions into which an area indicated by the map information is divided, and a road reference position conversion unit that converts each observed position determined to be in the region of the map information, into a traveling direction position indicating a position in a direction parallel to an assumed road direction in the region indicated by the map information, and a transverse direction position indicating a position in a direction perpendicular to the assumed road direction in the region, using the map information. The object identification device further includes a comparison unit that rearranges the observed positions after the position conversion in order of the traveling direction, creates pairs of front and rear observed positions in the traveling direction, calculates a difference in the traveling direction positions and a difference in the transverse direction positions between each pair of observed positions, and determines that a pair of observed positions between which the differences are within thresholds specified in respective items are derived from the same object, and determines that a pair of observed positions between which at least one of the differences is greater than the threshold are derived from different objects.
The object identification device according to the present invention has an advantage of being able to reduce the load of processing to identify objects.
Hereinafter, an object identification device, a roadside apparatus, and an object identification method according to an embodiment of the present invention will be described in detail with reference to the drawings. Note that the embodiment is not intended to limit the invention.
It is obvious that a vehicle traveling an expressway travels on the expressway. Whether the vehicle travels in a curve is determined by the shape of the expressway. Here, the object identification device 10 of the roadside apparatus 20 installed at the roadside stores information on the shape of the road, that is, map information. By an area indicated by the map information being subdivided into a plurality of regions, the object identification device 10 changes the motion model of a vehicle traveling on a curve for a model in which the vehicle moves on a straight line all the way in each region. Consequently, the object identification device 10 can reduce processing load in the identification of a vehicle or an object, compared to a case where a plurality of motion models including turning is considered.
The specific configuration and operation of the object identification device 10 will be described. The object identification device 10 includes a sensor installation information storage unit 11, a map information storage unit 12, a common coordinate transformation unit 13, a region determination unit 14, a road reference position conversion unit 15, a position estimation unit 16, a comparison unit, 17, and an identification processing unit 18.
The sensor installation information storage unit 11 stores sensor installation information that is information on the installation positions of the plurality of sensors (not illustrated). Each sensor observes a vehicle at the roadside, and outputs observed position information indicating an observed position that is the position of the vehicle when the sensor has observed the vehicle, to the common coordinate transformation unit 13. It is assumed that there is a plurality of sensors. The sensor installation information is position information in an absolute coordinate system common to the sensors. The sensor installation information may alternatively be position information based on the position of a reference sensor serving as a reference in an absolute coordinate system, and the relative positions of the other sensors to the reference sensor.
The map information storage unit 12 stores map information that is information on the road that vehicles travel. The map information storage unit 12 stores information on the road on the map as a combination of a plurality of straight lines. That is, the map information storage unit 12 stores information on the road, that is, an area managed, as information on a map divided into a plurality of regions according to the curvature of the road. In the divided regions, the road is treated as straight lines. Thus, in the map information, the area indicated by the map information is divided into the plurality of regions, and each divided region is of a size that allows the road to be linearly approximated in the region. The map information stored in the map information storage unit 12 includes division information on the regions, and information such as a passing order of the regions, road starting points in the regions, assumed road directions in the regions, a starting point shared by the entire map, and road starting point distances in the regions.
A starting point 51 shared by the entire map is the same as the road starting point in the first region, in the example of
The description returns to the explanation of
The region determination unit 14 acquires the observed position information transformed by the common coordinate transformation unit 13, and determines whether the observed position is in any one of the regions into which the area indicated by the map information is divided. Based on the map information acquired from the map information storage unit 12, the region determination unit 14 determines to which region the observed position belongs, from the division information on the regions included in the map information.
Based on the map information acquired from the map information storage unit 12 and the region determination result of the region determination unit 14, the road reference position conversion unit 15 converts the observed position determined to be in the region of the map information into a traveling direction position of the vehicle indicating a position in a direction parallel to the assumed road direction in the region indicated by the map information, and a transverse direction position of the vehicle indicating a position in a direction perpendicular to the assumed road direction in the region. The road reference position conversion unit 15 also calculates the traveling direction speed of the vehicle at the observed position. The detailed operation of the road reference position conversion unit 15 will be described later.
When the acquisition times of the observed position information acquired from the plurality of sensors vary from observed position information to observed position information, the position estimation unit 16 converts each observed position converted by the road reference position conversion unit 15 into an estimated observed position when the observed position is acquired at a reference time serving as a reference. The detailed operation of the position estimation unit 16 will be described later.
The comparison unit 17 rearranges the observed positions after the position conversion in order of the traveling direction, and compares front and rear observed positions. Specifically, the comparison unit 17 creates pairs of front and rear observed positions in the traveling direction, calculates the difference in the vehicle traveling direction positions, the difference in the vehicle transverse direction positions, and the difference in the vehicle traveling direction speeds between each pair of observed positions, and determines whether the differences are within thresholds specified in the respective items. The comparison unit 17 determines that a pair of observed positions between which the differences are within the thresholds specified in the respective items are derived from the same object, and determines that a pair of observed positions between which at least one of the differences is greater than the threshold are derived from different objects. Note that the comparison unit 17 may calculate the difference in the vehicle traveling direction positions and the difference in the vehicle transverse direction positions between each pair of observed positions, and perform the determination based on whether the differences, here, the two differences are within the thresholds specified in the respective items.
For each pair of observed positions determined to be derived from the same object by the comparison unit 17, the identification processing unit 18 discards the observed position information on one observed position of the two observed positions, or generates observed position information into which the two observed positions are integrated. The identification processing unit 18 outputs an object identification result obtained by repeating the discarding of observed position information or generation of observed position information into which two observed positions are integrated.
Next, the operation of the object identification device 10 to detect that observed positions indicated by acquired observed position information are derived from the same object, that is, to identify an object will be described.
The common coordinate transformation unit 13 transforms each acquired observed position from a relative coordinate system that is relative position information observed by the sensor into an absolute coordinate system common to the sensors such as latitude and longitude or coordinates obtained by transforming latitude and longitude into meters (step S2). When a laser is used as the sensor, for example, the relative position information measured by the sensor may be information such as the distance from the sensor to the observed position and the angle of the observed position as viewed from the sensor. As described above, when the observed positions are described in an absolute coordinate system common between the sensors, instead of relative position information to the sensors, the object identification device 10 can omit the operation in step S2.
The region determination unit 14 acquires the map information from the map information storage unit 12, and determines whether the observed position is in the regions on the map indicated by the map information (step S3). Specifically, the region determination unit 14 determines whether the observed position is included in any one of the regions of the map information illustrated in
The road reference position conversion unit 15 refers to the map information, and converts the observed position into a traveling direction position X and a transverse direction position Y of the vehicle with respect to the road in the map information, using the road starting point and the assumed road direction of the vehicle in the region in which the observed position is included (step S4). The road reference position conversion unit 15 can calculate the traveling direction position X of the vehicle and the transverse direction position Y of the vehicle using the following method, for example. The road reference position conversion unit 15, however, may use any calculation method by which the traveling direction position X of the vehicle and the transverse direction position Y of the vehicle can be calculated.
It is considered that the assumed road direction of the vehicle is parallel to the traveling direction of the vehicle, and the assumed road direction of the vehicle is perpendicular to the transverse direction of the vehicle. Thus, letting β be the angle of the assumed road direction relative to a specified direction on the map, a traveling direction road vector D(bold)hor is defined as in formula (1), and a transverse direction road vector D(bold)ver is defined as in formula (2).
D(bold)hor=(cosβ, sinβ) (1)
D(bold)ver=(cos(β−π/2), sin(β−π/2)) (2)
Let a certain point in the map be origin point (0, 0) of the map, and observed coordinates of the vehicle, that is, the observed position be S(bold)=(a, b). Letting the coordinates of the road starting point in the region be P(bold)road=(Xroad, Yroad), the road reference position conversion unit 15 can calculate a traveling direction position Xarea in the region by formula (3), and calculate a transverse direction position Yarea in the region by formula (4).
X
area=D(bold)hor·(S(bold)−P(bold)road) (3)
Y
area=D(bold)ver·(S(bold)−P(bold)road) (4)
Of them, the traveling direction position Xarea in the region represents the distance from the road starting point coordinates in the region. However, in practice, it is necessary to calculate the traveling direction distance from the starting point 51 shared by the entire map. Thus, the distance from the starting point 51 shared by the entire map to the starting point in the region including the observed position is added.
Thus, the road reference position conversion unit 15 can calculate the traveling direction position X of the vehicle and the transverse direction position Y of the vehicle, using the map information. The road reference position conversion unit 15 calculates a traveling direction speed indicating the speed of the vehicle in the traveling direction (step S6). Specifically, when the sensor is a radar, for example, the road reference position conversion unit 15 can calculate a traveling direction speed VX from a Doppler velocity Vget projected in an observed direction, using the angle γ between the assumed road direction of the vehicle and the measurement direction of the sensor, as in formula (5).
V
X=Vget/cosγ (5)
When the observed position is not in any region indicated by the map information (step S3: No), the region determination unit 14 discards the observed position information (step S5).
Here, it is expected that the sensors connected to the object identification device 10 have different measurement cycles. In this case, in the object identification device 10, pieces of observed position information observed by the sensors are collected at different times. In the object identification device 10, it is important to compare past data and current data even if they are pieces of observed position information from the same sensor, to determine how the same vehicle has traveled. However, the pieces of observed position information acquired at different times cannot be simply compared because the vehicle has traveled. The position estimation unit 16 converts the observed positions acquired at different times into estimated observed positions when the observed positions are acquired at a reference time serving as a base time (step S7).
Here, let the reference time be Tref, and the acquisition time of observed position information be Tget. The traveling direction of the vehicle can be regarded as a straight line relative to the assumed road direction in the region included in the map information stored in the map information storage unit 12 of the object identification device 10. When a dynamic map with a fast update cycle, for example, an update cycle of 100 ms or less is utilized, the time difference between the reference time Tref and the observed position acquisition time Tget is short, and the vehicle can be considered to be moving at a constant speed. That is, the position estimation unit 16 can calculate an estimated traveling direction position Xest of the vehicle, an estimated transverse direction position Yest of the vehicle, and an estimated traveling direction speed Vest of the vehicle at the reference time Tref, using the traveling direction position X, the transverse direction position Y of the vehicle, and the traveling direction speed VX of the vehicle at the acquisition time Tget, assuming that the vehicle observed at the acquisition time Tget of the observed position information has made a uniform linear motion. Specifically, the position estimation unit 16 can easily calculate the estimated traveling direction position Xest, the estimated transverse direction position Yest, and the estimated traveling direction speed Vest at the reference time Tref by the following formulas (6) to (8).
X
est=X+VX×(Tref−Tget) (6)
Y
est=X (7)
V
est=V (8)
Thus, the position estimation unit 16 can treat the pieces of data of observed position information at the different acquisition times Tget as those acquired at the same reference time Tref. By representing the vehicle in the traveling direction and the transverse direction, using the map information, the position estimation unit 16 can perform estimation processing, assuming that the vehicle has made a uniform linear motion regardless of whether the road is a straight line or a curve. The reference time Tref may be the next transmission time of the dynamic map, or the previous transmission time of the dynamic map or the like may be used. When the measurement cycles of the sensors are the same and synchronized, the object identification device 10 can omit the operation in step S6. Even if acquisition times are strictly different, the position estimation unit 16 may regard acquisition times in a specified period as the same. The specified period is, for example, the time required to travel a distance less than the length of one vehicle, in consideration of the speed of the vehicle.
Next, the comparison unit 17 rearranges the observed positions that can be considered to be simultaneously acquired by the processing of the position estimation unit 16, in order of the vehicle traveling direction (step S8). On the observed positions rearranged in order of the vehicle traveling direction, the comparison unit 17 creates pairs of front and rear observed positions in the order, and calculates the difference in the vehicle traveling direction positions, the difference in the vehicle transverse direction positions, and the difference in the vehicle traveling direction speeds, between each pair of observed positions. The comparison unit 17 determines whether there is a pair of observed positions between which the differences are within the thresholds specified in the respective items, specifically, the threshold of the vehicle traveling direction position, the threshold of the vehicle transverse direction position, and the threshold of the vehicle traveling direction speed (step S9). The threshold of the vehicle traveling direction position is set, for example, within 18 m based on the vehicle length. The threshold of the vehicle transverse direction is set, for example, to the vehicle width or the road width, specifically, to 3.5 m or so for an expressway. The threshold of the vehicle traveling direction speed is set, for example, within ±α km/h.
When the differences are within the threshold of the vehicle traveling direction position, the threshold of the vehicle transverse direction position, and the threshold of the vehicle traveling direction speed (step S9: Yes), the comparison unit 17 determines that the pair of observed positions between which the differences are within the thresholds specified in the respective items are derived from the same object. The comparison unit 17 notifies the identification processing unit 18 of the determination result. For the pair of observed positions determined to be derived from the same object, the identification processing unit 18 deletes the observed position information on one observed position of the two observed positions, or generates observed position information into which the two observed positions are integrated (step S10). The object identification device 10 repeatedly executes the processing until there is no pair of observed positions between which the differences are within the thresholds in step S9. When there is no pair of observed positions between which the differences are within the thresholds, that is, No in step S9, the processing is ended.
The effects obtained by the object identification device 10 performing the above processing will be specifically described.
(1) Comparison with a case where no map information is stored
Compared with the case where no map information is stored, the object identification device 10 can determine whether observed positions are derived from the same object by providing different thresholds for the vehicle traveling direction position and the vehicle transverse direction position. Specifically, the object identification device 10 can compare vehicle positions using two types of thresholds, the threshold of the vehicle traveling direction position and the threshold of the vehicle transverse direction position. On the other hand, a device not storing map information performs determination of whether observed positions are derived from the same object by comparing vehicle positions based on a relative distance between two points of the observed positions, that is, using only one type of distance threshold. Thus, there is a possibility that a vehicle in the next lane may be regarded as the same object. This is because the distance between vehicles in the transverse direction is short while the vehicle body is long in the traveling direction. For example, the road width may be 3.5 m or less while a large car is 10 m long.
(2) Comparison with a case where the map information is stored as a function of the road
The object identification device 10 may store the map information in the form of expressing the shape of the road by a function. However, it is difficult to express the shape of the road in the form of a general function because the shape of the road is generated from a complex combination of a straight line, an arc, a clothoid curve, a parabola, etc., and the actual road includes production errors. When an arbitrary nth-order polynomial is modeled from actual measured values of the map, overfitting may occur depending on a polynomial interpolation method, and a road with a shape completely different from the original shape of the road may be modeled. For a road expressed in the form of a function, it is necessary to perform calculation for determining a perpendicular between the observed position and the function to determine the transverse direction position, integration of the function for determining the traveling direction position, calculation of a tangential direction for calculating the traveling direction of the observed position, etc. Depending on the form of the function of the road, the calculation may become complicated, that is, processing load may be increased. By contrast, as described above, the object identification device 10 can reduce processing load by using the map information in which the road is divided into the regions that allow linear approximation.
(3) Comparison with a case where the map information is stored as a function of the road, and only an assumed road direction is acquired
After road information is stored in the form of a function, it is possible, from the function, to acquire only information on an assumed road direction based on a derivative value of the function, and calculate the difference in traveling direction positions and the difference in transverse direction positions between observed positions, individually, using the assumed road direction as the traveling direction. However, the difference in the traveling direction positions and the difference in the transverse direction positions must be determined based on position information on objects from a unified standard of the map. In this case, calculation using all combinations of observed positions is required. Thus, for m observed positions, calculation of the differences between the observed positions requires mC2 operations. By contrast, the object identification device 10 storing the map information calculates the difference in the traveling direction positions between front and rear observed positions, and thus for m observed positions, performs m−1 operations to calculate the differences between the positions necessary for the identification of an object, and can reduce processing load.
Next, the hardware configuration of the object identification device 10 will be described. In the object identification device 10, the sensor installation information storage unit 11 and the map information storage unit 12 are memory. The common coordinate transformation unit 13, the region determination unit 14, the road reference position conversion unit 15, the position estimation unit 16, the comparison unit 17, and the identification processing unit 18 are implemented by a processing circuit. That is, the object identification device 10 includes a processing circuit for determining whether observed positions are derived from the same object. The processing circuit may be a processor for executing programs stored in memory and the memory, or may be dedicated hardware.
Here, the processor 91 may be a Central Processing Unit (CPU), a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a Digital Signal Processor (DSP), or the like. The memory 92 corresponds, for example, to nonvolatile or volatile semiconductor memory such as Random Access Memory (RAM), Read Only Memory (ROM), a flash memory, an Erasable Programmable ROM (EPROM), or an Electrically EPROM (EEPROM) (registered trademark), or a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a Digital Versatile Disc (DVD), or the like.
Note that the functions of the object identification device 10 may be implemented partly by dedicated hardware and partly by software or firmware. Thus, the processing circuit can implement the above-described functions by dedicated hardware, software, firmware, or a combination of them.
As described above, according to the present embodiment, the object identification device 10 stores map information, and an area indicated by the map information is subdivided into a plurality of regions, whereby a motion model of a vehicle traveling on a curve is substituted by a model in which the vehicle moves on a straight line all the way in each region. Consequently, the object identification device 10 can reduce processing load when identifying an object, that is, a vehicle.
The configuration described in the above embodiment illustrates an example of the subject matter of the present invention, and can be combined with another known art, and can be partly omitted or changed without departing from the scope of the present invention.
10 object identification device; 11 sensor installation information storage unit; 12 map information storage unit; 13 common coordinate transformation unit; 14 region determination unit; 15 road reference position conversion unit; 16 position estimation unit; 17 comparison unit; 18 identification processing unit; 20 roadside apparatus.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2017/018570 | 5/17/2017 | WO | 00 |