The present disclosure relates to technologies for detecting axial misalignment of a beam sensor installable to vehicles. Note that the axial misalignment of a beam sensor represents displacement of a reference axis of a beam output from the beam sensor in its travelling direction with respect to a previously designed axis position; the reference axis of a beam sensor is referred to as a beam axis of the beam sensor.
Beam sensors are usually used in order to perform various types of control for improving the running safety of vehicles. Such a beam sensor transmits probing beams, such as laser beams, ultrasonic waves, or millimeter waves, and receives reflection beams, thus detecting targets located around a vehicle.
Such a beam sensor is mounted to a predetermined mount position of a vehicle while the beam axis is aligned with a previously designed axis position such that each probing beam is irradiated within a predetermined irradiation range. For this reason, if any factor causes the mounted position of the beam sensor to be deviated from the predetermined mount position, the beam axis may be deviated from the previously designed axis position. This may result in radar waves being out of the predetermined irradiation range. This may deteriorate the detection accuracy of targets to be detected by the beam sensor, deteriorating the accuracy of the various types of control for improving the running safety of the vehicle.
Note that such axial misalignment of the beam axis relative to a previously designed axis position will also be referred to merely as axial misalignment. In addition, axial misalignment in a vertical plane including the beam axis will be referred to as vertical misalignment, and axial misalignment in a horizontal plane including the beam axis will also be referred to as horizontal misalignment.
In view of these circumstances, technologies are proposed for detecting axial misalignment of beam sensors.
For example, a technology disclosed in patent document detects a vanishing point in accordance with an image captured while a vehicle to which a laser beam sensor is installed is running.
Then, during adjustment of the laser beam axis, i.e. while the vehicle is stopped, the technology detects, based on the detected vanishing point and the transmitting direction of a laser beam, the difference between the transmitting direction of the laser beam and the forward direction of the vehicle, and corrects the transmitting direction of the laser beam accordingly.
The technology disclosed in patent document 1 is capable of correcting the transmitting direction of the laser beam in accordance with the vanishing point that is detected based on the image captured while the vehicle to which the laser beam sensor is installed is running. Unfortunately, the technology performs the correction of the transmitting direction of the laser beam during adjustment of the laser beam axis, i.e. while the vehicle is stopped. Thus, the technology may result in a difficulty in detection of axial misalignment of the radar beam sensor while the corresponding vehicle is running.
The present disclosure has been created in view of such a problem. For example, a first object of the present disclosure is to provide technologies, each of which is capable of detecting axial misalignment of a beam sensor, which is installable to a vehicle, while the vehicle is running.
In addition, a second object of the present disclosure is to improve the accuracy of detecting axial misalignment of the beam axis of a beam sensor installable to vehicles.
There is provided a diagnostic apparatus of a beam sensor installed in a vehicle. The beam sensor transmits a probing beam and receives a reflected beam based on the probing beam. The diagnostic apparatus includes an obtaining unit for obtaining horizontal misalignment information indicative of whether there is horizontal misalignment, the horizontal misalignment being misalignment of the probing beam with respect to a designed beam axis position in a horizontal direction. The horizontal direction corresponds to a width direction of the vehicle. The diagnostic apparatus includes a diagnostic unit for diagnosing whether there is vertical misalignment. The vertical misalignment is misalignment of the probing beam with respect to a designed beam axis position in a vertical direction. The vertical direction corresponds to a height direction of the vehicle. The diagnostic apparatus includes a determining unit for
(1) Determining, based on the horizontal misalignment information, whether the diagnostic unit executes diagnosis of the vertical misalignment
(2) Causing the diagnostic unit to execute diagnosis of the vertical misalignment upon the horizontal misalignment information representing that there is no horizontal misalignment
(3) Disable the diagnostic unit from executing diagnosis of the vertical misalignment upon the horizontal misalignment information representing that there is horizontal misalignment.
The diagnostic apparatus is configured to disable execution of diagnosis of the vertical misalignment when there is misalignment of the probing beam in the horizontal direction. This configuration prevents the state where there is horizontal misalignment from being erroneously detected as the state where there is vertical misalignment. That is, this configuration reduces erroneous detection of vertical misalignment of the beam axis of the beam sensor.
Note that bracketed reference numerals in the claims represent correspondence relationship with respect to specific means described in the following embodiments as an example, and therefore do not restrict the scope of the present invention.
The following describes the embodiments of the present invention with reference to the accompanying drawings.
Referring to
The target recognition device 13 is communicably connected to the radar sensor 11, the image sensor 12, and the drive-assist execution device 14.
Referring to
Reference characters (a) and (c) of
(1) The center axis M of the detection range has a predetermined angle θY0 relative to a predetermined direction, for example, the direction of the X-axis, in the vehicle width direction along the X-Y plane, i.e. a horizontal plane, of the own vehicle
(2) The radar sensor 11 is mounted such that the center axis M of the detection range has a predetermined angle θZ0 relative to a predetermined direction, for example, the direction of the Z-axis, in the vehicle width direction along the X-Z plane, i.e. a vertical plane, of the own vehicle.
Hereinafter, the following state in which the angle, referred to as θYm, formed between the center axis M of the detection range and the predetermined direction, i.e. the X axis, in the vehicle width direction along the X-Y plane deviates from the predetermined angle θY0 is referred to as a state in which axial misalignment in the horizontal direction has occurred (see reference character (b) in
Similarly, the following state in which the angle, referred to as θZm, formed between the center axis M of the probing range and the predetermined direction, i.e. the Z axis, in the vehicle height direction along the Z-X plane deviates from the predetermined angle θZ0 is referred to as a state in which axial misalignment in the vertical direction has occurred (see reference character (d) in
The radar sensor 11 irradiates radar waves, i.e. radar beams, toward a first probing region established in front of the own vehicle 1, and receives echoes, i.e. reflected beams, based on the irradiated radar beams. For example, the radar sensor 11 and the target recognition device 13 constitute a known Frequency Modulated Continuous Wave (FMCW) radar that detects targets within the first probing region using millimeter waves.
Specifically, as illustrated in
For example, at least one of the transmitting antenna and the receiving antenna of the radar sensor 11 is comprised of an array of antennas. Note that the combination of the transmitting antenna and the receiving antenna, at least one of which is comprised of the array of antennas will be referred to as channels. The radar sensor 11 is operative to extract a beat signal for each of the channels. The radar sensor 11 causes an AD converter to convert the extracted analog beat signal to a digital beat signal, and outputs the digital beat signal to the target recognition device 13. The output beat signals are input to the target recognition device 13.
Referring to
The detecting range of the CCD camera has a predetermined angular range wider than that of the detection range of the radar sensor 11 (see
Specifically, as illustrated in
Additionally, the second probing range, i.e. second detection region, of the image sensor 12 is a region expanding, in the form of a sector shape, to have a predetermined angle of view in the horizontal direction, i.e. the vehicle width direction, while centering on the optical axis of the image sensor 12. Note that, as illustrated in
In addition, the first probing region, i.e. first detection region, of the radar sensor 11 expands, in the form of a sector shape, to have a predetermined angle of view in the vertical direction, i.e. the height direction of the vehicle 1, while centering on the beam axis of the radar beam. Additionally, the second probing region, i.e. second detection region, of the image sensor 12 expands, in the form of a sector shape, to have a predetermined angle of view in the vertical direction, i.e. the height direction, while centering on the optical axis of the image sensor 12 (see (a) of
This results in the first probing region and the second probing region being at least partly overlap one another.
The image sensor 12 performs known image-processing tasks, such as template matching, with respect to image data captured by the CCD camera, thus detecting predetermined targets, such as vehicles or pedestrians located in the corresponding detection range.
The image sensor 12 also transmits, to the target recognition device 13, information indicative of at least one target, which is referred to as an image-based target, detected by the image-processing tasks as image-based target information. The image-based target information includes at least the type, size, position, such as distance and orientation, of the image-based target.
The target recognition device 13 is comprised of a microcomputer including, for example, a CPU 31, a ROM 32, and a RAM 33. The target recognition device 13 also includes a digital signal processor (DSP) 34 for executing signal processing, such as fast Fourier transform (FFT).
The CPU 31 of the target recognition device 13 serves as a beam recognition unit 13a for recognizing, in accordance with the beat signal(s) obtained from the radar sensor 11, one or more targets located within the first probing region, thus generating target information to be supplied to the drive assist execution device 14 accordingly. The CPU 31 of the target recognition device 13 also serves as an image recognition unit 13a for recognizing, in accordance with the image-based target information obtained from the image sensor 12, one or more targets located within the second probing region, thus generating target information to be supplied to the drive assist execution device 14 accordingly. Detailed descriptions of how to recognize one or more targets based on the above target recognition operations are omitted, because how to recognize one or more targets based on the above target recognition operations is a wall-known technology.
The CPU 13 of the target recognition device 13 serves as a diagnosis processor for performing a radar misalignment diagnostic task that determines whether there is axial misalignment in the radar sensor 11.
The drive-assist execution device 14 controls various in-vehicle devices in accordance with the recognition results, i.e. target information, obtained by the target recognition device 13 to perform predetermined drive assist accordingly. The drive-assist execution device 14 includes at least a monitor and/or a speaker as the in-vehicle devices that the drive-assist execution device 14 controls. The monitor is operative to display various images, and the speaker is operative to output audible alarms and guide messages. The drive-assist execution device 14 can include various control units for controlling an internal combustion engine, a powertrain mechanism, and a brake mechanism installed in the own vehicle.
Next, the following describes the radar misalignment diagnostic routine carried out by the target recognition device 13, i.e. its CPU 13, with reference to the flowchart of
For example, the target recognition device 13 repeatedly executes the radar misalignment diagnostic routine while cruise control is carried out by the drive-assist execution device 14 based on the recognition results, i.e. target information, obtained by the target recognition device 13 with an auto cruise switch (ACC) switch on. The cruise control is control that automatically controls the speed of the own vehicle 1 as a function of the distance between the own vehicle 1 and a preceding vehicle.
First, the target recognition device 13 obtains horizontal misalignment information indicative of whether there is misalignment in the horizontal direction in the radar sensor 11 in step S10. The operation in step S10 by the CPU 31 or a hardware structure that carries out the operation in step S10 serves as, for example, an obtaining means 13c.
As an example, the target recognition device 13 according to the first embodiment performs a horizontal misalignment diagnostic routine, which is a separate routine from the radar misalignment diagnostic routine; the horizontal misalignment diagnostic routine determines whether there is horizontal misalignment in the horizontal direction in the radar sensor 11.
That is, the target recognition device 13 obtains diagnostic results by the horizontal misalignment diagnostic routine as the horizontal misalignment information in step S10. For example, the target recognition device 13 determines whether there is horizontal misalignment in the horizontal direction in the radar sensor 11 as illustrated in
Specifically, the target recognition device 13 detects a predetermined target contained in an image captured by the image sensor 12. For example, the target recognition device 13 detects the distance from the own vehicle 1 to a preceding vehicle 9 as the predetermined target, and detects the vehicle width W of the preceding vehicle 9. Then, the target recognition device 13 calculates an azimuth range θg matching with the vehicle width W of the image-recognized preceding vehicle 9 in a horizontal plane including a predetermined reference point; the horizontal plane is defined by the X- and Y-axis directions illustrated in
The target recognition device 13 determines whether all the targets detected by the radar sensor 11 are within an azimuth range θs having a predetermined angle containing the azimuth range θg matching with the vehicle width W of the preceding vehicle 9, thus determining whether there is horizontal misalignment in the radar sensor 11 in step S20.
The target recognition device 13 determines that there is no horizontal misalignment in the radar sensor 11 (NO in step S20) upon determining that all the targets detected by the radar sensor 11 are within the azimuth range θs.
Otherwise, the target recognition device 13 determines that there is horizontal misalignment in the radar sensor 11 (YES in step S20) upon determining that at least one target (see Pr in
The target recognition device 13 terminates the radar misalignment diagnostic routine while not executing, i.e. while disabling execution of, the following vertical misalignment diagnostic routine upon determining that there is horizontal misalignment in the radar sensor 11 (YES in step S20).
Otherwise, the target recognition device 13 executes the vertical misalignment diagnostic routine in step S30 upon determining that there is no horizontal misalignment in the radar sensor 11 (NO in step S20) in step S30.
The determining operation in step S20 by the CPU 31 or a hardware structure that carries out the determining operation in step S20 serves as, for example, a determining means 13d.
The diagnostic routine in step S30 by the CPU 31 or a hardware structure that carries out the diagnostic routine in step S30 serves as, for example, a diagnostic means 13e.
The target recognition device 13 terminates the radar misalignment diagnostic routine after executing the vertical misalignment diagnostic routine in step S30.
Next, the following describes an example of the vertical misalignment diagnostic routine carried out in step S30 of the radar misalignment diagnostic routine with reference to the flowchart of
First, in step S100, the target recognition device 13 executes a detection count routine as a subroutine. The detailed descriptions of the detection count routine will be described later. Thereafter, the vertical misalignment diagnostic routine proceeds to step S200.
In step S200, the target recognition device 13 executes a target pair-recognition percentage calculation routine as a subroutine. The detailed descriptions of the target pair-recognition percentage calculation routine will be described later. Thereafter, the vertical misalignment diagnostic routine proceeds to step S300.
In step S300, the target recognition device 13 executes an abnormal-recognition percentage calculation routine as a subroutine. The detailed descriptions of the abnormal-recognition percentage calculation routine will be described later. Thereafter, the vertical misalignment diagnostic routine proceeds to step S400.
In step S400, the target recognition device 13 executes a vertical misalignment-quantity calculation routine as a subroutine. The detailed descriptions of the vertical misalignment-quantity calculation routine will be described later. Thereafter, the target recognition device 13 terminates the vertical misalignment diagnostic routine.
Next, the following describes the detection count routine as the subroutine of step S100 in the vertical misalignment diagnostic routine with reference to the flowchart of
First, in step S1110, the target recognition device 13 determines whether an image-based target matches with a millimeter-wave based target. Note that, in step S1110, the image-based target is the preceding vehicle 9 recognized by the image sensor 12, and the millimeter-wave based target is the preceding vehicle 9 recognized by the radar sensor 11. The matching of the image-based target and radar-based target means that the same target is recognized by the pair of the radar sensor 11 and the image sensor 12. This recognition therefore means pair recognition. That is, the target recognition device 13 determines whether the same preceding vehicle is recognized by the pair of the radar sensor 11 and the image sensor 12.
As an example, the target recognition device 13 determines that the recognized preceding vehicle 9 is recognized by the pair of radar sensor 11 and the image sensor 12 upon determining that the radar-recognized preceding vehicle 9 is located within a predetermined range including the image-recognized preceding vehicle 9.
The target recognition device 13 for example, determines whether identification information included in the millimeter-wave based target obtained as a function of the radar recognition results of the radar sensor 11 matches with identification information included in the image-based target obtained as a function of the image recognition results of the image sensor 12. The outer-appearance information of the millimeter-wave based target is an example of the identification information of the millimeter-wave based target, and the outer-appearance information of the image-based target is an example of the identification information of the image-based target.
If the identification information included in the millimeter-wave based target matches with the identification information included in the image-based target as a result of the determination, the target recognition device 13 determines that the same target, i.e. the same preceding vehicle, is recognized by the pair of the radar sensor 11 and the image sensor 12.
That is, if the determination in step S1110 is affirmative (YES in step S1110), the detection count routine proceeds to step S1120. Otherwise, if the determination in step S1110 is negative (NO in step S1110), the detection count routine proceeds to step S1130.
In step S1120, the target recognition device 13 executes the determination of the target's distance. Specifically, the target recognition device 13 determines the distance between the own vehicle 1 and the preceding vehicle 9 based on both the radar recognition and the image recognition. Note that one of the results of the radar recognition and the results of the image recognition can be used to execute the determination of the target's distance. Thereafter, the detection count routine proceeds to step S1140.
In step S1130, the target recognition device 13 executes the determination of the target's distance. Specifically, the target recognition device 13 determines the distance between the own vehicle 1 and the preceding vehicle 9 based on the image recognition. Note that the results of the image recognition are used to execute the determination of the target's distance. Thereafter, the detection count routine proceeds to step S1170.
In step S1140, the target recognition device 13 determines whether the radar-recognition results represent abnormal recognition. Specifically, the target recognition device 13 determines whether the radar-recognition results by the radar sensor 11 represent abnormal recognition results.
When it is determined that the radar-recognition results represent abnormal recognition results (YES in step S1140), the detection count routine proceeds to step S1160. Otherwise, when it is determined that the radar-recognition results represent normal recognition results (NO in step S1140), the detection count routine proceeds to step S1150.
Note that the abnormal recognition results according to the first embodiment mean results different from normal recognition results. For example, the abnormal recognition results include
1. A case where the resolution of the radar-recognition results is inferior to a predetermined resolution of normal radar-recognition results
2. A case where, while the same target is continuously, i.e. cyclically, detected, disturbance causes the same target to not be detected in a cycle.
In step S1150, the target recognition device 13 increments one of hardware or software first counters C1 prepared therein.
Specifically, the target recognition device 13 refers to a distance determination table prepared therein and illustrated in
After the operation in step S1150, the target recognition device 13 terminates the detection count routine.
In step S1160, the target recognition device 13 increments one of hardware or software second counters C2 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
In step S1170, the target recognition device 13 increments one of hardware or software third counters C3 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
Next, the following describes the target pair-recognition percentage calculation routine as the subroutine of step S200 in the vertical misalignment diagnostic routine with reference to
The target recognition device 13 executes the target pair-recognition percentage calculation routine each time the vertical misalignment diagnostic routine proceeds to step S20.
First, the target recognition device 13 multiplies the value of each first counter C1 by a corresponding first coefficient, multiplies the value of each second counter C2 by a corresponding second coefficient, and multiplies the value of each third counter C1 by a corresponding third coefficient (see
Note that the first, second, and third coefficients are previously established based on, for example, experiments for assigning weights to the values of the respective first, second, and third counters C1, C2, and C3.
The following describes an example of how to perform the establishment using a graph indicative of the relationship between the distance from the own vehicle V to a preceding vehicle and the target pair-recognition percentage described later as for example illustrated in
This graph shows that, in a region in which the distance from the own vehicle 1 to the preceding vehicle is relatively short, each of values of the target pair-recognition percentage described in detail later, if there is no axial misalignment in the radar sensor 11, has a small difference from a corresponding one of the values of the target pair-recognition percentage if there is axial misalignment in the radar sensor 11.
In contrast, this graph shows that, in a region in which the distance from the own vehicle 1 to the preceding vehicle is relatively long, each of values of the target pair-recognition percentage, if there is no axial misalignment in the radar sensor 11, has a large difference from a corresponding one of the values of the target pair-recognition percentage if there is axial misalignment in the radar sensor 11.
For this reason, as illustrated in
In the case illustrated in
Subsequently, the target recognition device 13 calculates the target pair-recognition percentage. Specifically, for each distance section of the distance determination table, the target recognition device 13 divides the weighted value of the first counter C1 by the sum of the weighted value of the first counter C1, the weighted value of the second counter C2, and the weighted value of the third counter C3. This calculates the target pair-recognition percentage in units of % (see
The target pair-recognition percentage represents an example of the relationship, i.e. the ratio, between the number of times the preceding vehicle 9 is recognized by the pair of the radar recognition and the image recognition and the number of times the preceding vehicle 9 is recognized by at least one of the radar recognition and the image recognition. For example, the greater the number of times the preceding vehicle 9 is recognized by the pair of the radar recognition and the image recognition, the higher the target pair-recognition percentage. In contrast, the greater the number of times the preceding vehicle 9 is recognized by merely the image recognition is, the lower the target pair-recognition percentage is.
Thereafter, the target recognition device 13 terminates the target pair-recognition percentage calculation routine.
Next, the following describes the abnormal-recognition percentage calculation routine as the subroutine of step S300 in the vertical misalignment diagnostic routine with reference to
The target recognition device 13 executes the abnormal-recognition percentage calculation routine each time the vertical misalignment diagnostic routine proceeds to step S300.
First, the target recognition device 13 multiplies the value of each first counter C1 by the corresponding first coefficient, and multiplies the value of each second counter C2 by the corresponding second coefficient (see
Subsequently, the target recognition device 13 calculates the abnormal-recognition percentage. Specifically, for each distance section of the distance determination table, the target recognition device 13 divides the weighted value of the second counter C2 by the sum of the weighted value of the first counter C1 and the weighted value of the second counter C2. This calculates the abnormal-recognition percentage in units of % (see
Thereafter, the target recognition device 13 terminates the abnormal-recognition percentage calculation routine.
Next, the following describes the vertical misalignment-quantity calculation routine as the subroutine of S400 in the vertical misalignment diagnostic routine with reference to
The target recognition device 13 executes the vertical misalignment-quantity calculation routine each time the vertical misalignment diagnostic routine proceeds to step S400.
That is, the target recognition device 13 estimates a vertical misalignment quantity in the vertical direction, which has occurred in the radar sensor 11, in accordance with the target pair-recognition percentage calculated in step S200 and the abnormal-recognition percentage calculated in step S300. The vertical misalignment quantity is also referred to as a vertical misalignment estimator.
Specifically, the target recognition device 13 refers to a map M stored therein, illustrated as an example in
Note that, in the map M, each region and the value of the vertical misalignment quantity allocated to each region are previously established based on, for example, experiments.
For example, the target pair-recognition percentage has the following characteristics that, the higher the target pair-recognition percentage is, the lower the absolute value of the vertical misalignment quantity is. That is, the target pair-recognition percentage has the following characteristics that, the lower the target pair-recognition percentage is, the higher the absolute value of the vertical misalignment quantity is.
The abnormal-recognition percentage has the following characteristics that the vertical misalignment quantity is positive when the abnormal-recognition percentage is low, and the vertical misalignment quantity is negative when the abnormal-recognition percentage is high. Note that, in the vertical plane including the radar beam axis, the upper-side misalignment of the radar beam axis with respect to the designed beam axis position represents a positive misalignment quantity. In addition, in the vertical plane including the radar beam axis, the lower-side misalignment of the radar beam axis with respect to the designed beam axis position represents a negative misalignment quantity.
Based on the characteristics, the target recognition device 13 can establish each region and the value of the vertical misalignment quantity allocated to each region in the map M.
An example illustrated in
Thereafter, the target recognition device 13 terminates the vertical misalignment-quantity calculation routine.
As described above, the target recognition device 13 in the drive assist system 10 according to the first embodiment determines whether there is horizontal misalignment in the radar sensor 11 before performing whether there is vertical misalignment in the radar sensor 11. This disables the target recognition device 13 from executing the diagnosis of misalignment in the vertical direction if it is determined that there is horizontal misalignment in the radar sensor 11. This enables the first embodiment to achieve the first advantageous effect that prevents the state of horizontal misalignment from being erroneously detected as the state of vertical misalignment. In other words, the first embodiment prevents erroneous detection of vertical misalignment of a beam sensor, such as the beam sensor 11.
Otherwise, the target recognition device 13 executes the vertical misalignment diagnostic routine upon determining that there is no horizontal misalignment in the radar sensor 11, thus diagnosing whether there is misalignment of a beam sensor, such as the radar sensor 11 in the vertical direction. Then, the target recognition device 13 detects the vertical misalignment quantity upon diagnosing that there is vertical misalignment in the beam sensor.
That is, the target recognition device 13 diagnoses whether there is vertical misalignment in the beam sensor while there are certainly determined that there is no horizontal misalignment. Then, the target recognition device 13 detects the vertical misalignment quantity upon diagnosing that there is vertical misalignment in the beam sensor.
For this reason, the first embodiment achieves the second advantageous effect of enabling the various types of control for improving the running safety of the vehicle 1 to be carried out with higher accuracy.
The target recognition device 13 performs radar recognition of a preceding vehicle 9 running in front of the own vehicle 1. Additionally, the target recognition device 13 performs image recognition of the preceding vehicle 9 running in front of the own vehicle 1 based on a captured image of the front scene of the own vehicle 1.
Then, the target recognition device 13 calculates, based on the radar-recognition results and the image-recognition results, the percentage of the number of times the preceding vehicle 9 is recognized by the pair of the radar recognition and the image recognition to the number of times the preceding vehicle 9 is recognized by at least the image recognition. Note that an example of the percentage is the pair-recognition percentage. The target recognition device 13 detects, based on the calculated value of the percentage, vertical misalignment, which has occurred in a beam sensor, such as the radar sensor 11 (see (a) and (b) in
The target recognition device 13 calculates a value of the target pair-recognition percentage for each of prepared distances between the own vehicle 1 and the preceding vehicle 9 in the vertical misalignment diagnostic routine. Then, the target recognition device 13 adds predetermined weights to the values of the target pair-recognition percentage for the respective prepared distances, and calculates the sum of the weighed values. The target recognition device 13 determines whether there is vertical misalignment, which has occurred in the radar sensor 11, as a function of the calculated sum. This enables the first embodiment to achieve the fourth advantageous effect of detecting vertical misalignment of the radar sensor 11 installed in the own vehicle 1 with further higher accuracy.
The target recognition device 13 calculates the percentage of the preceding vehicle 9 being normally recognized, i.e. the normal recognition percentage, and the percentage of the preceding vehicle 9 being abnormally recognized, i.e. the abnormal recognition percentage in the vertical misalignment diagnostic routine. Then, the target recognition device 13 determines whether there is vertical misalignment, which has occurred in a beam sensor, such as the radar sensor 11, as a function of the calculated normal recognition percentage and the calculated abnormal recognition percentage. In addition, the target recognition device 13
(1) Determines whether an upper-side misalignment or a lower-side misalignment has occurred upon determining that there is vertical misalignment
(2) Determines a misalignment quantity of the upper-side or lower-side misalignment.
This enables the first embodiment to achieve the fifth advantageous effect of detecting vertical misalignment of the radar sensor 11 installed in the own vehicle 1 with further higher accuracy.
Note that the target recognition device 13 according to the first embodiment serves as an example of a detection device, an obtaining means, a determining means, a diagnosis means, a radar recognition means, and an image recognition means. The operation in step S20 serves as an example of the determining means and the operation in step S30 serves as an example of a detection means.
The fundamental structure of the second embodiment is basically identical to that of the first embodiment except for the following different point. So, the following mainly describes the different points while omitting the descriptions of the common structure.
Referring to
Next, the following describes the radar misalignment diagnostic routine according to the second embodiment with reference to the flowchart of
The target recognition device 13 executes the same operations as the respective operations in steps S10 and S20 according to the first embodiment.
Upon determining that there is no horizontal misalignment in the radar sensor 11 (NO in step S20), the target recognition device 13 executes the vertical misalignment diagnostic routine in step S30 in the same procedure as the first embodiment. The target recognition device 13 terminates the radar misalignment diagnostic routine when completing the vertical misalignment diagnostic routine.
Otherwise, upon determining that there is horizontal misalignment in the radar sensor 11 (YES in step S20), the target recognition device 13 executes the operation in step S40 to reset all the counters C1, C2, and C3. The in step S40 by the CPU 13 or a hardware structure that carries out the operation in step S40 serves as, for example, a reset means.
Specifically, the target recognition device 13 resets the counters used to execute the count detection routine, i.e. the first counter C1, second counter C2, and third counter C3. Thereafter, the target recognition device 13 terminates the radar misalignment diagnostic routine.
The second embodiment described in detail above achieves the following advantageous effects in addition to the first to fifth advantageous effects of the first embodiment.
The target recognition device 13 resets all the counters used to execute the count detection routine, i.e. all the first counter C1, second counter C2, and third counter C3 upon determining that there is horizontal misalignment in the radar misalignment diagnostic routine.
Let us assume that there is horizontal misalignment in the radar sensor 11. In addition, let us assume that it takes some to obtain horizontal misalignment information indicative of the occurrence of horizontal misalignment, which has elapsed since the horizontal misalignment actually occurred.
Under these assumptive situations, the target recognition device 13 resets the first to third counters C1 to C3 when obtaining the horizontal misalignment information indicative of the occurrence of horizontal misalignment. This prevents the counted values of the first to third counters C1 to C3 for the period from the time when the horizontal misalignment actually occurred to the time when the horizontal misalignment information is actually obtained, i.e. incorrectly counted values, from being used for the vertical misalignment diagnostic routine.
The second embodiment therefore achieves the sixth advantageous effect of
(1) Higher-accuracy determination of whether there is vertical misalignment in the vertical misalignment diagnostic routine
(2) Higher-accuracy detection of vertical misalignment when it is determined that there is vertical misalignment.
In the second embodiment, the target recognition device 13 serves as, for example, a first count means, a second count means, and a reset means. The operation in step S1170 serves as an example of the first count means, the operations in steps S1150 and S1160 serve as an example of the second count means, and the operation in step S40 serves as an example of the reset means.
The fundamental structure of the third embodiment is basically identical to that of the first embodiment except for the following different point. So, the following mainly describes the different point while omitting the descriptions of the common structure.
The target recognition device 13 according to the first embodiment detects, based on the radar recognition and the image recognition of the preceding vehicle 9, vertical misalignment that has occurred in the radar sensor 11.
In contrast, the target recognition device 13 according to the first embodiment performs misalignment detection depending on the height of the preceding vehicle 9.
Specifically, the target recognition device 13 executes a detection count routine illustrated in
Next, the following sequentially describes the detection count routine, the target pair-recognition percentage calculation routine, and the abnormal-recognition calculation routine according to the third embodiment.
Next, the following describes the detection count routine carried out by the operation in step S100 of the vertical misalignment diagnostic routine.
First, in step S1205, like step S1110, the target recognition device 13 determines whether an image-based target matches with a millimeter-wave based target. That is, the target recognition device 13 determines whether the same preceding vehicle 9 is recognized by the pair of the radar recognition by the radar sensor 11 and the image recognition by the image sensor 12.
If the determination in step S1205 is affirmative (YES in step S1205), the detection count routine proceeds to step S1210. Otherwise, if the determination in step S1205 is negative (NO in step S1205), the detection count routine proceeds to step S1215.
In step S1210, like step S1120, the target recognition device 13 executes the determination of the target's distance. Specifically, the target recognition device 13 determines the distance between the own vehicle 1 and the preceding vehicle 9 recognized by both the radar recognition and the image recognition. Note that one of the results of the radar recognition and the results of the image recognition can be used to execute the determination of the target's distance. Thereafter, the detection count routine proceeds to step S1220.
In step S1215, like step S1130, the target recognition device 13 executes the determination of the target's distance. Specifically, the target recognition device 13 determines the distance between the own vehicle 1 and the preceding vehicle 9 recognized by the image recognition. Note that the results of the image recognition are used to execute the determination of the target's distance. Thereafter, the detection count routine proceeds to step S1235.
In step S1220, like step S1140, the target recognition device 13 determines whether the radar-recognition results represent abnormal recognition. Specifically, the target recognition device 13 determines whether the radar-recognition results by the radar sensor 11 represent abnormal recognition results.
When it is determined that the radar-recognition results represent the abnormal recognition results (YES in step S1220), the detection count routine proceeds to step S1230. Otherwise, when it is determined that the radar-recognition results represent normal recognition results (NO in step S1220), the detection count routine proceeds to step S1225.
In step S1225, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the vehicle heights of standard vehicles. Specifically, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than a predetermined threshold in accordance with the results of the image recognition. Note that the predetermined threshold is previously set based on, for example, experiments in order to remove preceding vehicles, such as trucks, whose vehicle heights are higher than the vehicle heights of standard vehicles (see
If the determination in step S1225 is affirmative (YES in step S1225), the detection count routine proceeds to step S1245. Otherwise, if the determination in step S1225 is negative (NO in step S1225), the detection count routine proceeds to step S1240.
In step S1230, like step S1225, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the vehicle heights of standard vehicles. Specifically, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the predetermined threshold in accordance with the results of the image recognition.
If the determination in step S1230 is affirmative (YES in step S1230), the detection count routine proceeds to step S1255. Otherwise, if the determination in step S1230 is negative (NO in step S1230), the detection count routine proceeds to step S1250.
In step S1235, like step S1225, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the vehicle heights of standard vehicles. Specifically, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the predetermined threshold in accordance with the results of the image recognition.
If the determination in step S1235 is affirmative (YES in step S1235), the detection count routine proceeds to step S1265. Otherwise, if the determination in step S1235 is negative (NO in step S1235), the detection count routine proceeds to step S1260.
In step S1240, the target recognition device 13 increments one of hardware or software fourth counters C4 prepared therein.
Specifically, the target recognition device 13 refers to a distance determination table prepared therein and illustrated in
That is, each of the fourth counters C4 is used to represent the number of times preceding vehicles 9 whose heights are lower than the predetermined threshold are normally recognized by radar recognition, and the fourth counters C4 are prepared for the respective distance sections determined in the distance determination table.
After the operation in step S1240, the target recognition device 13 terminates the detection count routine.
In step S1245, the target recognition device 13 increments one of hardware or software fifth counters C5 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
After the operation in step S1245, the target recognition device 13 terminates the detection count routine.
In step S1250, the target recognition device 13 increments one of hardware or software sixth counters C6 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
After the operation in step S1250, the target recognition device 13 terminates the detection count routine.
In step S1255, the target recognition device 13 increments one of hardware or software seventh counters C7 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
After the operation in step S1255, the target recognition device 13 terminates the detection count routine.
In step S1260, the target recognition device 13 increments one of hardware or software eighth counters C8 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
In step S1265, the target recognition device 13 increments one of hardware or software ninth counters C9 prepared therein.
Specifically, the target recognition device 13 refers to the distance determination table prepared therein and illustrated in
Next, the following describes the target pair-recognition percentage calculation routine executed in step S200 of the vertical misalignment diagnostic routine with reference to
First, the target recognition device 13 multiplies the value of each fourth counter C4 by a corresponding fourth coefficient, and multiplies the value of each fifth counter C5 by a corresponding fifth coefficient (see
In addition, the target recognition device 13 multiplies the value of each sixth counter C6 by a corresponding sixth coefficient, and multiplies the value of each seventh counter C7 by a corresponding seventh coefficient (see
Moreover, the target recognition device 13 multiplies the value of each eighth counter C8 by a corresponding eighth coefficient, and multiplies the value of each ninth counter C9 by a corresponding ninth coefficient (see
Note that the fourth to ninth coefficients are previously established based on, for example, experiments for assigning weights to the values of the respective fourth to ninth counters.
Next, the target recognition device 13 calculates the target pair-recognition percentage. Specifically, for each distance section of the distance determination table, the target recognition device 13 divides the first count additional value by the sum of the second and third count additional values. This calculates the target pair-recognition percentage in units of % (see
Thereafter, the target recognition device 13 terminates the target pair-recognition percentage calculation routine.
Next, the following describes the abnormal-recognition percentage calculation routine executed in step S300 of the vertical misalignment diagnostic routine with reference to
First, the target recognition device 13 multiplies the value of each fourth counter C4 by the corresponding fourth coefficient, and multiplies the value of each fifth counter C5 by the corresponding fifth coefficient (see
In addition, the target recognition device 13 multiplies the value of each sixth counter C6 by the corresponding sixth coefficient, and multiplies the value of each seventh counter C7 by the corresponding seventh coefficient (see
Next, the target recognition device 13 calculates the abnormal-recognition percentage. Specifically, for each distance section of the distance determination table, the target recognition device 13 divides the first count additional value by the sum of the first and second count additional values. This calculates the abnormal-recognition percentage in units of % (see
Thereafter, the target recognition device 13 terminates the abnormal-recognition percentage calculation routine.
The third embodiment described in detail above achieves the following advantageous effects in addition to the advantageous effects of the first embodiment.
The target recognition device 13 according to the third embodiment calculates the target pair-recognition percentage and the abnormal-recognition percentage for each of the different vehicle heights of the preceding vehicles 9 in the vertical misalignment diagnostic routine. Then, the target recognition device 13 according to the third embodiment detects axial misalignment of the radar sensor 11 in the vertical plane according to the target pair-recognition percentage and the abnormal-recognition percentage calculated for each of the different vehicle heights of the preceding vehicles 9. This results in higher-accuracy detection of axial misalignment.
In addition, the target recognition device 13 determines whether the vehicle height of the preceding vehicle 9 is higher than the predetermined threshold in the vertical misalignment diagnostic routine, i.e. the detection count routine. Then, the target recognition device 13 calculates the target pair-recognition percentage and the abnormal-recognition percentage while eliminating the preceding vehicles 9 whose heights are higher than the predetermined threshold. This results in further higher-accuracy detection of axial misalignment.
The first to third embodiments of the present invention have been described, but the present invention is not limited to the first to third embodiments, and can be naturally modified as various modifications.
The target recognition device 13 of each embodiment is configured to detect a vertical misalignment quantity of the radar sensor 11 in the vertical direction in the vertical misalignment diagnostic routine, but can be configured to detect only information about whether there is vertical misalignment in the vertical direction.
Each embodiment defines
(1) Horizontal misalignment based on the angle between the center axis M of the detection range of the radar sensor 11 and the horizontal direction, i.e. the X-axis direction
(2) Vertical misalignment based on the angle between the center axis M of the detection range of the radar sensor 11 and the vertical direction, i.e. the Y-axis direction.
However, the other definitions can be made.
An axis of the radar sensor 11 for defining axial misalignment can be different from the center axis M. For example, an axis, which extends from the radar sensor 11 as the starting point, toward the probing range of targets can be established, and horizontal misalignment and vertical misalignment can be defined based on the established axis.
The vertical misalignment diagnostic routine described in the third embodiment can be applied to the vertical misalignment diagnostic routine, which is carried out by the target recognition device 13 in step S30 according to the second embodiment. The counter reset operation in step S40 according to this modification resets all the counters illustrated in the flowchart of
The target recognition device 13 according to each embodiment detects horizontal misalignment in the radar sensor 11 using the radar sensor 11 and the image sensor 12, but horizontal misalignment can be detected using other various methods.
For example, the target recognition device 13 can detect, for example, a traffic sign provided on a travelling road for the own vehicle 1 using the image sensor 12. Then, the target recognition device 13 can detect horizontal misalignment in the radar sensor 11 in accordance with how the detected positions, i.e. horizontal positions, of the traffic sign or the like.
Specifically, as illustrated as an example in reference character (a) of
In contrast, as illustrated as an example in reference character (b) of
The target recognition device 13 can therefore detect horizontal misalignment of the center axis M in the radar sensor 11 and a corresponding horizontal misalignment quantity in accordance with how the horizontal positions E of the traffic sign Q change.
The functions of one element in each embodiment can be distributed as plural elements, and the functions that plural elements have can be combined into one element. At least part of the structure of each embodiment can be replaced with a known structure having the same function as the at least part of the structure of the corresponding embodiment. A part of the structure of each embodiment can be eliminated as long as the remaining structure of the corresponding embodiment is capable of solving the problem. At least part of the structure of each embodiment can be added to or replaced with the structures of the other embodiments. All aspects included in the technological ideas specified by the language employed by the claims constitute embodiments of the present invention.
The present invention can be implemented by various embodiments in addition to the drive assist 10 and the target recognition device 13; the various modification include programs for running the target recognition device 13, storage media storing the programs, and axial misalignment diagnostic methods.
Number | Date | Country | Kind |
---|---|---|---|
2014-173074 | Aug 2014 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2015/074249 | 8/27/2015 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2016/031918 | 3/3/2016 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5325096 | Pakett | Jun 1994 | A |
5517196 | Pakett et al. | May 1996 | A |
20060077052 | Matsuoka | Apr 2006 | A1 |
20120235851 | Park | Sep 2012 | A1 |
20160349356 | Takaki | Dec 2016 | A1 |
Number | Date | Country |
---|---|---|
102679953 | Sep 2012 | CN |
2002-174684 | Jun 2002 | JP |
2002-174684 | Jun 2002 | JP |
2004-085258 | Mar 2004 | JP |
2004-205398 | Jul 2004 | JP |
2008-215912 | Sep 2008 | JP |
2008-215912 | Sep 2008 | JP |
Number | Date | Country | |
---|---|---|---|
20170254881 A1 | Sep 2017 | US |