Patent Application
20130194127
The present invention relates to a vehicle collision risk prediction apparatus.
Japanese Unexamined Patent Application Publication No. 2000-172980 discloses a related art of this technical field. This publication discloses “a method for detecting an obstruction on a road with the use of a millimeter-wave sensor installed on a road side in which an obstruction candidate is detected according to a difference between measurement data obtained by scanning with the millimeter-wave sensor, and background data having no obstruction, and the presence of the obstruction is detected if the obstruction candidate is always present as a result of repeating the detection” (refer to abstract of this publication).
In driving of the vehicle, when an object unexpected by a driver suddenly appears at a close range in a traveling direction of the vehicle, a collision is liable to occur. For example, at a blind curve or an intersection with street trees, the driver cannot visibly recognize the object having the potentiability of collision such as persons, animals, automobile, bikes, or bicycles in advance, and starts an action for avoiding collision such as braking or turning a steering wheel after the driver could visually recognize the object at the close range. As a result, it is too late for avoidance of the collision, resulting in an accident.
As described above, Japanese Unexamined Patent Application Publication No. 2000-172980 discloses a related art of this technical field. This publication discloses “a method for detecting an obstruction on a road with the use of a millimeter-wave sensor installed on a road side in which an obstruction candidate is detected according to a difference between measurement data obtained by scanning with the millimeter-wave sensor, and background data having no obstruction, and the presence of the obstruction is detected if the obstruction candidate is always present as a result of repeating the detection”. However, the device disclosed in Japanese Unexamined Patent Application Publication No. 2000-172980 needs to be installed on the road side in advance, resulting in a problem that the accident cannot be reduced in roads where the device is not installed.
Under the circumstances, the present invention has been made to solve the above problems, and therefore aims at providing a device that can be installed in a subject vehicle, can detect information on an object with the potentiability of collision which is located, for example, at a blind area of the driver, and can contribute to collision accident avoidance.
The typical outline of the invention disclosed in the present application will be described in brief below.
(1) A vehicle risk prediction apparatus including: a first imaging unit that detects an electromagnetic wave of a wavelength ranging from a millimeter wave to a submillimeter wave to output a first image; a first detection unit that processes the first image output from the first imaging unit to detect a given object; and a risk prediction unit that outputs a detection result of the given object detected by the first detection unit, in which the first imaging unit includes a transmit antenna unit that radiates the electromagnetic wave of the wavelength ranging from the millimeter wave to the submillimeter wave; a receive antenna array unit that has a plurality of receive antenna units arranged two-dimensionally, and receives a reflected wave of the electromagnetic wave radiated by the transmit antenna unit from the given object; and a signal processing unit that measures a time from radiation of the electromagnetic wave by the transmit antenna unit to reception of the reflected wave by the receive antenna array unit according to the number of read frames by the receive antenna array, and calculates both or any one of a distance from the subject vehicle to the given object, and a relative speed between the subject vehicle and the given object.
(2) The vehicle risk prediction apparatus according to the item (1) in which the signal processing unit further calculates a place of the given object on the basis of two-dimensional positions of the respective receive antenna units of the receive antenna array, which receive the reflected wave.
According to the present invention, there can be provided the device that can be installed in a subject vehicle, can detect information on an object with the potentiability of collision which is located, for example, at a blind area of the driver, and can contribute to collision accident avoidance.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
Hereinafter, a first embodiment of the present invention will be described in detail.
The vehicle collision risk prediction system 100 is configured by a system that is mounted on a vehicle, and detects a risk of collision in a vehicle periphery (for example, a front direction) so as to give a warning to a driver.
The vehicle collision risk prediction system 100 appropriately includes the vehicle collision risk prediction apparatus 101, an image display unit 107, and a warning sound output unit 108.
The vehicle collision risk prediction apparatus 101 is configured by a system that is mounted on the vehicle, detects the risk of collision in the vehicle periphery (for example, the front direction), and outputs a synthetic image and a sound signal for giving a warning to the driver. The vehicle collision risk prediction apparatus 101 appropriately includes a millimeter wave imaging unit 102, a first detection unit 103, a visible light imaging unit 104, a risk prediction unit 105, and an image synthesis unit 106.
The millimeter wave imaging unit 102 includes a millimeter wave sensor & signal processing unit 109.
The millimeter wave sensor & signal processing unit 109 images an electromagnetic wave of a wavelength ranging from a millimeter wave band to a submillimeter wave band (wavelength ranges from about several tens μm to about 1 cm), and outputs an output image which is two-dimensional digital data to the first detection unit 103 and the image synthesis unit 106. In general, the electromagnetic wave of the wavelength ranging from the millimeter wave band to the submillimeter wave band (wavelength ranges from about several tens μm to about 1 cm) has a property that an object made of a certain kind of material transmits such an electromagnetic wave. For that reason, the millimeter wave sensor & signal processing unit 109 can image a configuration of the object located at a position which is hidden behind an obstruction and cannot be viewed
The first detection unit 103 extracts an object configuration of a living object such as a person or an animal, or a vehicle such as an automobile, a bike, or a bicycle, from the output image of the millimeter wave imaging unit 102. The first detection unit 103 also determines a travel speed of the object, and a trend of the travel. When the first detection unit 103 determines that there is a risk that the object (hereinafter, collision risk object) collides with the subject vehicle, the first detection unit 103 outputs collision risk object information indicative of a size of the collision risk object on an image, and position information to the risk prediction unit 105. An example of a method of determining the collision risk object will be described later.
The visible light imaging unit 104 images an electromagnetic wave of a wavelength ranging from an ultraviolet band to a near-infrared band (wavelength ranges from about 10 nm to about several μm) including a visible light, and outputs a second image which is two-dimensional digital data to the image synthesis unit 106.
The risk prediction unit 105 outputs the collision risk object information output from the first detection unit 103 to the image synthesis unit 106. Also, the risk prediction unit 105 determines contents about which the driver is warned with a warning sound such as an alarm sound or a synthetic voice, on the basis of the collision risk object information output from the first detection unit 103. The risk prediction unit 105 then converts the determined contents into a sound signal, and outputs the sound signal to the warning sound output unit 108.
The image display unit 107 clips an image at the position of the collision risk object from the output image of the millimeter wave imaging unit 102 on the basis of the collision risk object information output from the risk prediction unit 105. The image display unit 107 then outputs a synthetic image in which the clipped image is superimposed on the output image of the visible light imaging unit 104 to the image display unit 107.
The warning sound output unit 108 pronounces on the basis of the sound signal output from the risk prediction unit 105, and gives a warning to the driver with a sound.
With the above configuration, the collision risk object located behind the obstruction can be detected by the millimeter wave imaging unit 102 and the first detection unit 103. The driver is warmed by the synthetic image and the sound to promote a collision avoidance action with the result that a collision accident can be obviated. The driver may be warmed with only one of the sound and the image, or a time lag may be provided so that the sound is first output, and the image is output after a given time has been elapsed. Also, those warning may be notified the driver of while the warning is gradually changed according to a distance between the subject vehicle and the collision risk object.
As illustrated in
For that reason, if the device of the present invention is not used, when the collision risk object suddenly bursts out from behind of the obstruction, it is too late for a collision avoidance action such as braking or handling, thereby leading to the possibility of an accident.
Under the circumstances, there is a need to obviate the collision accident by detecting the collision risk object in advance, warning the driver, and allowing the driver to take the collision avoidance action, even if the collision risk object is present behind the obstruction. To achieve this action, in the first embodiment, the imaging is conducted with the electromagnetic wave ranging from the millimeter wave band to the submillimeter wave band (wavelength ranges from about several tens μm to about 1 cm). The electromagnetic wave of this wavelength band has a property that this electromagnetic wave is transmitted through a variety of materials such as wood, plastic, cloth, paper, ceramic, cardboard, smoke, and fog except for water and metal, reflected on a metal surface, and also absorbed by an object containing a large amount of moisture such as a person or an animal. That is, if the obstruction is made of a material that transmits the electromagnetic wave of this wavelength band, an image seeing through behind of the obstruction can be obtained by the millimeter wave imaging unit 102.
In general, the imaging method is classified into two types of a passive type and an active type depending on the kind of a light source (radiation source) of the electromagnetic wave. The passive type is an imaging method having the electromagnetic wave ranging from the millimeter wave band to the submillimeter wave band (wavelength ranges from about several tens μm to about 1 cm), which is naturally radiated from an object having a heat as the light source. On the other hand, the active type is an imaging method in which an object to be imaged is illuminated with a light source installed in the subject vehicle, and the electromagnetic wave reflected by a maternal such as metal can be sharply imaged more than that in the passive type.
In the first embodiment, imaging is conducted by the imaging method of the passive type. For that reason, the pedestrian, the animal, and the traveling vehicle (particularly, engine), which are the objects having a heat, can be detected.
An example of the method for determining the collision risk object in the first detection unit 103 will be described with reference to
For example, in a case of
As described above, with the use of the configuration according to the first embodiment, the collision risk objects present behind the objection can be detected by the millimeter wave imaging unit 102 and the first detection unit 103, and the driver is warned by the image and the sound to facilitate the collision avoidance action, to thereby obviate the collision accident. The example in which the front of the subject vehicle is imaged is described. However, the present invention is not limited to this configuration, but it is needless to say that when the subject vehicle is backed, the present invention is applicable in the same manner while the back of the subject vehicle is imaged. Also, a direction of the imaging range may be appropriately changed, for example, according to the operation of a direction indicator of the subject vehicle. Also, modified examples described in the first embodiment can be also appropriately applied to other embodiments.
Hereinafter, a second embodiment of the present invention will be described in detail.
The vehicle collision risk prediction apparatus 101 appropriately includes a millimeter wave imaging unit 102-2, a first detection unit 103-2, a visible light imaging unit 104-2, a risk prediction unit 105-2, and an image synthesis unit 106-2. The millimeter wave imaging unit 102-2 includes a millimeter wave sensor & signal processing unit 109-2 and a millimeter wave source 601-2.
The millimeter wave source 601-2 is configured by a light source (radiation source) that can radiate the electromagnetic wave (wavelength ranges from about several tens μm to about 1 cm), which can be imaged by the millimeter wave sensor & signal processing unit 109-2, in the periphery of the subject vehicle to be photographed. The other constituent elements are identical with those in the first embodiment illustrated in
The second embodiment is different from the first embodiment in that the millimeter wave sensor & signal processing unit 109-2 and the millimeter wave source 601-2 are combined together in the imaging method of the active type.
In the second embodiment, since the imaging method of the active type is applied, the vehicle such as the automobile, the bikes, or the bicycles, which are objects covered with metal can be sharply imaged more than that in the imaging method of the passive type. As a result, a detection precision in the risk object, and a sharpness of the synthetic image provided to the driver are improved.
Since the image sharply imaged is used, the detection precision of the collision risk object in the first detection unit 103-2 is higher than that in the first embodiment.
As described above, with the use of the configuration according to the second embodiment, the collision risk objects present behind the obstruction can be detected by the millimeter wave imaging unit 102 with high precision, and the driver can be warned with the provision of the captured sharp image. As a result, since the driver can more property take the collision avoidance action, the collision accident can be obviated.
Hereinafter, a third embodiment of the present invention will be described in detail.
The vehicle collision risk prediction apparatus 101-3 appropriately includes a millimeter wave imaging unit 102-3, a first detection unit 103-3, a visible light imaging unit 104-3, a risk prediction unit 105-3, and an image synthesis unit 106-3. The millimeter wave imaging unit 102-3 includes a millimeter wave sensor & signal processing unit 109-3 and a millimeter wave source 601-3.
The risk prediction unit 105-3 implements the same processing as that of the risk prediction unit 105-2 in the second embodiment. Further, the risk prediction unit 105-3 outputs a control signal for controlling an imaging parameter of the millimeter wave imaging unit 102-3 to the millimeter wave imaging unit 102-3. Also, the risk prediction unit 105-3 outputs a control signal for switching on (light on)/off (light off) the millimeter wave source 601-3 to the millimeter wave source 601-3 on the basis of a switch unit not shown. The other constituent elements are identical with those in the second embodiment illustrated in
The third embodiment is different from the first and second embodiments in that the imaging method is switched by time sharing, and both the imaging methods of the passive type and the active type are switched by time sharing for imaging. In the third embodiment, both of detection results of those two imaging methods can be used under the time sharing control. This can realize both of an action for enhancing the detection precision of the object made of metal such as the vehicle by imaging of the active type, and an action for enabling the detection of the pedestrian or the animal by imaging of the passive type, at the same time.
The first detection unit 103-3 detects the respective collision risk objects in the output image captured by the imaging method of the passive type and the output image captured by the imaging method of the active type, and matches both results of the active type and the passive type. The first detection unit 103-3 then outputs the collision risk object information on the collision risk object detected by at least any one imaging method to the risk prediction unit 105-3.
Thus, with the use of the configuration according to the third embodiment, both of the detection results in the two imaging methods can be used. This can realize both of the action for enhancing the detection precision of the object made of metal such as the vehicle by imaging of the active type, and the action for enabling the detection of the pedestrian or the animal by imaging of the passive type, at the same time.
Hereinafter, a fourth embodiment of the present invention will be described in detail.
The vehicle collision risk prediction apparatus 101-4 appropriately includes a millimeter wave imaging unit 102-4, a first detection unit 103-4, a visible light imaging unit 104-4, a risk prediction unit 105-4, an image synthesis unit 106-4, and a second detection unit 1101-4. The millimeter wave imaging unit 102-4 includes a millimeter wave sensor & signal processing unit 109-4.
The second detection unit 1101-4 extracts an object configuration of a living object such as a person or an animal, or a vehicle such as an automobile, a bike, or a bicycle, from the output image of the visible light imaging unit 104-4. The visible light imaging unit 104-4 also determines a travel speed of the object, and a trend of the travel. When the second detection unit 1101-4 determines that there is the collision risk object, the second detection unit 1101-4 outputs the collision risk object information indicative of a size of the collision risk object on an image, and position information to the risk prediction unit 105-4. An example of a method of determining the collision risk object by the second detection unit 1101-4 will be described later.
The risk prediction unit 105-4 receives the collision risk object information obtained in the first detection unit 103-4 and the second detection unit 1101-4, independently, matches the objects, and outputs the information to the image synthesis unit 106-4 with the addition of a parameter of “level of risk” of the collision risk object. The definition of “the level of risk” will be described later. Also, the contents of a sound signal from the risk prediction unit 105-4 to the warning sound output unit 108-4 are also changed according to “the level of risk”.
The image synthesis unit 106-4 generates the synthetic image in which a part of the image of the collision risk object is superimposed on the output image of the visible light imaging unit 104 as in the first embodiment, and the information on “the level of risk” can be further provided. The image synthesis unit 106-4 then outputs the synthetic image to the image display unit 107-4. The other constituent elements in
The fourth embodiment is different from the first embodiment in that the fourth embodiment uses both of the detection result of the first detection unit 103-4 that detects the collision risk object with the use of the output image of the millimeter wave imaging unit 102-4, and the detection result of the second detection unit 1101-4 that detects the collision risk object with the use of the output image of the visible light imaging unit 104-4. The fourth embodiment is also different from the first embodiment in that the fourth embodiment calculates the parameter of “the level of risk” in the risk prediction unit 105-4, and changes the contents about which the driver is warned by the image or the sound according to the calculation result.
In the fourth embodiment, the parameter of “level of risk” can be obtained for the collision risk object with the use of both the detection results of the two imaging units. A warning given to the driver about the collision risk object of “level of risk A” by the image or the sound is escalated, as a result of which a particularly risky object is more easily recognized by the driver, and the driver consciously easily takes the collision avoidance action to prevent the accident.
Hereinafter, a method of determining the collision risk object in the second detection unit 1101-4 will be described.
The second detection unit 1101-4 is different from the first detection unit 103-4 using the output image of the millimeter wave imaging unit 102-4 as the input image, in that the output image of the visible light imaging unit 104-4 is used as the input image.
In the method of determining the collision risk object from the input image, the second detection unit 1101-4 may be identical in detection algorithm and setting value with the first detection unit 103-4, or different therefrom.
Hereinafter, a description will be given of an example in which the second detection unit 1101-4 uses the same detection algorithm and setting value as those in the first detection unit 103-4. As the method of determining the collision risk object from the input image, first, the object configuration of the living object such as the person or the animal, or the vehicle such as the automobile, the bike, or the bicycle is extracted from the output image output from the visible light imaging unit 104-4. Then, a predicted traveling direction and speed of the object is calculated by image processing according to the output images temporally continuously taken to predict the motion of the object. When it is determined that the object potentially passes through an area falling within a yaw angle θ[°] (for example: θ=10) and within a distance L[m] (for example: L=10) in the forward direction of the subject vehicle, and within a time t [sec] (for example: t=2), the object is determined as the collision risk object. In this case, the collision risk object information indicative of the size and the position information of the collision risk object on the image is output.
For example, in a case of
Hereinafter, the behavior of the risk prediction unit 105-4 according to the fourth embodiment will be described.
In the fourth embodiment, both the detection results of the first detection unit 103-4 and the second detection unit 1101-4 are used as an input of the risk prediction unit 105-4. In the risk prediction unit 105-4, it is determined (matched) whether the collision risk objects are the same object, or not, on the basis of the detection results. As a specific matching method, there is a method in which, for example, when the collision risk objects are present at the same coordinates, and travel at the same speed in the same direction, it is determined that those collision risk objects are the same object.
Table 1 is a table for describing the definition of the parameter of “the level of risk” in the risk prediction unit 105-4.
The definition of “the level of risk” as illustrated in Table 1 is based on an idea that, to lightly state, “invisible risk is riskier”. That is, (in fact, although a wavelength that can be imaged by the visible light imaging unit 104-4 is wider than a visible range of the person,) the object that can be detected by the visible light can be visibly recognized by the driver, and can be conceived as a standard level of risk. On the contrary, the object that cannot be detected by the visible light may potentially come close to the subject vehicle because the driver has no means of knowing the object, and can be conceived as a high level of risk. Further, for example, the object present at a shorter distance to the subject vehicle on the basis of the distance information is conceived as the higher level of risk according to a distance and a relative speed to the object, and a position thereof. With the use of the apparatus and system according to the present invention, the level of risk is determined by the risk prediction unit 105-4, and the driver can be strongly warned about the object high in the level of risk.
The risk prediction unit 105-4 determines the levels of risk of the object as illustrated in Table 1, according to a condition of whether the object could be detected, or not, in each of the first detection unit 103-4 that detects the object by the millimeter wave and the second detection unit 1101-4 that detects the object by the visible light, with respect to the matching results of the object. As the determining method, the object that could be detected by the first detection unit 103-4 is first defined as “the level of risk B”. Further, among the objects that could not be detected by the first detection unit 103-4, the objects that could be detected by the second detection unit 1101-4 are defined as “the level of risk A”, and the object that could not be detected by the second detection unit 1101-4 are defined as “the level of risk B”. The object of “the level of risk A” is higher in risk of collision than the object of “the level of risk B”.
In the image synthesis unit 106-4, as in the first embodiment, the image is synthesized in such a manner that the output image taken by the millimeter wave is superimposed on the output image taken by the visible light, and the collision risk objects are emphasized by markers. Further, in the image synthesis unit, the image is synthesized in such a manner that the object of the level of risk A is particularly emphasized to allow the driver to easily understand the warning (an emphasizing method will be described later).
Also, a volume of a warning sound, a tone of the warning sound, a warning statement of the synthetic sound as the warning sound, or a tone of the synthetic sound as the warning sound, of the sound signal generated by the risk prediction unit 105-4 is changed according to the level of risk so that warning about the collision risk object of “the level of risk A” is particularly strongly given with a sound
Thus, when the driver is more strongly warned as the object is higher in the level of risk, the object that is particularly liable to be linked to the collision accident can be more consciously avoided by the driver. As a result, the collision can be prevented.
Hereinafter, synthesis of the image will be described specifically with reference to the drawings.
As in the first embodiment, a diagram exemplifying the output image of the millimeter wave imaging unit 102-4 is identical with
On the other hand, a diagram exemplifying the output image of the visible light imaging unit 104-4 is identical with
Thus, when the objects detected by the two detection units are matched, the four collision risk objects of the bicycle 204, the pedestrian 205, the pedestrian 301, and the automobile 302 are detected. Further, when the level of risk is determined on the basis of Table 1, the pedestrian 301 and the automobile 302 are determined as “the level of risk A”, and the bicycle 204 and the pedestrian 205 are determined as “the level of risk B”.
In
As described above, with the use of configuration according to the fourth embodiment, the parameter of “the level of risk” can be obtained for the collision risk object with the use of both the detection results of the two imaging units. For the collision risk object of “the level of risk A”, warning given to the driver is heightened by the image and the sound. As a result, the particularly risky objects are more easily recognized by the driver, and the driver consciously easily takes the collision avoidance action to prevent the accident.
Hereinafter, a fifth embodiment of the present invention will be described in detail.
The vehicle collision risk prediction apparatus 101-5 appropriately includes a millimeter wave imaging unit 102-5, a first detection unit 103-5, a visible light imaging unit 104-5, a risk prediction unit 105-5, an image synthesis unit 106-5, and a second detection unit 1101-5. The millimeter wave imaging unit 102-5 includes a millimeter wave sensor & signal processing unit 109-5, and a millimeter wave source 601-5.
As in
In the fifth embodiment, as in the second embodiment, the millimeter wave source 601-5 and the millimeter wave imaging unit 102-5 are combined together in the imaging method of the active type. Since the imaging method of the active type is applied, the vehicle such as the automobile, the bikes, or the bicycles, which are objects covered with metal can be sharply imaged more than that in the imaging method of the passive type. As a result, a detection precision in the risk object, and a sharpness of the synthetic image provided to the driver are improved.
Further, in the fifth embodiment, as with the fourth embodiment, the parameter of “the level of risk” can be obtained for the collision risk object with the use of both the detection results of the two imaging units. For the collision risk object of “the level of risk A”, warning given to the driver is heightened by the image and the sound. As a result, the particularly risky objects are more easily recognized by the driver, and the driver consciously easily takes the collision avoidance action to prevent the accident.
The fifth embodiment is different from the second and fourth embodiments in that the fifth embodiment can use both of a technique for applying the active type imaging method as in the second embodiment, and a technique for obtaining the parameter of “the level of risk” to change the synthetic image and the sound signal according to the obtained parameter as in the fourth embodiment, at the same time. In the fifth embodiment, the technique for applying the imaging method of the active type is identical with that of the second embodiment, and therefore a description thereof will be omitted. Also, in the fifth embodiment, the technique for obtaining the parameter of “the level of risk” to change the synthetic image and the sound signal according to the obtained parameter is identical with that of the fourth embodiment, and therefore a description thereof will be omitted.
As described above, with the use of the configuration according to the fifth embodiment, as in the second embodiment, the collision risk objects present behind the obstruction can be detected with high precision, and the driver can be warned with the provision of the captured sharp image. As a result, since the driver can more property take the collision avoidance action, the collision accident can be obviated.
Also, at the same time, with the use of the configuration according to the fifth embodiment, as with the fourth embodiment, the parameter of “the level of risk” can be obtained for the collision risk object with the use of both the detection results of the two imaging units. For the collision risk object of “the level of risk A”, warning given to the driver is heightened by the image and the sound. As a result, the particularly risky objects are more easily recognized by the driver, and the driver consciously easily takes the collision avoidance action to prevent the accident. Thus, the fifth embodiment can obtain both the advantages of the second embodiment and the fourth embodiment at the same time.
Hereinafter, a sixth embodiment of the present invention will be described in detail.
As in
The risk prediction unit 105-6 outputs a control signal for controlling an imaging parameter of the millimeter wave imaging unit 102-6 to the millimeter wave imaging unit 102-6. Also, the risk prediction unit 105-6 outputs a control signal for switching on (light on)/off (light off) the millimeter wave source 601-6 to the millimeter wave source 601-6.
Further, as in
As described above, with the use of the configuration according to the sixth embodiment, as in the third embodiment, both of detection results of those two imaging methods can be used. This can realize both of an action for enhancing the detection precision of the object made of metal such as the vehicle by imaging of the active type, and an action for enabling the detection of the pedestrian or the animal by imaging of the passive type, at the same time.
Also, at the same time, with the use of the configuration according to the sixth embodiment, as with the fourth embodiment, the parameter of “the level of risk” can be obtained for the collision risk object with the use of both the detection results of the two imaging units. For the collision risk object of “the level of risk A”, warning given to the driver is heightened by the image and the sound. As a result, the particularly risky objects are more easily recognized by the driver, and the driver consciously easily takes the collision avoidance action to prevent the accident. Thus, the sixth embodiment can obtain both the advantages of the third embodiment and the fourth embodiment at the same time.
Hereinafter, a seventh embodiment of the present invention will be described in detail.
The vehicle collision risk avoidance system 1600-7 is mounted on the vehicle, detects a risk of collision in the periphery of the vehicle (for example, a forward direction), and warns the driver. Also, in order to avoid the collision, the vehicle collision risk avoidance system 1600-7 allows the vehicle per se to take the collision avoidance action, and avoids the collision.
The vehicle collision risk avoidance system 1600-7 includes a vehicle collision risk prediction apparatus 101-7, an image display unit 107-7, a warning sound output unit 108-7, and a vehicle control unit 1601-7. The vehicle collision risk prediction apparatus 101-7 is configured by the vehicle collision risk prediction apparatus described mainly by any one of the first embodiment (
Further, the risk prediction unit (any one of 105 in
In the seventh embodiment, the driver is warned about the collision risk object to facilitate the collision avoidance action through any technique of the first to third embodiments.
On the other hand, the seventh embodiment is different from the first to third embodiments in that even if the driver does not take the collision avoidance action, the subject vehicle per se makes a determination, and takes the collision avoidance action for the purpose of preventing the collision with the object.
A specific method in which the subject vehicle per se makes a determination, and takes the collision avoidance action will be described, for example, below.
First, the first detection unit (any one of
For example, as the determination algorithm of the collision avoidance object, as with the determination algorithm of the collision risk object illustrated in
For the object determined as the collision avoidance object, the risk prediction unit (any one of
If θ2θ, L2≦L, and t2≦t is satisfied as in this example, safety measurements can be gradually taken as the object comes closer to the subject vehicle. If the object comes closer to the subject vehicle, the object is determined as the collision risk object, and the driver is warned to facilitate a voluntary collision avoidance action of the driver. Thereafter, if the object further comes closer to the subject vehicle, the object is determined as the collision avoidance object, and the vehicle per se takes the collision avoidance action.
As described above, with the use of the configuration according to the seventh embodiment, as in the first to third embodiments, the driver can be warned about the collision risk objects present behind the obstruction by the image and/or sound, and can properly take the collision avoidance action. As a result, the collision accident can be obviated. Also, with the use of the configuration according to the seventh embodiment, even if the driver does not take the collision avoidance action, since the subject vehicle automatically takes the collision avoidance action, the collision accident can be obviated.
As a modified example of this embodiment, the image display unit 107-7 can be omitted from the configuration of
Hereinafter, an eighth embodiment of the present invention will be described in detail.
The vehicle collision risk avoidance system 1600-8 is mounted on the vehicle, detects a risk of collision in the periphery of the vehicle (for example, a forward direction), and warns the driver. Also, in order to avoid the collision, the vehicle collision risk avoidance system 1600-8 allows the vehicle per se to take the collision avoidance action, and avoids the collision.
The vehicle collision risk avoidance system 1600-8 includes a vehicle collision risk prediction apparatus 101-8, an image display unit 107-8, a warning sound output unit 108-8, and a vehicle control unit 1601-8.
The vehicle collision risk prediction apparatus 101-8 is configured by the vehicle collision risk prediction apparatus described mainly by any one of the fourth embodiment (101-4 in
Further, the first detection unit (any one of 103-4 in
Further, the second detection unit (any one of 1101-4 in
Further, the risk prediction unit (any one of 105 in
The vehicle control unit 1601-8 receives the collision avoidance information from the risk prediction unit (any one of 105-4 in
In the eighth embodiment, the driver is warned about the collision risk object to facilitate the collision avoidance action through any technique of the fourth to sixth embodiments.
On the other hand, the eighth embodiment is different from the fourth to sixth embodiments in that even if the driver does not take the collision avoidance action, the subject vehicle per se makes a determination, and takes the collision avoidance action for the purpose of preventing the collision with the object.
Also, the eighth embodiment is different from the seventh embodiment in that the second detection unit (any one of 1101-4 in
A specific method in which the subject vehicle per se makes a determination, and takes the collision avoidance action will be described, for example, below.
First, the first detection unit and the second detection unit detect objects (collision avoidance objects) whose collision should be avoided. In this case, methods for determining the collision risk object and the collision avoidance object may be identical in algorithm and setting value, or changed. The method of detecting the collision avoidance object in the first detection unit is described in the seventh embodiment with reference to
In the method for determining the collision risk object from the input image in the second detection, the detection algorithms and the setting values of the first detection unit and the second detection unit may be identical with each other, and changed.
Hereinafter, an example in which the same detection algorithm and setting value as those in the first detection unit are used even in the second detection unit will be described.
In the eighth embodiment, both the detection results of the first detection unit and the second detection unit are used as the input of the risk prediction unit.
In the risk prediction unit, it is determined (matched) whether the collision risk objects are the same object, or not, on the basis of the detection results. As a specific matching method, there is a method in which, for example, when it is detected that the collision risk objects are present at the same coordinates, and travel at the same speed in the same direction, those collision risk objects are determined as the same object. The above-mentioned Table 1 describes the definition of the parameter of “the level of risk” in the risk prediction unit. The risk prediction unit determines the levels of risk of the object as illustrated in Table 1, according to a condition of whether the object could be detected as the collision avoidance object, or not, in each of the first detection unit that detects the object by the millimeter wave and the second detection unit that detects the object by the visible light, with respect to the matching results of the object.
In the eighth embodiment, the collision avoidance action is taken for the objects determined as the level of risk A or B among the collision avoidance objects. Since collision with the objects detected by at least one of the millimeter wave and the visible light can be avoided, the ratio of detection of the objects can be enhanced.
As described above, with the use of the eighth embodiment, as in the fourth to sixth embodiments, the level of risk is calculated according to both the detection results of the visible light and the millimeter wave, and the degree of warning is controlled according to the level of risk. As a result, the risker object invisible by the driver can be more easily recognized by the driver to prevent the accident.
Also, with the use of the configuration according to the eighth embodiment, even if the driver does not take the collision avoidance action, since collision with the objects detected by at least one of the millimeter wave and the visible light can be avoided, the subject vehicle can automatically take the collision avoidance action on the basis of the high ratio of detection, and the collision accident can be obviated.
As one modified example of this embodiment, the image display unit can be omitted from the configuration of
Hereinafter, a ninth embodiment of the present invention will be described in detail.
The millimeter wave imaging unit 102 appropriately includes the millimeter wave sensor & signal processing unit 109, and the millimeter wave source 601. The millimeter wave source 601 appropriately includes a transmitter circuit 3001, and a transmit antenna 3002. The millimeter wave sensor & signal processing unit 109 appropriately includes a lens filter 3000, a receive antenna array 3003, a receiver circuit 3004, and a signal processing unit 3005.
The transmitter circuit 3001 generates a transmit signal of analog at a timing designated by the signal processing unit 3005, and outputs the transmit signal to the transmit antenna 3002. The transmit antenna 3002 can radiate the electromagnetic wave including a signal of the wavelength ranging from the millimeter wave band to the submillimeter wave band (wavelength ranges from about several tens μm to about 1 cm) in the periphery of the subject vehicle to be photographed.
The lens filter 3000 focuses and filters the electromagnetic wave of the above wavelength for each pixel or on a surface so as to receive the electromagnetic wave with high precision. The receive antenna array 3003 of the wavelength has a plurality of antennas that receives the electromagnetic wave including the signal of the above wavelength, two-dimensionally arranged, and outputs a receive signal of analog to the receiver circuit 3004. The receiver circuit 3004 A/D converts the receive signal of analog into the receive signal of digital, and outputs the receive signal to the signal processing unit 3005. The signal processing unit 3005 outputs a digital signal for controlling an output timing, which is a transmit signal, to the transmitter circuit 3001. Also, the signal processing unit 3005 compares a timing for transmitting the transmit signal with a receive signal output from the receiver circuit, calculates distance information on a given object, and relative speed information on the given object, and outputs calculated information to the first detection unit 103.
The receive antennas (2002 to 2017) are arranged at the respective individual positions, and can also receive signals from the air with the same or individual directionalities. The row circuit 2001 and the column circuit 2022 select one or a plurality of receive antennas among the receive antennas (2002 to 2017), and allows the selected receive antennas to output signals. The amplifiers (2018 to 2021) amplify the signals output from the receive antennas, and output the signals to the column circuit 2022.
In the case of
The radiated electromagnetic wave is reflected on the object present in the traveling direction of the electromagnetic wave, and received by the receive antenna array 3003 and output (receive signal 2304). A delay time τ occurs according to the distance and relative speed between the object and the subject vehicle until the electromagnetic wave radiated from the transmit antenna is reflected by a given object, and returned. If the electromagnetic wave is reflected with no time delay (τ=T0) (that is, distance is zero), the receive signal 2304 is output in all the frame periods of Frame 0. However, because the above-mentioned delay time occurs, the timing at which the receive signal is output is changed according to the distance. For example, the respective receive signals are output in the Frame 0 when T0≦τ<(T0+Ta) is satisfied, in the Frame 1 when (T0+Ta)≦τ<(T0+2Ta) is satisfied, in the Frame 2 when (T0+2Ta)≦t<(T0+3Ta) is satisfied, and in the Frame 3 when (T0+3Ta)≦τ<(T0+4Ta) is satisfied. In the respective frame periods, the receive signals are output in the order of scanning lines.
The signal processing unit 3005 compares the receive signal 2304 thus received with the transmit signal 2302 to obtain the amount of delay for each pixel. That is, the signal processing unit 3005 can calculate the distance information for each of two-dimensional pixels.
In this way, the signal processing unit 3005 can obtain the distance information and the relative speed information two-dimensionally for the signal of the selected receive antenna as illustrated in
Also, when the transmit signal 2302 is a signal (beat signal) which is not a pulse but includes a plurality of frequencies ranging from a low frequency to a high frequency, the distance as well as the relative speed to the given speed can be calculated two-dimensionally for each pixel by the principle of radar. The relative speed information from the subject vehicle can be obtained two-dimensionally by the technique of this embodiment at the same time.
In the determination of the collision risk object illustrated in
As described above, with the use of the configuration according to the ninth embodiment, since the distance and the relative velocity of the given object can be obtained more precisely, a precision of the risk prediction by the risk prediction unit 105 can be enhanced to obviate the collision accident.
Hereinafter, a tenth embodiment of the present invention will be described in detail.
The tenth embodiment has the configuration of, for example, the second embodiment (
In order to realize the technique for reading a large number of pixels in parallel, in this embodiment, in the row circuit 2001 and the column circuit 2022 of
In order to process a large number of pixels in parallel, the receiver circuit 3004 and the signal processing unit 3005 in
As described in this embodiment, when the plurality of pixels is read in parallel at the same time, the large number of pixels can be also processed at high speed, high definition of output can be performed without lessening a frame rate.
As described above, with the use of the configuration according to the ninth embodiment, the high definition of output can be performed without lessening the frame rate. This can contribute to an improvement in the precision of the risk prediction by the risk prediction unit 105, and an improvement in the image quality when the driver confirms the image display unit 107, to thereby obviate the collision accident.
Hereinafter, an eleventh embodiment of the present invention will be described in detail.
The eleventh embodiment has the configuration of, for example, the second embodiment (
First, a technique called “fast read mode” in which the pixels can be read at a higher frame rate (shorter frame period) than that when all of the pixels are read will be described with reference to
In this way, a set of outputs of all 2×4 pixels are completed from the times T1 to T9. In the case of
Subsequently, a description will be given of a technique called “gradual distance and relative speed calculation” in which an area for calculating the distance information and the speed information is gradually narrowed so that the collision risk object can be detected at higher speed than that when both of the position and the relative speed are measured for all of the pixels, with reference to
As compared with ranging by using the pulse signal used in Steps 1 and 2, the transmission of the beat signal used in Steps 3 and 4 requires much time for measurement because there is a need to transmit a plurality of frequencies and receive the plurality of frequencies. In the gradual distance and relative speed calculation according to this embodiment, a distance to the overall image is measured in Steps 1 and 2. Then, the pixel area in which the object having a risk of collision is highly potentially hidden is estimated in Step 3, and the relative speed is measured for only the estimated pixel area in Steps 4 and 5. With this process, the collision risk object can be detected at higher speed than that when both of the position and relative speed are measured for all of the pixels.
As described above, with the use of the gradual distance and relative speed calculation according to this embodiment, the collision risk object can be detected at higher speed than that when both of the position and relative speed are measured for all of the pixels. This can contribute to an improvement in the recognition precision of the object in the first detection unit 103, an improvement in the precision of the risk prediction by the risk prediction unit 105, and an improvement in the image quality and the response speed when the driver confirms the image display unit 107, to thereby obviate the collision accident.
Hereinafter, a twelfth embodiment of the present invention will be described in detail.
The vehicle collision risk avoidance system 2900 appropriately includes the vehicle collision risk prediction apparatus 101, the image display unit 107, the warning sound output unit 108, and a vehicle control unit 2901. The vehicle control unit 2901 is identical with the vehicle control unit 1601 in
The vehicle collision risk prediction apparatus is identical with the vehicle collision risk prediction apparatus 101 in
The vehicle control unit 2902 automatically decelerates the subject vehicle by braking on the basis of the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101, and avoids the risk of collision. In this case, the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101 to the vehicle control unit 2902 includes, for example, information indicative of the intensity and timing of braking.
The transmission unit 2903 shifts down, reduces the speed by an engine brake, and avoids the risk of collision, on the basis of “collision avoidance information” output from the vehicle collision risk prediction apparatus 101. In this situation, the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101 to the transmission unit 2903 includes information indicative of timing for shifting gears.
The steering control unit 2904 turns the steering wheel in a direction opposite to the collision risk object on the basis of the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101 to avoid the collision.
The body contact notification unit 2905 controls a site that comes into contact with a body of the driver, and notifies the driver of the risk by a method of changing the tightness of a seat belt, or vibrating a seat on the basis of the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101. In this case, the “collision avoidance information” output from the vehicle collision risk prediction apparatus 101 to the body contact notification unit 2905 includes information indicative of the degree of changing the tightness of the seat belt, the degree of oscillating the seat, and a timing at which the tightness of the seat belt or the vibration of the seat is changed.
In the collision avoidance action, only a part of elements within a vehicle control device may be controlled, or all of the elements may be controlled at the same time. For example, there are cases in which only the vehicle control unit 2902 is used, two elements of the vehicle control unit 2902 and the transmission unit 2903 are used together, three elements of the vehicle control unit 2902, the transmission unit 2903, and the steering control unit 2904 are used together, and all of four elements of the vehicle control unit 2902, the transmission unit 2903, the steering control unit 2904, and the body contact notification unit 2905 are used together. Also, the collision avoidance action may be implemented when the collision avoidance action has not been conducted even if a given time has been elapsed after the driver has been notified of the warning by the screen display of the collision risk object or the output of the warning source such as the alarm sound or the synthetic sound. Also, a timing of starting the collision avoidance action may be changed according to the level of risk. For example, if it is determined on the basis of the obtained distance information that the distance to the collision risk object is short, and the level of risk is high, a given time from a notification of warning to the driver to the avoidance operation start may be shortened, or the avoidance operation may start together with the notification. Whether the collision risk avoidance action has been conducted, or not, is monitored by, for example, a vehicle speed monitoring unit, a transmission monitoring unit, or a steering monitoring unit, and whether a necessary action such as a reduction in the vehicle speed is detected, or not, may be checked.
If the number of elements to be used is small among the four elements (vehicle control unit 2902, transmission unit 2903, steering control unit 2904, and body contact notification unit 2905) within the vehicle control unit 2901 in
As described above, with the use of the configuration according to the twelfth embodiment, as in the seventh and eighth embodiments, the driver can be warned about the collision risk objects present behind the obstruction by the image and the sound, and can properly take the collision avoidance action. As a result, the collision accident can be obviated. Also, with the use of the configuration according to the seventh embodiment, even if the driver does not take the collision avoidance action, since the subject vehicle automatically takes the collision avoidance action, the collision accident can be obviated. The configuration of the twelfth embodiment can be applied in appropriate combination with the configurations described in the other embodiments.
The present invention is not limited to the above-mentioned embodiments, but includes various modified examples. For example, the above-mentioned embodiments are described in detail for the purpose of facilitating understanding of the present invention, and the present invention does not always include all of the configurations described above. Also, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment. Also, in a part of the configurations of the respective embodiments, another configuration can be added, deleted, or replaced.
Also, parts or all of the above-mentioned respective configurations may be configured by hardware, or may be realized by causing a processor to execute programs.
Also, the control lines and the information lines necessary for description are illustrated, and all of the control lines and the information lines necessary for products are not always illustrated. In fact, it may be conceivable that most of the configurations are connected to each other.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2012-016087 | Jan 2012 | JP | national |
