In the accompanying drawings:
Hereinafter is described a first embodiment of the present invention with reference to the accompanying drawings.
In
The camera 10 is configured in such a way that it can adjust a shutter speed, a frame rate, a gain of a digital signal outputted to a vehicle detection controller 20, or the like under the control of a control unit, not shown, incorporated in the camera. The camera 10 outputs digital signals that serve as image data indicating the brightness of individual pixels of a picked-up image. These digital signals, together with horizontal/vertical synchronizing signals, are outputted to the vehicle detection controller 20. (Details of the vehicle detection controller is shown in
The vehicle detection controller 20 applies image processing to the image data inputted from the camera 10 to detect light spots originated from the tail lamps of a preceding vehicle or the headlamps of an oncoming vehicle. When such light spots originated from the tail lamps of a preceding vehicle or the headlamps of an oncoming vehicle are detected, the detection information on the preceding or oncoming vehicle is outputted to a headlamp controller 30.
The headlamp controller 30 then controls a beam-axis alignment, i.e., an orientation of the headlamps based on the detection information on other vehicles, such as a preceding vehicle and an oncoming vehicle, inputted by the vehicle detection controller 20. For example, where a distance from the instant vehicle to a preceding or oncoming vehicle provided by the detection information is equal to or less than a predetermined distance, the orientation of the headlamps is controlled to emit low beams of light. Thus, a driver of the preceding or oncoming vehicle is prevented from being dazzled by the headlamps of the instant vehicle. On the other hand, where the distance from the instant vehicle to the preceding or oncoming vehicle is equal to or more than the predetermined distance, or where no preceding or oncoming vehicle is detected, the orientation of the headlamps is controlled to emit high beams of light so as to assure high visibility for the driver of the instant vehicle. Use of the image data of the camera 10 enables detection of a preceding or oncoming vehicle which is relatively far away (e.g., 600 m) from the instant vehicle, so that the headlamp controller 30 can adequately control the orientation of the headlamps.
The procedure of vehicle detection in the vehicle detection system 100 will now be described in detail below with reference to a flow diagram of
At step S100, the image data picked up by the camera 10, functioning as an imaging device 10 shown in
Specifically, the brightness of each individual pixel is compared with a predetermined threshold brightness to carry out binarization processing. In the binarization processing, a pixel having brightness equal to or more than the predetermined threshold brightness is allocated with “1” and a pixel having brightness less than the predetermined threshold brightness is allocated with “0” to thereby produce a binarized image. Subsequently, if the pixels allocated with “1” are close to each other in the binarized image, labeling processing is carried out. In the labeling processing, these pixels are labeled so as to be recognized as being a single light spot. In this way, a light spot made up of a collection of a plurality of pixels is detected as a single light spot.
At step S130, functioning as a line detector 50 shown in
In this case, where the headlamps of the instant vehicle are being turned on, the light emitted from the headlamps is reflected by the white lines. As a result, the white lines are shown comparatively brightly in the image data. Thus, such an edge can be detected at a position turning from a road region (dark area) to a white-line region (bright area) or at a position turning from the white-line region (bright area) to the road region (dark area). In this way, when the combination of the detected edges forms a shape corresponding to a white line, a white line is detected as lying at the position of the combined edges.
It should be appreciated that the white-line detection processing is not limited to the one described above, but may be carried out by using other known processes. For example, the brightness of the pixels corresponding to the white-line region is higher than that of the pixels corresponding to the road region as described above. Based on this, a threshold may be set, and then the pixels having brightness equal to or more than the set threshold brightness may be extracted. When a shape corresponding to a white line has appeared by combining the extracted pixels, the collection of the extracted pixels may be detected as a white line. The colors of partition lines include yellow other than white. It should be appreciated that the white-line detection processing described above may also be applied to the detection of the yellow partition lines, furthermore, a line on and along the road where the instant vehicle runs or is present.
In the white-line detection processing at step S130, no white line may be detected in the absence of the white lines on the rode, for example. At the subsequent step S140, functioning as a noise filter 60 shown in
At step S150, reflector detection processing is carried out, in which the light spots originated from the reflectors provided along the roadside are detected.
In the daytime, a vehicle driver can drive the vehicle by using the white lines and the guard fences, for example, as traveling guides. At night, however, it is significantly difficult to catch sight of these facilities serving as the traveling guides. The road geometry therefore can only be visually recognized chiefly in a limited range illuminated by the headlamps of the instant vehicle. Thus, for the improvement, for example, of the degree of recognition of the road geometry, reflectors (also referred to as “delineators”) having very high reflectance may be set up along the roadside. The provision of such reflectors along the roadside may allow the vehicle driver, if the headlamps of the driver's vehicle are on, to recognize the reflectors over a long distance.
On the other hand, however, such high-reflectance reflectors may appear on the image data picked up by the camera 10 with the brightness equivalent to the light spots produced by some light sources. Therefore, the light spots produced by the reflectors may be erroneously detected as other vehicle lamps, such as the tail lamps of a preceding vehicle or the headlamps of an oncoming vehicle. To take measures for this, the present embodiment detects the light spots of the reflectors referring to the positions of the white lines. Accordingly, the light spots produced by the reflectors can be excluded in advance from the detection of vehicle lamps to thereby reduce as much as possible the erroneous detection mentioned above.
Hereinafter, a scheme of detecting the light spots originated from the reflectors is described with reference to
As shown by broken lines in the specific example of detecting the row of the light spots in
At subsequent step S160, a determination is made as to whether or not a row of the light spots corresponding to the reflectors has been detected in the reflector detection processing at step S150. At step S160, if it is determined that no row of the light spots corresponding to the reflectors has been detected, control proceeds to step S180. Contrarily, if a row of the light spots corresponding to the reflectors has been determined as having been detected at step S160, control proceeds to step S170.
At step S170, the row of the light spots corresponding to the reflectors is deleted from the image data. Thus, the light spots remaining in the image data no longer include the light spots produced by the reflectors. As a result, accurate detection can be performed of the light spots originated from the vehicle light sources, such as the tail lamps of a preceding vehicle or the headlamps of an oncoming vehicle.
At step S180, the light spots originated from the tail lamps of the preceding vehicle or the light spots originated from the headlamps of the oncoming vehicle are detected from among the light spots included in the image data based, for example, on the brightness, shapes and symmetricalness of the light spots. Where the light spots produced by the tail lamps of the preceding vehicle or the headlamps of the oncoming vehicle are detected, vehicle detection information is outputted to the headlamp controller 30, indicating that other vehicles, such as the preceding and oncoming vehicles, have been detected. Preferably, the vehicle detection information may include a distance to each of the detected vehicles. As is well known, a distance to a detected vehicle can be calculated based, for example, on a length between the left and right lamps, and the positions of the light spots in the image sensor.
At step S140, if it is determined that no white line has been detected, and at step S160, if it is determined that no reflector has been detected, control proceeds to step S180 without carrying out the process of step S170. Accordingly, in this case, all the light spots detected at step S120 are subjected to the processing for detecting the light spots originated from other vehicle lamps.
Note that the vehicle detection procedure S110 to S180 explained above and shown in
Advantages of this first embodiment now will be described hereinafter using the vehicle detection system. Identical advantages to the system can be achieved in a method or a program product manner to which identical technique are applied and recited in attached claims.
The vehicle detection system 100 described in this embodiment comprises: an imaging device (10, 40; S100, S120) imaging a forward view of the instant vehicle and outputting a first image data of the view; a detector (50; S130) detecting, from the first image data, a second image data indicating a line on a road, the line running along the road on which the instant vehicle and the other vehicles are present; a filter (60; S140,S150, S160 and S170) filtering the first image data to remove therefrom a noise consisting of image data other than the spot of light; and an output member (70; S180) outputting a signal filtered by the filter, the a signal indicating the spot of light.
Thus, in the vehicle detection system of the present embodiment, the light spots, or bright areas, produced by some light sources and appear on the image data are detected as to whether or not the light spots have been produced by the disturbing light sources, with reference to the location of the partition lines. If the light spots are considered as being originated from the disturbing light sources, such light spots are deleted from the objects to be detected in detecting the light spots originated from other vehicle lamps as light sources. As a result, erroneous detection of the light spots originated from the disturbing light sources, such as the reflectors set up on the roadside as being the light spots originated from vehicle lamps can be reduced as much as possible.
In this system 100 just described above, particularly, the filter (60; S140,S150, S160 and S170) filters a third image data originated from a plurality of light spots extending parallel to the line. Further particularly, the plurality of light spots are produced by reflectors provided on a side of the road.
The reflectors set up along the roadside, which are also referred to as “delineators”, have very high reflectance. When the headlamps of the instant vehicle are being turned on, the light reflected by the reflectors is picked up by the image pickup means and appears on the image data with the brightness corresponding to the light spots produced by some light sources. For the improvement of the degree of recognition of the road geometry at night, the reflectors, with a certain same height, are set up along the roadside with a certain interval therebetween. Accordingly, the reflectors set up along the roadside appear on the image data as a row of a plurality of light spots extending parallel to the partition line. In this particular system, detection of the row of the light spots can enable deletion of the light spots produced by the reflectors in detecting light spots produced by vehicle lamps.
Further, A specific scheme for detecting the row of the light spots can be presented. In this system 100 just described above, preferably, the filter 60 filters the third image data when the third image data overlaps to the second image data by shifting stepwise to a direction. Particularly, the direction is a direction indicating height of a reflector provided along the line in the first image data.
In this way, recognition error originated from the reflectors can be reduced, thus, increasing the ability to remove noise.
A second embodiment of the present invention is described below. The vehicle detection system according to the second embodiment has a configuration similar to the one in the first embodiment. In the second embodiment, the identical or similar components or processes to those in the first embodiment are given the same reference numerals for the sake of simplifying or omitting the explanation.
A difference of the vehicle detection system of the present embodiment from that of the first embodiment resides in the scheme of detecting the disturbing light sources, such as the reflectors. The description below is focused on the scheme of detecting the disturbing light sources, such as the reflectors, in the vehicle detection system according to the second embodiment.
In the present embodiment, if the white line is determined as having been detected at step S140, control proceeds to step S155, functioning as a noise filter 60 shown in
The road region where the instant vehicle as well as other vehicles such as the preceding and oncoming vehicles travels is basically divided into lanes by partition lines, such as white lines. For a plurality of lanes provided for the same traveling direction, broken lines are used to define each of the plurality of lanes, and for a border dividing between the road region and the region outside the road region, a continuous line is used. Thus, with respect to the preceding vehicle that travels on a lane toward a traveling direction in which the instant vehicle travels, the partition line that lies opposite to the oncoming lane can be used as a basis for determining a no-vehicle area where no preceding vehicle is present. Specifically, when the left-side white line of a lane where the instant vehicle travels in left-hand traffic is a continuous line, the lane can be regarded as being the leftmost lane. Accordingly, the outside of the leftmost white line along the lane where the instant vehicle travels can be regarded as being the no-vehicle area, such as a side strip, where no preceding vehicle is present.
Therefore, when a determination “YES” is made at step S155, control proceeds to step S165 where the left-side white line is used as a basis for setting an area left-side of the white line (outside the lane) as the no-vehicle area where no preceding vehicle travels. At the subsequent step S175 the light spots belonging to the no-vehicle area set at step S165 are regarded as being produced by the disturbing light sources, such as the reflectors, and deleted from the image data. Thus, the light spots remaining in the image data no longer contain those light spots originated from the disturbing light sources, such as the reflectors, whereby accurate detection can be performed for the light spots originated from other vehicle lamps.
As shown in
In setting the no-vehicle area at step S165, it is preferable that, as shown in
Note that the vehicle detection procedure S110 to S180 explained above and shown in
Advantages of the second embodiment now will be described hereinafter using the vehicle detection system 100. Identical advantages to the system can be achieved in a method or a program product manner as recited in appended claims.
The vehicle detection system 100 described in the second embodiment, the noise filter (S165; S1650) filters all of image data within a no-vehicle area in the first image data, the no-vehicle area defined based on the second image data.
A road, or a road area, where other vehicles such as preceding and oncoming vehicles travel is basically defined by partition lines. Thus, by defining the no-vehicle area where no vehicle is present, the light spots included in the no-vehicle area may be regarded as being the light spots originated from the disturbing light sources.
In defining the no-vehicle area using the line on and along the road, it is preferable that the no-vehicle area (shown in
In case where a plurality of lanes are provided on the road, each partition line defining the lanes is indicated by a broken line. Meanwhile, a partition line which lies on a side opposite to an oncoming lane and partitions between a lane and an area other than the lane (e.g., a side strip) is indicated by a continuous line. Therefore, if the partition line which lies along the lane where the instant vehicle travels, being opposite to an oncoming lane, is a continuous line, the area outside the lane along this partition line can be determined as being the no-vehicle area.
However, in spite of the fact that the preceding vehicle travels inside the partition line, the tail lamps of the preceding vehicles, which are positioned at a certain level, may appear on the image data as if being present outside the partition line. This is because, on the image data, a closer-range object appears with a larger dimension, and a longer-range object appears with a smaller dimension, as in so-called linear perspective, and thus because the partition line, as it extends farther, appears as an oblique line extending closer to the center of the image.
Therefore, it is preferable that the no-vehicle area (i.e., the area defined as the region with broken oblique lines in
Thus, the light spots produced by the tail lamps of the preceding vehicle can be prevented from being erroneously detected as being the light spots produced by the disturbing light sources.
Further, the method using information of the vehicle-present area can provide easier countermeasures against unexpected errors occurred under various conditions encountering in future, when an area-information of the vehicle-present area is set as a programmable one.
Some preferred embodiments of the present invention have been described above. The present invention, however, should not be limited to the embodiments described above but may be embodied with various modifications within a scope not departing from the spirit of the present invention.
For example, the vehicle detection system in the above embodiments has been applied to the headlamp controller. However, the vehicle detection system may be applied to a drive assist system, for example, which detects a preceding or oncoming vehicle at night to give an indication or warning to the driver accordingly.
Further, above embodiments are described, supposing the case of left-hand traffic in Japan. In case of right-hand traffic, e.g., in US and Germany, although, the vehicle detection schema disclosed in this description is also applicable when left and right-side are switched with appropriate modifications complying with each rule of the road in these countries.
Number | Date | Country | Kind |
---|---|---|---|
2006-206899 | Jul 2006 | JP | national |