Patent Grant
11721005
This application is a National Stage of International Application No. PCT/JP2018/032355 filed Aug. 31, 2018.
The present disclosure relates to an automobile use video image recording device, and an automobile use graphical image recognition device.
Automobile use video image recording devices for recording a video image of the circumference of a host vehicle are attached on the upper part of a driver seat in a vehicle room, so that the video image can be recorded through a front wind shield (front glass). However, a dashboard on the inside of a car is illuminated by the light from the outside of a car body and produces a reflection on the surface of a front wind shield, and thereby, there arises a problem that reflection glare is taken into a video image capture device. In order to prevent the production of this reflection glare, a variety of automobile use video image recording devices are proposed.
One of such devices is a setup in which a linearly polarized light filter is provided on an optical path of the reflection glare which is taken into a video image pickup lens of an automobile use video image recording device. To be more precise, a device is proposed in which a linearly polarized light filter is attached on the lower part of a video image pickup lens (Patent Document 1). However, when a linearly polarized light filter is attached on the lower part of a video image pickup lens, there arises a problem that the driver's field of view is obstructed.
In order to solve this problem, proposed is a structure in which a filter having a function of an optical switch is disposed on a front wind shield. This filter is a device designed so that a general video image can be recorded through a front wind shield, when the filter is in a turned off state, and further, so that a reflection video image by the front wind shield can be recorded, when the filter is in a turned on state. According to this proposal, a difference video image is created by deducting the reflection video image, from the general video image which is recorded with a camera, using the filter, and correction is carried out on the general video image based on this difference video image to obtain a final video image (Patent Document 2).
However, in the case where this proposal is implemented, the filter must be disposed on the outside of a front wind shield, since a reflection video image on the indoor side of the front wind shield needs to be obtained. Additionally, there arises a problem that a configuration for establishing the link with a camera becomes complicated, and further, the filter obstructs the movement of a wiper which is provided on the outside of the front wind shield.
Patent Document 1: Japanese Patent No. 5417773
Patent Document 2: Japanese Laid-Open Patent Publication No. 2013-258677
In connection with the fact that a reflection video image is included in a general video image which is obtained through a front wind shield, there is an issue that influence of the reflection glare of a reflection video image cannot be eliminated, without obstructing the driver's field of view.
The present disclosure aims at providing an automobile use video image recording device which does not obstruct the driver's field of view and is made to be less sensitive to the influence of a reflection video image.
An automobile use video image recording device according to the present disclosure includes: a video image capture device which obtains a first graphical image data on a general video image and a second graphical image data on a predetermined part in a vehicle room, wherein the general video image is with a reflection video image by a wind shield, of the predetermined part in the vehicle room and also with a transmission video image that transmitted through the wind shield, a graphical image conversion device which converts the second graphical image data into a third graphical image data, the third graphical image data corresponding to a reflection video image by the wind shield, and a graphical image correction device which corrects the first graphical image data based on the third graphical image data.
According to the present disclosure, since the graphical image data on a general video image is corrected by graphical image processing which uses a graphical image data corresponding to a reflection video image, the reflection glare can be made to have smaller amounts of influence.
Automobile use video image recording devices for recording a video image of the circumference of a host vehicle are attached on the upper part of a driver seat in a vehicle room, so that the video image can be recorded through a front wind shield. As shown in
The graphical image data which can be taken out from the first video image capture device 10 is a graphical image data on a general video image, which is a transmission video image on which a reflection video image is added. In addition, the graphical image data which can be taken out from the second video image capture device 20 is not a graphical image data on a reflection video image itself, but a graphical image data on a video image which can be obtained by recording a video image of a predetermined part that became an object of the reflection video image. That is to say, the camera 21 of the second video image capture device 20 is the one to record a video image of a predetermined part that became an object of the reflection video image.
The storage device 13 of the first video image capture device 10 and the storage device 23 of the second video image capture device 20 are connected to a graphical image conversion device 30. This graphical image conversion device 30 converts a second graphical image data which is taken out from the storage device 23, into a graphical image data which corresponds to a reflection video image (a third graphical image data). In order to bring the third graphical image data closer to the graphical image data on a reflection video image, the graphical image data on a general video image, which is stored in the storage device 13 of the first video image capture device 10, is required as a reference data. That is to say, in the graphical image conversion device 30, graphical image conversion technology is used to create a graphical image data on a reflection video image by a wind shield, from the second graphical image data by the second video image capture device 20.
For example, since the reflection video image is a video image which is reflected by a wind shield, the second graphical image data is reversed and is disposed on a flat surface, and the brightness information is converted to numerical values and those values are disposed on a plane coordinate. As for the first graphical image data, the brightness information is also converted to numerical values and those values are disposed on a plane coordinate. Similar regions are determined by similar image search technology, in which the similarity in the values of each brightness information (the third graphical image data, which is obtained by performing graphical image conversion to the second graphical image data, is similar to a part of the first graphical image data) is judged. Then, adjustment of the data can be performed, so that the third graphical image data may be brought closer to a part of the first graphical image data. It is to be noted that these operations perform the expansion and contraction of graphics and the adjustment of slopes, based on the brightness value and graphical image data. So, learning of the repetition for the adjustment can be performed, using a microprocessor, where parameters and coordinate axes in the adjustment are set up previously.
Further, the first video image capture device 10 is connected to a graphical image correction device 40. The graphical image correction device 40 corrects the first graphical image data which is taken out from the storage device 13, based on the third graphical image data, which underwent the conversion by the graphical image conversion device 30. Then, the first graphical image data which underwent the correction based on the third graphical image data (the first graphical image data after the correction) is output to a graphical image output device 50, and a video image in which a reflection video image is eliminated from a general video image, can be provided, as an output of the automobile use video image recording device.
Next, the operation of the automobile use video image recording device which is shown in
At first, the graphical image data on a general video image (the first graphical image data on a general video image, wherein the general video image is with a transmission video image that transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room) is obtained with a camera 11, in the first video image capture device 10 (Step S001). In the case where the present device is attached to, for example, a front wind shield of a vehicle, the first graphical image data which is obtained here is on a general video image, wherein the general video image is with a video image of the scenery ahead, including an object to which attention on the contact or collision along the travelling direction of a vehicle should be paid, and also with a reflection video image in a vehicle room.
In the second video image capture device 20, a video image of a predetermined part, which became an object of the reflection video image, is recorded with the camera 21 (Step S002). The graphical image data on the video image which is recorded here, is temporarily stored in the storage device 23, as a second graphical image data (Step S003).
Graphical image conversion is performed on a second graphical image data which is obtained by the second video image capture device 20, so that the second graphical image data may become a video image of the time when reflected by a wind shield, and a third graphical image data which has a huge similarity to a part of the first graphical image data is created (Step S004).
Further, the first graphical image data which is obtained by the first video image capture device 10 is sent to a graphical image correction device 40. The graphical image correction device 40 reads in the third graphical image data from the graphical image conversion device 30, and correction process by graphical image processing is performed on a corresponding part of the first graphical image data, based on the third graphical image data (Step S005).
Here, a method for performing specifically the correction process by graphical image processing on the third graphical image data, which corresponds to a graphical image with reflection glare, is for example as follows; a fixed quantity of correction is performed beforehand on RGB values or brightness values, or the both, with respect to respective pixels of a reflection glared graphical image, and then, the process for doing division from the graphical image data is performed.
After that, the first graphical image data in which a corresponding part of the third graphical image data is processed will be sent to the graphical image output device 50 (Step S006).
Next, explanation will be made, based on
Here, brightness values of only a portion of image elements in the Graphical image A1 are exemplary presented, for the sake of simplicity. In a similar manner, Data A4 represents brightness values of a portion of image elements in the Graphical image A2. Numeral A5 represents a correction value, which will be multiplied to the brightness values of image elements A3. Data A6 represents brightness values of after the correction, where the brightness values of image element A3 underwent the correction by the correction value A5. Furthermore, Data A7 represents brightness values, which are obtained by subtracting the brightness values A6 of a reflection glared graphical image (after the correction) from the brightness values A3 of the Graphical image A1. When those A7 values are employed to depict a graphical image, the graphical image from which reflection glare is eliminated, like Graphical image A8, is produced.
It is to be noted that a correction value A5 is introduced, since only subtracting the brightness values A4 simply from the brightness values A3 may not always eliminate the reflection glare, depending on the surrounding environment. For example, subtraction is carried out with a default setting for the correction value A5, and check on the degree of correction is performed by the Graphical image A8, which is a result of after this subtraction. Those checks are carried out repeatedly to set up an optimal correction coefficient.
In Embodiment 1, there is shown an automobile use video image recording device which is provided with a first video image capture device 10, which obtains the first graphical image data on a general video image, wherein the general video image is with a transmission video image that transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room; and also with a second video image capture device 20, which obtains the second graphical image data on a video image of the predetermined part in the vehicle room, which became an object of the reflection video image. In the present Embodiment 2, the function of the second video image capture device 20 is established in the first video image capture device 10, and the automobile use video image recording device is configured to switch the video image recording areas of the camera 11 of the first video image capture device 10.
That is to say, the automobile use video image recording device according to Embodiment 2 is provided with a function to switch the video image recording areas of the camera 11, as shown in
As shown in
Further, the storage device 13 is set up so that, the first graphical image data and the second graphical image data are each stored in a different storage sector. Like in Embodiment 1, the second graphical image data is taken out from the storage device 13, and converted into a graphical image data corresponding to a reflection video image (the third graphical image data), in the graphical image conversion device 30. Then, in the graphical image correction device 40, correction is performed on the first graphical image data which is taken out from the storage device 13, based on the third graphical image data. Then, the first graphical image data which is corrected based on the third graphical image data (the first graphical image data after the correction) is output to the graphical image output device 50.
Next, the operation of an automobile use video image recording device which is shown in
At first, the graphical image data on a general video image (the first graphical image data on a general video image, wherein the general video image is with a transmission video image that transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room) is obtained with the camera 11, in the first video image capture device 10 (Step S001). In the case where the present device is attached to, for example, a front wind shield of a vehicle, the first graphical image data which is obtained here is on a general video image, wherein the general video image is with a video image of the scenery ahead, including an object to which attention on the contact or collision along the travelling direction of the vehicle should be paid, and also with a reflection video image in a vehicle room. These situations are the same as those in Embodiment 1.
Next, the video image recording areas of the camera 11 are switched by the camera direction control device 14, and a video image of a predetermined part which became an object of a reflection video image, is recorded (Step S0021). The graphical image data on the video image which is recorded here is put in a sector different from that of the first graphical image data, and is stored, as a second graphical image data, in the storage device 13 (Step S0031).
The video image recording areas of the camera 11 are switched, and a second graphical image data is obtained. Graphical image conversion is performed on the second graphical image data, so that the second graphical image data may become a video image which corresponds to a reflection image by a wind shield. Thereby, a third graphical image data which has a huge similarity to a part of the first graphical image data will be created (Step S004).
Furthermore, the first graphical image data which is obtained here is sent to a graphical image correction device 40. In the graphical image correction device 40, a third graphical image data from the graphical image conversion device 30 is read in, and the correction process by graphical image processing is performed on a corresponding part of the first graphical image data, based on the third graphical image data (Step S005). This correction process (Step S005) and the output to the graphical image output device 50 (Step S006) are the same as those in Embodiment 1.
According to the present Embodiment 2, the direction of the camera 11 needs to be brought back to the video image recording area of a steady state at the final step, that is to say, an operation to change the video image recording direction is added, so that the video image recording area may direct the forward part of a vehicle, from an on-dashboard part (Step S007).
The function of the second video image capture device 20 is established in the first video image capture device 10, and thereby, the automobile use video image recording device is configured to switch the video image recording areas of the camera 11 of the first video image capture device 10. As for the switching in this video image recording area, shown is a case in which a switching device of optical systems is used.
That is to say, as shown in
As shown in
The relation between the insertion of the reflector 15 and the reflector control device 16, which is shown in this
According to the present Embodiment 3, there is no need to change the position of a camera 11, and an additional component is only a reflector 15, and thereby, a simple configuration is achieved. Further, in the case where the reflector 15 is made from a device which is provided with a shutter function, like a liquid crystal display panel, an effect will be produced that a mechanical structure can be replaced with an electric fixing device.
In Embodiment 1, there is shown a configuration in which the first graphical image data is obtained by the first video image capture device 10, and the second graphical image data is obtained by the second video image capture device 20. Further, in Embodiment 2, there is shown a configuration in which the direction of the camera 11 is switched, as a configuration in which the function of the first video image capture device 10 and the function of the second video image capture device 20 are achieved by the first video image capture device 10. Further, in Embodiment 3, there is shown a configuration in which a reflector 15 is provided in front of the camera 11 and the motion of the reflector 15 is controlled, as a configuration in which the function of the first video image capture device 10 and the function of the second video image capture device 20 are achieved by the first video image capture device 10. In this Embodiment 4, as a configuration in which the function of the first video image capture device 10 and the function of second video image capture device 20 are achieved by the first video image capture device 10, there is shown a configuration in which a wide angle camera 17 is employed as the camera 11 of the first video image capture device 10. With this wide angle camera 17, the first video image capture device is configured so that a general video image and a predetermined part in a vehicle room, which became an object of a reflection video image, can be recorded at the same time.
That is to say, the configuration of an automobile use video image recording device according to Embodiment 4 is shown as a block diagram in
By recording a video image with the wide angle camera 17 and performing graphical image processing, different graphical image data can be processed at the same time, and thereby, the processing can be performed in a shortened time, and, in addition, recording of a video image is performed always on a predetermined part in a vehicle room, which became an object of a reflection video image. Therefore, an effect will be produced that the present embodiment can follow the change of the predetermined part in a vehicle room, like in the case where the first video image capture device 10 and the second video image capture device 20 are provided with.
In Embodiment 5, by the use of a first video image capture device 10 which obtains the first graphical image data on a general video image, wherein the general video image is with a transmission video image that transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room, an automobile use video image recording device obtains a general video image and a reflection video image, with the division being maintained between the two. Further, correction is performed on the graphical image data on a general video image (the first graphical image data), so that influence of the graphical image data on a reflection video image (the third graphical image data) may be reduced. Thus, in obtaining the graphical image data on a reflection video image (the third graphical image data), the automobile use video image recording device is configured to obtain a graphical image data on a reflection video image, using the partially masked state of a general video image, by the motion of a wiper, which moves and rotates on the outside of a wind shield (the outdoor side of a vehicle).
As shown in
By the use of this first video image capture device 10, obtained are a first graphical image data on a general video image, wherein the general video image is with a transmission video image that transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room, and a graphical image data on a reflection video image (third graphical image data), wherein the reflection video image is produced by the reflection on the surface of the wind shield, when the general video image is interrupted by the wiper 60. Then, the first video image capture device 10 stores the first graphical image data and the third graphical image data in the storage device 13, with the division being maintained between the two.
Furthermore, the first video image capture device 10 is connected to a graphical image correction device 40. Based on the third graphical image data, the graphical image correction device 40 performs the correction on the first graphical image data which is taken out from the storage device 13. Then, the first graphical image data which is corrected based on the third graphical image data (the first graphical image data after the correction) is output to the graphical image output device 50, and a video image in which a reflection video image is eliminated from the general video image, can be provided as an output of the automobile use video image recording device.
Operations of the automobile use video image recording device according to Embodiment 5 follow a diagram which is shown in
At first, in the first video image capture device 10, the graphical image data on a general video image (the first graphical image data on a general video image, wherein the general video image is with a transmission video image which transmitted through a wind shield and also with a reflection video image by the wind shield, of a predetermined part in a vehicle room) is obtained with the camera 11 (Step S001). In the case where the present device is attached to, for example, a front wind shield of a vehicle, the first graphical image data which is obtained here, is on a general video image, wherein the general video image is with a video image of the scenery ahead, including an object to which attention on the contact or collision along the travelling direction of a vehicle should be paid, and also with a reflection video image in a vehicle room. The graphical image data which is obtained here (the first graphical image data) will be stored in a predetermined sector of the storage device 13.
Next, with the camera 11 of the first video image capture device 10, a reflection video image is recorded in conformity with the motion of a wiper 60, with respect to a region which is masked optically by the wiper 60 (Step S0021). The graphical image data on a video image which is recorded here is stored in a predetermined sector of the storage device 13, as a third graphical image data (Step S0032).
The third graphical image data which is to be stored in the storage device 13, is accumulated sequentially, in accordance with the motion of the wiper 60, and the whole of video images which are reflected by a wind shield can be obtained by tying them together (Step S004).
With regard to a timing for the acquisition of the graphical image data on a reflection video image (the third graphical image data), the wiper control device 18 is in charge. In the case where the wiper control device determines that it is the timing to obtain a graphical image data on a reflection video image, the wiper control device 18 gives an operation command to the wiper 60 (Step S0051).
When the wiper 60 receives an operation command, the wiper will move to a video image recording area of the camera 11 of the first video image capture device 10, according to the command, and thereby, a partial black background will be generated. After that, the wiper control device 18 issues a command to the data acquisition device 12, so as to record a reflection video image (Step S0061).
In a state where this partial black colored background is generated, the data acquisition device 12 obtains a forward part graphical image data in the partial black background generation state (first graphical image data), in other words, a forward part graphical image data which includes a part of the reflection glared graphical image (Step S0071). Then, the graphical image data on the obtained reflection video image will be stored in the storage device 13 (Step S0081).
After that, the wiper 60 moves, and the recording of a video image is carried out again. That is to say, the processing in Step S0051 to Step S0081 will be repeated, according to the change in the position of the wiper 60. This repetition will be performed until a judgment on the end of video image recording (Step S0091) is made by the wiper control device 18. The judgment on the end of video image recording is made when the partial black backgrounds which are generated by the wiper 60 cover the whole of video image capture range. That is, suppose that a plurality of recorded partial black background graphical images are clipped out and combined together. When one sheet of the whole black background graphical images which extends all over the video image capture range, in other words, when the whole of reflection video images are obtained, the wiper control device 18 judges that it is the time to end the recording of a video image.
In Embodiment 6, explanation will be made about the configuration of an automobile use graphical image recognition device, in the case where automobile use video image recording devices which are shown in Embodiments 1 to 5 are employed to utilize as the automobile use graphical image recognition device.
The object recognition device 70 is provided with reference information for making a comparative review on the shape of an object, and is the one to compare provided graphical image information with the holding reference information, and judge an object which is coincident with the provided graphical image. The automobile use video image recording device 1000 is connected to this object recognition device 70, and provides graphical image information (graphical image data), whose output information is corrected, so that influence of a reflection video image may be reduced. For the reason above, errors in graphical image recognition are decreased, and the automobile use video image recording device 1000 will be used effectively.
The vehicle control device 80 controls the motion of a vehicle, based on the recognition result by the object recognition device 70. Further, the warning device 90 is the one to issue a warning on a when needed basis, based on the recognition result by the object recognition device 70.
In more precise words, in the object recognition device 70, owned is graphical image information, on the shape of various persons, the shape of animals, the shape of vehicles, and the shape of various fixtures provided on a road. The object recognition device 70 compares the holding graphical image information (the reference information) and the graphical image information provided from the automobile use video image recording device 1000 (the graphical image data), and judges what the graphical image data, which appears in the automobile use video image recording device 1000, corresponds to. Based on the judgement result, the object recognition device 70 performs the control of a vehicle by the vehicle control device 80, or the warning by the warning device 90.
In the case where the above mentioned control of a vehicle or warning is performed based on a graphical image data, a mistaken result is brought, when a graphical image data by a reflection glare is contained in the graphical image data. In particular, mistaken guidance will be conducted, in the case where learning effect by the graphical image data is expected,
However, errors in the graphical image recognition can be prevented, by reducing the influence of a reflection video image, like in this Embodiment 6.
It is to be noted that, the automobile use video image recording devices according to Embodiments 1-5 and the automobile use graphical image device according to Embodiment 6 are conducted by a control device 500 which is constructed with a processor 510 and a storage device 520, as shown in
Although the present application is described above in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects and functionality described in one or more of the individual embodiments are not limited in their applicability to the particular embodiment with which they are described, but instead can be applied, alone or in various combinations to one or more of the embodiments.
It is therefore understood that numerous modifications which have not been exemplified can be devised without departing from the scope of the present application. For example, at least one of the constituent components may be modified, added, or eliminated. At least one of the constituent components mentioned in at least one of the preferred embodiments may be selected and combined with the constituent components mentioned in another preferred embodiment.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/032355 | 8/31/2018 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2020/044535 | 3/5/2020 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20050216144 | Baldassa | Sep 2005 | A1 |
| 20130329045 | Choi | Dec 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 102016009702 | Feb 2017 | DE |
| 2005-280526 | Oct 2005 | JP |
| 2005280526 | Oct 2005 | JP |
| 2006-086784 | Mar 2006 | JP |
| 2006086784 | Mar 2006 | JP |
| 2009-255722 | Nov 2009 | JP |
| 2013-258677 | Dec 2013 | JP |
| 5417773 | Feb 2014 | JP |
| 2016-127470 | Jul 2016 | JP |
| Entry |
|---|
| International Search Report for PCT/JP2018/032355 dated Nov. 6, 2018 (PCT/ISA/210). |
| Communication dated Nov. 10, 2021, issued by the National Intellectual Property Office of the P.R.C. in application No. 201880096858.9. |
| Communication dated Feb. 8, 2022, issued by the Japanese Patent Office in JP Patent Application No. 2020-539983. |
| Number | Date | Country | |
|---|---|---|---|
| 20210295481 A1 | Sep 2021 | US |
