Embodiments of the present disclosure relate to an image collecting system, an image collecting processing system and an image collecting processing method.
When a vehicle runs in rainy days, especially when running in a heavy rain, lots of rain water would be stay on the front windshield, which would have a serious impact on the driver's view.
Embodiments of the present disclosure provide an image collecting system, an image collecting processing system and an image collecting processing method, which reduce the amount of image information processing and improve the accuracy of image processing.
According to at least one embodiment of the present disclosure, an image collecting system is included, including: a pick-up device configured to acquire a first image and a second image of a target scene; and a polarizing device configured to be overlapped with an input path of the pick-up device corresponding to the second image when the pick-up device acquires the second image, and configured to allow first incident light for forming the first image and second incident light for forming the second image, entering the pick-up device, to have different polarization states.
According to at least one embodiment of the present disclosure, an image collecting processing system is provided, including the image collecting system, and an image processing device configured to generate a target image according to the first image and the second image.
According to at least one embodiment of the present disclosure, an image collecting processing method is provided, including: acquiring a first image of a target scene by a pick-up device; acquiring a second image of the target scene by a polarizing device and the pick-up device, in this step, the polarizing device is overlapped with an input path of the pick-up device corresponding to the second image when the pick-up device acquires the second image, to allow first incident light for forming the first image and second incident light for forming the second image, entering the pick-up device, to have different polarization states; and generating a target image according to the first image and the second image.
Brief description will be given below to the accompanying drawings of embodiments to provide a more clear understanding of the technical proposals of the embodiments of the present disclosure. It is apparent that the drawings described below only involve some embodiments of the present disclosure but are not intended to limit the present disclosure.
In order to make objects, technical solutions and advantages of the embodiments of the disclosure apparent, technical solutions according to the embodiments of the present disclosure will be described clearly and fully as below in conjunction with the accompanying drawings of embodiments of the present disclosure. It is apparent that the described embodiments are just a part but not all of the embodiments of the disclosure. Based on the described embodiments herein, those skilled in the art can obtain other embodiment(s), without any creative work, which shall be within the scope of the present disclosure.
Unless otherwise defined, all the technical and scientific terms used herein have the same meanings as commonly understood by one of ordinary skill in the art to which the present disclosure belongs. The terms, such as “first,” “second,” or the like, which are used in the description and the claims of the present disclosure, are not intended to indicate any sequence, amount or importance, but for distinguishing various components. The terms, such as “comprise/comprising,” “include/including,” or the like are intended to specify that the elements or the objects stated before these terms encompass the elements or the objects and equivalents thereof listed after these terms, but not preclude other elements or objects. The terms, such as “connect/connecting/connected,” “couple/coupling/coupled” or the like, are not limited to a physical connection or mechanical connection, but may include an electrical connection/coupling, directly or indirectly. The terms, “on,” “under,” “left,” “right” or the like are only used to indicate relative position relationship, and when the position of the object which is described is changed, the relative position relationship may be changed accordingly.
The inventor of the application has noticed in the research that for the commonly used image collecting processing system, the rain can reflect at least partial light from a target scene, so that light for forming images, which come from the target scene and is incident into the image collecting processing system, includes the light reflected by the rain, so that the information of the images acquired by the image collecting processing system can be insufficient and the accuracy is not high. Moreover, the common used image collecting processing system needs to analyze and process all the pixels in an acquired initial image to generate a target image, so that the amount of image information processing is relatively large and the processing time is relatively long.
Embodiments of the present disclosure provide an image collecting system, an image collecting processing system and an image collecting processing method. The image collecting system includes a pick-up device and a polarizing device. The pick-up device is configured to acquire a first image and a second image of a target scene. The polarizing device is disposed in an input path of the pick-up device corresponding to the second image when the pick-up device acquires the second image, so that first incident light for forming the first image and second incident light for forming the second image, entering the pick-up device, can have different polarization states.
On one hand, the embodiment of the present disclosure can remove at least partial polarized light in the light reflected by the rain by arranging the polarizing device in the image collecting system, so as to reduce the impact of rain on the light which comes from the target scene and is incident into the pick-up device. On the other hand, the embodiment of the present disclosure generates the target image according to the first image and the second image acquired by the image collecting system, and can reduce the amount of image information processing and the processing time and improve the accuracy of image processing.
At least one embodiment of the present disclosure provides an image collecting system, which respectively acquires a first image and a second image of the same target scene at the same moment or different moments by two pick-up devices.
As illustrated in
The pick-up device 130 is configured to acquire a first image and a second image of a target scene and includes a first sub-pick-up device 131 and a second sub-pick-up device 132. The first sub-pick-up device 131 is configured to acquire the first image of the target scene, and the second sub-pick-up device 132 is configured to acquire the second image of the target scene.
The polarizing device 152 is overlapped with an input path of the pick-up device corresponding to the second image 130 when the pick-up device 130 acquires the second image, namely the polarizing device 152 is overlapped with an input path of the second sub-pick-up device 132 when the second sub-pick-up device 132 acquires the second image, so that partial polarized light in light 140, which comes from the target scene and is incident into the polarizing device 152, can be removed. At this point, first incident light 110 which enters the first sub-pick-up device 131 to form the first image is non-polarized light. In this way, the polarizing device 152 allows the first incident light 110 for forming the first image and second incident light 120 for forming the second image, entering the pick-up device 130, to have different polarization states.
The pick-up device 152 may adopt an imaging sensor, such as charge-coupled device (CCD) and complementary metal oxide semiconductor (CMOS).
For instance, the polarizing device may adopt an absorptive-type polarizer, such as wire grating polarizer, a multi-layer polarizer, such as pile of plates (a stacked structure of a plurality of glass plates), or a polarizing prism, such as a Nicol prism.
For instance, as illustrated in
In an embodiment of the present disclosure, for instance, the light-splitting device may adopt a light-splitting device, such as a beam splitter, and a transflective mirror.
Continuously refer to
For instance, the support substrate 160 may be any substrate with supporting capacity, such as a plastic substrate, a glass substrate and a wood substrate.
For instance, as illustrated in
For instance, a support including a vertical portion 162 and a horizontal portion 163 may be disposed on the support substrate 160. The vertical portion 162 is configured to support the horizontal portion 163. The horizontal portion 163 may be configured to support a sub-pick-up device away from the support surface 161 (for instance, as shown by the first sub-pick-up device 131 in
The first sub-pick-up device 131 may be disposed on a side of the second sub-pick-up device 132 away from the support substrate 160, as shown in
For instance, as shown in
For instance, the polarization direction of the second polarizing device 151 may be perpendicular to the polarization direction of the polarizing device 152. In this way, the impact of rain on the accuracy of the target image can be reduced to a greater extent.
For instance, the transmittance of the second polarizing device 151 and the polarizing device 152 may be same. In this way, the step of adjusting the brightness of the first image and the second image can be saved in the process of generating the target image by utilizing the first image and the second image.
For instance, as illustrated in
For instance, as illustrated in
For instance, as illustrated in
For instance, by adoption of the polarization switching device 170, the accuracy of the target image can be improved by not using the polarizing device on non-rainy days and using the polarizing device on rainy days.
For instance, as for any example as shown in
For instance, as illustrated in
In the example as shown in
For instance, the first sub-pick-up device and the second sub-pick-up device may have same specification, so that the difference between the first sub-pick-up device and the second sub-pick-up device can be reduced, and the accuracy of generating the target image according to the first image and the second image can be improved.
For instance, an image collecting system provided by at least one embodiment of the present disclosure may acquire the first image and the second image at different moments by the same pick-up device, so as to avoid the parallax generated between the first image and the second image.
As illustrated in
For instance, as illustrated in
For instance, the polarizing device 152 may also change the polarization direction through the rotating device 180 as shown in
The polarization direction, or the like of the polarizing device 152 may refer to the design modes in any foregoing embodiment. No further description will be given to the same details herein.
At least one embodiment of the present disclosure provides an image collecting processing system. As illustrated in
The image processing device is configured to generate a target image according to a first image and a second image acquired by the image collecting system 100. For instance, it may be implemented by a computing device (e.g., a central processing unit (CPU)), a special computing device (e.g., a digital signal processor (DSP)), or the like. No further description will be given herein.
The image collecting system 100 and the image processing device may adopt any type of wired or wireless connection, as long as the first image and the second image acquired by the image collecting system 100 can be sent to the image processing device.
For instance, an image collecting processing system provided by at least one embodiment of the present disclosure may further include a display device, which, as shown in
The image collecting systems and the image collecting processing devices in the embodiments of the present disclosure may be applied in the automotive field, so as to reduce the impact of rain on the images acquired by the image collecting system on rainy days.
At least one embodiment of the present disclosure provides an image collecting processing method. As illustrated in
S41: acquiring a first image of a target scene by a pick-up device.
S42: acquiring a second image of the target scene by a polarizing device and the pick-up device. In the step, the polarizing device is overlapped with an input path of the pick-up device corresponding to the second image when the pick-up device acquires the second image, and configured to allow first incident light for forming the first image and second incident light for forming the second image, entering the pick-up device, to have different polarization states.
For instance, the image collecting system including the first sub-pick-up device and the second sub-pick-up device, provided by any foregoing embodiment, may be adopted to acquire the first image and the second image. That is to say, as illustrated in FIG. 1, the pick-up device 130 may include a first sub-pick-up device 131 and a second sub-pick-up device 132. In this case, the step S41 may include acquiring the first image of the target scene by the first sub-pick-up device 13; and the step S42 may include acquiring the second image of the target scene by the second sub-pick-up device 132. When the second sub-pick-up device 132 acquires the second image, the polarizing device 152 is overlapped with an input path of the second sub-pick-up device 132.
For instance, the steps S41 and S42 may be synchronously executed, namely the first sub-pick-up device 131 and the second sub-pick-up device 132 may pick up a target scene at a same moment to acquire a first image and a second image. Alternatively, the steps S41 and S42 may also be respectively executed at different moments, and the sequence may be exchanged.
For instance, in the step S41, the second polarizing device 151 and the first sub-pick-up device 131 as shown in
For instance, the image collecting system including one pick-up device, provided by any foregoing embodiment, may also be adopted to acquire the first image and the second image. That is to say, the step S41 may include adopting the pick-up device 130 as shown in
In the method provided by the embodiments of the present disclosure, other designs of the polarizing device and the pick-up device may refer to relevant description in the above embodiments. No further description will be given herein.
After the steps S41 and S42 are finished, the step S43, namely generating the target image according to the first image and the second image, is executed.
In the step S43, the first image and the second image may be compared to obtain the target image. Compared with the way of the image collecting processing system commonly used in the field of obtaining the target image after acquiring the initial image and analyzing and processing the initial image, this way of obtaining the target image by the comparison may more accurately identify what positions of the first image and the second image have more real information and what positions of the information are required to be processed, so that the accuracy of image processing can be improved and the amount of image information processing and the processing time can be reduced.
For instance, the target image may be generated by comparing image information of corresponding pixels in the first image and the second image. In this case, the step S42 may include determining a first pixel in the first image and a second pixel in the second image, which represent a same object point of the target scene, and comparing image information of the first pixel in the first image with image information of the second pixel in the second image; and generating the target image by utilizing the second pixel in the second image when the comparison result is that the difference between the image information of the first pixel in the first image and the image information of the second pixel in the second image is less than or equal to a first threshold or greater than a second threshold.
Description will be given below by taking the case that the first image and the second image are respectively represented by an array X and an array Y as an example,
where A11, . . . , AMN in the array X represent position information and image information of pixels in the first image; B11, . . . , BMN in the array Y represent position information and image information of pixels in the second image; an array Z may be obtained by calculating X-Y; and the value of a number Zij=Xij−Yij (i refers to an integer from 1 to M, and j refers to an integer from 1 to N) in the array Z may be as follows: the first type of value is that an absolute value of Zij is within the range [0, β]; Pt the second type of value is that the absolute value of Zij is within the range [β, θ]; and the third type of value is that the absolute value of Zij is (θ, ∞), and 0<β<0.
The first type of value, namely the absolute of Zij is within the range [0, β], indicates that the difference between Aij of the first image and Bij of the second image is very small. The reason may be that there is no rain water at an object point of the target scene corresponding to Bij of the second image, and may also be that the polarizing device cannot eliminate the impact of rain due to too much rain water at the object point. Therefore, in this case, the target image may be generated by adopting the position information and the image information of Bij. That is to say, when the difference between the first pixel and the second pixel is less than or equal to the first threshold β, the target image may be generated by utilizing the second pixel of the second image. It is noted that one or more numbers in the array X may be adopted to indicate the first pixel, and the second pixel in the second image may also be set similarly.
The third type of value, namely the absolute value of Zij is (θ, ∞) and 0<β<θ, indicates that the difference between the first image and the second image is very large. It indicates that the polarizing device can reduce the impact of rain. Therefore, in this case, the target image may be generated by adopting the position information and the image information of Bij. That is to say, when the difference between the first pixel and the second pixel is greater than the second threshold θ, the target image may be generated by adopting the second pixel of the second image.
As for the second type of value between the first type of value and the third type of value, a common way in the field may be adopted to process information of positions provided with the second type of values and fill the information at corresponding positions of the target image.
The first threshold and the second threshold may be set according to actual demands.
The analyzing and processing ways of the first type of value and the third type of value may be simplified by the comparison of the first image and the second image. Compared with the way of analyzing and processing all data of the images in a commonly used image collecting processing system, the amount of information processing and the processing time can be reduced.
For instance, in order to improve the accuracy of the target image, an image collecting processing method provided by at least one embodiment of the present disclosure may also include: before step S43, adjusting the brightness of the second image according to the transmittance of the polarizing device and the initial brightness of the second image (namely the brightness of the second image directly acquired by the pick-up device). For instance, the initial brightness of the second image may be divided by the transmittance of the polarizing device, so that the brightness of the first image and the second image can be restored to the same level.
When the image collecting system as shown in
For instance, the image collecting system including the first sub-pick-up device and the second sub-pick-up device, provided by any foregoing embodiment, is adopted to acquire the first image and the second image; and an image collecting processing method provided by at least one embodiment of the present disclosure may also include: before the step S43, processing at least one of the first image or the second image, so that no parallax is presented between the first image and the second image. For instance, positions of the numbers in the array X may be translated, so that the position information of the numbers in the array X can be consistent with the position information of the numbers in the array Y. In this way, misjudgment caused by the parallax of two pick-up devices can be reduced. The parallax between the first image and the second image may be eliminated by an image parallax processing method commonly used in the field. No further description will be given herein.
The image collecting processing method provided by the embodiments of the present disclosure can be applied in the image collecting processing system provided by any foregoing embodiment. The image collecting processing method provided by the embodiments of the present disclosure may reduce the impact of rain water on the target image by adopting the polarizing device, generate the target image by the comparison of the first image and the second image, and reduce the amount of information processing and the processing time of the first image and the second image and improve the accuracy of image processing.
Description is given to the image collecting system, the image processing system and the image collecting processing method, provided by embodiments of the present disclosure, by taking two images (namely the first image and the second image) of the same target scene as an example. More images (e.g., a third image, a fourth image, or the like) may also be acquired by utilizing the embodiments of the present disclosure, so that a plurality of target images can be acquired.
The foregoing is only the exemplary embodiments of the present disclosure and not intended to limit the scope of the present disclosure. The scope of the present disclosure is defined by the appended claims.
The present application claims priority to the Chinese patent application No. 201610082147.9 filed on Feb. 5, 2016, the entire disclosure of which is incorporated herein by reference as part of the present application.
Number | Date | Country | Kind |
---|---|---|---|
2016 1 0082147 | Feb 2016 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2016/082721 | 5/20/2016 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2017/133138 | 8/10/2017 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5543917 | Bushman | Aug 1996 | A |
9494804 | Zuo | Nov 2016 | B2 |
9562764 | France | Feb 2017 | B2 |
20100157082 | Katerberg | Jun 2010 | A1 |
20100283883 | Sato | Nov 2010 | A1 |
20130136306 | Li et al. | May 2013 | A1 |
20150172631 | Kasahara | Jun 2015 | A1 |
20150256733 | Kanamori | Sep 2015 | A1 |
20160062121 | Border | Mar 2016 | A1 |
Number | Date | Country |
---|---|---|
102075679 | May 2011 | CN |
102450023 | May 2012 | CN |
103080978 | May 2013 | CN |
104487803 | Apr 2015 | CN |
104954656 | Sep 2015 | CN |
204967991 | Jan 2016 | CN |
105530419 | Apr 2016 | CN |
2010-004090 | Jan 2010 | JP |
2011049149 | Apr 2011 | WO |
Entry |
---|
The First Chinese Office Action dated Dec. 28, 2017; Appln. No. 201610082147.9. |
International Search Report and Written Opinion dated Oct. 28, 2016; PCT/CN2016/082721. |
The Chinese Second Office Action dated Sep. 30, 2018, Appln. No. 201610082147.9. |
Number | Date | Country | |
---|---|---|---|
20180234602 A1 | Aug 2018 | US |