The present invention relates to a device designed for detecting a soiling of at least one transmitting window and/or one receiving window of a sensor.
To protect against soiling due to dust or water, for example, the transmitting and/or receiving windows of surroundings sensors, such as LIDAR sensors or cameras are protected toward the outside by transparent covers. However, the soiling may also settle on the covers, whereby the optical path of the sensor may be impaired.
To detect a soiling on a windshield of a vehicle, PCT Application No. WO 2014/005585A1 describes, for example, to detect the state of a pane with the aid of a “surround” camera.
It is an object of the present invention to develop a simplified device for detecting a soiling of a transparent cover of at least one transmitting window and/or one receiving window of an optical sensor.
In accordance with an example embodiment of the present invention, a device for detecting a soiling of a transparent cover of at least one transmitting window and/or one receiving window of an optical sensor is provided. The optical sensor is, in particular, an optical surroundings sensor of a vehicle. The example device includes at least one hologram structure, which in this connection is designed to at least partially deflect light beams which are incident through the transparent cover in the direction of an image sensor. The light beams are, in particular, incident from outside surroundings of the device through the transparent cover. As an alternative, the hologram structure is designed to at least partially deflect light beams which are reflected by an inner side of the transparent cover in the direction of the image sensor. The inner side in this context refers to the side of the transparent cover which is directed in the direction of the hologram structure and the image sensor. In both instances, the image sensor of the device is designed to detect an image signal as a function of the deflected light beams reaching the image sensor. The device furthermore includes a processing unit, which is designed to detect a soiling of the transparent cover as a function of the at least one detected image signal.
The processing unit is preferably designed to ascertain a mapping of a surface of the transparent cover as a function of the at least one detected image signal. The mapping may, for example, represent a complete mapping of the surface of the inner side or of the outer side of the transparent cover in the process. The processing unit may, in turn, detect a soiling of the transparent cover as a function of the ascertained mapping in the process. The mapping may, in particular, be designed as a color map. In this case, the soiling of the surface may, in particular, be realistically represented in the appropriate color.
The at least one hologram structure is preferably designed as a volume hologram. A volume hologram is characterized in that light beams reaching the volume hologram are not refracted, but diffracted. Only light beams having a certain wavelength and/or a certain incidence angle on the volume hologram are diffracted in the direction of the image sensor. The volume hologram is transparent to light beams having a wavelength different therefrom and/or a different incidence angle, and the light beams are able to pass through the volume hologram without deflection. The diffraction characteristic of such a volume hologram as a holographic optical element (HOE) is defined during the recording of the HOE by the angles of incidence and/or wavelengths used there. The diffraction characteristic of the volume hologram may thus be set, for example, in such a way that the optical function of the optical sensor is not impaired. In the case of a LIDAR sensor, the volume hologram may, for example, be designed to be transparent to infrared beams emitted and/or received by the LIDAR sensor, and to thus not diffract them. The infrared beams may pass through the volume hologram without impairment, and the optical sensor may continue to carry out its optical function. The volume hologram preferably includes a volume grating. These holographic diffraction gratings are exposed in a film and may be designed as reflection gratings or as transmission gratings. In the case of the transmission volume grating, the volume grating is designed to transmit the light beams incident through the transparent cover or the beams reflected by the inner side of the transparent cover. This means that the light beams which are diffracted in the direction of the image sensor are transmitted through the transmission hologram. In the case of the reflection volume grating, the volume grating is designed to reflect the light beams incident through the transparent cover, or the light beams reflected by the inner side of the transparent cover, in the direction of the image sensor as a function of the wavelength of the incident light beams and/or the incidence angle of the incident light beams.
The image sensor is preferably designed as a CCD image sensor. Such a CCD image sensor includes a matrix made up of a multitude of light-sensitive photodiodes, which are also referred to as pixels. Depending on the illumination of such a pixel, an image point is generated on a mapping. Each pixel is assigned a defined area of the transparent cover to be mapped in the process. The at least one hologram structure is designed to deflect the light beams incident in the defined areas of the transparent cover to be mapped onto the pixels of the CCD image sensor which are assigned to the respective defined area. As an alternative, the hologram structure is designed to deflect the light beams reflected at the defined areas of the inner side of the transparent cover onto the assigned pixel of the CCD image sensor. In this way the option exists to generate a mapping of the transparent cover. As a result of the generated mapping, a possible soiling on the transparent cover may be localized. The CCD image sensor preferably includes a multitude of red, green and blue. This means, for example, that only visible light which corresponds to a wavelength of the color red reaches a red pixel. In this way, a color map of the transparent cover may be generated. Furthermore, the CCD image sensor may preferably additionally include a multitude of infrared pixels. In this way, simultaneously the option exists to also detect the infrared component of the light.
The at least one hologram structure is preferably designed as a layer including multiple superimposed holograms. Each of the multiple holograms is designed in the process to differently diffract the light beams incident through the transparent cover, or the light beams reflected by the inner side of the transparent cover, in each case in the direction of the image sensor as a function of the wavelength of the light beams and/or the incidence angle of the light beams. This method of superimposing multiple holograms in one layer, which is also referred to as holographic multiplexing, for example, results in the option of assigning a certain pixel of the image sensor to a defined area of the transparent cover. The resolution of the resulting mapping is determined by the number of the superimposed holograms and the pixels of the image sensor. As an alternative, the at least one hologram structure is formed from multiple consecutively situated holograms. The hologram structure is made up of a stack of multiple individual hologram layers. The individual holograms are designed in the process to diffract the light beams incident through the transparent cover, or the light beams reflected by the inner side of the transparent cover, differently in each case in the direction of the image sensor as a function of the wavelength of the light beams and/or the incidence angle of the light beams. This also results in the option, for example, to assign a certain pixel of the image sensor to a defined area of the transparent cover. The resolution of the resulting mapping is determined by the number of the holograms in the stack and the pixels of the image sensor.
The device preferably additionally includes at least one first illumination unit, which is designed to illuminate the inner side of the transparent cover. The illumination is carried out in such a way that the light beams emitted by the first illumination unit are reflected at the inner side of the transparent cover in the event of soiling of the transparent cover. In this connection, the at least one hologram structure is designed to at least partially deflect the light beams emitted by the first illumination unit and reflected at the inner side of the transparent cover in the direction of the image sensor. The image sensor is, in turn, designed to detect an image signal, and the processing unit identifies a soiling of the transparent cover as a function of the detected image signal.
The device preferably includes at least one second illumination unit, which is designed to illuminate an outer side of the transparent cover in such a way that the light beams emitted by the second illumination unit are reflected at the outer side in the event of soiling of the transparent cover. The outer side of the transparent cover in this connection refers to the side of the transparent cover which is directed away from the direction of the at least hologram structure and the image sensor. In this connection, the at least one hologram structure is designed to at least partially deflect the light beams emitted by the second illumination unit and incident through the outer side of the transparent cover in the direction of the image sensor. The image sensor is, in turn, designed to detect an image signal, and the processing unit identifies a soiling of the transparent cover as a function of the detected image signal.
The device preferably includes at least one third illumination unit, which is designed to illuminate the transparent cover laterally from above or from below in such a way that the light beams emitted by the third illumination unit are deflected in the direction of the hologram structure in the event of soiling of the transparent cover. The at least one hologram structure is designed to at least partially deflect the light beams emitted by the third illumination unit and deflected in the direction of the hologram structure in the direction of the image sensor. The image sensor is, in turn, designed to detect an image signal, and the processing unit identifies a soiling of the transparent cover as a function of the detected image signal. The device preferably additionally includes at least one fourth illumination unit, which is also designed to illuminate the transparent cover laterally from above or from below in such a way that the light beams emitted by the third illumination unit are deflected in the direction of the hologram structure in the event of soiling of the transparent cover. The fourth illumination unit is situated opposite the third illumination unit, whereby each of the two illumination units thus radiate in the direction of the other illumination unit.
Illumination units such as the above-described first, second, third or fourth illumination units offer the advantage that a uniform illumination of the transparent cover may be generated, which, in turn, is advantageous for the comparability of the deflected, detected light beams and the image signal resulting therefrom. A further advantage of the external illumination is that a soiling of the transparent cover may be detected both during the day and at night. The first, second, third and/or fourth illumination unit(s) may be designed as LEDs, for example.
In accordance with an example embodiment of the present invention, an optical sensor, which includes the above-described device for detecting a soiling of a transparent cover of at least one transmitting window and/or one receiving window of an optical sensor, in provided. The optical sensor, which may, in particular, be designed as an optical surroundings sensor of a vehicle, additionally includes a housing including at least one transmitting window and/or at least one receiving window of the sensor. The transmitting window and/or the receiving window refers to the section of the housing which is designed to allow generated sensor radiation or a received signal for the sensor to pass through. The optical sensor furthermore includes a transparent cover, which is designed to cover the at least one transmitting window and/or the at least one receiving window of the optical sensor with respect to exterior surroundings of the optical sensor. At least one hologram structure of the device according to the present invention is situated inside the housing in such a way that light beams incident through the transparent cover, or light beams reflected by an inner side of the transparent cover, are at least partially deflected in the direction of an image sensor which is also situated inside the housing. The image sensor is, in turn, designed to detect at least one image signal as a function of the deflected light beams. A processing unit identifies a soiling of the transparent cover as a function of the detected image signal. The processing unit is preferably designed to ascertain a mapping of a surface of the transparent cover as a function of the at least one detected image signal, and to identify a soiling of the transparent cover as a function of the ascertained mapping. The optical sensor is preferably a LIDAR sensor. Such LIDAR sensors may be designed as scanning or as rotating LIDAR sensors and include a transparent cover, which protects the optical sensor against the ingress of water into the housing, for example.
The hologram structure is preferably situated on a curved outer side of a receiving lens system of the LIDAR sensor as an optical sensor. The material of which the hologram structure is made may be applied in the liquid state onto the curved outer side of the receiving lens system in the process. Thereafter, the hologram structure is exposed and then cured. As an alternative, the hologram structure may also be designed as a film and be situated on the outer side of the receiving lens system. The film has, in particular, a thickness of approximately 100 μm. To protect against the surroundings and for improved handling, the applied hologram structure is, for example, covered by a protective layer made up of polycarbonate or polyamide. Situating the hologram structure on the outer side of the receiving lens system offers the option of using the image sensor of the LIDAR sensor also as an image sensor for the device according to the present invention. The pixels on the image sensor are preferably distributed in such a way that the function of the surroundings detection by the LIDAR sensor is not limited by the additional detection of the soiling of the transparent cover. For this purpose, for example, comparatively more infrared pixels may be situated on the image sensor than red, green and blue, or also alternatively monochrome, pixels. The optical filter function required for this purpose may, for example, be implemented with a holographic cascade filter, which is implemented from a specific angular or multi-stage arrangement of reflection or transmission holograms. In accordance with an example embodiment of the present invention, a method is provided for detecting a soiling of a transparent cover of at least one transmitting window and/or one receiving window of an optical sensor. The example method is carried out with the aid of the above-described device according to the present invention.
Device 110a includes a hologram structure 100a in the process, which is designed as a holographic optical element (HOE), for example. Device 110a additionally includes an image sensor 120a and a processing unit 130. In this first specific embodiment, device 110a additionally includes a third illumination unit 70a, which illuminates the transparent cover laterally from below in such a way that the light beams are reflected and deflected in the direction of hologram structure 100a in the event of soiling 51, 51b and 51c. Moreover, a fourth illumination unit 70b is provided, which illuminates the transparent cover laterally from above in such a way that the light beams are reflected and deflected in the direction of hologram structure 100a in the event of soiling 51, 51b and 51c. Hologram structure 100a, in turn, is used to deflect the reflected beams 71a, 71b, 72a, 72b, 73a and 73b in the direction of image sensor 120a.
In this first specific embodiment, image sensor 120a is designed as an image sensor including a multitude of pixels 121, 122 and 123. Each pixel 121, 122 and 123 is assigned a defined area 52a, 52b or 53c of transparent cover 50. In this case, for example, pixel 121 is assigned area 52a of transparent cover 50. Hologram structure 100a deflects the reflected light beams 71a, 71b, 72a, 73a and 73b in such a way that the deflected light beams 71c, 72c, 73c, 75c, 76c and 77c incident on pixel 121, 122 or 123 assigned to the respective area 52a, 52b or 53c. For this purpose, hologram structure 100a may, for example, be formed from multiple consecutively situated holograms. The individual holograms are each differently designed and deflect reflected light beams 71a, 71b, 72a, 72b, 73a and 73b in the direction of the respective pixel 121, 122 or 123 as a function of the wavelength of light beams 71a, 71b, 72a, 73a and 73b and/or the incidence angle of light beams 71a, 71b, 72a, 72b, 73a and 73b. As an alternative, multiple optical functions may be stored by holographic multiplexing in a layer of hologram structure 100a, and light beams 71c, 72c, 73c, 75c, 76c and 77c may thus be deflected onto corresponding pixel 121, 122 or 123.
In this case, hologram structure 100a is designed as a volume hologram, which is designed to reflect the reflected light beams 71a, 71b, 72a, 72b, 73a and 73b in the direction of the image sensor. The volume hologram is transparent to light beams 78 which have a different wavelength and/or a different incidence angle compared to light beams 71a, 71b, 72a, 72b, 73a and 73b, and light beams 78 may pass through the volume hologram without deflection.
Device 110a additionally includes a processing unit 130, which is designed to detect a soiling 51a, 51b or 51c of transparent cover 50 as a function of the at least one detected image signal. In this first specific embodiment of device 110a, processing unit 130 is designed to ascertain a mapping of a surface of transparent cover 50. With the aid of image sensor 120, which is designed as a CCD image sensor, for example, processing unit 130 receives image signals, from which a monochrome or even a color map of the surface of transparent cover 50 may be generated. For example, white dots on the generated mapping may indicate a soiling 51, 51b and 51c.
In contrast to the first specific embodiment in
This holographic cascade filter 140 serves as a filter unit for light beams which do not have a defined wavelength range and/or entrance angle range. First hologram 100a is designed as a transmission hologram and is used to deflect incident light which has the defined wavelength range and/or entrance angle range in the direction of a downstream second hologram 100e. Incident light beams 116a which are not situated within the defined wavelength range and/or entrance angle range may pass through first hologram 100d linearly without deflection.
Second hologram 100e is designed as a reflection hologram and is also designed to reflect only incident light beams 116b which have a defined wavelength range and/or a defined entrance angle range onto a downstream third reflection hologram 100f. In this way, incrementally more and more light beams which do not correspond to a defined wavelength range and/or a defined entrance angle range are filtered out.
In this first specific embodiment, holographic cascade filter 140 is designed in a curved shape and, after multiple reflections and corresponding filtering at one of reflection holograms 100e, 100f, 100g and 100g, a light beam 116f falls on hologram 100i designed as a transmission hologram. Transmission hologram 100i is designed to diffract only light beams having a certain wavelength and/or a certain incidence angle and to deflect them onto pixel 125a. The wavelength may correspond to the wavelength of the color red, for example, whereby the generation of a monochrome color map is made possible.
In contrast to
In this second specific embodiment of a holographic cascade filter 140b in accordance with the present invention, a further reflection hologram 106a is connected upstream from each of the two transmission holograms 106b and 107b, which filters undesirable signals, such as interfering signals, out of the optical path. The two subsequent transmission holograms 106b and 107b are designed to diffract light beams 127b or 137b having a wavelength range and/or an entrance angle range different from one another and to reflect them in the direction of the following reflection hologram 106b or 107c. Thereafter, as in
In a method step 220 following method step 210, a mapping of a surface of the transparent cover is optionally generated as a function of the at least one detected image signal. In a subsequent method step 230, it is checked whether a soiling of the transparent cover is apparent on the generated mapping. If a soiling of the surface on the transparent cover is apparent, the method is continued with method step 240. However, if no soiling is apparent, the method is restarted or optionally ended.
Number | Date | Country | Kind |
---|---|---|---|
102018209020.3 | Jun 2018 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/064267 | 6/3/2019 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2019/233917 | 12/12/2019 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6307198 | Asakura | Oct 2001 | B1 |
20080212151 | Wolf et al. | Sep 2008 | A1 |
20150293498 | Picart | Oct 2015 | A1 |
20160041525 | Utsugi | Feb 2016 | A1 |
Number | Date | Country |
---|---|---|
19512864 | Aug 1996 | DE |
19530289 | Feb 1997 | DE |
19701258 | Jul 1997 | DE |
10049401 | Apr 2002 | DE |
10229239 | Jan 2004 | DE |
10314704 | Oct 2004 | DE |
102005062785 | Jul 2007 | DE |
102010028347 | Nov 2011 | DE |
102013210887 | Dec 2014 | DE |
0736426 | Oct 1996 | EP |
0999104 | May 2000 | EP |
2014005585 | Jan 2014 | WO |
2019141644 | Jul 2019 | WO |
Entry |
---|
International Search Report for PCT/EP2019/064267, dated Sep. 25, 2019. |
Number | Date | Country | |
---|---|---|---|
20210067769 A1 | Mar 2021 | US |