The invention relates to a method for capturing at least particle compositions in a monitoring region of a vehicle that exhibit a temporally dynamic behaviour with an optical detection apparatus of the vehicle, wherein, in the method, during at least one measurement,
The invention furthermore relates to an optical detection apparatus for capturing at least dynamic particle compositions in a monitoring region,
DE 10 2009 028 578 A1 discloses a method for vicinity capturing using at least one LiDAR sensor system, in which a capturing region of the vicinity is scanned with a scanning beam and radiation reflected at objects in the vicinity is captured and evaluated. The intensity of the backscattered radiation of a scanning beam is captured as a function of the distance (intensity curve). Furthermore, a threshold value for the amplitude of the intensity curve is prescribed. A disturbance in the propagation conditions is concluded if the prescribed threshold value is exceeded at least over a prescribed distance interval. In the case of corresponding weather conditions, such as wetness on the road, it is likely that the disturbance is caused by a cloud of spray that has been swirled up by a moving object.
It is the object of the invention to design a method and a detection apparatus of the type mentioned in the introductory part, with which a determination of particle compositions captured in the monitoring region of the detection apparatus can be improved.
This object is achieved with the method according to the invention in that
According to the invention, the temporal development of the particle target density in at least one partial volume of the monitoring region is considered. From the temporal development of the particle target density, a conclusion is drawn as to whether the captured particles belong to a particle composition having a temporally dynamic behaviour or a temporally uniform behaviour.
For particle compositions having a temporally uniform behaviour, the particle target density between the measurements changes slightly or not at all. For particle compositions having a temporally dynamic behaviour, a clear change in the particle target density is capturable between the measurements. When assessing whether the behaviour is a temporally dynamic behaviour or a temporally uniform behaviour, corresponding tolerances with respect to the particle target densities can be taken into account, where this is appropriate.
For the at least one partial volume, a particle target density difference of the particle target densities existing there or variables characterizing them can be advantageously ascertained during the at least two measurements. If the particle target density lies below a prescribed or prescribable limit, for which a corresponding tolerance can have been taken into account, it is possible to conclude that the particle reflection signals from the at least one partial volume are caused by the reflection of the transmission signals at dynamic particle compositions. If this is not the case, it is possible to conclude that the particle reflection signals are caused by the reflection of the transmission signals at particle compositions having a temporally uniform behaviour.
The particle compositions that are ascertainable with the invention may be precipitation, in particular rain, snow, sleet, hail or the like, or spray, fog, smoke, smog or the like. Extensive investigations carried out along the way to the invention have found that the particle target density in the case of spray, fog, smoke or smog has a temporally dynamic behaviour. Spray, fog, smoke and smog are thus dynamic particle compositions within the meaning of the invention. In contrast, the particle target density in the case of precipitation, in particular rain, snow, hail, sleet or the like, has a temporally uniform behaviour. Precipitation, in particular rain, snow, hail, sleet or the like, within the meaning of the invention is thus a particle composition having a temporally uniform behaviour.
Spray is water that is swirled up from the ground. The water can be swirled up in particular by vehicles and/or strong wind.
A particle target is a point on the surface of a particle at which optical transmission signals can be reflected and transmitted back in the form of particle reflection signals. A particle can have one or more such particle targets.
Advantageously, the detection apparatus can also be used to capture objects in the monitoring region. The objects can be in particular vehicles, people, animals, obstacles, potholes, roadway boundaries, such as crash barriers, or the like. To capture the objects, transmission signals that are reflected at object targets can be captured in the form of object reflection signals. Using corresponding means, it is possible to ascertain from the object reflection signals object information, in particular the direction, distance and/or speed of an object relative to the detection apparatus and/or properties of the object. An object target is a point on the surface of an object at which optical transmission signals can be reflected and transmitted back in the form of object reflection signals. An object can have one or more object targets.
Advantageously, the optical detection apparatus can operate according to a time-of-flight method, in particular a light pulse time-of-flight method. Optical detection apparatuses operating in accordance with the light pulse time-of-flight method can be embodied and referred to as time-of-flight (TOF) systems, light detection and ranging (LiDAR) systems, laser detection and ranging (LaDAR) systems or the like. Here, a time of flight from transmission of a transmission signal, in particular a light pulse, using at least one transmitter and the receipt of the corresponding reflected transmission signal, that is to say the reflection signal, using at least one receiver is measured, and a distance between the detection apparatus and a particle target or an object target is ascertained therefrom.
Advantageously, the optical detection apparatus can be designed as a scanning system. In this context, a monitoring region can be scanned with transmission signals. For this purpose, the corresponding transmission signals can be panned over the monitoring region with respect to their propagation direction. In this case, at least one deflection device, in particular a scanning device, a deflection mirror device or the like, can be used.
Advantageously, the optical detection apparatus can be designed as a laser-based distance measurement system. The laser-based distance measurement system can have, as the light source of at least one transmitter, at least one laser, in particular a diode laser. The at least one laser can be used to transmit in particular pulsed transmission signals. The laser can be used to emit transmission signals in frequency ranges that are visible or not visible to the human eye. Accordingly, at least one receiver can have a detector designed for the frequency of the transmitted light, in particular an (avalanche) photodiode, a diode array, a CCD array or the like. The laser-based distance measurement system can advantageously be a laser scanner. A laser scanner can be used to scan a monitoring region with an in particular pulsed laser beam.
The invention is used in a vehicle, in particular a motor vehicle. The invention can advantageously be used in a land-based vehicle, in particular a passenger vehicle, a lorry, a bus, a motorcycle or the like, an aircraft and/or a watercraft. The invention can also be used in vehicles that can be operated autonomously or at least partially autonomously.
The detection apparatus can advantageously be connected to at least one electronic control device of a vehicle, in particular a driver assistance system and/or a chassis control system and/or a driver information device and/or a parking assistance system and/or a gesture recognition or the like or can be part of such a device, system or apparatus. In this way, at least partially autonomous operation of the vehicle can be made possible.
Knowledge of the condition of the road is useful in particular in the case of vehicles so as to influence the driving behaviour in particular with the aid of a driver assistance system. For example, a wet or slippery road will significantly increase the expected braking distance. In order to be able to better assess the condition of the road, it is helpful to be able to better identify the particle composition captured using the detection apparatus. In particular, an estimation relating to the spray due to vehicles driving in front and/or the estimation relating to current quantities of precipitation can be used to assess the driving environment, in particular the condition of the road. The invention can be used to better differentiate the particle compositions. In particular spray can thus be distinguished from precipitation. Overall, driving safety can thus be improved.
If in an advantageous configuration of the method the particle target densities ascertained during the at least two measurements or variables characterizing them possibly correspond to one another within a prescribable or prescribed tolerance, it is possible to conclude that the particle reflection signals are caused by the reflection of the transmission signals at particle compositions having a temporally uniform behaviour. In this way, in particular spray can be distinguished from precipitation, in particular rain, snow, hail or sleet.
In a further advantageous configuration of the method, it is possible for ascertaining the particle target densities or variables characterizing them to normalize a number of particles captured during the measurements with respect to a prescribed partial volume of the monitoring region. The normalized particle target densities or the variables characterizing them from the measurements can thus be directly compared with one another.
In a further advantageous configuration of the method, at least one portion of the monitoring region can be divided into prescribed partial volumes and the particle target densities or variables characterizing them can be ascertained in each case separately for the partial volumes. In this way, a corresponding portion of the monitoring region can be checked in a spatially resolved manner for corresponding particle compositions. In this case, different particle compositions can be captured in each case in the partial volumes. For example, it is possible that mainly precipitation, which generates temporally uniform particle target densities, is captured in a partial volume. It is possible that in a different partial volume mainly spray is captured, which generates temporally dynamic particle target densities.
In a further advantageous configuration of the method, at least one portion of the monitoring region can be assigned to a virtual grid, wherein the grid cells of the grid represent partial volumes of the monitoring region. In this way, a reproducible spatial assignment can be realized. The monitoring region can be assigned to the corresponding grids according to a classification of the reflection signals.
The virtual grid can advantageously be given as a surface grid or as a spatial grid. The virtual grid can advantageously be based on a Cartesian coordinate system, a polar coordinate system or another type of coordinate system.
In a further advantageous configuration of the method, the reflection signals from the monitoring region can be classified at least as particle reflection signals and as object reflection signals, which are caused by objects in the monitoring region. In this way, objects can be distinguished from particles. It is thus possible to ascertain the portion of the monitoring region in which objects are present.
In a further advantageous configuration of the method, a particle target density or variable characterizing the latter can be ascertained for at least one partial volume of the monitoring region located in a free space of the monitoring region from which no object reflection signals are captured that are caused by reflections of optical transmission signals at objects. The viewing range of the detection apparatus in the free space of the monitoring region is not limited by any objects. Said free space is in expert circles also referred to as “visible space”.
Advantageously, the checking of the particle target density can be limited to distances of approximately between 2 m and 20 m from the detection apparatus. In this way, the amount of data can be reduced and the processing time can thus be shortened.
In a further advantageous configuration of the method, the monitoring region can be scanned with the transmission signals during the at least one measurement. In this way, the monitoring region can be checked in a spatially resolved manner for particles and/or objects.
In a further advantageous configuration of the method, particle reflection signals and possibly object reflection signals can be received and converted into corresponding electrical signals that can be further processed accordingly. In this way, the optical reflection signals can be electrically evaluated after their conversion into electrical signals in particular with the aid of electronic and/or electrical components.
In a further advantageous configuration of the method,
Furthermore, the object is achieved according to the invention in the case of the optical detection apparatus by way of the detection apparatus having means for performing the method according to the invention.
In an advantageous embodiment, the detection apparatus can have means for scanning the monitoring region with the aid of the transmission signals. In this way, the monitoring region can be monitored in a spatially resolved manner for particles and/or objects.
The detection apparatus can advantageously have at least one deflection device with which the transmission signals can be deflected, in particular with which their direction can be panned, so as to scan the monitoring region. This deflection device or a different deflection device can be suitable for deflecting the reflection signals from the monitoring region to at least one receiver of the detection apparatus.
Moreover, the features and advantages indicated in connection with the method according to the invention and the detection apparatus according to the invention and the respective advantageous configurations and embodiments thereof apply in a mutually corresponding manner and vice versa. The individual features and advantages can of course be combined with one another, wherein further advantageous effects can occur that go beyond the sum of the individual effects.
Further advantages, features and details of the invention are apparent from the following description, in which an exemplary embodiment of the invention will be explained in more detail with reference to the drawing. A person skilled in the art will also expediently consider individually the features which have been disclosed in the drawing, the description and the claims in combination, and combine them to form further meaningful combinations. In the drawing, schematically:
In the figures, identical components are provided with the same reference numerals.
The laser scanner 12 can be used to monitor a monitoring region 14 in the driving direction 16 in front of the vehicle 10 for objects 18 and particles 20. For this purpose, the monitoring region 14 can be scanned with corresponding optical transmission signals 22 using the laser scanner 12.
Objects 18 can be other vehicles, people, animals, obstacles, potholes, roadway boundaries, the road surface or the like.
The particles 20 occur in the form of a particle composition 21 in the form of precipitation, for example rain, snow, hail, sleet or the like, or in the form of spray, fog, smog, smoke or the like. Accordingly, the particles 20 can be raindrops, water drops, drops of fog or mist, hailstones, snowflakes, smoke particles, smog particles, dust particles, grains of sand or the like.
If an object 18 is present in the monitoring region 14, the corresponding transmission signals 22 are reflected at object targets 24 of the object 18 in the form of object reflection signals 26 and are transmitted back to the laser scanner 12. An object target 24 is a region of the surface of an object 18 at which transmission signals 22 can be reflected. Each object 18 can have one or more such object targets 24, which can be captured with the transmission signals 22.
If particles 20 are present in the monitoring region 14, the corresponding transmission signals 22 are reflected at particle targets 28 of the particles 20 in the form of particle reflection signals 30 and are transmitted back to the laser scanner 12. A particle target 28 is a region of the surface of a particle 20 at which transmission signals 22 can be reflected. Each particle 20 can have one or more such particle targets 28, which can be captured with the transmission signals 22.
The laser scanner 12 operates according to what is referred to as a time-of-flight method, in which a time of flight between the emission of a transmission signal 22 and the reception of an object reflection signal 26 can be captured, and a distance, a speed and/or a direction of the object 18 relative to the vehicle 10 can be determined therefrom. If a particle reflection signal 30 is received, it is accordingly possible to determine a distance, a speed and/or a direction of the particle 20 relative to the vehicle 10. The respective position can be determined from the distance and the direction of an object 18 or of a particle 20.
The laser scanner 12 has a transmitter 32 for transmitting the transmission signals 22, a receiver 34 for receiving the object reflection signals 26 and the particle reflection signals 30, a deflection device 36, for example in the form of a deflection mirror device, for deflecting the transmission signals 22, the object reflection signals 26 and the particle reflection signals 30, and a control and evaluation device 38 for controlling the transmitter 32, the receiver 34 and the deflection device 36 and for evaluating object reflection signals 26 and particle reflection signals 30 that have been received.
The transmitter 32 has, for example, a laser diode with which the transmission signals 22 are transmitted in the form of laser pulses.
The beam directions of the transmission signals 22 are panned into the monitoring region 14 using the deflection device 36 so that the monitoring region 14 can be scanned with the transmission signals 22. Furthermore, the returning object reflection signals 26 and particle reflection signals 30 are steered onto the receiver 34 using the deflection device 36.
The receiver 34 has an optoelectronic component, for example a photodiode, a CCD chip or the like, with which the optical object reflection signals 26 and the particle reflection signals 30 can be converted into corresponding electrical signals. The electrical signals can be processed accordingly with the control and evaluation device 38.
The laser scanner 12, or rather the control and evaluation device 38, is functionally connected to a driver assistance system 40. The driver assistance system 40 can be used to control driving functions of the vehicle 10, for example steering, braking, a motor or the like, or at least to support the control thereof or a driver of the vehicle 10. The vehicle 10 can be operated autonomously or partially autonomously with the aid of the driver assistance system 40.
During the operation of the laser scanner 12, the transmitter 32 is controlled by the control and evaluation device 38 such that transmission signals 22 in the form of laser pulses are transmitted thereby. The transmission signals 22 are deflected by the deflection device 36 into the monitoring region 14. In this case, the transmission direction of the transmission signals 22 on the outlet side of the deflection device 36 is panned into a direction, for example in the horizontal direction, such that the monitoring region 14 is scanned with successive transmission signals 22. In this way, the azimuth of a captured object 18 or of a captured particle 20 can be determined. Optionally, the transmission direction of the transmission signals 22 can be additionally panned in a further, preferably orthogonal, direction using the deflection device 36 such that the monitoring region 14 can also be scanned accordingly in this direction. In this way, the elevation of the object 18 or of the particle 20 can additionally be determined.
During a measurement with the laser scanner 12, which can also be referred to as a scan, the viewing angle defining the monitoring region 14 is scanned once in its entirety. During the operation of the laser scanner 12, a plurality of measurements are performed successively such that the monitoring region 14 can be scanned in its entirety in each case at different time points.
During the respective measurements, the object reflection signals 26 of the objects 18 and the particle reflection signals 30 of the particles 20 are received by the receiver 34 and converted into corresponding electrical signals.
The control and evaluation device 38 is used to evaluate the corresponding electrical signals. For the sake of better comprehension, the terms “object reflection signals 26”, “particle reflection signal 30”, “particle target densities 52” and “particle target density difference 54” are also used in the description of the processing of the electrical signals using the control and evaluation device 38, even though the corresponding electrical signals are here meant to refer to respectively characterizing variables.
During the evaluation, the reflection signals received with the receiver 34 are classified. In this case, the reflection signals caused by objects 18 are classified as object reflection signals 26. The reflection signals caused by particles 20 are classified as particle reflection signals 30. The positions of the objects 18, specifically of the vehicles driving ahead, of the crash barriers 44 and of the road surface, are ascertained from the object reflection signals 26.
Method steps for capturing the particle compositions 21 with which rain can be distinguished from spray will be described below.
A free space 50 is ascertained from the positions of the objects 18. The free space 50 is the region in the monitoring region 14 that is not obscured or blocked by objects 18, viewed from the laser scanner 12, meaning that the transmission signals 22 can pass freely. The free space 50 is additionally limited to distances of for example between 2 m and 20 m from the laser scanner 12. The distance of 20 m is indicated in dashes in
The number of the corresponding particle reflection signals 30 is determined for each partial volume 48 in the free space 50. The number of the particle reflection signals 30 is normalized to the partial volume 48 and a normalized particle target density 52 is thus ascertained for each partial volume 48. In
Extensive investigations have shown that particle compositions 21 in the form of spray have a temporally dynamic behaviour. In contrast, particle compositions 21 in the form of rain have a behaviour that is temporally uniform as compared to spray. In partial volumes 48 in which spray prevails, the corresponding particle target density 52 differs between the measurements. In partial volumes 48 in which rain prevails, the particle target densities 52 are uniform, for example constant, during the measurements. When assessing whether a behaviour is a temporally dynamic behaviour or a temporally uniform behaviour, corresponding tolerances with respect to the particle target densities 52 can be taken into account.
In order to ascertain the partial volumes 48 in which spray prevails and the partial volumes 48 in which rain prevails, the particle target density difference 54 of the corresponding particle target densities 52 from the two measurements from
The partial volumes 48 are labelled in the virtual grid 46 on the basis of the particle target density differences 54, as shown in
Optionally, it is furthermore ascertained whether mainly rain or mainly spray prevails in the free space 50 overall.
To this end, a respective particle target density difference 54 is in each case ascertained during a plurality of measurements for the partial volumes 48 in the free space 50. A stochastic variance is formed from the particle target density differences 54. The variance is compared with a prescribed threshold value. The threshold value can be initially ascertained for example during a calibration of the laser scanner 12 and be stored in a corresponding storage medium, for example the control and evaluation device 38.
If the variance is greater than the threshold value, it is concluded that the particle reflection signals 30 from the relevant partial volumes 48 are mainly caused by particle compositions 21 having a temporally dynamic behaviour, that is to say spray in the present example. If this is not the case, it is concluded that the relevant particle reflection signals 30 are mainly caused by particle compositions 21 having a temporally uniform behaviour, that is to say rain in the present case.
This information is additionally supplied to the driver assistance system 40, so as to further improve driving safety.
Number | Date | Country | Kind |
---|---|---|---|
10 2018 125 715.5 | Oct 2018 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/077925 | 10/15/2019 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/078983 | 4/23/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20050207943 | Puzey | Sep 2005 | A1 |
20070076201 | Babin | Apr 2007 | A1 |
20100194574 | Monk | Aug 2010 | A1 |
20180136337 | Zohar et al. | May 2018 | A1 |
20180209887 | Ray | Jul 2018 | A1 |
Number | Date | Country |
---|---|---|
102006030734 | Jan 2008 | DE |
102009028578 | Feb 2011 | DE |
10346951 | Apr 2011 | DE |
102012105379 | Jul 2013 | DE |
Entry |
---|
Satat Guy et al: “Towards photography through realistic fog”, 2018IEEE International Conference on Computational Photography (ICCP), IEEE, May 4, 2018 (May 4, 2018), Seiten 1-10, XP033352256, DOI: 10.1109/ICCPHOT.2018.8368463 (10 pages). |
International Search Report and Written Opinion in corresponding International Application No. PCT/EP2019/077925, mailed Jan. 14, 2020 (13 pages). |
German Search Report in corresponding German Application No. 10 2018 125 715.5, dated Sep. 26, 2019 (5 pages). |
Number | Date | Country | |
---|---|---|---|
20220003871 A1 | Jan 2022 | US |