The invention relates to a method for estimating the heights of objects in the region surrounding vehicles by means of ultrasonic sensor technology.
The process of capturing surroundings information in the region of a vehicle by means of ultrasonic sensors, in order to capture the spacing from other objects during parking, for example, is known.
Ultrasonic sensors supply spacing information based on the transit time of the ultrasonic signal, but no direct height information of the detected object, since the reception angle from which the back-reflection occurs cannot be established.
However, the process of establishing the height of the object at which the reflection occurs by evaluating the geometric relationships from multiple transmitting/receiving cycles is known. Thus, the height of the object may be calculated, for example, during a movement of the vehicle between the two transmitting/receiving cycles by evaluating the spacing information measured between the ultrasonic sensor and the reflecting object and an item of distance information which indicates the spacing of the sensor positions of the ultrasonic sensor in the horizontal direction along the direction of propagation of the ultrasonic signal between the ultrasonic sensor and the reflecting object.
The problem with this is that noise frequently results in poor measurement results which lead to inadequate estimation of heights with large deviations.
Proceeding herefrom, it is the object of the present disclosure to indicate a method for estimating the heights of objects in the region surrounding vehicles by means of ultrasonic sensor technology, which allows the height of the reflecting object to be reliably estimated.
The object is achieved by a method having the features of the independent claim 1. Example embodiments are the subject-matter of the subclaims. A system for estimating the height of an object is the subject-matter of the alternative, independent claim 15.
According to a first aspect, the present disclosure relates to a method for estimating the height of an object by means of the ultrasonic sensor technology of a vehicle. The method includes the following steps.
Initially, at least two ultrasonic signals are received by at least one ultrasonic sensor. A single ultrasonic sensor may have different sensor positions relative to the object due to a vehicle movement. That is to say that, in other words, items of reception information of an individual ultrasonic sensor are evaluated, the individual ultrasonic sensor taking up different positions, due to the vehicle movement, relative to the object, the height of which is to be established, in consecutive measuring cycles. Alternatively, multiple ultrasonic sensors may also receive the at least two ultrasonic signals, wherein these have different sensor positions relative to the object due to the vehicle movement and/or a different arrangement on the vehicle.
A first item of height information which is a measure of the squared height of the object is then calculated. The height of the object may be the relative height of the object to the installation height of the at least one ultrasonic sensor on the vehicle. In other words, the height of the object is therefore not directly determined, but rather the squared height, in order to thereby avoid misestimations which are caused by noise. The first height information is calculated based on two items of spacing information measured between the respective sensor position and the object, and an item of distance information measured horizontally between the sensor positions. The first height information is, for example, established in a first measuring cycle.
The variance of the first height information is then calculated.
Subsequently, at least one further ultrasonic signal is received by the at least one ultrasonic sensor. Based on the further ultrasonic measurement, a second item of height information which is a measure of the squared height of the object is calculated. The calculation is, in turn, effected based on two items of spacing information measured between the respective sensor position and the object, and an item of distance information measured horizontally between the sensor positions. At least one part of this information which is necessary for the calculation originates from the further ultrasonic measurement which, for example, forms a second measuring cycle. The second measuring cycle may be a measuring cycle immediately following the first measuring cycle, or further measuring cycles may lie between the first and second measuring cycle. If the first and second measuring cycles do not immediately follow one another, the outcome is, for example, that the vehicle moves between the first and second measuring cycle on a longer route, which increases the accuracy of the height estimation.
The variance of the second height information is then calculated.
In a further step, an averaged item of height information is calculated by combining the first and second height information and an averaged variance of the height information is calculated by combining the variance of the first and second height information.
A detected object is classified in a height class by calculating at least one probability value based on a normal distribution function which has as the mean value the averaged height information and as the variance the averaged variance of the height information.
The technical advantage of the method according to the present disclosure is that the height of the reflecting object may be reliably established by determining an item of height information which takes into account the squared height of the object. As a result, with repeated use, a distribution of values of items of height information is achieved, which corresponds better to a normal distribution than when the unsquared height of the object is determined directly.
According to an example embodiment, further items of height information (i.e., additional items of height information in addition to the first and second items of height information), which are a measure of the squared height of the object, and items of variance information regarding the further items of height information are calculated iteratively. The averaged height information is determined by combining the items of height information, such as all of the iteratively determined items of height information, and an averaged variance of the items of height information is determined by combining the variances of the items of height information, such as all of the iteratively established variances. A reliable classification of the height of the object may be achieved by the iterative determination of a plurality of items of height information and the variances thereof, and combining the items of height information.
According to an example embodiment, the first, second and/or further height information is calculated by the following formula:
In contrast to the direct determination of the height difference h, the aforementioned formula does not contain a root term, which means that negative values of H or the squared height h, which can arise from noise, do not lead to invalid results.
According to an exemplary embodiment, the variance of the first, second and/or further height information is established based on a first-order variation analysis. The variance of the height information may be calculated by the variation analysis by adding multiple summands, wherein the summands in each case take into account the change in the height information as a function of the change in an input variable which is enlisted to calculate the height information.
According to an example embodiment, the variance of the first, second and/or further height information is calculated by the following equation:
According to an exemplary embodiment, the averaged height information is calculated based on the following formula:
Either items of height information, which originate from individual measurements, or the estimated height information may be already averaged items of height information, i.e., even produced from an averaging over multiple measurements, may be used as the estimated height information from the respective measuring cycles. The same applies analogously to the variance of the height information in the first and/or second measuring cycle.
According to an example embodiment, the averaged variance of the height information is calculated based on the following formula:
According to another example embodiment, the averaged height information and the averaged variance of the height information are calculated based on a least squares method. Weighting factors (weighted least squares method) may be used, which are selected in such a way that they take into account an existing correlation between the measurements.
According to an example embodiment, the probability value for assigning the object to a height class is calculated based on the following formula:
Therefore, the probability that an object is located in a height range fixed by the lower or upper limit may be determined by assuming a normal distribution of the height information around the averaged height information as the mean value and having a variance equal to the averaged variance.
According to an example embodiment, the height class is calculated based on a correction function which takes into account the deviation of the statistical distribution of the height information from the normal function. As a result, the error which results from the deviation of the statistical distribution of the height information from the normal function may be minimized.
According to an example embodiment, the correction function is estimated based on a stream of height information data which were established based on different items of spacing information between the respective sensor position and the object and different items of horizontally measured distance information. In other words, it is therefore analyzed what influence the items of spacing information or the items of distance information have on the statistical distribution of the items of height information, and the correction function is selected depending on this.
According to an example embodiment, a lower and/or upper limit used for the calculation of the probability value is/are adjusted based on the correction function. As a result, the deviation of the statistical distribution of the height information from the normal function may be compensated for by adapting the lower and/or upper limit(s) during the determination of the height of the object.
According to an example embodiment, the distance information is established based on the vehicle's odometry data. In other words, an odometry system of the vehicle may provide information which indicates how the vehicle has moved between two measuring cycles of the at least one ultrasonic sensor. Since the movement of the vehicle does not necessarily have to take place in the transmitting or receiving direction of the ultrasonic sensor, the distance information, i.e., the spacing of the sensor positions in the transmitting or receiving direction of the ultrasonic sensor, must be calculated from the vehicle's odometry data.
According to an example embodiment, the object is assumed to be a line object having a longitudinal alignment, and the transmitting and receiving direction of the at least one ultrasonic sensor and the direction in which the distance information is measured is assumed to be perpendicular to the longitudinal alignment of the line object.
According to an alternative example embodiment, the object is simulated by means of items of information, which were established by the ultrasonic sensor technology in multiple capturing cycles, by an object contour line, and the items of distance information are assumed to be the difference between the horizontally measured spacing of the sensor positions and the line.
According to a further aspect, the present disclosure relates to a system for estimating the height of an object, including ultrasonic sensor technology provided on a vehicle and a computer unit, wherein the system is configured to carry out the following steps of:
Within the meaning of the present disclosure, the expressions “approximately”, “substantially” or “roughly” mean deviations from the exact value in each case by +/−10%, such as by +/−5%, and/or deviations in the form of changes which are insignificant to the function.
Further developments, advantages and possible applications of the present disclosure are set out by the following description of example embodiments and by the figures. All of the features described and/or pictured per se or in any combination are fundamentally the subject-matter of the present disclosure, independently of their combination in the claims or references back thereto. The content of the claims is also made an integral part of the description.
The present disclosure is explained in greater detail below on the basis of the figures with reference to example embodiments, wherein:
The ultrasonic sensors 2 are coupled to at least one computing unit 4, by means of which the method described below for estimating the height of an object 3 in the environment of a vehicle 1 is affected.
The height of the object 3 may either be determined in that either multiple measurements are performed by a single ultrasonic sensor 2, wherein, for example, a first measurement is carried out at a first sensor position P1 and a second measurement is carried out at a second sensor position P2 and the sensor positions P1 and P2 are different due to the movement of the vehicle 1 or, alternatively, the height of the object 3 may also be determined by at least two measurements of different ultrasonic sensors 2 of the vehicle, which are arranged at different positions on the vehicle 1 and therefore have a different spacing from the object 3.
As shown in
The spacing between the first and second sensor positions p1, p2 measured horizontally in the direction of the connecting line between the sensor 2 and the object 3 is referred to below as distance information s. The vertically measured difference in height between the object 3 and the ultrasonic sensor 2 is referred to below as the height h.
Due to geometrical relationships, the height h may be calculated as follows:
The problem is that noise may cause the term under the root to become negative, therefore making it impossible to calculate the height.
A method of classifying heights of the object 3 is disclosed below, which avoids the problem of the negative term under the root.
Instead of the height h, the method according to the present disclosure estimates an item of height information H which corresponds to the square of the height h.
In turn:
Since individual measurements may be highly error-prone and therefore lead to incorrect height estimations, multiple measurements are carried out and a height estimation of the object 3 or a height classification is carried out based on an averaging of the estimated items of height information H and the estimation of the variance of the items of height information H.
In order to determine the variance of the items of height information H, a first-order variational analysis is, for example, carried out.
For example, this may be done based on the following formula:
wherein:
The first derivative of the height information H according to r1 is calculated as follows:
The first derivative of the height information H according to r2 is calculated as follows:
The first derivative of the height information H according to s is calculated as follows:
Advantageously, multiple measurements carried out by the ultrasonic sensor technology of the vehicle 1, which are carried out for example during an object tracking during the movement of the vehicle, are combined with one another. The respective variance of the items of height information H may be enlisted as a weighting factor.
In the event that a first item of height information H′ and a second item of height information H″ are established, an averaged item of height information may be established by the following formula:
The averaged variance may be calculated as follows:
wherein the following applies:
It should be noted that the items of height information H′, H″ or the variances Var[H′] and Var[H″] may, in each case, refer to a single measuring cycle (i.e., determination of an individual item of height information H by the measurement of spacing information by a sensor at two different sensor positions), but also to multiple measuring cycles, i.e., the items of height information H′, H″ and the variances Var[H′] and Var[H″] may themselves already be averaged values.
Alternatively, the measurements of the items of height information H may also be combined by a method which is based on a weighted least squares method. The weighting factors of such a method may be selected in such a way that they take into account an existing correlation between the two measurements.
After a plurality of items of height information H have been estimated, the height h of the object 3 may be determined based thereon. In particular, a height classification of the object 3 in a height class may be performed.
For example, a height classification may be carried out to the effect that it is checked how high the probability is that the object 3 has a height h in a certain height range.
In the event that the height class is fixed by a lower limit a and an upper limit b, the probability that the height of the object 3 falls within the height class may be calculated by the following formula:
The following applies:
If the height class does not have a lower or upper limit, i.e., it is the lowest or the highest height class, the lower limit a may assume the value −∞ or the upper limit b may assume the value +∞.
It is understood that the limits a, b of formula 9 likewise have to be squared due to the relationship H=h2, i.e., a classification limit of 0.3 m must be converted into a limit of 0.09 m2.
Formula 9 assumes that the averaged height information has a uniform distribution over x. However, in reality, the averaged height information frequently deviates from the normal distribution.
In order to compensate for this deviation, the at least one limit a, b may be adjusted by means of a correction function. In particular, a correction function which carries out an adjustment of the at least one limit depending on the spacing information r1, r2 and the distance information s may be selected.
Such a correction function may be established, for example, by a simulation or by real data, based on which the dependency of the height information H on the spacing information r1, r2 and the distance information s is determined.
As previously described, the distance information s, i.e., the change in the sensor positions P1, P2 along the transmitting and receiving direction of the ultrasonic signal, is needed.
The vehicle movement itself may be determined by information from an odometry unit of the vehicle. However, the direction of movement of the vehicle does not have to coincide with the transmitting and receiving direction of the ultrasonic signal between the ultrasonic sensor and the object.
The distance information s may, for example, be estimated as follows:
The object 3 may be assumed to be a line object, for example. The line object is assumed to be aligned with the transmitting and receiving direction of the ultrasonic sensor 2 in such a way that the transmitting and receiving direction of the ultrasonic sensor 2 runs perpendicularly to the longitudinal axis of the line object. It is therefore likewise assumed that the distance information s is to be measured perpendicularly to the longitudinal axis of the line object. If the direction of movement of the vehicle 1 and the absolute movement thereof are known, the distance information s may be calculated therefrom.
Alternatively, multiple measurements and tracking may be used to determine the object contour as a curved or arbitrarily shaped line or as a polygon or polygon section. In this case, the distance information s may be calculated directly and, indeed, as the difference between the respective sensor position P1, P2 and the line reproducing the object contour.
Initially, at least two ultrasonic signals are received by at least one ultrasonic sensor 2. A single ultrasonic sensor may have different sensor positions relative to the object due to a vehicle movement. Alternatively, multiple ultrasonic sensors 2 may have different sensor positions relative to the object 3 due to the vehicle movement and/or a different arrangement on the vehicle 1 (S10).
A first item of height information H is then calculated, which is a measure of the squared height h of the object. The calculation is effected based on two items of spacing information r1, r2 measured between the respective sensor position and the object 3, and an item of distance information (s) measured horizontally between the sensor positions (S11).
Subsequently, the variance of the first item of height information is calculated (S12).
At least one further ultrasonic signal is then received by the at least one ultrasonic sensor, and a second item of height information which is a measure of the squared height of the object is calculated based on two items of spacing information measured between the respective sensor position and the object, and an item of distance information measured horizontally between the sensor positions (S13).
Subsequently, the variance of the second height information is calculated (S14).
An averaged item of height information is then calculated by combining the first and second height information and an averaged variance of the height information is calculated by combining the variance of the first and second height information (S15).
Finally, a detected object is classified in a height class by calculating at least one probability value based on a normal distribution function which has as the mean value the averaged height information and as the variance the averaged variance of the height information (S16).
The invention has been described above with reference to example embodiments. It is understood that numerous changes as well as variations are possible, without departing from the scope of protection defined by the claims.
Number | Date | Country | Kind |
---|---|---|---|
10 2021 208 072.3 | Jul 2021 | DE | national |
The present application is a National Stage Application under 35 U.S.C. § 371 of International Patent Application No. PCT/DE2022/200146 filed on Jun. 29, 2022, and claims priority from German Patent Application No. 10 2021 208 072.3 filed on Jul. 27, 2021, in the German Patent and Trademark Office, the disclosures of which are herein incorporated by reference in their entireties.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/DE2022/200146 | 6/29/2022 | WO |