Patent Application
20240001945
This application claims priority on German Patent Application No 10 2022 116 562.0 filed Jul. 4, 2022, the entire disclosure of which is incorporated herein by reference.
The invention relates to a method, a system, and a computer program product for validating and/or calibrating an advanced driver assistance system (ADAS) and/or an automated driving system (ADS).
An advanced driver assistance system (ADAS) and/or an automated driving system (ADS) must be tested, validated, adjusted and or calibrated for vehicles in road traffic or prototype vehicles on test terrains. These tests should assess critical properties for all vehicle derivatives of a series of vehicles that share some common properties. Test results are to be considered for ADAS/ADS validation in vehicles of this series, or should demonstrate at least most of the difficulties that may arise in this vehicle series.
U.S. Pat. No. 11,507,717 B2 discloses a method for simulating traffic for an environment where vehicles can drive automatically. A method for determining identifiers for the environment to be automatically driven with vehicles also is discussed.
EP 3 621 052 A1 describes a method for analyzing the driving behavior of motor vehicles. The method captures the contours and the trajectory of a motor vehicle. These captured data are used to create a vehicle model for later simulation of the motor vehicle in a simulation environment.
US 2019/0235521 A1 discloses a scenario-based method for validating an autonomous driving operation of a motor vehicle. The method uses synthetic data sets obtained in a virtual environment in addition to real sensor data sets.
In light of this background, an object of the invention is to provide a method for identifying a vehicle that is particularly suitable for ADAS/ADS validation and with the identified vehicle combining all or at least most of the properties of vehicles of a vehicle pool critical to the ADAS/ADS validation. The vehicle pool comprises a basic model of a series and all possible derivatives with respective equipment options. A further object is to provide a system on which the method can be carried out.
The invention generally relates to a method for validation and/or calibration of an advanced driver assistance system (ADAS) and/or an automated driving system (ADS) so that the ADAS/ADS can be executed in both a virtual environment and a real environment. The vehicle pool comprises multiple real vehicles, and each real vehicle of the vehicle pool can be mapped onto the virtual environment by means of vehicle or scenario parameters.
One aspect of the method includes: inputting a vehicle model that is described by vehicle parameters, such as engine size or brake specifications; inputting test scenarios, such as braking distance or rate of deceleration for which the ADAS/ADS is tested in a virtual environment with the respective vehicle; and inputting evaluation criteria with which a performance of the ADAS/ADS is evaluated in a virtual and/or real test drive. The method proceeds by virtual test driving for all vehicles of the vehicle pool, with results of the evaluation criteria being recorded for each test drive. The method continues by evaluating all of the results and identifying the vehicle with the worst results as the worst-case vehicle, as determined by the virtual test drives. The method then includes selecting the real vehicle from the vehicle pool corresponding to the worst-case vehicle. The ADAS/ADS then is validated by at least one real test drive with this selected real vehicle and the ADAS/ADS of all vehicles are calibrated or adjusted, if required, based on the evaluation of the worst-case vehicle.
The method of the invention provides the so-called worst-case vehicle for a whole series, but advantageously avoids having to test all vehicles of the series to gain knowledge, for example concerning improvements and/or calibration in the ADAS/ADS to be validated. Thus, the method significantly reduces test effort and makes the validation process much more efficient for a particular ADAS/ADS version.
It is conceivable that, through additional virtual and/or real test drives with other vehicles of the vehicle pool, it can be demonstrated that all or at least most of the properties of the vehicles of the vehicle pool influencing the performance of the ADAS/ADS are demonstrated by the worst-case vehicle.
The performance of the ADAS/ADS is given, for example, by a grade in the performance of a driving task, for example, a minimum distance from a vehicle driving ahead, within which the ADAS/ADS can bring the ADAS/ADS controlled vehicle to a standstill. Another example is a maximum value of (negative) acceleration occurring in a deceleration scenario. The lower this value is, the higher the ride comfort perceived by vehicle occupants, and thus the better the performance of the ADAS/ADS.
In one embodiment, a transferability of the evaluation results for the performance of the ADAS/ADS on the worst-case vehicle to all other vehicles of the vehicle pool is checked by additional virtual test drives after the calibration or adjustment. This can be checked by additional virtual test drives and can demonstrate that the evaluation results achieved with the worst-case vehicle, as determined according to the invention, stand in or apply for the entire vehicle pool. It is conceivable to carry out a so-called proof-of-principle by performing one-time real test drives with at least one additional vehicle of the vehicle pool to demonstrate the transferability of the results achieved in the worst-case vehicle to the vehicle pool and to validate further ADAS/ADS versions only with the worst-case vehicle according to the invention.
In a further embodiment, the vehicle parameters describing a vehicle model are assigned to different vehicle derivatives and/or variants of equipment. Examples include differentiated motorization, specification of the brakes, for example ceramic braking, or a built-in radar for an automated spacer.
In another embodiment of the method, at least one scenario for testing the ADAS/ADS in the virtual environment is emergency braking at the end of a traffic jam as a function of different initial speeds.
In yet another embodiment, the at least one evaluation criterion is selected from: duration until standstill upon full braking, and minimum duration until impact.
The invention also relates to a system for validating and/or calibrating an advanced driver assistance system (ADAS) and/or an automated driving system (ADS) of vehicles in a vehicle pool. The ADAS/ADS can be executed in both a virtual environment and a real-world environment. The vehicle pool comprises multiple real vehicles, and each real vehicle of the vehicle pool can be mapped onto the virtual environment by scenario parameters or vehicle parameters. The system is configured to carry out the steps of: inputting a vehicle model that is described by the vehicle parameters; inputting test scenarios for which the ADAS/ADS is tested in the virtual environment with the respective vehicle; inputting evaluation criteria with which a performance of the ADAS/ADS is evaluated in a virtual and/or real test drive; virtual test driving all vehicles of the vehicle pool, with results of the evaluation criteria being recorded for the virtual test drive; evaluating all results to identify the worst-case vehicle as the vehicle having the worst result; and selecting the real vehicle from the vehicle pool corresponding to the worst-case vehicle, wherein the ADAS/ADS is validated by at least one real test drive with this vehicle.
In some embodiments, the system is configured to check a transferability of the evaluation results for the performance of the ADAS/ADS on the worst-case vehicle to all other vehicles of the vehicle pool by additional virtual test drives.
In a further configuration of the system, the vehicle parameters that describe a vehicle model are associated with different vehicle derivatives and/or configuration variants.
In yet another configuration of the system, at least one scenario for testing the ADAS/ADS in the virtual environment comprises emergency braking at the end of a traffic jam as a function of different initial speeds.
In yet another configuration of the system, at least one evaluation criterion is selected from duration until standstill upon full braking and minimum duration until impact.
A computer program product also is proposed and has a computer-readable medium that stores a program code that can be executed for validation and/or calibration of an advanced driver assistance system (ADAS) and/or an automated driving system (ADS). The ADAS/ADS can be executed in both a virtual environment as well as in a real environment. A vehicle pool comprises multiple real vehicles, and each real vehicle of the vehicle pool can be mapped onto the virtual environment by vehicle parameters. When executed on a computing unit, the program code prompts the computing unit to carry out the steps of the method described above.
Additional advantages and configurations of the invention result from the description and the enclosed drawing.
It is understood that the aforementioned features and the features yet to be explained in the following can be used in the specified combination, and in other combinations or on their own, without departing from the scope of the invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2022 116 562.0 | Jul 2022 | DE | national |
