The present invention relates to a method for detecting an operating capability of an environment sensor, a control unit for executing the method and a vehicle equipped with the control unit.
In order to achieve sufficient reliability in autonomous or semiautonomous driving of a vehicle on the basis of sensor data, the sensor or sensors for generating the sensor data should have a predefined accuracy. Moreover, the installation position of the sensor and an orientation of the sensor should be sufficiently known and/or a corresponding calibration of the sensor be performed. The calibration can be complex and thus may entail considerable expense already during the production of the vehicle.
An object of the present invention is to detect a function of an environment sensor on a vehicle in a more optimal manner, in particular in order to calibrate the environment sensor.
The aforementioned object may be achieved by a method in accordance with an example embodiment of the present invention as well as by a control unit in accordance with an example embodiment of the present invention and a vehicle in accordance with an example embodiment of the present invention.
The present invention relates to a method for detecting an operating capability of an environment sensor of a vehicle. In accordance with an example embodiment of the present invention, the method includes an ascertainment of current coordinates of the vehicle. For instance, the current coordinates of the vehicle are coordinates of a satellite-based navigation system, which are acquired with the aid of a sensor. In addition, the method includes an ascertainment of a current orientation of the vehicle based on the current coordinates. This current orientation of the vehicle, for instance, is a yaw angle or an orientation of the vehicle in the sense of a compass. Next, at least one object in the environment of the vehicle and a setpoint position of the object in relation to the vehicle are determined as a function of the ascertained coordinates, the ascertained orientation, a predefined position of the environment sensor on the vehicle, and a map of the environment. For instance, for a camera disposed on the right side of the vehicle in the driving direction and used as a mirror substitute, a section of the map visible to the camera is ascertained based on the ascertained orientation of the vehicle, and the object as well as the setpoint position of the object in relation to the vehicle are identified or determined in this map section, the object preferably being easily detectable or identifiable and/or located in a predefined distance range from the vehicle. The map includes at least the object and a position of the object. Preferably, the determination of the object and the setpoint position of the determined object in the environment of the vehicle is at least partly implemented with the aid of a trained machine-based detection, preferably with the aid of a neural network. In an advantageous manner, the map is a highly precise map which has a resolution of less than one meter. Moreover, a detection of the environment of the vehicle is carried out with the aid of the environment sensor of the vehicle, for instance using the camera situated on the right side of the vehicle in the driving direction. Environment data are generated as a function of the acquired environment. The environment data may preferably be generated as a function of at least two environment sensors, the environment sensors using the same type of sensor or alternatively different types of sensors; for example, the environment data are generated as a function of a camera and/or a lidar sensor and/or a radar sensor and/or an ultrasonic sensor. Next, an actual position of the determined object in the environment of the vehicle is detected or ascertained as a function of the environment data. For instance, the object is detected in a camera image by an artificial intelligence or a trained machine-based detection method or a neural network, and a distance between the object and the vehicle is ascertained based on the environment data, the environment data preferably including distance data between objects in the environment of the vehicle and the vehicle. Then, an operating capability of the environment sensor is detected or ascertained by comparing the detected or ascertained actual position of the object to the ascertained setpoint position of the object. As an alternative to the detection of the operating capability or in addition to the detection of the operating capability, the environment sensor is calibrated as a function of the actual position and the setpoint position. The present method provides the advantage that the operating capability of the environment sensor is able to be determined rapidly and cost-effectively and/or a calibration of the environment is able to be carried out during an ongoing operation without the need to install artificial markings at fixedly defined locations. The calibration of the environment sensor of the vehicle such as a camera and/or a stereo camera and/or a lidar sensor and/or a radar sensor and/or an ultrasonic sensor is advantageously carried out at least with a precision that is sufficiently accurate to reliably represent an environment model which is descriptive and without artefacts and/or to realize a semiautomatic or fully automatic driving function as a function of the environment sensor with at least adequate reliability.
In one preferred embodiment of the present invention, the ascertainment of the coordinates of the vehicle is carried out as a function of acquired signals, which are received with the aid of a location sensor for a global satellite navigation system, and/or as a function of at least one camera image from a vehicle camera, and/or as a function of acquired distance data between the vehicle and objects in the environment of the vehicle, and/or as a function of odometry data of the vehicle. This embodiment, in particular when combining the dependencies, advantageously allows for a highly precise ascertainment of the coordinates of the vehicle. Alternatively or additionally, the ascertainment of the coordinates of the vehicle is realized as a function of at least a certain propagation time of an acquired Car-to-X communications signal between the vehicle and a stationary infrastructure device.
In a further preferred embodiment of the present invention, the ascertainment of the orientation of the vehicle is performed as a function of signals from a magnetometer and/or as a function of signals from at least one inertial measuring unit and/or as a function of a characteristic of ascertained coordinates of the vehicle, in particular ascertained across a predefined time span. This embodiment, in particular when combining the dependencies, advantageously allows for a highly precise ascertainment of the orientation of the vehicle.
In a further refinement of the present invention, the ascertainment of the coordinates and/or the ascertainment of the orientation of the vehicle additionally take(s) place as a function of received position information, the received position information being sent out or transmitted by an infrastructure monitoring device in the environment of the vehicle. For instance, the position information is acquired with the aid of a distance sensor system of the infrastructure monitoring device and, in one optional embodiment, the position information additionally includes information about the orientation of the vehicle. The infrastructure monitoring device is stationary and/or the location of the infrastructure monitoring device is precisely known. The data acquired with the aid of the distance sensor system or the acquired infrastructure information or acquired position information is sent or transmitted to the vehicle. For instance, the infrastructure monitoring device as the distance sensor system includes a lidar sensor and/or a stereo camera provided with a corresponding evaluation electronics. In an advantageous manner, the ascertainment of the coordinates and/or the ascertainment of the orientation as a function of the transmitted position information is/are therefore especially precise in this embodiment.
In one embodiment of the present invention, the location of the object indicated on the map has an accuracy of less than one meter. The accuracy of the position of the object on the map preferably amounts to less than 10 centimeters and, especially preferably, is less than or equal to one centimeter. Because of the high accuracy of the map or the position of the object, the operating capability of the environment sensor is advantageously able to be identified in a precise rapid and also reliable manner.
In one preferred further refinement of the present invention, the setpoint position of the determined object does not drop below a predefined distance of the object from the vehicle. In an advantageous manner, the accuracy of the map or the position of the object is therefore generally less relevant for detecting or ascertaining the operating capability of the environment sensor. The method consequently becomes considerably more robust in this further refinement. Moreover, this advantageously results in the technical effect that the operating capability of the environment sensor is able to be determined very precisely.
The detection of the actual position of the determined object in the environment of the vehicle preferably takes place as a function of the environment data, at least partly with the aid of a trained machine-based detection, preferably using a neural network. Because of the trained machine-based detection or an artificial intelligence, objects are able to be detected in a rapid and reliable manner. In an advantageous manner, the actual position of the detected object can then be easily read out from the environment data.
In another embodiment of the present invention, after the operating capability of the environment sensor has been detected, the environment sensor is deactivated as a function of the detected operating capability. For example, this advantageously avoids an imprecise display of an environment model with image artefacts and/or an unreliable semiautomatic or fully automatic driving function as a function of a faulty operation of the environment sensor.
In a further embodiment of the present invention, an activation of a safety sensor and/or an alternative environment monitoring system of the vehicle is carried out as a function of the detected operating capability, in particular a faulty operating capability, the safety sensor at least partly replacing the environment sensor. This advantageously avoids an imprecise display of an environment model with image artefacts and/or an unreliable semiautomatic or fully automatic driving function as a function of a faulty operation of the environment sensor, the environment model being displayed as a function of an environment of the vehicle acquired with the aid of the safety sensor and/or the alternative environment monitoring system, and/or a semiautomatic or fully automatic driving function being carried in an at least sufficiently satisfactory manner as a function of the environment of the vehicle acquired with the aid of the safety sensor and/or the alternative environment monitoring system.
In addition, after the operating capability of the environment sensor has been detected, an adaptation of a display of an environment model for a user of the vehicle optionally takes place as a function of the detected operating capability. In this way, the display of the environment model is advantageously adapted to the detected operating capability. In a detected malfunction, for instance, an indicated abstraction degree of the environment model is advantageously increased by this step.
It may furthermore be provided that after the operating capability of the environment sensor has been detected, a control of a steering system of the vehicle and/or of a drive motor of the vehicle or a speed of the vehicle is/are adapted as a function of the detected operating capability. For instance, this provides the advantage that a fully automated control of the vehicle is changed to a semiautomatic control, in which certain driving maneuvers such as parking of the vehicle, which are especially affected by the operating capability of the environment sensor, have to be carried out manually.
In an optional embodiment of the present method in accordance with the present invention, the method is carried out immediately after a detected accident of the vehicle. The detection of an accident preferably takes place with the aid of acceleration sensors and/or pressure sensors which are situated on the vehicle. After an accident, the present method is used to advantageously check and/or calibrate each environment sensor to determine its full operating capability.
In addition, the present invention relates to a control unit, which includes a computing unit. The control unit or computing unit is designed to be connected to the environment sensor, and the environment sensor is designed to be placed at the predefined position of the vehicle. The environment sensor in particular is a camera (mono camera or stereo camera), an ultrasonic sensor, a radar sensor or a lidar sensor. The computing unit is set up to ascertain the current coordinates of the vehicle as a function of a signal from a location sensor of the vehicle and the current orientation of the vehicle. In addition, the computing unit is designed to determine at least the object in the environment of the vehicle and the setpoint position of the object in relation to the vehicle as a function of the ascertained coordinates, the ascertained orientation, the predefined position of the environment sensor on the vehicle, and the map of the environment. Moreover, the computing unit is designed to generate environment data as a function of the environment acquired with the aid of the environment sensor and to ascertain the actual position of the determined object in the environment of the vehicle as a function of the environment data. The computing unit is also designed to detect an operating capability of the environment sensor by comparing the actual position of the object with the setpoint position of the object.
The present invention furthermore relates to a vehicle which includes at least one location sensor for a global navigation system and an environment sensor, which is situated at a predefined position of the vehicle. The vehicle furthermore includes the control unit according to the present invention.
The vehicle is advantageously designed to receive a map from a server device, the receiving in particular taking place as a function of current coordinates of the vehicle, and a position of the object indicated on the map has an accuracy of less than one meter, the accuracy of the position of the object on the map in particular being less than 10 centimeters and, especially preferably, less than one centimeter.
In a further refinement of the present invention, the vehicle includes an odometry sensor, in particular an rpm sensor, and/or an acceleration sensor and/or a yaw rate sensor. Alternatively or additionally, the vehicle includes a communications unit which is designed to exchange data with an infrastructure monitoring device via radio or to receive position information from the infrastructure monitoring device, and/or it includes a Car-to-X communications unit which is designed to receive a Car-to-X communications signal or data from a stationary infrastructure device. In this way the vehicle is advantageously designed to ascertain the current coordinates of the vehicle and/or the current orientation of the vehicle in a very precise manner.
Additional advantages result from the following description of exemplary embodiments with reference to the figures.
Then, a detection 290 of an operating capability of environment sensor 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130 or 140 takes place by comparing the detected or ascertained actual position of object 310 with the setpoint position of object 310 determined on the basis of the map. As an alternative to detection 290 of the operating capability or after the detection 290 of the operating capability of the environment sensor, a calibration 291 of environment sensor 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130 or 140 is performed as a function of the actual position and the setpoint position. After the operating capability of the environment sensor has been detected, a deactivation 292 of environment sensor 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130 or 140 as a function of the detected operating capability may be carried out in an optional step 292. In another optional step 293, after the operating capability of the environment sensor has been detected, an activation 293 of a safety sensor and/or of an alternative environment monitoring system of vehicle 100 is able to be provided as a function of the detected operating capability, the safety sensor at least partly replacing environment sensor 110, 111, 112, 113, 114, 115, 116, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130 or 140. In a further optional step 294, after the operating capability of the environment sensors has been detected, an adaptation 294 of a display of an environment model for a user of vehicle 100 is able to take place as a function of the detected operating capability. In a further optional step 295, a control of a steering system and/or a control of a speed of vehicle 100 is able to be adapted as a function of the detected operating capability after the operating capability of the environment sensor has been detected.
In
Number | Date | Country | Kind |
---|---|---|---|
10 2019 206 021.8 | Apr 2019 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/058292 | 3/25/2020 | WO | 00 |