The invention relates to a control system for a vehicle and a vehicle that has such a control system.
Numerous sensors are used in autonomous vehicles for scanning the vehicle's environment and controlling the vehicle on the basis thereof. The sensors can be radar, camera and lidar sensors. The term sensor can also be used when the sensor has its own processor and outputs processed environment data. The data from the various sensors are compiled in general in a central control unit and processed to obtain a consolidated model of the environment. The driving behavior is then controlled on the basis of this model of the environment and the driving order. The central control unit is composed in general of one or more powerful processors in order to process the large amount of input data. This input data may be distributed to numerous processors within the computing unit. In particular with systems that should be safeguarded against malfunctioning it is necessary to distribute sensor data from different sensor interface units to different processors, in order to make use of independent paths.
A common approach is to have paths that can ensure a minimal functioning with a portion of the sensor data, and for there to be a main path that uses the data from all of the sensors in order to enable a maximal functioning. A known approach is the duplication of the interface units within the system in order to distribute the data accordingly. These interface units generally have different standards and transmission protocols. This requires numerous connections. Another disadvantage may also be that many signals may exceed the limits between different supply areas.
The object of the invention is to reduce and/or simplify the interface units between two independent data processing paths in a control system, and to increase the flexibility of the data transmission between the data processing paths.
These problems are solved by the subject matter of the independent claims. Further embodiments of the invention can be derived from the dependent claims and the following description.
One aspect of the invention relates to a control system for a vehicle. The vehicle can be a semiautonomous or autonomous vehicle. The vehicle can be a passenger automobile, truck, or bus. The control system can comprise numerous sensors and a central control unit that controls the autonomous or semiautonomous driving behavior of the vehicle, e.g. in that it generates control commands for a drive, braking system and steering system.
The control system in one embodiment of the invention contains a computing unit with a first subunit and second subunit, wherein the first subunit receives and processes sensor data from at least one first sensor, and performs first vehicle control functions on the basis thereof, and the second subunit receives and processes second sensor data from at least one second sensor, and performs second vehicle control functions on the basis thereof. The first and second sensors comprise radar, camera, and lidar sensors, for example. The first subunit and second subunit can be redundant units, which can perform their control functions only on the basis of the sensor data that they receive. The first and second control functions can comprise the creation of a model of the environment and/or classification of the sensor data on the basis of machine learning algorithms, for example. The first and second control functions can also comprise controlling the vehicle on the basis of the driving order and the evaluated first and/or second control data.
The first subunit according to one embodiment of the invention contains at least one first interface unit for receiving the first sensor data, one first processor for performing the first control functions, and one first connection unit for transmitting the first sensor data to the first processor. The second subunit can also contain at least one second interface unit for receiving the second sensor data, one second processor for performing the second control functions, and one second connection unit for transmitting the second sensor data to the second processor. Each of the subunits can provide a data transmission path from the respective sensors to the respective processors via the interface unit and the connection unit.
It should be understood that the connection units and/or processors can have the same design. The processors can be high power computers. They can comprise CPUs, GPUs and/or modules that simulate neural networks.
It should also be understood that there can be numerous first interface units that are connected to numerous first sensors, and/or numerous second interface units that are connected to numerous second sensors.
The first connection unit contains a first data exchange block and the second connection unit contains a second data exchange block according to one embodiment of the invention. The first data exchange block is configured to transmit the first sensor data to the second data exchange block and the second data exchange block is configured to transmit the first sensor data to the second processor. The second processor is configured to perform the second control functions on the basis of the first sensor data. It can also be the case that the second data exchange block is configured to transmit the second sensor data to the first data exchange block, and the first data exchange block is configured to send the second sensor data to the first processor, and the first processor is configured to perform the first control functions on the basis of the second sensor data.
The first data exchange block and second data exchange block thus form an interface unit between the two subunits. All of the sensor data exchanged between the two subunits can be sent over these interface units.
The first processor and second processor can perform their functions on the basis of the first and second sensor data. The first and second subunits can also provide redundant functions if only the first sensor data or second sensor data are received, for example. This may be the case if sensors that provide these data malfunction.
The number and types of interface units between the two subunits can be reduced with the interface units provided by the first data exchange block and second data exchange block. The data exchange can take place via a single shared intermediate connection.
The transmission of sensor data between the first data exchange block and second data exchange block takes place according to one embodiment of the invention with an exchange protocol. The exchange protocol can be a standard protocol such as PCI express or Ethernet. The first data exchange block can translate the first sensor data received in a first sensor transmission protocol into the exchange protocol. The second data exchange block can also translate the second sensor data received in a second sensor transmission protocol into the exchange protocol.
The first sensor transmission protocol and second sensor transmission protocol can be the same protocol and/or they can be based on the same or different standard protocols. By way of example, the first sensor transmission protocol and/or second sensor transmission protocol can be Ethernet or CAN bus protocols. In general, a protocol refers to a data transmission process in this context. The protocol can be defined by a standard, or it can be a proprietary protocol.
The transmission of sensor data between the first data exchange block and second data exchange block takes place according to one embodiment of the invention by means of differential signaling, in order to separate the first subunit and second subunit with regard to an electrical potential. The coupling of the data exchange blocks and thus the subunits can take place via an AC (alternating current) coupling. This is so that the data exchange takes place using a differential pair of signals. Differential signaling involves transmitting signals with voltages of opposite polarities on two lines. Such a transmission can be implemented with a CAN bus or Ethernet, for example.
In the case of the loss of a power supply for one of the subunits, a reverse supply from another supply area can be prevented with differential signaling. This can increase the reliability of the control system and/or the computing unit, because more easily separated power supplies are provide for the different independent data transmission paths.
The first subunit receives first sensor data from at least two first sensors according to one embodiment of the invention. The data exchange between the first data exchange block and second data exchange block can take place using a time-slot method in which first sensor data from different first sensors are transmitted in successive time slots. In the same manner, the second subunit can also receive second sensor data from at least two second sensors. The data exchange between the first data exchange block and second data exchange block in this case can also take place using a time-slot method in which second sensor data are transmitted from different second sensors in successive time slots. The time-slot method can take place in particular with a static data rate for each type of sensor data. The sensor data can be transmitted sequentially with a predictable latency. It is possible to separate different virtual channels at the lowest protocol levels via corresponding bit encoding processes.
The first connection unit conducts the first sensor data, which are encoded in the first sensor transmission protocol, to the first processor in the first sensor transmission protocol according to one embodiment of the invention. The second connection unit can also send the second sensor data, which are encoded in a second sensor transmission protocol, to the second processor in the second sensor transmission protocol. In other words, the first and second sensor data are only sent through the respective connection units, without altering the protocol structures.
It is possible that the first and/or second sensor data both come from at least two first and/or second sensors and are both encoded in at least two different sensor transmission protocols. These first and/or second sensor data can be sent to the first and/or second processors without being altered.
The first connection unit has a first protocol conversion block according to one embodiment of the invention, with which the first sensor data, which are encoded in a first sensor transmission protocol, are translated into a first processor transmission protocol and then sent to the first processor. The second connection unit can also have a second protocol conversion block, with which the second sensor data, which are encoded in a second sensor transmission protocol, are translated into a second processor transmission protocol and then sent to the second processor. As a result, the respective processors must only be configured to process the processor transmission protocol. The sensor data from different sensors, which may be encoded in different protocols, can be transmitted to the respective processors via the same interface unit. The processor transmission protocol can be PCI express, by way of example.
It is also possible for the first and/or second sensor data to both come from at least two first and/or second sensors, and to each be encoded in at least two different sensor transmission protocols. These at least two different sensor transmission protocols can be translated by the respective protocol conversion blocks into the processor transmission protocol.
According to one embodiment of the invention, the first sensor data, which have been translated into the first processor transmission protocol, are translated into the exchange protocol by the first data exchange block to be sent to the second data exchange block. It is also possible for the second sensor data, which have been translated into the second processor transmission protocol, to be translated into the exchange protocol by the second data exchange block, to be sent to the first data exchange block. As a result, the data exchange blocks only have to translate one type of protocol.
It is also possible for the first and/or second processor transmission protocols to be the same as the exchange protocol.
Instead of translating the one or more sensor transmission protocols directly into the processor transmission protocol, the one or more sensor transmission protocols can be translated into an intermediate transmission protocol, which is then translated into the processor transmission protocol and the exchange protocol. By way of example, the sensor data can be sorted in a first step, such that they can more easily be translated into the processor transmission protocol and the exchange protocol. As a result, the data does not have to be sorted twice.
In one embodiment of the invention, the first connection unit contains a first protocol conversion block, with which the first sensor data, which have been encoded in a first sensor transmission protocol, are translated into a first intermediate transmission protocol. The first sensor data, which have been translated into the first intermediate transmission protocol, can then be translated into the first processor transmission protocol by the first protocol conversion block, and sent to the first processor. The first sensor data, which have been translated into the first intermediate transmission protocol, can be translated into the exchange protocol by the first data exchange block, to be sent to the second data exchange block.
In the same manner, the second connection unit can contain a second protocol conversion block, with which the second sensor data, which have been translated into a second sensor transmission protocol, are translated into a second intermediate transmission protocol. The second sensor data, which have been translated into the second intermediate transmission protocol, can be translated into the second processor transmission protocol by the second protocol conversion block, and sent to the second processor. The second sensor data, which have been translated into the second intermediate transmission protocol, can be translated into the exchange protocol by the second data exchange block, to be sent to the first data exchange block.
It is also possible for the first and/or second sensor data to come from at least two first and/or second sensors, and to be encoded in at least two different sensor transmission protocols. These at least two different sensor transmission protocols can be translated by the respective protocol conversion block into the intermediate transmission protocol.
In one embodiment of the invention, the first connection unit and second connection unit are hardware modules. All of the components of the first connection unit and second connection unit, such as the first and second data exchange blocks and/or the first and second protocol conversion blocks, can be in the form of hardware.
The first connection unit and second connection unit can each be an FPGA. FPGAs support different interface standards and/or interface protocols, which therefore do not have to be implemented separately. Because their logic systems can be configured in different ways, FPGAs offer a flexibility that makes it possible to implement and combine the connection units efficiently.
The first connection unit and second connection unit can also be implemented in the form of ASICs. Other solutions for the connection units are also fundamentally possible, such as switches, hubs, etc.
Another aspect of the invention relates to a vehicle that has the control system described above, which is described in greater detail below. In addition to the control system, the vehicle can also comprise a drive and other actuators such as a braking system and/or steering system.
Exemplary embodiments of the invention shall be explained in detail below in reference to the drawings.
The reference symbols are listed with the elements to which they refer in the list of reference symbols. Identical or similar parts are given the same reference symbols.
It should be understood that the components 26a, 26b, 28a, 28b, 30a, 30b can be hardware modules in the computing unit 22.
As shall be described in greater detail below, the sensor data 36a, 36b are forwarded to the processors 30a, 30b via the connection units 28a, 28b. The sensor data 36a, 36b are indicated by broken lines. Using the connection units 28a, 28b, it is possible for both processors 30a, 30b to receive and process the sensor data 36a, 36b that are sent to the respective subunits 24a, 24b in a normal operation thereof. It is also possible for the processors 30a, 30b to perform their functions when certain sensors 32a, 32b malfunction and/or their connections to the computing unit 22 are interrupted, when only the sensor data 36a, 36b from their subunits 24a, 24b are received and/or when only the sensor data 36a, 36b in another subunit 24a, 24b are received. The subunits 24a, 24b can provide redundant data paths in this manner.
The processors 30a, 30b can comprise CPUs, GPUs and/or other hardware modules with which machine learning algorithms can be performed, which evaluate and classify the sensor data 36a, 36b, and generate control commands 38a, 38b for the drive therefrom. In general, the first processor 30 performs first control functions 40a, and the second processor 30b performs second control functions 40b.
In summary, the control system 14 contains a computing unit 22 with a first subunit 24a and a second subunit 24b, wherein the first subunit 24a receives and processes first sensor data 36a from at least one first sensor 32a, and performs first control functions 40a of the vehicle 10 on the basis thereof, and the second subunit 24b receives and processes second sensor data 36b from at least one second sensor 32b, and performs second control functions 40b of the vehicle 10 on the basis thereof. The first subunit 24a has at least one interface unit 26a for receiving the first sensor data 36a, a first processor 30a for performing the first control functions 40a, and a first connection unit 28a for transmitting the first sensor data 36a to the first processor 30a. The second subunit 24b has at least one second interface unit 26b for receiving the second sensor data 36b, a second processor 30b for performing the second control functions 40b, and a second connection unit 28b for transmitting the second sensor data 36b to the second processor 30b.
Each of the connection units 28a, 28b has a data exchange block 42a, 42b with which the two subunits 24a, 24b can exchange sensor data 36a, 36b. The data exchange blocks 42a, 42b convert the sensor data 36a, 36b, which can be encoded and/or transmitted in different sensor transmission protocols 44a, 44b and/or transmission standards, into an exchange protocol 46. The respective sensor data 36a, 36b are then sent with the exchange protocol 46 to the other data exchange block, and then sent from the other connection unit 28a, 28b to the associated processor, also by means of the exchange protocol 46, for example.
The transmission of sensor data 36a, 36b between the first data exchange block 42a and second data exchange block 42b takes place by means of an exchange protocol 46. The first sensor data 36a, which are received in a first sensor transmission protocol 44a, are translated the into the exchange protocol 46 by the first data exchange block 42a. The second sensor data 36b, which are received in a second sensor transmission protocol 44b, are also translated the into the exchange protocol 46 by the second data exchange block 42b.
As shown in
In summary, the first data exchange block 42a is configured to transmit the first sensor data 36a to the second data exchange block 42b. The second data exchange block 42b is configured to transmit the first sensor data 36a to the second processor 30b. The second processor 30b is configured to perform the second control functions 40b on the basis of the first sensor data 36a. In the same manner, the second data exchange block 42b s configured to transmit the second sensor data 36b to the first data exchange block 42a, wherein the first data exchange block 42a is configured to transmit the second sensor data 36b to the first processor 30a, and the first processor 30a is configured to perform the first control functions 40a on the basis of the second sensor data 36b.
Because there is only one interface unit between the two subunits 24a, 24b, this interface unit can also be used to decouple the two from one another. The data transmission between the two data exchange blocks can take place with an AC coupling, or with an AC coupled signal. In particular, the transmission of sensor data 36a, 36b between the first data block 42a and second data block 42b can take place with differential signaling, in order to separate the first subunit 24a from the second subunit 24b with regard to an electrical potential.
Furthermore, the standardized interface unit can be used to exchange the sensor data 36a, 36b between the subunits 24a, 24b in the same manner. The sensor data 36a, 36b can be exchanged via a single physical channel that has been subdivided into numerous virtual channels. A time slot method can be used for this. In particular, sensor data 36a, 36b from various sensors can be transmitted in different time slots.
The first subunit 24a can receive first sensor data 36a from at least two first sensors 32a and the data exchange between the first data exchange block 42a and second data exchange block 42b can take place using a time slop method in which the first sensor data 36a from various first sensors 32a are transmitted successively in time slots. In the same manner, the second subunit 24b can receive second sensor data 36b from at least two second sensors 32b and the data exchange between the first data exchange block 42a and second data exchange block 42b can take place using a time slot method in which second sensor data 36b from various second sensors 32b are transmitted successively in time slots.
As is shown in
Protocol conversion blocks 48a, 48b first translate the sensor data 36a, 36b optionally into an intermediate transmission protocol 54 and into a processor transmission protocol 50a, 50b. The sensor data 36a, 36b can then be translated into the exchange protocol by the data exchange block 42a, 42 from the intermediate transmission protocol 54, or directly from the processor transmission protocol 50a, 50b. By way of example, the sensor data 36a, 36b can first be recoded into another format with the intermediate transmission protocol 54, from which the sensor data 36a, 36b can be generated in the processor transmission protocol 50a, 50b and the exchange protocol 46 with less computing effort.
On the whole, the first sensor data 36a, which are encoded in a first sensor transmission protocol 44a, are translated into the first processor transmission protocol 50a by the first protocol conversion block 48a, and forwarded to the first processor 30a. The second sensor data 36b, which are encoded in a second sensor transmission protocol 44b, are translated into the second processor transmission protocol 50b by the second protocol conversion block 48b, and forwarded to the second processor 30b.
The first sensor data 36a, which have been translated into the first processor transmission protocol 50a, can then be translated into the exchange protocol 46 by the first data exchange block 42a. The second sensor data 36b, which have been translated into the second processor transmission protocol 50b, can then be translated into the exchange protocol 46 by the second data exchange block 42b.
It is also possible for the first sensor data 36a, which have been translated in the first protocol conversion block 48a into the first sensor transmission protocol 44a, to be translated into an intermediate transmission protocol 54, and the first sensor data 36a, which have been translated into the intermediate transmission protocol 54, can subsequently be translated into the first processor transmission protocol 50a, and forwarded to the first processor 30a. In this case, the first sensor data 36a, which have been translated into the intermediate transmission protocol 54, can then be translated into the exchange protocol 46 by the first data exchange block 42a.
In the same manner, the second sensor data 36b, which are encoded in a second sensor transmission protocol 44b, can be translated into the intermediate transmission protocol 54 by the second protocol conversion block 48b, with which the second sensor data 36b, which have been translated into the intermediate transmission protocol 54, are subsequently translated into the second processor transmission protocol 50, and then forwarded to the second processor 30b. The second sensor data 36b, which have been translated into the intermediate transmission protocol 54, can then be translated the into the exchange protocol 46 by the second data exchange block 42b.
In both
The data path from the first processor 30a via the first connection unit 38a to the second connection unit 28b and from there to the second processor 30b can also be used for the data exchange between the processors 30a and 30b. In the same manner, the data transmission can take place in the opposite direction, from the second processor 30b to the first processor 30a. A conversion of the protocols takes place in a manner comparable to the conversion of the protocols for the sensor data.
It should also be noted that the term “comprising” does not exclude any other elements or steps, and “one” or “a” do not exclude a plurality. It should also be noted that features or steps described in reference to any of the exemplary embodiments described above can also be used in combination with other features or steps in other exemplary embodiments described above. Reference symbols in the claims are not to be regarded as limiting.
10 vehicle
12 drive
14 control system
16 sensor data
18 sensor
20 control commands
22 computing unit
24
a first subunit
24
b second subunit
26
a first interface unit
26
b second interface unit
28
a first connection unit
28
b second connection unit
30
a first processor
30
b second processor
32
a first sensor
32
b second sensor
34
a first group
34
b second group
36
a first sensor data
36
b second sensor data
38
a first control command
38
b second control command
40
a first control function
40
b second control function
42
a first data exchange block
42
b second data exchange block
44
a first sensor transmission protocol
44
b second sensor transmission protocol
46 exchange protocol
48
a first protocol conversion block
48
b second protocol conversion block
50
a first processor transmission protocol
50
b second processor transmission protocol
54 intermediate transmission protocol
Number | Date | Country | Kind |
---|---|---|---|
10 2020 206 295.1 | May 2020 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2021/061646 | 5/4/2021 | WO |