Patent Application
20190111921
This patent application claims priority to European Patent Application No. 17196570.0, filed 16 Oct. 2017, the disclosure of which is incorporated herein by reference in its entirety.
Illustrative embodiments relate to a method for collision avoidance between a vulnerable road user transportation vehicle and a transportation vehicle in the vicinity. Illustrative embodiments further relate to a corresponding vulnerable road user transportation vehicle, a corresponding further transportation vehicle as well as a corresponding computer program.
An exemplary embodiment is illustrated in the drawings and is explained in more detail below with reference to the figures, in which:
In cities, there is a high risk of accidents involving cyclists. Accidents are usually caused by incorrect behavior on the part of cyclists, but also by other road users. Frequently, accidents occur in the case of incorrect or prohibited use of the road, errors in moving into the flow traffic, unadjusted speed, or incorrect behavior during turning.
The subject application therefore is concerned with an important property of a safety package for vulnerable road user transportation vehicles, e.g., bicycles. According to this concept radio messages will be sent about the position, speed, direction and other parameters such as bicycle size, lean angle, acceleration of a cyclist to the local road users in the vicinity. These messages are processed by appropriately equipped surrounding transportation vehicles and, in the event of a danger, lead to the driver being warned or the launch of an autonomous collision avoidance maneuver when autonomous driving technology is involved. These kinds of systems are already known in the automotive sector.
From DE 102 45 796 A1 a method of determining the current locomotion mode of a road user who is making use of a mobile telephone is known. Such method involves, that the place of the road user is successively determined on the basis of successive radiolocation instants. A vector chain of the locations as well as a vector sequence of the velocities of the mobile telephone is determined. Thereby a link of a respective place of the road user with a digital Road map, a so-called “map matching technique” is used to determine the way of locomotion of the road user.
From DE 103 34 203 A1 a method for organizing traffic on the road is known which aims at minimizing road accidents. The position of vulnerable road users, particularly pedestrians or two-wheelers can be determined by the mobile phones of such road users. Core of the process according to the disclosure is that at least within an adjustable range, two traffic users moving in this range engage automatically in a direct intercommunication and inform each other about their locomotion. Through the direct and, above all, situation-based automatic intercommunication of the road users is the intermediate involvement of a control center to clear the situation superfluous. Valuable time is saved and automatic warnings as well as possible automatic interventions will be so promptly triggered, that causing an accident can be safely prevented.
From DE 10 2008 012 655 A1 an apparatus for determining the relative position between a first and a second transportation vehicle is known. For determining a relative position between two transportation vehicles the position data of the adjacent transportation vehicles with certain metadata will be transferred to the other transportation vehicle. The transmission occurs, for example, by direct vehicle-to-vehicle communication or by way of a detour via a central station. The metadata can be used to make a selection of the available satellites for the position determination in the other transportation vehicle. In this way, it is possible to minimize the systematic errors resulting from a different selection of the satellites in the two transportation vehicles for the position determination with GPS signals as a result. In the inner city area, where the satellite signals are not always readily receivable, the signals from a direction sensor, distance sensor and steering wheel angle sensor for the position determination can also be evaluated.
In view of the prior art mentioned above, there is still a problem that the position determination, which is solely based on satellite navigation is not precise enough for the purpose of a collision avoidance in connection with vulnerable road user transportation vehicles. E.g., the precision of the position determined with GPS signals is announced to be ±7.5 m.
Disclosed embodiments improve the position determination method to increase safety for vulnerable road users.
Disclosed embodiments provide a method for collision avoidance between a vulnerable road user transportation vehicle and a surrounding transportation vehicle, a vulnerable road user transportation vehicle a transportation vehicle, and a computer program.
The solution is based on an adaptation of the vulnerable road user transportation vehicle on one hand and, in particular, the exact localization of the vulnerable road user transportation vehicle through the interaction between VRU vehicle and the portable device of the VRU user, such as smartphone or tablet.
The solution works independently of the technology used for direct V2V or D2D communication (WLAN 802.11p, LTE-V, 5G).
First of all, it is mentioned that the vulnerable road user transportation vehicle will be equipped with at least one odometer sensor supporting an independent position determination apart from the global navigation satellite system GNSS, such as Global Positioning System GPS, Globalnaja nawigazionnaj a sputnikowaj a sistema GLONASS, Galileo or Beidou. Moreover, the determination of the high precision position is done by interaction between VRU vehicle and portable user equipment. This interaction comprises an operation of transferring position detecting sensor data to the portable communication device. A wireless communication technology could be used for this data transfer, such as BLUETOOTH® or ZIGBEE® communication. In the portable communication device then there is executed an operation of evaluating the received position detecting sensor data and deriving position data therefrom for the vulnerable road user transportation vehicle. For the position detecting sensor data as odometer sensor data, an operation of performing a map matching technique is performed for refining the position data. It follows an operation of transferring the refined position data to the vulnerable road user transportation vehicle and in the vulnerable road user transportation vehicle an operation of distributing the refined position data to the surrounding transportation vehicles. The surrounding transportation vehicles can hence make use of the received position data to estimate a trajectory for the VRU vehicle, determine the risk of a collision and finally take an action to avoid a collision. This solution has several important benefits. Normally, a VRU makes use of a portable communication device such as smart phone or tablet. These portable communication devices typically are equipped with GPS module and offer the feature of satellite navigation. It also has enough CPU power to execute evolved algorithms. On the other hand the VRU vehicle is better suited for participating in direct D2D or V2V communication. E.g., it is bigger in size than the portable communication device and can be equipped with multiple antennas at different places. The places for mounting the antennas can have better direct sight to the satellites of the satellite navigation system and also to other road participants. Also it is equipped with a high capacity battery and hence can deliver enough power for a prolonged direct D2D or V2V communication phase.
An alternative solution which is also regarded as an exemplary embodiment is that not the bare position detection sensor data is transferred to the portable device but the completed position data which is derived from the position detection sensor data. In this case there is no need for performing the operations of evaluating the position detection sensor data and deriving the position data in the portable device.
Another beneficial measure is if the vulnerable road user transportation vehicle is equipped with at least two different position detection sensors and in the portable communication device an operation of performing a data fusion algorithm with the position data derived from the received different position detecting sensors is performed. Both help subjectively to improve the precision of the position determination.
For improving safety of the user of the VRU vehicle, a surrounding transportation vehicle performs an operation of calculating a trajectory for the vulnerable road user transportation vehicle based on the position data received in the distribution operation, determining the risk of a collision and if the risk of a collision exceeds a certain level, performing a collision avoidance maneuver and/or outputting a warning message to the driver of the surrounding transportation vehicle. Such algorithms need to be installed in the transportation vehicle anyhow if cooperative driving and/or autonomous driving shall be supported. Making autonomous collision avoidance maneuvers with the VRU vehicle is more difficult since the user is not at all protected.
For the communication between VRU vehicle and the portable communication device for the operation of transferring the position detecting sensor data it is beneficial that it is performed by a short range wireless communication technique, such as BLUETOOTH® or ZIGBEE®. These communication systems are standardized and are readily available on the market and can be implemented without causing high costs. The user just needs to associate his portable communication device with the VRU vehicle before starting a route. This can be done automatically when a pairing has been established before.
For a vulnerable road user transportation vehicle, such as bicycle, motorcycle, scooter, wheel chair, or roller, it is beneficial if it comprises at least two different position detecting sensors, a communication module and an antenna module.
It is further of benefit if the antenna module comprises at least two antennas for applying an antenna diversity technique such as MISO corresponding to multiple input single output, SIMO corresponding single input multiple output or MIMO corresponding to multiple input multiple output processing. When used in combination with diversity schemes, this improves the robustness of the communication against interferences.
Also beneficial for improving the exactness of the position determination is if the at least two position detection sensors comprise at least two of the sensors a wheel tick sensor, an inertial measurement unit, and an absolute positioning system module such as GPS, GLONASS, Galileo or Beidou.
Here, it is further beneficial that the communication module is capable to perform vehicle-to-vehicle communication V2V or device-to-device communication D2D according to one of the systems WLAN 802.11p corresponding to wireless LAN, LTE-V corresponding to Long Term Evolution-vehicle or 5G D2D corresponding to the 5. Generation mobile communication technology. These technologies are also specified and can be implemented without subjective research and development work.
The proposal also concerns, a corresponding transportation vehicle which is adapted to perform the operations of the surrounding transportation vehicle in the method according to one of the claims 1 to 4.
For a corresponding computer program it is beneficial that, the computer program comprises program operations, which when run in a computer carry out the operations of, evaluating the received position detecting sensor data and deriving position data for the vulnerable road user transportation vehicle, performing a map matching technique for refining the position data, and transferring the refined position data to the vulnerable road user transportation vehicle, which finally informs the other transportation vehicles in the vicinity. This computer program may be implemented as an app which could be installed on the portable device of the vulnerable road user, such as smart phone or tablet computer as mentioned before.
It is further beneficial if the computer program further comprises program operations, which when run in a computer carry out an operation of performing a data fusion algorithm with the position data derived from the different position detecting sensors. Such data fusion algorithm causes a high demand of computing time such that this type of calculation is better executed on the portable communication device which if it comes as a smartphone or tablet is equipped with a powerful central processing unit CPU.
In this case, the absolute position data indicate the measured position of the transportation vehicle at a certain time in absolute values, for example, in a UTM or WGS84 reference coordinate system. Optionally, the absolute position data may also be provided with an orientation, e.g., a current direction of movement of the transportation vehicle. A combination of position and orientation is often referred to as a pose. The position is usually expressed two-dimensionally in a Cartesian coordinate system.
The odometry position data, on the other hand, indicate a self-movement or relative movement of the transportation vehicle, for example, in an arbitrarily defined reference coordinate system or in the so-called transportation vehicle coordinate system (“body frame”). In this case, the self-movement, is indicated in each case relative to a preceding position of the transportation vehicle.
Corresponding benefits are apparent for a vulnerable road user transportation vehicle and a further transportation vehicle according to the proposal and a computer program according to the proposal as claimed.
The present description illustrates the principles of the present disclosure. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the disclosure.
All examples and conditional language recited herein are intended for educational purposes to aid the reader in understanding the principles and concepts of the disclosure to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
Moreover, all statements herein reciting principles, properties, and embodiments of the disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
Thus, for example, it will be appreciated by those skilled in the art that the diagrams presented herein represent conceptual views of illustrative circuitry embodying the principles of the disclosure.
The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, read only memory (ROM) for storing software, random access memory (RAM), and nonvolatile storage.
Other hardware, conventional and/or custom, may also be included. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
In the claims hereof, any element expressed as a method or mechanism for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The disclosure as defined by such claims resides in the fact that the functionalities provided by the various recited methods or mechanisms are combined and brought together in the manner which the claims call for. It is thus regarded that any method or mechanism that can provide those functionalities are equivalent to those shown herein.
Another transportation vehicle is labeled with reference number 20. That transportation vehicle is a bigger size transportation vehicle with 3, 4 or more wheels. The term transportation vehicle is to be understood as a collective term for transportation vehicles with an internal combustion engine or an electric motor. Whether for, passenger cars, trucks, buses, agricultural transportation vehicles or construction machines. The list is not exhaustive and includes other transportation vehicle categories.
For these types of transportation vehicles there exist a plurality of communication techniques. Transportation vehicles participate in mobile communication since long, and now with cooperative or autonomous driving technologies arising there is also a focus on transportation vehicle direct communication, which is necessary for this purpose. Various systems for transportation vehicle communication are developed. Examples include WLAN-based transportation vehicle communication, also called “ad-hoc domain”, and transportation vehicle communication in the field of mobile radio networks. In the case of mobile radio-based technology, however, the base station has to transmit the messages from transportation vehicle to transportation vehicle. This is the area where communication takes place in the so-called “Infrastructure Domain” For the future mobile radio generation, the transportation vehicle direct communication is also made possible. In LTE, according to Long Term Evolution, this option is called LTE-V corresponding to LTE vehicle, and in the case of the 5G initiative this option is often called D2D for device two device communication.
Such transportation vehicles 20 are equipped with a communication module, which serves as a transmitting and receiving unit for communication in a mobile radio network. All messages from the transportation vehicle 20 (uplink) and to the transportation vehicle 20 (downlink) are routed either via a base station 30 which serves a mobile radio cell or, in the case of direct transportation vehicle communication (Sidelink), directly between a plurality of the transportation vehicles 20. If the transportation vehicles 20 are within this mobile radio cell, they are registered or logged in at the base station 30. If they leave the mobile cell, they are handed over to the neighboring cell (handover) and accordingly logged out or logged off at the base station 30. The base station 30 also provides access to the Internet so that the transportation vehicles 20 or all other mobile radio subscribers are supplied with Internet data in the mobile radio cell.
Such mobile radio technologies are standardized and reference is made here to the corresponding specifications of mobile radio standards. As a modern example of a mobile radio standard, reference is made to the 3GPP initiative and the LTE standard (Long Term Evolution). Many of the related ETSI specifications are currently available in the version 14. The following is mentioned as an example: ETSI TS 136 213 V13.0.0 (2016-05); Evolved Universal Terrestrial Radio Access (E-UTRA); Physical layer procedures (3GPP TS 36.213 version 13.0.0 Release 13).
The on-board unit 11 is a communication module which comprises a WLAN module or an LTE modem as indicated above.
In the following it is assumed that the on-board unit 11 comprises an LTE modem. This LTE modem is compliant with the specification for direct vehicle-to-vehicle communication LTE-V as above mentioned. This sort of direct V2V communication makes use of the sidelink communication direction as specified in the various LTE specifications. The on-board unit 11 may also be equipped with a BLUETOOTH® communication protocol stack such that the module is capable to exchange messages with an associated BLUETOOTH® partner station.
The method for collision avoidance is now described with the help of
At the beginning, the cyclist connects his mobile phone to the bicycle 10 via BLUETOOTH® communication. This corresponds to the well-known BLUETOOTH® association process. Bike and smartphone can communicate continuously. In the following we describe the collision avoidance procedure:
The bicycle measures a position using the GPS module 15. This task is better performed at the bicycle 10 than at the portable communication device, since the bicycle may be equipped with better antennas having a better direct visual connection to the sky than what is possible with the portable device. Several antennas 12 for the mobile communication can also be installed on the bicycle 10 for making use of an antenna diversity technique, in particular, reception diversity such as MISO technique corresponding to multiple input single output.
The bicycle 10 takes information about the movement of the wheels by the wheel-tick unit 13. This can only be done on the bicycle 10 with a sensor—this is not possible on the portable communication device. Moreover, the bicycle 10 receives information about the movement and orientation/inclination via the Inertial Measurement Unit (IMU) 14 and GPS data from the GPS module 15. The bicycle 10 transmits the recorded data to the portable communication device. All this happens in operation at 101 of
The smart phone evaluates the position sensor data and calculates position data for the bicycle in operations at 102 and 103. The calculation is performed with the recorded raw data that had been collected in operation at 101. The way the smartphone calculates the bicycle position is basically a known process. E.g., smartphones and tablets are anyway capable to calculate the absolute position of the smartphone, since they are usually equipped with a navigation app, like “Google Maps”, a trademark from Google Inc. The calculation of the position is carried out in operation at 103. Operations at 102 and 103 are optional and will be left out if the GPS module delivers completed position data on its own.
The portable device performs an operation of map matching in operation at 104 with the position data to improve the position quality. The map matching technique maps the measured position with the map information about the location and geometry of objects in the map so that the most likely position of the object is determined in the map. Also the map matching technique is used in conventional navigation systems, such that it is referred to such state of the art solutions for further details.
The different sensor systems, odometry with WTS and IMU sensor and GPS deliver different results for the bicycle position. Both position results are subject to errors. In operation at 105 then the technique of data fusion is applied on the different position data. This technique is capable of merging the different position results. With this technique the precision of the position determination is subjectively increased. Also the data fusion technique, sometimes also called “sensor fusion” is known in the state of the art. Applicant refers to the former application of the applicant with application number DE 10 2017 108 130.5 for further details about the data fusion technique.
The map matching technique requires that map data is updated frequently to perform this operation with high precision. The data fusion technique comprises a high demand of calculation expenditure. Therefore, these operations should be better performed on the portable device than on bicycle 10.
The finished position is sent back to the bicycle 10 in operation at 106.
The bike distributes information on the finished position (see above) and dimensions of the bicycle 10 to all road users in operation at 107. This is implemented using one of the possible communication technologies that allow direct communication with the environment (802.11p, LTE-V, future 5G D2D technology). The distribution of that information can be done significantly better than with the portable device: As above mentioned, it can be equipped with better antennas for the V2V, D2D or car2car direct communication. Furthermore, the continuous emission of signals also requires energy. This can be provided on the bicycle more easily than on the portable device.
The surrounding transportation vehicles which receive the bicycle 10 position information use it to calculate on their own the bicycle trajectory. The trajectory describes the bicycle movement in a certain time period which typically also comprises a time period in the future such that the transportation vehicle 20 has an estimate of where the bicycle 10 will go to be able to estimate the a risk of a collision. The bike trajectory is predicted in operation at 108 and the risk of a collision is calculated in operation at 110. If transportation vehicle 20 recognizes a certain risk of a collision, it outputs a warning message to the driver. An alternative embodiment of the solution is that the transportation vehicle automatically performs a collision avoidance maneuver without waiting for the reaction of the driver. Here, the transportation vehicle could perform a strong braking action or an emergency braking action to avoid a collision with the bicycle.
A good overview about different ways to calculate such collision avoiding maneuver is described in a thesis report of Dr. Thomas Maurer titled “Bewertung von Mess-und Pradiktionsunsicherheiten in der zeitlichen Eingriffsentscheidung für automatische Notbrems-und Ausweichsysteme” at University Duisburg-Essen. Another detailed example of such a system is described in the pending application of the applicant with the number K24686.
It is to be understood that the proposed method and apparatus may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. Special purpose processors may include application specific integrated circuits (ASICs), reduced instruction set computers (RISCs) and/or field programmable gate arrays (FPGAs). Optionally, the proposed method and apparatus is implemented as a combination of hardware and software. Moreover, the software may be implemented as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Optionally, the machine is implemented on a computer platform having hardware such as one or more central processing units (CPU), a random access memory (RAM), and input/output (I/O) interface(s). The computer platform also includes an operating system and microinstruction code. The various processes and functions described herein may either be part of the microinstruction code or part of the application program (or a combination thereof), which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
It should be understood that the elements shown in the figures may be implemented in various forms of hardware, software or combinations thereof. Optionally, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces. Herein, the phrase “coupled” is defined to mean directly connected to or indirectly connected with through one or more intermediate components. Such intermediate components may include both hardware and software based components.
It is to be further understood that, because some of the constituent system components and method operations depicted in the accompanying figures may be implemented in software, the actual connections between the system components (or the process operations) may differ depending upon the manner in which the proposed method and apparatus is programmed Given the teachings herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the proposed method and apparatus.
The disclosure is not restricted to the exemplary embodiments described here. There is scope for many different adaptations and developments which are also considered to belong to the disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 17196570.0 | Oct 2017 | EP | regional |
