This application claims the benefit under 35 U.S.C. § 119(a)-(d) of United Kingdom Patent Application No. 2209599.6, filed on Jun. 30, 2022 and entitled “Improved communications within an intelligent transport system to anticipate the behavior of mobile objects”. The above cited patent application is incorporated herein by reference in its entirety.
The present disclosure relates generally to Intelligent Transport Systems (ITS) and more specifically to Cooperative Intelligent Transport Systems (C-ITS).
Cooperative Intelligent Transport Systems (C-ITS) is an emerging technology for future transportation management that aims at improving road safety, traffic efficiency, and driver experience.
Intelligent Transport Systems (ITS), as defined by the European Telecommunications Standards Institute (ETSI), include various types of communication such as:
C-ITSs are not restricted to road transport as such. More generally, C-ITS may be defined as the use of information and communication technologies (ICT) for rail, water and air transport, including navigation systems. Such various types of C-ITS generally rely on radio services for communication and use dedicated technologies.
Such C-ITSs are subject to standards, specified for each country and/or territory where C-ITSs are implemented. Today, in Europe, the European Telecommunications Standards Institute is in charge of the elaboration of the specifications forming the standards to which C-ITSs are subjected.
Cooperation within C-ITSs is achieved by exchange of messages, referred as to ITS messages, between ITS stations (denoted ITS-Ss). The ITS-Ss may be vehicles, Road Side Units (RSUs), Vulnerable Road Users (VRUs) carrying an ITS equipment (for instance included in a smartphone, a GPS device, a smart watch, or in a cyclist equipment), or any other entities or infrastructure equipped with an ITS equipment, as well as central subsystems (back-end systems and traffic management centers).
As observed above, C-ITSs may support various types of communications, for instance between vehicles (vehicle-to-vehicle or “V2V”), referring to all kinds of road users, e.g., car-to-car, or between vehicles and stationary stations such as vehicle-to-infrastructure or “V21”, and infrastructure-to-vehicle or “I2V”, e.g., car-to-infrastructure.
Such exchanges of messages may be performed via a wireless network, referred to as “V2X” (for “vehicle” to any kind of devices) networks, examples of which may include 3GPP LTE-Advanced Pro, 3GPP 5G, or IEEE 802.11p technology (3GPP, LTE, and IEEE are Registered Trade Marks).
Exemplary ITS messages include Collective Perception Messages (CPMs), Cooperative Awareness Messages (CAMs), and Decentralized Environmental Notification Messages (DENMs). An ITS-S sending an ITS message is named an “originating” ITS-S and an ITS-S receiving an ITS message is named a “receiving” ITS-S.
It is recalled here that ETSI TS 103 324 (V0.0.29 of May 2022) standard defines the Collective Perception Service, that may be used by an ITS-S having an on-board sensor system to detect objects in its vicinity and to transmit, using broadcast CPMs, description information (e.g., its dynamics such as a position and/or kinematic information) thereof. The CPMs are generally periodically sent with a period varying from 100 milliseconds to one second depending, for example, on the speed of the objects sensed by the originating ITS-S.
It is also to be noted that the EN 302 637-2 (V1.4.1 of April 2019) standard defines the Cooperative Awareness Basic Service, that may be used by an ITS-S to transmit, using broadcast CAMs, its ego-vehicle dynamics (e.g., its position and speed).
It is also to be noted that the EN 302 637-3 (V1.3.1 of April 2019) standard defines the Decentralized Environmental Notification Basic Service, that may be used by an originating ITS-S to send, using broadcast DENMs, notifications to other ITS-Ss, such as warnings or alerts. Such a message notifies of an event (e.g., a road hazard, driving environment information, traffic condition information, etc.) detected by the originating ITS-S.
As mentioned above, the Collective Perception Service allows a sensor-equipped ITS station to share, on a periodic basis, its perceived objects (e.g., vehicles or pedestrians) with other nearby ITS stations to improve their local environment perception using broadcast Collective Perception Messages (CPMs). The receiving ITS stations can then update their local environment model (LEM) with objects perceived by other ITS stations, and perform an association process with the data obtained from their on-board sensors to improve the reliability of the local environment model data. It is observed that CPMs complying with a first CPM version mainly contain information about the current state of the objects (e.g a current position, a current speed, an object classification, etc.) while CPMs complying with a second CPM version may include “predictions” related information to include potential future states of objects.
While exchanging items of information regarding the objects perceived by each ITS stations enables an overall improvement in safety of the ITS users, it should be kept in mind that exchanging data between ITS stations is resource intensive (e.g., bandwidth, processing, etc.) and that only truly useful data should be transmitted. Therefore, there is a constant need to improve the selection of transmitted data to increase the overall safety of the system.
The present invention has been devised to address one or more of the foregoing concerns.
According to a first aspect of the disclosure, there is provided a method of communication in an intelligent transport system, ITS, comprising, at an originating ITS station, ITS-S, monitoring an area:
Accordingly, the method of the disclosure makes it possible to transmit predicted data and associated context information enabling a receiving ITS station to process efficiently received predicted data and thus, to optimize use of resources in an ITS.
According to some embodiments, the at least one element is different from the perceived object.
According to some embodiments, the predicted behavior comprises a predicted position or a predicted trajectory including a set of consecutive predicted positions.
Still according to some embodiments, the item of information characterizing the predicted behavior comprises a danger level associated with an occurrence of the predicted behavior, a difficulty level representing a difficulty for predicting the behavior of the perceived object, and/or an indication of an existing or a predicted situation causing a possible occurrence of the predicted behavior.
Still according to some embodiments, the method further comprises determining the predicted behavior. Determining the predicted behavior comprises accessing knowledge associated with elements of the area, the knowledge associated with elements of the area being, for example, observed past trajectories, vehicle timetables, school timetables, and/or local events.
Still according to some embodiments, the method further comprises determining a state of the perceived object, wherein determining the predicted behavior is carried out as a function of the state of the perceived object, the item of information characterizing the predicted behavior comprising an indication of the state of the perceived object.
Still according to some embodiments, the method further comprises determining an attitude of the perceived object, wherein determining the predicted behavior is carried out as a function of the attitude of the perceived object, the item of information characterizing the predicted behavior comprising an indication of the attitude of the perceived object.
According to a second aspect of the disclosure, there is provided a method of communication in an intelligent transport system, ITS, comprising, at a receiving ITS station, ITS-S:
Accordingly, the method of the disclosure makes it possible to receive predicted data and associated context information enabling the receiving ITS station to process efficiently the received predicted data and thus, to optimize use of resources in an ITS.
According to some embodiments, the at least one element is different from the perceived object.
Still according to some embodiments, the method further comprises determining a predicted behavior of the perceived object, the determined predicted behavior or the received predicted behavior being considered as a result of the analyzing.
Still according to some embodiments, the item of information characterizing the predicted behavior comprises a danger level associated with an occurrence of the predicted behavior, a difficulty level representing a difficulty for predicting the behavior of the perceived object, an indication of an existing or a predicted situation causing a possible occurrence of the predicted behavior, and/or a state or an attitude of the perceived object.
This aspect of the disclosure has advantages similar to those mentioned above.
According to other aspects of the disclosure, there is provided a device configured for carrying out each of the steps of the method described above and a non-transitory computer-readable medium storing a program which, when executed by a microprocessor or computer system in an Intelligent Transport System station, ITS-S, causes the ITS-S to perform each step of the method described above.
These aspects of the disclosure have advantages similar to those mentioned above.
At least parts of the methods according to the disclosure may be computer implemented. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit”, “module” or “system”. Furthermore, the present disclosure may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium.
Since the solutions of the present disclosure can be implemented in software, the solutions of the present disclosure can be embodied as computer readable code for provision to a programmable apparatus on any suitable carrier medium. A tangible carrier medium may comprise a storage medium such as a floppy disk, a CD-ROM, a hard disk drive, a magnetic tape device or a solid state memory device and the like. A transient carrier medium may include a signal such as an electrical signal, an electronic signal, an optical signal, an acoustic signal, a magnetic signal or an electromagnetic signal, e.g., a microwave or RF signal.
Further advantages of the present invention will become apparent to those skilled in the art upon examination of the drawings and detailed description. Embodiments of the invention will now be described, by way of example only, and with reference to the following drawings, in which:
It is noted that the names of the lists and elements (such as data elements) provided in the following description are only illustrative. Embodiments are not limited thereto and other names could be used.
The embodiments of the present disclosure are intended to be implemented in Intelligent Transportation Systems (ITSs).
There exist ITS stations provided with some behavior analysis or trajectory prediction functions that enable prediction of future states of objects belonging to their local dynamic map. The results of the behavior analysis may lead to predicted trajectories that can be used to improve the decision-making of a traffic participant, e.g., to reduce a risk of collision or to select trajectories reducing a risk of congestion. This results in a higher level of traffic safety and/or in optimized traffic flow (reducing the level of emissions).
Since not all the ITS stations are equipped with the same processing capabilities, not all the ITS stations can obtain prediction by themselves. Accordingly, prediction related information, for example predicted behaviour such as predicted paths of perceived objects, may be exchanged between ITS stations within Collective Perception Message (CPM). However, adding predicted paths to all perceived objects by all ITS stations in messages that are exchanged between the ITS stations would increase the bandwidth used by the Collective Perception Service.
The inventors have observed that transmitting predicted paths without additional items of information may lead to wasting resources with data that are useless (e.g., predicted paths that are already known by a receiving ITS-S using its own prediction algorithm) or that are actually not usable (e.g., predicted paths for which a receiving ITS-S cannot determine a confidence level).
Accordingly, prediction information should be included in CPMs with other items of information to be useful to a receiving ITS-S, such other items of information being directed, for example, to specific knowledge of the originating ITS-S. For the sake of illustration, such originating ITS stations that should share their predictions with other ITS stations can be ITS stations that have specific knowledge of the considered local area (e.g., knowledge about bus timetables, about presence of temporary construction sites, about trajectories learnt over time, etc.) that other ITS station entering into this area do not have. This is typically the case for a roadside ITS station connected to an infrastructure that can provide local-area knowledge. Still for the sake of illustration, originating ITS stations that should share their predictions with other ITS stations can be ITS stations provided with on-board sensors comprising behavior analysis (e.g., on-board sensors or resources making it possible to detect the head and body orientation of a pedestrian, to detect the rising hand of a cyclist, etc., that is useful to predict that a human may cross the road or that a cyclist may turn).
According to some embodiments of the disclosure, a dangerousness value is associated with a predicted behavior so that a receiving ITS-S station may decide how to process the received predicted behavior. For the sake of illustration, a predicted behavior with a low probability of occurrence that is associated with a high dangerousness value should be handled more rigorously than a predicted behavior with a low probability of occurrence that is associated with a low dangerousness value. Therefore, an information item representing the predicted path dangerousness is preferably transmitted along with the corresponding predicted path so that receiving ITS station can analyze the trade-off between the predicted path probability and its dangerousness. In addition or in a variant, an information item representing the difficulty to determine a predicted behaviour such as a predicted path without having specific knowledge or specific behavior analysis capability is added to the transmitted message comprising the predicted data so that a receiving ITS station may analyze the trade-off between the predicted data probability and the difficulty to obtain such prediction.
Still according to some embodiments of the disclosure, an indication of a criterion (or reason) used by an originating ITS station to decide whether to share predicted data with other ITS stations (by transmitting these predicted data into a CPM) is transmitted along with the predicted data. By receiving the criterion or reason with a predicted behavior (e.g., a predicted path), the receiving ITS station can increase its level of trust in the plausibility of the prediction.
Still according to some embodiments of the disclosure, a predicted situation type is transmitted along with predicted data to ease the analysis of the latter. Such a predicted situation type (e.g., a human crossing a road, a vehicle slowing down, a vehicle stopping, etc.) may be detected by the originating ITS station transmitting the predicted data when analyzing a behavior and/or predicting a trajectory.
Therefore, a CPM, i.e. a message regularly transmitted by an originating ITS station to share objects, free spaces, or space states perceived by its local sensors, comprises predicted data concerning perceived objects and additional items of information associated with the predicted data. Examples of such additional items of information are a level of dangerousness associated with a predicted path, a reason why the originating ITS station has included predicted information, and/or a type of situation associated with predicted information (examples of such situation type being a human crossing the road, a cyclist turning, a vehicle slowing down, an obstacle bypassing, etc.).
A receiving ITS-S may use such additional items of information contained in a CPM and related to predicted data also contained in the CPM to determine the confidence it may have in the received predicted data before using them to update its local environment model. Accordingly, it can perform a quicker analysis of the prediction impact using the dangerousness or the situation type information.
According to this example, an ITS station, that may generate and transmit CPMs such as CPM 130, is embedded within a road side unit, RSU, 110. It is observed that RSUs have generally more processing resources to analyze behavior and predict trajectories than ITS-Ss embedded within moving vehicles. For example, an RSU may have a wider field of view than an ITS-S embedded within a vehicle, multiple fields of view, fast access to other information such as traffic conditions, traffic light status, knowledge of objects that populate the monitored area, etc.
In particular, a wide view of the area monitored by an RSU allows the RSU to learn and to analyze the trajectories of vehicles, motorbikes, cyclists, or pedestrians. The RSU may also have access to local peculiarities such as timetables of bus, school, presence of a temporary construction site, etc.
As illustrated, ITS 100 is implemented at an intersection and comprises stationary road side unit 110 and several entities that may carry or embed an ITS station (ITS-S) each, for transmitting and/or receiving ITS messages within the ITS. The several entities may be for example, vehicles 151, 152, 153, a motorbike 154, and a pedestrian 155.
Stationary road side unit 110 includes a set of sensors, such as image sensors, here video cameras 120, 121, 122, and 123 and an analytical module to analyze data provided by the sensors, such as analysis module (or situation analysis module) 111. Each of the video cameras 120, 121, 122, and 123 is configured to monitor or scan a portion of the area monitored by the RSU (here the road intersection), making it possible to acquire images and/or videos of the monitored area. Other sensors such as LIDARs (laser imaging detection and ranging devices) may also be used.
The sensors are connected to the analysis module (e.g., video cameras 120, 121, 122, and 123 are connected to analysis module 111) so that the analysis module may process the stream captured by the sensors/video cameras to analyze the traffic and to predict future states of the traffic participants. The analysis module and the sensors may be separated from or embedded within the same physical road side unit. For example, the analysis module may be wire-connected to sensors that may be remote sensors (i.e. not embedded within the road side unit).
The processing of the data received from the sensors by the analysis module, e.g., analysis module 111, aims at detecting objects potentially present in the monitored area, referred to as “perceived objects” or “detected objects” hereinafter. Mechanisms to detect such objects are well known by one skilled in the art.
The situation analysis module is also configured to output a list of the perceived objects respectively associated with corresponding description information referred to as “state vector”. The state vector for a perceived object may include for instance parameters such as a position, a kinematic, temporal information, behavioral or object type classification information, etc.
Therefore, the situation analysis module may identify, among the perceived objects, Vulnerable Road Users (VRUs) such as pedestrians and cyclists as well as motorcyclists and also persons with disabilities or reduced mobility and orientation. It may also identify objects such as trees, road construction/work equipment (e.g., road barriers), and so on.
A VRU may be considered as an ITS-S when carrying an ITS equipment, for example an ITS equipment included in a smartphone, a satnav system, a smart watch, or in a cyclist equipment.
According to the example illustrated in
In addition, the perceived objects may be classified. For example, if the perceived objects are ITS stations, they can be classified as vehicles, VRUs, RSUs, or any another ITS-S types. Such object type classification may be based for example on predetermined rules, provided during the setting up of road side unit 110, or more generally the ITS-S. It is observed that ETSI TR 103 562 V2.1.1 defines for instance the categories “unknown”, “vehicle”, “person”, “animal”, and “other”. Of course, other categories, more specific, may be defined.
According to some embodiments, the analysis module comprises behavior analysis and trajectory prediction functions to analyze the trajectories and the behavior of the perceived objects, to predict their future trajectories.
The analysis module may also have access to some information about the monitored area, e.g., about the road intersection geometry, about bus timetables, about school timetables, etc., that can be used to analyze the monitored area, enabling, for example, to predict that a bus will stop or turn on this road, that pedestrians will cross the road to go to a school entrance, etc.
As illustrated in
Thanks to roadside ITS-S 112, RSU 110 can share information relative to the perceived objects. Typically, RSU 110 can share such information with receiving ITS stations by sending ITS messages, particularly the so-called Collective Perception Messages, CPMs, e.g., CPM 130, for example as defined in documents ETSI TR 103 562 and ETSI TS 103 324, that are generally sent periodically. An example of the format of a CPM according to some embodiments of the present disclosure is illustrated in
More generally, any ITS-S in ITS 100 may share information on the objects it perceives, by sending CPMs, as well as information on itself, by sending so-called Cooperative Awareness Messages, CAMs, for example as defined in document ETSI EN 302 637-2. CAMs may include a position, a kinematic (or dynamics), a unique station identifier, temporal information, behavioral or object type classification information, etc. Similarly, VRU Awareness Messages, VAMs, for example as defined in document ETSI TS 103 300-3, can be sent by VRU ITS-S to share their own position and kinematic or to share information corresponding to a group of VRUs (i.e., a VRU cluster).
The ITS messages are usually broadcast by their originating ITS-S, so that any other ITS-S can receive and exploit them.
All the messages exchanged over ITS 100 may help each ITS-S to have a good level of knowledge of its environment in terms of which objects are present, where and how they behave.
For the sake of illustration, it is considered here that the illustrated road side unit is the RSU referenced 110 in
As mentioned above by reference to
The raw data acquired from these sensors may be processed by the perception and tracking module 230 of analysis module 111. According to some embodiments, the perception and tracking module 230 analyzes these raw data and uses sensor data fusion algorithms to combine or merge items of information directed to the same objects detected from the raw data acquired by several sensors.
Consideration of similarity between objects detected from raw data acquired from different sensors may be based on their object types, positions, kinetics/dynamics (speed, acceleration), trajectories, etc. A level of confidence may also be computed when scrutinizing the similarities of these items of information and the merging process may be affected by the level of confidence.
Items of information related to newly perceived objects and/or to already-tracked objects may be used to update the environment model 220 of the ITS-S. CAMs, VAMs, DENMs, and CPMs received from other ITS-Ss by the ITS message reception module 270 of ITS-S 112, conveying additional information, may also be used to update environment model 220.
The environment model (also known as the Local Dynamic Map) contains a list of the perceived objects. Each ITS-S has its own environment model 220.
In environment model 220, an object may be defined together with multiple items of information including, for example, all or some of the following:
According to the illustrated example, analysis module 111 further comprises the prediction module 240 that analyzes the behavior and the trajectory of the perceived objects to make predictions, for example to predict a behavior or a path. Predicted data may be added to environmental model 220. For the sake of illustration, environment model 220 may comprise the following predicted data:
Additionally, the predictionInformation may contain additional information item provided by the prediction module such as an identifier of a predicted path (e.g., PredictedPathID).
Still additionally, the predictionInformation may contain additional information item determined by the prediction module such as a list of linked predicted paths (e.g., LinkedPredictedPathIDLst). An object predicted path can be associated with another object predicted path or several objects predicted paths to reflect the possible interactions between object predictions.
In addition, the predictionInformation may further comprise a dangerousness value, a predictability level, a reason for predicting a behavior, and/or a type of situation, as described hereafter. Such items of information may be stored in the environment model and/or transmitted to other ITS-Ss, to increase the quality of the prediction behavior.
According to a particular embodiment, the prediction module (e.g., prediction module 240) may determine a dangerousness value associated with predicted data (e.g., a predicted behavior or a predicted path), in addition to a probability that an event leading to the predicted data occurs. Such a dangerousness value may be used by a receiving ITS station to determine how to process the corresponding predicted data. For the sake of illustration, a predicted path with a low probability, that is associated with a high dangerousness value, should be considered by a receiving ITS-S in such a way that appropriate mitigation actions are anticipated to avoid a dangerous situation in case this prediction becomes reality. If the predicted path has a low probability and is associated with a low dangerousness value, it may be ignored by the receiving ITS-S. According to this embodiment, the prediction module advantageously updates the environment model (e.g., environment model 220) with the determined dangerousness values. For example, the prediction module may update an information item denoted PathDangerousness, for each predicted path contained in an information item denoted predictionInformation of the environment model, where predicted data are stored. The level of dangerousness associated with a predicted path may also be included in a CPM.
This level can be expressed as a percentage value or a level value. The higher the value is, the higher the level of danger is. As for other data elements defined in ITS ASN.1, the 0 value may be used to indicate that the level is “unknown”.
For the sake of illustration, the dangerousness level may be defined as follows using the ASN1 code:
Thanks to the information about a path dangerousness, the other ITS-Ss receiving the CPM can anticipate a dangerous situation.
In addition or in a variant, the path dangerousness value may reflect a difficulty to predict a situation without having the local knowledge of the monitored area or without having any advanced prediction algorithm (e.g., pedestrian behavior analysis based on head/body orientation). This value is then used to balance the path probability value. An additional PathPredictability field may be used or the PathDangerousness field can be renamed PathPredictability. For the sake of illustration, the predictability level may be defined as follows using the ASN1 code:
By sending a path predictability level, the originating ITS-S can indicate to other ITS stations an added value of its prediction. The receiving ITS-Ss can then trust or not trust the prediction and can decide to use it or not to enrich their local environment model.
Still according to a particular embodiment (that may be combined with the previous one), the prediction module (e.g., prediction module 240) may identify and signal items of information that led to predicted data, for example that led to a predicted behavior or to a predicted path. For the sake of illustration, the prediction module may determine predicted paths by analyzing past trajectories and the object dynamics. Still for the sake of illustration, the prediction module may use information obtained from local-area knowledge, for example from local-area knowledge database 250, to predict data. Such local-area knowledge may comprise learnt trajectories of the monitored areas, timetables of local events (e.g., bus timetables, school timetables, etc.), and/or local events (e.g., construction work, illegal parking area, etc.). Predicted data may also result from analyzing the behavior of perceived objects. For example, analyzing the head and body orientation of a pedestrian may lead to predicting an intention of the pedestrian to cross the road, with a certain level of confidence. Likewise, detecting a cyclist raising his left-hand may lead to predicting an intention of the cyclist to turn to the left. Still for the sake of illustration, analyzing the state of a vehicle (e.g., whether the doors are opening or closing) may lead to anticipating a passing cyclist's deviation. According to this embodiment, the prediction module advantageously updates the environment model (e.g., environment model 220) with an item of information directed to one or more reasons why data have been predicted or with an indication of the method used to predict data. For example, the prediction module may update an information item denoted PredictionSendingReason, for each predicted path contained in an information item denoted predictionInformation of the environment model, where predicted data are stored.
The reason why the originating ITS-S station adds a predicted path in a CPM, that may be denoted the Prediction Sending Reason, can be indicated in the CPM, in a PredictionSendingReason field associated with this predicted path. The Prediction Sending Reason can be indicated using a code. For example, it can be composed of a main category code and of a subcategory code such as described in the following table:
Of course, other values may be contemplated.
The supported type of sending a prediction reason can also be transmitted through Service Specific Permission field (SSP), as described by reference to
By sending prediction information, the originating ITS-S can indicate to other ITS stations an added value of its prediction. The receiving ITS-Ss can then trust or not trust the prediction and can decide to use it or not to enrich their local environment model.
Predicted type of situations associated with predicted data Still according to a particular embodiment (that may be combined with the previous ones), the prediction module (e.g., prediction module 240) may indicate a type of a situation associated with predicted data, for example a type of a situation corresponding to a predicted behavior. For the sake of illustration, such a situation may be an obstacle avoidance, a slowdown of vehicles, a vehicle stopping, a pedestrian crossing the road, a cyclist turning, a vehicle starting, etc. Still for the sake of illustration, the prediction module may update an information item denoted PredictedSituationType, for each predicted path contained in an information item denoted predictionInformation of the environment model, where predicted data are stored, to indicate the corresponding type of situation.
The type of a predicted situation may also be indicated in a CPM, for example in a PredictedSituationType field associated with a predicted path. The predicted situation type can be indicated using a code such as the ones described in the following table:
Of course, other values may be contemplated. Several values may also be combined (e.g., dangerous behavior & cyclist turning).
The “unpredictable” code (used as a predicted situation type) may be used in case of objects whose behavior is difficult to predict, such as young children or a pedestrian looking at his or her smartphone while walking. If this code is used, then the predicted path might contain no path point. The use of the unpredictable code may alert other ITS-Ss that their prediction algorithms might not provide an accurate prediction due to the nature of the behavior or the type of the object.
Thanks to the predicted situation type, the originating ITS-S can indicate its analysis of the future situation to other ITS stations. Then, the receiving ITS-Ss can benefit from this analysis and quickly decide mitigation actions to limit dangerous situations or decide upon its next maneuver.
As apparent from
Transmitting CPMs with Predicted Information
As illustrated, the method of communication in an ITS comprises monitoring an area (step 300) such as a road portion or a road intersection, as shown in
Next (or in parallel), the prediction module analyzes the objects described in the environment model (e.g., in environment model 220 in
According to a particular embodiment, when prediction information is added or updated in the environment model, the ITS-S, acting as an originating ITS-S, sends a CPM containing items of information directed to the perceived objects with which is associated the added or updated prediction information and to the associated prediction information (step 330), for example using the CPM format described by reference to
Accordingly, the originating ITS-S may determine a prediction inclusion score for each prediction information item associated with a perceived objet. If the prediction inclusion score is greater than a given threshold (e.g., denoted P_Threshold), then the originating ITS-S includes the corresponding prediction information with items of information directed to the associated perceived object in a next generated CPM. According to some embodiments, the threshold value (P_Threshold) may be adjusted dynamically, for example as a function of the channel load (e.g., in case of channel congestion, the threshold value is decreased). For the sake of illustration, the prediction inclusion score can be computed using a combination of at least two of the following elements:
When a predicted path becomes meaningless, it is possible to transmit it with a PathProbability set to 0 in order to indicate to the receiving ITS-Ss that the corresponding items of information are no more applicable.
As illustrated in
As illustrated, after having received a CPM comprising items of information associating objects with prediction information (step 400), a receiving ITS-S, that can be for example a vehicle or a pedestrian, may use the received CPM to update its local environment model. Next, the receiving ITS-S updates its environment model with the perceived object information and the associated prediction information (step 410). As disclosed above, some items of information associated with predicted data make it possible to increase the level of understanding and the level of trust for a receiving ITS-S. For instance, if a predicted path has a low path probability, without additional explanation (i.e. without items of information associated with the predicted path), the receiving ITS-S may discard this prediction while this predicted path could help to anticipate a future dangerous situation. Using items of information characterizing the predicted path dangerousness or the predicted situation type, the receiving ITS-S may anticipate its reaction to a future dangerous situation. Likewise, using items of information characterizing the reasons why an originating ITS-S sent predicted data, the receiving ITS-S can trust or double-check the prediction prior to integrate it in its environment model (this can be carried out for example, at step 410). For instance, a receiving ITS-S may determine that for the same object, its local prediction is quite different from the prediction received through a CPM. By analyzing the prediction sending reason (e.g., the presence of roadwork), the receiving ITS-S can then increase its level of trust in the received prediction compared to its own local prediction. As illustrated in
According to the disclosure, the structure of the CPMs is modified to comprise items of information describing predicted behaviors, for example defining links between perceived objects and one or more situations.
For the sake of illustration, the illustrated CPM structure is based on ETSI TS 103 324 specification (V0.0.29 of May 2022). As illustrated, it comprises an ITS PDU header referenced 500, a CPM reference time field referenced 505, a “CPM Parameters” field 510, and a “Certificate” 515.
ITS PDU header 500 is a common header that includes the information of the protocol version, the message type, and the ITS-S identifier (ID) of the originating ITS-S.
CPM reference time field 505 (denoted cpmReferenceTime) is the absolute reference time of the message.
“CPM Parameters” field 510 contains a management container referenced 520, an optional station data container referenced 530, a perception data container referenced 540 containing an optional set of sensor information containers referenced 550, an optional set of perceived object containers referenced 560, and an optional set of free space addendum Containers referenced 570.
Each container includes some data elements (DE) and/or data frames (DF). ETSI TS 102 894-2 specification defines conventional data elements and data frames used in ITS messages.
Regardless of the type of the ITS-S generating the considered CPM, the management container provides information regarding the station type and the reference position of the originating ITS station. The message can be transmitted either by an ITS station, such as a vehicle, or by a stationary RSU. In case of a CPM generated by a vehicle, the station data container contains the dynamic information of the originating ITS station. It is not optional in case of a vehicle transmitting the CPM. In case of a CPM generated by an RSU, the station data container may provide references to identification numbers provided by the MAP Message (CEN ISO/TS 19091) reported by the same RSU. These references are required in order to match data provided by the CPM to the geometry of an intersection or road segment as provided by the MAP message. It is not required that a RSU has to transmit a MAP message for matching objects to road geometries. In this case, the station data container may be omitted. It is for this reason that the station data container is set as optional.
The sensor information container 550, that is optional, contains the set of sensor information. It provides information about the sensory capabilities of an ITS station. Depending on the station type of the originating ITS station, different sensor information specifications are available to encode the properties of a sensor. The sensor information container is attached to CPMs at a lower frequency than the other containers, as defined in ETSI TR 103 562 specification. Up to 128 sensor information may be used in a CPM.
The perceived object container 560, that is optional, contained a set of perceived objects 561. It is composed of a sequence of optional or mandatory data elements (DEs) and/or data frames (DFs) which give a detailed description of the dynamic state and properties of a detected (or perceived) object.
More precisely, each object has to be described using the dedicated perceivedObject structure referenced 561. The first part of this structure (referenced 562) contains data elements and/or data frames, for example as defined in ETSI TS 103 324 specification (V0.0.29 of May 2022), and comprises various fields including the following:
Free space addendum container 570 is optional. It contains the set of free space addendum information. It comprises a sequence of optional or mandatory data elements (DEs) which provide information about free spaces detected by a particular sensor. Each free space addendum comprises various fields such as:
It is noted that collective perception messages as described in TS 103 324 draft V0.0.29 with the items of information contained in data structure 562 for perceivedObject enables reporting of the current state of an object.
The items of information contained in the data structure 563 is a prediction container that enables reporting information related to the future state of an object.
The prediction container data structure 563 may comprise various fields such as:
Other organizations of the data structure may be envisioned, such as having the DeltaTime for each path point or as adding a unique identifier within a CPM predictedPathID to track the prediction evolution in successive CPM.
According to some embodiments of the disclosure, additional items of information may be included in the data structure 563 for each predicted path, such as:
The relationship type may also be reflected by adding a link type information (e.g., “parent”).
Back to
In order to secure V2X communications within the ITS, a public-key-infrastructure (PKI), for example as defined in version 1.1.1 of the ETSI TS 102 731 specification, may be used, in particular to verify the integrity of a message and to authenticate an originating ITS-S. The PKI-based security may be implemented through the use of certificates delivered by a certification authority to the ITS stations.
Therefore, each ITS message exchanged is made of a non-encrypted message, CPM parameter 510, accompanied with a digital signature and a pseudonym certificate (also referred to as an authorization ticket) that validates the authenticity of the originating ITS-S and the integrity of the message, while keeping anonymity of the originating ITS-S. For communicating within the ITS, an ITS-S may comprise one or more authorization tickets, and may use an authorization ticket for communicating.
Information about the prediction, provided for example in the data structure 563 of CPM 130 in
The authorization ticket may therefore comprise indications related to the privileges and authorizations of an originating ITS-S to transmit specific ITS messages, for example CPM 130 comprising data structure 563.
To that end, an authorization ticket may contain a field called ITS AID, which includes the list of the services that the station is authorized to access and use, for example as specified in ETSI TR 102 965 specification. In particular, a specific service is dedicated to collective perception service, to indicate that the sender is entitled to send CPMs. The authorization ticket also contains a field called ITS AID service specific permissions (SSP), which indicates specific sets of permission within the overall permission indicated by the ITS-AID. Its format may be the one specified in ETSI TS 103 097 specification.
According to some embodiments of the present disclosure, a SSP is provided, that may be specified in the certificate of CPMs containing a data structure 563, as described hereinbefore. An example of such a SSP is illustrated in
As illustrated, SSP 600 comprises three bytes referenced 610, 620, and 630. According to this example, the first byte (byte 610) gives a version of the SSP and the second and third bytes (bytes 620 and 630) define specific permission.
Still according to the illustrated example, specific permission 640 are defined using the first, second, third, and fourth bits of the second byte (byte 620) as follows:
Of course, other positions and/or values may be contemplated.
With such permission, an originating ITS-S is allowed to include prediction information in the CPMs it generates and the receiving ITS-Ss can trust that this originating ITS-S is entrusted to transmit such prediction information.
According to some embodiments of the present disclosure, such an SSP may be provided in authorization tickets dedicated to an RSU, which are less likely to be hacked. Of course, according to some embodiments of the present disclosure, such an SSP may be provided within authorization tickets to any type of ITS-S.
For the sake of clarity and conciseness, the intelligent transportation systems illustrated in
Like RSU 110 in
Again, ITS 700 is implemented at an intersection and comprises a stationary road side unit 110 and several entities that may carry or comprise ITS stations (ITS-Ss) each, for transmitting and/or receiving ITS messages within the ITS. The several entities may be, for example, the vehicles 151, 152, and 153, the motorbike 154, and the pedestrian 155. Likewise, stationary road side unit 110 comprises a set of sensors, such as image sensors, here video cameras 120, 121, 122, and 123, and analysis module 111 to analyze data provided by the sensors.
By scanning the monitored area, analysis module 111 may perceive the following objects:
In the illustrated example, motorbike 154 is likely to bypass obstacle 710 by the left, driving in the middle of the road, creating a potentially dangerous situation for the vehicle 151 if it turns to its right.
To cope with this situation, the prediction module of analysis module 111 (e.g., prediction module 240 in
The generated CPMs may have the CPM format described by reference to
Upon reception of such a CPM, the receiving ITS-S of vehicle 151 analyses the received CPM. In a first step, the receiving ITS-S of vehicle 151 associates perceivedObject 164 with a corresponding object of its local environment model or create a new object if it is not yet known. When analyzing the predicted path 720 for the perceived object 164, it may trust this prediction and be very cautious before turning to the right as there is a risk of having the motorbike in the middle of the road (which is dangerous).
The communication device 800 may preferably be a device such as a micro-computer, a workstation, or a light portable device embedded in a vehicle or a RSU. As illustrated, communication device 800 comprises a communication bus 813 to which there are preferably connected:
Optionally, the communication device 800 may also include one or several of the following components:
The communication device 800 may be optionally connected to various peripherals including perception sensors 808, such as digital cameras, each being connected to an input/output card (not shown) so as to supply data to the communication device 800.
Preferably the communication bus provides communication and interoperability between the various elements included in the communication device 800 or connected to it. The representation of the bus is not limiting and in particular the central processing unit is operable to communicate instructions to any element of the communication device 800 directly or by means of another element of the communication device 800.
The disk 806 may optionally be replaced by any information medium such as for example a compact disk (CD-ROM), rewritable or not, a ZIP disk, a USB key or a memory card and, in general terms, by an information storage means that can be read by a microcomputer or by a microprocessor, integrated or not into the apparatus, possibly removable and adapted to store one or more programs whose execution enables a method according to the invention to be implemented.
The executable code may optionally be stored either in read-only memory 807, on the hard disk 804 or on a removable digital medium such as for example a disk 806 as described previously. According to an optional variant, the executable code of the programs can be received by means of the communication network, via the interface 802, in order to be stored in one of the storage means of the communication device 800, such as the hard disk 804, before being executed.
The central processing unit 811 is preferably adapted to control and direct the execution of the instructions or portions of software code of the program or programs according to the invention, which instructions are stored in one of the aforementioned storage means. On powering up, the program or programs that are stored in a non-volatile memory, for example on the hard disk 804 or in the read-only memory 807, are transferred into the random access memory 812, which then contains the executable code of the program or programs, as well as registers for storing the variables and parameters necessary for implementing the invention.
In a preferred embodiment, the apparatus is a programmable apparatus which uses software to implement the invention. However, alternatively, the present invention may be implemented in hardware (for example, in the form of an Application Specific Integrated Circuit or ASIC).
Although the present invention has been described herein above with reference to specific embodiments, the present invention is not limited to the specific embodiments, and modifications will be apparent to a skilled person in the art which lie within the scope of the present invention.
Many further modifications and variations will suggest themselves to those versed in the art upon making reference to the foregoing illustrative embodiments, which are given by way of example only and which are not intended to limit the scope of the invention, that being determined solely by the appended claims. In particular, the different features from different embodiments may be interchanged, where appropriate.
Certain of the embodiments of the invention described above may be implemented solely or as a combination of elements of a plurality of the embodiments. Also, features from different embodiments can be combined where necessary or where the combination of elements or features from individual embodiments in a single embodiment is beneficial.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The mere fact that different features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be advantageously used.
Number | Date | Country | Kind |
---|---|---|---|
2209599.6 | Jun 2022 | GB | national |