The invention relates to the merging of information originating from several sensors and more particularly to the merging of imperfect information originating from non-independent sources.
Systems integrating several sensors are used in a great variety of fields such as site surveillance, maintenance, robotics, medical diagnosis or meteorological forecasting. Such systems for example carry out classification, identification and tracking functions in real time.
To derive the best from multi-sensor systems, it is necessary to use an effective information merging scheme to combine the data originating from the various sensors of the system and generate a decision.
According to the known art, certain information merging schemes rely on Dempster-Shafer theory (theory generalizing probability theory) and thus use belief functions. Belief functions are known for their ability to faithfully represent imperfect information. Information comprising an inaccuracy or an uncertainty or incomplete information is called imperfect information. The sensors of a system are considered to be sources of imperfect information, notably because of their inaccuracy. The term sensor is intended here in the broad sense. It includes physical devices for data acquisition (camera, radar, etc.) but also devices for processing these data. It is possible to establish a belief function on the basis of the data provided by most commercially available sensors. Belief combining schemes can be used. By their very nature these schemes are therefore particularly appropriate to the problem of the merging of imperfect information arising from sensors.
A belief function can be represented with the aid of a function m called the mass distribution defined on a set of proposals Ω which is a space of possible worlds with finite cardinal. It associates degrees of belief, lying between 0 and 1, with parts A (groups of proposals, also called subsets) of Ω. These degrees of belief are determined on the basis of the available information. The set of parts of Ω is denoted 2Ω.
A multi-sensor system of classifier type used for the optical recognition of handwritten characters may be considered by way of nonlimiting example. It is assumed that the system is intended to determine whether the character formed on an image I is one of the letters ‘a’, ‘b’ or ‘c’. We therefore have a set of proposals Ω={a, b, c}. Each of the sensors of the system is a classifier which itself provides an item of information about the character to be recognized in the form of a belief function. It is assumed that there are two sensors of this type in our example. The following table gives an example of a belief function m1 produced by a first sensor of the system and defined on 2Ω.
In this example, the sensor considers that it is as probable that the character to be recognized belongs to {a, b} as that it belongs to {b, c}. (m1({a, b})=m1({b, c})=0.4). m1(Ω)=0.2 represents the ignorance, that is to say the share of doubt, of the sensor.
Dempster-Shafer theory makes it possible to combine the belief functions representing information arising from different sources, so as to obtain a belief function that takes into account the influences of each of the sources. The belief function thus obtained represents the combined knowledge of the various sources of imperfect information (the sensors).
However, systems relying on this theory are based on the assumption that the merged information is independent. In practice two items of information can be considered to be independent if the sources associated with these items of knowledge are wholly unrelated. The concept of independence is fundamental since one of the constraints of information merging is to avoid counting the same item of information twice. It is obvious that this independence assumption is not satisfied by a certain number of multi-sensor systems. For example in the problem of the optical recognition of handwritten characters, the sensors may not be independent. Indeed, according to the known art, shape recognition schemes rely on automatic learning techniques using learning bases. If the sensors have been trained on the same learning bases, that is to say if the sensors have been set up using the same data, then the independence assumption required by the known art merging systems is not satisfied and therefore these systems may not be used.
The invention is aimed notably at alleviating the problem cited previously by proposing a method, a device and a system for merging information originating from several non-independent sensors. This invention makes it possible to prevent the same item of information from being reckoned twice during merging. The solution afforded consists of the creation of a new combination operator applying to latent belief structures. Said latent belief structures are obtained previously from conventional belief functions. These conventional belief functions are produced directly on the basis, for example, of the sensors of the system. The invention also proposes a means of transforming these latent belief structures into a probability distribution useful for decision taking.
For this purpose, the subject of the invention is a method for merging information originating from several sensors c1, c2, . . . , cn, n being the number of sensors, said method comprising the following steps:
w
m
c(A)=w1c(A)w2c(A) . . . wnc(A), A⊂Ω
w
m
d(A)=w1d(A)w2d(A) . . . wnd(A), A⊂Ω
According to a variant of the invention, the acquisition of the belief functions is direct, said sensors c1, c2, . . . , cn giving a belief function directly.
According to another variant of the invention, characterized in that the acquisition of the belief functions is indirect, said belief functions m1, m2, . . . , mn being calculated on the basis of the information arising from the sensors c1, c2, . . . , cn.
According to a characteristic of the invention, the calculation of a probability distribution comprises the following steps:
According to a characteristic of the invention, the calculation of the commonality functions qmc and qmd uses the following equations:
According to a characteristic of the invention, the calculation of the functions plmc and plmd uses the following equations:
According to a characteristic of the invention, the calculation of the probability distributions Pmc and Pmd uses the following equations:
According to a characteristic of the invention, the calculation of the merged probability distribution Pm uses the following equation:
The subject of the invention is also a device for merging information comprising:
The subject of the invention is also a system for merging information comprising:
The invention will be better understood and other advantages will become apparent on reading the detailed description given by way of nonlimiting example and with the aid of the figures among which:
It is proposed to illustrate the method according to the invention, by way of nonlimiting example, with the previously mentioned multi-sensor system of classifier type used for the optical recognition of handwritten characters. It is assumed that the system is intended to determine whether the character formed on an image I is one of the letters ‘a’, ‘b’ or ‘c’.
The term sensor is intended here in the broad sense. It includes physical devices for data acquisition (camera, micro, etc.) but also devices for processing these data, in the example: a classifier.
An exemplary embodiment of a system for merging information according to the invention is illustrated by
According to the known art, shape recognition schemes rely on automatic learning techniques using predetermined learning bases. In this example, we assume that the two classification systems C1 101 and C2 102 are not independent since they have been trained on the same learning base. The independence assumption made in the merging systems according to the known art is therefore not satisfied.
The system furthermore comprises a device 103 for merging the information originating from the sensors C1 and C2. The device 103 for merging the information comprises:
The acquisition can be done in a direct manner when a sensor produces a belief function directly or in an indirect manner when the belief function is calculated on the basis of the information provided by the sensor.
These means 106 are noteworthy in that they implement the method according to the invention and in that they make it possible to calculate a probability distribution on the basis of the belief functions provided by the two non-independent sensors C1 and C2. The merging means 106 can be a computer or an integrated circuit implementing the method according to the invention.
The system must recognize in the acquired image one of the three letters ‘a’, ‘b’ or ‘c’. We therefore have a set of proposals Ω={a, b, c}.
The table below presents the various intermediate calculations performed by applying the method according to the invention.
The first column contains the subsets of Ω. The second and third columns contain the values of the functions m1(A), m2(A) provided by the two sensors.
The method for merging information originating from several sensors according to the invention is applied hereinafter to the system comprising two sensors, said sensors being non-independent. However the method according to the invention can be applied to a system comprising a larger number of sensors.
The first step 201 of the method according to the invention is the acquisition of the belief functions m1, m2 arising from the sensors. In the example, two functions m1, m2 are acquired, corresponding respectively to the two sensors C1 and C2. In this example, the first sensor C1 considers that it is as probable that the character to be recognized belongs to {a, b} as that it belongs to {b, c}. (m1({a, b})=m1({b, c})=0.4). m1(Ω)=0.2 represents the ignorance, that is to say the share of doubt of the sensor. The second sensor C2 considers that it is as probable that the character to be recognized belongs to {a, c} as that it belongs to {b, c}.
The second step 202 of the method according to the invention is the calculation of latent belief structures LBS1 and LBS2 for each belief function m1, m2 obtained on the basis of each of the sensors. Each of the latent belief structures LBS1 and LBS2 is calculated by using the canonical decomposition of a belief function. The canonical decomposition is a function denoted w and calculated on the basis of the belief function m by way of a function q called the commonality function. The canonical decomposition w1 of the belief function m1 is therefore calculated 206 on the basis of the function q1. The function q1 is calculated 205 with the following equation:
We have, for example, q1({a,b})=m1({a,b})+m1(Ω)=0.4+0.2=0.6; q1(Ω)=m1(Ω)=0.2.
The function is w1 calculated 206 with the following equation:
We have for example:
The canonical decomposition w2 of the belief function m2 is calculated in a similar manner.
A latent belief structure LBS1 is a pair of functions w1c and w1d representing respectively the confidence and the distrust for a given set A. The calculation 207 of the functions w1c and w1d, whose values appear in the fourth and fifth columns of the above table, uses the following equations:
We have, for example,
We proceed in a similar manner to calculate the functions w2c and w2d whose values appear in the sixth and seventh columns of the above table.
The method according to the invention is noteworthy in that it furthermore comprises the following steps.
The third step 203 of the method according to the invention is the calculation of a merged latent belief structure LBSm by applying a rule called a weak rule to the values calculated in the previous step 202. The merged latent belief structure LBSm takes the form of a pair of functions wmc(A) and wmd(A). The weak rule is defined by:
w
m
c(A)=w1c(A)w2c(A), Aε2Ω\{Ω}
w
m
d(A)=w1d(A)w2d(A), Aε2Ω\{Ω}
The fourth step 204 of the method according to the invention is the calculation of a probability distribution Pm on the basis of the merged latent belief structure LBSm.
According to the known art, it is possible to obtain a probability distribution on the basis of a mass distribution. The LBS obtained in the previous step 203 can be converted into a mass distribution, however this mass distribution is potentially signed, that is to say it can take its values in the set of reals IR rather than in the interval [0,1]. Now, the scheme according to the known art for obtaining a probability distribution on the basis of a mass distribution is not applicable to signed mass distributions. The method according to the invention is noteworthy in that it makes it possible to calculate a probability distribution directly on the basis of the merged LBS, that is to say without needing to calculate an intermediate mass distribution.
The calculation 204 of a probability distribution Pm on the basis of the merged latent belief structure comprises the following sub-steps.
The first sub-step 208 is the calculation of the commonality functions corresponding to the functions wmc and wmd calculated previously and complying with the following equations:
We have for example:
The second sub-step 209 is the calculation of the plausibility functions plmc and plmd on the basis of the commonality functions qmc and qmd calculated previously and complying with the following equations:
We have for example:
The function plmd is then calculated in a similar manner.
The third sub-step 210 is the calculation of the probability distributions Pmc and Pmd on the basis of the plausibility functions plmc and plmd calculated previously. This is done via the following equations:
We have for example:
The fourth sub-step 211 is the calculation of a probability distribution Pm corresponding to the merged latent belief structure LBSm and calculated on the basis of the probability distributions Pmc and Pmd:
We therefore have:
Likewise, we calculate Pm({b}) and Pm({c}):
The probability distribution Pm corresponding to the example is given in the tenth column of the above table. The conclusion of the multi-sensor system according to the invention is that the most probable character on the image 1 is ‘a’.
Number | Date | Country | Kind |
---|---|---|---|
07/05528 | Jul 2007 | FR | national |
This application claims priority to PCT Patent Application Number PCT/EP2008/059660, entitled Procédé, Dispositif Et Système Pour La Fusion D'informations Provenant De Plusieurs Capteurs, filed Jul. 23, 2008, also claiming priority to FR 07 05528, filed Jul. 27, 2007.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2008/059660 | 7/23/2008 | WO | 00 | 6/30/2010 |