MOTION CAPTURE DEVICE AND ASSOCIATED METHOD

Abstract
The invention concerns a device for capturing the motion of a structure consisting of N articulated segments, characterised in that it comprises: first means (ML) that deliver at least one item of information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame forming a reference, at successive times tk, k being an integer number greater than or equal to 1, andsecond measuring means (MD1, MDn) distributed over the various segments and which deliver, for each segment of rank 1 to N, at each time tk, a measurement (M1, Mn) representing an orientation vector ({right arrow over (Θ)}1, {right arrow over (Θ)}n) of the segment in the reference frame.
Description
TECHNICAL FIELD AND PRIOR ART

The invention concerns a motion capture device and the associated motion capture method. The invention also concerns a motion reproduction device and the associated motion reproduction method.


A device for capturing the motion of a structure is a device that measures quantities able to describe, by processing, the motion of the structure. The structure may for example be a person or robot, moving about or not.


The capture of human motion is a technique very much used in many applications: biomechanical analysis, telemanipulation, animation of a character, ergonomics, etc.


A first category of motion capture devices consists of devices that comprise two distinct parts: a first part is placed on the moving object and a second part is fixed with respect to the movement of the object. In this first category, there are mainly optical systems, electromagnetic systems and ultrasound systems. These devices are effective in terms of precision. They do however have a certain number of drawbacks. It is thus necessary to install equipment both on the object and in the environment of the object. In all cases, these systems have a short range (in keeping with the range of the physical source) and a fairly lengthy installation and calibration phase. Their cost is also very high.


The technology probably most used at the present time is based on optics, as described for example in the patent applications US 2003/0215130 A1 and US 2005/00883333 A1. These systems make it possible to reconstruct the movements of the body from images seen by cameras placed all around the scene where the action is taking place. Markers highly visible to the cameras are disposed on the moving object. Processing provides the 3D position (3D standing for “three dimensional”) of each marker through the principle of stereoscopy. Despite this, the problems of optical occlusion are numerous, which makes the minimum number of cameras used high. Some authors propose reducing this type of disadvantage, as appears for example in the document entitled “Skeleton-Based Motion Capture for Robust Reconstruction of Human Motion” (L. Herda; P. Fua; R. Plänkers; R. Boulic; D. Thalmann, Computer Graph Lab (LIG), EPFL—web 01/2000). Other authors propose processing methods based on the silhouette extracted from a single camera by associating with it the model of the moving object (cf “Marker-free Kinematic Skeleton Estimation from Sequences of Volume Data” C. Theobalt; E. Aguiar; M. Magnor; H. Theisel; H-P. Seidel; MPI Informatik).


The systems based on electromagnetism reconstruct the angles and positions of the sensors disposed on the object.


Ultrasound systems, just like optical systems, find the positions of the transmitters. These two technologies suffer from the same limitation in space as camera-based technology.


A second category of device concerns devices in a single unit disposed on the moving object. This is the case with exoskeletal devices. These devices make it possible to be free of the limitation to the capture volume but are constraining since they consist of mechanical articulated arms disposed on the structure or person. The reconstruction of the movement uses measurements of angle, rather than position, between the segments of the articulated members.


More recently, systems based on a fairly old principle (the principle of inertial units) have seen the light of day on smaller scales than traditional scales, typically a few centimetres a side (cf U.S. Pat. No. 6,162,191). These devices, consisting of angular velocity sensors (gyrometers) are placed on the moving object or moving person. The angular velocity sensors supply the angles of the rotation segments provided that the measurement, which causes a drift, is integrated once. Accelerometers, or even magnetometers are sometimes associated with the gyrometers, so that, whenever the movement is slower, their measurement, based on the terrestrial magnetic and gravitational fields, reset the estimation of the orientation, thus cancelling out the drift. The capture of rapid movements does nevertheless remain a problem if the accelerations remain, since the resetting no longer occurs. In addition, gyrometers are sensors still difficult to use, fairly expensive and also having certain sensitivity to accelerations.


Another approach (cf U.S. Pat. No. 6,820,025) consists of juxtaposing with the articulated segments, angle sensors comprising gyrometers for reconstructing the movement.


The French patent application FR 2 838 185 describes a device for capturing the orientation of a solid that moves in a reference frame. The motion capture device supplies, from measurements issuing from axial or vectorial sensors placed on the solid, at least one angle of orientation θ made by the moving reference frame of the solid in the reference frame. The sensors used are preferably a magnetometer and an accelerometer. There then exists an equation (1) between the measurements M, the gravitation field G expressed in the reference frame, the magnetic field H expressed in the reference frame and the orientation angle θ:






M=F(θ,G,H)  (1)


The measurements M of the physical quantities that are made respectively by the accelerometer and magnetometer are thus modelled as a function F that represents the rotation θ of the reference frame attached to the solid with respect to the fixed reference frame in which the solid moves.


The orientation angle θ is derived from equation (1) by the following equation (2):





θ=F−1(M,G,H)  (2)


If the motion is accelerated, a new equation (3) describes the system, namely:






M=F(θ,a,G,H)  (3)


The unknowns θ and a then form a space with a high dimension that, in a practical fashion, prohibits inversion of the function F. It is then not possible to extract the unknowns θ and a from equation (3). Without additional information, the device therefore does not allow the measurement of the orientation angles when the moving object is accelerated or at least when the acceleration of the moving object cannot be ignored. This represents a drawback.


The invention does not have the drawbacks of the devices mentioned above.


DISCLOSURE OF THE INVENTION

This is because the invention concerns a device for capturing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises:

    • first means that deliver information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame, at successive times tk, k being an integer number greater than or equal to 1,
    • second measuring means fixed to the segment of rank 1 and which deliver, at each time tk, a measurement representing an orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, and
    • supplementary measurement means fixed to each segment of rank n (n=2, . . . , N), and which deliver, at each time tk, a measurement representing an orientation vector {right arrow over (Θ)}n of the segment of rank n.


According to a supplementary characteristic of the invention, the second measuring means and the supplementary measuring means consist of an accelerometer and a sensor that delivers a measurement of a uniform physical field present in the space where the structure moves and with a known direction in the reference frame.


According to another supplementary characteristic of the invention, the second measuring means and the supplementary measuring means comprise further at least one gyrometric axis.


According to yet another supplementary characteristic of the invention, the sensor that delivers a measurement of a uniform physical field of known direction in the reference frame is a magnetometer.


According to yet another supplementary characteristic of the invention, the sensor that delivers a measurement of a uniform physical field of known direction in the reference frame is a photoelectric cell.


According to yet another supplementary characteristic of the invention, the first means consist of a velocity measurer so that the information able to restore an absolute acceleration vector of a point on the segment of rank 1 is the velocity of the point.


According to yet another supplementary characteristic of the invention, the first means consist of a position measurer so that the information able to restore an absolute acceleration vector of a point on the segment of rank 1 is the position of the point.


The invention also concerns a device for reproducing motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises:

    • a motion capture device according to the invention in which the supplementary measuring means of a segment of rank n are positioned close to the articulation point pn so that the distance that separates the supplementary measuring means of a segment of rank n from the articulation point pn is considered to be zero, and
    • calculation means that calculate, at each time tk:


a) the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the information delivered by the first means,


b) the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement representing the orientation vector {right arrow over (Θ)}1 of the segment of rank 1;


c) an acceleration vector {right arrow over (a)}n (n≧2) of the articulation point pn in the reference frame, from the equation:








a


n

=



a



n
-
1


+


(









ω



n
-
1





t


)


Λ







L

n
-
1





+



ω



n
-
1




Λ


(



ω



n
-
1



Λ







L

n
-
1





)








where {right arrow over (ω)}n=d({right arrow over (Θ)}n)/dt and {right arrow over (L)}n being a vector oriented from the articulation point pn−1 to the articulation point pn and whose modulus has as its value the distance that separates the articulation point pn from the articulation point pn−1; and


d) the orientation vector {right arrow over (Θ)}n (n≧2) of the segment of rank n from the acceleration vector {right arrow over (a)}n and the measurement representing the orientation of the segment of rank n.


The invention also concerns a device for reproducing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises:

    • a motion capture device according to the invention in which the supplementary measuring means of a segment of rank n are distant from the articulation point pn, and
    • calculation means that calculate, at each instant tk:


a) the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the information delivered by the first means,


b) the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement representing the orientation vector {right arrow over (Θ)}1 of the segment of rank 1;


c) an acceleration vector {right arrow over (a)}n (n≧2) of the articulation point pn in the reference frame, from the equation:








a


n

=



a



n
-
1


+


(









ω



n
-
1





t


)


Λ







L

n
-
1





+



ω



n
-
1




Λ


(



ω



n
-
1



Λ







L

n
-
1





)








where {right arrow over (ω)}n=d({right arrow over (Θ)}n)/dt, {right arrow over (L)}n being a vector oriented from the articulation point pn−1 to the articulation point pn and whose modulus has as its value the distance that separates the articulation vector pn from the articulation point pn−1; and


d) the orientation vector {right arrow over (Θ)}n (n≧2) and an acceleration vector {right arrow over (b)}n of the measuring point of the supplementary measuring means fixed on the segment of rank n from the acceleration vector {right arrow over (a)}n, the measurement (Mn) representing the orientation of the segment of rank n, and the orientation vectors of the segment of rank n at least two times that precede the time tk, with {right arrow over (b)}n such that:








b


n

=



a


n

+


(









ω


n




t


)




D


n


+



ω


n



(



ω


n




D


n


)







where {right arrow over (D)}n is a vector oriented from the articulation point pn to the supplementary measuring means of the segment of rank n and whose modulus is substantially equal to the distance that separates the articulation point pn of the supplementary measuring means of the segment of rank n.


According to an additional characteristic of the invention, radio transmission means transmit elementary electrical signals representing the measurements delivered by the first measuring means and the second measuring means to the calculation means.


According to yet another additional characteristic of the invention, the radio transmission means comprise an intermediate unit that receives the elementary electrical signals and that retransmits an electrical signal representing the elementary electrical signals to the calculation means.


According to yet another additional characteristic of the invention, storage means store the measurements delivered by the first measuring means and the second measuring means.


According to yet another additional characteristic of the invention, the storage means are placed on the structure.


The invention also concerns:

    • a motion capture method according to independent claim 14,
    • a motion reproduction method according to independent claim 18, and
    • a motion reproduction method according to independent claim 19.


An elementary measuring device according to the invention consists of two types of sensor, one of which is an accelerometer.


Preferentially, an elementary measuring device is produced by means of a device for capturing solid rotation motion as described in the French patent application published under the reference FR 2 838 185 and filed, in the name of the applicant, on 5 Apr. 2002. An elementary measuring device thus consists of a pair (accelerometer, sensor X).


Sensor X means any sensor that supplies a measurement of a uniform physical field present in the space where the moving body is moving, physical field whose direction is known in the reference frame or which is measured in a reference position. The only constraints concerning the sensor X are firstly that the sensor must not be sensitive to acceleration and secondly that the direction of the physical field measured is different from the vertical. The sensor X can thus be a magnetometer that measures the direction of the terrestrial magnetic field. The sensor X can also be a photoelectric cell whose measurement is that of the light intensity that arrives on the cell. If for example, the illumination source is the sun and the date, time, longitude and latitude are known when the light intensity is measured, the angle of incidence of the solar ray in an absolute reference frame can be predicted and consequently the measurement is modulated according to the angle that the device makes with respect to the direction of the solar ray. This is therefore also another way of measuring an angle. The sensor X can also consist of one or more gyrometric axes that supplement the measurement of the accelerometer.


The first means that deliver information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 can be implemented by a system of local measurements. A simple accelerometer is not suitable if means are not available for compensating for the acceleration of gravity. In the concrete case of the measurement of the movement of a person, the local measurement system can advantageously be placed at the centre of gravity or close to the centre of gravity of the body of the person (at the waist, for example).


The system of local measurements may for example be a device of the GPS type (GPS standing for “Global Positioning System”) associated with a differentiating circuit. The GPS device makes it possible to know at any time the position of the element that carries it and a differentiating circuit, by differentiating the position data twice, determines the absolute acceleration in the geographical reference frame.


The system of local measurements can also be implemented by means of a radio location device associated with a differentiating circuit. Radio location devices require the use of beacons (ULB radar (ULB standing for “Ultra Large Band”), optical beacon, etc). Radio location devices therefore cause the autonomous character of the local measuring system to be lost. They do however prove to be very advantageous in use when following movements in an enclosure where beacons are first positioned. The use of radio systems also has the dual advantage of the data transmission and position measurement (this is particularly the case with ULB devices). Just as in the case of the GPS device, the position measurement delivered by the radio location device is differentiated twice in order to obtain the acceleration measurement.


An oriented pressure measurement (tube) is directly correlated with the velocity of a body in air. It is thus possible to determine, along three axes, the velocity vector of a segment to which a pressure measurer is fixed. By differentiating the velocity measurement once, the acceleration is obtained.


The motion capture device can advantageously be “dynamic” with regard to the hierarchical structure of the moving structure. In the case for example of a humanoid structure (person or robot), this means that the local measuring system or systems ML may be placed either at the foot, the hand, the waist, etc, or any other part of the body that can be assimilated to a rigid element.


In other embodiments of the invention, the first means that deliver information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 are not measuring means. Where it is known that a point on a segment is fixed in the reference frame, it is in fact unnecessary to make an acceleration measurement on this segment. This segment can then advantageously be chosen as the segment of rank 1. The first means that deliver the information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 may therefore for example be storage means that have knowledge of the fixed position occupied by a point on the segment of rank 1 in the reference frame.


By way of non-limitative example, in the remainder of the description, the first means that deliver information able to restore an absolute acceleration vector {right arrow over (a)}1 are measuring means ML fixed to the segment of rank 1. The measuring means ML will be considered to be superimposed on the second measuring means MD1, which are also fixed to the segment of rank 1. In a more general case, the measuring means ML and MD1 are distant from each other, the position of the measuring means ML then being able to be assimilated to a virtual point of articulation between the segment of rank 1 and a virtual segment of rank zero.


A measuring device MD can characterise an idle state. The variance of the signals delivered by the device MD is then below a threshold. As soon as an idle state is detected at a point, there exists a very high probability for this point to be at rest in the fixed reference frame (this is because, although a uniform rectilinear movement gives the same result as an idle state, such a movement is improbable and difficult to maintain). In the case of rest detected, the acceleration of the structure is zero and the state of rest can be detected.


However, there are cases where an articulation is at rest in a particular movement. This is the case for example in walking where each foot is momentarily at rest alternately. In this case, the method of the invention applies so that the segment of rank 1 is alternately the right foot or the left foot.


In the remainder of the description, the invention will be described for the capture and reproduction of the movement of an articulated structure consisting of a succession of segments. However, it is clear that the invention also applies to any non-articulated solid body of any form (this may then be identified with the segment of rank 1 of the articulated structure described) or to a complex articulated structure consisting of several sets of articulated segments.





BRIEF DESCRIPTION OF THE DRAWINGS

Other characteristics and advantages of the invention will emerge from a reading of a preferential embodiment given with reference to the accompanying figures, among which:



FIG. 1 depicts, symbolically, an example of an articulated structure to which the motion capture device of the invention relates;



FIG. 2 depicts an example of a motion capture device according to the invention in the case of a structure with four articulated segments;



FIG. 3 depicts two successive articulated segments provided with a motion capture device according to the invention;



FIG. 4A depicts essential steps of a particular case of the measurement processing method used in the context of the invention;



FIG. 4B depicts, in the general case, essential steps of the measurement processing method used in the context of the invention;



FIG. 5A depicts a detailed flow diagram of an essential step of the measurement processing method shown in FIG. 4A;



FIG. 5B depicts a detailed flow diagram of an essential step of the measurement processing method shown in FIG. 4B;



FIG. 6A illustrates, symbolically, in the particular case mentioned above, the change over time of the acceleration and orientation data obtained for the various segments of a structure with five articulated segments;



FIG. 6B illustrates, in the general case, the results of calculation, gradually, of the acceleration and orientation data obtained for the various segments of a structure with articulated segments;



FIGS. 7A and 7B depict two embodiments of a motion reproduction device according to the invention.





In all the figures, the same references represent the same elements.


DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION


FIG. 1 depicts an example of an articulated structure to which the motion capture device of the invention relates.


The structure, for example a human body or a humanoid robot, is broken down into a set of segments which are so many solid elements articulated with respect to one another. All the segments are thus broken down into a head segment TE, a neck segment C, a set of trunk segments T1, T2, T3, a set of left arm segments BG1, BG2, BG3, GB4, a set of right arm segments BD1, BD2, BD3, BD4, a set of left leg segments JG1, JG2, JG3, JG4, JG5 and a set of right leg segments JD1, JD2, JD3, JD4, JD5.



FIG. 2 depicts an articulated structure provided with a motion capture device according to the invention. The structure is for example a robot arm consisting of four articulated segments B1, B2, B3, B4 ranging from the shoulder to the hand.


The segment B1 is provided with a system of local measurements ML and an elementary orientation-measurements device MD1. The elementary orientation-measurements device MD1 is distant from the local-measurements system ML. The fixing point of the local-measurements system ML and the fixing point of the elementary orientation-measurements device MD1 define a vector {right arrow over (D)}1 of modulus D1 oriented from ML towards MD1. As mentioned previously, when a point on the segment of rank 1 is fixed, the local-measurement system ML is unnecessary since it is then known that the acceleration of this point is zero in the reference frame.


Each segment Bn (n=2, 3, 4) is provided with an articulation point pn where the adjoining segment Bn−1 is articulated. An elementary orientation-measurements device MDn is placed on each segment Bn. The fixing point of the elementary orientation-measurements device MDn is distant from the articulation point pn, the fixing point of the elementary orientation-measurements device MDn and the articulation point pn defining a vector {right arrow over (D)}n of modulus Dn and oriented from pn towards MDn.


The function of the motion reproduction device of the invention is to estimate, gradually, from the knowledge of the acceleration and orientation of the first segment B1, the acceleration of the successive articulation points of the various segments as well as the angles that the various segments make to each other.


In the following diagrams and discussions, n is the generic index, or rank, of a segment, k is a generic time incrementation index, an is the acceleration of the articulation point pn of the segment of rank n in a fixed reference frame and θn is the orientation in three dimensions (3D orientation) of the segment of rank n in the fixed reference frame. For reasons of convenience, the accelerations an and orientations θn are usual denoted in scalar form in the patent application. It must however be noted that all these quantities are third-dimension vectors in the reference frame.



FIG. 3 depicts a detail view of a moving structure equipped with a motion capture device of the invention. A segment Sn is articulated with a segment Sn−1 at an articulation point pn. The length of the segment Sn is assimilated to the distance Ln that separates the articulation point pn+1 from the articulation point pn. Likewise, the length of the segment Sn−1 is assimilated to the distance Ln−1 that separates the articulation point pn from the articulation point pn−1. The articulation points pn−1 and pn define a vector {right arrow over (L)}n oriented from pn−1 towards pn and whose modulus is equal to the distance that separates the articulation points pn and pn−1. The articulation point pn has an acceleration an and the articulation point pn−1 has an acceleration an−1. The measurement points of the devices MDn and MDn−1 on the respective segments of rank n and n−1 have the respective accelerations bn and nn−1.


In the remainder of the description, the invention will be presented firstly in the particular case where the vectors {right arrow over (D)}n are negligible (the vectors {right arrow over (D)}n are then consider to be zero vectors) and secondly in the general case where the vectors {right arrow over (D)}n are not considered to be negligible.



FIG. 4A depicts the general principle of determining quantities {right arrow over (a)}n and {right arrow over (Θ)}n according to the invention in the particular case where the vectors {right arrow over (D)}n are zero. The acceleration {right arrow over (a)}n of the articulation point pn is calculated from the acceleration {right arrow over (a)}n−1 of the articulation point pn−1, the vector {right arrow over (L)}n−1 that represents the segment of rank n−1 and the vector {right arrow over (Θ)}n−1 that represents the 3D orientation vector of the segment of rank n−1. This gives, in accordance with the motion composition law:











a


n

=



a



n
-
1


+


(









ω



n
-
1





t


)


Λ







L

n
-
1





+



ω



n
-
1




Λ


(



ω



n
-
1



Λ







L

n
-
1





)








(
4
)







in which:

    • the symbol “Λ” represents the “vectorial product” operator, and
    • {right arrow over (ω)}n−1=d({right arrow over (Θ)}n−1)/dt


The acceleration {right arrow over (a)}n being a known quantity, it is then possible to calculate the orientation {right arrow over (Θ)}n on the basis of equation (5):





{right arrow over (Θ)}n=F−1(Mn,{right arrow over (a)}n,G,H)  (5)


in which:

    • Mn represents the measurements delivered by the elementary measurements device MDn placed on the segment of rank n, and
    • G and H are respectively the gravitation field and the magnetic field measured in the reference frame, at the segment of rank n.


Equation (5) is an equation known per se that corresponds to equation (2) given above.



FIG. 4B depicts, in the general case, the essential steps of the measurement processing method used in the context of the invention. In the general case, the equation that connects the acceleration {right arrow over (b)}n of the measuring point of the device MDn and {right arrow over (Θ)}n is written:








b


n

=



a



n
-
1


+


(









ω



n
-
1





t


)


Λ







L

n
-
1





+



ω



n
-
1




Λ


(



ω



n
-
1



Λ







L

n
-
1





)



+


(









ω


n




t


)




D


n


+



ω


n



(



ω


n




D


n


)







or again:








b


n

=



a


n

+


(









ω


n




t


)




D


n


+



ω


n



(



ω


n




D


n


)







It is then possible to write the quantity bb(tk) in the following form:






b
n(tk)=K({right arrow over (a)}n(tk),{right arrow over (Θ)}n(ti<k),{right arrow over (Θ)}n(tk))


The vector {right arrow over (a)}n is then calculated by means of equation (4) as it was before in the particular case described above. Next the vectors {right arrow over (b)}n and {right arrow over (Θ)}n are calculated, at time tk, using equation (6) such that:





{right arrow over (Θ)}n(tk)=L−1(Mn(tk),{right arrow over (a)}(tk),G,H,{right arrow over (Θ)}n(ti<k))  (6)


where the function L is a function that combines the functions F and K so that:











M
n



(

t
k

)


=

F


(




b


n



(

t
k

)


,
G
,
H
,



Θ


n



(

t
k

)



)








=

F


[


K


(




a


n



(

t
k

)


,



Θ


n



(

t

j
<
k


)


,



Θ


n



(

t
k

)



)


,
G
,
H
,



Θ


n



(

t
k

)



]








=

L


(




a


n



(

t
k

)


,
G
,
H
,



Θ


n



(

t
k

)


,



Θ


n



(

t

i
<
k


)



)










FIG. 5A depicts a detailed flow diagram of an essential step of the measurement processing method depicted in FIG. 4A.


The processing unit depicted in FIG. 5A details the calculation of the quantities an(tk) and θn(tk), which are associated, at a time tk, with the segment of rank n. The quantities an(tk) and θn(tk) of the segment of rank n are determined from the following measured or calculated data:

    • the accelerations an−1(tk), an−1(tk−1) and an−1(tk−2) relating to the segment of rank n−1, calculated for three different times tk, tk−1, tk−2, and
    • the measurements Mn−1(tk−1) and Mn−1(tk−2) delivered, by the elementary measurements device MDn−1, at the two different times tk−1 and tk−2,
    • the orientation θn−1(tk) of the segment of rank n−1 calculated at time tk, and
    • the measurements Mn(tk) delivered by the elementary measurements device MDn at time tk.


The quantities an−1(tk−2) and Mn−1(tk−2) are applied to an operator 2, which uses equation (5) and delivers the orientation θn−1 (tk−2). Likewise the quantities an−1(tk−1) and Mn−1(tk−1) are applied to an operator 2 that uses equation (5) and delivers the orientation θn−1(tk−1).


The quantities θn−1(tk−2) and θn−1(tk−1) and the interval of time information Δt21 such that:





Δt21=tk−2−tk−1


are next applied to a differentiating operator DIFF that calculates the quantity ωn−1(tk−1) such that:





ωn−1(tk−1)=(θn−1(tk−2)−θn−1(tk−1))/Δt21.


The quantities ωn−1(tk) and d(ωn−1(tk))/dt are then calculated:

    • the quantity ωn−1(tk) is calculated by means of a differentiating operator DIFF so that: ωn−1(tk)=(θn−1(tk−1)−θn−1(tk))/Δt10, where θn−1(tk−1) is the quantity calculated above, θn−1(tk) is known (calculated previously), and Δt10=tk−1−tk, and
    • the quantity d(ωn−1(tk))/dt is calculated by means of a differentiating operator DIFF so that: d(ωn−1(tk))/dt=(ωn−1(tk−1)−ωn−1(tk))/Δt10, where ωn−1(tk−1) and ωn−1(tk) are the quantities calculated above, and Δt10=tk−1−tk.


The quantities an−1(tk), ωn−1(tk) and d(ωn−1(tk))/dt are then applied to an operator 1, which uses equation (4) and delivers the quantity an(tk). The calculated quantity an(tk) and the known measurement taken Mn(tk) are then applied to an operator 2 that uses equation (5) and delivers the orientation quantity θn(tk).


The processing of the measurements acquired by the articulated motion capture device of the invention leads to the determination, for each segment of the moving structure, of its acceleration at the articulation point and its orientation in a reference frame. It is then possible to describe the motion of the structure, for example on a screen.


As appears clearly with reference to FIG. 5A, the determination of the pair [an(tk), θn(tk)] of a segment of rank n at time tk is deduced, amongst other things, from information relating to the segment of rank n−1 at the prior times tk−1 and tk−2. Consequently it is clear that not all the acceleration and orientation data relating to all the segments of the structure can be known as from the first measurement. It is thus necessary to acquire a certain number of measurements before the articulated motion can be reproduced in its entirety.



FIG. 5B depicts a detailed flow diagram of an essential step of the measurement processing method depicted in FIG. 4B.


In addition to the data mentioned with reference to FIG. 5A, the quantities {right arrow over (a)}n(tk) and {right arrow over (Θ)}n(tk) relating to the segment of rank n are here also determined from the orientations θn(tk−1) and θn(tk−2) calculated, for the segment n, at times tk−1 and tk−2.


The quantities an−1(tk−2), θn−1(tk−3), θn−1(tk−4) and Mn−1(tk−2) are then applied to an operator 2 that used equation (6) and delivers the orientation θn−1(tk−2). Likewise, the quantities an−1(tk−1), θn−1(tk−2), θn−1(tk−3) and Mn−1(tk−1) are applied to an operator 2, which uses equation (6) and delivers the orientation θn−1(tk−1).


The quantities an−1(tk), ωn−1(tk) and d(ωn−1(tk))/dt are then applied to an operator 1, which uses equation (4) and delivers the quantity an(tk). The orientations θn(tk−1) and θn(tk−2) estimated at the two times preceding time tk, the calculated quantity an(tk) and the known measurement sample Mn(tk) are then applied to an operator 2, which uses equation (6), where ωn(tk) and dω(tk) are given as before by the operator DIFF:





ωn(tk)=(θn(tk−1)−θn(tk))/Δt10






d(Wn(tk))/dt=(Wn(tk−1)−W(tk))/Δt10





where






W
n(tk−1)=(θn(tk−2)−θn(tk−1))/Δt21


The operator 2 then delivers the orientation quantity θn(tk).


The processing of the measurements acquired by the articulation motion capture device of the invention leads to the determination, for each segment of the moving structure, of its acceleration at the articulation point and its orientation in a reference frame. It is then possible to describe the movement of the structure, for example on a screen.


As appears clearly, for example with reference to FIG. 5A, the determination of the pair [an(tk), θn(tk)] of a segment of rank n at time tk is deduced, amongst other things, from information relating to the segment of rand n−1 at the prior times tk−1 and tk−2. Consequently it is clear that not all the acceleration and orientation data relating to all the segments of the structure can be known as from the first measurement. It is thus necessary to acquire a certain number of measurements before the articulated movement can be reproduced in its entirety.


Likewise, in the general case where the vectors {right arrow over (D)}n are not considered to be zero, it is necessary to know two previous successive orientations of the segment of rank n in order to initialise the method. These orientations can be obtained for example when the segment is immobile using the method described in the patent application FR 2 838 185. On the other hand, as shown above, where the measuring means representing the orientation of the segment of rank n are sufficiently close to the articulation point pn, it is not necessary to know the two previous successive orientations and the method is simplified.



FIG. 6A illustrates, symbolically, in the particular case where the vectors {right arrow over (D)}n are considered to be zero, the change over time of the acceleration and orientation data obtained for the various segments of a structure with five articulated segments.


In FIG. 6A, the horizontal axis represents the rank n of the segments that make up the structure and the vertical axis represents the successive measurement times tk. At the intersection of a rank n and a time tk there are indicated the quantities (acceleration and orientation) that are known at time tk, for the segment of rank n. These quantities consist of measurement data and/or data deduced from measurement data.


In order not to burden FIG. 6A, the quantity dθn/dt is represented by the symbol {dot over (θ)}n and the quantity d2θn/dt2 is represented by the symbol {umlaut over (θ)}n. Moreover, this gives:

    • n(tk)=θn(tk)−θn(tk−1),
    • dt(tk)=tk−tk−1,
    • d2θn(tk)=dθn(tk)−dθn(tk−1),
    • dt2(tk)=tk−tk−1.


At time t1, the only known quantities relating to the segments are as follows:

    • a1(t1), θ1(t1)


These data are of course insufficient to describe the motion of the structure.


At time t2, the known quantities relating to the segments of ranks 1 to 5 are as follows:

    • a1(t2), θ1(t2), dθ1/dt(t2)


These data are still insufficient to describe the motion of the structure.


At time t3, the known quantities relating to the segments are as follows:

    • a1(t3), θ1(t3), dθ1/dt(t3), d2θ1/dt2(t3),
    • a2(t3), θ2(t3).


These data are still insufficient to describe the motion of the structure.


At time t4, the known quantities are as follows:

    • a1(t4), θ1(t4), dθ1/dt(t4), d2θ1/dt2(t4),
    • a2(t4), θ2(t4), dθ2/dt(t4).


These data are still insufficient to describe the motion of the structure.


At time t5 the known quantities are as follows:

    • a1(t5), θ1(t5), dθ1/dt(t5), d2θ1/dt2(t5),
    • a2(t5), θ2(t5), dθ2/dt(t5), d2θ2/dt2(t5),
    • a3(t5), θ3(t5).


These data are still insufficient to describe the motion of the structure.


At time t6, the known quantities relating to the segments of ranks 1 to 5 are respectively as follows:

    • a1(t6), θ1(t6), dθ1/dt(t6), d2θ1/dt2(t6),
    • a2(t6), θ2(t6), dθ2/dt(t6), d2θ2/dt2(t6),
    • a3(t6), θ3(t6), dθ3/dt(t6).


These data are still insufficient to describe the motion of the structure.


At time t7, the known quantities relating to the segments of ranks 1 to 5 are respectively as follows:

    • a1(t7), θ1(t7), dθ1/dt(t7), d2θ1/dt2(t7),
    • a2(t7), θ2(t7), dθ2/dt(t7), d2θ2/dt2(t7),
    • a3(t7), θ3(t7), dθ3/dt(t7), d2θ3/dt2(t7),
    • a4(t7), θ4(t7).


These data are still insufficient to describe the motion of the structure.


At time t8, the known quantities are as follows:

    • a1(t8), θ1(t8), dθ1/dt(t8), d2θ1/dt2(t8),
    • a2(t8), θ2(t8), dθ2/dt(t8), d2θ2/dt2(t8),
    • a3(t8), θ3(t8), dθ3/dt(t8), d2θ3/dt2(t8),
    • a4(t8), θ4(t8), dθ4/dt(t8).


At time t9 the known quantities are as follows:

    • a1(t9), θ1(t9), dθ1/dt(t9), d2θ1/dt2(t9),
    • a2(t9), θ2(t9), dθ2/dt(t9), d2θ2/dt2(t9),
    • a3(t9), θ3(t9), dθ3/dt(t9), d2θ3/dt2(t9),
    • a4(t9), θ4(t9), dθ4/dt(t9), d2θ4/dt2(t9),
    • a5(t9), θ5(t9).


These data now make it possible to completely describe the motion of the structure. If the representation is continued for the subsequent times t10 and t11, this gives:

    • at time t10, the known quantities relating to the segments of rank 1 to 5 are respectively as follows:
    • a1(t10), θ1(t10), dθ1/dt(t10), d2θ1/dt2(t10),
    • a2(t10), θ2(t10), dθ2/dt(t10), d2θ2/dt2(t10),
    • a3(t10), θ3(t10), dθ3/dt(t10), d2θ3/dt2(t10)
    • a4(t10), θ4(t10), dθ4/dt(t10), d2θ4/dt2(t10)
    • a5(t10), θ5(t10), dθ5/dt(t10); and
    • at time t11, the known quantities relating to the segments of rank 1 to 5 are respectively as follows:
    • a1(t11), θ1(t11), dθ1/dt(t11), d2θ1/dt2(t11)
    • a2(t11), θ2(t11), dθ2/dt(t11), d2θ2/dt2(t11),
    • a3(t11), θ3(t11), dθ3/dt(t11), d2θ3/dt2(t11),
    • a4(t11), θ4(t11), dθ4/dt(t11), d2θ4/dt2(t11),
    • a5(t11), θ5(t11), dθ5/dt(t11), d2θ5/dt2(t11).


The articulated motion of the structure with five segments is completely defined as soon as the accelerations and orientations of the five segments (n=5) are known, that is to say as from time t9 (k=9). Likewise it is found for example that, for a structure with three segments (n=3), the accelerations and orientations of the three segments are known as from time t5 (k=5).


It is thus possible to establish, between the integer number n and the integer number k, a relationship that translates the fact that the motion capture device is functioning correctly, that is to say delivers all the acceleration and orientation information necessary for all the segments of the structure. This relationship is written:






k>2n−2



FIG. 6B illustrates, in the general case, the results of calculations of acceleration and orientation data obtained, gradually, for various segments of a structure with articulated segments. The calculation of the acceleration and orientation data is described below for the first three segments.


The Case of the First Segment

In a first step, the measurements a1(tk) and M1(tk) are used, which correspond respectively to the acceleration measured (or calculated) on the segment 1 (by virtue of the first measuring means ML) and the measurements delivered by the second measuring means (MD1). Use is also made of the orientations θ1(tk−1) and θ1(tk−2) of the first segment given (or calculated) for the previous times (tk−1 et tk−2).


By virtue of these four items of information it is possible to calculate the orientation of the segment 1 at time tk: θ1(tk).


In a second step, a1(tk) the acceleration measured (or calculated) on the segment 1 (by virtue of the first measuring means ML) is used, as well as the orientations of the first segment θ1(tk) calculated at the previous step and θ1(tk−1) and θ1(tk−2) those given (or calculated) for the previous times (tk−1 and tk−2). With these quantities the acceleration a2(tk) at the articulation p2 is calculated.


The Case of the Second Segment

In a first step, the acceleration a2(tk) calculated at the previous step and the measurements M2(tk) of the measuring means MD2 of the second segment are used at time tk. Use is also made of the orientations θ2(tk−1) and θ2(tk−2) of the second segment given (or calculated) for the previous times (tk−1 and tk−2).


By virtue of these four items of information it is possible to calculate the orientation of the segment 1 at time tk: θ1(tk).


In a second step, a2(tk) the acceleration calculated at the second step of the first segment is used, as well as the orientations of the second segment θ2(tk) calculated at the previous step and θ2(tk−1) and θ2(tk−2) given (or calculated) for the previous times (tk−1 and tk−2). With these quantities the acceleration a3(tk) at the articulation p3 is calculated.


The Case of the Third Segment

The same two steps are carried out as for the second segment, substituting the index 4 for the index 3, the index 3 for the index 2 and the index 2 for the index 1.


This continues as far as the Nth segment: the same two steps are performed as for the second segment, substituting the index N+1 for the index 3, the index N for the index 2 and the index N−1 for index 1.


When all the segments have been considered, the following time tk is awaited in order to recommence.


In the general case, it should be noted that, in order to know the estimated orientation of a segment at time tk, it is necessary to know the estimated orientations of this same segment at the previous two times tk−1 and tk−2. Consequently, for the first calculation time, it is necessary to initialise the values of the orientations at the previous times. For this purpose it will be possible for example to make static measurements for which the accelerations are low and may consequently be ignored; the angles can then be calculated as described in patent application FR 2 838 185. It is also possible to use other means for initialising the angles (angular coders, set to a stressed initial position, etc).



FIGS. 7A and 7B depict two embodiments of a motion reproduction device according to the invention. The structure S consisting of n articulated segments is represented symbolically by a rectangle. The structure S, for example a man or a robot, is provided with a set of devices MDi (i=1, 2, . . . , n) and a set of local measurement systems MLj (j=1, 2, . . . , m). The devices MDi and the systems MLj are distributed over the structure as described previously. As also described previously, although m local measurement systems are shown in FIGS. 7A and 7B, a single system of local measurements suffices to implement the invention.


In the first embodiment (FIG. 7A), the measurements delivered by the devices MDi and the measurements delivered by the local measurement systems MLj are transmitted, by the respective radio signals RDi and RLj, to a calculation system 3, for example a computer. The motion reproduction device then comprises radio transmission means. The calculation system 3 is provided with a reception antenna R that receives the signals RDi and RLj. The calculation system 3 also receives, as input parameters, the value G of the local gravitation field in the reference frame, the value H of the local magnetic field in the reference frame and the coordinates of the various vectors {right arrow over (L)}i, (i=1, 2, . . . , n) that represent the various segments.


The calculation system 3 then implements a data process in accordance with what was described above with reference to FIGS. 5 and 6. A display device E, for example a screen, then displays the motion of the articulated structure.



FIG. 7B differs from FIG. 7A in that the radio signals RDi and RLj are not here directly transmitted to the calculation system 3 but are transmitted to an intermediate unit DEM fixed to the structure S. The unit DEM then transmits the data that it receives in the form of a radio signal RF to the calculation system 3.


The presence of an intermediate unit DEM on the structure S advantageously makes it possible to implement another embodiment of the invention. This is because, in the case where the structure S moves at a great distance from the calculation system 3, it is possible that the range of the RF signal may deteriorate. A memory card placed in the intermediate unit DEM can then record the signals RDi and RLj. The processing of the data can then be carried out subsequently to the capture of the measurements, once the movement is executed, from the reading of the data recorded on the memory card.

Claims
  • 1-19. (canceled)
  • 20. Motion capture device of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises: first means (ML) that deliver information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame forming a reference, at successive times tk, k being an integer number greater than or equal to 1,second measuring means (MD1) fixed to the segment of rank 1 and which deliver, at each time tk, a measurement (M1) representing an orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, andsupplementary measurement means (MDn) fixed to each segment of rank n (n=2, . . . , N), and which deliver, at each time tk, a measurement representing an orientation vector {right arrow over (Θ)}n of the segment of rank n.
  • 21. Motion capture device according to claim 20, in which the second measuring means (MD1) and the supplementary measuring means (MDn) consist of an accelerometer and a sensor that delivers a measurement of a uniform physical field present in the space where the structure moves and with a known direction in the reference frame.
  • 22. Motion capture device according to claim 21, in which the second measuring means (MD1) and the supplementary measuring means (MDn) further comprise at least one gyrometric axis.
  • 23. Motion capture device according to claim 21, in which the sensor that delivers a measurement of a uniform physical field of known direction in the reference frame is a magnetometer.
  • 24. Motion capture device according to claim 21, in which the sensor that delivers a measurement of a uniform physical field of known direction in the reference frame is a photoelectric cell.
  • 25. Device according to claim 20, in which the first means (ML) are measuring means consisting of a velocity measurer so that the data item able to restore an absolute acceleration vector of the segment of rank 1 is the velocity of the point.
  • 26. Device according to claim 20, in which the first means (ML) are measuring means consisting of a position measurer so that the data item able to restore an absolute acceleration vector of a point on the segment of rank 1 is the position of the point.
  • 27. Device for reproducing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rang n−1 at an articulation point pn, characterised in that it comprises: a motion capture device according to claim 20 in which the supplementary measurement means (MDn) of a segment of rank n are positioned close to the articulation point pn so that the distance that separates the supplementary measuring means (MDn) of a segment of rank n from the articulation point pn is considered to be zero, andcalculation means (3) that calculate, at each time tk:a) the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the information delivered by the first means,b) the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement (M1) representing the orientation vector ({right arrow over (Θ)}1) of the segment of rank 1;c) an acceleration vector {right arrow over (a)}n (n≧2) of the articulation point pn in the reference frame, from the equation:
  • 28. Device for reproducing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rank n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises: a motion capture device according to claim 20 in which the supplementary measuring means (MDn) of a segment of rank n are distant from the articulation point pn, andcalculation means (3) that calculate, at each time tk:a) the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the information delivered by the first means,b) the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement (M1) representing the orientation vector {right arrow over (Θ)}1 of the segment of rank 1;c) an acceleration vector {right arrow over (a)}n (n≧2) of the articulation point pn in the reference frame, from the equation:
  • 29. Motion reproduction device according to claim 27, in which radio transmission means transmit elementary electrical signals (RDn, RLm) representing the measurements delivered by the first measuring means (ML) and the second measuring means (MDn) to the calculation means (3).
  • 30. Motion reproduction device according to claim 29, in which the transmission means comprise an intermediate unit (DEM) that receives the elementary electrical signals (RD1, . . . , RDX, RL1, . . . , RLY) and that retransmits an electrical signal (RF) representing elementary electrical signals to the calculation means (3).
  • 31. Motion reproduction device according to claim 28, in which radio transmission means transmit elementary electrical signals (RDn, RLm) representing the measurements delivered by the first measuring means (ML) and the second measuring means (MDn) to the calculation means (3).
  • 32. Motion reproduction device according to claim 31, in which the transmission means comprise an intermediate unit (DEM) that receives the elementary electrical signals (RD1, . . . , RDX, RL1, . . . , RLY) and that retransmits an electrical signal (RF) representing elementary electrical signals to the calculation means (3).
  • 33. Device according to claim 20, in which storage means store the measurements delivered by the first measuring means (ML) and the second measuring means (MDn).
  • 34. Device according to claim 33, in which the storage means are placed on the structure.
  • 35. Method of capturing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rang n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it comprises: at least one determination of an item of information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame, at successive times tk, k being an integer number greater than or equal to 1,at least one measurement representing an orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, at each of the successive times tk, andfor each segment of rank n, at least one supplementary measurement of an orientation vector {right arrow over (Θ)}n of the segment of rank n in the reference frame, at each of the successive times tk.
  • 36. Motion capture method according to claim 35, in which the measurement representing the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame and the measurement representing the orientation vector {right arrow over (Θ)}n of the segment of rank n are each a measurement of a uniform field present in the space where the structure moves and with a known direction in the reference frame.
  • 37. Motion capture method according to claim 35, in which the information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame is the velocity of the point in the reference frame.
  • 38. Motion capture method according to claim 35, in which the information able to restore an absolute acceleration vector {right arrow over (a)}1 of a point on the segment of rank 1 in a reference frame is the position of the point in the reference frame.
  • 39. Method for reproducing the motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater than or equal to 2, the segment of rang n (n=2, . . . , N) being articulated with the segment of rank n−1 at an articulation point pn, characterised in that it uses: a motion capture method according to claim 35, anda calculation, at each time tk:a) of the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the measurement able to restore an absolute acceleration vector {right arrow over (a)}1,b) of the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement (M1) representing the orientation vector ({right arrow over (Θ)}1) of the segment of rank 1;c) of an acceleration vector {right arrow over (a)}n (n≧2) of the articulation point pn in the reference frame, from the equation:
  • 40. Method for reproducing motion of a structure consisting of N successive solid segments articulated with respect to one another from a segment of rank 1 as far as a segment of rank N, N being an integer number greater or equal to 2, segment of rank n (n=2, . . . , N) being articulated with the segment of rang n−1 at an articulation point pn, characterised in that it comprises: a motion capture method according to claim 35; anda calculation, at each time tk:a) of the absolute acceleration vector {right arrow over (a)}1 in the reference frame, from the information delivered by the first means,b) of the orientation vector {right arrow over (Θ)}1 of the segment of rank 1 in the reference frame, from the absolute acceleration vector {right arrow over (a)}1 and the measurement (M1) representing the orientation vector {right arrow over (Θ)}1 of the segment of rank 1;c) of an acceleration vector {right arrow over (a)}n (n≧2) of the articulation pn in the reference frame, from the equation:
Priority Claims (1)
Number Date Country Kind
06 01410 Feb 2006 FR national
PCT Information
Filing Document Filing Date Country Kind 371c Date
PCT/EP2007/051522 2/16/2007 WO 00 8/15/2008