Method and Device for Determining a Person's Motions

Abstract

A sensor worn by a person measures movements of the person. Movements of orientation are not expressed by rotations leading from a stationary reference point to a reference point associated with the sensor, but by angles separating axes or planes of the stationary reference point and axes associated with the wearer, thereby making it possible to better identify his/her movements and his/her activity. The sensor can be applied to the monitoring of patients.

Description

The subject of this invention is a method and a device for determining movements of a person.

There are numerous uses of such methods for activity monitoring or surveillance purposes. One of them, which is important for the invention, without being limiting, is the surveillance of patients. It is important to provide not only the situation in the space of a person, but also indications concerning his/her posture and even his/her activity or physiological state so as to help to detect a dangerous state and intervene with a lower risk of ineffectiveness.

The surveillance is performed by a sensor associated with the person (who will also be referred to as “the wearer” in this text), often stuck to the chest. It often includes acceleration detectors in which the integration of signals gives to position of the person or physiological indications such as respiration or heartbeat. The movement of the person can be known in position as well as in orientation, according to successive inclinations communicated to the sensor.

French patent 2 838 185 describes a method for determining the orientation of a sensor capable of being placed on a solid body and in particular on a person, estimated by so-called angles of pitch, roll, and yaw, measured from a stationary reference point. The sensor includes magnetometers and accelerometers.

It is then natural to use a stationary reference point comprising an axis directed toward the local magnetic North, an axis directed toward the magnetic East and a third axis directed toward the ground. The method for estimating the orientation of the sensor comprises a mathematical optimisation converging toward the orientation measured. A mobile reference point associated with the sensor is introduced. At each instant, the sensor provides the measurement of the magnetic field and of the gravitational field in the mobile reference point. Then, a rotation giving this measurement is sought, according to the value of the magnetic field expressed in the stationary reference point. This rotation can be expressed in a composition of three basic rotations of Euler angles, such as roll, pitch and yaw angles, so as to obtain the measurements of the sensor. This method is repeated continuously at short time intervals.

The disadvantages of such a method are that it is not easy to interpret the results for deducing the behaviour of the wearer of the sensor. Moreover, the sensor is generally put on by the person who wears it, with uncertainty about the desired orientation, which makes it even more difficult to interpret the results. Finally, the real movements are complex and rapid in the sense that they generally and quickly cause a variation in a plurality of Euler angles of the sensor at one time. The convergence can then become difficult; substantial instabilities are common in practice.

An example of the difficulty of interpreting the movements of the wearer of the sensor can be the following. When the wearer turns around in standing position, about the vertical, the sensor records a variation in the three Euler angles, the variation of the yaw angle, assumed to express this movement of the wearer, being completed by variations in the pitch and roll angles in the general case. In practice, all movements of the wearer, even simple ones, are expressed by combinations of variations, even simple ones, in all of the Euler angles.

Therefore, it has been sought to improve the prior art methods so as to make it easier to work with the indications of the orientation of the person. The invention is based on the observation that the orientation difference of the main axes of the sensor with respect to the natural axes of the wearer are essentially responsible for the difficulties in interpretation of the results, while such differences are, for all practical purposes, inevitable.

The new angles that the sensor will provide will be associated with physical postures of the wearer rather than with orientations of the sensor itself. They will express the person's lateral inclination, his/her longitudinal inclination and the direction toward which the person is turned.

It will thus be easier to determine the type of activity of the wearer.

One aspect of the invention consists of calibrating the position of the sensor even if it was originally positioned improperly: it is necessary simply to take a first measurement when the wearer assumes a conventional posture that he/she is instructed to assume; the original indications given by the sensor correspond to this conventional posture. The orientations of the sensors are continuously recalculated according to these results of the calibration so as to give the orientation of the wearer, the change of which makes it possible to much more easily interpret the movements that he/she is making, with the couplings between the rotation angles being much less significant in the reference point associated with the person.

Other aspects of the invention will now be described in relation to the figures.

FIG. 1 shows the location of the sensor on the wearer,

FIG. 2 shows the sensor in its entirety,

FIG. 3 shows the processing system,

FIGS. 4 and 5 show relationships between two movement points and

FIG. 6 shows an organisation chart.

FIG. 1 shows that the sensor, designated with the reference 2, is placed on the chest of a wearer 1. It could be placed on the abdomen or in other locations. The sensor 2 is miniature, which enables it to be worn comfortably. The axes X₀, Y₀ and Z₀ define a stationary reference point R₀ and are directed toward the magnetic North, the magnetic East and the ground; X₀ and Y₀ are by definition horizontal and Z₀ is vertical. Another reference point R₂ is associated with the sensor 2, the axis X₂ being directed toward the front of the wearer, axis Z₂ toward the feet and axis Y₂ toward his/her right-hand side. The known method involves measuring the angles bringing the stationary reference point R₀ to the reference point associated with the sensor R₂ by a rotation about the axis Z₀ with a yaw angle, then by a rotation about the axis Y₀ (moved by the yaw rotation) by a pitch angle, then by a rotation about the axis X₀ (also moved) by a roll angle.

According to FIG. 2, the sensor 2 can comprise a casing 3 containing three accelerometers all designated with the reference 4, three magnetometers all designated with the reference 5 and a processing system 6 to which the accelerometers 4 and magnetometers 5 are connected by wires so as to provide it with their signals. The accelerometers 4 each measure an acceleration component of the movement of the wearer's chest 1 in one of the axes X₂, Y₂ and Z₂ respectively according to the direction of gravity; the magnetometers 5 do the same according to the direction of the Earth's magnetic field. The sensor 2 is held at a constant orientation against the skin or a clothing item of the wearer 1 with adhesive, stitches, a fastening band or any other suitable means. FIG. 3 shows that the signals from the accelerometers 4 or the magnetometers 5 each pass through a standardisation module 7 and are transmitted to a first calculation module 8 that calculates, according to the prior art, the angles of pitch, roll and yaw expressing the rotations between the reference points R0 (X₀, Y₀ and Z₀) and R2 (X₂, Y₂ and Z₂).

We will now discuss the more characteristic aspects of the invention. A second calculation module 9 completes the calculations indicated above in order to express the positions of axes X₁, Y₁, and Z₁ of another reference point R₁, associated with the wearer 1, and which appears in FIG. 4. The axis X₁ is directed toward the outside of the chest (forward), the axis Y₁ is aligned with the shoulders and directed to the right and axis Z₁ runs along the trunk and is directed downward. It should be noted that if the sensor 2 is properly positioned, the respective axes of the reference points R₁ and R₂ are parallel. The invention is fully useful even if this condition is not satisfied.

Next, three new angles are defined to characterise the posture of the wearer 1. Their location is shown in FIGS. 4 and 5. The angle θ is defined between the axis of the vertical and the axis X₁ directed forward and expresses the inclination of the wearer 1 at close to 90°; it is close to 0 in the straight position, +90° along the abdomen and −90° along the back.

The lateral angle of inclination or twist angle ψ is defined as the angle between the lateral axis Y₁ and the horizontal at close to 90°; it is equal to 90° if the wearer is standing straight or if, for example, he/she is leaning forward, less than 90° if the person leans toward the right and greater than 90° if he/she leans toward the left. Its value may range between 0° and 180°. This angle can indicate whether the person is on his/her right side, left side, back or front when lying down.

The third angle of orientation of the person expresses the direction toward which he/she is turned. It is an angle of azimuth φ made by the projection of the axis X₁ directed forward in the horizontal plane and the axis X₀ pointing to the magnetic North.

The organisation chart of FIG. 6 shows the calculations performed in the processing system 6 in accordance with the invention. The first calculation module 8 gives the normal angles of orientation of the sensor 2 with respect to the stationary reference point using a processor 10 that combines the measurements of the magnetometers and the accelerometers together. These calculations are regularly re-performed in order to monitor the movements of the wearer. In a more original manner, the results are transmitted to the second calculation module 9, which contains a second processor 12 and a calibration memory 11. This second calculation module 9 makes it possible to go from the reference point associated with the sensor R₂ to the reference point associated with the wearer R₁ and makes an estimation of the angles separating these reference points, which is particularly important if the sensor is attached to the person with its main axes very different from the main axes of the person. It is assumed that the wearer attaches the sensor 2 to his/her chest and that the sensor 2 no longer moves then, so that the reference points R₁ and R₂ are in a relative invariable position. The person 1 is asked to stand up straight, against a wall for example, for one or two seconds, or possibly lying on the ground in a known direction. The orientation of the reference point associated with the person R₁ with respect to the stationary reference point R₀ is then precisely known, and preliminary measurements performed with the sensor 2 give the orientation of the reference point associated with the sensor R₂ (X₂, Y₂, Z₂) in the stationary reference point R₀ (X₀, Y₀, Z₀). It is then easy to deduce the orientation of the reference point associated with the person R₁ (X₁, Y₁, Z₁) with respect to the reference point associated with the sensor R₂ since the mutual positions of the stationary reference point R₀ and the reference point associated with the person R₁ are known. This difference in orientation (which can be expressed in the form of three angles) of rotation applied successively, as between R₀ and R₁ as described above is used as a corrective action for all subsequent measurements. It is stored in the calibration memory 11 after having been registered there during the calibration.

The equation making it possible to go from the reference point associated with the sensor R₂ to the reference point associated with the person R₁ is therefore P_R2→R1=P_R2→R0 ref·P_R0→R2 ref, in which P are rotation matrices, P_R2→R0 ref expresses the measured orientation of the sensor in the reference state during calibration, and P_R0→R1 ref expresses the known orientation of the person in the stationary reference point during calibration.

At any subsequent time t, the second processor 12 applies the equation:P_R0→R1(t)=P_R0→R2(t)·P_R2→R1

The results are then transmitted to a monitoring station outside the sensor and not shown.

Another way to calibrate the device would consist of using a second orientation sensor, equivalent to the previous one but used to give orientations in the stationary reference point R₀. The second orientation sensor is associated with a part such as a straight edge, preferably with a main axis of measurement in the direction of the straight edge. While the wearer 1 is in a stable posture, seated for example, the straight edge is placed on certain chosen parts of the body so as to deduce the position of the anatomical axes of the reference point associated with the person R₁ at this time in the stationary reference point R₀. These parts where the straight edge is placed can be the apex of the vertebral column (with the straight edge in a vertical position) and the axis of the shoulders (with the straight edge in a horizontal position). The orientation of the sensor 2 with respect to the person 1 wearing it can be deduced if the measurements of the sensor 2 at this time and the comparison thereof with those of the other sensor are known. This calibration method can give better results than the previous one.

The invention can be used with all types of known sensors, including various combinations of magnetometers, accelerometers, gyrometers or other means; it can complement methods in which the orientation of the sensor is represented by quaternions known to a person skilled in the art rather than by Euler angles.

Clinical trials have shown that the method according to the invention makes it possible to conveniently interpret routine movements of patients and changes in posture between standing, sitting and lying positions.

A remarkable application of the method will probably be the balance analysis: trials have shown that it provided sensitive results under stable and under disturbed conditions, resulting from posture or external elements, and that it therefore made it possible to recognise or even distinguish some of these disturbances. Moreover, the movements for restoring balance can be measured precisely and analysed.

Claims

1-7. (canceled)

8. A method for determining movement of a person, comprising: measuring orientation of a sensor associated with the person; giving three angles of orientation of the sensor with respect to a stationary reference point; and correcting angles so as to give three angles of posture expressing a lateral inclination of the person, a longitudinal inclination of the person, and a direction toward which the person is turned according to a preliminary calibration between the sensor and the person, by a comparison of the angles of orientation of the sensor and values of the angles for a conventional posture, determined with respect to the stationary reference, imposed on the person.

9. A method according to claim 8, wherein the preliminary calibration between the sensor and the person includes a comparison of the angles of orientation of the sensor and angles of orientations, measured according to a stationary reference, of an orientation sensor associated with a part placed in predetermined locations on the person's body.

10. A method according to claim 8, wherein the sensor includes accelerometers and magnetometers.

11. A method according to claim 8, wherein the sensor includes gyrometers.

12. A method according to claim 8, wherein the angles of orientation of the sensor are Euler angles.

13. A method according to claim 8, wherein the angles of orientation of the sensor are expressed by quaternions.

14. A device for applying a method according to claim 8, comprising: a first calculation module giving the angles of orientation of the sensor with respect to the stationary reference; a second calculation module giving the angles of orientation of the person with respect to the stationary reference; and a calibration memory storing three angles of orientation of the person with respect to the sensor and registered during the preliminary calibration.