The present application claims the benefit under 35 U.S.C. § 119 of German Patent Application No. DE 10 2022 203 199.7 filed on Mar. 31, 2022, which is expressly incorporated herein by reference in its entirety.
The present invention relates to a method for classifying movements, to an arithmetic logic unit configured to carry out the method, and to a sensor system.
Movement sensors that can be used to classify a movement are available in the related art. Sensors of this kind can, for example, be used in fitness and/or sports and worn on a human body. If certain fitness or sports exercises are then performed, the sensors can recognize and classify the type of the movement and optionally recognize and output a number of repetitions of the movement. U.S. Pat. No. 10,540,597 B1 describes a system of this kind in which data from a gyroscope and an accelerometer are evaluated using Kalman filters, the type of the movement is classified, and then a number of repetitions is output. A method for classifying movements in which, in particular, a frequency of a repeated movement is evaluated is used for this purpose. In this case, Kalman filters can be used in particular to correct information ascertained from the sensor data in order to enhance the measurement accuracy and the probability that a classification is correct. In particular, in Kalman filters a phase of a mathematical model is changed while the sensor data are processed in the mathematical model.
An object of the present invention is to provide an improved method for classifying movements, an arithmetic logic unit for carrying out the method, and an improved sensor system.
These objects may be achieved by the features of the present invention. Advantageous developments and example embodiments of the present invention are disclosed herein.
According to an example embodiment of the present invention, in a method for classifying movements, sensor data are first received. In this case, the sensor data may be output by a sensor directly via electrical lines, wires, cables, or the like, or via a wireless link. In both cases, the sensor data can be made available via a signal input of an arithmetic logic unit. The sensor may in particular already comprise an A/D converter for converting a physical measured value into a digital signal. In particular, the sensor may be an accelerometer and/or a gyroscope and/or a pressure sensor and/or a magnetic-field sensor, but it is not limited to these examples. A characteristic measured variable is then ascertained from the received sensor data, and a movement sequence is classified on the basis of the characteristic measured variable. In the process, the characteristic measured variable may, for example, include a movement frequency and the movement may be classified on the basis of the movement frequency. In particular, different fitness or sports exercises may have different movement frequencies, so conclusions on which fitness or sports exercise is being performed can be drawn on the basis of the movement frequency. Other repetitive movement sequences besides fitness or sports exercises can also be recognized.
Next, the sensor data are input into a mathematical model, wherein the mathematical model includes at least one coefficient and is dependent on the characteristic measured variable. The mathematical model is selected on the basis of the movement sequence. In particular, the mathematical model can thus be selected in accordance with the recognized or classified movement sequence. Then, an equation of state of a sensor data value is determined, wherein the equation of state includes the at least one coefficient. In the process, the sensor data value maps a curve of the characteristic measured variable. Next, the at least one coefficient is adjusted on the basis of the sensor data, wherein the coefficient is additionally kept within a predetermined range during the adjustment. Additionally, the mathematical model is adjusted on the basis of the adjusted coefficient. Additionally, an item of information is output, for example via a signal output, wherein the type of the classified movement is part of the information.
In the method described in the related art, the coefficients are fixed and are not changed. Only a phase is changed in order to ascertain the equations of state and the mathematical model. Using the method according to the present invention, different executions of the fitness or sports exercise can be mapped more accurately, for example on the basis of different physical abilities or if the person is tiring, thereby achieving greater accuracy when classifying the movement. By way of the predetermined range in which the changed coefficients are kept, classification errors, i.e., supposedly recognizing an incorrect movement, that is to say, a movement that is not performed, can be reduced. Additionally, person-specific differences in the execution of fitness or sports exercises can thus be taken into account, and in particular a sensor system can be adjusted to a user. By way of example, a particular user may execute a fitness or sports exercise differently from other users. The conventional methods from the related art cannot take these differences into account as the mathematical model is fixed.
In one specific example embodiment of the present invention, the sensor data are predicted using the adjusted mathematical model. This allows data to be acquired more accurately, thus allowing the movement to be classified more accurately too.
In one specific example embodiment of the present invention, the predetermined range is selected on the basis of the classified movement sequence. Therefore, classification errors in particular can be reduced further.
In one specific example embodiment of the present invention, reading the sensor data into the mathematical model, determining the equation of state of the sensor data value, adjusting the at least one coefficient, and adjusting the mathematical model are each carried out multiple times. As a result, even relatively long sequences of sensor data can be used, and the accuracy of the classification can additionally be increased further. Additionally, the sensor data can optionally be predicted multiple times.
In one specific embodiment of the present invention, the information additionally includes a measured variable that is characteristic of the movement sequence. By way of example, this may be a movement frequency or a number of repetitions of a fitness or sports exercise. As a result, for example, the movement frequency and number of repetitions of a fitness or sports exercise can also be output.
In one specific embodiment of the present invention, the mathematical model includes a Kalman filter, an expanded Kalman filter, or an unscented Kalman filter. These filters have proven suitable for the method and allow movements to be classified. In these embodiments in particular, improved accuracy can be achieved by the additional sensor data prediction and by the method steps being run through multiple times.
In one specific embodiment of the present invention, the equation of state of the sensor data value includes a Fourier series. The characteristic measured variable includes a frequency of a movement. In this case, there are at least two coefficients, which are Fourier coefficients of the Fourier series. More than two Fourier coefficients may also be provided. The predetermined range is determined on the basis of the Fourier coefficient(s) of the Fourier series. This allows for a simple mathematical transposition of the predetermined range. In the process, the Fourier coefficients can be adjusted such that the predetermined ranges for different movements do not overlap, meaning that the coefficients are each adjusted within a recognized movement.
In one specific embodiment of the present invention, an excursion and a phase are determined using the Fourier coefficients. When adjusting the Fourier coefficients, a maximum adjustment amount is used. The maximum adjustment amount is selected such that, in the event that the predetermined range is departed from, the excursion is scaled such that the excursion is within the predetermined range, and, in the event that the predetermined range is departed from due to the phase once the excursion has been scaled, the phase is changed such that the predetermined range is adhered to.
In one specific embodiment of the present invention, the information corrected on the basis of the mathematical model and ascertained from the sensor data is also used for classifying the movement. This can further improve the classification.
In one specific embodiment of the present invention, the adjusted coefficient and the adjusted model are stored in a memory. By way of example, this allows a user to repeat a fitness or sports exercise and makes it possible, when the fitness or sports exercise is being repeated, to consult a mathematical model that has already been adjusted to the movement sequence of the user.
In one specific embodiment of the present invention, at least one further coefficient is added to the mathematical model when it is established that the sensor data are then a better fit for the mathematical model. This can entail, for example, changing the number of Fourier coefficients. By way of example, this can be configured as reinforcement learning.
The present invention further relates to an arithmetic logic unit comprising a signal input, a processor, and a signal output. The processor comprises a program that causes the arithmetic logic unit to receive sensor data via the signal input, and then to carry out the method according to the present invention and output the information via the signal output. In this case, the processor can include the program in the form of an accordingly equipped piece of hardware, for example a chip adjusted to the program sequence, or the program can be processed in the processor in the form of software.
The arithmetic logic unit may have a memory, wherein the processor comprises a program that causes the arithmetic logic unit to store the adjusted coefficient and the adjusted model in the memory.
The present invention further relates to a sensor system that comprises a sensor for determining sensor data and an arithmetic logic unit according to the present invention. The sensor is connected to the signal input. Sensor data ascertained using the sensor can be communicated to the signal input.
Exemplary embodiments of the present invention are explained on the basis of the figures.
Reading the sensor data into the mathematical model, determining the equation of state of the sensor data value, adjusting the at least one coefficient, adjusting the mathematical model, and, where applicable, predicting the sensor data, i.e., the third method step 103, the fourth method step 104, the fifth method step 105, the sixth method step 106, and, where applicable, the seventh method step 107, can each be carried out multiple times. As a result, even relatively long sequences of sensor data can be used, and the accuracy of the classification can additionally be increased further.
In one exemplary embodiment, the information additionally includes a measured variable that is characteristic of the movement sequence. By way of example, this may be a movement frequency or a number of repetitions of a fitness or sports exercise. As a result, for example, the movement frequency and number of repetitions of a fitness or sports exercise can also be output in the eighth method step 108.
In one exemplary embodiment, the mathematical model includes a Kalman filter, an expanded Kalman filter, or an unscented Kalman filter. These filters have proven suitable for the method and allow movements to be classified.
In the embodiment in
In one of the embodiments explained in conjunction with
In particular, a parameterized equation of state for a dimension of the sensor 140 for a time range t can be described using the formula:
where θtθ_t corresponds to the phase over time t, and C0,i corresponds to a signal offset. Ck,i and Sk,i are the Fourier coefficients, and k corresponds to the frequency component, where k=1 corresponds to the fundamental and k>1 corresponds to the harmonics. N is the number of possible vibrations (fundamentals and harmonics). The composition of this formula including the Fourier coefficients can correspond to the determination of an equation of state of a sensor data value of the fourth method step 104.
The classification and, where applicable, the determination of the measured variable that is characteristic of the movement sequence can be carried out by determining the phase θt as being between 1 and M for all sensor dimensions i by using an expanded Kalman filter, for example, by way of predetermined Fourier parameters: 0_t
This is known in principle from the related art.
When adjusting the at least one coefficient of the fifth method step 105, a quadratic error equation
can be determined. This can be done such that
is minimized for each sensor dimension and the relationships
are adhered to. In this case, p denotes an excursion, which can be calculated using
and a corresponds to the angle predetermined by Ck,i and Sk,i. In this case, the aim is not an exact solution to the problem but rather an approximation that is accurate enough. The boundary conditions of the excursion and direction are provided firstly to avoid the fitness and sports exercise being associated with the wrong exercises and secondly also to prevent large deviations from the intended parameters for the exercise.
To be able to adjust the Fourier coefficients, it may be provided to consider one small step in each case toward gradients of the equation of state. This can be described by way of the formulas:
At a time j, the Fourier coefficients can be adjusted in the fifth method step 105 using the formulas:
In the process, a length of the change 213 can be scaled using a scaling factor γ. Using the formulas:
the scaling factor can be calculated for both Fourier coefficients. As a result, a similar or identical convergence rate can be obtained for the parameters.
In the event that the change 213 is such that the predetermined range 225 would be departed from, a further adjustment can then be carried out. In this case, the change 213 can be adjusted such that the second measurement signal 212 no longer departs from the predetermined range.
where
Where an adjustment is carried out in relation to the excursion, this may already change the direction such that the direction is between the minimum angle 223 and the maximum angle 224.
and then a summated phase change can be carried out using the formula:
It can then be checked whether the direction is within the predetermined boundary conditions, it being possible to use the following formulas:
In the process,
can be used.
The Fourier coefficients can be adjusted when
This can be done using the equations:
It may be provided that the boundary conditions, i.e., the minimum excursion 221, the maximum excursion 222, the minimum angle 223, and the maximum angle 224, are not implemented for each pass of the method but only during each second, third, etc., pass.
Lastly, a smoothing filter may also be used, which can be described using the formulas:
The smoothing filter can be initialized using predetermined coefficients, for example:
it being possible to configure a filter parameter ∈1 for each fitness or sports exercise.
In one exemplary embodiment, the predetermined range 225 is selected on the basis of the classified movement sequence. Therefore, classification errors in particular can be reduced further.
In one exemplary embodiment, the information ascertained from the sensor data on the basis of the mathematical model is also used for classifying the movement. This can further improve the classification.
Using the predetermined ranges 225 shown in
This can be used in particular when a technique of a user, for example the person 150 in
Using the formula:
a summation can then be carried out by way of the sensor dimensions, and standardization can be carried out using the sensor noise σi; the accepted frequency ω of the corresponding exercise is also used for the standardization.
An activity rate can then be calculated and filtered using the formulas:
The activity rate describes how close the execution of the fitness or sports exercise is to a predetermined pattern. If the activity rate 251 exceeds the threshold value 254 for the first predetermined time period 255, the Fourier coefficients can be adjusted. If the activity rate 251 is below the threshold value 254 for the second predetermined time period 256, the adjustment of the Fourier coefficients can be terminated. The first time period 255 and the second time period 256 may be identical, but may also be different.
Although the present invention has been described in detail using the preferred exemplary embodiments, the present invention is not limited to the disclosed examples and a person skilled in the art may derive other variations therefrom without departing from the scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
10 2022 203 199.7 | Mar 2022 | DE | national |