The present invention relates to a method for quantifying a gait, especially referring to a method for accurately quantifying a gait parameter of a human body by using Wi-Fi.
When measuring a movement parameter of a human body of a subject during the medical research, the subject will be equipped with a wearing device, and the movement parameter or a limb movement of the human body will be obtained by an inertia measuring unit or a camara device respectively to evaluate whether an abnormal phenomenon exists in the movement of human body. However, the wearing device interferes the extension of human limbs to a certain degree and compresses the human body for long-term wearing, making it unsuitable for every patient. Moreover, the camara device, limited by the requirement of shooting angle and the privacy problem, is not suitable for long-term tracking and measuring.
In view of the problem aforementioned, current relevant research indicates that a gait parameter can be measured through Wi-Fi in the environment. However, error exist in the results measured using Wi-Fi with respect to the actual results of the human body movement, resulting in a human body healthy surveillance cannot be performed accurately. In summary, a method for accurately quantifying the gait parameter of the human body by using Wi-Fi is needed nowadays.
The problem that the present invention aims to solve comprises: providing a method for accurately quantifying a gait parameter of a human body by using Wi-Fi.
To accomplish the purpose, the present invention provides a method for health surveillance using Wi-Fi to quantify gait parameter, comprising: (S1) using a transmitter and a receiver to establish a Wi-Fi space, wherein the transmitter is configured to emit a first wireless signal; (S2) moving a human body in the Wi-Fi space to receive a second wireless signal by the receiver, and extracting a CSI signal from the second wireless signal, wherein the second wireless signal is formed by the first wireless signal reflected from the human body; (S3) preprocessing the CSI signal to obtain a denoised CSI signal; (S4) performing a feature extraction on the denoised CSI signal to obtain a human body CSI gait parameter; and (S5) calibrating the human body CSI gait parameter using a calibration equation to obtain a calibrated gait parameter.
Preferably, in the step (S1), a line of sight
Preferably, wherein the step (S3) comprises: using a wave filter to filter a high frequency noise in the CSI signal, and performing a principal component analysis (PCA) on the CSI signal, thereby extracting a human body gait related signal from the CSI signal; or wherein the step (S4) comprises: performing a short-time Fourier transform (STFT) on the denoised CSI signal to obtain a spectrogram, and tracking a high energy region in the spectrogram to form a trunk velocity contour on the spectrogram thereby obtaining the human body CSI gait parameter.
Preferably, in the step (S5), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, wherein a step for obtaining the human body actual gait parameter comprises: equipping a mark on a first body part of the human body and tracking the mark using a tracking software thereby obtaining a first actual walking velocity curve.
Preferably, in the step (S5), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, and establishing the correlation between the human body CSI gait parameter and the human body actual gait parameter using a linear regression to obtain the calibration equation: Vcorrection=1.305 VCSI+0.006325, wherein the VCSI is a human body walking velocity obtained by analyzing the CSI signal, the Vcorrection is a calibrated human body walking velocity obtained by calibrating the VCSI.
The present invention further provides a system for health surveillance using Wi-Fi to quantify gait parameter, comprising: a transmitter configured to emit a first wireless signal; a receiver arranged relative to the transmitter to optionally receive a second wireless signal and extract a CSI signal from the second wireless signal, wherein the second wireless signal is formed by the first wireless signal reflected from a human body; and a processor arranged relative to the receiver and configured to receive the CSI signal and execute an instruction as the following: (SA) preprocessing the CSI signal to obtain a denoised CSI signal; (SB) performing a feature extraction on the denoised CSI signal to obtain a human body CSI gait parameter; and (SC) calibrating the human body CSI gait parameter to obtain a calibrated gait parameter using a calibration equation.
Preferably, a line of sight
Preferably, wherein in the step (SA) comprises: using a wave filter to filter a high frequency noise in the CSI signal, and performing a principal component analysis (PCA) on the CSI signal, thereby extracting a human body gait related signal from the CSI signal; or wherein the step (SB) comprises: performing a short-time Fourier transform (STFT) on the denoised CSI signal to obtain a spectrogram, and tracking a high energy region in the spectrogram to form a trunk velocity contour on the spectrogram thereby obtaining the human body CSI gait parameter.
Preferably, wherein in the step (SC), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, wherein a step for obtaining the human body actual gait parameter comprises: equipping a mark on a first body part of the human body and tracking the mark using a tracking software thereby obtaining a first actual walking velocity curve.
Preferably, in the step (SC), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, and establishing the correlation between the human body CSI gait parameter and the human body actual gait parameter using a linear regression to obtain the calibration equation: Vcorrection=1.305 VCSI+0.006325, wherein the VCSI is a human body walking velocity obtained by analyzing the CSI signal, the Vcorrection is a calibrated human body walking velocity obtained by calibrating the VCSI.
The effectiveness of the present invention compared with prior art comprises: in prior art, there are gaps or differences between the human body gait measurement result measured by using Wi-Fi directly and the result of actual walking of the human body, therefore the Wi-Fi measurement lacks practical value and cannot be used to determine a healthy degree of a subject. The method provided by the present invention comprises analyzing the result of CSI signal and fitting them with the human body actual gait parameter to obtain the calibration equation, wherein the gait parameter is close to the human body actual gait parameter after the gait parameter of CSI signal is calibrated by the calibration equation, thereby can be used to analyze the health status of the human body. On the other hand, the present invention can analyze one or more time period of a human body gait change curve, calculate the gait parameter to track the history measuring result of the subject's gait, and remind the subject when abnormality occurs in their body, thereby improving the medication administration or the treatment strategy to the subject.
To elaborate the purpose, effectiveness, or characteristic of the present invention more properly, some preferred embodiments are provided as the following:
One of the aims of the present invention is to provide a method for health surveillance using Wi-Fi to quantify gait parameter, as shown in
In some embodiments, in the step (S5), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter. Specifically, a condition that can be adjusted in the process of obtaining the human body CSI gait parameter or a human body actual gait parameter comprises: subject's age, sex, or body type; the hardware condition of, or the correlation between the transmitter and the receiver settings; the angle and the distance of a line started from an start point to an end point of walking of the subject, or the line relative to a line of sight (LoS); or step length, cadence and any combination thereof of the subject. In some preferred embodiments, the human body CSI gait parameter is a first velocity and time correlation diagram obtained by CSI measurement, from which a first human body velocity curve is formed, wherein a walking velocity of the human body VCSI is obtained in accordance with the first human body velocity curve; and the human body actual gait parameter is a second velocity and time correlation diagram obtained by a wearing device or an image tracking system, from which a second human body velocity curve is formed, wherein a walking velocity of the human body VREAL. In some preferred embodiments, the VCSI can be calibrated to become a Vcorrection using the calibration equation, wherein the Vcorrection is close to VREAL, in other words, the Vcorrection represents the actual walking velocity of the human body, and it will be further compared with a default threshold to determine whether a health status of the human body is qualified.
In some embodiments, the method further comprises: (S6) calculating T1 and T2 in one or more time period, and delivering a health surveillance report when T2>T1, wherein T1 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T2 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold. Concretely, the default threshold is adjustable in accordance with the subject's age, sex, body weight, or health condition, T1 represents the total time during which the performance of the subject's gait is good, and T2 represents the total time during which the performance of the subject's gait is poor, in other words, through comparing the difference between T1 and T2, the gait performance of the subject can be evaluated, and according to the difference between T1 and T2, the health status of the subject can be evaluated for improving the medication administration or for changing treatment direction. In some embodiments, the one time period refers to, for example, 1 a.m. to 10 a.m.; the more time period refers to, for example, 1 a.m. to 2 a.m., 4 a.m. to 5 a.m., and 7 a.m. to 8 a.m.
In some embodiments, the method further comprises: (S7) calculating T1 and T2 in a first time period, wherein T1 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T2 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold; calculating T3 and T4 in a second time period, wherein T3 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T4 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold; and delivering a health surveillance report when
wherein the second time period is later than the first time period. Concretely, the improvement of gait of human body can be understood through analyzing the performance of the gait in different time period, that means, when
is larger, the performance of the subject in the first time period is better, when
is larger, the performance of the subject in the second time period is better, and conceivably, when
the performance of the subject in second time period is worse than the performance of the subject in the first time period, further condition tracking or medication improvement may be needed for preventing from health deterioration of the subject. In some embodiments, the length of total time of the first time period is identical to or is not identical to the length of the of total time of the second time period, and the first time period and the second time period can be single time period or multiple time periods respectively.
In some embodiments, in the step (S5), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter; and establishing the correlation between the human body CSI gait parameter and the human body actual gait parameter using a linear regression to obtain the calibration equation: Vcorrection=1.305 VCSI+0.006325, wherein the VCSI is a human body walking velocity obtained by analyzing the CSI signal, the Vcorrection is a calibrated human body walking velocity obtained by calibrating the VCSI. In some embodiments, the calibrated gait parameter comprises the calibrated human body walking velocity Vcorrection.
In some embodiments, to ensure the accuracy of the measurement, and to avoid the difference between the human body CSI gait parameter and the human body actual gait parameter is too large to calibrate, in the step (S1), a line of sight
In some embodiments, to avoid the interference of the noise, and to prevent the accuracy of the gait parameter measurement from affecting by the signal irrelevant to the gait of the human body, in the step (S3) comprises: using a wave filter to filter a high frequency noise in the CSI signal, and performing a principal component analysis (PCA) on the CSI signal, thereby extracting a human body gait related signal from the CSI signal; moreover, to quantify a gait parameter extracted from the denoised CSI signal, the step (S4) comprises: performing a short-time Fourier transform (STFT) on the denoised CSI signal to obtain a spectrogram, and tracking a high energy region in the spectrogram to form a trunk velocity contour on the spectrogram thereby obtaining the human body CSI gait parameter, wherein the trunk velocity contour is first human body velocity curve or highest energy curve.
In some embodiments, in the step (S5), to obtain the human body actual gait parameter and to make it a comparative standard to the human body CSI gait parameter, a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, wherein a step for obtaining the human body actual gait parameter comprises: equipping a mark on a first body part of the human body and tracking the mark using a tracking software thereby obtaining a first actual walking velocity curve. In some embodiments, the second human body velocity curve comprises the first actual walking velocity curve.
Embodiment 1: the specification of the transmitter (1) Tx and the receiver (2) Rx.
The present invention uses a Linux™ 802.11n CSI tool and its monitor mode to collect the CSI signal. Further, in the present invention, two minicomputers (GIGABYTE™ GB-BER7H-5800) are configured as the transmitter (1) and the receiver (2) respectively, wherein both the two minicomputers run Ubuntu 14.04 LTS system, and are equipped with Wi-Fi Link 5300 network interface controller (NICs) (Intel®), and three omnidirectional antennas to generate 9 of CSI data streams. Specifically, every CSI data stream comprises detailed measurement data of 30 subcarriers, and different frequency of signal composed of amplitude and phase. In addition, the microcomputers collect the data in the 5 GHz frequency band, specifically the central frequency is 5.32 GHz, the band width is 20 MHz, and the sampling rate is 1000 Hz. It is understood that the NIC can be used to capture the CSI signal and then transmit the CSI signal to the processor (3) thereby allowing the processor (3) to conduct subsequent signal processing.
Embodiment 2: the process of preprocessing of CSI signal.
The CSI signal obtained by the transmitter (1) Tx and the receiver (2) Rx comprises: a human body walking related signal and a noise coming from hardware and environment, to prevent the CSI signal from the interference of the noise, the CSI signal is preprocessed. Specifically, to obtain a denoised CSI signal, a band-pass filter is used to remove the high frequency part of noise and the affection of DC component in the CSI signal. Then, a principal component analysis (PCA) is performed on the denoised CSI signal to process the subcarrier from all the omnidirectional antennas and to reduce the dimensionality of denoised CSI signal, thereby obtaining a signal component related to the human gait or the walking mode.
Embodiment 3: the process of performing a feature extraction on the denoised CSI signal to obtain a human body CSI gait parameter.
A short-time Fourier transform (STFT) is performed on the denoised CSI signal to change it into a spectrogram comprising an energy distribution, wherein the horizontal axis of the spectrogram is time, the vertical axis of the spectrogram is frequency. With reference to
The following provides the method for obtaining a human walking velocity from the spectrogram: during the process of obtaining the CSI signal, the receiver (2) receives the signal reflected from the human body to analyze the gait of the human body, conceivably, the area of the trunk is largest, the largest quantity of the signal will be reflected from the trunk, thereby forming the most signal power shown in the spectrogram. As shown in
The following provides the method for obtaining a human body cadence from the spectrogram: providing a weighted average method: first, standardizing the energy value in the spectrogram to the range from 0 to 1; second, removing the frequency value where an energy strength is lower than 0.3; third, multiplying the frequency value at every time point by its energy strength to obtain a weighted average frequency fweighted(t) as the following equation:
wherein fi(t) represents the frequency at which the time is t, Ei(t) represents the energy value of every fi(t) in the spectrogram, Etotal(t) represents the total energy at which the time is t, and variable n is the total number of frequencies satisfying the condition Ei(t)>0.3. With reference to
Embodiment 4: the following provides a test using Wi-Fi and Tracker to demonstrate whether the walking velocity measured by the CSI reflects the actual walking velocity of the human body.
As shown in
From the start point (S) to the end point (E), the subject walks in any combination of three cadences (1 Hz, 1.5 Hz, and 2 Hz) and three step lengths (20 cm, 40 cm, and 60 cm). Notably, the condition (1.5 Hz+20 cm) and (2 Hz+20 cm) are excluded because they are impractical. The remaining 7 conditions and an additional condition that the subject walks in random cadences and step lengths (naturally), totally 8 conditions are tested, wherein every condition is tested for 10 times, totally 80 of CSI data fragments are collected, and a CSI velocity curve (the first human body velocity curve) is obtained.
In this test, to obtain a Tracker velocity curve (the second human body velocity curve), a mark is equipped on the waist of the subject, then the subject is allowed to move according to the 8 conditions, and an image analyzing software Tracker, established by the Open Source Physics (OSP) Java, is used to track the mark on the waist of the subject and then calculate the actual walking velocity of the subject (VRA). As shown in
Accordingly, the human body gait parameter measured using CSI needs to be calibrated to reflect the actual walking status of the human body. To determine whether the calibrated CSI velocity curve is close to the Tracker velocity curve, in this embodiment, a Dynamic Time Warping (DTW) is used to evaluate the similarity between the CSI velocity curve and the Tracker velocity curve, the smaller the DTW value, the higher the similarity between the two curves.
Embodiment 5: the establishment of the calibration equation
To eliminate the error between the CSI velocity curve and the Tracker velocity curve, to make the Wi-Fi-derived walking velocity closer to the human body actual walking velocity, and to realize a precise quantification of walking velocity accomplished without using a wearing device and an image monitoring device, the following provides a velocity quantification calibration function for calibrating the walking velocity measured by Wi-Fi. First, analyzing the 80 CSI data fragments to obtain an average walking velocity (VCSI) derived from the CSI, and obtaining the human body actual walking velocity (VREAL) measured by Tracker. Second, as shown in
As shown in the calibration equation: Vcorrection=1.305 VCSI+0.006325, wherein the coefficient is 1.305, the constant is 0.006325. According to the coefficient and the constant, it can be concluded as follows: (1) before calibrating the CSI velocity curve using the calibration equation, the CSI velocity curve is nearly completely lower than the Tracker velocity curve; (2) the range of extremum in the CSI velocity curve is smaller than in the Tracker velocity curve, indicating that the fluctuation of peak value and valley value is relatively smooth compared with the Tracker velocity curve; (3) the constant is small, indicating that the correlation between the CSI velocity curve and the Tracker velocity curve approximates a inclined line. As shown in
Embodiment 6: generalization tests will be provided as follows to estimate the performance of the calibration equation under different circumstances.
Multiple variables are arranged to be tested separately, the variable comprises: (1) individual differences of subjects, (2) relative correlation between the arrangements of transmitter (1) Tx and receiver (2) Rx, (3) relative position between walking path and the line formed by Los, (4) walking direction (toward or away from Los), walking angle (θ), length of Los (L), the distance the subject moves from the start point to the end point (D), and walking path offset (δ). On the other hand, other environments can be arranged to conduct the test, in some embodiments, the transmitter (1) Tx and receiver (2) Rx are arranged on both sides of the corridor, a Los between them is 1.6 m, the subject walks along the perpendicular bisector of the Los, and the subjects walks from the start point (3.6 m away from the Los) to the end point (0.8 m away from the Los).
Table 1 concludes the test results after adjusting the variables, it should be found that the calibration equation can be generally used in groups with different variables. Specifically, as shown in
Embodiment 7: the following describes a clinical research method for demonstrating the effectiveness of the present invention.
In this clinical research, 13 subjects of different ages, different sex, and different disease stage are tested in department of neurology, wherein 3 subjects are diagnosed with a Parkinson's disease. As illustrated in Table 2, in accordance with IRB protocol (NCKUH IRB, No. B-ER-112-076), the physician explains the details of this research during the clinical visit, the consent form for participating in the research and the use of data is provided by each subject, and the research is conducted under the surveillance of the physician wherein the subjects are receiving treatment. As shown in
Embodiment 8: the following provides the process of the clinical research of the Parkinson's patients.
24 Parkinson's patients (subjects) comprising 12 males and 12 females are recruited, the age of the subjects range from 52 to 84 years old, the rating score of the unified Parkinson's Disease Rating Scale (UPDRS) of the subjects range from 0 to 2, wherein the rating score of 1 subject is 0, the rating score of 10 subjects is 1, and the rating score of 13 subjects is 2. As shown in
Embodiment 9: the following elaborates the factors that influence the accuracy of quantifying the gait parameter.
As shown in
wherein the n is a nature number, the Qn represents a point on an oval of the n Fresnel zone. according to the formula: when the difference between the length of reflection path (|
As shown in
In summary, through the test accomplished by diverse clinical cases, conclusions are provided as follows: under the same data preprocessing and the same test design, velocity quantification by using Wi-Fi is affected by: the length of the Los, the walking direction should be vertical to the Los, and the activity restriction of the subject in the environment. If the conditions aforementioned meet the standard, even the walking velocity of the Parkinsons's disease patient can be precisely quantified in the clinical environment, wherein the wearing device or the image monitor is not required during the quantification process, the gait parameter can be recorded more naturally, and the healthcare professionals or the caregiver will be informed when something wrong happens in the body of the patient.
As shown in
In some embodiments, the instruction further comprises: (SD) calculating T1 and T2 in one or more time period, and delivering a health surveillance report when T2>T1, wherein T1 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T2 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold. In some embodiments, the instruction further comprises: (SE) calculating T1 and T2 in a first time period, wherein T1 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T2 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold; calculating T3 and T4 in a second time period, wherein T3 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is larger than the default threshold, T4 is the total time in which the calibrated gait parameter (Vcorrection) of the subject is smaller than the default threshold, and delivering a health surveillance report when
wherein the second time period is later than the first time period.
In some embodiments, to ensure the accuracy of the measurement, and to avoid the difference between the human body CSI gait parameter and the human body actual gait parameter is too large to calibrate, a line of sight
In some embodiments, to avoid interference of noise, and to prevent the accuracy of measurement of gait parameter from affecting by signal irrelevant to human gait, the step (SA) comprises: using a wave filter to filter a high frequency noise in the CSI signal, and performing a principal component analysis (PCA) on the CSI signal, thereby extracting a human body gait related signal from the CSI signal; or wherein the step (SB) comprises: performing a short-time Fourier transform (STFT) on the denoised CSI signal to obtain a spectrogram, and tracking a high energy region in the spectrogram to form a trunk velocity contour on the spectrogram thereby obtaining the human body CSI gait parameter.
In some embodiments, to obtain the human body actual gait parameter and to make it a comparative standard to the human body CSI gait parameter, in the step (SC), a step for obtaining the calibration equation comprises: fitting the human body CSI gait parameter with a human body actual gait parameter, wherein a step for obtaining the human body actual gait parameter comprises: equipping a mark on a first body part of the human body and tracking the mark using a tracking software thereby obtaining a first actual walking velocity curve.
The effectiveness of the present invention compared with prior art comprises: in prior art, there are gaps or differences between the human body gait measurement result measured by using Wi-Fi directly and the actual walking value of the human body, therefore the Wi-Fi measurement lacks practical value and cannot be used to determine a healthy degree of a subject. The method provided by the present invention comprises analyzing the result of CSI signal and fitting them with the human body actual gait parameter to obtain the calibration equation, wherein the gait parameter is close to the human body actual gait parameter after the gait parameter of CSI signal is calibrated by the calibration equation, thereby can be used to analyze the health status of the human body. On the other hand, the present invention can analyze one or more time period of a human body gait change curve, calculate the gait parameter to track the history measuring result of the subject's gait, and remind the subject when abnormality occurs in their body thereby improving the medication administration or the treatment strategy.
The foregoing description merely illustrates the preferred embodiments of the present invention and should not be construed as limiting the scope of the invention. Any simple equivalent changes or modifications made in accordance with the scope of the patent claims and the description of the invention shall fall within the scope covered by the patent of the present invention. Additionally, none of the embodiments or claims of the present invention are required to achieve all the objectives, advantages, or features disclosed herein. Furthermore, the abstract and titles are provided solely to facilitate patent documentation searches and are not intended to limit the scope of the invention. Moreover, terms such as “first” and “second” mentioned in the specification are used merely to denote the names of components and do not imply any upper or lower limit on the quantity of the components.
Number | Date | Country | |
---|---|---|---|
63623792 | Jan 2024 | US |