This disclosure generally relates to the field of wearable devices, and more particularly to providing contact force estimation and adjustment feedback for wearable devices.
Modern wearable devices are equipped with increasingly advanced physiological sensing hardware. Such wearable devices need to be firmly secured to a user's body for optimal performance, yet remain comfortable when worn for extended periods of time. In order to enhance device performance, users can manually adjust the tightness of their wearable devices. However, this manual and subjective tightness adjustment is unlikely to ensure repeatable data collection conditions and yield optimal results in all instances. While dedicated sensors may be used to directly measure or estimate the contact force between the wearable device and the user's body, use of such sensors results in an overall increase in complexity and cost. In addition, although automated software-based techniques may be used to detect and correct sensor signal anomalies and improve signal quality, these techniques sometimes fail to fully compensate for poor data quality.
As such, there is room for improvement.
In accordance with one aspect, there is provided a contact force determination method comprising obtaining, at a computing device, at least one physiological signal indicative of at least one physiological parameter of a user, the at least one physiological signal obtained from at least one contact-based physiological sensor embedded in a wearable device secured to a body part of the user; determining, at the computing device, one or more statistical parameters of the at least one physiological signal; determining at the computing device, based on the one or more statistical parameters, a contact force between the wearable device and the body part; and outputting, at the computing device, the contact force as determined.
In accordance with another aspect, there is provided a contact force determination system comprising a processing unit and a non-transitory computer-readable medium having stored thereon program instructions executable by the processing unit for obtaining at least one physiological signal indicative of at least one physiological parameter of a user, the at least one physiological signal obtained from at least one contact-based physiological sensor embedded in a wearable device secured to a body part of the user; determining one or more statistical parameters of the at least one physiological signal; determining, based on the one or more statistical parameters , a contact force between the wearable device and the body part; and outputting the contact force as determined.
In accordance with another aspect, there is provided a non-transitory computer-readable medium having stored thereon program instructions executable by a processor for obtaining at least one physiological signal indicative of at least one physiological parameter of a user, the at least one physiological signal obtained from at least one contact-based physiological sensor embedded in a wearable device secured to a body part of the user; determining one or more statistical parameters of the at least one physiological signal; determining, based on the one or more statistical parameters, a contact force between the wearable device and the body part; and outputting the contact force as determined.
Many further features and combinations thereof concerning embodiments described herein will appear to those skilled in the art following a reading of the instant disclosure.
In the figures,
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
The user 102 may manually adjust a tightness of the wearable device 104, in order to optimize the user's comfort level. For instance, the user 102 can adjust the tightness of a strap 120 securing the wearable device 104 to the skin 106, the wearable device 104 exerting a contact force (not shown) on the skin 106. As understood by those skilled in the art, a “contact force” is a force that is applied by objects in contact with each other, the contact force acting on a point of direct contact between the two objects. As used herein, the term “contact force” therefore refers to a normal force between the wearable device 104 and the body part the wearable device 104 is secured to. In other words, the contact force refers to the normal force exerted by the wearable device 104 on the body part and/or the normal force exerted by the body part on the wearable device 104). The contact force can be continuous (i.e. as a continuous force) or momentary (i.e. as an impulse). As used herein, the term “tightness” (also referred to as “tightness level”, “coupling rate” or “coupling force”) refers to the degree of coupling (or fitting) of the wearable device 104 to the user's body part. Such coupling is referred to herein as “tight” when the wearable device 104 is fitted to the body part in a manner that limits motion or movement of the wearable device 104 relative to the body part. The coupling is referred to herein as “loose” when the wearable device 104 is fitted to the body part in a manner that allows for some motion or movement of the wearable device 104. The tightness level is typically selected as a trade-off between adequately securing the wearable device 104 to the user's body part (to prevent undesirable motion and/or improper operation of the wearable device 104) and preventing discomfort or interference with the user's daily activities (e.g., due to an excessively tight wearable device 104).
Although the wearable device 104 is illustrated in
Referring now to
It should however be understood that contact-based physiological sensors other than optical heart rate (or PPG) sensors may also apply. In addition, in some embodiments, the wearable device 104 may comprise one or more additional sensors using any suitable sensing technology and configured to provide one or more additional sensor signals. The one or more additional sensor signals may then be used to perform contact estimation and adjustment feedback, in a similar manner to that described herein with reference to the physiological sensor 202. For example, sensing technologies including, but not limited to, skin conductance sensors (configured to measure conductance of the skin 106), motion sensors (configured to detect movement of the user's body part), accelerometers (configured to detect body part orientation and acceleration), gyroscopes (configured to measure orientation and angular velocity), altimeters (configured to measure the user's altitude above a fixed level such as ground), or the like, may apply.
The physiological sensor 202, exemplarily shown in
In the embodiment of
In order to improve the quality of physiological measurements, it is therefore desirable to properly select and adjust the tightness level of the wearable device 104. As used herein, the term “optimal tightness level” (or “optimal coupling”, also referred to herein as a “target coupling”) refers to a tightness level (i.e. a coupling between the wearable device 104 and a body part of the user 102) at which the quality of the physiological sensor signal 108 is maximized (i.e. reaches a maximum value), while providing an acceptable level of comfort for the user 102. Tightness levels other than (i.e. above or below, within a pre-determined tolerance or threshold) the optimal tightness level are considered “sub-optimal”, where the term “sub-optimal tightness level” may refer to a tightness level at which the quality of the physiological sensor signal 108 is degraded (compared to the sensor signal quality at the optimal tightness level), while providing an unacceptable level of comfort (i.e. providing discomfort) for the user 102.
Referring back to
As used herein, the term “features of interest” (or “properties of interest”) refers to any value or quantitative measure derived from a signal and that characterize the signal. At least some of the features of interest correspond to statistical parameters of the signal. A feature of interest characterizes, for instance, a data set, a probability distribution, or a spectral density function or spectrum. In some embodiments, the features of interest extracted from the physiological sensor signal 108 may include, but are not limited to, mean, median, variance, standard deviation, inter-quartile interval, skewness, kurtosis, root mean square, energy, entropy, approximate entropy, maximum slope, singular value decomposition (SVD), Sym8 wavelet transform energy at levels 1 to 9 (and more particularly at level 4), maximum, minimum, first statistical moment, second statistical moment, third statistical moment, fourth statistical moment (and more particularly the third statistical moment), median frequency, total spectral power (in a range of 0 Hz to about 10 Hz), relative spectral power (in the range of 0 Hz to about 10 Hz), peak amplitude (in the range of 0 Hz to about 10 Hz), mean of first derivative, standard deviation of first derivative, number of median crossings, power spectral density at 1, 3, 5, 7, 9, 13, 17, 21 and 29 Hz (and more particularly at 7 Hz), coefficients from third order autoregressive (AR) model, and/or number of median crossings at the instantaneous frequency of the sensor signal. It should however be understood that other features may also be considered as being of interest.
Once extracted, at least some of the features of interest are sent to the contact force estimation module 112 configured to estimate the contact force between the wearable device 104 and the user's skin 106. The contact force estimation module 112 is configured to use the received feature(s) of interest as predictor(s) for contact force estimation. In one embodiment, the contact force estimation module 112 may implement a supervised learning approach in which the predictor(s) selected among the extracted feature(s) of interest are used as part of a machine learning classification model to classify or predict the contact force. In other words, the predictor(s) are used as input to the machine learning classification model and the model's output is the estimated (or predicted) contact force between the wearable device 104 and the user's skin 106.
The machine learning classification model described herein, such as the one implemented by the contact force estimation module 112, may be trained using suitable labeled training data and a suitable optimization process to minimize a loss function. In one embodiment, the machine learning classification model implemented by the contact force estimation module 112 may be trained in advance prior to the deployment of the system 100. In other embodiments, the machine learning classification model may be trained in real-time, based on live (i.e. real-time) operational data from the user 102. Still other embodiments may apply. For instance, a hybrid approach of training the model partly in advance and partly in real-time may be used. Furthermore, the parameters of the machine learning classification model may be continuously tuned to improve the accuracy of the model, for example by enhancing the data fed as input to the machine learning classification model. Machine learning refinement may occur at different stages of the model and at different time points (e.g., using feedback to refine the machine learning classification model after deployment of the system 100).
In one embodiment, the machine learning classification model is a bagged tree model. In order to reduce computational load while maintaining predictive power, a minimal viable number of predictors may be found by sequentially training models that include an increasingly large subset of the above-mentioned features of interest. Step forward feature selection may be used at each iteration to determine the smallest viable set of predictor variables to use in the model. The performance at each iteration may be estimated using root mean squared error (RMSE) and k-fold cross-validation (CV), for instance 5-fold cross-validation. The number of predictors to include in the model (i.e. to be extracted by the signal acquisition and processing module 110) may be determined to be the number at which the inclusion of an additional feature reduces the RMSE by less than a pre-determined percentage of the current value, for instance 1%. As indicators of model performance, mean absolute errors (MAE), RMSE and the coefficient of determination r2 may be used. Alternative embodiments using other machine learning classification models including, but not limited to, logistic regression, support vector machines (SVMs), decisions trees, Naïve Bayes, and Random Forest approaches, may also apply.
As illustrated in
In one embodiment, the tightness recommendation problem may be formulated as a two-class classification task, in which the two classes comprise an “optimal” class and a “too loose” class. In this embodiment, the “optimal” class comprises a range of contact forces that correspond to the optimal tightness level, with the signal quality of the physiological signal being maximized at the optimal tightness. The “too loose” class comprises a range of contact forces that correspond to a sub-optimal tightness level below the optimal tightness level. A first threshold between the “optimal” class and the “too loose” class may be introduced as a transition from the “optimal” to the “too loose” tightness levels. During use of the wearable device 104, oscillations between the at least two classes, due to noise or relaxation of the strap 120 of the wearable device 104, could negatively impact the user's experience. As such, hysteresis may be introduced, for instance by including a second threshold lower than the first threshold for transitions from “optimal” to “too loose”. The first and second thresholds may be determined in any suitable manner. In some embodiments, a third “too tight” class may be used, the “too tight” class comprising a range of contact forces that are deemed to correspond to a sub-optimal tightness level greater than the optimal tightness level. Still, it should be understood that the number of classes may vary depending on the application, such that other classes may apply.
With continued reference to
In other embodiments, the tightening adjustment feedback may be provided by the feedback module 118 using vibrations. For example, when the user 102 is securing the wearable device 104 to his or her body, vibrations may be initially output having a given vibration parameter associated therewith. The vibration parameter may be initially set at a given value in order to encourage the user 102 to loosen the wearable device 104 (or conversely to tighten the wearable device 104). The vibration parameter may be modified over time (as a result of manual adjustment of the wearable device's tightness), as the user 102 approaches optimal tightness. In other words, the vibration parameter may be indicative of a current (or actual) coupling between the wearable device 104 and the user's body part and the coupling may impact the vibration parameter.
The vibration parameter may comprise any suitable parameter that characterizes the vibrations including, but not limited to, vibration intensity, a number of pulses of the vibrations, a tempo (or duration) of the pulses, a vibration frequency, or any combinations thereof. In one embodiment, the vibration parameter may be set at a first value when the actual coupling is above the optimal coupling (i.e. the coupling is too tight), and at a second value when the actual coupling is below the optimal coupling (i.e. the coupling is too loose). For example, a first number of pulses (e.g., five (5) pulses) may be output to indicate that the wearable device 104 is currently coupled to the user's body part too tight while a second number of pulses (e.g., two (2) pulses) lower than the first number of pulses may be output to indicate that the current coupling between the wearable device 104 and the user's body part is too loose. In another example, the tempo of the vibrations may be varied such that several long pulses may be output for a coupling that is too tight and several short pulses for a coupling that is too loose, where long pulses refers to pulses having a duration above a predetermined threshold and short pulses refers to pulses having a duration below a predetermined threshold. In yet another example, the frequency of the vibrations may be varied such that vibrations at a first frequency (e.g., 160 Hz) may be output to indicate a coupling that is too tight and vibrations at a second frequency (e.g., 80 Hz) lower than the first frequency may be output for a coupling that is too loose.
Vibrations may also be output at a high intensity (i.e. an intensity above a pre-determined threshold) to indicate that the wearable device 104 is currently coupled to the user's body part too tight (or conversely at a low intensity, i.e. an intensity below the threshold, to indicate that the wearable device 104 is currently coupled to the user's body part too loose) and gradually decrease (or increase) over time as the user 102 approaches optimal tightness. Other embodiments may apply. In addition, it should be understood that a combination of text prompts and vibrations may used. It should also be understood that the feedback module 118 may provide the adjustment feedback in any other suitable manner including, but not limited to, using graphics (e.g., a graphical prompt), sound (e.g. an audio prompt or the like), and light.
Referring now to
The memory 404 may comprise any suitable known or other machine-readable storage medium. The memory 404 may comprise non-transitory computer readable storage medium, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. The memory 404 may include a suitable combination of any type of computer memory that is located either internally or externally to device, for example random-access memory (RAM), read-only memory (ROM), compact disc read-only memory (CDROM), electro-optical memory, magneto-optical memory, erasable programmable read-only memory (EPROM), and electrically-erasable programmable read-only memory (EEPROM), Ferroelectric RAM (FRAM) or the like. Memory 404 may comprise any storage means (e.g., devices) suitable for retrievably storing machine-readable instructions 406 executable by processing unit 402.
In one embodiment, the systems and methods described herein may be used in medical applications, to achieve optimal heart rate measurement quality. This may result in greater confidence placed in the collected signals. Due to the increase in signal quality, psycho-physiologically attentive systems may be able to better capture the internal states of their users and adapt their behavior appropriately.
In other embodiments, the systems and methods described herein may be used in haptic applications. The consistent perception of haptic effects is indeed dependent on achieving robust mechanical coupling between the haptic system and a user's skin. Changes in coupling may cause failure to perceive and misinterpretation of haptic cues. The systems and methods described herein may be employed to adjust properties of a stimulus presented by a haptic system, to ensure consistent perception of the stimulus by users. Knowledge that a wearable device is worn at a consistent tightness may allow a more informed exploration of in-the-wild tactile effect perception.
In other embodiments, the systems and methods described herein may be applied to next generation head-mounted displays (HMD), which may be equipped with physiological and behavioral sensors (e.g., gaze and motion tracking sensors). The systems and methods described herein may be employed to ensure robust coupling between the HMD and the user's head, facilitating the collection of high quality physiological signals and ensuring that the device is appropriately positioned to maintain optical focus.
In yet other embodiments, the systems and methods described herein may be employed to provide pressure-based continuous user input on wearable and video game controllers. For example, a smartwatch typically only allows discrete touch input (i.e. touching or not, position of the touch). Using the systems and methods described herein, smartwatches may integrate an additional input dimension (i.e. pressure). This may be useful to enter continuous information without having to interact with small sliders, and the like. This may also allow users to provide inputs through clothing (e.g., gloves) that would typically preclude smartwatch interactions. The systems and methods described herein may also be used as a new input source in handheld video game controllers, to provide a continuous input source for games.
The systems and methods described herein may also prove useful in smart garment applications. The fit of smart clothing equipped with physiological sensors is generally estimated using traditional sizing charts. The systems and methods described herein may provide an objective source of information to determine how a smart garment fits a specific user's body, thereby offering benefits to the quality of physiological signals estimation. If measurements are performed at various locations on the body, the systems and methods described herein may be used to modify haptic or other stimulation at or near these different locations on the body to provide a consistent haptic effect across users.
For activity detection applications, the systems and methods described herein may provide a complementary source of information (e.g., to inertial measurement units or IMUs) to improve accuracy in activity recognition applications and in within-exercise activity count (e.g., counting the number of repetitions, recognizing specific activities such as tennis serves versus backhands, and the like).
In other embodiments, the systems and methods described herein may be implemented in self-tightening systems. For example, a wristband, belt or shoe may automatically tie or tighten itself using actuators. The systems and methods described herein may be used as an input to a system controlling the automated tightness adjustment process.
The above description is meant to be exemplary only, and one skilled in the art will recognize that changes may be made to the embodiments described without departing from the scope of the present disclosure. Still other modifications which fall within the scope of the present disclosure will be apparent to those skilled in the art, in light of a review of this disclosure.
Various aspects of the systems and methods described herein may be used alone, in combination, or in a variety of arrangements not specifically discussed in the embodiments described in the foregoing and is therefore not limited in its application to the details and arrangement of components set forth in the foregoing description or illustrated in the drawings. For example, aspects described in one embodiment may be combined in any manner with aspects described in other embodiments. Although particular embodiments have been shown and described, it will be apparent to those skilled in the art that changes and modifications may be made without departing from this invention in its broader aspects. The scope of the following claims should not be limited by the embodiments set forth in the examples, but should be given the broadest reasonable interpretation consistent with the description as a whole.
This patent application claims priority of U.S. Provisional Application No. 63/271,396, filed on Oct. 25, 2021, the entire contents of which are hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
63271396 | Oct 2021 | US |