Patent Application
20230351876
This application claims priority under 35 U.S.C. § 119 to application no. IN 202241025119, filed on Apr. 29, 2022 in India, the disclosure of which is incorporated herein by reference in its entirety.
The present disclosure relates to a controller to detect non-swim activity of a swimmer and method thereof.
Current wearable market is totally driven by new smart features like swim analytics, activity detections etc. It is always helpful to measure swimming progress via times during workouts. Gauging times in the pool is an accurate way to determine swimmer's level and how much he/she has progressed. In techniques like short rest interval swimming, swimmer takes short rests after completing certain number of lengths and resumes swimming after the rest interval. Also, swimming is inevitably affected by large number of people present in case of public pools, making swimmers to temporarily rest in the pool. Thus, it is desirable to break a pool swim session into swim intervals and non-swim (start/stop/rest) intervals to know the accurate time utilized in both the cases. Another point of consideration is the swimmer efficiency or performance analysis—swim metrics like swimming time, resting time, length time, inter-length rest time, distance, average pace, etc., must not get computed during non-swim intervals as this could lead to poor accuracy of swim tracking device. There are two ways to do non-swim detection —pressing a button manually by the swimmer to indicate that rest/pause has started or by automatically detecting the non-swim period.
In most of the existing solutions, swimmer must manually press a button in his/her swim tracking device when he/she wishes to pause in between. When the swimmer is ready to resume swimming, he/she must press the button again to end the pause and start a new swim interval. This action is tedious (not user-friendly) and if swimmer forgets to do this, his performance metrics gets affected. In ‘Auto rest’ feature present in some devices, it detects rest of minimum 20 secs of duration. Therefore, short rest/pause (less than ˜20 secs) are not get captured.
Also, current solutions use accelerometer for non-swim detection which could provide false positives as accelerometer might detect normal hand movements made during rest time as swim strokes and thus falsely increment swim time, strokes, and lengths during this time. Therefore, swimmer must stand very idle during rest time (shouldn't move his arms around very much) for it to be detected accurately using accelerometer-based solutions. There is need for innovation to make the swim analytics feature more innovative and intuitive by automatically detecting the rest time during swimming without expecting the swimmer to provide the details.
According to a prior art US2021068713 detecting swimming activities on a wearable device is disclosed. Disclosed embodiments include wearable devices and techniques for detecting swimming activities. classifying user motion, detecting water submersion, and monitoring performance during swimming activities. By accurately and promptly detecting swimming activities and automatically distinguishing between different swimming stroke type performed during a swimming activity, the disclosure enables wearable devices to accurately calculate user performance information when user: forget to start and/or stop recording swimming activities. In various embodiments, swimming activity detection techniques may improve the selectivity of motion based methods of identifying swimming activities identification by confirming motion analysis with water immersion and pressure data analysis that detects when the wearable device is submerged in water.
An embodiment of the disclosure is described with reference to the following accompanying drawings,
The gyroscope 102 based automatic non-swim (start/stop/rest) detection system is used to help differentiate the time when swimmer is actually performing swimming from the total time, he/she has spent in the pool. The non-swim activity/time includes all the actions performed by swimmer in pool other than swimming i.e. actions performed by swimmer before start of swimming (adjusting his goggles/cap, standing at pool edge to warm up, etc.), taking pause in between lengths, resting at edge of pool after finishing swimming, etc. The controller 110 provides information indicative of how much the swimmer has swum and how much rest/pause/non-swim activity has been taken in the pool. Thus, the controller 110 enables calculation of total swim time vs total non-swim time in the pool.
Also, during rest interval, swimmer might perform some hand movements which might get detected as swim strokes and thus produce incorrect swim metrics. This will affect overall accuracy of the swim tracking device. By automatically detecting rest time, any stroke count increment, length count increment, etc. reported during this time is negated by the controller 110.
According to the present disclosure, the controller 110 is equipped with necessary signal detection, acquisition, and processing circuits along with connection to other sensors (if required). The controller 110 is a control unit (computing device) which comprises memory element such as Random Access Memory (RAM) and/or Read Only Memory (ROM), Analog-to-Digital Converter (ADC) and a Digital-to-Analog Convertor (DAC), clocks, timers, counters and at least one micro-processor/micro-controller (capable of implementing machine learning) connected with each other and to other components through communication bus channels. The memory element is pre-stored with logics or instructions or programs or applications or modules/models and/or threshold values, which is/are accessed by the at least one processor as per the defined routines. The internal components of the controller 110 are not explained for being state of the art, and the same must not be understood in a limiting manner. The controller 110 may also comprise communication units to communicate with an external computing device such as the cloud, a remote server, etc., through wireless or wired means such as Global System for Mobile Communications (GSM), 3G, 4G, 5G, Wi-Fi, Bluetooth, Ethernet, serial networks, and the like. The controller 110 is implementable in the form of System-in-Package (SiP) or System-on-Chip (SOC) or any other known types.
According to an embodiment of the present disclosure, the controller 110 comprises the Band Pass Filter (BPF) 106, the Energy Envelope Estimator 112 and the Detector 116 as three modules stored in the memory element. The raw signals 104 from the gyroscope 102 is passed through the BPF 106 designed with a particular passband frequency range to pass only the frequencies corresponding to swimming stroke patterns and to remove any frequencies that correspond to hand movements or other motions that the swimmer might perform during rest time. For example, passband frequency range is set as [0.2-0.833] Hz.
Now with respect to the energy envelope estimator 112, when the swimmer is performing stroke movements while swimming, periodic patterns are observed in the signal waveform corresponding to strokes. When swimmer is resting, signals are irregular and non-periodic in nature. Thus, in the energy envelope of filtered signal 108, the energy is high during swim time and low during the rest time. For determining the energy, the energy envelope estimator 112 computes the moving variance of the filtered signal 108 along each channel/axis independently over time.
The energy envelope estimator 112 uses sliding window method to compute the energy. In the sliding window method, a window of specified length moves over the data sample-by-sample, and the energy over the data in the window is computed. For example, the window length is set as 3 seconds, and if sampling frequency of raw signal 104 is 100 Hz, the energy is computed over 300 samples of data at a time. The energy estimator 112 is explained using
According to an embodiment of the present disclosure, the controller 110 uses data from at least one axis from a group comprising Y-axis and combination of X-axis and Y-axis. The axis orientation of the gyroscope 102 with respect to wrist wearable device 100 is same as smartphone orientation. The X axis is tangential to the ground and points east, the Y axis is tangential to the ground and points towards magnetic north, and, and the Z axis points towards the sky and is perpendicular to the plane made up of X and Y axes. The at least one gyroscope 102 is either standalone or part of the Inertial Measurement Unit (IMU) sensor.
Now the detector 116 is explained. As disclosed before, the controller 110 is configurable to use only one axis, i.e. Y axis if a specific type of swim style is set before swimming. In an alternate embodiment, the controller 110 is configurable to use two axes i.e. Y axis and X axis to make the determination of non-swim activity detection agnostic to the swim style. Now the use of energy envelope signal 114 over both the axes is explained with reference to
According to an embodiment of the present disclosure, the controller 110 is configured to use non-swim time output to increase accuracy of swim performance metrics. The controller 110 is able to calculate total swim time vs. total pool time. Whenever output of detector 116 is high (indicating segment as start/stop/rest), it is added into ‘non-swim time’ metric and whenever the output of detector 116 is low, it is added into ‘swim time’ metric. Thus, ‘total pool time’ is calculated as ‘swim time’ plus ‘non-swim time’. In other words, time period detected as non-swim need to be subtracted from total pool time to get actual swim time swum by the swimmer.
Similarly, the controller 110 is configured to discard false positives of a stroke counter module, a length counter module, and a swim type classifier module when a segment of the swim session is detected as non-swim activity. The controller 110 removes false positive strokes during rest time. Arm movements made by swimmer during rest time could be detected as swimming stroke falsely by stroke counter module. Once a segment is detected as ‘non-swim’, then all the false strokes reported during that time by stroke counter module are negated. This helps in improving the stroke counting accuracy. The controller 110 also removes false positive lengths during rest time. The stroke count value is used inside length counter module to validate turns. Sometimes, sudden movements performed by swimmer like jumps, etc. during rest time might get detected as ‘turn’ by turn detector module. But since non-swim detection output negates false strokes and thus keeps stroke count number very low, false turns will not get validated and thus improves length counter accuracy.
The controller 110 is able to improve swim style prediction. The arm movements done by swimmer during non-swim time could get wrongly predicted as one of the four swim styles (butterfly/breaststroke/freestyle/backstroke) and thus give wrong indication to swimmer. Thus, when non-swim output flag 118 is high, swim style classifier is disabled to stop any prediction during that time. In this manner, non-swim detection output is used to increase accuracy of swimmer's performance metrics in wearable devices 100 and enables the swimmer to take rest/pause anywhere in the pool without needing manual input from him.
According to an embodiment of the present disclosure, the at least one gyroscope 102 is part of a wearable device 100 worn by the swimmer or externally connected to the wearable device 100. The wearable device 100 is any one selected from a group comprising a smart watch, a smart ring, a smart band, and a sensor module. In an embodiment, the controller 110 is a cloud or smartphone which receives signal from the sensor module worn by the swimmer. The sensor module is equipped with at least one gyroscope 102. Further, the gyroscope 102 is either at least three-axis gyroscope 102 or multi-axes gyroscope 102. Alternatively, a single axis gyroscope 102 is used for each axis of interest.
According to the present disclosure, a working of the controller 110 is envisaged. Consider a user wearing the smartwatch. Assuming that the swim metrics feature is active or even the detection of swim metrics is automatically activated, the controller 110 starts monitoring and recording the data received over X-axis and Y-axis. The controller 110 generates filtered signal 108 over both the X axis and Y axis, followed by calculating the respective energy envelope signal 114 by the energy envelope estimator 112. The detector 116 compares the value for the segment (say 3 second frame) of both the axes with first threshold and second threshold. If the output flag 118 is high, then non-swim activity is detected, else it is swim activity. Accordingly, the other modules of the controller 110 uses the output to correct their values for accurate swim metrics such as stroke count, length count, swim type detection, total swim time, total pool time, etc.
Similar approach works well if case the controller 110 is configured to use data from the Y-axis only, in which case the swimmer must preset the swim type other than breaststroke. In other type of strokes such as butterfly stroke, freestyle, backstroke, the data from Y-axis can be used alone.
According to the method, the energy envelope estimator 112 comprises the step of generating the energy envelope signal 114 using sliding window average of the preset window size over the filtered signal 108. The detector 116 comprises a step 410 of comparing values of the energy envelope signal 114 for at least one axis against respective threshold value, and a step 412 classifying the segment of the raw signals 104 as non-swim activity upon satisfactory comparison.
According to the present disclosure, the at least one axis is selected from a group comprising Y-axis, and X-axis and Y-axis. When the swim style is preset other than breaststroke, the method use only Y-axis data. On the other hand, to make the method agnostic to swim style, data from both the X and Y axes are usable. The method also comprises discarding false positives of the stroke counter module, the length counter module, and the swim type classifier module when the segment of the swim session is detected as non-swim activity. Further, the at least one gyroscope 102 is located in the wearable device 100 worn by the swimmer or external device wirelessly connected to the wearable device 100. The wearable device 100 is any one selected from a group comprising the smart watch, the smart ring and the smart band and the like.
According to the present disclosure, the controller 110 for automatic nonswim (Start/Stop/Rest/others) detection in swimming application is disclosed. There is no manual input from swimmer, and requires only one sensor causing low power consumption.
It should be understood that the embodiments explained in the description above are only illustrative and do not limit the scope of this disclosure. Many such embodiments and other modifications and changes in the embodiment explained in the description are envisaged. The scope of the disclosure is only limited by the scope of the claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202241025119 | Apr 2022 | IN | national |
