This application claims priority from a provisional patent application filed in India bearing no. 201911005132 titled “SMART TOE-RINGS FOR CAPTURING MOVEMENTS AND GESTURES” filed on Feb. 8, 2019.
Embodiments of a present disclosure relate to a compact and comfortable wearable electronic device and more particularly to a foot mounted wearable device and a method to operate the same.
Wearable devices or wearables are electronic devices which are incorporated into clothing or worn on body of an individual as implants or accessories. The wearable devices are used for tracking information on real time basis. The wearable devices have motion sensors that take the snapshot of our day to day activity and sync them with mobile devices or computers. The wearable devices presently available in the market are of one or more types which includes smart watch, fitness tracker, head mounted display, foot mounted wearable device and the like. The foot mounted wearable device amongst the one or more wearable electronic devices is used for capturing precise motion information related to human movements, gait and gesture, for indoor navigation or gesture capturing or gait analysis, are either in the form of insole or are an externally attachable compact device. Various types of foot mounted wearable devices are available which helps in tracking the foot movement of the user.
Conventionally, the foot mounted wearable devices available in the market are worn by the user in the foot or such devices are mounted with shoes of the user. However, such devices cause hindrance in the foot movement and sometimes become inconvenient to use by the user. Also, such conventional foot mounted wearable devices are less durable, and performance of the device depends upon the quality of mounting. Moreover, shaking or sliding of one or more sensors of the foot mounted wearable device during foot movement, results in performance deterioration due to improper capture of motion data and compromises accuracy.
Hence, there is a need for an improved foot mounted wearable device and a method to operate the same in order to address the aforementioned issues.
In accordance with an embodiment of the present disclosure, a foot mounted wearable device is disclosed. The foot mounted wearable device includes at least one toe-ring. The at least one toe-ring includes a plurality of sensors configured to sense motion data associated with a foot of a user. The at least one toe-ring also includes a microcontroller operatively coupled to the plurality of sensors. The microcontroller includes a motion information processing subsystem configured to process the sensed motion data acquired from the plurality of sensors to determine motion information associated with the user. The device also includes a motion information analysis subsystem hosted on a server and operatively coupled to the microcontroller. The motion information analysis subsystem is configured to receive the motion information associated with the user via an established communication network. The motion information analysis subsystem is also configured to analyse received motion information associated with the user to derive knowledge of at least one function associated with the user based on computation of a plurality of gait parameters and motion equation, wherein the at least one function associated with the user includes at least one of gesture recognition of the user, steps tracking of the user or a combination thereof.
In accordance with another embodiment of the present disclosure, a method of operation of a foot mounted wearable device is disclosed. The method includes sensing, by a plurality of sensors of at least one toe-ring, motion data associated with a foot of a user. The method also includes processing, by a motion information processing subsystem of a microcontroller, the sensed motion data acquired from the plurality of sensors to determine motion information associated with the user. The method also includes receiving, by a motion information analysis system hosted on a server, the motion information associated with the user via an established communication network. The method also includes analysing, by the motion information analysis subsystem, received motion information associated with the user to derive knowledge of at least one function associated with the user based on computation of a plurality of gait parameters and motion equation, wherein the at least one function associated with the user includes at least one of gesture recognition of the user, steps tracking of the user or a combination thereof.
To further clarify the advantages and features of the present disclosure, a more particular description of the disclosure will follow by reference to specific embodiments thereof, which are illustrated in the appended figures. It is to be appreciated that these figures depict only typical embodiments of the disclosure and are therefore not to be considered limiting in scope. The disclosure will be described and explained with additional specificity and detail with the appended figures.
The disclosure will be described and explained with additional specificity and detail with the accompanying figures in which:
Further, those skilled in the art will appreciate that elements in the figures are illustrated for simplicity and may not have necessarily been drawn to scale. Furthermore, in terms of the construction of the device, one or more components of the device may have been represented in the figures by conventional symbols, and the figures may show only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the figures with details that will be readily apparent to those skilled in the art having the benefit of the description herein.
For the purpose of promoting an understanding of the principles of the disclosure, reference will now be made to the embodiment illustrated in the figures and specific language will be used to describe them. It will nevertheless be understood that no limitation of the scope of the disclosure is thereby intended. Such alterations and further modifications in the illustrated system, and such further applications of the principles of the disclosure as would normally occur to those skilled in the art are to be construed as being within the scope of the present disclosure.
The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such a process or method. Similarly, one or more devices or sub-systems or elements or structures or components preceded by “comprises . . . a” does not, without more constraints, preclude the existence of other devices, sub-systems, elements, structures, components, additional devices, additional sub-systems, additional elements, additional structures or additional components. Appearances of the phrase “in an embodiment”, “in another embodiment” and similar language throughout this specification may, but not necessarily do, all refer to the same embodiment.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this disclosure belongs. The system, methods, and examples provided herein are only illustrative and not intended to be limiting.
In the following specification and the claims, reference will be made to a number of terms, which shall be defined to have the following meanings. The singular forms “a”, “an”, and “the” include plural references unless the context clearly dictates otherwise.
Embodiments of the present disclosure relate to a foot mounted wearable device and a method to operate the same. The device includes at least one toe-ring, wherein the at least one toe-ring includes a plurality of sensors configured to sense motion data associated with a foot of a user. The at least one toe-ring also includes a microcontroller operatively coupled to the plurality of sensors. The microcontroller includes a motion information processing subsystem configured to process the sensed motion data acquired from the plurality of sensors to determine motion information associated with the user. The device also includes a motion information analysis subsystem hosted on a server and operatively coupled to the microcontroller. The motion information analysis subsystem is configured to receive the motion information associated with the user via an established communication network. The motion information analysis subsystem is also configured to analyse received motion information associated with the user to derive knowledge of at least one function associated with the user based on computation of a plurality of gait parameters and motion equation the at least one function associated with the user includes at least one of gesture recognition of the user steps tracking of the user or a combination thereof.
One such embodiment of the set of toe-rings connected by a chain is depicted in
The set of toe-rings 105 (
The at least one toe-ring 105 also includes a plurality of sensors 110 configured to sense motion data associated with a foot of a user. In one embodiment, the plurality of sensors 110 may include at least one of an accelerometer, a gyroscope, a pressure sensor, a magnetometer or a combination thereof. The at least one toe-ring 105 also includes a microcontroller 120 operatively coupled to the plurality of sensors 110. In a specific embodiment, the device 100 further includes a battery 112 to supply power for an operation at least one toe-ring 105 for performing multiple functions. In such embodiment, the battery may be recharged through a charging port 113. One embodiment of the at least one toe-ring with the plurality of sensors 110 and electronic components such as the battery 112, the charging port 113, the microcontroller (120 and the communication subsystem 135) to establish the communication network is depicted in
In some embodiment, the at least one toe-ring may include a compact plastic or a metallic capsule which may include the plurality of sensors. In another embodiment, the plurality of sensors may be attached on a periphery of a housing of the at least one toe-ring. In one embodiment, the at least one toe-ring may house the plurality of sensors 110 and one or more components. In such embodiment, the at least one toe-ring may be fabricated from fibre, carbon fibre, selective laser sintering (SLS) material, rubber, flexible materials and the like. The microcontroller 120 includes a motion information processing subsystem 130 configured to process the sensed motion data acquired from the plurality of sensors 110 to determine motion information associated with the user. In one embodiment, the motion data acquired from the plurality of sensors 110 may include linear motion data associated with the foot of the user, rotational motion data associated with the foot of the user or a combination thereof. In some embodiment, the motion data acquired from the plurality of sensors 110 may include at least one of position of the foot, acceleration of the foot, velocity of the foot, orientation of the foot or a combination thereof. In some embodiment, the accelerometer and the gyroscope may be used to capture fast movement of feet of the user by sampling acceleration and angular velocity data with high frequency. In one embodiment, the orientation of the foot may be obtained using the magnetometer and or the gyroscope. In another embodiment, the pressor sensor may be utilised to obtain height from sea level.
In one embodiment, the motion information may include at least one of step count, step size, traversed path, gesture, foot movement or a combination thereof. The motion information processing subsystem 130 also removes electronic noises or errors from sensed motion data acquired from the plurality of users by using a noise removal technique. In such embodiment, the noise removal technique may include a zero-velocity update (ZUPT) based pedestrian dead reckoning (PDR) technique. In a specific embodiment, the motion information processing subsystem 130 monitors positional accuracy of the user based on a positioning system, wherein the positioning system includes an indoor positioning system (IPS) and/or an outdoor positioning system.
A position obtained from the plurality of sensors 110 are fused with positioning obtained from an outdoor positioning receiver. In one embodiment, the outdoor positioning receiver may include a global positioning system (GPS) receiver. Such process is particularly useful in urban environment where building structures obstruct direct GPS satellite signals every now and then. Similarly, one possible way of realizing indoor positioning and navigation is by deploying one or more beacon systems which includes a wireless technology such as wireless fidelity (Wi-Fi) technology or Bluetooth technology. But such indoor positioning systems also suffer from inaccuracies. Here also, the Wi-Fi/Bluetooth technology maybe fused to the plurality of sensors to get the indoor navigation system (INS) enhancing positional accuracy. In one embodiment, data obtained from the positioning system is sent through a communication subsystem to a user interface of electronic device associated with a user. In another embodiment, data obtained from the positioning system is sent to a remote server through the communication subsystem (not shown in
The device 100 also includes a motion information analysis subsystem 140 hosted on a server and operatively coupled to the microcontroller 120. In one embodiment, the motion information analysis subsystem 140 may be located on the at least one toe-ring 105. One such embodiment of the toe-ring with the motion information analysis subsystem 140 located locally on the toe-ring 105 is depicted in
In one embodiment, the knowledge associated with the land survey for the user may be derived based on computation of displacement and heading change at every step from the inertial position data of the foot mounted device. In some embodiment, the motion information analysis subsystem 140 analyses the inertial position data of the user and constructs a user's resultant path. Here, the inertial data or step's coordinates are stored in a log file for future reference. Such stored data are later utilised in conducting land survey of urban slums or the congested areas where the open sky is not easily accessible to allow GPS signals to reach to ground, narrow crowded lanes, which are curved or crooked, and are difficult to survey using traditional method of using total station and sensitive areas where land survey may not be carried out openly due to security reasons.
In yet another embodiment, the knowledge of the fitness monitoring associated with the user may be derived by identifying one or more body gestures. The one or more body gestures of the user which are recognised further helps in fitness monitoring, sports analytics, gesture-based commands. The motion information analysis subsystem 140 derives knowledge of the fitness monitoring for the user by detecting a type of one or more exercises and counting number of the one or more exercises performed by the user based on the received motion information. In one embodiment, the type of the one or more exercises may include at least one of squats, crunches, halasana, jumping jacks and the like. The type of the one or more exercises performed by the user are detected from raw data obtained from the plurality of sensors. Such collected raw data is analysed by a sensor fusion stack (SFS) based on signal processing and machine learning techniques. In one embodiment, the SFS may enable implementation of heuristic model based on a fusion of deductive and heuristic techniques. In one embodiment, the SFS may be implemented on the foot mounted wearable device. In another embodiment, the SFS may be implemented on a user device associated with user. In yet another embodiment, the SFS may be implemented on the remote server such as the cloud server.
In a preferred embodiment, the device 100 further includes a notification subsystem 150 operatively coupled to the motion information analysis subsystem 140. The notification subsystem 150 is configured to notify a plurality of monitoring status upon analysis of the motion information to the user through a plurality of notification means. In one embodiment, the monitoring status may include at least one of the type of the one or more exercises, number of calories burnt, time interval of a particular exercise, and the like.
The toe-ring 105 includes a plurality of sensors 110 configured to sense motion data associated with a foot of the user. Here, the motion data may include at least one of position of the foot, acceleration of the foot, velocity of the foot, orientation of the foot or a combination thereof. For example, the plurality of sensors may include at least one of an accelerometer, a gyroscope, a pressure sensor, a magnetometer or a combination thereof. Here, inertial sensors such as the accelerometer and the gyroscope may be used to capture fast movement of feet of the user by sampling acceleration and angular velocity data with high frequency. Again, the orientation of the foot may be obtained using the magnetometer and or the gyroscope. Similarly, the pressor sensor may be utilised to obtain height from sea level.
The toe-ring 105 also includes a microcontroller 120 wherein the microcontroller 120 includes a motion information processing subsystem 130 to process the sensed motion data acquired from the plurality of sensors to determine motion information associated with the user. Here, the motion data may be processed to obtain the motion information such as at least one of step count, step size, traversed path, gesture, foot movement or a combination thereof. The motion information processing subsystem 130 also removes electronic noises or errors from sensed motion data acquired from the plurality of users by using a noise removal technique. For example, the noise removal technique may include a zero-velocity update (ZUPT) based pedestrian dead reckoning (PDR) technique. Also, the motion information processing subsystem 130 monitors positional accuracy of the user based on positioning system, wherein the positioning system includes an indoor positioning system (IPS) and/or an outdoor positioning system. Here, the outdoor positioning system may include a global positioning system (GPS) to obtain the outdoor position. One such example of outdoor positioning solution using the device 100 is shown in
Referring back to
Again, referring back to
Here, the knowledge associated with the land survey for the user may be derived based on computation of displacement and heading change at every step from the inertial position data of the foot mounted device. For example, the motion information analysis subsystem analyses the inertial position data of the user and constructs a user's resultant path which is further notified on the electronic device associated with user. One such representation of the land survey process using the foot mounted wearable device is shown in
Similarly, the knowledge associated with the fitness monitoring of the user may include tracking physical workouts or one or more exercises performed by the user. Here, the motion information analysis subsystem 140 identifies gestures of the user to detect a type of the one or more exercises and counting number of the one or more exercises performed by the user based on the received motion information. For example, the type of the one or more exercises may include at least one of squats, crunches, halasana, jumping jacks and the like. One such example of the jumping jacks performed by the user is shown in
The motion information analysis subsystem 140 (
Further, the device 100 also includes a notification subsystem 150 to notify a plurality of monitoring status upon analysis of the motion information to the user through a plurality of notification means. Here, the monitoring status may include at least one of the type of the one or more exercises, number of calories burnt, time interval of a particular exercise, and the like. Thus, the device 100 helps the user in overall manner by tracking the feet movement, monitoring the movement disorders, monitoring health parameters and alerting the user to create awareness.
The processor(s) 230, as used herein, means any type of computational circuit, such as, but not limited to, a microprocessor, a microcontroller, a complex instruction set computing microprocessor, a reduced instruction set computing microprocessor, a very long instruction word microprocessor, an explicitly parallel instruction computing microprocessor, a digital signal processor, or any other type of processing circuit, or a combination thereof.
The memory 210 includes a subsystem stored in the form of executable program which instructs the processor 230 to perform the method steps illustrated in
The motion information analysis subsystem 140 is configured to receive motion information associated with the user via an established communication network. The motion information analysis subsystem is also configured to analyse received motion information associated with the user to derive knowledge of at least one function associated with the user based on computation of a plurality of gait parameters and motion equation, wherein the at least one function associated with the user includes at least one of gesture recognition of the user, tracking steps of the user or a combination thereof.
The bus 220 as used herein refers to be internal memory channels or computer network that is used to connect computer components and transfer data between them. The bus 220 includes a serial bus or a parallel bus, wherein the serial bus transmit data in bit-serial format and the parallel bus transmit data across multiple wires. The bus 220 as used herein, may include but not limited to, a system bus, an internal bus, an external bus, an expansion bus, a frontside bus, a backside bus and the like.
The method 300 also includes processing, by a motion information processing subsystem of a microcontroller of the toe-ring, the sensed motion data acquired from the plurality of sensors to determine motion information associated with the user in step 320. In one embodiment, processing the sensed motion data to obtain the motion information may include processing the sensed motion data to obtain information of at least one of step count, step size, traversed path, gesture, foot movement or a combination thereof. In some embodiment, the motion data may be processed by removing electronic noises or errors from sensed motion data acquired from the plurality of users by using a noise removal technique. In such embodiment, the noise removal technique may include a zero-velocity update (ZUPT) based pedestrian dead reckoning (PDR) technique.
The method 300 also includes receiving, by a motion information analysis system hosted on a server, the motion information associated with the user via an established communication network in step 330. In one embodiment, receiving the motion information associated with the user via the established network may include receiving the motion information via a wireless communication network established with one or more user devices for transmission of received motion information to the remote server through at least one of a Bluetooth low energy (BLE) technology, wireless fidelity (Wi-Fi) networking technology, near field communication (NFC), long term evolution (LTE) communication standard or a combination thereof.
The method 300 also includes analysing, by the motion information analysis subsystem, received motion information associated with the user to derive knowledge of at least one function associated with the user based on computation of a plurality of gait parameters and motion equation in step 340. In one embodiment, analysing the received motion information associated with the user to derive the knowledge of the at least one function may include analysing the received motion information to derive knowledge of at least one of gesture recognition of the user, steps tracking of the user or a combination thereof.
Various embodiments of the present disclosure relate to a foot-mounted wearable device which helps to obtain accurate movement data when the tracking sensor is worn as a toe-ring.
Moreover, the present disclosed system helps in preliminary diagnosis of movement disorders associated with the user based on gait analysis through the toe-ring which generally makes the user aware and motivates him or her for further consultation with a medical practitioner.
Also, the present disclosed device enables gesture recognition of the user which further helps in fitness monitoring, sports analytics, gesture-based commands.
Furthermore, the present disclosed device also enables steps tracking of the user which further helps in pedestrian positioning in absence of GPS, enhancing performance of the GPS based positioning system, by fusing positioning data obtained using toe-ring, enhancing performance of the indoor positioning system by fusing positioning data obtained using toe-ring, land survey (or measurement of land parcel) by tracking steps and the like.
Moreover, the indoor positioning technology has applications in tracking rescue agents (firefighters, mining rescue agents etc) when they perform rescue operation indoor. As a result, real-time indoor position which is obtained from indoor pedestrian positioning technology helps in case of emergency and may be used for tracking workforce, for better management and safely, in airports, factories, hotels etc.
Again, the present disclosed device provides more accurate results in capturing the motion information as sometimes conventional wearable devices which are worn on wrist or hand of the user may consider a footstep count even if there is some sort of hand movement.
In addition to, the present disclosed device is also capable of capturing hand movements of the user when worn by the user in fingers while performing the one or more physical exercises and thus helps in identifying the type of the one or more physical exercises, wherein the hand movement is captured by using one or more inertial sensors and further such captured hand movements are analysed and recognised by using a signal processing and machine learning technique.
It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the disclosure and are not intended to be restrictive thereof.
While specific language has been used to describe the disclosure, any limitations arising on account of the same are not intended. As would be apparent to a person skilled in the art, various working modifications may be made to the method in order to implement the inventive concept as taught herein.
The figures and the foregoing description give examples of embodiments. Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, the order of processes described herein may be changed and are not limited to the manner described herein. Moreover, the actions of any flow diagram need not be implemented in the order shown; nor do all of the acts need to be necessarily performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of embodiments is by no means limited by these specific examples.
Number | Date | Country | Kind |
---|---|---|---|
201911005132 | Feb 2019 | IN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/IB2020/050972 | 2/7/2020 | WO | 00 |