Aspects of the disclosure relate to the configuration and operation of body area networks to capture sensor data about a user.
A body area network involves communication between at least one body worn device and other body worn or external devices. Most applications fall into either personalized applications or medical applications. Personalized applications may include health, wellness, fitness, sports, etc., while medical applications have more stringent requirements with regards to data security, interoperability, and performance. To address body area network requirements for medical applications, there are several standardization efforts including the Institute of Electrical and Electronics Engineer (IEEE) 802.15.6 standard. On the other hand, for personalized applications there are no specific standards.
In one or more illustrative examples, a method for configuring and utilizing a body area network (BAN) is provided. In a configuration phase, configuration messages are sent for scheduling a plurality of transmit-only devices such that during a data collection phase each of the plurality of transmit-only devices is configured to transmit in an individually-assigned time slot. In the data collection phase, a data collector device receives, from the plurality of transmit-only devices, sensor data messages including sensor data from the transmit-only devices, the sensor data messages being scheduled according to the configuration phase.
In one or more illustrative examples, a system for configuring and utilizing a body area network (BAN) includes a plurality of transmit-only devices and a data collector device. In a configuration phase, the plurality of transmit-only devices are configured to receive configuration messages for scheduling transmissions of the plurality of transmit-only devices, such that during a data collection phase each of the plurality of transmit-only devices is configured to transmit in an individually-assigned time slot. In the data collection phase, the data collector device is configured to receive, from the plurality of transmit-only devices, sensor data messages including sensor data from the transmit-only devices, the sensor data messages being scheduled according to the configuration phase.
As required, detailed embodiments of the present invention are disclosed herein; however, it is to be understood that the disclosed embodiments are merely exemplary of the invention that may be embodied in various and alternative forms. The figures are not necessarily to scale; some features may be exaggerated or minimized to show details of particular components. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a representative basis for teaching one skilled in the art to variously employ the present invention.
Aspects of the disclosure relate to providing low power wireless connectivity among body worn devices as well as with non-body worn devices in communication with the body worn devices. Several applications such as health, wellness, fitness, sports, etc., require a user to wear one or more sensor devices on the body to provide sensor data. This sensor data may be utilized to measure and optimize properties such as posture correction, exercise monitoring/recommendation, sports performance, etc.
Body worn sensors are usually battery powered for optimal user experience and, in some cases, required by application itself. Because body worn devices are generally battery powered, a tradeoff between power consumption and data rate/latency remains a key challenge. Hence, low power consumption is very important, along with satisfying data rate, latency, and interoperability requirements.
In this disclosure, sensors with transmit-only radios are used. Such devices may lead to an order of magnitude power savings for wireless communication compared to transceiver-based solutions. Depending on the use case, these transmit-only sensors may allow the sensors to be completely battery-less. The management of several transmit-only sensors and supporting quality of service requirement of the application is non-trivial. Further aspects of the disclosure present methods to support those requirements.
At least one of those sensors 102 may utilize a transmit-only radio. A transmit-only radio may be configured to send transmissions but not also receive transmissions. The transmit-only radio therefore be able to operate in a much lower power mode than a transceiver that also is configured to receive transmissions.
In some examples, one or more of the sensors 102 may support wakeup radio. Wakeup radio refers to systems in which a receiver is configured to wake up just in time to receive radio transmissions. This may be accomplished through adding a small companion receiver, with the purpose of waking up the primary connectivity radio. The small companion receiver may be referred to as a wakeup receiver. Since the wakeup receiver may only need to detect presence of a wakeup signal, and not decode complex information, the wakeup receiver may be implemented in a lower power design than a full receiver.
As a specific example, the sensors 102 may implement BLUETOOTH low energy (BLE), e.g., as a BLE transceiver with wakeup radio and/or as BLE transmit-only devices. Such radios are low power compared to traditional BLE implementations, while still being able to create and transmit BLE packets. A wakeup radio BLE transmitter in general consumes less extra energy compared to a BLE backscatter solution, yet can create standard complaint transmit packet without needing any excitation signal for data transfer. Such transmit-only devices may still need a wakeup signal for the wakeup radio. It should be noted that use of BLE is only an example, and the sensors 102 may implement other wireless technologies including Wi-Fi, IEEE 802.15.4, ultra-wideband (UWB), various proprietary protocols, etc.
The sensors 102 may be powered by a power source such as a super-capacitor or a battery. In some cases, the sensors 102 may scavenge energy from ambient conditions. It should be noted that various wireless charging methods may be utilized during usage of the sensor 102 devices on the human body. After the usage, the sensors 102 may be recharged or the batteries replaced.
The microcontroller 208 may be utilized to generate data packet and process sensor data. Additionally, the sensors 102, microcontroller 208, radio transmitter 212, and wakeup receiver 214 may be separate chips, circuits, devices, or packaged in one module. The transmitter 212 may be configured to transmit signals using various protocols such as BLE, Wi-Fi, IEEE 802.15.4, UWB, various proprietary protocols, etc.
The transmit-only device 202 may be powered by the power storage 210. The power storage 210 may be a normal battery, a super capacitor, or a rechargeable battery. For rechargeable power options, the device may additionally utilize wired, wireless charging or ambient charging, power harvesting from kinetic energy, etc.
The transmit-only device 202 may optionally include a wakeup receiver 214. The wakeup receiver 214 circuit may allow the transmit-only device 202 to receive a wakeup message (via a wakeup signal) or to transmit data packets. The wakeup signal may be provided using a simple On-Off Keying. One such implementation utilizes Manchester coded 125 kHz waveform. The transmitted data packet signal may be of standard technologies such as BLE, Wi-Fi, IEEE 802.15.4, 5G reduced capacity, or any other proprietary wireless protocol. The transmit-only device 202 may optionally utilize wakeup circuitry comprising an envelope detector at a minimum to wake up only when signal is above a given threshold. The transmit-only device 202 may also include a pattern correlator to wake up only when message is addressed to the transmit-only node by utilizing a unique pattern for each transmit-only device 202.
When a wakeup receiver 214 is employed, a transmit-only device 202 may also include an antenna switching circuit 228 (shown in
For an optimal or immersive user experience, the data collector device 204 may include an HMI 218 to provide for user feedback. The data collector device 204 may also include a microcontroller 208 to aggregate and process sensor data for displaying or forwarding to the HMI devices 224. The data collector device 204 itself may be battery powered and may employ a rechargeable battery 222 which may be charged via wired or wireless means.
The antenna switching circuit 228 may allow the general sensor device 206 to switch between receiving a wakeup message (via a wakeup signal) or transmitting data packets. When the antenna switching circuit 228 is in wakeup mode, the general sensor device 206 may be able to receive wakeup signals via the wireless transceiver 216. When the antenna switching circuit 228 is in transmit mode, the transmit-only device 202 may transmit raw or processed sensor data using the wireless transceiver 216. This may allow the general sensor devices 206 to either operate as discussed above with respect to the wakeup circuit 214 of the transmit-only device 202 or to operate as discussed above using the wireless transceiver 216 of the data collector device 204.
The devices in the BAN 200 may take on various roles. As shown in
As shown in
One or more devices of the body area network 200 may implement the wakeup device 402 role. In one example, the wakeup device 402 may be implemented by one of the sensors 102. Or the data collector device 204 may serve as the wakeup device 402. In another example, the wakeup device 402 may be implemented as a dedicated device for generating the wakeup signal. In yet another example, the HMI device 224 may be used to generate the wakeup signal. For a more immersive or enhanced user experience, the BAN 200 may include such additional HMI devices 224 such as a smartphone, tablet, tv, connected screens, etc. The receiver device 302 may also be used to generate the wakeup signal to configure the transmit-only devices 202.
Standard wearable devices such as smartwatches, rings, etc., may also operate as the data collector device 204. When a separate HMI device 224 is used, the data collector device 204 may simply act as a sensor 102 while the HMI device 224 may operate as receiver device 302 for all sensor data from general sensor devices 206 and transmit-only devices 202. Alternately, the HMI device 224 may generate the wakeup signal while the data collector device 204 acts as the receiver device 302. The data collector device 204 itself may generate the wakeup signal to configure transmit-only devices 202 and act as the receiver device 302 during data communication cycles.
The BAN 200 may collectively enable logging and/or analyzing of data from the sensors 102 for various applications. These applications may include, as some non-limiting examples: body motion capture application for orientation tracking like Yoga or curvature tracking such as running; posture correction and balancing; daily activities such as walking, running, biking, sleeping, etc.; fitness activities such as (full body) workouts, exercises, etc.; wellbeing activities such as yoga, dancing, meditation, etc.; sports activities such as soccer, boxing, basketball, cricket, badminton, tennis, table tennis, golf swing, swimming, etc.; and/or custom gestures such as pet activities (scratching), accessories (ring), skateboard, smartphone photo/QR-code scan, etc.
Referring again to
For the periodic transmission, each transmit-only device 202 may collect sensor data 304 for a pre-determined period of time such that when the timer expires, the transmit-only device 202 transmits the sensor data 304. This period of time may be random, in an example. The periodic interval time information may also be included in the data message, or the data collector device 204 may receive a first few initial messages from each transmit-only device 202 to infer its respective periodic time interval.
For the random transmission, each transmit-only device 202 may collects data for a random period of time, such that once the timer expires the transmit-only device 202 transmits the data along with a time interval for the next round of transmission. In an alternative, the transmit-only device 202 may also wake up randomly and decide whether to transmit based on a random probability (e.g., taken from a uniform distribution between 0 and 1). If the probability is above a predefined threshold, e.g., 1/n where n is total number of transmit-only devices 202, then the transmit-only device 202 may transmit, otherwise the transmit-only device 202 may not transmit. Responsive to the transmit-only device 202 determining not to transmit, the transmit-only device 202 may wait for a shorter random time again before calculating the probability for transmission. The method is similar to p persistent carrier sense multiple access (CSMA).
These approaches may be sufficient when the number of transmit-only devices 202 is small and network utilization is low. However, if high data rates are desired to be supported, additional methods may be utilized to perform channel arbitration.
One approach is to include a low power wakeup receiver 214 in each of the transmit-only devices 202. The wakeup circuit may trigger the transmit-only device 202 to transmit responsive to receiving a wakeup signal above a predefined threshold signal level. This may address the issue of transmitting to be performed only at times requested by the receiver of the data collector device 204. With transmission power control, it can therefore be ensured that only transmit-only devices 202 on the human body will wake up and transmit. This approach may be acceptable if there is only a single transmit-only device 202 on the body.
However, in case of many transmit-only devices 202, an additional approach for channel arbitration may be desired to ensure that messages can be received from all of the transmit-only devices 202. Otherwise, energy in transmitting may be wasted if those messages are ignored or overlap or are otherwise unable to be received. This channel arbitration may be performed in various ways, such as those indicated below. One of more of these channel arbitration approaches may be combined to further improve performance with multiple transmit-only devices 202.
In one channel arbitration approach, each transmit-only device 202 may randomly decide whether to transmit or not to transmit (e.g., when the transmit-only device 202 has data to transmit). The transmit-only device 202 may not need to transmit when it has no data to send, unless the time between last transmission exceeds a pre-determined sending timeout. In that case, the transmit-only device 202 may still transmit a message to indicate that the transmit-only device 202 is still alive.
In another channel arbitration approach, each transmit-only device 202 may transmit on a different channel, so either at receiver we have multiple receivers (e.g., operating on different channels) or a software radio that can receive all transmit-only messages simultaneously. Or the receiver may decide which transmitting device to tune in. In this case, energy may be expended for transmitting nodes that are unnecessary to be listened to.
In another channel arbitration approach, a node identifier (ID) may be coded in the wakeup signal which is detected by the pattern correlator at the receiver. This may allow the indicated transmit-only node to respond while the other transmit-only devices 202 ignore the wakeup message.
As shown, the receiver device 302 may send a periodic offset to the wakeup device 402. The wakeup device 402 may then send a configure event to the transmit-only device 202, which may include a wakeup signal having a wakeup pattern and/or the periodic offset. In the alternative, the wakeup device 402 may send the configure event to the transmit-only device 202, which may include a wakeup signal having a wakeup pattern and/or the periodic offset. Responsive to the periodic wakeup for the data transfer occurring, the transmit-only device 202 may send the message data.
In the no pipeline, single radio architectures, the receiver device 302 is assumed to have only one radio and hence all devices are scheduled sequentially. Initially a configuration phase is performed where the controller device sends the Beacon C (configuration) messages to configure at least the transmit-only devices 202. During the configuration phase, each of the general sensor devices 206 and transmit-only devices 202 is scheduled, such that during a data collection phase each of them can transmit in their individual assigned/calculated time slots. In case a dedicated source is being used for generating wakeup signal, this beacon may be used to synchronize that device as well.
In the pipeline enabled, dual radio architecture, two radios are assumed for reception: one for general sensor devices 206 and one for transmit-only devices 202. The advantage of such an architecture is that when general sensor devices 206 are being configured, transmit-only devices 202 may be configured in parallel (i.e. pipelined) on a separate channel. Another advantage is a shorter duration of the data collection phase. Here again, the general sensor devices 206 and transmit-only devices 202 may be scheduled for each receiving radio. Thus, the system capacity can be doubled at a cost of one additional radio at the receiver. An alternate setup may utilize a collector for collecting data from all general sensor devices 206 with an HMI/display device from all transmit-only devices 202 (or vice versa) with the data being aggregated at either end for analytics and/or user experience (UX).
The key messages for these architectures may include Beacon C messages, configuration messages, Beacon D (data) messages, and data collection messages.
The payload of the Beacon C message may include information for use by the wakeup device 402 in initiating system configuration. For instance, to identify the message as being the Beacon C message, the Beacon C message may include a configuration bit set to ‘1’ (or another value denoting the Beacon C message is a configuration message). Further, the Beacon C message may include a timestamp to synchronize system clocks of network devices and to avoid replay attacks. The Beacon C message may further include a total number of devices (e.g., the general sensor devices 206 and the transmit-only devices 202) and optionally an offset value to indicate the beginning of data collection phase.
Responsive to receiving the Beacon C message, the wakeup device 402 responsible for generating wakeup signal, if any, may proceed to configure each of the transmit-only devices 202. The wakeup device 402 may also send a system broadcast wakeup pattern including a pattern to indicate beginning of configuration cycle. This could be used by the other devices to synchronize their clocks.
The configuration of general sensor devices 206 and transmit-only devices 202 may also occur in parallel when configuration of these two sets is done by two different devices, e.g., by data collector devices 204 and dedicated wakeup devices 402, respectively, for pipelined architectures, or if the data collector device 204 has more than one radio.
Depending on application data rate requirements there could be gap between successive data collection cycles denoted by offset in data period beacon.
The nth transmit-only device 202N may transmit to general sensor device 206 (n−1). Then, in the next cycle, the general sensor device 206 (n−1) may send its own data along with that of the nth transmit-only device 202. The wakeup pattern may be generated by general sensor device 206 which is going to listen to the corresponding transmit-only device 202.
A separate wakeup device 402 may alternatively be used to generate wakeup patterns for transmit-only devices 202. This wakeup may be required only in the first data transmission cycle, because after that the transmit-only devices 202 may wake themselves up periodically. Further, the receiver device 302 may also transmit a broadcast wakeup pattern at beginning of every data cycle to synchronize the transmit-only devices 202.
It should be noted that the pipeline architectures may be especially useful when the number of transmit-only devices 202 is equal to or less than the number of general sensor devices 206 in the BAN 200.
It should also be noted that, to achieve power optimization, the sensor devices may be equipped with a low power wakeup receiver 214. In this case, the devices may take turns toggling between general sensor device 206 mode and transmit-only device 202 modes. In an example, a general sensor device 206 which is transmitting more frequently may switch itself to transmit-only device 202 mode and may use all transmit-only time slots for data communication in the pipelined architecture to achieve power optimization.
It should further be noted that in all the aforementioned architectures, an additional guard band may be used before every transmit-only device 202 when they are explicitly woken up to receive wakeup signal pattern. In some examples, the devices 202, 204, 206 may also enable data encoding in which case they send either processed data or only differential data in their time slots to optimize their own respective overall transmissions.
Thus, sensors 102 with transmit-only radios may be utilized in a BAN 200 to provide an order of magnitude of power savings for wireless communication. To support various quality of service requirements, the management of the transmit-only devices 202 may be accomplished using various architectures, including: a no pipeline, single radio receiver architecture; a no pipeline, single radio receiver architecture with a dedicated wakeup source; pipeline enabled, a two receiver/receiver with two radios architecture; and a pipeline enabled, single receiver architecture with data aggregation.
The processor 804 may include one or more integrated circuits that implement the functionality of a central processing unit (CPU) and/or graphics processing unit (GPU). In some examples, the processors 804 are a system on a chip (SoC) that integrates the functionality of the CPU and GPU. The SoC may optionally include other components such as, for example, the storage 806 and the network device 808 into a single integrated device. In other examples, the CPU and GPU are connected to each other via a peripheral connection device such as peripheral component interconnect (PCI) express or another suitable peripheral data connection. In one example, the CPU is a commercially available central processing device that implements an instruction set such as one of the x86, ARM, Power, or microprocessor without interlocked pipeline stage (MIPS) instruction set families.
Regardless of the specifics, during operation the processor 804 executes stored program instructions that are retrieved from the storage 806. The stored program instructions, accordingly, include software that controls the operation of the processors 804 to perform the operations described herein. The storage 806 may include both non-volatile memory and volatile memory devices. The non-volatile memory includes solid-state memories, such as not and (NAND) flash memory, magnetic and optical storage media, or any other suitable data storage device that retains data when the system is deactivated or loses electrical power. The volatile memory includes static and dynamic random-access memory (RAM) that stores program instructions and data during operation of the system 100.
The GPU may include hardware and software for display of at least two-dimensional (2D) and optionally 3D graphics to the output device 810. The output device 810 may include a graphical or visual display device, such as an electronic display screen, projector, printer, or any other suitable device that reproduces a graphical display. As another example, the output device 810 may include an audio device, such as a loudspeaker or headphone. As yet a further example, the output device 810 may include a tactile device, such as a mechanically raiseable device that may, in an example, be configured to display braille or another physical output that may be touched to provide information to a user.
The input device 812 may include any of various devices that enable the computing device 802 to receive control input from users. Examples of suitable input devices that receive human interface inputs may include keyboards, mice, trackballs, touchscreens, voice input devices, graphics tablets, and the like.
The network devices 808 may each include any of various devices that enable the devices to send and/or receive data from external devices over networks. Examples of suitable network devices 808 include an Ethernet interface, a Wi-Fi transceiver, a cellular transceiver, or a BLUETOOTH or BLE transceiver, UWB transceiver, or other network adapter or peripheral interconnection device that receives data from another computer or external data storage device, which can be useful for receiving large sets of data in an efficient manner.
The processes, methods, or algorithms disclosed herein can be deliverable to/implemented by a processing device, controller, or computer, which can include any existing programmable electronic control unit or dedicated electronic control unit. Similarly, the processes, methods, or algorithms can be stored as data and instructions executable by a controller or computer in many forms including, but not limited to, information permanently stored on non-writable storage media such as read-only memory (ROM) devices and information alterably stored on writeable storage media such as floppy disks, magnetic tapes, compact discs (CDs), RAM devices, and other magnetic and optical media. The processes, methods, or algorithms can also be implemented in a software executable object. Alternatively, the processes, methods, or algorithms can be embodied in whole or in part using suitable hardware components, such as application specific integrated circuit (ASIC), field-programmable gate array (FPGA), state machines, controllers or other hardware components or devices, or a combination of hardware, software and firmware components.
While exemplary embodiments are described above, it is not intended that these embodiments describe all possible forms encompassed by the claims. The words used in the specification are words of description rather than limitation, and it is understood that various changes can be made without departing from the spirit and scope of the disclosure. As previously described, the features of various embodiments can be combined to form further embodiments of the invention that may not be explicitly described or illustrated. While various embodiments could have been described as providing advantages or being preferred over other embodiments or prior art implementations with respect to one or more desired characteristics, those of ordinary skill in the art recognize that one or more features or characteristics can be compromised to achieve desired overall system attributes, which depend on the specific application and implementation. These attributes can include, but are not limited to strength, durability, life cycle, marketability, appearance, packaging, size, serviceability, weight, manufacturability, ease of assembly, etc. As such, to the extent any embodiments are described as less desirable than other embodiments or prior art implementations with respect to one or more characteristics, these embodiments are not outside the scope of the disclosure and can be desirable for particular applications.