One embodiment of the present invention comprises a wireless telecommunication system for providing multiple streams of content to a receiver. In one particular embodiment of the invention, a headset worn by an athlete includes one or more sensors, a microprocessor, a non-volatile memory, a radio and an ultrasonic communicator. The athlete's headset receives and transmits signals to a coach while the athlete is performing.
None.
The number of wireless telecommunication devices that are currently available for use by athletes is relatively small. Athletes may currently used cellular or smart phones for two-way communications, or may use MP-3 players to listen to audio content. No device is presently on the market that provides athletes with a transceiver device that enables the delivery of multiple streams of content. No device is presently on the market that also combines a multiple-stream of content transceiver with sensors that provide information about the athlete. No device is currently on the market that allows real-time communication through water to an athlete without impeding their performance.
The development of a system that would constitute a major technological advance, and would satisfy long-felt needs in the athletic equipment business.
One embodiment of the present invention comprises a wireless telecommunication system for providing multiple streams of content to a receiver. In one embodiment of the invention, a headset worn by an athlete includes one or more sensors, a microprocessor, a non-volatile memory, a radio and an ultrasonic underwater communication device. In this embodiment, the headset is a remote transceiver which receives and transmits signals to a coach via a standard computer, a laptop, a tablet, a smart phone or via some other suitable personal computing device or information appliance.
In this embodiment, the present invention provides coordinated audio streams to an athlete during his/her exercise and training, while logging sensor output for evaluation in real time (by the coach) or post-exercise. In one implementation, the system coordinates audio for entertainment (such as music), real time performance information (such as count of laps, heart rate, etc.), possible activity instructions and interrupt audio such as a coach's advice, or cell phone messages. Alternative embodiments may be used for any exercise/sport that involves long or repetitive periods of activity; such as running, walking, general exercise, etc. In addition, the invention, the invention may be used for medical rehabilitation, physical therapy or any other applications which require monitoring body positions and assisting, guiding or otherwise communicating with a patient.
An appreciation of the other aims and objectives of the present invention, and a more complete and comprehensive understanding of this invention, may be obtained by studying the following description of a preferred embodiment, and by referring to the accompanying drawings.
Section One: Overview of the Invention
In alternative embodiments, the user may wear a different, but generally equivalent device that functions like the headset 14. As examples, the headset 14 could be configured so that it is clipped to a belt, or worn on an armband. In another embodiment, the headset may be configured so that its functions are physically separated into different modules such as: external battery, hear rate sensor on a chest belt, motion sensors on ankle and wrist, processor module on headband or helmet.
In
Section Two:
One embodiment of the invention comprises a combination of hardware and software running that may include a system communication module 16, and a smart phone, tablet computer, personal computer or some other suitable information appliance 20. In one embodiment, a head set or other device 14 worn by a user 12 includes one or more real time performance sensors 42.
The present invention includes a combination of hardware and specially designed software that transforms the state of the device 14, and that produces information and communications capabilities that are not available to the user 12 without this combination of hardware and special purpose software.
The sensors 42 derive measurements of various performance metrics. The sensors 42 are worn on an athlete's body 12, and are linked by a wired or wireless connection 15 to the headset 14. The sensors 42 may include, but are not limited to:
Lap counter
Heart rate monitor
Respiration (breath rate) monitor
Stroke counter
Speedometer
Lap timer
The sensors 42 provide data in digital electronic form to the headset 14 during the athletic activity.
In one embodiment, the headset 14 comprises a processor 22 and a non-volatile memory 24. Additional memory may be connected to the headset 14 for supplying generally continuous entertainment audio, such as music files, playlist, books on tape, workouts, etc. The processor 22 is capable of driving a set of headphones 14A, such as ear buds, inductive bone system, etc., that would provide audio to the athlete 12.
In one embodiment, the headset 14 is equipped with wireless communication capabilities for receiving data from the System communication module. These capabilities may include, but are not limited to, Bluetooth, IEEE 802.11 (Wi-Fi) and/or some other suitable wireless system. Alternative embodiments may also include multiple communication capabilities. For a swimmer 12, this would include an out-of-water communication method based on radio transmissions (such as Wi-Fi), and an in-water communication method. An alternative embodiment that uses ultrasonic frequencies through water is described below.
In one embodiment, the athlete's headset 14 is configured to to translate the digital data received from the real time performance sensors 42 into understandable audio. This feature is accomplished using commercially available text-to-speech algorithms or pre-recorded voice. Some examples of this audio would be:
Finished lap 10
Heart rate 92
Last lap time was 20 seconds
3 seconds behind target pace
3 seconds behind John's most recent pace
System Communication Module
The system communication module 16 provides a communication link 15 to the headset 14 as well as to applications running on a smart phone or computer 20 (coach's software, audio download software). For a swimming application, this module 16 communicates with smart phones via Wi-Fi or Bluetooth and communicates with the headset 14 using Wi-Fi (out-of-water communication) or ultrasonic underwater frequencies (in-water communication).
The system communication module 16 includes all the hardware that is necessary to provide these communication capabilities, as well as a small computer system to handle two different modes of communication:
During the activity, the system communication module 16 also receives data from the headset 14 when a communication link is available for such data transfer. This data comprises data accumulated from the sensors 42 by the headset 14. The system communication module stores and/or forwards this data to the coach 18.
In an alternative embodiment, the system communication module 16 provides the means for charging one or more headsets 14 when they are not being used. The headset charging is done inductively or through a wired connection.
Coach's Software
In one embodiment of the invention, the information appliance used by the coach runs a specially configured software application. This software application is used by a coach 18 in real-time as the athlete 12 is performing the activity. One of the functions of the software application is to provide the coach 18 with the ability to select an individual athlete to communicate with, and then to translate his/her voice to digital form and send it to the system communication module 16 for forwarding on to the particular athlete selected. The system will also have the ability to select subgroups (e.g., lanes) or all swimmers in the pool as recipients of an audio message.
Various other functions of this software include, but not be limited to, display of athletes picture, prior performance (in graphical or tabular form), the ability to add notes or voice memos to an athletes data profile, and/or receiving real-time performance information (lap count, speed).
After a given session, the software application uploads the performance results, coach's notes, and/or other information or data to a server. Such a server is connected to the internet (which may be referred to a “remote server” or “the cloud”), to a local network, or is a stand-alone computer. The server enables the sharing of data amongst teammates or others using the system (parents, friends, other athletes or coaches). The use of a server also allows coaches (or others) to define pre-packaged workouts (with or without music) for others to use, either as sellable content or as freeware.
Audio Download Software
A second software application that runs on a smart phone or computer is employed to send the entertainment audio data (in the form of computer files) to the system communication module 16 before the athletic activity starts, or during the athletic activity. The selection of what audio to send would be made through user choice either in real-time, or made at some previous time, e.g., at home, long before getting to the pool. The audio file is sent to the system communication module by the coach 18 or by the athlete 12, and the audio file can be sent to a specific headset 14, group of headsets or all headsets.
System Operational Modes
The present invention operates in two distinctive modes. The first mode, which includes two steps, is implemented prior to the beginning of the athletic activity beginning, as shown in
Step One: Audio content is selected by the athlete, the coach, or a third party. The selection would be made through using the audio download software, and is done prior to the athlete getting to the pool (though it could also be done at poolside on a smart phone/tablet).
Step Two: The audio download software then communicates with the system communication module 1 and transfers the audio files, playing instructions and/or athletic activity instruction audio files through the module 16 and into the headset 14. This transfer can be either a point to point transmission (or series of point to point transmissions), targeted at an individual swimmer, or a point to multi-point transmission, in which one set of audio files are downloaded for all the swimmers on a given day. The system communication module 16 then duplicates the data, and downloads it to each headset 14. This download takes place before the athletic activity, and, as an alternative, before the swimmer actually gets into the pool. This process need not be simultaneous for each headset 14. The system communication module 16 coordinates the transmission of data to each headset as it becomes available.
The second mode, which includes five steps, is implemented during the athletic activity, as shown in
Step One. As the athlete 12 performs the activity, the headset 14 plays the entertainment audio stream generally continuously, which allows, for example, the swimmer to hear music while swimming his/her laps.
Step Two. At regular intervals, or when certain events occur (like finishing a lap), the headset 14 will transform some or all of the digital data received from the real time performance sensors 42, and then delivers it in audio form to the athlete 12. For example, after every lap in the pool, the swimmer 12 could hear the lap count e.g., “Finished lap X”. During play of the performance audio, the entertainment audio stream is paused, and then resumes after the performance data had been spoken.
Step Three. If there are athletic activity instructions, they are provided when triggered (e.g., by time, lap count, distance). The audio stream is provided by the headset 14 as appropriate. The audio stream also causes the entertainment audio stream to be paused while it is delivered. An example of such an audio stream could be instructions like: “Switch to the backstroke on the next lap.”
Step Four. When the coach 18 wants to communicate with an athlete 12, the coach selects a particular athlete to target using the coach's software. The coach then speaks into his or her smart phone or tablet's microphone 93A, 93B 93C. The resulting digitized voice stream is sent by the coach's software, along with identification of the targeted athlete 12, to the system communication module 16. The module 16 then sends it on to the correct headset 14 through the appropriate means (for a swimmer this would be modulated ultrasonic audio propagated through the water). When received by the headset 14, this interrupt audio would be immediately delivered to the athlete 12. The entertainment audio stream is then paused. Any performance data delivery is then delayed or discarded. Activity instruction audio is delayed if it is interrupted/interdicted by the interrupt audio.
Step Five. When the headset 14 is out of the water (for example, during a rest period between laps or after a set of laps), recorded performance data from the attached sensors 42 is sent back to the system communication module 16 for archiving and is then relayed to the coach's information appliance. In addition, at this time, new athletic activity instructions and/or audio is downloaded to the individual headset 14 from the system communication module 16, as shown in
Real Time Audio Selection
In one embodiment of the invention, the headset 14 is programmed with software algorithms that are stored in the non-volatile memory 24, and that handle the various audio streams that are available for simultaneous delivery to the athlete 12.
At decision point 62A, the system plays the entertainment audio stream if there is no other audio ready to play.
At decision point 62B, the system determines if the non-entertainment audio is interrupt audio (coach's voice). If it is, it will be played as the highest priority, and will continue to be played until it terminates/ends. When it ends, the system will check if other non-entertainment audio is ready or has been delayed (in the case of activity instructions).
At decision point 62C, the system plays activity instructions in preference to performance data.
At decision point 62D, the system provides performance data as the lowest priority audio stream. If there is no performance data to provide, the system will go back to playing the previously paused entertainment audio.
A Web Portal
One embodiment of the invention includes a web portal for distributing workouts in a defined format. The web portal enables coaches to sell or to distribute their workouts (e.g., a triathalon training schedule). The web portal not only distributes the workouts, but also gives the coach 18 and the athlete 12 access to the performance data for all workouts recorded with the system and any swim meet results.
Communication from Swimmers
In another alternative embodiment, a microphone is built into the headset to allow the athlete to communicate with the coach. The microphone would enable the swimmer to send audio (speech) over the wireless link 15 to the system communication module 16. The audio data is saved (verbal commentary) and/or transmitted to the coach and/or transmitted to other athletes.
Section Three:
Underwater Ultrasound Communication System
One embodiment of the invention comprises a one-way underwater communication system designed for audio messages, such as speech or music, transmitted to swimmers in a pool from a poolside location. Although a specific embodiment is described below, persons having ordinary skill in the art will appreciate that many design variations may be employed to implement the invention. These variations include, but are not limited to, different frequency bands, numbers of channels, bandwidths, channel selection logic and/or other design configurations.
As shown in
The individual swimmers are identified by the numbers 1, 2 . . . N; and each wears an ultrasound receiver with earpieces for hearing. Each coach has a transmitting apparatus connected either by wires or wireless means to a common transmitting hydrophone immersed in the pool. The first coach 18 always talks over channel B, and the second coach 46 always talks over channel C. The selection of an individual swimmer to hear a message from a coach is accomplished by sending a tone of a specific frequency over channel A. For example, if first coach 18 wants to talk to swimmer #3 (but to no others), tone frequency f3 is transmitted on channel A, as shown in
The coaches 18 & 46 can talk to more than one swimmer at a time by simultaneously sending more than one tone over channel A. For example, if first coach 18 simultaneously sends tone frequencies f3, f5, and f7 over channel A, swimmers #3, #5, and #7 can hear the first coach 18 talking over channel B. One or more swimmers can also to hear both coaches 18 & 46 at the same time. For example, if on channel A first coach 18 sends tone frequencies f2 and f6 and second coach 46 sends tone frequencies fN+2 and fN+6, swimmers #2 and #6 will be able to hear both coaches 18 & 46 talking.
Transmitter Design
Receiver Design
A schematic block diagram of one embodiment of a swimmer's receiver is shown in
After acquisition, the tracker generates the same PN code as that which was transmitted, but which has been compensated for Doppler shift due to swimmer motion, and is aligned with the direct-path received PN code. The received signal is multiplied by the tracking PN code, which despreads all four received channels. By also tracking the despread 100 KHz pilot #1 carrier, the tracker generates Doppler-compensated frequencies, nominally 100, 150, 200, and 250 KHz, which are used to shift each of the four channels to baseband using complex frequency shifters as shown in the figure. Each baseband channel is lowpass filtered and AM demodulated. The lowpass filter for baseband channel A is made just wide enough to pass all received tones. The channel B and C lowpass filters have a 3 KHz cutoff to pass speech but not higher frequencies. The lowpass filter for channel D has a 10 KHz cutoff to pass music with reasonably good fidelity.
The received selection tones from baseband channel A are fed to a tone decoder, the output of which selects which of the baseband channels B, C, and/or D are to be heard by the swimmer. The specific tone frequencies which enable channels B and C to be heard are unique to the individual swimmers receiver, while the tone frequency f0 which forces and announcement on channel D to be heard is common to all receivers.
In one embodiment, an automatic gain control (AGC) is included in the receiver. Because underwater ultrasound attenuation has a rather severe frequency dependence, in one embodiment, each of the four channels includes an independent AGC circuit.
PN Code Characteristics
The 30 kchip/sec PN code is a shift-register generated maximal length PN sequence of length where N is a positive integer equal to the length of the shift register. The shift register feedback configurations for various values of N are well-known in the art. The normalized autocorrelation function for such a PN sequence has a peak of value −1/(2N−1) for no chip shift and a constant value of for all shifts greater than 1 chip in magnitude. For a suggested value of N=10, the code consists of a 1023-chip sequence having a repetition period of 0.0341 seconds and a spatial period of 49.8 meters in water. The spatial length of one chip is 4.87 cm. Thus, on each of the 4 channels, any multipath signal with a spatial delay between 4.87 cm and about 49.8 meters relative to the direct path signal will be significantly attenuated. The amount of attenuation increases with the chip rate of the PN code and higher chipping rates may be used if needed.
Digital Implementation
One embodiment of the present invention is configured to achieve low-cost digital implementations of both the transmitter and receiver. Required sampling rates are quite low, digital implementation of the required lowpass filter designs is not very demanding, and arithmetic operations is relatively simple to implement with a microprocessor and/or dedicated chip, including those needed for code/carrier tracking and the tone decoder in the receiver.
All frequencies generated within the transmitter or receiver are relatively low and are easily synthesized from a single oscillator. The oscillator frequency tolerance is not demanding.
Design Tradeoffs
In an alternative embodiment of the invention, the four channel center frequencies could be closer together than described in the previous embodiment, as long as the space between the unspread channel spectra is large enough to allow channel isolation by the lowpass filtering in the receiver. For example, the center frequencies for channels A-D might respectively be 100, 120, 140, and 160 KHz. This reduces the required bandwidth of the transmit and receive hydrophones, probably making them less costly. This also reduces the variation of ultrasound attenuation in the water over the signal bandwidth. These center frequencies cause greater overlap of the spread spectra of the transmitted channels. However, this presents no problems inasmuch as the despreading process in the receiver removes the overlap.
By using SSB modulation instead of AM on each channel, channel bandwidths may be halved, permitting even closer channel spacing and a yet smaller required hydrophone bandwidth. However, SSB modulation/demodulation adds complexity to the system design.
The generation and decoding of selection tones may be made simpler by having at most two tones simultaneously transmitted by a coach. One tone identifies the individual swimmer, and the other identifies the coach, enabling the identified swimmer to hear the identified coach. This embodiment also offers the capability of transmitting a special tone of frequency f0 for an announcement to all swimmers.
If desired, stereo could be transmitted on channel D using I and Q for left and right.
Alternate Embodiments of the Underwater Ultrasound Communication System
In another embodiment of the Underwater Ultrasound Communication System, all four channels are transmitted at the same frequency (for example, 100 kHz) and signals are frequency-spread on the channels using a unique PN code for each channel. At a swimmer's receiver, the signal from an individual channel is recovered by correlation using its PN code as a reference. At the output of the correlator for a given channel, the signals from the other channels appear as wideband noise, most of which are removed by a filter with a bandwidth just large enough to pass the de-spread speech or music information for the given channel.
The selection of a swimmer for communication from either coach is accomplished in the same manner as the original embodiment described above. Also, the optional unspread pilot tone #2 shown in
For increased reliability in selecting swimmers for communication, each coach 18 and coach 46 swimmer select tone can be replaced with a dual tone using multi-frequency (DTMF) technology, similar to that used in touch-tone telephones. Keypads for producing 10 DTMF signals have low cost and are widely available for telephone use. Any modifications needed to permit each coach to independently select up to ten swimmers should be relatively simple. If necessary, pressing two keys on a DTMF keypad could further expand the number of selectable swimmers.
Section Four:
Magnetic Lap Counter
One embodiment of the invention includes a system for automatic counting of laps for a swimmer through the use of magnetic sensors. Although a specific embodiment for swimmers is described, such a device could be used for any exercise/sport that consists of back and forth movement (such as running laps on an oval track).
General Description
As shown in
Hardware Sensor Design
One embodiment of the invention includes a set of three magnetic sensors in an orthogonal configuration (“3 axis magnetic sensor”) and a set of three acceleration sensors in an orthogonal configuration (“3 axis accelerometers”). The two sets of sensors are constructed and connected such that the rotational relationship between them is a known, fixed quantity. This configuration allows measurements made by the magnetic sensors to be referenced to measurements made by the accelerometers. In this embodiment, the sensors have identical alignments as shown in
VM=ΩMAVA
Where VM is the vector in the magnetic sensor frame, VA the vector in the accelerometer sensor frame and ΩMA is the rotation matrix between the two frames.
Basic Measurement Processing
Measurements obtained from the sensors are processed in a low cost/low power microprocessor (or other computing device, such as the headset microprocessor). The accelerometers feel the pull of gravity, and detect a 9.8 m/s/s acceleration “down” towards the center of the Earth (along the “Y” axis in
HM=VM−VG(VM·VG)
Where VM is the measured (3 axis) magnetic vector, VG is a unit vector in the direction of measured gravity and HM is the horizontal component of the magnetic vector. When the sign of HM changes, a “lap” will be counted.
Stroke and Body Orientation Changes
In this embodiment, the accelerometers are used to determine if the swimmer has changed “stroke” between laps. Specifically, if the swimmer transitions between a face down swimming style (like breast stroke) to a face up swimming style (like back stroke) the sensor suite will undergo a 180 degree rotation. This is detected by the change in sign of the gravity vector measured by the accelerometers. In the sensor frame (body frame of the swimmer), the gravity vector will switch from pointing “down” to pointing “up” (caused by the sensor suite flipping over). When detected, this is compensated.
Measurement Filtering
In this embodiment, the sensors are attached to the swimmer's body, so they undergo motions related to the swimmer's movements. These motions will be dependent on the actual location of the device on the swimmer's body (for example; motion of the head will be different than motion of the hips). This body motion will be removed from the measurements through appropriate (and standard) mathematical filtering techniques (such as box car averaging, continuous averaging, alpha-beta filters, etc.). The actual filtering algorithms and parameters may vary depending upon placement of the system.
The algorithms that are used for filtering are fixed, or selected, based on attachment position of the system. Or, they can be determined through analysis of the sensor system's motion via the accelerometer readings. Profiles for expected acceleration patterns based on attachment position (head, waist, hips, wrist, etc.) are stored and matched to actual sensor readings. Once the attachment position is determined, the appropriate filtering algorithms can be used to process the measurements for lap counting.
Design Tradeoffs
This embodiment uses three axes of magnetic sensors and three axes of acceleration sensors. Alternative embodiments may employ fewer sensors by restricting the alignment/placement of the system on the athlete. The minimum configuration would include only a single magnetic sensor and no acceleration sensors. Other configurations are also possible. The acceleration sensors provide data that could be processed for other purposes. Such as (but not limited to):
Speed profile during the lap.
Time of “turnover” at the transition from one lap to another.
“Push off” acceleration/force during “turnover”
Although the present invention has been described in detail with reference to one or more preferred embodiments, persons possessing ordinary skill in the art to which this invention pertains will appreciate that various modifications and enhancements may be made without departing from the spirit and scope of the Claims that follow. The various alternatives for providing a Activity Monitoring and Directing System that have been disclosed above are intended to educate the reader about preferred embodiments of the invention, and are not intended to constrain the limits of the invention or the scope of Claims.
The Present Non-Provisional patent application is based on Pending Provisional U.S. Patent Application No. 61/855,725, filed on 22 May 2013. In accordance with the provisions of Sections 119 and/or 120 of Title 35 of the United States Code of Laws, the Inventors claim the benefit of priority for any and all subject matter which is commonly disclosed in the Present Non-Provisional patent application, and in the Provisional Patent Application U.S. Ser. No. 61/855,725.
Number | Name | Date | Kind |
---|---|---|---|
4039999 | Weston | Aug 1977 | A |
4065747 | Patten | Dec 1977 | A |
4147222 | Patten | Apr 1979 | A |
5412620 | Cafarella | May 1995 | A |
5523982 | Dale | Jun 1996 | A |
6272072 | Wulich | Aug 2001 | B1 |
6392960 | Seltzer | May 2002 | B1 |
6950681 | Hoffman | Sep 2005 | B2 |
6980487 | Davies | Dec 2005 | B2 |
7006407 | Davies | Feb 2006 | B2 |
7301474 | Zimmerman | Nov 2007 | B2 |
7391317 | Abraham | Jun 2008 | B2 |
7505365 | Chryssostomidis | Mar 2009 | B2 |
7505367 | Abdi | Mar 2009 | B2 |
7613225 | Haque | Nov 2009 | B1 |
7711322 | Rhodes | May 2010 | B2 |
7796943 | Levan | Sep 2010 | B2 |
7853206 | Rhodes | Dec 2010 | B2 |
7873316 | Rhodes | Jan 2011 | B2 |
7877059 | Rhodes | Jan 2011 | B2 |
8045919 | Rhodes | Oct 2011 | B2 |
8159903 | Skrobanek | Apr 2012 | B2 |
8241184 | Dibenedetto | Aug 2012 | B2 |
20030208113 | Mault | Nov 2003 | A1 |
20110213234 | Leskiw | Sep 2011 | A1 |
20120039482 | Walsh | Feb 2012 | A1 |
20120245714 | Mueller | Sep 2012 | A1 |
20120283856 | Caritu | Nov 2012 | A1 |
20130214998 | Andes | Aug 2013 | A1 |
20140285326 | Luna | Sep 2014 | A1 |
20140308042 | Woo | Oct 2014 | A1 |
20150264314 | Goesnar | Sep 2015 | A1 |
Number | Date | Country |
---|---|---|
WO 2015 092 533 | Jun 2015 | WO |
Number | Date | Country | |
---|---|---|---|
20140348367 A1 | Nov 2014 | US |
Number | Date | Country | |
---|---|---|---|
61855725 | May 2013 | US |