Patent Application
20190022532
The present invention relates to the use of biofeedback devices, and more particularly to systems and methods for providing authenticated biofeedback information to a mobile device such as a cellular telephone and for using such information.
Biofeedback devices such as portable heart rate monitoring (HRM) devices are commonly used in fitness related activities for weight loss, goal heart rate (HR) training, and general HR monitoring. Such devices may sometimes be employed by healthcare professionals for chronic and/or acute heart condition monitoring and/or diagnosis.
Portable HRMs and other monitoring devices typically are expensive, and in some cases are cost prohibitive for many consumers. A need exists for inexpensive and/or simplified monitoring systems.
In some embodiments, the present invention provides a wearable band adapted to be worn by a user. The wearable band includes a pulse monitor adapted to monitor a pulse of the user at the user's wrist; and a transmitter adapted to wirelessly transmit pulse information from the pulse monitor to a cellular telephone. The wearable band does not include a display for the pulse information.
In some other embodiments, the present invention provides a system adapted to monitor biometric information of a user. The system includes a wearable band having a pulse monitor adapted to monitor a pulse of the user; and a transmitter adapted to wirelessly transmit pulse information from the pulse monitor to a cellular telephone. The wearable band does not include a display for the pulse information and the cellular telephone is adapted to receive the pulse information from the wearable band.
In still other embodiments, the present invention provides a system which includes a plurality of wearable bands, the wearable bands each including one or more accelerometers, an identification indicia, one or more proximity sensors, and a communications device; and a mobile device adapted to communicate with one or more of the plurality of wearable bands and to determine an activity of a wearer of the plurality of wearable bands based on information transmitted by the wearable bands.
In one or more embodiments of the invention, wearable monitors and/or sensors are provided which may communicate wirelessly with a mobile device such as a cellular telephone, personal digital assistant or other portable computing device. For example, a wrist, ankle or other body part band, strap, bracelet or other securing mechanism may include one or more monitors or sensors adapted to sense biometric information from a user and to transmit this information to a cellular telephone, personal digital assistant or other portable device. Exemplary biometric information that may be monitored includes, but is not limited to, heart rate, pulse rate, temperature, respiration, acceleration, skin resistivity, etc.
In some embodiments, a band or bracelet may be provided for each arm and/or each ankle of a user to monitor arm and leg position during golf, tennis, running, etc., and to provide this or other biometric information to a cellular telephone, personal digital assistant or other portable device. Such a system may be used, for example, to determine stride length during running, body position during a golf or tennis swing, “hang time” during a basketball dunk, and the like.
In one or more embodiments, an accelerometer may be provided within a band or bracelet. The accelerometer may be employed to measure acceleration during a golf, tennis, hockey, or other swing. Such acceleration information may be wirelessly transmitted to a cellular telephone, personal digital assistant or other portable device and used to determine club, racquet or stick speed, club, racquet or stick velocity, swing tempo, or the like. In some embodiments, such acceleration information may be adjusted to compensate for the affects of gravity. Software and/or one or more computer program products on the cellular telephone or other portable device may be employed to calculate or otherwise determine any relevant information.
For example, in a golf embodiment, the portable device may employ the acceleration information from a band or bracelet to determine (1) acceleration of a club during a swing (e.g., club head acceleration); (2) velocity and/or speed of a club during a swing (3) swing tempo; (4) ball-club contact; (5) ball-club contact force; (6) ball-club contact timing; (7) follow through speed, timing and/or tempo; (8) number of strokes of a golf club and/or golfer; (9) predicted ball travel distance (e.g., based on ball-club contact force, club type, swing speed, etc.); (10) predicted ball position (e.g., based on ball-club contact force, club type, swing speed, etc.); (11) golf score; (12) golf handicap; and/or any other similar information.
In another exemplary embodiment, an accelerometer or other sensor may be used to monitor acceleration and/or striking force during a boxing or mixed martial arts (MMA) event (e.g., by embedding the accelerometer in a band or glove worn by a participant) and to provide this or other biometric information to a cellular telephone, personal digital assistant or other portable device.
The present invention also aggregates various inputs from one or more sensors (e.g., in the wearable bands) and provides messages (e.g., signals) to a central system (e.g., a game console, a mobile device running a game program, etc.) indicating sensed “macro” status information (e.g., compound activities/statuses) about a user and/or the user's activity or experiences. In other words, based on verifiable data collected/acquired and aggregated from one or more sensors, the present invention provides an authenticated or verified indication that a user is taking an action or experiencing a particular sensation or physical, physiological, or mental “occurrence.” This authenticated information may then be used to impact, alter, and/or adjust the central system (e.g., change game play on a game console). For example, a video game that wants to require that the user is maximally exerting himself may rely upon an authenticated message from the apparatus of the present invention that confirms the user's maximal exertion. Thus the video game does not have to evaluate or even be aware of the whole array of parameters and corresponding raw data collected from various sensors (e.g., in the wearable bands) such as the user's heart rate (e.g., from an HRM) being above a certain percentage threshold, user perspiration level (e.g., from a moisture sensor) being above a certain threshold, user body temperature level (e.g., from a thermometer) being above a certain threshold, user impact shock level (e.g., from an accelerometer) being above a certain threshold, user acceleration/deceleration (e.g., from an accelerometer) being above a certain threshold, user motion frequency (e.g., from accelerometer(s) and/or proximity sensor(s)) being above a certain threshold, user speed of movement (e.g., from a GPS and clock) being above a certain threshold, user breathing frequency being above a certain threshold (e.g., from a microphone, HRM, etc.), user breathing depth level (e.g., from a microphone, HRM, etc.) being above a certain threshold, user muscle flexing frequency (e.g., from accelerometer(s) and/or proximity sensor(s)) being above a certain threshold, user blood pressure (e.g., from a blood pressure monitor) being above a certain threshold, user pulse oxygen level (e.g., from a pulse oxygen monitor) being above a certain threshold, user blood sugar or insulin or cholesterol levels being above or below certain thresholds (e.g., from an automated blood tester), user muscle expansion (e.g., from a measurement of the muscle size), etc. In other words, the present invention defines a protocol and an interface for providing authenticated activity or status information about a user based on an aggregation of sensed data.
Each cellular telephone 104a-b, or any other portable device receiving information from the band 102, may be programmed to process the biometric information received from the band 102 (e.g., for general health monitoring, determining swing information, monitoring sleep patterns, enhancing video game performance by affecting a video game character or characteristic based on the biometric information, etc.).
In some embodiments, the band 102 may be flexible, continuous and/or water resistant.
In some embodiments, a cellular telephone or other portable device may be employed to display exercise information for a user during exercise. For example, a stepper, elliptical or other piece of exercise equipment may include a crude or rudimentary display of calories burned, steps taken, miles walked, pulse rate, etc. A cellular telephone, portable video game device, personal digital assistant, etc., receiving information from a band, bracelet, strap or the like may provide a much more enjoyable and interactive interface, for example, displaying an avatar representation of an exerciser, a mountain or hill or any other environment for the exerciser to climb or pass through, exercise statistics, graphs of exercise level and/or performance, etc.
In some embodiments, for example using multiple bands, the bands may operate as a mobile ad hoc and/or mesh network to allow the bands to communicate with each other and collectively provide relative positioning information using information derived from, for example, built-in accelerometers, GPS sensors, identification signals, proximity sensors (e.g., sensors that determine distance from other bands based on, e.g., received signal relative strength), etc. The relative positioning information may be used to deduce the activity or position of the wearer or wearers of the bands. For example, if four bands worn on the four appendages of a single user collectively determine and report (e.g., via a wireless signal to a mobile device) that they are all within approximately 10 cm of each other, the mobile device receiving the signal may determine that the user is touching his toes. If within, for example, approximately 10 seconds, the signal is preceded by a prior signal from the bands worn on the user's ankles that the ankle bands are less than approximately 10 cm apart from each other but both the wrist bands are greater than approximately 40 cm from the ankle bands, the mobile device may deduce that the user has just bent over to touch his toes.
As indicated above, in addition to proximity sensors, accelerometers in the bands may be used to sense and report data that corroborates the deduction that the user has bent over. In addition to corroborating the user's body motion, the accelerometers may also be used to determine the orientation of the user's body before, after, and/or at the time of the motion so that, for example, it may be determined that the user is touching his toes while seated versus toe touching while standing. Further, a fifth band (or strap or sensor e.g., included in the mobile device) may be worn on the user's torso and allow the system to determine for example, whether the user's arms and/or legs are extending (e.g., stretched) during the toe touch or retracted (e.g., in an “Indian-style” position) during the toe touch.
In some embodiments, the body position and user activity information that may be deduced by the system of wearable bands and mobile device described above, may be further enhanced by incorporating other sensed biometric information such as, e.g., heart rate, body temperature, and identification (e.g., voice identification) information. For example, heart rate information detected and transmitted by the wearable bands may be used to deduce that the user is engaging in strenuous activity and combined with, e.g., corroborating body positioning and orientation information as well as identity information (e.g., a recorded response to a voice prompt from the mobile device, a user specific heart rhythm pattern, etc.), the system can reliably deduce that the particular user is, e.g., performing a particular exercise or has achieve a particular body status, e.g., physical exhaustion.
In one or more embodiments of the invention, a flight simulator video game may be provided on a cellular telephone (and/or other mobile device, e.g., any number of handheld computing devices (HCDs) including cellular or other telephones) and biometric data from one or more of the wearable bands (or other measurement/sensor devices) may be used to affect the flight simulator video game. For example, for a plane to take off or land safely from an airstrip in the game, a user may be required to have a relatively rapid pulse or heart rate (e.g., 130 plus pulses/minute). In this manner, a user may have to pedal, run, row, walk or otherwise exercise harder to take-off or land a plane in the video game. Thereafter, the user may be required to maintain a predetermined pulse or heart rate in order keep the plane in flight. The longer the user exercises, the longer and/or better the user does at the video game (e.g., by keeping the plane airborne). Some cellular telephones/HCDs, such as, for example, an iPhone available from Apple, Inc., of Cupertino, Calif., include one or more accelerometers for measuring the orientation of the cellular telephone (for affecting display size and orientation). In some embodiments of the invention, such accelerometers may be used as part of the flight simulator to control position (e.g., level, climbing, lowering) of the plane. In other embodiments, external accelerometers or other sensors, such as in one or more wearable bands, may measure arm and/or leg position and/or orientation and provide such information to the cellular telephone. The cellular telephone may then use this position and/or orientation information to control position of the plane. For example, a game player may be required to wear two wrist bands and two ankle bands, each with accelerometers or other position and/or orientation sensors. Movement of the game player's arms and legs may be used to control movement of the plane. For example, a game player may be required to lay on his or her back and raise his or her legs together to have a plane climb, lower his or her legs together to have the plane dive, raise one leg only to have the plane bank right, raise the other leg only to have the plane bank left, or the like. Similar or other plane movements may be controlled by arm position and/or orientation. Note that such a video game embodiment may be performed on a non-mobile or non-portable video game platform (e.g., a Microsoft® xBox, Sony® Playstation®, Nintendo® Wii™, etc.).
In another embodiment, an MMA or similar fight-based video game may be provided on a cellular telephone/HCD and biometric data from one or more of the wearable bands or other measurement devices may be used to affect the fight-based video game. For example, a video game player may be required to wear two wrist bands and two ankle bands, each with accelerometers or other position and/or orientation sensors. Movement of the game player's arms and legs may be used to control movement of a video game player (e.g., blocking, striking, kicking, kneeing, throwing, jumping, etc.). The difference between blocking and striking (or kicking) may be determined based on, for example, movement of an arm or wrist band toward the cellular telephone (e.g., using multi-axis accelerometers or other multi-axis sensors). Such a system may additionally or alternatively be used to teach self defense and/or Martial arts, or other exercise activities, such as Kung Fu, Tae Kwon Do, Muay Thai Boxing, Tai Chi, Pilates, Yoga, Dance or the like by providing a user real time feedback about proper and improper body position and/or orientation. For example, biometric readings from multiple acceleration and/or other monitors coupled to a user may be correlated with body position and/or orientation (e.g., arm, leg, torso, hip, head or other body part position, relative position and/or orientation) and then used during a video game or instruction lesson. Note that such a video game embodiment may be performed on a non-mobile or non-portable video game platform (e.g., a Microsoft® xBox, Sony® Playstation®, Nintendo® Wii™, etc.).
In some other embodiments, a user may employ one or more wearable bands and/or other biometric sensors in combination with a cellular telephone/HCD or other similar device to collect biometric information during a predetermined time period (e.g., during all or part of a work day, daily, weekly, monthly, etc.) and then employ this information to affect video game play. For example, a user may wear a band (e.g., a wrist band) that measures and transmits pulse or heart rate information to a cellular telephone during the course of a work day. Other information may be collected such as calories consumed. At the end of the work day, the user may analyze the collected data to determine one or more of periods of high stress, calories burned, etc., and/or may use the information to affect video game play (e.g., such as on a train ride back from the office). The cellular phone may also employ this information to determine (1) recommended food choices based on calories consumed or burned, types of food already eaten, etc.; (2) additional types or amounts of exercise the user should perform; or (3) the like.
Any of the above or alternative embodiments may be used alone or in combination to provide “fitness-enhanced” entertainment.
In some embodiments, the system may include a calibration function that allows the user to provide examples to the system of the way the user performs/achieves particular activities, body positions/orientations, and body status information. For example, the mobile device/HCD may instruct the user to lie still for ten second, jog in place for ten seconds, perform ten “jumping jack” exercises, perform ten “squat-thrust” exercises, and then lie still again for ten seconds. While the user executes the five different exercises/activities under the direction of the mobile device (e.g., via voice commands from the mobile device), the system may sense and record data that will allow the system to reliably recognize similar body positions, activities, and body status as well as combinations of data that indicate other body positions, activities, and body status. Along with activities that the system actually “observes” (e.g., senses and records) during normal activity, the example data captured during the calibration function (e.g., during directed resting, jogging, jumping jacks, squat-thrusts, and post-exertion resting) may be used to build a database (e.g., stored on the mobile device) of activities, body positions/orientations, and body status correlated to sensed data so that particular activities (and sequences of activities) may be quickly and reliably be identified. For example, in embodiments where the system includes a GPS and a clock, the activities, status, and locations of a user may be logged throughout a full day or over a period of weeks or years.
In some embodiments, the system may include an authentication function that uses various pieces of sensed information to corroborate the actual performance of activities, body positions/orientations/locations/identity, and body status of the user and to provide a signal that reliable indicates that a particular user has in fact, e.g., performed an activity at a given time and place. The signal from this authentication function may be used and relied upon as proof, for example, that a user performed an exercise (e.g., ran 10 laps at a track in 20 minutes on Aug. 10, 2009) or engaged in an activity (e.g., loaded a truck with heavy items, drove 150 miles, and unloaded the truck all in four hours). For example, the combination of heart rate data indicating the exertions of user, voice identification data indicating the identity of the user, GPS data indicating the locations over time of the user, wearable band proximity and accelerometer data indicating the body position/motion of the user, may all be captured, stored and correlated to authenticate the user's actual performance of a specific activity or set of activities.
In some embodiments, the present invention may include a protocol (e.g., a software protocol implementable and executable on a mobile or other device, including a system in accordance with the present invention) for sensing, collecting, storing, authenticating, and securely reporting a user's actual performance of activities, body positions/orientations/locations/identity, and/or body status of the user. In addition the protocol may include a function (e.g., an application program interface (API)) for requesting authentication of a particular activity or body position/status. In other words, the present invention may include software (e.g., an authentication module) that allows, for example, another program (e.g., a video game application, a medical treatment program, a business workflow tracking program, etc.) to request and receive an indicia (e.g., a signal, an encrypted code, etc.) from the system of the present invention that reliably verifies that a user has engaged in a particular activity or achieved a particular body status. For example, the system 200 of the present invention may provide an interface to a game system (e.g., a video game console, a program running on the mobile device of the system itself, etc.) that (1) rewards the user with enhanced game features and/or (2) allows the user to control the game, based on performance of specific activities, body positions/orientations/locations/identity, and/or body status. The interface may include a set of predefined activities/statuses such that the game may request and receive verification of the activities/statuses by calling the function with any number of various pre-defined parameters such as an identifier of the particular activity/status of interest (e.g., activity ID), the time of the activity/status (e.g., timestamp), a degree of exertion associated with the activity/status (e.g., level, intensity), a rate associated with the activity/status (e.g., pace), an efficiency or performance rating associated with the activity/status, etc.
Further, in some embodiments the interface may provide the game with access to historical information regarding the activities/statuses of the user stored in a historical database. The database may include one or more fields that identify recognized or deduced activities of the user wearing the bands. The activities may be macro or compound activities/statuses that are aggregated combinations or sets of sub-activities and/or sensed data that together corroborate the performance of the compound activities/statues.
An example list of compound activities or macro status information that may be determined/deduced and authenticated using the systems and protocols of the present invention (e.g., an authentication module 406) includes determining that a user is maximally exerting himself (e.g., based on heart rate being greater than a percentage of the user's maximum heart rate, perspiration, body temperature, impact shock level/acceleration/de-acceleration, motion frequency, speed (delta GPS information), breath frequency, breath depth, muscle flexing, blood pressure, pulse oxygen level); user is sleeping; user is relaxed; user is moderately exerting; user is minimally exerting; user is dead; user is unconscious; user is intoxicated; user is in pain; user is in shock; user is experiencing a heart attack (fibrillation); user is aroused; user is experiencing a particular physical sensation or stimulation; user is conscious; user is awake; user is in free fall; user is dizzy; user is X % exhausted; user is at physical failure; user is hot/cold; user is dehydrated (e.g., based on electrical measurement of user's body relative water content); user blood sugar level is high/low (e.g., based on an automated blood test); user insulin level is high/low; user is hungry/thirsty; user is laughing; user is suffocating; user is asphyxiating (e.g., based on blood oxygen level measurement); user is overweight; user is out of shape; user is fit; user is under-weight; user is tense; user is nervous; user is angry; user is lying; user is being tickled; user is sneezing; user is depressed; user is happy; user is confused; user is afraid; user is running at X % maximum speed; user is walking at X % maximum speed; user is dancing; user is swimming; user is skipping; user is jumping; user is punching (with left/right) (jab/cross/hook/upper cut/8 point blocking); user is kicking (left/right) (front/side/round house/back); user is rowing; user is prone (front/back); user is kneeling/sitting/standing; user is throwing (left/right); user is balancing; user is dribbling a ball; user is cradling a lacrosse stick; user is cradling a baby; user is eating/drinking; user is crying; user is driving; user is swinging a bat/tennis racket/golf club/lacrosse stick; user is typing; user is thinking; user is talking, and the like. These activities may be stored in a database of activities 408 that associates each of the activities with stored patterns of biometric information.
Further, in some embodiments the interface may provide real time access to the current activities/statues of the user. For example, the system of the present invention may provide a stream of data reporting actual sensed data and/or recognized activities that are deduced from and corroborated by the sensed data. The stream of recognized activities delivered by the interface may be encoded or even encrypted so that the game (or other application requesting the information) can have a high degree of confidence that the activities/statuses are authentic. Thus, the game (or other application requesting the information) can reasonably decide to transfer value based on the authenticated information. For example, a valuable contest prize can be awarded to the winner of a game that relies on the protocol of the present invention to verify that the winner in fact performed the required activities to win the game. Likewise, an employer can allow a workflow program running on a host system to decide to pay an employee for performing a task (e.g., load and drive a truck) by using the systems and protocols of the present invention to verify timely and efficient performance of the task.
Turning to
Turning to
Accordingly, while the present invention has been disclosed in connection with the exemplary embodiments thereof, it should be understood that other embodiments may fall within the spirit and scope of the invention, as defined by the following claims.
This application is a continuation of and claims priority to U.S. patent application Ser. No. 15/591,084, filed May 9, 2017, and titled “SYSTEMS AND METHODS FOR PROVIDING BIOFEEDBACK INFORMATION TO A CELLULAR TELEPHONE AND FOR USING SUCH INFORMATION” (Attorney Docket No. PEXS002/C02), which is a continuation of and claims priority to U.S. patent application Ser. No. 14/619,061, filed Feb. 10, 2015, and titled “SYSTEMS AND METHODS FOR PROVIDING BIOFEEDBACK INFORMATION TO A CELLULAR TELEPHONE AND FOR USING SUCH INFORMATION” (Attorney Docket No. PEXS002/C01), now U.S. Pat. No. 9,675,875, which is a continuation of and claims priority to U.S. patent application Ser. No. 12/538,862, filed Aug. 10, 2009, and titled “SYSTEMS AND METHODS FOR PROVIDING BIOFEEDBACK INFORMATION TO A CELLULAR TELEPHONE AND FOR USING SUCH INFORMATION” (Attorney Docket No. PEXS002), now U.S. Pat. No. 8,976,007, which claims priority to U.S. Provisional Patent Application No. 61/087,698, filed Aug. 9, 2008 and entitled “SYSTEMS AND METHODS FOR PROVIDING BIOFEEDBACK INFORMATION TO A CELLULAR TELEPHONE AND FOR USING SUCH INFORMATION” (Attorney Docket No. PEXS002/L) and which is a continuation-in-part of and claims priority to U.S. patent application Ser. No. 12/426,193, filed Apr. 17, 2009 and entitled “SYSTEMS AND METHODS FOR PROVIDING AUTHENTICATED BIOFEEDBACK INFORMATION TO A MOBILE DEVICE AND FOR USING SUCH INFORMATION” (Attorney Docket No. PEXS001), which claims priority to U.S. Provisional Patent Application No. 61/045,955, filed Apr. 17, 2008 (Attorney Docket No. PEXS001/L). All of the above applications are hereby incorporated by reference herein in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61087698 | Aug 2008 | US | |
| 61045955 | Apr 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15591084 | May 2017 | US |
| Child | 16141967 | US | |
| Parent | 14619061 | Feb 2015 | US |
| Child | 15591084 | US | |
| Parent | 12538862 | Aug 2009 | US |
| Child | 14619061 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12426193 | Apr 2009 | US |
| Child | 12538862 | US |
