The present invention relates to electronic devices and accessories having integrated sensors for tracking a user's performance metrics.
An increasing number of people are exercising to the beat of their favorite songs. Often, the songs are stored on a portable media player strapped to a user's arm so that the user would not need to carry the portable media player during the workout. Audio signals can be transmitted from the portable media player to the user's ear using a set of headphones.
During the workout, the user may want to monitor his performance metrics, e.g., the distance the user has covered during a jog and/or the user's heart rate. Conventionally, this can require the user to attach additional electronic devices to his body or clothing. For example, to monitor the distance a user has jogged, the user may clip a pedometer to his clothing. To obtain information about the user's heart rate, the user may strap a heart rate sensor to his chest and a receiver for receiving data from the heart rate sensor to his wrist. Disadvantageously, the user can become very uncomfortable during his fitness routine due to the number of devices the user has attached to his body and clothing.
The present invention can include systems and methods for integrating sensors for tracking a user's performance metrics into electronic devices and accessories therefor. In one embodiment of the present invention, the electronic devices can include portable media devices similar to iPods™ sold by Apple Inc. of Cupertino, Calif. or cellular telephones similar to iPhones™ designed by Apple Inc.
In one embodiment, the present invention can include headsets having one or more integrated physiological sensors. The headsets can be, for example, headphones for receiving audio signals from a media device or headsets for communication with cellular telephones. The sensor signals can be transmitted to a data repository through the same communication channel through which audio signals are transmitted to the headset (e.g., hard-wired or wireless).
In one embodiment, the present invention can include a sling having one or more integrated physiological sensors. The sling can have an enclosure within which a portable electronic device can be disposed. The sling also can have a strap for securing the sling and the portable electronic device to the user's body or clothing. In one embodiment of the present invention, the sling can have an integrated connector configured to be operatively coupled to a complementary connector in the portable electronic device. The sensor signals can be transmitted from the sling to the portable electronic device via these connectors. Alternatively, the sensor signals can be transmitted via wireless communication protocols.
In one embodiment, the present invention can include a portable media device having one or more integrated physiological sensors. The physiological sensors can (1) be exposed through the housing of the portable media device, or (2) be hidden from view and undetectable by the user. A sling for securing such a portable electronic device to the user's body also is provided by the present invention.
In one embodiment of the present invention, an electronic device can accept data from one or more physiological sensors, along with data from one or more other sensors that track the user's movements. The movement sensors can be disposed within the electronic device itself or attached to or incorporated within the user's body or clothing (e.g., a movement sensor similar to the sensor from the Nike+iPod Sport Kit sold by Apple Inc. and Nike Inc. of Beaverton, Oreg.). The electronic device can be configured to condition the data from the physiological sensors using the data from the movement sensors. For example, because the physiological sensor may contain anomalies due to the user's movements, the electronic device can identify the anomalies based on data indicative of the user's movements and thereafter remove or filter out their effects.
The above and other advantages of the present invention will be apparent upon consideration of the following detailed description, taken in conjunction with accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
So, if a user wants to listen to be entertained, e.g., by audio tracks stored on portable media device 102 and simultaneously monitor his performance metrics during a workout, the user would need to strap his portable media player onto his arm, a heart rate sensor to his chest, and a receiver to his wrist. Unfortunately, due to the numerous electronic devices strapped to the user, the user may experience considerable discomfort.
The present invention can include systems and methods for integrating sensors for tracking a users performance metrics into media devices and accessories therefor, thereby reducing or eliminating the need for additional independent monitoring devices. Advantageously, such integration of sensors can be desirable because it requires no additional effort by the user to use them. As used herein, performance metrics can include physiological metrics (e.g., heart rate, EKG, blood oxygen content, temperature, heat flux, etc.) and non-physiological indications of performance (e.g., distance covered, pace, etc.).
In one embodiment of the present invention, earbud 202 also can be equipped with one or more physiological sensors 218. For example, sensors 218 can include one or more infrared photodetectors for tracking the user's temperature, heat flux, and heart rate. From infrared radiation in the user's ear, sensors 218 can detect minute temperature variations due to the user's heart beats. Heart rate can be calculated based on the time between beats and the user's temperature can be set as the “DC component” (or average or median value) of the detected temperature distribution. Other sensors also can be used for tracking the same physiological metrics or different physiological metrics. In one embodiment of the present invention, one sensor 218 can be centered with respect to acoustical aperture 212 to ensure that the sensor receives a sufficient infrared signal regardless of how the user positions earbud 202 in the user's ear. Alternatively, speaker 210 can be centered with respect to acoustical aperture 212 and two or more of the same sensors 218 can be positioned around the periphery of speaker 210. This can increase the likelihood that at least one sensor 218 can obtain a sufficient infrared signal regardless of how the user positions earbud 202 in the user's ear.
Sensors 218 can send data signals to a signal processor. The signal processor can be disposed in earbud 202, in an electronic device from which the earbud receives audio signals, and/or in an adapter configured for coupling to the electronic device. Illustrative embodiments of an electronic device and adapter are described in greater detail herein.
In accordance with one aspect of the present invention, earbud 202 can be incorporated into a wired or wireless headset that receives and/or transmits audio signals. For example, if the electronic device with which the headset communicates is a telephone, the headset also can be equipped with a microphone. The telephone can be based on any one of the following networks: public switched telephone network (PSTN), cellular, voice over internet protocol (VoIP), any other telephone network, or any combination thereof. Each earbud in the headset can have sensors 218 or only one of the earbuds can have sensors 218.
Light source 312 can be disposed within clip portion 308a or 308b, and photodetector 314 can be disposed within the other clip portion. Clip portions 308a and 308b can have apertures through which light can be transmitted and received by light source 312 and photodetector 314, respectively. Alternatively, clip portions 308a and 308b can be made at least partially of a transmissive material through which the light can pass.
In one embodiment of the present invention, light source 312 and photodetector 314 can be used to track a user's blood oxygen content and heart-rate. For example, light source 312 can include two light emitting diodes that provide light at two different wavelengths. Photodetector 314 can detect the portion of such light that passes through the user's earlobe, the remaining light having been absorbed by the blood within the user's earlobe. From the relative absorption of these two wavelengths of light, the user's blood oxygen content can be calculated. The user's heart beat also can be determined based on the photodetector signal since the signal may bounce in time with the user's heart beat due to the expansion and contraction of arterial blood vessels. In an alternative embodiment, both light source 312 and photodetector 314 can be disposed in either clip portion 308a or 308b and operate as a reflectance pulse oximeter.
Light source 312 can receive signals from and photodetector 314 can send data signals to a controller that controls the light source and photodetector and processes signals sent thereto or received therefrom. The controller can be disposed in earbud 302, in an electronic device from which the earbud receives audio signals, and/or in an adapter configured for coupling to the electronic device.
In accordance with an alternative embodiment of the present invention, electrical contacts (not shown) also can be disposed within clip portion 308a and/or 308b, in addition to or instead of light source 312 and photodetector 314. Electrical contacts can include contacts for detecting, e.g., temperature, heat flux, EKG waveforms, heart rate, any other suitable physiological metric, or any combination thereof. For example, to detect EKG waveforms, each earbud of a headset can be equipped with electrical contacts. The placement of the electrical contacts in both the left and right hemispheres of the user body and the resulting distance between electrical contacts can permit the present invention to detect greater voltage differences, and thus more accurate EKG data. The user's heart rate can be extracted from the EKG waveforms, although, in some embodiments of the present invention, heart rate can be determined without detecting EKG waveforms.
To promote contact between sensor 410 and the user's skin, the sensor can be partially or fully encased in a material that causes it to be removably attached to the user's skin. For example, sensor 410 can be encased in a material that is attracted to the ionic charges on the user's skin.
Portable electronic device 412 can have housing 414 within which is disposed display 416, user input component 418, memory 420, antenna(s) 421, controller 422, sensors 424, audio connector receptacle 426, and connector 428.
User input component 418 can permit a user to interact with the electronic device. User input component 418 can include a clickwheel similar to that incorporated in some models of iPods™. The clickwheel can include one or more buttons and a touchpad. The touchpad can permit a user to scroll by running the user's finger around the track of the clickwheel. In alternative embodiments, user input component 418 can include, for example, one or more buttons, a touchpad, a touchscreen display, electronics for accepting voice commands, antennas for accepting signals from other electronic devices, infrared ports for accepting signals from other electronic devices, or any combination thereof. In one embodiment of the present invention, display 416 and user input 418 can be integrated into one component by using a touchscreen display.
Memory 420 can store sensor data generated by sensor 410, sensor(s) 424, and/or any other sensor used for tracking a user's performance metrics. Memory 420 can include read only memory, random access memory, solid-state memory, buffer memory, hard drive memory, any other memory known in the art or otherwise, or any combination thereof.
In one embodiment of the present invention, memory 420 also can store media files for playback by electronic device 412. Media files can include, for example, audio files for playback through speakers (e.g., headset 402) and/or graphic images for playback on a display (e.g., display 416). The media files can include media files that a user has selected to be played back during performance of an activity to entertain and motivate the user. Such media files can include, for example, songs, audio books, multimedia presentations, still images, text, podcasts, videos, etc.
Electronic device 412 can have one or more antennas 421 for wirelessly communicating with a data network and/or with one or more accessories (e.g., any of the headsets described herein). For example, the electronic device can include one or more antennas for communication with Bluetooth-enabled devices, WiFi network, cellular network, radio network, or any combination thereof. In one embodiment of the present invention, antenna(s) 421 can permit a user to stream or otherwise download audio and/or visual media to entertain and motivate the user during performance of an activity. For example, the user may choose to stream internet radio or a podcast through a WiFi network. If electronic device 412 is a cellular telephone, the user may choose to have a telephone conversation with another person by connecting to a cellular network.
Controller 422 can, for example, control operation of electronic device 412, generate audio signals for transmission to a headset, instruct audio signals to be transmitted to a headset, generate control signals for any of the sensors described herein, and/or accept data signals from any of the sensors described herein. Controller 422 can include one or more processors, ASICS, circuits, or any combination thereof.
Display 416 can provide graphics (e.g., text, still images, and/or videos) to the user. In one embodiment of the present invention, display 416 can provide the user with graphics about the user's performance metrics. Display 416 also can provide entertainment graphics from media files stored in memory 420 or downloaded from a data network via antenna(s) 421. In one embodiment of the present invention, controller 422 can instruct display 416 to display graphics about the user's performance metrics and entertainment graphics simultaneously. Advantageously, this permits a user to monitor his performance metrics while simultaneously be entertained during his workout.
Sensors 424 can incorporate sensors described in greater detail with respect to
Data from sensors 424 and any other sensor for tracking performance metrics can be transmitted to signal processing module 430 of controller 422 for signal processing. For example, signal processing module 430 can incorporate digital circuitry, analog circuitry, and/or software for amplifying and filtering the sensor data.
Audio connector receptacle 426 can be configured to accept audio connector 408 of headset 402. In one embodiment of the present invention, audio connector 408 and receptacle 426 can transmit control signals to and accept data from sensors integrated with headset via a dedicated electrical lead in audio connector 408. Alternatively, the control signals and sensor data can be interleaved with other signals using, e.g., a serial interface protocol.
In a further alternative embodiment, the control signals and sensor data can be transmitted through connector 428, as illustratively described in greater detail with respect to
In one embodiment of the present invention, controller 422 can generate audio signals related to the user's performance metrics. These audio signals can be intermixed with audio signals from entertainment media files stored in memory 420 or audio signals downloaded by the user from data networks (e.g., the internet or radio broadcast).
In one embodiment of the present invention, electronic device 412 can be an iPod™ or an iPhone™. Electronic device 412 also can be any electronic device suitable for processing signals from sensors that track a user's performance metrics during physical activity. For example, the electronic device can be any portable, mobile, hand-held, or miniature consumer electronic device. Illustrative electronic devices can include, but are not limited to, music players, video players, still image players, game players, other media players, music recorders, video recorders, cameras, other media recorders, radios, medical equipment, calculators, cellular phones, other wireless communication devices, personal digital assistants, programmable remote controls, pagers, laptop computers, printers, or any combination thereof. Miniature electronic devices may have a form factor that is smaller than that of hand-held devices. Illustrative miniature electronic devices can include, but are not limited to, watches, rings, necklaces, belts, accessories for belts, headsets, accessories for shoes, virtual reality devices, other wearable electronics, accessories for sporting equipment, accessories for fitness equipment, key chains, or any combination thereof.
While electronic device 412 is illustratively shown in operation with headset 402 in
In one embodiment of the present invention, adapter 506 can incorporate signal processing module 508 for processing signals from sensors integrated with headset 502, in contrast to the embodiment of
In one embodiment of the present invention, armband 602 can be equipped with one or more integrated sensors 608 for tracking the physiological metrics of the user. Sensors 608 can be integrated into, e.g., a back wall of enclosure 604 or within strap 606. When armband 602 is strapped onto a user's arm, the sensors can be positioned in close proximity to or in contact with the user's skin.
One or more sensors 608 can be electrical contacts for tracking, e.g., a user's EKG waveforms, heart rate, temperature, and/or heat flux. The electrical contacts can be exposed to the external environment or obtain physiological signals through material that is conducive to electrical and/or thermal conduction. For example, one or more sensors 608 can include electrical contacts similar to those described above with respect to
One or more sensors 608 also can include an optical sensor system for tracking, e.g., the user's oxygen content, heart rate, temperature, and/or heat flux. The optical sensor system can transmit and/or receive light through an aperture in a wall of the armband or through a light-transmissive material. For example, one or more sensors 608 can include a light source and photodetector similar to those described above with respect to
To transmit sensor data to an electronic device for additional processing, analysis, and/or storage, armband 602 can have an integrated connector 610 (as shown in the cut-away view of
In alternative embodiments of the present invention, sensors 608 and connector 610 also can be integrated in other types of slings. For example, the sensors and connector also can be integrated into leg-bands and chest-bands.
Electronic device 702 also can have additional electronic components similar to those described with respect to electronic device 412 of
In one embodiment of the present invention, adapter 812 having wireless communication module 814 can be provided to facilitate wireless communication between electronic device 802 and one or more accessories therefor (e.g., headset 804, sensor 810, and/or armband 806). For example, adapter 812 can be configured to communicate with headset 804 using the Bluetooth protocol and with sensor 810 using another radio-frequency wireless communication protocol.
Adapter 812 also permits electronic device 802 to receive sensor data from multiple sensors for tracking performance metrics, including, e.g., sensor(s) in headset 804 and sensor 810. Upon receipt, the sensor data can be routed to signal processing module 816 disposed within adapter 818 or within electronic device 802. The signals can be transmitted via connector 818 and a complementary connector in electronic device 802 to a controller within the electronic device for additional conditioning, analysis, or storage. Adapter 812 also can transmit audio and control signals generated by electronic device 802 to accessories, e.g., headset 804.
In an alternative embodiment of the present invention, one or more components of adapter 812 can be disposed within electronic device 802. For example, adapter 812 can be eliminated by equipping electronic device 802 with all of the components disposed in adapter 812. Thus, electronic device 802 can wirelessly communicate with headset 804, sensor 810, and/or armband 806 directly. Electronic device 802 also can be configured to communicate directly with multiple accessories and data sources (without use of adapter 812) using a combination of hard-wired and wireless connections.
Electronic device 802 also can be configured to communicate with multiple accessories and data sources using only hard-wired connections, either indirectly (e.g., through an adapter) or directly (e.g., without an adapter). For example, a hard-wired adapter can have multiple receptacles and a multiplexer for facilitating receipt of data from multiple sources. The hard-wired adapter can communicate with electronic device 802 using a connector similar to connector 818.
Advantageously, by being able to accept sensor data from multiple sources, the electronic devices of the present invention can correlate data from the multiple sources, analyze each data set with respect to one or more other data sets, and provide the user with a more comprehensive picture of the user's workout. For example, in one embodiment of the present invention, an electronic device of the present invention can be configured to condition the data from one or more physiological sensors using data indicative of the user's movements (e.g., from sensor 810).
Although particular embodiments of the present invention have been described above in detail, it will be understood that this description is merely for purposes of illustration. Alternative embodiments of those described hereinabove also are within the scope of the present invention.
Combinations of the above-described embodiments of the present invention or portions thereof may be provided in one system without departing from the scope of the present invention. For example, earbuds 202 and 302 of FIGS. 2 and 3A-3B can be combined with sensor 410 of
While the description herein may focus on particular sensors for tracking a user's performance metrics, the present invention can employ any type of sensors, including, e.g., pedometers, accelerometers, pressure sensitive sensors, strain sensors, contact switches, heart rate monitors, oximeters, location-tracking (e.g., GPS) sensors, temperature sensors, heat flux sensors, electrocardiogram sensors, scales, glucometers, any other suitable sensor useful for capturing data about a person's performance metrics, or any combination thereof. Any of the physiological sensors described herein with respect to
While the description herein may focus on the use of the present invention in tracking a user's performance metrics during a workout, the present invention also can be used to track a user's performance metrics during any other physical or mental activity. For example, the present invention can be used to monitor how a user's heart rate, EKG waveforms, temperature, and blood oxygen levels respond to stress, e.g., when the user is taking an exam.
The above described embodiments of the present invention are presented for purposes of illustration and not of limitation, and the present invention is limited only by the claims which follow.
This is related to: U.S. Provisional Patent Application No. 60/846,414 to Gilley et al., filed on Sep. 21, 2006 (referred to herein as “the incorporated provisional patent application”), the entirety of which is incorporated herein by reference; U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “LIFESTYLE COMPANION SYSTEM,” Attorney Docket No. 104677-0019-101/P4725US1 (referred to herein as “the incorporated LIFESTYLE COMPANION document”), the entirety of which is incorporated herein by reference; U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METHODS FOR PROVIDING AUDIO AND VISUAL CUES VIA A PORTABLE ELECTRONIC DEVICE,” Attorney Docket No. 104677-0019-102/P4725US2 (referred to herein as “the incorporated AUDIO AND VISUAL CUES document”), the entirety of which is incorporated herein by reference; U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “DYNAMICALLY ADAPTIVE SCHEDULING SYSTEM,” Attorney Docket No. 104677-0019-103/P4725US3 (referred to herein as “the incorporated ADAPTIVE SCHEDULING SYSTEM document”), the entirety of which is incorporated herein by reference; U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “SYSTEMS AND METHODS FOR FACILITATING GROUP ACTIVITIES,” Attorney Docket No. 104677-0019-104/P4725US4 (referred to herein as “the incorporated GROUP ACTIVITIES document”), the entirety of which is incorporated herein by reference; U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “VARIABLE I/O INTERFACE FOR PORTABLE MEDIA DEVICE,” Attorney Docket No. 104677-0025-101/P4732US1 (referred to herein as “the incorporated VARIABLE I/O document”), the entirety of which is incorporated herein by reference; and U.S. patent application Ser. No. ______ to Gilley et al., filed on Mar. 27, 2007, entitled “REWARDS SYSTEMS,” Attorney Docket No. 104677-0022-101/P4727US1 (referred to herein as “the incorporated REWARDS SYSTEMS document”), the entirety of which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | 11729075 | Mar 2007 | US |
Child | 12507993 | US |