The present invention relates generally to electrical and electronic hardware, computer software, wired and wireless network communications, and computing devices. More specifically, techniques for a data-capable strapband are described.
With the advent of greater computing capabilities in smaller personal and/or portable form factors and an increasing number of applications (i.e., computer and Internet software or programs) for different uses, consumers (i.e., users) have access to large amounts of personal data. Information and data are often readily available, but poorly captured using conventional data capture devices. Conventional devices typically lack capabilities that can capture, analyze, communicate, or use data in a contextually-meaningful, comprehensive, and efficient manner. Further, conventional solutions are often limited to specific individual purposes or uses, demanding that users invest in multiple devices in order to perform different activities (e.g., a sports watch for tracking time and distance, a GPS receiver for monitoring a hike or run, a cyclometer for gathering cycling data, and others). Although a wide range of data and information is available, conventional devices and applications fail to provide effective solutions that comprehensively capture data for a given user across numerous disparate activities.
Some conventional solutions combine a small number of discrete functions. Functionality for data capture, processing, storage, or communication in conventional devices such as a watch or timer with a heart rate monitor or global positioning system (“GPS”) receiver are available conventionally, but are expensive to manufacture and purchase. Other conventional solutions for combining personal data capture facilities often present numerous design and manufacturing problems such as size restrictions, specialized materials requirements, lowered tolerances for defects such as pits or holes in coverings for water-resistant or waterproof devices, unreliability, higher failure rates, increased manufacturing time, and expense. Subsequently, conventional devices such as fitness watches, heart rate monitors, GPS-enabled fitness monitors, health monitors (e.g., diabetic blood sugar testing units), digital voice recorders, pedometers, altimeters, and other conventional personal data capture devices are generally manufactured for conditions that occur in a single or small groupings of activities.
Generally, if the number of activities performed by conventional personal data capture devices increases, there is a corresponding rise in design and manufacturing requirements that results in significant consumer expense, which eventually becomes prohibitive to both investment and commercialization. Further, conventional manufacturing techniques are often limited and ineffective at meeting increased requirements to protect sensitive hardware, circuitry, and other components that are susceptible to damage, but which are required to perform various personal data capture activities. As a conventional example, sensitive electronic components such as printed circuit board assemblies (“PCBA”), sensors, and computer memory (hereafter “memory”) can be significantly damaged or destroyed during manufacturing processes where overmoldings or layering of protective material occurs using techniques such as injection molding, cold molding, and others. Damaged or destroyed items subsequently raises the cost of goods sold and can deter not only investment and commercialization, but also innovation in data capture and analysis technologies, which are highly compelling fields of opportunity.
Thus, what is needed is a solution for data capture devices without the limitations of conventional techniques.
Various embodiments or examples (“examples”) are disclosed in the following detailed description and the accompanying drawings:
Various embodiments or examples may be implemented in numerous ways, including as a system, a process, an apparatus, a user interface, or a series of program instructions on a computer readable medium such as a computer readable storage medium or a computer network where the program instructions are sent over optical, electronic, or wireless communication links. In general, operations of disclosed processes may be performed in an arbitrary order, unless otherwise provided in the claims.
A detailed description of one or more examples is provided below along with accompanying figures. The detailed description is provided in connection with such examples, but is not limited to any particular example. The scope is limited only by the claims and numerous alternatives, modifications, and equivalents are encompassed. Numerous specific details are set forth in the following description in order to provide a thorough understanding. These details are provided for the purpose of example and the described techniques may be practiced according to the claims without some or all of these specific details. For clarity, technical material that is known in the technical fields related to the examples has not been described in detail to avoid unnecessarily obscuring the description.
As described above, bands 104-112 may be implemented as wearable personal data or data capture devices (e.g., data-capable devices) that are worn by a user around a wrist, ankle, arm, or other appendage. One or more facilities, sensing elements, or sensors, both active and passive, may be implemented as part of bands 104-112 in order to capture various types of data from different sources. Temperature, environmental, temporal, motion, electronic, electrical, chemical, or other types of sensors (including those described below in connection with
Using data gathered by bands 104-112, applications may be used to perform various analyses and evaluations that can generate information as to a person's physical (e.g., healthy, sick, weakened, or other states), emotional, or mental state (e.g., an elevated body temperature or heart rate may indicate stress, a lowered heart rate and skin temperature may indicate physiological depression caused by exertion or other factors, chemical data gathered from evaluating outgassing from the skin's surface may be analyzed to determine whether a person's diet is balanced or if various nutrients are lacking, salinity detectors may be evaluated to determine if high, lower, or proper blood sugar levels are present for diabetes management, and others). Generally, bands 104-112 may be configured to gather from sensors locally and remotely.
As an example, band 104 may capture (i.e., record, store, communicate (i.e., send or receive), process, or the like) data from various sources (i.e., sensors that are organic (i.e., installed, integrated, or otherwise implemented with band 104) or distributed (e.g., microphones on mobile computing device 115, mobile communications device 118, computer 120, laptop 122, distributed sensor 124, global positioning system (“GPS”) satellites, or others, without limitation)) and exchange data with one or more of bands 106-112, server 114, mobile computing device 115, mobile communications device 118, computer 120, laptop 122, and distributed sensor 124. As shown here, a local sensor may be one that is incorporated, integrated, or otherwise implemented with bands 104-112. A remote or distributed sensor (e.g., mobile computing device 115, mobile communications device 118, computer 120, laptop 122, or, generally, distributed sensor 124) may be sensors that can be accessed, controlled, or otherwise used by bands 104-112. For example, band 112 may be configured to control devices that are also controlled by a given user (e.g., mobile computing device 115, mobile communications device 118, computer 120, laptop 122, and distributed sensor 124). For example, a microphone in mobile communications device 118 may be used to detect, for example, ambient audio data that is used to help identify a person's location. Additionally, a sensor implemented with a screen on mobile computing device 115 may be used to read a user's temperature or obtain a biometric signature while a user is interacting with data. A further example may include using data that is observed on computer 120 or laptop 122 that provides information as to a user's online behavior and the type of content that she is viewing, which may be used by bands 104-112. Regardless of the type or location of sensor used, data may be transferred to bands 104-112 by using, for example, an analog audio jack, digital adapter (e.g., USB, mini-USB), or other, without limitation, plug, or other type of connector that may be used to physically couple bands 104-112 to another device or system for transferring data and, in some examples, to provide power to recharge a battery (not shown). Alternatively, a wireless data communication interface or facility (e.g., a wireless radio that is configured to communicate data from bands 104-112 using one or more data communication protocols (e.g., IEEE 802.11a/b/g/n, WiFi, WiMax, ANT™, ZigBee, Bluetooth, Near Field Communications (“NFC”), and others)) may be used to receive or transfer data. Further, bands 104-112 may be configured to analyze, evaluate, modify, or otherwise use data gathered, either directly or indirectly.
In some examples, bands 104-112 may be configured to share data with each other or with an intermediary facility, such as a database, website, web service, or the like, which may be implemented by server 114. In some embodiments, server 114 can be operated by a third party providing, for example, social media-related services. Bands 104-112 and other related devices may exchange data with each other directly, or bands 104-112 may exchange data via a third party server, such as a third party like Facebook™, to provide social-media related services. Examples of third party servers include servers for social networking services, including, but not limited to, services such as Facebook™, Yahoo! IM™, GTalk™, MSN Messenger™, Twitter™ and other private or public social networks. The exchanged data may include personal 20 physiological data and data derived from sensory-based user interfaces (“UI”). Server 114, in some examples, may be implemented using one or more processor-based computing devices or networks, including computing clouds, storage area networks (“SAN”), or the like. As shown, bands 104-112 may be used as a personal data or area network (e.g., “PDN” or “PAN”) in which data relevant to a given user or band (e.g., one or more of bands 104-112) may be shared. As shown here, bands 104 and 112 may be configured to exchange data with each other over network 102 or indirectly using server 114. Users of bands 104 and 112 may direct a web browser hosted on a computer (e.g., computer 120, laptop 122, or the like) in order to access, view, modify, or perform other operations with data captured by bands 104 and 112. For example, two runners using bands 104 and 112 may be geographically remote (e.g., users are not geographically in close proximity locally such that bands being used by each user are in direct data communication), but wish to share data regarding their race times (pre, post, or in-race), personal records (i.e., “PR”), target split times, results, performance characteristics (e.g., target heart rate, target VO2 max, and others), and other information. If both runners (i.e., bands 104 and 112) are engaged in a race on the same day, data can be gathered for comparative analysis and other uses. Further, data can be shared in substantially real-time (taking into account any latencies incurred by data transfer rates, network topologies, or other data network factors) as well as uploaded after a given activity or event has been performed. In other words, data can be captured by the user as it is worn and configured to transfer data using, for example, a wireless network connection (e.g., a wireless network interface card, wireless local area network (“LAN”) card, or the like. Data may also be shared in a temporally asynchronous manner in which a wired data connection (e.g., an analog audio plug (and associated software or firmware) configured to transfer digitally encoded data to encoded audio data that may be transferred between bands 104-112 and a plug configured to receive, encode/decode, and process data exchanged) may be used to transfer data from one or more bands 104-112 to various destinations (e.g., another of bands 104-112, server 114, mobile computing device 115, mobile communications device 118, computer 120, laptop 122, and distributed sensor 124). Bands 104-112 may be implemented with various types of wired and/or wireless communication facilities and are not intended to be limited to any specific technology. For example, data may be transferred from bands 104-112 using an analog audio plug (e.g., TRRS, TRS, or others). In other examples, wireless communication facilities using various types of data communication protocols (e.g., Bluetooth™, ZigBee, ANT, and others) may be implemented as part of bands 104-112, which may include circuitry, firmware, hardware, radios, antennas, processors, microprocessors, memories, or other electrical, electronic, mechanical, or physical elements configured to enable data communication capabilities of various types and characteristics.
As data-capable devices, bands 104-112 may be configured to collect data from a wide range of sources, including onboard (not shown) and distributed sensors (e.g., server 114, mobile computing device 115, mobile communications device 118, computer 120, laptop 122, and distributed sensor 124) or other bands. Some or all data captured may be personal, sensitive, or confidential and various techniques for providing secure storage and access may be implemented. For example, various types of security protocols and algorithms may be used to encode data stored or accessed by bands 104-112. Examples of security protocols and algorithms include authentication, encryption, encoding, private and public key infrastructure, passwords, checksums, hash codes and hash functions (e.g., SHA, SHA-1, MD-5, and the like), or others may be used to prevent undesired access to data captured by bands 104-112. In other examples, data security for bands 104-112 may be implemented differently.
Bands 104-112 may be used as personal wearable, data capture devices that, when worn, are configured to identify a specific, individual user. By evaluating captured data such as motion data from an accelerometer and using analysis techniques, both long and short-term (e.g., software packages or modules of any type, without limitation), a user may have a unique pattern of behavior or motion that can be used as a signature for identification. For example, bands 104-112 may gather data regarding an individual person's gait or other unique physiological or behavioral characteristics. Using, for example, distributed sensor 124, a biometric signature (e.g., fingerprint, retinal or iris vascular pattern, or others) may be gathered and transmitted to bands 104-112 that, when combined with other data, determines that a given user has been properly identified and, as such, authenticated. When bands 104-112 are worn, a user may be identified and authenticated to enable a variety of other functions such as accessing or modifying data, enabling wired or wireless data transmission facilities (i.e., allowing the transfer of data from bands 104-112), modifying functionality or functions of bands 104-112, authenticating financial transactions using stored data and information (e.g., credit card, PIN, card security numbers, and the like), running applications that allow for various operations to be performed (e.g., controlling physical security and access by transmitting a security code to a reader that, when authenticated, unlocks a door by turning off current to an electromagnetic lock, and others), and others. Different functions and operations beyond those described may be performed using bands 104-112, which can act as secure, personal, wearable, data-capable devices. The number, type, function, configuration, specifications, structure, or other features of system 100 and the above-described elements may be varied and are not limited to the examples provided.
In some examples, memory 206 may be implemented using various types of data storage technologies and standards, including, without limitation, read-only memory (“ROM”), random access memory (“RAM”), dynamic random access memory (“DRAM”), static random access memory (“SRAM”), static/dynamic random access memory (“SDRAM”), magnetic random access memory (“MRAM”), solid state, two and three-dimensional memories, Flash®, and others. Memory 206 may also be implemented using one or more partitions that are configured for multiple types of data storage technologies to allow for non-modifiable (i.e., by a user) software to be installed (e.g., firmware installed on ROM) while also providing for storage of captured data and applications using, for example, RAM. Once captured and/or stored in memory 206, data may be subjected to various operations performed by other elements of band 200.
Vibration source 208, in some examples, may be implemented as a motor or other mechanical structure that functions to provide vibratory energy that is communicated through band 200. As an example, an application stored on memory 206 may be configured to monitor a clock signal from processor 204 in order to provide timekeeping functions to band 200. If an alarm is set for a desired time, vibration source 208 may be used to vibrate when the desired time occurs. As another example, vibration source 208 may be coupled to a framework (not shown) or other structure that is used to translate or communicate vibratory energy throughout the physical structure of band 200. In other examples, vibration source 208 may be implemented differently.
Power may be stored in battery 214, which may be implemented as a battery, battery module, power management module, or the like. Power may also be gathered from local power sources such as solar panels, thermo-electric generators, and kinetic energy generators, among others that are alternatives power sources to external power for a battery. These additional sources can either power the system directly or can charge a battery, which, in turn, is used to power the system (e.g., of a strapband). In other words, battery 214 may include a rechargeable, expendable, replaceable, or other type of battery, but also circuitry, hardware, or software that may be used in connection with in lieu of processor 204 in order to provide power management, charge/recharging, sleep, or other functions. Further, battery 214 may be implemented using various types of battery technologies, including Lithium Ion (“LI”), Nickel Metal Hydride (“NiMH”), or others, without limitation. Power drawn as electrical current may be distributed from battery via bus 202, the latter of which may be implemented as deposited or formed circuitry or using other forms of circuits or cabling, including flexible circuitry. Electrical current distributed from battery 204 and managed by processor 204 may be used by one or more of memory 206, vibration source 208, accelerometer 210, sensor 212, or communications facility 216.
As shown, various sensors may be used as input sources for data captured by band 200. For example, accelerometer 210 may be used to gather data measured across one, two, or three axes of motion. In addition to accelerometer 210, other sensors (i.e., sensor 212) may be implemented to provide temperature, environmental, physical, chemical, electrical, or other types of sensed inputs. As presented here, sensor 212 may include one or multiple sensors and is not intended to be limiting as to the quantity or type of sensor implemented. Data captured by band 200 using accelerometer 210 and sensor 212 or data requested from another source (i.e., outside of band 200) may also be exchanged, transferred, or otherwise communicated using communications facility 216. As used herein, “facility” refers to any, some, or all of the features and structures that are used to implement a given set of functions. For example, communications facility 216 may include a wireless radio, control circuit or logic, antenna, transceiver, receiver, transmitter, resistors, diodes, transistors, or other elements that are used to transmit and receive data from band 200. In some examples, communications facility 216 may be implemented to provide a “wired” data communication capability such as an analog or digital attachment, plug, jack, or the like to allow for data to be transferred. In other examples, communications facility 216 may be implemented to provide a wireless data communication capability to transmit digitally encoded data across one or more frequencies using various types of data communication protocols, without limitation. In still other examples, band 200 and the above-described elements may be varied in function, structure, configuration, or implementation and are not limited to those shown and described.
As shown, accelerometer 302 may be used to capture data associated with motion detection along 1, 2, or 3-axes of measurement, without limitation to any specific type of specification of sensor. Accelerometer 302 may also be implemented to measure various types of user motion and may be configured based on the type of sensor, firmware, software, hardware, or circuitry used. As another example, altimeter/barometer 304 may be used to measure environment pressure, atmospheric or otherwise, and is not limited to any specification or type of pressure-reading device. In some examples, altimeter/barometer 304 may be an altimeter, a barometer, or a combination thereof. For example, altimeter/barometer 304 may be implemented as an altimeter for measuring above ground level (“AGL”) pressure in band 200, which has been configured for use by naval or military aviators. As another example, altimeter/barometer 304 may be implemented as a barometer for reading atmospheric pressure for marine-based applications. In other examples, altimeter/barometer 304 may be implemented differently.
Other types of sensors that may be used to measure light or photonic conditions include light/IR sensor 306, motion detection sensor 320, and environmental sensor 322, the latter of which may include any type of sensor for capturing data associated with environmental conditions beyond light. Further, motion detection sensor 320 may be configured to detect motion using a variety of techniques and technologies, including, but not limited to comparative or differential light analysis (e.g., comparing foreground and background lighting), sound monitoring, or others. Audio sensor 310 may be implemented using any type of device configured to record or capture sound.
In some examples, pedometer 312 may be implemented using devices to measure various types of data associated with pedestrian-oriented activities such as running or walking. Footstrikes, stride length, stride length or interval, time, and other data may be measured. Velocimeter 314 may be implemented, in some examples, to measure velocity (e.g., speed and directional vectors) without limitation to any particular activity. Further, additional sensors that may be used as sensor 212 include those configured to identify or obtain location-based data. For example, GPS receiver 316 may be used to obtain coordinates of the geographic location of band 200 using, for example, various types of signals transmitted by civilian and/or military satellite constellations in low, medium, or high earth orbit (e.g., “LEO,” “MEO,” or “GEO”). In other examples, differential GPS algorithms may also be implemented with GPS receiver 316, which may be used to generate more precise or accurate coordinates. Still further, location-based services sensor 318 may be implemented to obtain location-based data including, but not limited to location, nearby services or items of interest, and the like. As an example, location-based services sensor 318 may be configured to detect an electronic signal, encoded or otherwise, that provides information regarding a physical locale as band 200 passes. The electronic signal may include, in some examples, encoded data regarding the location and information associated therewith. Electrical sensor 326 and mechanical sensor 328 may be configured to include other types (e.g., haptic, kinetic, piezoelectric, piezomechanical, pressure, touch, thermal, and others) of sensors for data input to band 200, without limitation. Other types of sensors apart from those shown may also be used, including magnetic flux sensors such as solid-state compasses and the like. The sensors can also include gyroscopic sensors. While the present illustration provides numerous examples of types of sensors that may be used with band 200 (
For example, logic module 404 may be configured to send control signals to communications module 406 in order to transfer, transmit, or receive data stored in memory 206, the latter of which may be managed by a database management system (“DBMS”) or utility in data management module 412. As another example, security module 408 may be controlled by logic module 404 to provide encoding, decoding, encryption, authentication, or other functions to band 200 (
Interface module 410, in some examples, may be used to manage user interface controls such as switches, buttons, or other types of controls that enable a user to manage various functions of band 200. For example, a 4-position switch may be turned to a given position that is interpreted by interface module 410 to determine the proper signal or feedback to send to logic module 404 in order to generate a particular result. In other examples, a button (not shown) may be depressed that allows a user to trigger or initiate certain actions by sending another signal to logic module 404. Still further, interface module 410 may be used to interpret data from, for example, accelerometer 210 (
As shown, audio module 414 may be configured to manage encoded or unencoded data gathered from various types of audio sensors. In some examples, audio module 414 may include one or more codecs that are used to encode or decode various types of audio waveforms. For example, analog audio input may be encoded by audio module 414 and, once encoded, sent as a signal or collection of data packets, messages, segments, frames, or the like to logic module 404 for transmission via communications module 406. In other examples, audio module 414 may be implemented differently in function, structure, configuration, or implementation and is not limited to those shown and described. Other elements that may be used by band 200 include motor controller 416, which may be firmware or an application to control a motor or other vibratory energy source (e.g., vibration source 208 (
Another element of application architecture 400 that may be included is service management module 418. In some examples, service management module 418 may be firmware, software, or an application that is configured to manage various aspects and operations associated with executing software-related instructions for band 200. For example, libraries or classes that are used by software or applications on band 200 may be served from an online or networked source. Service management module 418 may be implemented to manage how and when these services are invoked in order to ensure that desired applications are executed properly within application architecture 400. As discrete sets, collections, or groupings of functions, services used by band 200 for various purposes ranging from communications to operating systems to call or document libraries may be managed by service management module 418. Alternatively, service management module 418 may be implemented differently and is not limited to the examples provided herein. Further, application architecture 400 is an example of a software/system/application-level architecture that may be used to implement various software-related aspects of band 200 and may be varied in the quantity, type, configuration, function, structure, or type of programming or formatting languages used, without limitation to any given example.
A mode can be entered and exited implicitly 605. In particular, a strapband and its logic can determine whether to enter or exit a mode of operation by inferring either an activity or a mode at 630. An inferred mode of operation can be determined as a function of user characteristics 632, such as determined by user-relevant sensors (e.g., heart rate, body temperature, etc.). An inferred mode of operation can be determined using motion matching 634 (e.g., motion is analyzed and a type of activity is determined). Further, an inferred mode of operation can be determined by examining environmental factors 636 (e.g., ambient temperature, time, ambient light, etc.). To illustrate, consider that: (1.) user characteristics 632 specify that the user's heart rate is at a resting rate and the body temperature falls (indicative of resting or sleeping), (2.) motion matching 634 determines that the user has a relatively low level of activity, and (3.) environment factors 636 indicate that the time is 3:00 am and the ambient light is negligible. In view of the foregoing, an inference engine or other logic of the strapband likely can infer that the user is sleeping and then operate to transition the strapband into sleep mode. In this mode, power may be reduced. Note that while a mode may transition either explicitly or implicitly, it need not exit the same way.
Here, band 900 may be configured to perform data communication with one or more other data-capable devices (e.g., other bands, computers, networked computers, clients, servers, peers, and the like) using wired or wireless features. For example, plug 900 may be used, in connection with firmware and software that allow for the transmission of audio tones to send or receive encoded data, which may be performed using a variety of encoded waveforms and protocols, without limitation. In other examples, plug 904 may be removed and instead replaced with a wireless communication facility that is protected by molding 902. If using a wireless communication facility and protocol, band 900 may communicate with other data-capable devices such as cell phones, smart phones, computers (e.g., desktop, laptop, notebook, tablet, and the like), computing networks and clouds, and other types of data-capable devices, without limitation. In still other examples, band 900 and the elements described above in connection with
According to some examples, computer system 1000 performs specific operations by processor 1004 executing one or more sequences of one or more instructions stored in system memory 1006. Such instructions may be read into system memory 1006 from another computer readable medium, such as static storage device 1008 or disk drive 1010. In some examples, hard-wired circuitry may be used in place of or in combination with software instructions for implementation.
The term “computer readable medium” refers to any tangible medium that participates in providing instructions to processor 1004 for execution. Such a medium may take many forms, including but not limited to, non-volatile media and volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as disk drive 1010. Volatile media includes dynamic memory, such as system memory 1006.
Common forms of computer readable media includes, for example, floppy disk, flexible disk, hard disk, magnetic tape, any other magnetic medium, CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, RAM, PROM, EPROM, FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
Instructions may further be transmitted or received using a transmission medium. The term “transmission medium” may include any tangible or intangible medium that is capable of storing, encoding or carrying instructions for execution by the machine, and includes digital or analog communications signals or other intangible medium to facilitate communication of such instructions. Transmission media includes coaxial cables, copper wire, and fiber optics, including wires that comprise bus 1002 for transmitting a computer data signal.
In some examples, execution of the sequences of instructions may be performed by a single computer system 1000. According to some examples, two or more computer systems 1000 coupled by communication link 1020 (e.g., LAN, PSTN, or wireless network) may perform the sequence of instructions in coordination with one another. Computer system 1000 may transmit and receive messages, data, and instructions, including program, i.e., application code, through communication link 1020 and communication interface 1012. Received program code may be executed by processor 1004 as it is received, and/or stored in disk drive 1010, or other non-volatile storage for later execution.
According to some embodiments, inference engine 1304 can be configured to analyze real-time sensor data, such as user-related data 1301 derived in real-time from sensors and/or environmental-related data 1303 derived in real-time from sensors. In particular, inference engine 1304 can compare any of the data derived in real-time (or from storage) against other types of data (regardless of whether the data is real-time or archived). The data can originate from different sensors, and can obtained in real-time or from memory as user data 1352. Therefore, inference engine 1304 can be configured to compare data (or sets of data) against each other, thereby matching sensor data, as well as other data, to determine an activity or mode.
Diagram 1300 depicts an example of an inference engine 1304 that is configured to determine an activity in which the user is engaged, as a function of motion and, in some embodiments, as a function of sensor data, such as user-related data 1301 derived from sensors and/or environmental-related data 1303 derived from sensors. Examples of activities that inference engine 1304 evaluates include sitting, sleeping, working, running, walking, playing soccer or baseball, swimming, resting, socializing, touring, visiting various locations, shopping at a store, and the like. These activities are associated with different motions of the user, and, in particular, different motions of one or more locomotive members (e.g., motion of a user's arm or wrist) that are inherent in the different activities. For example, a user's wrist motion during running is more “pendulum-like” in it motion pattern, whereas, the wrist motion during swimming (e.g., freestyle strokes) is more “circular-like” in its motion pattern. Diagram 1300 also depicts a motion matcher 1320, which is configured to detect and analyze motion to determine the activity (or the most probable activity) in which the user is engaged. To further refine the determination of the activity, inference engine 1304 includes a user characterizer 1310 and an environmental detector 1311 to detect sensor data for purposes of comparing subsets of sensor data (e.g., one or more types of data) against other subsets of data. Upon determining a match between sensor data, inference engine 1304 can use the matched sensor data, as well as motion-related data, to identify a specific activity or mode. User characterizer 1310 is configured to accept user-related data 1301 from relevant sensors. Examples of user-related data 1301 include heart rate, body temperature, or any other personally-related information with which inference engine 1304 can determine, for example, whether a user is sleeping or not. Further, environmental detector 1311 is configured to accept environmental-related data 1303 from relevant sensors. Examples of environmental-related data 1303 include time, ambient temperature, degree of brightness (e.g., whether in the dark or in sunlight), location data (e.g., GPS data, or derived from wireless networks), or any other environmental-related information with which inference engine 1304 can determine whether a user is engaged in a particular activity.
A strapband can operate in different modes of operation. One mode of operation is an “active mode.” Active mode can be associated with activities that involve relatively high degrees of motion at relatively high rates of change. Thus, a strapband enters the active mode to sufficiently capture and monitor data with such activities, such as working out, playing sports, exercising, other types of strenuous activities, etc., with power consumption as being less critical. In this mode, a controller, such as mode controller 1302, operates at a higher sample rate to capture the motion of the strapband at, for example, higher rates of speed. Certain safety or health-related monitoring can be implemented in active mode, or, in response to engaging in a specific activity. For example, a controller of strapband can monitor a user's heart rate against normal and abnormal heart rates to alert the user to any issues during, for example, a strenuous activity. In some embodiments, strapband can be configured as set forth in
Diagram 1300 also depicts a motion matcher 1320, which is configured to detect and analyze motion to determine the activity (or the most probable activity) in which the user is engaged. In various embodiments, motion matcher 1320 can form part of inference engine 1304 (not shown), or can have a structure and/or function separate therefrom (as shown). Regardless, the structures and/or functions of inference engine 1304, including user characterizer 1310 and an environmental detector 1311, and motion matcher 1320 cooperate to determine an activity in which the user is engaged and transmit data indicating the activity (and other related information) to a controller (e.g., a mode controller 1302) that is configured to control operation of a mode, such as an “active mode,” of the strapband.
Motion matcher 1320 of
For example, motion capture manager 1322 can be configured to capture motion relating to the activity of walking and motion relating to running, each motion being associated with a specific profile 1344. To illustrate, consider that motion profiles 1344 of walking and running share some portions of motion in common. For example, the user's wrist motion during running and walking share a “pendulum-like” pattern over time, but differ in sampled positions of the strapband. During walking, the wrist and strapband is generally at waist-level as the user walks with arms relaxed (e.g., swinging of the arms during walking can result in a longer arc-like motion pattern over distance and time), whereas during running, a user typically raises the wrists and changes the orientation of the strapband (e.g., swinging of the arms during running can result in a shorter arc-like motion pattern). Motion/activity deduction engine 1324 is configured to access profiles 1344 and deduce, for example, in real-time whether the activity is walking or running.
Motion/activity deduction engine 1324 is configured to analyze a portion of motion and deduce the activity (e.g., as an aggregate of the portions of motion) in which the user is engaged and provide that information to the inference engine 1304, which, in turn, compares user characteristics and environmental characteristics against the deduced activity to confirm or reject the determination. For example, if motion/activity deduction engine 1324 deduces that monitored motion indicates that the user is sleeping, then the heart rate of the user, as a user characteristic, can be used to compare against thresholds in user data 1352 of database 1350 to confirm that the user's heart rate is consistent with a sleeping user. User data 1352 can also include past location data, whereby historic location data can be used to determine whether a location is frequented by a user (e.g., as a means of identifying the user). Further, inference engine 1304 can evaluate environmental characteristics, such as whether there is ambient light (e.g., darkness implies conditions for resting), the time of day (e.g., a person's sleeping times typically can be between 12 midnight and 6 am), or other related information.
In operation, motion/activity deduction engine 1324 can be configured to store motion-related data to form motion profiles 1344 in real-time (or near real-time). In some embodiments, the motion-related data can be compared against motion reference data 1346 to determine “a match” of motions. Motion reference data 1346, which includes reference motion profiles and patterns, can be derived by motion data captured for the user during previous activities, whereby the previous activities and motion thereof serve as a reference against which to compare. Or, motion reference data 1346 can include ideal or statistically-relevant motion patterns against which motion/activity deduction engine 1324 determines a match by determining which reference profile data 1346 “best fits” the real-time motion data. Motion/activity deduction engine 1324 can operate to determine a motion pattern, and, thus, determine an activity. Note that motion reference profile data 1346, in some embodiments, serves as a “motion fingerprint” for a user and can be unique and personal to a specific user. Therefore, motion reference profile data 1346 can be used by a controller to determine whether subsequent use of a strapband is by the authorized user or whether the current user's real-time motion data is a mismatch against motion reference profile data 1346. If there is mismatch, a controller can activate a security protocol responsive to the unauthorized use to preserve information or generate an alert to be communicated external to the strapband.
Motion analyzer 1326 is configured to analyze motion, for example, in real-time, among other things. For example, if the user is swinging a baseball bat or golf club (e.g., when the strapband is located on the wrist) or the user is kicking a soccer ball (e.g., when the strapband is located on the ankle), motion analyzer 1326 evaluates the captured motion to detect, for example, a deceleration in motion (e.g., as a motion-centric event), which can be indicative of an impulse event, such as striking an object, like a golf ball. Motion-related characteristics, such as space and time, as well as other environment and user characteristics can be captured relating to the motion-centric event. A motion-centric event, for example, is an event that can relate to changes in position during motion, as well as changes in time or velocity. In some embodiments, inference engine 1304 stores user characteristic data and environmental data in database 1350 as user data 1352 for archival purposes, reporting purposes, or any other purpose. Similarly inference engine 1304 and/or motion matcher 1320 can store motion-related data as motion data 1342 for real-time and/or future use. According to some embodiments, stored data can be accessed by a user or any entity (e.g., a third party) to adjust the data of databases 1340 and 1350 to, for example, optimize motion profile data or sensor data to ensure more accurate results. A user can access motion profile data in database 1350. Or, a user can adjust the functionality of inference engine 1304 to ensure more accurate or precise determinations. For example, if inference engine 1304 detects a user's walking motion as a running motion, the user can modify the behavior of the logic in the strapband to increase the accuracy and optimize the operation of the strapband.
To illustrate operation of motion capture manager 1561, consider that motion profile 1502 represents motion data captured for a running or walking activity. The data of motion profile 1502 indicates the user is traversing along the Y-axis with motions describable in X, Y, Z coordinates or any other coordinate system. The rate at which motion is captured along the Y-axis is based on the sampling rate and includes a time component. For a strapband disposed on a wrist of a user, motion capture manager 1561 captures portions of motion, such as repeated motion segments A-to-B and B-to-C. In particular, motion capture manager 1561 is configured to detect motion for an arm 1501a in the +Y direction from the beginning of the forward swinging arm (e.g., point A) to the end of the forward swinging arm (e.g., point B). Further, motion capture manager 1561 is configured to detect motion for arm 1501b in the −Y direction from the beginning of the backward swinging arm (e.g., point B) to the end of the backward swinging arm (e.g., point C). Note that point C is at a greater distance along the Y-axis than point A as the center point or center mass of the user has advanced in the +Y direction. Motion capture manager 1561 continues to monitor and capture motion until, for example, motion capture manager 1561 detects no significant motion (i.e., below a threshold) or an activity or mode is ended.
Note that in some embodiments, a motion profile can be captured by motion capture manager 1561 in a “normal mode” of operation and sampled at a first sampling rate (“sample rate 1”) 1532 between samples of data 1520, which is a relatively slow sampling rate that is configured to operate with normal activities. Samples of data 1520 represent not only motion data (e.g., data regarding X, Y, and Z coordinates, time, accelerations, velocities, etc.), but can also represent or link to user related information captured at those sample times. Motion matcher 1560 analyzes the motion, and, if the motion relates to an activity associated with an “active mode,” motion matcher 1560 signals to the controller, such as a mode controller, to change modes (e.g., from normal to active mode). During active mode, the sampling rate increases to a second sampling rate (“sample rate 2”) 1534 between samples of data 1520 (e.g., as well as between a sample of data 1520 and a sample of data 1540). An increased sampling rate can facilitate, for example, a more accurate set of captured motion data. To illustrate the above, consider that a user is sitting or stretching prior to a work out. The user's activities likely are occurring in a normal mode of operation. But once motion data of profile 1502 is detected, a motion/activity deduction engine can deduce the activity of running, and then can infer the mode ought to be the active mode. The logic of the strapband then can place the strapband into the active mode. Therefore, the strapband can change modes of operation implicitly (i.e., explicit actions to change modes need not be necessary). In some cases, a mode controller can identify an activity as a “running” activity, and then invoke activity-specific functions, such as an indication (e.g., a vibratory indication) to the user every one-quarter mile or 15 minute duration during the activity.
In operation, a mode controller can determine that the motion data of profile 1552 is associated with an active mode, similar with the above-described running activity, and can place the strapband into the active mode, if it is not already in that mode. Further, motion matcher 1560 can analyze the motion pattern data of profile 1552 against, for example, the motion data of profile 1502 and conclude that the activity associated with the data being captured for profile 1552 does not relate to a running activity. Motion matcher 1560 then can analyze profile 1552 of the real-time generated motion data, and, if it determines a match with reference motion data for the activity of swimming, motion matcher 1560 can generate an indication that the user is performing “swimming” as an activity. Thus, the strapband and its logic can implicitly determine an activity that a user is performing (i.e., explicit actions to specify an activity need not be necessary). Therefore, a mode controller then can invoke swimming-specific functions, such as an application to generate an indication (e.g., a vibratory indication) to the user at completion of every lap, or can count a number of strokes. While not shown, motion matcher 1560 and/or a motion capture manager 1561 can be configured to implicitly determine modes of operation, such as a sleeping mode of operation (e.g., the mode controller, in part, can analyze motion patterns against a motion profile that includes sleep-related motion data. Motion matcher 1560 and/or a motion capture manager 1561 also can be configured to an activity out of a number of possible activities.
To illustrate action and event processing of a strapband, consider the following examples. First, consider a person is performing an activity of running or jogging, and enters an active mode at 1702. The logic of the strapband analyzes user characteristics at 1704, such as sleep patterns, and determines that the person has been getting less than a normal amount of sleep for the last few days, and that the person's heart rate indicates the user is undergoing strenuous exercise as confirmed by detected motion in 1706. Further, the logic determines a large number of wireless signals, indicating a populated area, such as along a busy street. Next, the logic detects an incoming call to the user's headset at 1710. Given the state of the user, the logic suppresses the call at 1716 to ensure that the user is not distracted and thus not endangered.
As a second example, consider a person is performing an activity of sleeping and has entered a sleep mode at 1702. The logic of the strapband analyzes user characteristics at 1704, such as heart rate, body temperature, and other user characteristics relevant to the determination whether the person is in REM sleep. Further, the person's motion has decreased sufficiently to match that typical of periods of deep or REM sleep as confirmed by detected motion (or lack thereof) at 1706. Environmental factors indicate a relatively dark room at 1708. Upon determination that the user is in REM sleep, as an event, at 1710, the logic of the strapband inhibits an alarm at 1716 set to wake the user until REM sleep is over. This process loops at 1718 until the user is out of REM sleep, when the alarm can be performed subsequently at 1714. In one example, the alarm is implemented as a vibration generated by the strapband. Note that the strapband can inhibit the alarm features of a mobile phone, as the strapband can communicate an alarm disable signal to the mobile phone.
In at least some examples, the structures and/or functions of any of the above-described features can be implemented in software, hardware, firmware, circuitry, or a combination thereof. Note that the structures and constituent elements above, as well as their functionality, may be aggregated with one or more other structures or elements. Alternatively, the elements and their functionality may be subdivided into constituent sub-elements, if any. As software, the above-described techniques may be implemented using various types of programming or formatting languages, frameworks, syntax, applications, protocols, objects, or techniques. As hardware and/or firmware, the above-described techniques may be implemented using various types of programming or integrated circuit design languages, including hardware description languages, such as any register transfer language (“RTL”) configured to design field-programmable gate arrays (“FPGAs”), application-specific integrated circuits (“ASICs”), or any other type of integrated circuit. These can be varied and are not limited to the examples or descriptions provided.
Although the foregoing examples have been described in some detail for purposes of clarity of understanding, the above-described inventive techniques are not limited to the details provided. There are many alternative ways of implementing the above-described invention techniques. The disclosed examples are illustrative and not restrictive.
This patent application is a continuation-in-part of U.S. patent application Ser. No. 13/158,372, filed Jun. 10, 2011. This patent application also claims the benefit of U.S. Provisional Patent Application No. 61/495,997, filed Jun. 11, 2011, U.S. Provisional Patent Application No. 61/495,995, filed Jun. 11, 2011, U.S. Provisional Patent Application No. 61/495,994, filed Jun. 11, 2011, and U.S. Provisional Patent Application No. 61/495,996, filed Jun. 11, 2011, all of which are herein incorporated by reference for all purposes.
Number | Date | Country | |
---|---|---|---|
61495997 | Jun 2011 | US | |
61495995 | Jun 2011 | US | |
61495994 | Jun 2011 | US | |
61495996 | Jun 2011 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13158372 | Jun 2011 | US |
Child | 13491345 | US |