All publications and patent applications mentioned in this specification are herein incorporated by reference in their entirety to the same extent as if each individual publication or patent application was specifically and individually indicated to be incorporated by reference.
Described herein are systems and methods to determine and/or confirm the identity of an individual based on an analysis of sensed parameters from a plurality of sensors worn as part of an integrated garment. The sensors may include a plurality of sensor management subsystems (SMSes) distributed in characteristic positions as part of the garment(s). These SMSes may be coordinated for local sensing, including precise time-coordination with a central processor, and may record a variety of different parameters including, but not limited to individuals body movements, including voluntary movements (e.g., gait, arm, hand, leg, finger, foot, knee, elbow, chest, etc. movements), and involuntary movements or reactions (e.g., respiratory rate, heart rate, ECG, EMG, EOG, etc.), from which a biometric pattern may be determined. The voluntary and involuntary movements or reactions may be linked to the voluntary movements. A biometric indicator may be learned by the system while wearing the apparatus, and features extracted from the recorded data in order to generate a biometric template. The biometric template may be stored and used as a test against future biometric templates (tokens) from the same or different garments worn by the user to uniquely identify the user. Described herein are methods of forming an identifying biometric template, methods of storing and transmitting the biometric template information securely, and/or methods of using the biometric template to uniquely and accurately identify an individual. Also described herein are the apparatuses (devices and systems) performing these methods as well.
For example, described herein are garments having a variety of sensors forming SMSes that may be used to determine, confirm, or analysis biometric identification.
It has become increasingly important to uniquely identify an individual. Stealing or hacking personal, financial, medical and security information is increasingly common. Attacks against digital information databases are increasing. For example, by 2015, fraudulent card transactions have exceeded $11 billion a year worldwide, of which the U.S. represents 50%, while Europe follows with 15% of the total. Health insurance providers are one of the many industries most affected by hacking. In 2014, 47% of American adults had their personal information stolen by hackers-primarily through data breaches at large companies. In 2013, 43% of companies had a data breach in which hackers got into their systems to steal information. Data breaches targeting consumer information are on the rise, increasing 62% from 2012 to 2013, with 594% more identities stolen. Data about more than 120 million people has been compromised in more than 1,100 separate breaches at organizations handling protected health data since 2009. The data reflects a staggering number of times individuals have been affected by breaches at organizations trusted with sensitive health information.
Some of the data can be used to pursue traditional financial crimes, such as setting up fraudulent lines of credit, but it can also be used for medical insurance fraud, including purchasing medical equipment for resale or obtaining pricey medical care for another person. Personal information is also at risk, including information about an individual's mental health or HIV treatments.
Existing solutions are not adequate. For example, the security of passwords (e.g., password-protected systems) depends on a variety of factors. Compromising attacks, such as protection against computer viruses, man-in-the-middle attacks (where the attacker secretly intrudes into the communication of two unaware parties intercepting their conversation), physical breech (such as bystanders steeling the password by covertly observing thorough video cameras, e.g., at ATMs machines), etc. The stronger the password, the more secure is the information it protects. Strength may be a function of length, complexity and unpredictability. Using strong passwords lowers overall risk of a security breach, but strong passwords do not replace the need for other effective security controls. The effectiveness of a password of a given strength is strongly determined by the design and implementation of the factors (knowledge, ownership, inherence).
Tokens (security tokens) are used to prove one's identity electronically, as in the case of a customer trying to access their bank account. The token is used in addition to or in place of a password to prove that the customer is who they claim to be. The token acts like an electronic key to access something.
The simplest vulnerability with any password container is theft or loss of the device. The chances of this happening, or happening unawares, can be reduced with physical security measures such as locks, electronic leashes, or body sensors and alarms. Stolen tokens can be made useless by using two factor authentication. Commonly, in order to authenticate, a personal identification number (PIN) must be entered along with the information provided by the token the same time as the output of the token.
Any system which allows users to authenticate via an untrusted network (such as the Internet) is vulnerable to man-in-the-middle attacks. In this type of attack, a fraudulent party acts as the “go-between” the user and the legitimate system, soliciting the token output from the legitimate user and then supplying it to the authentication system themselves. Since the token value is mathematically correct, the authentication succeeds and the party is improperly granted access.
Trusted as much a regular hand-written signature, a digital signature should ideally be made with a private key known only to the person authorized to make the signature. Tokens that allow secure on-board generation and storage of private keys enable secure digital signatures, and can also be used for user authentication, as the private key also serves as a proof for the user's identity.
For tokens to identify the user, all tokens must have some kind of number that is unique. Not all approaches fully qualify as digital signatures according to some national laws. Tokens with no on-board keyboard or another user interface cannot be used in some signing scenarios, such as confirming a bank transaction based on the bank account number that the funds are to be transferred to.
Biometrics (e.g., biometric identification systems) often physical features to check a person's identity, ensure much greater security than password and number systems. Biometric features such as the face or a fingerprint can be stored on a microchip in a credit card, for example. A single feature, however, sometimes fails to be exact enough for identification. Another disadvantage of using only one feature is that the chosen feature is not always readable.
A template protection scheme with provable security and acceptable recognition performance has thus far remained elusive. Development of such a scheme is crucial as biometric systems are beginning to proliferate into the core physical and information infrastructure of our society. Described herein are methods and apparatuses that may address the issues discussed above.
Described herein are apparatuses (systems, methods, including garments, etc.) and methods that allow individual owners to use their identifier, which may be based on a wearable (e.g., garment) capable of medical-level physiological data and biometrics measuring, acting as a communication platform, which may allow a user to uniquely identify herself/himself in order to perform security-sensitive actions such as being identified, generating medical data, transferring funds, purchasing goods, modify contracts, enter in restricted-access areas, etc., with certainty of identity, without divulging data to a third party, minimizing the risk of data being stolen. These methods and apparatuses may convert data detected in a predefined manner from any of the wearable apparatuses described herein (or similar in at least some of the functional characteristics described herein) into biometric template information that may be stored and later compared against other similarly-acquired biometric information to confirm a user's identity. This information may act as a token in a security protocol, method or system. These methods and apparatuses may generate the biometric information from one or more wearable garments including a plurality of integrated SMSes; the garment may securely receive, record and transmit a biometric template or token derived from the one sensor (or more likely plurality of sensors) integrated into the garment(s), in minimal time and with minimal cost. A biometric may be a measurement of a physiological trait, traditionally such as fingerprint, iris pattern, retina image, hand or face geometry, or it can be a behavioral trait such as voice, body sweating, gait. Current biometric technology identifies individuals automatically through one or several of these traits. Automatically means that the person's trait has been scanned, converted into a digital form in a database or on identity card. Thus current technology obliges individuals to divulge their data (to the database that will identify them) with the risk of the database being hacked or the card being stolen. The moment users divulge their data they have lost it, potentially irrevocably: unlike passwords, biometrics cannot be easily changed. Furthermore current biometric technology may not be accurate because it is not able to be universally present, unique to the individual, stable over time and easily measurable and have the disadvantage that, unlike a password, a person's characteristics are not secret and can therefore be copied. Once copied biometric data is lost forever: unlike a password it cannot be reset. The methods and apparatuses (e.g., systems and devices) described herein may overcome these limitations. See, e.g., U.S. Pat. No. 6,016,476, describing a portable information and transaction processing system and method utilizing biometric authorization and digital certificate security.
Commonly used biometric traits include fingerprint, face, iris, hand geometry, voice, palmprint, handwritten signatures, and gait. Biometric traits have a number of desirable properties with respect to their use as an authentication token, namely, reliability, convenience, universality, and so forth. These characteristics have led to the widespread deployment of biometric authentication systems. But there are still some issues concerning the security of biometric recognition systems that need to be addressed in order to ensure the integrity and public acceptance of these systems. There are five 5 major components in a generic biometric authentication system, namely, 1) sensor, 2) feature extractor, 3) template database, 4) matcher, and 5) decision module. 1) Sensor is the interface between the user and the authentication system and its function is to scan the biometric trait of the user. 2) Feature extraction module processes the scanned biometric data to extract the salient information (feature set) that is useful in distinguishing between different users. In some cases, the feature extractor is preceded by a 2A) quality assessment module which determines whether the scanned biometric trait is of sufficient quality for further processing.
The systems described herein may not need all of these components, since biometric data may are not necessarily stored in a database; instead these systems may use data generate during the biometric identification process. Thus, these systems may not need a template database. Otherwise, during enrollment, the extracted feature set may be stored in a database as a template (XT) indexed by the user's identity information. Since the template database could be geographically distributed and contain millions of records (e.g., in a national identification system), maintaining its security is often not a trivial task. The matcher module is usually an executable program, which accepts two biometric feature sets XT and XQ (from template and query, resp.) as inputs, and outputs a match score (S) indicating the similarity between the two sets. Finally, the 5) decision module makes the identity decision and initiates a response to the query.
A fish-bone model can be used to summarize the various causes of biometric system vulnerability. At the highest level, the failure modes of a biometric system can be categorized into two classes: intrinsic failure and failure due to an adversary attack. Intrinsic failures occur due to inherent limitations in the 1) sensing, 2) feature extraction, or 3) matching technologies as well as the 4) limited discriminability of the specific biometric trait. In adversary attacks, a resourceful hacker (or possibly an organized group) attempts to circumvent the biometric system for personal gains. We further classify the adversary attacks into three types based on factors that enable an adversary to compromise the system security. These factors include system administration, nonsecure infrastructure, and biometric overtness.
Intrinsic failure is the security lapse due to an incorrect decision made by the biometric system. A biometric verification system can make two types of errors in decision making, namely, 1) false accept and 2) false reject. A genuine (legitimate) user may be falsely rejected by the biometric system due to the large differences in the user's stored template and query biometric feature sets. These intra-user variations may be due to incorrect interaction by the user with the biometric system (e.g., changes in pose and expression in a face image) or due to the noise introduced at the sensor (e.g., residual prints left on a fingerprint sensor). False accepts are usually caused by lack of individuality or uniqueness in the biometric trait which can lead to large similarity between feature sets of different users (e.g., similarity in the face images of twins or siblings). Both intrauser variations and interuser similarity may also be caused by the use of nonsalient features and nonrobust matchers. Sometimes, a sensor may fail to acquire the biometric trait of a user due to limits of the sensing technology or adverse environmental conditions. For example, a fingerprint sensor may not be able to capture a good quality fingerprint of dry/wet fingers. This leads to failure-to-enroll (FTE) or failure-to-acquire (FTA) errors. Intrinsic failures can occur even when there is no explicit effort by an adversary to circumvent the system. So this type of failure is also known as zero-effort attack. It poses a serious threat if the false accept and false reject probabilities are high. Ongoing research is directed at reducing the probability of intrinsic failure, mainly through the design of new sensors that can acquire the biometric traits of an individual in a more reliable, convenient, and secure manner, the development of invariant representation schemes and robust and efficient matching algorithms, and use of multibiometric systems
The apparatuses and methods described herein may allow one to build a measuring systems that can reduce or eliminate the risk of incorrect decisions being made by the biometric system by synthesizing a large variety (e.g., large array) of biometric data (e.g., specifying which, why and how) provided by the apparatus/garment acting as a biometric system and/or communications platform.
The methods and apparatuses described herein may provide biometric security that may possess the following four properties. Diversity: the secure template must not allow cross-matching across databases, thereby ensuring the user's privacy. Revocability: it should be straightforward to revoke a compromised template and reissue a new one based on the same biometric data. Security: it must be computationally hard to obtain the original biometric template from the secure template. This property prevents an adversary from creating a physical spoof of the biometric trait from a stolen template. Performance: the biometric template protection scheme should not degrade the recognition performance (FAR and FRR) of the biometric system.
Typically, biometric recognition is probabilistic; it is not an absolutely accurate and certain identification technology and, according to critics, this is one of the technology's key limitations. In other words, biometric systems will always only provide a probability of verification. There have been moves to manage the probabilistic nature of biometric matching and the challenges that this represents, for example by introducing ‘multi-modal biometrics’ such that the uniqueness of a match (i.e. the likelihood of making a correct match) increases with the number of biometrics that are combined (i.e. whilst it is likely that someone might have a fingerprint pattern that matches yours, it is far less likely that someone will have both a fingerprint and an iris image which match yours). In other words: the fusion of multiple biometrics helps to minimise the system error rates.
However, the use of multi-modal biometric systems then entails a different set of limitations and challenges. First, multi-modal biometrics is more expensive as it requires more data to be collected and processed. Besides that, another challenge confronting the implementation of multi-modal biometric systems is that a crucial question still remains unresolved; namely the question of what are the best combinations (modalities). Moreover, multi-modal biometric systems are also challenging to implement because of the complexities involved in making decisions “about the processing architecture to be employed in designing the multi-modal biometric system as it depends upon the application and the choice of the source. Processing is generally complex in terms of memory and or computations.” Besides that, there are also still a number of unresolved issues about the scalability of multi-modal biometric systems. Finally, increasing the amount of biometrics being collected from an individual might increase the performance of the system but might also, at the same time, increase the risk of data theft or misuse of individual information.
Biometrics can be defined as “any automatically measurable, robust and distinctive physical characteristic or personal trait that can be used to identify an individual or verify the claimed identity of an individual.” Contemporary biometric technologies may entail the digitalization of the unique body part, a process that has implications for the knowledge produced from the processing of this digitalized biometric data and hence for the body subjected to this technology, in particular given the possible political use of such biometrically-derived knowledge.
Described herein are systems that through a wearable apparatus (e.g., a wearable computing & communicating device that covers a significant part of the user's body, e.g., one or more of: torso, arms, legs; and may also include one or more of: head, hands, feet, etc.) accurately measures a plurality of biometrical data (using the same or multiple modalities) to generate an accurate identification of a person, in a private (no third party intrusion), automatic (directly executed by the computing and communication module thus sidestepping user intervention that could generate errors), simple (identification is activated by a single input such as a voice command, a touch on the garment, such as a touch point, a smart screen touch, etc.), fast (synthesis can be produced in just a few seconds), repeatable (it can be generated as many times as needed), low cost (e.g., virtually no execution cost to the owner of apparatus) and controlled manner (the user is in control and needs no external support). The apparatus may generate its owner identity: a synthesis of traits and data that make her/him unmistakably who she/he is. Most importantly, the system allows the person to be the sole owner of the identification data produced. Present biometric-recognition systems require sharing data with a database owned by a third party (government, medical facility, financial institution, vendor, etc.) in order for the person to be identified. Being identified through biometrics today has a substantial cost to the data owners of data: they lose ownership of their data and possibility to generate and income with it. In today ever more digital economy, data is becoming exponentially more valuable: the value is today collected by large corporations rather than by their natural/legitimate owners, partly a cause of today vast economic divide. Securing ownership of personal data could be a mean to close the divide gap by allowing owners to monetize their ever more valuable data.
The biometric identification apparatuses described herein may be: universal, i.e., each individual possesses this characteristic; easily measured, i.e., it is quite easy technically and convenient for an individual to obtain the characteristic; unique, i.e., there are no two individuals with identical characteristics; and permanent, i.e., the characteristic does not change over time.
Ideally the characteristic should be universally present, unique to the individual, stable over time and easily measurable. No biometric characteristics have been formally proven to be unique, although they are usually sufficiently distinct for practical uses. Different biometrics will be more suitable for different applications depending, for example, on whether the aim is to identify someone with their co-operation or from a distance without their knowledge.
For example, described herein are methods of confirming a user's identity using a garment including a variety of sensors. For example, the method may include: wearing a garment comprising a plurality of integrated sensors at predetermined locations; synchronously recording sensor data from multiple predetermined locations on the garment; generating, in the garment, a biometric token from the recorded sensor data; transmitting the biometric token to a lodger in or on the garment; and transmitting the biometric token to a third party having a biometric template against which the biometric token may be tested.
Generating a biometric token from the recorded sensor data may comprise generating the biometric token in a master and/or scheduler on the garment. The master and/or scheduler may include a processor.
Wearing may include adjusting the position of the sensors based on haptic feedback from the garment. For example, the garment may include one or more haptics that will vibrate or otherwise indicate that a nearby sensor in the garment is not properly positioned on the user's body.
Synchronously recording sensor data may comprise synchronously recording sensor data from a plurality of motion sensors. The sensors may be of different types (e.g., different modes, such as respiration sensors, cardiac sensors, galvanic skin sensors, EMG sensors, EEG sensors, etc.). Synchronously recording sensor data may comprise synchronously recording sensor data from a plurality of motion sensors, one or more respiration sensors and one or more electrodes configured to contact the user's skin when the garment is worn. Wearing the garment may comprise wearing the garment over the user's torso (e.g., the garment may be a shirt, or may include a shirt). Synchronously recording may include synchronously recording sensor data from multiple sensor types on the garment. For example, the scheduler and/or master may coordinate the recording of sensor (slave) data; each sensor or sub-sets of sensors may record at different frequencies based on the type of sensor it is. Thus, synchronously recording sensor data may comprise recording data at a plurality of frequencies.
Any of these methods may also include encrypting the biometric token prior to transmitting the biometric token to the third party. Thus, in general, the biometric token is determined using the master and/or scheduler, which may also encrypt the biometric token.
Since the user may wear the apparatus (garment with sensors) continuously for a long period of time, the biometric token may be determined on an ongoing basis (e.g., a running window) and/or upon demand (e.g., upon a request for identity verification).
Any of the methods and apparatuses described herein may also include encrypting and transmitting the biometric template that can be used by a third party to compare with the biometric token. For example, the garments described herein may generate a biometric template upon some triggering event 9 e.g, wearing the garment for a predetermined time) or upon request from a third party.
The substance of the biometric template and/or biometric token, including the type of data (sensor type, etc.) may be determined, for example, based on the ability of that type of data to distinguish identity of the individual wearing the garment. For example, the biometric template may be constructed from accelerometer data (including from one of the axes of motion of the accelerometer, such as one axis of motion of the accelerometer) and/or recorded electrical activity (e.g., cardiac data, EMG data, galvanic skin response data, etc.) and/or respiration data.
Any of these methods may also include sending a coded message requesting approval of the wearer to proceed from the third party. An approval message may be transmitted to the user in a coded (e.g., in a Morse-like tactile code), and a response code may be transmitted by responding to specific location on the garment (e.g., tactile output) and/or to a touchscreen in communication with the device. Thus, contacting an output on the garment may be used to indicate agreement to the third party.
For example, a method of confirming a user's identity may include: wearing a garment comprising a plurality of integrated sensors at predetermined locations in the garment that are configured to position the integrated sensors over the user's torso; synchronously recording sensor data from multiple predetermined locations on the garment, using a plurality of different sensor types; generating, in the garment, a biometric token from the recorded sensor data; and transmitting the biometric token to a third party having a biometric template against which the biometric token may be tested.
A method of confirming a user's identity may include: wearing a garment comprising a plurality of integrated sensors at predetermined locations in the garment that are configured to position the integrated sensors over the user's torso; adjusting the position of the sensors using haptic feedback from the garment; synchronously recording sensor data from multiple predetermined locations on the garment, using a plurality of different sensor types; generating, in the garment, a biometric token from the recorded sensor data; encrypting the biometric token; and transmitting the encrypted biometric token to a third party having a biometric template against which the biometric token may be tested.
The novel features of the invention are set forth with particularity in the claims that follow. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:
Described herein are biometric identification methods and apparatuses (including devices and systems) for uniquely identifying one an individual based on a garment including one (or more preferably a plurality) of sensors, including but not limited to sensors having multiple sensing modalities (e.g., movement, respiratory movements, heart rate, ECG, EEG, etc.).
In the first step 101, the user (also referred to as a subject or wearer) may wear the device. In general, the device may be a garment including a plurality of SMSes that each receive and/or record, and/or process sensor data from one or more sensors. For example, the apparatus may be a garment such as the garments described in one or more of U.S. patent application Ser. No. 14/023,830, titled “WEARABLE COMMUNICATION PLATFORM” (Now U.S. Pat. No. 9,282,893); U.S. patent application Ser. No. 14/331,142, titled “COMPRESSION GARMETS HAVING STRETCHABLE AND CONDUCTIVE INK” (Now U.S. Pat. No. 8,948,839); U.S. patent application Ser. No. 14/612,060, titled “GARMENTS HAVING STRETCHABLE AND CONDUCTIVE INK” (US-2015-0143601-A1); U.S. patent application Ser. No. 14/331,185, titled “METHODS OF MAKING GARMENTS HAVING STRETCHABLE AND CONDUCTIVE INK” (Now U.S. Pat. No. 8,945,328; U.S. patent application Ser. No. 15/324,152, titled “GARMENTS HAVING STRETCHABLE AND CONDUCTIVE INK”; U.S. patent application Ser. No. 15/202,833, titled “SYSTEMS AND METHODS TO AUTOMATICALLY DETERMINE GARMENT FIT” (US-2016-0314576-A1); U.S. patent application Ser. No. 14/644,180, titled “PHYSIOLOGICAL MONITORING GARMENTS” (US-2015-0250420-A1); U.S. patent application Ser. No. 15/516,138, titled “DEVICES AND METHODS FOR USE WITH PHYSIOLOGICAL MONITORING GARMENTS”; and U.S. patent application Ser. No. 15/335,403, titled “CALIBRATION PACKAGING APPARATUSES FOR PHYSIOLOGICAL MONITORING GARMENTS,” each of which is herein incorporated by reference in its entirety.
These apparatuses (e.g., garments) may include a tutorial application to ensure that the device is properly worn and a) all the sensors are properly functioning and/or correctly positioned. Alternatively or in addition, when wearing the garment, the processor (e.g., computer) communicating with or integrated into the apparatus may detect that a sensor is not working and may indicate it on the smartscreen (e.g., touchscreen), and/or by haptic feedback near the sensor 103. For example, a message indicating that the sensor needs to be positioned or worn correctly/adjusted may appear on the smart phone or computer's screen in communication with or integrated into the garment.
In general, sensors integrated into the garment(s) may be properly positioned in the right place. For example: IMU need to be positioned in the middle of the segment (shoulder to elbow, elbow to wrist), on the back of the hand between wrist and knuckles.
Once worn and adjusted, the device may be worn for a few minutes or longer so that sensors adapt to body temperature.
The apparatus may then activate the production of synthesis of biometric data from the plurality of sensors (e.g., from the plurality of SMSes). For example, the apparatus may be activated automatically or manually, e.g., through a touch point (touching a microchip on the sleeve for example), through voice command, a sensorial command or other type of command. Thereafter, the apparatus may produce a biometric representation (e.g., token or template) of the wearer's physiological data 107. This is described in greater detail below, and generally includes collecting sensor data, e.g., from coordinated SMSes on/in the garment and analyzing the data in an ongoing or discrete manner to evaluate one or more characteristics (“prototypes”) specific to each sensor (per characteristic sensor type and location). The biometric representation may be perfected through machine learning. Thus, the more the owner uses the device, the more precise the identity synthesis algorithm becomes.
The method and biometric representation can also be made more accurate by using more than one garment or a garment covering more than one region. For example, the garment may be a garment configured to collect medical diagnostic information. the wearer may wear the garment that covers the body from the tip of the toes (leggings incorporating socks) to the top of the head/balaclava see, e.g.,
The apparatus in
The system shown in
Other garments covering more or less of the body may be used. For example, a garment configured as an efficiency device that may monitor and provide feedback to the owner during daily life to improve health by, for example, analyzing activities and improving habits, may also be used. This apparatus may be, for example, an upper-body device with short or long sleeves very comfortable to be worn during daily life and may optionally include a visor or glasses to monitor EEG, EOG, EMG facial signals, body temperature, and one or more IMUs to monitor head movements, etc. See, e.g.,
Other garments may also include an apparatus configured as a performance device that supports the owner during regular or intensive fitness activities or professional sports. See, e.g.,
By wearing any of these garments for a period of time (e.g., 1 day, 1 week, 2 or more weeks, 1 month, or more months, etc.) for short period of time (e.g., with the medical device garment of
Physiological data captured by the many sensors may be processed in multiple locations throughout the body. For example, the sensors (e.g., IMUs or EMGs) may be positioned in proximity of an SMS (e.g., microchip) that process the data. The physiological data may be jointly processed into the Sensor Management System (SMS). Thus, the data may be synchronously processed at multiple locations in the garment 105; the different processors may be synchronized and the data accurately time stamped (e.g., to within +/−1 ms, 0.1 ms, 0.001 ms, etc.). The synchronized data are processed/calculated with minimal latency, and may be recombined and/or further processed. SMS software and/or firmware can calculate data at different Hertz velocities depending on the type of physiological data. For example IMU may be measured at 500 Hertz, heart rate at the same or at a different frequency (e.g., 100 Hz or less), respiration at the same or at a different frequency (e.g., 10 Hz), EEG at the same or at a different frequency (e.g., 200 Hz), EOG at the same or at a different frequency (e.g., 300 Hz), EMG at the same or at a different frequency, Skin conductance at the same or at a different frequency, body temperature at the same or at a different frequency, etc.
In general, any of the methods and apparatuses described herein may include tactile feedback, via one or more haptic actuators (e.g., piezoelectric actuators, etc.). For example, the devices may be equipped with haptic actuators to provide touch feedback at or near the sensor(s). Haptic feedback may be provided when confirming that the sensor(s) are correctly positioned. Haptic actuators may provide a tactile feedback to the user to indicate that the synthesis has been performed by the SMS. The synthesis may include the formation of a biometric template or token that is synthesized from a plurality of different sensors or combination of sensors in/on the garment. Once synthetized, the biometric template or token may be encrypted. For example, the synthesis of the biometric template/token may be an encrypted 532 to 1064 characters in SMS.
The synthesized biometric template or token may then be sent by a lodger 109 (a telecommunications module, such as a cell phone or wireless-enabled unit that may be located in or on the garment, e.g., on the upper-back between the shoulder blades in a torso garment such as a shirt). The biometric template or token may be sent to an interested party 111 that may verify the biometric token and then send a coded message requesting approval of the wearer to proceed, assuming that the biometrics match 113. The request for approval may be displayed on the garment, including on a display integrated into or in communication with the garment. Approval may be provided by a touchpoint in/on the garment and/or a touchscreen. For example, in case of a bank access, before approval of a payment, the biometric information may be transmitted from the garment (lodger) to the bank, acting as the third party. Assuming that the bank has a reference biometric template to compare to (which is also encoded), the bank may verify the biometric information from the garment and may then request additional verification. Additional (optional) security may then be provided; for example, the coded message may be delivered on the garment by haptic actuators in a Morse-type code chosen by the user. The user may then send approval to the bank. In some variations, the synthesis can be stored in a blockchain.
In general, the garments described herein may include a sensor network (e.g., a network of sensor elements, including a master, a scheduler, and one or more slaves (sensors). The slave(s) may be the last element(s) of the sensor network, and may typically be placed directly on the garment. More than one slave sensor can be attached to the sensor network. As mentioned, the garment may support more than one sensor. The slaves/sensors may be responsible to: directly acquire data from sensors, execute signal processing, execute algorithms, derive virtual sensor data from hardware sensors (e.g., Quaternions), etc.
Different sensor types supported. For example, slave breath sensors (e.g., “Type ECG-BREATH”) may be configured to acquire data from a 12-lead ECG and breathing sensors. Slave motion sensors (e.g., “Type IMU-EMG”) may be configured to acquire data from an IMU (e.g., Accelerometer, Gyroscope, Magnetometer, Quaternions) and/or EMG sensors.
A scheduler may be placed inside of a control device or directly on/in a garment. The scheduler may generally manage the sensor network of the garment, and may organize slaves to execute synchronous sampling. The scheduler may control and synchronize the clocks in the individual regions of the garment (and may include a master clock, and may coordinate the sample frequencies and/or synchronize the sensors). The scheduler may also encrypt data provided to the master, and/or provide the access of the sensor network to the master. The scheduler may include circuitry (e.g., clock, processor, memory, etc.).
A master may also be included in the control device, and may be configured to manage the sensor network (e.g., thorough the scheduler). The master may obtain data from the sensor network (e.g., encrypted by the scheduler), and may execute control logic (e.g. processes) and/or may directly acquire data from the sensors, store data, exchange data with a remote server (e.g., the cloud, for example, through WiFi/mobile network), exchange data with an external user device (e.g., through WiFi/Bluetooth), and/or exchange data with an external third party medical devices (e.g., through Bluetooth).
In some variations, the biometric apparatuses described herein are wearable devices that cover the major part of the body to maximize the number of sensors located around the body; in general, the higher the number of sensor the higher the medical accuracy of the data. This may also help to ensure that sensors are located in the best possible part of the body for maximum precision. A sensor located around the heart may be more precise then a sensor on the wrist (like in wearable bracelets and watches). The device may be comfortable (e.g., preventing data noise distortions introduced by constriction/lack of comfort), and can be used during daily life (generating more relevant data and habits far from the anxieties and risks of hospitals and medical laboratories) for long period of time. Longer measurement times may enhance the chance to discover pathologies or abnormalities in garments configured for medical use, and may also provide greater accuracy for the data through machine learning.
The apparatuses described herein may not need a password to authenticate an individual, which may substantially increasing the ease of use. Passwords may get misplaced or are forgotten. The biometric technologies linked to the particular individual such as those described herein may provide greater security, speed, and ease of use than traditional methods like passwords, PIN's, or “smart” cards. Biometric login can also save time and reduce costs.
Rather than simply generate physiological data to compare to previously stored physiological data bases, the methods and apparatuses described herein may determine reliable biometric templates from sensors in/or a garment, these biometric templates may be generalizable between different garments. This may reduce the risk of the user's physiological data being held in possession of a third party (e.g., such as the US government as currently done for fingerprints and retinal scans). The systems, devices and methods described herein may help ensure that the persons generating the physiological data remains the sole owner of their data and does not need to divulge their data in order to be identified or in order to use their data to make transactions or to monetize it.
Thus, in general, the validation server does not store sensitive user data such as personally identifiable information (PII). A user's unique biometric signature may remain within trusted execution and may not ever be transmitted over the web. Raw biometric data may never be sent through the network or stored in a central database.
The systems described herein may replaces and compete with existing tokens. These systems are typically a synthesis of users' physiological data. The methods and apparatuses described do not reveal the owner's physiological data, but merely provide extracted and/or calibrated information that may be further processed.
Advantageously, the use of multiple, synchronized sensors as described herein may allow for rapid and robust sensing. For example, the apparatuses described herein may generate an accurate biometric token within under about 10 seconds. Typically these systems may only work with the owner of the system. Once the system is worn for more than a few times (e.g., more than 5 times, more than 6 time, more than 7 times, more than 8 times, more than 9 times, more than 10 times, etc.) it may recognizes its owner and may be configured to only work when it is worn by the owner.
As mentioned, any combination of different physiological data types may be used. for example, at least 3 types of physiological data (e.g., at least four types, at least five times, at least six types, etc.) may be used to generate an accurate synthesis of the biometric template/token. For example, heart, respiration, movement, and rest (EEG, EOG, EMG, temperature, skin conductance, etc.), or any component part of these. For example, an accelerometer may include three different axes (x, y, z), which may be analyzed separately or together.
In any of these variations, SMS information may be encrypted so that data is protected before being sent. The data may be encrypted before being passed into the phone module to guarantee safety. Once a transaction is automatically approved by a third party device after comparing the biometric template based on a wearable garment with sensors stored by the third party with a biometric token based on a wearable garment with sensors, a message may be sent to the wearable garment's haptic system of the wearer/owner of physiological data. The haptic communication may be a ‘pass-haptic signals’ in a Morse-type code rather than a ‘password’ and thus it can be reset.
The signal may be performed by two different haptic actuators placed in two different parts of the body, which may oblige the owner to wear the device properly.
The data may be saved in a physiological data platform (e.g., in the cloud or in a secure remote server. The authentication may be given by the physiological data platform after matching the data. A biometric encryption may help ensure that a user's credentials are decentralized and stored offline. A cryptographic digital key may be generated from a biometric such as a fingerprint or voice and used to sign transactions initiated by a relying party. Raw biometric data may not be sent through the network or stored in a central database.
Thus, the authentication solutions described herein may provide biometric encryption without requiring an authentication channel relying on a centralized storage of biometrics. End-users may be able to choose which biometric authenticators they will utilize. Biometric data may remain encrypted and protected against malware on a user's device. Relying parties set policies for which biometric authenticators can be used. A UAF Server may provide the server side of UAF protocols; HYPR makes it easy to deploy any FIDO server on-premises or as a cloud solution.
Using public key cryptography, it is possible to prove possession of a private key without revealing that key. The authentication server may encrypt a challenge (typically a random number, or at least data with some random parts) with a public key; the device describe described herein may allow the apparatus to prove it possesses a copy of the matching private key by providing the decrypted challenge.
The identification systems described herein may use a classical scheme including data acquisition, data preprocessing, formation of input feature space, transition to reduced feature space, and sensor information classification. The generic system structure (
Previously described biometric authentication has typically been based on data derived from direct measurements of a part of the human body, like the DNA, fingerprint, retina, iris, face, ear, palm, the veins' pattern in the hand or in the wrist, etc. The heart activity has also been used for the person authentication, whether by capturing the electrical activity (ECG) or the sound produced by it (PCG). Photoplethysmography (PPG) has also been used for authentication. Vein patterns have also been used. In addition, it is also possible to perform biometric authentication based on behavioral characteristics of the user, which may be linked/coordinated by these physiological responses. For instance, gait, the way the user walks, signature and voice recognition, keystroke-based or by capturing the response of the user (e.g., EEG) to a given stimulus.
Typically, the raw signals captured from direct measurements of the user to be authenticated are characterized and authentication may be based on a comparison between the features of those measurements and the features of the signals measured on the candidate person. For instance, fingerprint authentication may be based on three basic patterns of fingerprint ridges: arches, loops, and whorls. The features or data points defining the authenticated user can define a region or a set of regions in a high-dimensional space. In this case, the procedure of authentication consists on computing if the candidate data lies inside those regions.
Described herein are garments that may provide sufficient biometric information (on both voluntary and involuntary responses) to accurately and reliably be used as biometric identifying data; these garments may further be configured to securely determine from the biometric information a synthesis of biometric templates or tokens that may be used to verify identity of an individual wearing the garment.
In a proof of concept test, multiple IMU units present in the sample garment of
Initial tests identified sets of signal patterns that are uniquely present in a given individual. The resulting authentication system would be of a behavioral type, given that those signals are generated, for instance while the user is walking and working.
In a first approach, we exhaustively extracted all 1-second time-series of each axis of the available sensors (i.e., 5 sensors×3 axes of acceleration, thus 15 axes). We then proceeded to group those time-series such that for many similar time-series patterns, we chose one single prototype (e.g., by means of a time-series clustering technique such as K-medoids). The user's behavior is thus characterized by a set of prototypes for each sensor axis (in our experiments, 15 sensor axes×50 time-series prototypes). Those 750 prototypes may be different for every user, or that at least, we can base the authentication of a user on the distance between the measured time-series patterns of the candidate user and the prototype time-series characterizing the authenticated user. Thus, the candidate user may be recognized as the authenticated user, if the aforementioned distance is below a certain threshold. The set of prototypes used for characterizing the behavior of a user can be identified whether by a semi-supervised approach or in a completely unsupervised way. Results of this approach are summarized in
In a second approach, we analyzed if a user's way of behaving had a particular pattern in the frequency domain, captured by the IMU's accelerometers. We considered for this purpose all of the available accelerometers in all of the walking datasets. We then computed the power spectrum of the signal for each accelerometer in each of the 3 axes and kept the median signal over periods of 1 minute. We chose a resolution of 0.25 Hz in the frequency domain ranging from 0 to 20 Hz. These median spectra were used to construct a baseline (or prototype) for each specific user. We considered for this purpose a method called Support Vector Data Description (SVDD). This method relies on the construction of a multidimensional domain around typical data points of the target user. The domain is created using a recorded dataset and can then be used to classify new measurements as belonging to the target user or not. Data points falling within the boundaries of the domain are considered as belonging to the user and points falling outside are considered outliers. Therefore, by counting the proportion of points that fall in the domain with respect to the total number of measurements, we can estimate quantitatively the likelihood of the garment being worn by a specific user. Results are presented in
A first approach was to look at time-series clustering. The three plots in
Moreover, we have tested how the distances changed depending on which sensors are used. On the one hand,
Also described herein are methods and apparatuses including the use of support vector data description. The Support Vector Data description (SVDD) deals with the problem of making a description of a training dataset with the aim of detecting which (new) data observations resemble this training set. This procedure is also known as one-class classification. Data description can be used for outlier detection, that is, to detect uncharacteristic data values from a data set. In many one-class classification problems there is a major complication, namely that it is beforehand not clear what the specific distribution of the data will be in practice. With SVDD, we obtain a spherically shaped boundary around the training dataset. We used SVDD to obtain those boundaries in the frequency domain of the accelerometer data, and then computed a confidence of being part of the training data. The plots below (
Interestingly, we observed that the quality of the results in terms of prediction accuracy for both the positive class (the target user) and the negative class (all other users) does not depend on the amount of sensor considered. Indeed, the difference in accuracy with respect to the results presented above stays in the ballpark of +/−5% if we consider the signal of any individual sensor instead of all combined. Nevertheless, we suspect that this might not be the case if we were to repeat this experiment on a larger set of users. In this case, the probability of having similar signals among individuals would increase thus making the definition of unique user domains more difficult. With more sensors however, we are able to work in a higher dimensional space where overlaps are less likely and identification is therefore improved.
Although the examples descried herein use Dynamic Time Warping instead of Euclidean Distance, in some variations it may be more appropriate given that out-of-phase time series can match prototype time-series characterizing the authenticated user. For the second approach, the use of wavelet transforms instead of FFT may add time dependency to the models and may be useful.
In general, further tests including other sensors and a combination of model predictions (e.g., by using a Bayesian approach). The use of a larger collection of data for more accurate models may also be used. Testing the robustness and accuracy (e.g., test if a user can imitate the behavior of another one) of the model. Other kind of features may be used to characterize the signals being used to authenticate the user. For instance, based on theoretical-information measures indicating disorder (entropy), complexity, fractal dimension and chaos dimension may be used.
As illustrated, it is possible to build user-specific models of behavior from the available data, which indicates that authentication is feasible based on behavioral biometric data. Authentication is possible among this reduced group of people using all the IMU sensors in the garment.
This proof-of-concept is based on approaches using only one modality (accelerometer). This approach may be extended to a larger group or users, using multiple modalities and combining multiple machine learning-based authentication algorithms working in parallel.
When a feature or element is herein referred to as being “on” another feature or element, it can be directly on the other feature or element or intervening features and/or elements may also be present. In contrast, when a feature or element is referred to as being “directly on” another feature or element, there are no intervening features or elements present. It will also be understood that, when a feature or element is referred to as being “connected”, “attached” or “coupled” to another feature or element, it can be directly connected, attached or coupled to the other feature or element or intervening features or elements may be present. In contrast, when a feature or element is referred to as being “directly connected”, “directly attached” or “directly coupled” to another feature or element, there are no intervening features or elements present. Although described or shown with respect to one embodiment, the features and elements so described or shown can apply to other embodiments. It will also be appreciated by those of skill in the art that references to a structure or feature that is disposed “adjacent” another feature may have portions that overlap or underlie the adjacent feature.
Terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. For example, as used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items and may be abbreviated as “/”.
Spatially relative terms, such as “under”, “below”, “lower”, “over”, “upper” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is inverted, elements described as “under” or “beneath” other elements or features would then be oriented “over” the other elements or features. Thus, the exemplary term “under” can encompass both an orientation of over and under. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly. Similarly, the terms “upwardly”, “downwardly”, “vertical”, “horizontal” and the like are used herein for the purpose of explanation only unless specifically indicated otherwise.
Although the terms “first” and “second” may be used herein to describe various features/elements (including steps), these features/elements should not be limited by these terms, unless the context indicates otherwise. These terms may be used to distinguish one feature/element from another feature/element. Thus, a first feature/element discussed below could be termed a second feature/element, and similarly, a second feature/element discussed below could be termed a first feature/element without departing from the teachings of the present invention.
Throughout this specification and the claims which follow, unless the context requires otherwise, the word “comprise”, and variations such as “comprises” and “comprising” means various components can be co-jointly employed in the methods and articles (e.g., compositions and apparatuses including device and methods). For example, the term “comprising” will be understood to imply the inclusion of any stated elements or steps but not the exclusion of any other elements or steps.
As used herein in the specification and claims, including as used in the examples and unless otherwise expressly specified, all numbers may be read as if prefaced by the word “about” or “approximately,” even if the term does not expressly appear. The phrase “about” or “approximately” may be used when describing magnitude and/or position to indicate that the value and/or position described is within a reasonable expected range of values and/or positions. For example, a numeric value may have a value that is +/−0.1% of the stated value (or range of values), +/−1% of the stated value (or range of values), +/−2% of the stated value (or range of values), +/−5% of the stated value (or range of values), +/−10% of the stated value (or range of values), etc. Any numerical values given herein should also be understood to include about or approximately that value, unless the context indicates otherwise. For example, if the value “10” is disclosed, then “about 10” is also disclosed. Any numerical range recited herein is intended to include all sub-ranges subsumed therein. It is also understood that when a value is disclosed that “less than or equal to” the value, “greater than or equal to the value” and possible ranges between values are also disclosed, as appropriately understood by the skilled artisan. For example, if the value “X” is disclosed the “less than or equal to X” as well as “greater than or equal to X” (e.g., where X is a numerical value) is also disclosed. It is also understood that the throughout the application, data is provided in a number of different formats, and that this data, represents endpoints and starting points, and ranges for any combination of the data points. For example, if a particular data point “10” and a particular data point “15” are disclosed, it is understood that greater than, greater than or equal to, less than, less than or equal to, and equal to 10 and 15 are considered disclosed as well as between 10 and 15. It is also understood that each unit between two particular units are also disclosed. For example, if 10 and 15 are disclosed, then 11, 12, 13, and 14 are also disclosed.
Although various illustrative embodiments are described above, any of a number of changes may be made to various embodiments without departing from the scope of the invention as described by the claims. For example, the order in which various described method steps are performed may often be changed in alternative embodiments, and in other alternative embodiments one or more method steps may be skipped altogether. Optional features of various device and system embodiments may be included in some embodiments and not in others. Therefore, the foregoing description is provided primarily for exemplary purposes and should not be interpreted to limit the scope of the invention as it is set forth in the claims.
The examples and illustrations included herein show, by way of illustration and not of limitation, specific embodiments in which the subject matter may be practiced. As mentioned, other embodiments may be utilized and derived there from, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. Such embodiments of the inventive subject matter may be referred to herein individually or collectively by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept, if more than one is, in fact, disclosed. Thus, although specific embodiments have been illustrated and described herein, any arrangement calculated to achieve the same purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the above description.
This patent application is a continuation of U.S. patent application Ser. No. 15/640,963, filed Jul. 3, 2017, titled “BIOMETRIC IDENTIFICATION BY GARMENTS HAVING A PLURALITY OF SENSORS,” now U.S. Pat. No. 10,154,791, which claims priority to U.S. Provisional Patent Application No. 62/357,665, titled “BIOMETRIC IDENTIFICATION BY WORN MOVEMENT SENSORS,” and filed Jul. 1, 2016, the entirety of which is herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
3591526 | Kawashima | Jul 1971 | A |
3793716 | Smith Johannsen | Feb 1974 | A |
4624817 | Gusack et al. | Nov 1986 | A |
4710981 | Sanchez | Dec 1987 | A |
4823240 | Shenker | Apr 1989 | A |
4867166 | Axelgaard et al. | Sep 1989 | A |
5036865 | Keaton | Aug 1991 | A |
5111818 | Suzuki et al. | May 1992 | A |
5148002 | Kuo et al. | Sep 1992 | A |
5163006 | Deziel | Nov 1992 | A |
5241300 | Buschmann | Aug 1993 | A |
5280265 | Kramer et al. | Jan 1994 | A |
5352315 | Carrier et al. | Oct 1994 | A |
5379461 | Wilmers | Jan 1995 | A |
5395508 | Jolly et al. | Mar 1995 | A |
5557263 | Fisher et al. | Sep 1996 | A |
5581492 | Janik | Dec 1996 | A |
5635909 | Cole | Jun 1997 | A |
5678448 | Fullen et al. | Oct 1997 | A |
5694645 | Triplette | Dec 1997 | A |
5749365 | Magill | May 1998 | A |
5802607 | Triplette | Sep 1998 | A |
5824996 | Kochman et al. | Oct 1998 | A |
5845644 | Hughes et al. | Dec 1998 | A |
5853005 | Scanlon | Dec 1998 | A |
5865740 | Kelly et al. | Feb 1999 | A |
5903222 | Kawarizadeh et al. | May 1999 | A |
5906004 | Lebby et al. | May 1999 | A |
5912653 | Fitch | Jun 1999 | A |
5921674 | Koczi | Jul 1999 | A |
5984063 | Wallace, III | Nov 1999 | A |
6016476 | Maes et al. | Jan 2000 | A |
6019877 | Dupelle et al. | Feb 2000 | A |
6024575 | Ulrich | Feb 2000 | A |
6047203 | Sackner et al. | Apr 2000 | A |
6080690 | Lebby et al. | Jun 2000 | A |
6097297 | Fard | Aug 2000 | A |
6136127 | De Bastiani | Oct 2000 | A |
6144120 | Doi et al. | Nov 2000 | A |
6210771 | Post et al. | Apr 2001 | B1 |
6232879 | Tyren | May 2001 | B1 |
6259399 | Krasner | Jul 2001 | B1 |
6319015 | Faunce | Nov 2001 | B1 |
6325066 | Hughes et al. | Dec 2001 | B1 |
6341504 | Istook | Jan 2002 | B1 |
6349201 | Ford | Feb 2002 | B1 |
6415176 | Scheirer et al. | Jul 2002 | B1 |
6436064 | Kloecker | Aug 2002 | B1 |
6490534 | Pfister | Dec 2002 | B1 |
6561814 | Tilbury et al. | May 2003 | B2 |
6563424 | Kaario | May 2003 | B1 |
6642467 | Farringdon | Nov 2003 | B2 |
6668380 | Marmaropolous et al. | Dec 2003 | B2 |
6713733 | Kochman et al. | Mar 2004 | B2 |
6729025 | Farrell et al. | May 2004 | B2 |
6792124 | Tilbury et al. | Sep 2004 | B2 |
6801140 | Mantyjarvi et al. | Oct 2004 | B2 |
6830344 | Reho et al. | Dec 2004 | B2 |
6895261 | Palamides | May 2005 | B1 |
6930608 | Grajales et al. | Aug 2005 | B2 |
6968075 | Chang | Nov 2005 | B1 |
6970731 | Jayaraman et al. | Nov 2005 | B1 |
6982115 | Poulos et al. | Jan 2006 | B2 |
7020508 | Stivoric et al. | Mar 2006 | B2 |
7034685 | Fabre et al. | Apr 2006 | B2 |
7161084 | Sandbach | Jan 2007 | B2 |
7173437 | Hervieux et al. | Feb 2007 | B2 |
7191803 | Orr et al. | Mar 2007 | B2 |
7210939 | Marmaropolous et al. | May 2007 | B2 |
7211053 | Marmaropolous et al. | May 2007 | B2 |
7230610 | Jung et al. | Jun 2007 | B2 |
7248756 | Ebbesen et al. | Jul 2007 | B2 |
7250547 | Hofmeister et al. | Jul 2007 | B1 |
7299034 | Kates | Nov 2007 | B2 |
7299964 | Jayaraman et al. | Nov 2007 | B2 |
7319895 | Klefstad-Sillonville et al. | Jan 2008 | B2 |
7320947 | Child et al. | Jan 2008 | B2 |
7321785 | Harris | Jan 2008 | B2 |
7324841 | Reho et al. | Jan 2008 | B2 |
7344379 | Marmaropolous et al. | Mar 2008 | B2 |
7348645 | Xu | Mar 2008 | B2 |
7365031 | Swallow et al. | Apr 2008 | B2 |
7377133 | Sandbach et al. | May 2008 | B2 |
7388166 | Marmaropolous et al. | Jun 2008 | B2 |
7429959 | Gerder et al. | Sep 2008 | B2 |
7448874 | Willis | Nov 2008 | B2 |
7476104 | Marmaropolous et al. | Jan 2009 | B2 |
7559768 | Marmaropolous et al. | Jul 2009 | B2 |
7578195 | DeAngelis et al. | Aug 2009 | B2 |
7616112 | Miller, III | Nov 2009 | B2 |
7645220 | Hoffman et al. | Jan 2010 | B2 |
7665288 | Karayianni et al. | Feb 2010 | B2 |
7683643 | Qi et al. | Mar 2010 | B2 |
7712373 | Nagle et al. | May 2010 | B2 |
7715873 | Biere et al. | May 2010 | B1 |
7719007 | Thompkins et al. | May 2010 | B2 |
7732002 | Kodas et al. | Jun 2010 | B2 |
7753685 | Lee et al. | Jul 2010 | B2 |
7753845 | Gopinathan et al. | Jul 2010 | B2 |
7760082 | Wong et al. | Jul 2010 | B2 |
7769412 | Gailloux | Aug 2010 | B1 |
7770473 | Von Lilienfeld-Toal et al. | Aug 2010 | B2 |
7779656 | Dias et al. | Aug 2010 | B2 |
7783334 | Nam et al. | Aug 2010 | B2 |
7787726 | Ten Eyck et al. | Aug 2010 | B2 |
7849888 | Karayianni et al. | Dec 2010 | B2 |
7862624 | Tran | Jan 2011 | B2 |
7870761 | Valentine et al. | Jan 2011 | B2 |
7872557 | Seibert | Jan 2011 | B2 |
7878030 | Burr | Feb 2011 | B2 |
7880607 | Olson et al. | Feb 2011 | B2 |
7891020 | Von Bluecher | Feb 2011 | B2 |
7914108 | Konno et al. | Mar 2011 | B2 |
7933554 | Hoyt et al. | Apr 2011 | B2 |
7955696 | Baikerikar et al. | Jun 2011 | B2 |
7976480 | Grajales et al. | Jul 2011 | B2 |
7982613 | Zheng | Jul 2011 | B2 |
7983876 | Vock et al. | Jul 2011 | B2 |
8008606 | Kaiserman et al. | Aug 2011 | B2 |
8024023 | Tolvanen | Sep 2011 | B2 |
8032199 | Linti et al. | Oct 2011 | B2 |
8063307 | Bukshpun et al. | Nov 2011 | B2 |
8099258 | Alten et al. | Jan 2012 | B2 |
8140143 | Picard et al. | Mar 2012 | B2 |
8146171 | Chung et al. | Apr 2012 | B2 |
8162857 | Lanfermann et al. | Apr 2012 | B2 |
8186231 | Graumann et al. | May 2012 | B2 |
8214008 | Hassonjee et al. | Jul 2012 | B2 |
8228202 | Buchner et al. | Jul 2012 | B2 |
8253586 | Matak | Aug 2012 | B1 |
8262217 | Furukawa | Sep 2012 | B2 |
8263215 | Burr et al. | Sep 2012 | B2 |
8267862 | Jeong et al. | Sep 2012 | B2 |
8308489 | Lee et al. | Nov 2012 | B2 |
8331097 | Yang et al. | Dec 2012 | B2 |
8340740 | Holzer et al. | Dec 2012 | B2 |
8348841 | Varadan | Jan 2013 | B2 |
8348865 | Jeong et al. | Jan 2013 | B2 |
8362882 | Heubel et al. | Jan 2013 | B2 |
8373079 | Walkington | Feb 2013 | B2 |
8398546 | Pacione et al. | Mar 2013 | B2 |
8403845 | Stivoric et al. | Mar 2013 | B2 |
8416579 | Biesheuvel et al. | Apr 2013 | B2 |
8475371 | Derchak et al. | Jul 2013 | B2 |
8540363 | Abreu | Sep 2013 | B2 |
8739397 | Nagata et al. | Jun 2014 | B2 |
8798708 | Tremblay | Aug 2014 | B2 |
8862431 | Hodge | Oct 2014 | B2 |
8925393 | Cannard et al. | Jan 2015 | B2 |
8945328 | Longinotti-Buitoni et al. | Feb 2015 | B2 |
8948839 | Longinotti-Buitoni et al. | Feb 2015 | B1 |
8954129 | Schlegel et al. | Feb 2015 | B1 |
9282893 | Longinotti-Buitoni et al. | Mar 2016 | B2 |
9566032 | Babaeizadeh et al. | Feb 2017 | B2 |
9582072 | Connor | Feb 2017 | B2 |
9802080 | Burich et al. | Oct 2017 | B2 |
9817440 | Longinotti-Buitoni et al. | Nov 2017 | B2 |
9979547 | Starner et al. | May 2018 | B2 |
10039354 | Van der Laan | Aug 2018 | B2 |
10045439 | Longinotti-Buitoni et al. | Aug 2018 | B2 |
10154791 | Longinotti-Buitoni et al. | Dec 2018 | B2 |
10159440 | Longinotti-Buitoni et al. | Dec 2018 | B2 |
20020093515 | Fay et al. | Jul 2002 | A1 |
20030139692 | Barrey et al. | Jul 2003 | A1 |
20040115430 | Leonard | Jun 2004 | A1 |
20040249242 | Lau et al. | Dec 2004 | A1 |
20050022894 | Shannon | Feb 2005 | A1 |
20050029680 | Jung et al. | Feb 2005 | A1 |
20050058744 | Steinberg et al. | Mar 2005 | A1 |
20050067816 | Buckman | Mar 2005 | A1 |
20050107722 | Ozaki et al. | May 2005 | A1 |
20050228234 | Yang | Oct 2005 | A1 |
20060007059 | Bell | Jan 2006 | A1 |
20060062993 | Ogata et al. | Mar 2006 | A1 |
20060080182 | Thompson et al. | Apr 2006 | A1 |
20060124470 | Zama et al. | Jun 2006 | A1 |
20060139165 | Bader | Jun 2006 | A1 |
20060155182 | Mazzarolo | Jul 2006 | A1 |
20070000912 | Aisenbrey | Jan 2007 | A1 |
20070046720 | Konno et al. | Mar 2007 | A1 |
20070049842 | Hill et al. | Mar 2007 | A1 |
20070151312 | Bruce et al. | Jul 2007 | A1 |
20070153363 | Gruner | Jul 2007 | A1 |
20070177770 | Derchak | Aug 2007 | A1 |
20070178716 | Glaser et al. | Aug 2007 | A1 |
20070202765 | Krans et al. | Aug 2007 | A1 |
20070293781 | Sims et al. | Dec 2007 | A1 |
20080045815 | Derchak et al. | Feb 2008 | A1 |
20080058744 | Tippey et al. | Mar 2008 | A1 |
20080064964 | Nagata et al. | Mar 2008 | A1 |
20080083720 | Gentile et al. | Apr 2008 | A1 |
20080083721 | Kaiserman et al. | Apr 2008 | A1 |
20080083740 | Kaiserman et al. | Apr 2008 | A1 |
20080171914 | Ouwerkerk et al. | Jul 2008 | A1 |
20080177168 | Callahan et al. | Jul 2008 | A1 |
20080234561 | Roesicke et al. | Sep 2008 | A1 |
20080241391 | Kim et al. | Oct 2008 | A1 |
20080246629 | Tsui et al. | Oct 2008 | A1 |
20080255794 | Levine | Oct 2008 | A1 |
20080258921 | Woo et al. | Oct 2008 | A1 |
20080269629 | Reiner | Oct 2008 | A1 |
20080269652 | Reiner | Oct 2008 | A1 |
20080287769 | Kurzweil et al. | Nov 2008 | A1 |
20080287770 | Kurzweil et al. | Nov 2008 | A1 |
20080294019 | Tran | Nov 2008 | A1 |
20090012408 | Nagata et al. | Jan 2009 | A1 |
20090018410 | Coene et al. | Jan 2009 | A1 |
20090105795 | Minogue et al. | Apr 2009 | A1 |
20090112078 | Tabe | Apr 2009 | A1 |
20090157327 | Nissila | Jun 2009 | A1 |
20090227856 | Russell et al. | Sep 2009 | A1 |
20090281394 | Russell et al. | Nov 2009 | A1 |
20090286055 | Pourdeyhimi et al. | Nov 2009 | A1 |
20100004720 | Li et al. | Jan 2010 | A1 |
20100029598 | Kopitz et al. | Feb 2010 | A1 |
20100041974 | Ting et al. | Feb 2010 | A1 |
20100059274 | Ives et al. | Mar 2010 | A1 |
20100071205 | Graumann et al. | Mar 2010 | A1 |
20100077528 | Lind et al. | Apr 2010 | A1 |
20100112195 | Kodas et al. | May 2010 | A1 |
20100113910 | Brauers et al. | May 2010 | A1 |
20100149567 | Kanazawa et al. | Jun 2010 | A1 |
20100176952 | Bajcsy et al. | Jul 2010 | A1 |
20100185062 | Salazar et al. | Jul 2010 | A1 |
20100185398 | Berns et al. | Jul 2010 | A1 |
20100194815 | Furukawa | Aug 2010 | A1 |
20100198038 | Nagata et al. | Aug 2010 | A1 |
20100234715 | Shin et al. | Sep 2010 | A1 |
20100274100 | Behar et al. | Oct 2010 | A1 |
20100292598 | Roschk et al. | Nov 2010 | A1 |
20100309209 | Hodgins et al. | Dec 2010 | A1 |
20100312071 | Schenk | Dec 2010 | A1 |
20100324405 | Niemi et al. | Dec 2010 | A1 |
20110000412 | Chung et al. | Jan 2011 | A1 |
20110015498 | Mestrovic et al. | Jan 2011 | A1 |
20110028815 | Simpson et al. | Feb 2011 | A1 |
20110032103 | Bhat et al. | Feb 2011 | A1 |
20110042125 | Lee et al. | Feb 2011 | A1 |
20110087115 | Sackner et al. | Apr 2011 | A1 |
20110092795 | Derchak | Apr 2011 | A1 |
20110100683 | Bhattacharya et al. | May 2011 | A1 |
20110102304 | Nelson | May 2011 | A1 |
20110115624 | Tran | May 2011 | A1 |
20110125064 | Shyr | May 2011 | A1 |
20110130643 | Derchak et al. | Jun 2011 | A1 |
20110144457 | Coulon | Jun 2011 | A1 |
20110181238 | Soar | Jul 2011 | A1 |
20110183068 | Yamakawa et al. | Jul 2011 | A1 |
20110184270 | Russell et al. | Jul 2011 | A1 |
20110259638 | Sherrill et al. | Oct 2011 | A1 |
20110267578 | Wilson | Nov 2011 | A1 |
20110277206 | Sokolowski | Nov 2011 | A1 |
20110288605 | Kaib et al. | Nov 2011 | A1 |
20120024833 | Klewer et al. | Feb 2012 | A1 |
20120029299 | Deremer et al. | Feb 2012 | A1 |
20120030935 | Slade et al. | Feb 2012 | A1 |
20120031431 | Carlson et al. | Feb 2012 | A1 |
20120035426 | Mielcarz et al. | Feb 2012 | A1 |
20120071039 | Debock et al. | Mar 2012 | A1 |
20120071793 | Gal | Mar 2012 | A1 |
20120078127 | McDonald et al. | Mar 2012 | A1 |
20120088986 | David et al. | Apr 2012 | A1 |
20120101357 | Hoskuldsson et al. | Apr 2012 | A1 |
20120118427 | Brookstein et al. | May 2012 | A1 |
20120127687 | Allee et al. | May 2012 | A1 |
20120136231 | Markel | May 2012 | A1 |
20120143093 | Stirling et al. | Jun 2012 | A1 |
20120144551 | Guldalian | Jun 2012 | A1 |
20120144561 | Begriche et al. | Jun 2012 | A1 |
20120144934 | Russell et al. | Jun 2012 | A1 |
20120146797 | Oskin et al. | Jun 2012 | A1 |
20120156933 | Kreger et al. | Jun 2012 | A1 |
20120158074 | Hall | Jun 2012 | A1 |
20120165645 | Russell et al. | Jun 2012 | A1 |
20120165717 | Al Khaburi | Jun 2012 | A1 |
20120184826 | Keenan et al. | Jul 2012 | A1 |
20120188158 | Tan et al. | Jul 2012 | A1 |
20120197224 | Chagger | Aug 2012 | A1 |
20120215076 | Yang et al. | Aug 2012 | A1 |
20120223833 | Thomas et al. | Sep 2012 | A1 |
20120233751 | Hexels | Sep 2012 | A1 |
20120238845 | Yang | Sep 2012 | A1 |
20120246795 | Scheffler et al. | Oct 2012 | A1 |
20120255166 | Kim et al. | Oct 2012 | A1 |
20120324616 | Hyde et al. | Dec 2012 | A1 |
20120330109 | Tran | Dec 2012 | A1 |
20130013331 | Horseman | Jan 2013 | A1 |
20130019372 | Esses | Jan 2013 | A1 |
20130019383 | Korkala et al. | Jan 2013 | A1 |
20130041272 | Guillen et al. | Feb 2013 | A1 |
20130053674 | Volker | Feb 2013 | A1 |
20130066168 | Yang et al. | Mar 2013 | A1 |
20130072777 | Tremblay | Mar 2013 | A1 |
20130077263 | Oleson et al. | Mar 2013 | A1 |
20130079860 | Besio | Mar 2013 | A1 |
20130144111 | Wang et al. | Jun 2013 | A1 |
20130179288 | Moses et al. | Jul 2013 | A1 |
20130211208 | Varadan | Aug 2013 | A1 |
20130212900 | Stewart | Aug 2013 | A1 |
20130231711 | Kaib | Sep 2013 | A1 |
20130244121 | Gogotsi et al. | Sep 2013 | A1 |
20130245423 | Derchak et al. | Sep 2013 | A1 |
20130281795 | Varadan | Oct 2013 | A1 |
20130314668 | Haddadi et al. | Nov 2013 | A1 |
20140061273 | Bullivant et al. | Mar 2014 | A1 |
20140100436 | Brunner et al. | Apr 2014 | A1 |
20140135593 | Jayalth et al. | May 2014 | A1 |
20140135602 | Lemke | May 2014 | A1 |
20140172134 | Casillas et al. | Jun 2014 | A1 |
20140182880 | Simenhaus et al. | Jul 2014 | A1 |
20140206948 | Romem | Jul 2014 | A1 |
20140303470 | Tsukada et al. | Oct 2014 | A1 |
20140312027 | Augustine et al. | Oct 2014 | A1 |
20140352023 | Mordecai et al. | Dec 2014 | A1 |
20150143601 | Longinotti-Buitoni et al. | May 2015 | A1 |
20150289820 | Miller et al. | Oct 2015 | A1 |
20150342266 | Cooper et al. | Dec 2015 | A1 |
20160148531 | Bleich | May 2016 | A1 |
20160253487 | Sarkar | Sep 2016 | A1 |
20160262462 | Kawamura et al. | Sep 2016 | A1 |
20160314576 | Aliverti et al. | Oct 2016 | A1 |
20170084100 | Shibutani | Mar 2017 | A1 |
20170112440 | Mauri et al. | Apr 2017 | A1 |
20170319132 | Longinotti-Buitoni et al. | Nov 2017 | A1 |
20180004924 | Tieu | Jan 2018 | A1 |
20180038041 | Longinotti-Buitoni et al. | Feb 2018 | A1 |
20180184735 | Longinotti-Buitoni et al. | Jul 2018 | A1 |
20180199635 | Longinotti-Buitoni et al. | Jul 2018 | A1 |
20180249767 | Begriche et al. | Sep 2018 | A1 |
20180271441 | Dabby | Sep 2018 | A1 |
20180317814 | Nurkka | Nov 2018 | A1 |
20180376586 | Longinotti-Buitoni et al. | Dec 2018 | A1 |
20200065960 | Aliverti et al. | Feb 2020 | A1 |
20200068708 | Longinotti-Buitoni et al. | Feb 2020 | A1 |
Number | Date | Country |
---|---|---|
1294504 | May 2001 | CN |
1985761 | Dec 2006 | CN |
101108125 | Jan 2008 | CN |
101917903 | Dec 2010 | CN |
102970925 | Mar 2013 | CN |
1057923 | Dec 2000 | EP |
1335831 | Aug 2003 | EP |
1478249 | Nov 2004 | EP |
1509128 | Mar 2005 | EP |
1622512 | Feb 2006 | EP |
1709903 | Oct 2006 | EP |
1905112 | Apr 2008 | EP |
1907075 | Apr 2008 | EP |
1925718 | May 2008 | EP |
2025369 | Feb 2009 | EP |
2191737 | Jun 2010 | EP |
2196142 | Jun 2010 | EP |
2217145 | Aug 2010 | EP |
2314744 | Apr 2011 | EP |
3037036 | Jun 2016 | EP |
H05-77208 | Oct 1993 | JP |
2008229084 | Oct 2008 | JP |
2009228161 | Oct 2009 | JP |
2011521122 | Jul 2011 | JP |
2012526204 | Oct 2012 | JP |
2012214968 | Nov 2012 | JP |
2015206130 | Nov 2015 | JP |
WO9006189 | Jun 1990 | WO |
WO0016493 | Mar 2000 | WO |
WO0101855 | Jan 2001 | WO |
WO03000015 | Jan 2003 | WO |
WO03060449 | Jul 2003 | WO |
WO2004076731 | Sep 2004 | WO |
WO2004107831 | Dec 2004 | WO |
WO2005032447 | Apr 2005 | WO |
WO2005067796 | Jul 2005 | WO |
WO2005096133 | Oct 2005 | WO |
WO2006064447 | Jun 2006 | WO |
WO2006102538 | Sep 2006 | WO |
WO2007056557 | May 2007 | WO |
WO2008137046 | Nov 2008 | WO |
WO2008153786 | Dec 2008 | WO |
WO2009040696 | Apr 2009 | WO |
WO2009112281 | Sep 2009 | WO |
WO2010038176 | Apr 2010 | WO |
WO2010044018 | Apr 2010 | WO |
WO2010058346 | May 2010 | WO |
WO2010085671 | Jul 2010 | WO |
WO2010085688 | Jul 2010 | WO |
WO2010096907 | Sep 2010 | WO |
WO2010120945 | Oct 2010 | WO |
WO2010139087 | Dec 2010 | WO |
WO2011092620 | Aug 2011 | WO |
WO2011131235 | Oct 2011 | WO |
WO2011156095 | Dec 2011 | WO |
WO2012011068 | Jan 2012 | WO |
WO2012060524 | May 2012 | WO |
WO2012066056 | May 2012 | WO |
WO2012073076 | Jun 2012 | WO |
WO2012073230 | Jun 2012 | WO |
WO2012083066 | Jun 2012 | WO |
WO2012104484 | Aug 2012 | WO |
WO2012110954 | Aug 2012 | WO |
WO2012112186 | Aug 2012 | WO |
WO2012113014 | Aug 2012 | WO |
WO2012140079 | Oct 2012 | WO |
WO2012140522 | Oct 2012 | WO |
WO2012168836 | Dec 2012 | WO |
WO2012176193 | Dec 2012 | WO |
WO2014025430 | Feb 2014 | WO |
WO2014075682 | May 2014 | WO |
WO2014204323 | Dec 2014 | WO |
WO2015103620 | Jul 2015 | WO |
WO2015138515 | Sep 2015 | WO |
WO2016035350 | Mar 2016 | WO |
Entry |
---|
Longinotti-Buitoni et al., U.S. Appl. No. 16/231,587 entitled “Physiological monitoring garments,” filed Dec. 23, 2018. |
Aliverti et al.; Compartmental analysis of breathing in the supine and prone positions by optoelectronic plethysmography; Ann Biomed Eng; 29(1):60-70; Jan. 2001. |
Babchenko et al.; Fiber optic sensor for the measurement of respiratory chest circumference changes; J Biomed Opt; 4(2):224-229; Apr. 1999. |
Cala et al.; Chest wall and lung volume estimation by optical reflectance motion analysis; J Appl Physiol; 81(6):2680-2689; Dec. 1996. |
Chadha et al.; Validation of respiratory inductive plethysmography using different calibration procedures; Am Rev Respir Dis; 125:644-649; Jun. 1982. |
Chen et al.; Color structured light system of chest wall motion measurement for respiratory volume evaluation; J Biomed Opt; 15(2):026013; Mar.-Apr. 2010. |
Chourabi et al.; Understanding smart cities: An integrative framework; 45th Hawii International Conference on System Sciences; pp. 2289-2297; Jan. 4, 2012. |
D'Angelo et al.; A system for respiratory motion detection using optical fibers embedded into textiles; Conf Proc IEEE Med Biol Soc; 3694-3697; Aug. 2008. |
Dodgson; Variation and extrema of human interpupillary distance; Prod. of SPIE: Stereoscopic Displays and Virtual Reality Systems XI; vol. 5291; pp. 36-46; Jan. 2004. |
Ferrigno et al.; Three-dimensional optical analysis of chest wall motion; J Appl Physiol; 77(3):1224-1231; Sep. 1994. |
Gramse et al.; Novel concept for a noninvasive cardiopulmonary monitor for infants: a pair of pajamas with an integrated sensor module; Ann Biomed Eng; 31(2):152-158; Feb. 2003. |
Heilman et al.; Accuracy of the LifeShirt (Vivometrics) in the detection of cardiac rhythms; Biol Psychol; 75(3):300-305; Jul. 2007. |
Hossain et al.; Human identity verification by using physiological and behavioural biometric traits; International Journal of Bioscience, Biochemistry and Bioinformatics; 1(3); pp. 199-205; Sep. 2011. |
Kenyon et al.; Rib cage mechanics during quiet breathing and exercise in humans; J Appl Physiol; 83(4):1242-1255; Oct. 1997. |
Konno et al.; Measurement of the separate volume changes of rib cage and abdomen during breathing; J Appl Physiol; 22(3):407-422; Mar. 1967. |
Lafortuna et al.; A new instrument for the measurement of rib cage and abdomen circumference variation in respiration at rest and during exercise; Eur J Appl Physiol Occup Physiol; 71(2-3):259-265; Mar. 1995. |
Milledge et al.; Inductive plethysmography—a new respiratory transducer; J Physiol; 267(1):4P-5P; May 1977. |
Peacock et al.; Optical mapping of the thoracoabdominal wall; Thorax; 39(2):93-100; Feb. 1984. |
Peacock et al.; Optical measurement of the change in trunk volume with breathing; Bull Eur Physiopathol Respir; 21(2):125-129; Mar.-Apr. 1985. |
Pennock B.E.; Rib cage and abdominal piezoelectric film belts to measure ventilatory airflow; J Clin Monit; 6(4):276-283; Oct. 1990. |
Purao et al.; Modeling citizen-centric services in smart cities; 32nd. International Conference on Conceptual Modeling; Hong Kong; pp. 438-445; (8 pages, retrieved from the internet at https://icity.smu.edu.sg/sites/icity.smu.edu.sg/files/publications/Modeling-Citizen-centric-Services-in-Smart-Cities_ER2013.pdf); Nov. 11-13, 2013. |
Sackner et al.; Calibration of respiratory inductive plethysmograph during natural breathing; J Appl Physiol; 66(1):410-420; Jan. 1989. |
Saumarez; Automated optical measurements of human torso surface movements during freathing; J. Appl. Physiol.; 60(2); pp. 702-709; Feb. 1986. |
Zimmerman et al.; Postural changes in rib cage and abdominal volume-motion coefficients and their effect on the calibration of a respiratory inductance plethysmograph; Am Rev Respir Dis; 127(2):209-214; Feb. 1983. |
Qian Junhao; Constitution of Conductive Ink; New Ink Printing Technology; Chinese Light Industry Press; pp. 64-66; (English Summary Included); Jan. 2002. |
Yan Suzhai et al.; 984. Conductive materials can be divided into what kind of two major categories according to material properties; 1000 Questions on Screen Printing Ink; Printing Industry Press; pp. 241-242; (English Summary Included); Apr. 2005. |
Pang et al.; Review on fabric-based sensor; Industrial Textiles; Issue 6, (English Summary Included); (year of pub. sufficiently earlier than effective US filing date and any foreign priority date); 2012. |
Longinotti-Buitoni et al.; U.S. Appl. No. 16/875,700 entitled “Flexible fabric ribbon connectors for garments with sensors and electronics,” filed May 15, 2020. |
Number | Date | Country | |
---|---|---|---|
20190133474 A1 | May 2019 | US |
Number | Date | Country | |
---|---|---|---|
62357665 | Jul 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15640963 | Jul 2017 | US |
Child | 16222603 | US |