Patent Application
20240000315
Embodiments herein relate to ear-wearable devices configured to detect aberrant patterns indicative of events related to the safety or health of a wearer of an ear-wearable device.
Early intervention is important for successfully addressing scenarios that impact the safety or health of an individual. For example, if an individual suffering from a condition such as Alzheimer's wanders away from their home or residential care unit they could be seriously hurt or killed. The faster their absence can be detected, the faster they can be brought back to the safety of their proper location. As another example, if administered within three hours of an ischemic stroke, tissue plasminogen activator can dissolve blood clots and thereby improve blood flow and improving the chances of recovering from a stroke. Unfortunately, the individual suffering the stroke may not recognize what they are experiencing and/or may not be in a condition to seek assistance independently. As such, it can be difficult for some individuals to receive a timely therapeutic intervention.
Embodiments herein relate to ear-wearable devices configured to detect aberrant patterns indicative of events related to the safety or health of a wearer and related methods. In a first aspect, an ear-wearable device is included having a control circuit, a microphone, a motion sensor, and a power supply. The ear-wearable device is configured to monitor signals from the microphone and/or the motion sensor to identify an aberrant pattern, and issue an alert when an aberrant pattern is detected.
In a second aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the ear-wearable device is configured to record data based on signals from the microphone and/or the motion sensor to establish a baseline pattern.
In a third aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern indicates an increase in restlessness.
In a fourth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant sleeping pattern.
In a fifth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleep duration.
In a sixth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes aberrant sleep disruptions.
In a seventh aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant number of times getting up.
In an eighth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant time to falling asleep.
In a ninth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant duration from waking to rising in the morning.
In a tenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleeping heart rate.
In an eleventh aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleeping breathing pattern.
In a twelfth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes a change in eating or drinking habits.
In a thirteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant movement pattern.
In a fourteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the movement pattern includes an aberrant pattern with respect to a number of steps taken, standing time, and/or movement.
In a fifteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant geolocation movement pattern.
In a sixteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant geolocation movement pattern includes wandering.
In a seventeenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant head movement pattern.
In an eighteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant ambulation pattern.
In a nineteenth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant bathroom use pattern.
In a twentieth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant speech pattern.
In a twenty-first aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant nonverbal vocalization pattern.
In a twenty-second aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the alert is sent to another party.
In a twenty-third aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the another party includes at least one of a family member, a care provider, and a health care professional.
In a twenty-fourth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern is associated with safety, nutritional/hydration status, or new or deteriorating health conditions of a wearer of the ear-wearable device.
In a twenty-fifth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the alert includes a present location of a wearer of the ear-wearable device.
In a twenty-sixth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the ear-wearable device is configured to determine the present location using at least one of a satellite signal, a BLUETOOTH signal, a WIFI signal, a cellular network signal, a wireless beacon, an accessory device, and dead reckoning.
In a twenty-seventh aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the alert includes a last-known location of a wearer of the ear-wearable device.
In a twenty-eighth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes a change in habits or patterns related to activities of daily living.
In a twenty-ninth aspect, a method of passively monitoring a wearer of an ear-wearable device is included, the method can include monitoring signals from a microphone and/or a motion sensor, comparing the monitored signals with a baseline pattern to detect aberrant patterns, and issuing an alert when an aberrant pattern is detected.
In a thirtieth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the method can further include recording data based on signals from the microphone and/or the motion sensor to establish the baseline pattern.
In a thirty-first aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern indicates an increase in restlessness.
In a thirty-second aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant sleeping pattern.
In a thirty-third aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleep duration.
In a thirty-fourth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes aberrant sleep disruptions.
In a thirty-fifth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant number of times getting up.
In a thirty-sixth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant time to falling asleep.
In a thirty-seventh aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant duration from waking to rising in the morning.
In a thirty-eighth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleeping heart rate.
In a thirty-ninth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant sleeping pattern includes an aberrant sleeping breathing pattern.
In a fortieth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes a change in eating or drinking habits.
In a forty-first aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant movement pattern.
In a forty-second aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the movement pattern includes an aberrant pattern with respect to a number of steps taken, standing time, and/or movement.
In a forty-third aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant geolocation movement pattern.
In a forty-fourth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant geolocation movement pattern includes wandering.
In a forty-fifth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant head movement pattern.
In a forty-sixth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant ambulation pattern.
In a forty-seventh aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant bathroom use pattern.
In a forty-eighth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant speech pattern.
In a forty-ninth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes an aberrant nonverbal vocalization pattern.
In a fiftieth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern includes a change in habits or patterns related to activities of daily living.
In a fifty-first aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the method can further include sending the alert to another party.
In a fifty-second aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the another party includes at least one of a family member, a care provider, and a health care professional.
In a fifty-third aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the aberrant pattern is associated with safety, nutritional/hydration status, or new or deteriorating health conditions of a wearer of the ear-wearable device.
In a fifty-fourth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the alert includes a present location of a wearer of the ear-wearable device.
In a fifty-fifth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the method can further include determining the present location using at least one of a satellite signal, a BLUETOOTH signal, a WIFI signal, a cellular network signal, a wireless beacon, an accessory device, and dead reckoning.
In a fifty-sixth aspect, in addition to one or more of the preceding or following aspects, or in the alternative to some aspects, the alert includes a last-known location of a wearer of the ear-wearable device.
This summary is an overview of some of the teachings of the present application and is not intended to be an exclusive or exhaustive treatment of the present subject matter. Further details are found in the detailed description and appended claims. Other aspects will be apparent to persons skilled in the art upon reading and understanding the following detailed description and viewing the drawings that form a part thereof, each of which is not to be taken in a limiting sense. The scope herein is defined by the appended claims and their legal equivalents.
Aspects may be more completely understood in connection with the following figures (FIGS.), in which:
While embodiments are susceptible to various modifications and alternative forms, specifics thereof have been shown by way of example and drawings, and will be described in detail. It should be understood, however, that the scope herein is not limited to the particular aspects described. On the contrary, the intention is to cover modifications, equivalents, and alternatives falling within the spirit and scope herein.
As referenced above, early intervention is important for successfully addressing scenarios that impact the safety or health of an individual. For example, if an individual suffering from a condition such as Alzheimer's wanders away from their home or residential care unit they could be seriously hurt or killed. The faster their absence can be detected, the faster they can be brought back to the safety of their proper location.
In accordance with embodiments herein, ear-wearable devices can be used to rapidly identify aberrant patterns which may be indicative of a scenario impacting the health and/or safety of an individual wearing the ear-wearable device.
In specific, ear-wearable devices described herein can include sensors such as microphones, motion sensors, and others and can monitor signals from these sensors so as to quickly identify aberrant patterns that may indicative of a scenario impacting the health and/or safety of an individual and, in some embodiments, send an alert in order to request medical assistance. For example, ear-wearable devices herein can monitor signals from various sensors to detect changes reflecting aberrant patterns. In specific, ear-wearable devices herein can monitor signals from a motion sensor to detect patterns of movement or the lack thereof reflecting an aberrant pattern. In various embodiments, ear-wearable devices herein can monitor the geolocation of an individual wearing the ear-wearable device(s) to detect aberrant location patterns, such as that consistent with an individual leaving the safety of their home or a care facility.
Referring now to
If a pattern indicative of an event impacting the health and/or safety of the device wearer is detected, then the device or system can take various actions. In some embodiments, the device or system can take actions to confirm that the detected pattern actually represents an event impacting the health and/or safety of the device wearer. This confirmation can be performed in various ways. In some embodiments, the ear-wearable device 120 is configured to query the device wearer 100 (or a different person in an alerting scenario such as a family member, a care giver, or a health professional) if a pattern indicative of one or more of an event impacting the health and/or safety of the device wearer is detected. In some embodiments, the query can take the form of a simple question or series of questions. In some embodiments, the query can take the form of a request for the device wearer 100 to do something. Depending on the response to the query (explicit response or observed response), the system can take appropriate responsive action.
In some embodiments, if a pattern consistent with a scenario impacting the health and/or safety of the device wearer is detected (e.g., an aberrant pattern), the device or system can start a time clock period (or “cautionary period”) wherein it continues to evaluate signals and/or inputs for a recurrence of a pattern consistent with a scenario impacting the health and/or safety of the device wearer to serve as confirmation. In some cases, if the pattern is detected again within the time clock period, then the system or device can confirm that an event impacting the health and/or safety of the device wearer is indicated and take some type of alerting or corrective action. However, if the pattern is not detected again, then in some embodiments the event is logged, but no action is taken. For example, if the first detected pattern represents an actual incidence of event impacting the health and/or safety of the device wearer, then it would generally be expected that the pattern will recur. On the contrary, if the detected pattern is spurious, then it would be expected that the pattern would not recur. As such, by continuing to monitor signals during this time clock period, then the device can confirm whether or not an event impacting the health and/or safety of the device wearer is actually taking place. The time clock period can vary. In some embodiments, the time clock period can be about 1, 2, 3, 4, 5, 6, 7, 8, 10, 15, 20, 30 or 60 minutes or an amount of time falling within a range between any of the foregoing.
In some cases, the system or device may cut short or abbreviate the time clock period if patterns are detected sufficient to make waiting the rest of the time clock period unnecessary. For example, if a different type of pattern is detected that is also indicative of a substantial injury (e.g., an initial pattern is identified by evaluating signals from a motion sensor indicating a sudden loss of coordination and, simultaneously or sequentially, evaluation of the device-wearer's speech-language indicates confusion) then the time clock period can be cut short and corrective actions can be taken immediately. In such a scenario, the use of multiple sensors and/or inputs to assist in identifying an injury can improve efficiency and accuracy and reduce the amount of time that elapses before a corrective action is initiated. In some embodiments, the system or device can cut short or abbreviate the time clock period if one or more patterns are identified that generates a high confidence that a substantial insult/injury has taken place.
Corrective actions (or responsive actions) herein can take on many different forms. In various embodiments, the ear-wearable device 120 is configured to generate an alert if an aberrant pattern indicating an event impacting the health and/or safety of the device wearer is detected. Alerts can take on various forms. In some embodiments, the alert can be an electronic message to a third party or a system where a third party can receive the electronic message. In some embodiments, the alert can be a message delivered to emergency first responders. In some embodiments, the corrective action can take the form of initiating a call to an emergency service such as 911 or the like.
In some embodiments, an alert can be generated according to a tiered alert classification. The tiered alert classification can include various levels of perceived danger and/or injury severity and/or certainty thereof. In some embodiments, the levels can include severe, moderate, and mild. Because the timing for mitigation can be critical, in various embodiments, the ear-wearable device 120 wherein the ear-wearable device 120 is configured to mark the time of first detection of a pattern indicative of an event impacting the health and/or safety of the device wearer and subsequently transmit the same for receipt by a care provider.
As described above, it is critical for an individual experiencing an event impacting their health and/or safety that the event is dealt with as quickly as possible. In some embodiments, devices or systems herein can be configured to initiate a mitigating action if a pattern of an occurrence of an event impacting the health and/or safety of the device wearer is detected. In some embodiments, such actions can be taken if the device or system determines that the danger or probability of injury is severe according to a tiered alert classification. In some embodiments, initiating a mitigating action can include sending or issuing a request for therapy to a third party such as a care provider, a clinician, an emergency services responder, or the like.
In some embodiments initiating the administration of a therapy can include issuing a verbal, visual, or tactile instruction to the wearer to take a medication. In some embodiments the system can confirm that the wearer has taken a medication using methods such as those taught in Ser. No. 16/802,113 “SYSTEM ANI) METHOD FOR. MANAGING PHARMACOLOGICAL THERAPEUTICS INCLUDING A HEALTH MONITORING DEVICE”. In some embodiments, the system can send an alert or notification to a third party to inform them that the wearer has taken/not taken a medication in following the instruction.
It will be appreciated that many different aspects of the device wearer 100 can be monitored in order to detect aberrant patterns. Further, many different types of aberrant patterns are specifically contemplated herein. In some embodiments, the aberrant pattern indicates an increase in restlessness. In some embodiments, the aberrant pattern comprises an aberrant sleeping pattern. In some embodiments, the aberrant sleeping pattern comprises an aberrant sleep duration. In some embodiments, the aberrant sleeping pattern comprises aberrant sleep disruptions. In some embodiments, the aberrant sleeping pattern comprises an aberrant number of times getting up. In some embodiments, the aberrant sleeping pattern comprises an aberrant time to falling asleep. In some embodiments, the aberrant sleeping pattern comprises an aberrant duration from waking to rising in the morning. In some embodiments, the aberrant sleeping pattern comprises an aberrant sleeping heart rate. In some embodiments, the aberrant sleeping pattern comprises an aberrant sleeping breathing pattern. In some embodiments, the aberrant pattern comprises a change in eating or drinking habits. In some embodiments, the aberrant pattern comprises an aberrant movement pattern. In some embodiments, the movement pattern comprises an aberrant pattern with respect to a number of steps taken, standing time, and/or movement. In some embodiments, the aberrant pattern comprises an aberrant geolocation movement pattern. In some embodiments, the aberrant geolocation movement pattern comprises wandering. In some embodiments, the aberrant pattern comprises an aberrant head movement pattern. In some embodiments, the aberrant pattern comprises an aberrant ambulation pattern. In some embodiments, the aberrant pattern comprises an aberrant bathroom use pattern. In some embodiments, the aberrant pattern comprises an aberrant speech pattern. In some embodiments, the aberrant pattern comprises an aberrant nonverbal vocalization pattern.
In some embodiments, the aberrant pattern can relate to health-related data. Aspects of health-related data types are described in U.S. Publ. Appl. No. 2020/0273566, the content of which is herein incorporated by reference.
In some embodiments the ear-wearable device 120 can include a motion sensor (amongst other sensors) and can sense movement of the device wearer 100. For example, with respect to both the head 102 of the device wearer 100 and other parts of their body, the system or device can sense rotational movement 202 (within multiple planes), front to back movement 204, up and down movement 206, pitch, roll, yaw, twisting motions, and the like. Referring now to
As referenced above, many different patterns can be detected by the ear-wearable device and/or the ear-wearable device system in order to indicate the presence of an aberrant pattern which may reflect a scenario impacting the health and/or safety of an individual. For example, in some embodiments, the ear-wearable device 120 can detect a pattern that is indicative of motor impairment. In various embodiments, the ear-wearable device 120 can detect a pattern is indicative of one or more of gait ataxia, difficulty standing or walking, or a sudden decrease in motor coordination. In various embodiments, the ear-wearable device 120 can detect a pattern is indicative of onset of dizziness or imbalance. In various embodiments, the ear-wearable device 120 wherein the ear-wearable device 120 is configured to detect a non-volitional body movement.
In some embodiments, patterns herein can relate to the individual's gait and which can be detected with a motion sensor herein including, for example, gait speed, step distance, bilateral step comparison, footfall magnitude, and the like.
In some embodiments, systems herein can include and/or receive inputs from or send outputs to other types of devices other than one or more ear-wearable devices. For example, in some embodiments the ear-wearable device can include or can receive inputs from a cardiac sensor. In such a case, a pattern herein can include a cardiac pattern such as atrial fibrillation. In some embodiments, a pattern herein can include a cardiac pattern such as beat variability.
In some cases, the system can include a motion sensor to pick up essential tremors (unintentional, somewhat rhythmic, muscle movement involving to-and-fro movements or oscillations of one or more parts of the body) of the wearer. By way of example, some individuals suffering from an adverse event suffer uncontrollable shaking that can be identified within the signals of various sensors herein including motion sensors.
In accordance with various embodiments herein, information regarding geospatial location can be used in order to detect aberrant location patterns. In various embodiments herein, the ear-wearable devices 110, 210, and/or an accessory device thereto can be used to interface with a system or component in order to determine geospatial location. Referring now to
As previously stated, the ear-wearable devices 120, 320, and/or an accessory device thereto can be used to interface with a system or component in order to determine geospatial location. For example, the ear-wearable devices 120, 320, and/or an accessory device thereto can be used to interface with a locating device 342, a BLUETOOTH beacon 344, a cell tower 246, a WIFI router 248, a satellite 350, or the like. In various embodiments, the system can be configured with data cross referencing specific geospatial coordinates with environments of relevant for the individual device wearer. In some embodiments, the last known location of an individual can be stored so that if a present location cannot be determined, some information regarding location can still be provided.
Referring now to
It can be appreciated that while the ear-wearable device 120 should respond to patterns indicative of scenarios associated with the device wearer 100, that it should typically not take the same actions when such patterns are only detected in that of a third party. As such, in various embodiments herein, the device or system can distinguish between speech or sounds associated with the device wearer 100 from speech or sounds associated with a third party. Processing to distinguish between the two can be executed by any devices of the system individually or by a combination of devices of the system. In some embodiments, data used for distinguishing can be exported from an ear-wearable device or devices to one or more separate devices for processing.
Distinguishing between speech or sounds associated with the device wearer 100 and speech or sounds associated with a third party can be performed in various ways. In some embodiments, this can be performed through signal analysis of the signals generated from the microphone(s). For example, in some embodiments, this can be done by filtering out frequencies of sound that are not associated with speech of the device-wearer. In some embodiments, such as where there are two or more microphones (on the same ear-wearable device or on different ear-wearable devices) this can be done through spatial localization of the origin of the speech or other sounds and filtering out, spectrally subtracting, or otherwise discarding sounds that do not have an origin within the device wearer 100. In some embodiments, such as where there are two or more ear-worn devices, own-voice detection can be performed and/or enhanced through correlation or matching of intensity levels and or timing.
In some cases, the system can include a bone conduction microphone in order to preferentially pickup the voice of the device wearer. In some cases, the system can include a directional microphone that is configured to preferentially pickup the voice of the device wearer. In some cases the system can include an intracanal microphone (a microphone configured to be disposed within the ear-canal of the device wearer) to preferentially pickup the voice of the device wearer. In some cases, the system can include a motion sensor (e.g., an accelerometer configured to be on or about the head of the wearer) to preferentially pick up skull vibrations associated with the vocal productions of the device wearer.
In some cases, an adaptive filtering approach can be used. By way of example, a desired signal for an adaptive filter can be taken from a first microphone and the input signal to the adaptive filter is taken from the second microphone. If the hearing aid wearer is talking, the adaptive filter models the relative transfer function between the microphones. Own-voice detection can be performed by comparing the power of an error signal produced by the adaptive filter to the power of the signal from the standard microphone and/or looking at the peak strength in the impulse response of the filter. The amplitude of the impulse response should be in a certain range in order to be valid for the own voice. If the user's own voice is present, the power of the error signal will be much less than the power of the signal from the standard microphone, and the impulse response has a strong peak with an amplitude above a threshold. In the presence of the user's own voice, the largest coefficient of the adaptive filter is expected to be within a particular range. Sound from other noise sources results in a smaller difference between the power of the error signal and the power of the signal from the standard microphone, and a small impulse response of the filter with no distinctive peak. Further aspects of this approach are described in U.S. Pat. No. 9,219,964, the content of which is herein incorporated by reference.
In another approach, system uses a set of signals from a number of microphones. For example, a first microphone can produce a first output signal A from a filter and a second microphone can produce a second output signal B from a filter. The apparatus includes a first directional filter adapted to receive the first output signal A and produce a first directional output signal. A digital signal processor is adapted to receive signals representative of the sounds from the user's mouth from at least one or more of the first and second microphones and to detect at least an average fundamental frequency of voice (pitch output) F0. A voice detection circuit is adapted to receive the second output signal B and the pitch output F0 and to produce an own voice detection trigger T. The apparatus further includes a mismatch filter adapted to receive and process the second output signal B, the own voice detection trigger T, and an error signal E, where the error signal E is a difference between the first output signal A and an output O of the mismatch filter. A second directional filter is adapted to receive the matched output O and produce a second directional output signal. A first summing circuit is adapted to receive the first directional output signal and the second directional output signal and to provide a summed directional output signal (D). In use, at least the first microphone and the second microphone are in relatively constant spatial position with respect to the user's mouth, according to various embodiments. Further aspects of this approach are described in U.S. Pat. No. 9,210,518, the content of which is herein incorporated by reference.
In various embodiments, the ear-wearable device 120 can detect a pattern based on the content of the ear-wearable device 120 wearer's speech utterances. In some cases, the content can include the words that are spoken by the device wearer. In some cases, the content can include the sounds (i.e., phonemes) or sound patterns other than words that are uttered by the device wearer. In some cases, the content can include both the words and other sounds or sound patterns.
Signals reflecting the ear-wearable device wearer's speech utterances can be transcribed into words or phonemes (i.e., speech recognition) in various ways. In some embodiments, a speech-to-text module can be included within the system herein or can be accessed as part of a remote system such as an API. For example, one such speech-to-text API is the Google Cloud Speech-to-Text API, wherein files/data representing speech can be submitted and text can be retrieved. Another is the speech service API from Microsoft Azure Cognitive Speech Services.
In some embodiments, the system can evaluate the number or classification of words or phonemes reflecting confusion as uttered by the ear-wearable device wearer can be tracked. Words of confusion can include “what?” “who?”, “why?”, “when?”, “where?”, “uh?”, as well as others. In some embodiments, a value reflecting the number of words of confusion uttered per unit time (such as per minute, etc.) can be calculated. If this value changes substantially for an individual over a baseline value (such as by greater then 5, 10, 15, 20, 30, 50, 75, 100, 200 percent or more, or an amount falling within a range between any of the foregoing), then that can be taken as an aberrant pattern herein. In other embodiments, if such values cross threshold amounts, then that can be taken as an aberrant pattern herein.
In some embodiments, the system can use the transcription data (e.g., speech-to-text output data) associated with the device wearer's speech in order to verify whether the device wearer is answering questions correctly. For example, the system could provide a prompt, such as “what day is it?” and then wait for an answer from the device wearer. A series of similar questions could be asked and then the system could determine a score based on the number of correct answers. This could be done periodically over time. If this value is substantially reduced for an individual over a baseline value or if the score crosses a threshold amount, then that can be taken as an aberrant pattern.
In some embodiments, the system can present images of objects on a display screen and ask the user to identify the objects and the results can be scored. In some embodiments, the system can measure the amount of time required for the device wearer to answer an open-ended question such as describing their environment. In some embodiments, the system can administer a memory test such as providing information for the device wearer to remember and then asking them to recall the provided information. In some embodiments, the system can ask questions such as “tell me words that begin with the letter ‘E’” and then score the answers, such as by counting the number of words generated by the device wearer that correctly begin with the letter “E”. In some embodiments, the system could ask a question reflecting common knowledge such as “tell me the ingredients you might put on a pizza” and then score the results, such as by the total number of items stated by the device wearer. Any of these queries (or others) can be repeated periodically. If the resulting score or value changes substantially over a baseline value of if the score crosses a threshold amount, then that can be taken as an aberrant pattern. In some embodiments herein, queries can be generated and/or delivered by a component of the ear-wearable device system. However, in some embodiments, a third party may be generating and/or delivering the queries and a component of the ear-wearable device system can identify that a query is being delivered and monitor for a response.
It will be appreciated that speech patterns herein can include various features. In some embodiments, the speech pattern can include long delays. For example, the system can track the amount of time between words, between spoken sentences, and or the amount of time between a query and a response. In some cases, an average delay can be calculated. In some embodiments, a time ratio of delay to spoken word content time can be calculated for a given time period (e.g., total delay time per minute/total spoken word content time per minute). If such delays (in the absolute, as an average or other statistical measure, as a ratio, etc.) increase significantly over a baseline value (such as by greater then 5, 10, 15, 20, 30, 50, 75, 100, 200 percent or more, or an amount falling within a range between any of the foregoing), then that can be taken as an aberrant pattern. In other embodiments, if such values cross threshold amounts, then that can be taken as an aberrant pattern. In some embodiments, the amount of time that a particular speech phoneme is sustained may be atypically long or short.
In various embodiments, the speech pattern can include the clarity, breathiness, pitch change, vowel instability, and/or roughness of the ear-wearable device wearer's speech. In various embodiments, the speech pattern can include slurred utterances. In various embodiments, the speech pattern can include strained utterances. In various embodiments, the speech pattern can include quiet utterances. In various embodiments, the speech pattern can include raspy utterances. In various embodiments, the speech pattern can include changed pronunciation of words.
In some embodiments, speech patterns herein indicative of an aberrant pattern of concern can include changes in speech complexity (e.g., semantic complexity, grammatical incompleteness, etc.) or fluency (e.g., atypical pause patterns).
Referring now to
The camera 504 of the accessory device 324 can be focused on the device wearer 100 and can detect various visual aspects/features of the device wearer 100. To facilitate this, in some embodiments the ear-wearable device 120 is configured to prompt the device wearer 100 to look at the accessory device 324 (equipped with a camera 504) if a pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer is detected.
Many different visual aspects/features are contemplated herein. In various embodiments, the ear-wearable device 120 can detect non-volitional eye movement by virtue of the camera 504 capturing images of the device wearer 100. In some embodiments, the ear-wearable device 120 can be configured to detect eye dilation. In various embodiments, the ear-wearable device 120 can be configured to detect facial paralysis, face droop or actions that may be consistent with drooling such as characteristic head movements associated with wiping of the device wearer's face.
In various embodiments, the ear-wearable device 120 can be configured to query the device wearer 100. Referring now to
It will be appreciated that queries can take on many different forms. In some embodiments, the query can be visual, aural, tactile or the like. In some embodiments, the query can request device wearer feedback or input (such as could be provided through a button press, an oral response, a movement, etc.). In some embodiments, the query can take the form of a question regarding how the device wearer 100 is feeling or what they are experiencing. In some embodiments, the query can relate to whether they are experiencing weakness. In some embodiments, the query can take the form of a question which requires a degree of cognition in order to answer, such as a math question, a verbal question, a question about their person information (such as one for which the answer is already known by the system), or the like. In some cases, the query can target a response which tests a specific function/area of the brain (e.g., a specific language ability like differentiating phonological or semantic differences between test stimuli). In some cases, there can be a single query. In some cases, there can be multiple queries.
In some embodiments, the ear-wearable device 120 can be configured to evaluate a nature or quality of a response from the device wearer 100 in response to the query. For example, in the context of a question, the system can evaluate whether the answer to the question suggests they are feeling ill, are lost, or experiencing a symptom of a neurological injury. As another example, the system can evaluate whether the answer to a question is correct or not. As another example, the system can evaluate the amount of time taken for the device wearer to answer a question. Of course, in some cases a device wearer may simply not respond to a query. In some embodiments, the system can interpret the lack of a response as being indicative of one or more of an occurrence, prodrome or sequelae of an event impacting the health and/or safety of the device wearer. However, in other embodiments, the system can be configured so as to not interpret the lack of a response that way. In some embodiments, the system can be configured to allow the user to cease or skip further testing.
In some embodiments, a query can specifically take the form of a request or prompt for the device wearer 100 to do or say something. Referring now to
Ear-wearable devices herein, including heating aids and hearables wearable earphones), can include an enclosure, such as a housing or shell, within which internal components are disposed. Components of an ear-wearable device herein can include a control circuit, digital signal processor (DSP), memory (such as non-volatile memory), power management circuitry, a data communications bus, one or more communication devices (e.g., a radio, a near-field magnetic induction device), one or more antennas, one or more microphones, a receiver/speaker, a telecoil, and various sensors as described in greater detail below More advanced ear-wearable devices can incorporate a long-range communication device, such as a BLUETOOTH® transceiver or other type of radio frequency (RF) transceiver.
Referring now to
The ear-wearable device 120 shown in
Ear-wearable devices of the present disclosure can incorporate an antenna arrangement coupled to a high-frequency radio, such as a 2.4 GHz radio. The radio can conform to an IEEE 802.11 (e.g., WIFI v) or BLUETOOTH® (e.g., BLE, BLUETOOTH® 4.2 or 5.0) specification, for example. It is understood that ear-wearable devices of the present disclosure can employ other radios, such as a 900 MHz radio. Ear-wearable devices of the present disclosure can be configured to receive streaming audio (e.g., digital audio data or files) from an electronic or digital source. Representative electronic/digital sources (also referred to herein as accessory devices) include an assistive listening system, a TV streamer, a remote microphone device, a radio, a smartphone, a cell phone/entertainment device (CPED), a programming device, or other electronic device that serves as a source of digital audio data or files.
Referring now to
Sound waves enter the ear canal 912 and make the tympanic membrane 914 vibrate. This action moves the tiny chain of auditory bones 916 (ossicles malleus, incus, stapes) in the middle ear 904. The last bone in this chain contacts the membrane window of the cochlea 908 and makes the fluid in the cochlea 908 move. The fluid movement then triggers a response in the auditory nerve 920.
As mentioned above, the ear-wearable device 120 can be a receiver-in-canal type device and thus the receiver is designed to be placed within the ear canal. Referring now to
Referring now to NG. 11, a schematic view is shown of data and/or signal flow as part of a system in accordance with various embodiments herein. In a first location 1102, a device wearer (not shown) can have a first ear-wearable device 120 and a second ear-wearable device 1120. Each of the ear-wearable devices 120, 1120 can include sensor packages as described herein including, for example, an WU, The ear-wearable devices 120, 112.0 and sensors therein can be disposed on opposing lateral sides of the subject's head. In some embodiments, the ear-wearable devices 120, 1120 and sensors therein can be disposed in a fixed position relative to the subject's head. The ear-wearable devices 120, 1120 and sensors therein can be disposed within opposing ear canals of the subject. The ear-wearable devices 120, 1120 and sensors therein can be disposed on or in opposing ears of the subject. The ear-wearable devices 120, 1120 and sensors therein can be spaced apart from one another by a distance of at least 3, 4, 5, 6, 8, 10, 12, 14, or 16 centimeters and less than 40, 30, 28, 26, 24, 22, 20 or 18 centimeters, or by a distance falling within a range between any of the foregoing.
In various embodiments, data and/or signals can be exchanged directly between the first ear-wearable device 120 and the second ear-wearable device 1120. An accessory device 324 (which could be an external visual display device with a video display screen, such as a smart phone amongst other things) can also be disposed within the first location 1102. The accessory device 324 can exchange data and/or signals with one or both of the first ear-wearable device 120 and the second ear-wearable device 1120 and/or with an accessory to the ear-wearable devices (e.g., a remote microphone, a remote control, a phone streamer, etc.). The accessory device 324 can also exchange data across a data network to the cloud 1110, such as through a wireless signal connecting with a local gateway device, such as a network router 1106, mesh network, or through a wireless signal connecting with a cell tower 1108 or similar communications tower. In some embodiments, the external visual display device can also connect to a data network to provide communication to the cloud 1110 through a direct wired connection.
In some embodiments, a care provider 1116 such as an audiologist, speech-language pathologist, physical therapist, occupational therapist, a physician or a different type of clinician, specialist, or care provider) can receive information from devices at the first location 1102 remotely at a second location 1112 through a data communication network such as that represented by the cloud 1110. The care provider 1116 can use a computing device 1114 to see and interact with the information received. The computing device 1114 could be a computer, a tablet device, a smartphone, or the like. The received information can include, but is not limited to, information regarding the subject's response time (reaction time and/or reflex time). In some embodiments, received information can be provided to the care provider 1116 in real time. In some embodiments, received information can be stored and provided to the care provider 1116 at a time point after response times are measured.
In some embodiments, the care provider 1116 (such as an audiologist, physical therapist, a physician or a different type of clinician, specialist, or care provider, or physical trainer) can send information remotely from the second location 1112 through a data communication network such as that represented by the cloud 1110 to devices at the first location 1102. For example, the care provider 1116 can enter information into the computing device 1114, can use a camera connected to the computing device 1114 and/or can speak into the external computing device. The sent information can include, but is not limited to, feedback information, guidance information, and the like. In some embodiments, feedback information from the care provider 1116 can be provided to the subject in real time.
As such, embodiments herein can include operations of sending data to a remote system user at a remote site, receiving feedback from the remote system user, and presenting the feedback to the subject. The operation of presenting the auditory feedback to the subject can be performed with the ear-wearable device (s). In various embodiments, the operation of presenting the auditory feedback to the subject can be performed with an ear-wearable device(s).
Ear-wearable devices of the present disclosure can incorporate an antenna arrangement coupled to a high-frequency radio, such as a 2.4 GHz radio. The radio can conform to an IEEE 802.11 (e.g., WIFI®) or BLUETOOTH® (e.g., BLE, BLUETOOTH® 4.2 or 5.0) specification, for example. It is understood that ear-wearable devices of the present disclosure can employ other radios, such as a 900 MHz radio or radios operating at other frequencies or frequency bands. Ear-wearable devices of the present disclosure can be configured to receive streaming audio (e.g., digital audio data or files) from an electronic or digital source. Representative electronic/digital sources (also referred to herein as accessory devices) include an assistive listening system, a TV streamer, a radio, a smartphone, a cell phone/entertainment device (CPLD) or other electronic device that serves as a source of digital audio data or files. Systems herein can also include these types of accessory devices as well as other types of devices.
Referring now to
An audio output device 1216 is electrically connected to the DSP 1212 via the flexible mother circuit 1218. In some embodiments, the audio output device 1216 comprises a speaker (coupled to an amplifier). In other embodiments, the audio output device 1216 comprises an amplifier coupled to an external receiver 122 adapted for positioning within an ear of a wearer. The external receiver 1220 can include an electroacoustic transducer, speaker, or loud speaker. The ear-wearable device 120 may incorporate a communication device 1208 coupled to the flexible mother circuit 1218 and to an antenna 1202 directly or indirectly via the flexible mother circuit 1218. The communication device 1208 can be a BLUETOOTH® transceiver, such as a BLE (BLUETOOTH® low energy) transceiver or other transceiver(s) e.g., an IEEE 802.11 compliant device), The communication device 1208 can be configured to communicate with one or more external devices, such as those discussed previously, in accordance with various embodiments. In various embodiments, the communication device 1208 can be configured to communicate with an external visual display device such as a smart phone, a video display screen, a tablet, a computer, or the like.
In various embodiments, the ear-wearable device 120 can also include a control circuit 1222 and a memory storage device 1224. The control circuit 1222 can be in electrical communication with other components of the device. In some embodiments, a clock circuit 1226 can be in electrical communication with the control circuit. The control circuit 1222 can execute various operations, such as those described herein. The control circuit 1222 can include various components including, but not limited to, a microprocessor, a microcontroller, an FPGA (field-programmable gate array) processing device, an ASIC (application specific integrated circuit), or the like. The memory storage device 1224 can include both volatile and non-volatile memory. The memory storage device 1224 can include ROM, RAM, flash memory, EEPROM, SSD devices, NAND chips, and the like. The memory storage device 1224 can be used to store data from sensors as described herein and/or processed data generated using data from sensors as described herein.
It will be appreciated that various of the components described in
It will be appreciated that in various embodiments herein, a device or a system can be used to detect a pattern or patterns indicative of an occurrence of an event impacting the health and/or safety of the device wearer. Such patterns can be detected in various ways. Some techniques are described elsewhere herein, but some further examples will now be described.
As merely one example, one or more sensors can be operatively connected to a controller (such as the control circuit describe in
Any suitable technique or techniques can be utilized to determine statistics for the various data from the sensors, e.g., direct statistical analyses of time series data from the sensors, differential statistics, comparisons to baseline or statistical models of similar data, etc. Such techniques can be general or individual-specific and represent long-term or short-term behavior. These techniques could include standard pattern classification methods such as Gaussian mixture models, clustering as well as Bayesian approaches, neural network models and deep learning.
Further, in some embodiments, the controller can be adapted to compare data, data features, and/or statistics against various other patterns, which could be prerecorded patterns (baseline patterns) of the particular individual wearing an ear-wearable device herein, prerecorded patterns (group baseline patterns) of a group of individuals wearing ear-wearable devices herein, one or more predetermined patterns that serve as patterns indicative of indicative of an occurrence of an event impacting the health and/or safety of the device wearer (positive example patterns), one or more predetermined patterns that service as patterns indicative of the absence of an occurrence of an event impacting the health and/or safety of the device wearer (negative example patterns), or the like. As merely one scenario, if a pattern is detected in an individual that exhibits similarity crossing a threshold value to a positive example pattern or substantial similarity to that pattern, then that can be taken as an indication of an occurrence of an event impacting the health and/or safety of the device wearer.
Similarity and dissimilarity can be measured directly via standard statistical metrics such normalized Z-score, or similar multidimensional distance measures (e.g. Mahalanobis or Bhattacharyya distance metrics), or through similarities of modeled data and machine learning. These techniques can include standard pattern classification methods such as Gaussian mixture models, clustering as well as Bayesian approaches, neural network models, and deep learning.
As used herein the term “substantially similar” means that, upon comparison, the sensor data are congruent or have statistics fitting the same statistical model, each with an acceptable degree of confidence. The threshold for the acceptability of a confidence statistic may vary depending upon the subject, sensor, sensor arrangement, type of data, context, condition, etc.
The statistics associated with the health status of an individual (and, in particular, their status with respect to a scenario impacting the health and/or safety of the device wearer), over the monitoring time period, can be determined by utilizing any suitable technique or techniques, e.g., standard pattern classification methods such as Gaussian mixture models, clustering, hidden Markov models, as well as Bayesian approaches, neural network models, and deep learning.
Many different methods are contemplated herein. Aspects of system/device operation described elsewhere herein can be performed as operations of one or more methods in accordance with various embodiments herein.
In an embodiment, a method of passively monitoring a wearer of an ear-wearable device is included, the method monitoring signals from a microphone and/or a motion sensor, comparing the monitored signals with a baseline pattern to detect aberrant patterns, and issuing an alert when an aberrant pattern is detected.
In an embodiment, the method can further include recording data based on signals from the microphone and/or the motion sensor to establish the baseline pattern.
In an embodiment of the method, the aberrant pattern indicates an increase in restlessness. In an embodiment of the method, the aberrant pattern comprises an aberrant sleeping pattern. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant sleep duration. In an embodiment of the method, the aberrant sleeping pattern comprises aberrant sleep disruptions. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant number of times getting up. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant time to falling asleep. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant duration from waking to rising in the morning. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant sleeping heart rate. In an embodiment of the method, the aberrant sleeping pattern comprises an aberrant sleeping breathing pattern. In an embodiment of the method, the aberrant pattern comprises a change in eating or drinking habits. In an embodiment of the method, the aberrant pattern comprises an aberrant movement pattern. In an embodiment of the method, the movement pattern comprises an aberrant pattern with respect to a number of steps taken, standing time, and/or movement. In an embodiment of the method, the aberrant pattern comprises an aberrant geolocation movement pattern. In an embodiment of the method, the aberrant geolocation movement pattern comprises wandering. In an embodiment of the method, the aberrant pattern comprises an aberrant head movement pattern. In an embodiment of the method, the aberrant pattern comprises an aberrant ambulation pattern. In an embodiment of the method, the aberrant pattern comprises an aberrant bathroom use pattern. In an embodiment of the method, the aberrant pattern comprises an aberrant speech pattern. In an embodiment of the method, the aberrant pattern comprises an aberrant nonverbal vocalization pattern. In an embodiment of the method, the aberrant pattern comprises a change in habits or patterns related to activities of daily living.
In an embodiment, the method can further include sending the alert to another party. In an embodiment of the method, the other party comprises at least one of a family member, a care provider, and a health care professional.
In an embodiment of the method, the aberrant pattern is associated with safety, nutritional/hydration status, or new or deteriorating health conditions of a wearer of the ear-wearable device.
In an embodiment of the method, the alert includes a present location of a wearer of the ear-wearable device. In an embodiment, the method can further include determining the present location using at least one of a satellite signal, a BLUETOOTH signal, a WIFI signal, a cellular network signal, a wireless beacon, an accessory device, and dead reckoning.
In an embodiment of the method, the alert includes a last-known location of a wearer of the ear-wearable device.
In some embodiments, a method of monitoring an ear-wearable device wearer for an occurrence of a scenario impacting the health and/or safety of the device wearer is included. In some embodiments, a method herein can include monitoring signals from a microphone, a motion sensor, and/or other sensors to detect patterns indicative of an occurrence of an event impacting the health and/or safety of the device wearer.
In an embodiment, a method of monitoring an ear-wearable device wearer for an occurrence of an event impacting the health and/or safety of the device wearer is included, the method including gathering signals from a microphone, a motion sensor, or another sensor of an ear-wearable device and monitoring the signals to detect a pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer.
Various patterns indicative of an occurrence of an event impacting the health and/or safety of the device wearer can be detected. In an embodiment, the pattern can include the content of the ear-wearable device wearer's speech. In an embodiment, the pattern can include words indicating confusion. In an embodiment, the pattern can include speech patterns of the ear-wearable device wearer's speech. In an embodiment, the pattern can include long delays.
In an embodiment, the pattern comprising the clarity, breathiness, pitch change, vowel instability, and/or roughness of the ear-wearable device wearer's speech. In an embodiment, the pattern can include slurred words. In an embodiment, the pattern can include changed pronunciation. In an embodiment, the pattern can include slurred words.
In an embodiment of the method, the pattern is indicative of motor impairment. In an embodiment of the method, the pattern is indicative of a sudden decrease in coordination. In an embodiment of the method, the pattern is indicative of sudden dizziness.
In an embodiment, the method can further include querying the device wearer if a pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer is detected. In an embodiment, the method can further include prompting the device wearer to look at an accessory device equipped with a camera if a pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer is detected. In an embodiment, a detected pattern can include eye dilation. In an embodiment, the pattern can include non-volitional eye movement. In an embodiment, the pattern can include face droop.
In an embodiment of the method, the query comprises a prompt to execute a movement protocol.
In an embodiment, the method can further include identifying a cardiac pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer. In an embodiment, the cardiac pattern can include atrial fibrillation. In an embodiment, the cardiac pattern can include beat variability.
In an embodiment, the method can further include generating an alert if an occurrence of an event impacting the health and/or safety of the device wearer is detected. In an embodiment of the method, the alert is generated according to a tiered alert classification.
In an embodiment, the method can further include marking the time of first detection of a pattern indicative of an occurrence of an event impacting the health and/or safety of the device wearer and subsequently transmitting the same for receipt by a care provider.
In an embodiment, the method can further include detecting a non-volitional body movement. In an embodiment, the method can further include detecting a non-volitional eye movement.
Ear-wearable devices as well as medical devices herein can include one or more sensor packages (including one or more discrete or integrated sensors) to provide data. The sensor package can comprise one or a multiplicity of sensors. In some embodiments, the sensor packages can include one or more motion sensors (or movement sensors) amongst other types of sensors. Motion sensors herein can include inertial measurement units (IMU), accelerometers, gyroscopes, barometers, altimeters, and the like. The MU can be of a type disclosed in commonly owned U.S. patent application Ser. No. 15/331,230, filed Oct. 21, 2016, which is incorporated herein by reference. In some embodiments, electromagnetic communication radios or electromagnetic field sensors (e.g., telecoil, NEMI, TMR, GMR, etc.) sensors may be used to detect motion or changes in position. In some embodiments, biometric sensors may be used to detect body motions or physical activity. Motions sensors can be used to track movement of a patient in accordance with various embodiments herein.
In some embodiments, the motion sensors can be disposed in a fixed position with respect to the head of a patient, such as worn on or near the head or ears. In some embodiments, the operatively connected motion sensors can be worn on or near another part of the body such as on a wrist, arm, or leg of the patient.
According to various embodiments, the sensor package can include one or more of an IMU, and accelerometer (3, 6, or 9 axis), a gyroscope, a barometer, an altimeter, a magnetometer, a magnetic sensor, an eye movement sensor, a pressure sensor, an acoustic sensor, a telecoil, a heart rate sensor, a global positioning system (GPS), a temperature sensor, a blood pressure sensor, an oxygen saturation sensor, an optical sensor, a blood glucose sensor (optical or otherwise), a galvanic skin response sensor, a cortisol level sensor (optical or otherwise), a microphone, acoustic sensor, an electrocardiogram (ECG) sensor, electroencephalography (EEG) sensor which can be a neurological sensor, eye movement sensor (e.g., electrooculogram (EOG) sensor), myographic potential electrode sensor (EMG), a heart rate monitor, a pulse oximeter or oxygen saturation sensor (SpO2), a wireless radio antenna, blood perfusion sensor, hydrometer, sweat sensor, cerumen sensor, air quality sensor, pupillometry sensor, cortisol level sensor, hematocrit sensor, light sensor, image sensor, and the like.
In some embodiments, the sensor package can be part of an ear-wearable device. However, in some embodiments, the sensor packages can include one or more additional sensors that are external to an ear-wearable device. For example, various of the sensors described above can be part of a wrist-worn or ankle-worn sensor package, or a sensor package supported by a chest strap. In some embodiments, sensors herein can be disposable sensors that are adhered to the device wearer (“adhesive sensors”) and that provide data to the ear-wearable device or another component of the system.
Data produced by the sensor(s) of the sensor package can be operated on by a processor of the device or system.
As used herein the term “inertial measurement unit” or “IMU” shall refer to an electronic device that can generate signals related to a body's specific force and/or angular rate. IMUs herein can include one or more accelerometers (3, 6, or 9 axis) to detect linear acceleration and a gyroscope to detect rotational rate. In some embodiments, an MU can also include a magnetometer to detect a magnetic field.
The eye movement sensor may be, for example, an electrooculographic (EOG) sensor, such as an FOG sensor disclosed in commonly owned U.S. Pat. No. 9,167,356 which is incorporated herein by reference. The pressure sensor can be, for example, a MEMS-based pressure sensor, a piezo-resistive pressure sensor, a flexion sensor, a strain sensor, a diaphragm-type sensor and the like.
The temperature sensor can be, for example, a thermistor (thermally sensitive resistor), a resistance temperature detector, a thermocouple, a semiconductor-based sensor, an infrared sensor, or the like.
The blood pressure sensor can be, for example, a pressure sensor. The heart rate sensor can be, for example, an electrical signal sensor, an acoustic sensor, a pressure sensor, an infrared sensor, an optical sensor, or the like.
The oxygen saturation sensor (such as a blood oximetry sensor) can be, for example, an optical sensor, an infrared sensor, a visible light sensor, or the like.
The electrical signal sensor can include two or more electrodes and can include circuitry to sense and record electrical signals including sensed electrical potentials and the magnitude thereof (according to Ohm's law where V=IR) as well as measure impedance from an applied electrical potential.
It will be appreciated that the sensor package can include one or more sensors that are external to the ear-wearable device. In addition to the external sensors discussed hereinabove, the sensor package can comprise a network of body sensors (such as those listed above) that sense movement of a multiplicity of body parts (e.g., arms, legs, torso). In some embodiments, the ear-wearable device can be in electronic communication with the sensors or processor of another medical device, e.g., an insulin pump device or a heart pacemaker device.
It should be noted that, as used in this specification and the appended claims, the singular forms “a,” “an,” and “the” include plural referents unless the content clearly dictates otherwise. It should also be noted that the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
It should also be noted that, as used in this specification and the appended claims, the phrase “configured” describes a system, apparatus, or other structure that is constructed or configured to perform a particular task or adopt a particular configuration. The phrase “configured” can be used interchangeably with other similar phrases such as arranged and configured, constructed and arranged, constructed, manufactured and arranged, and the like.
All publications and patent applications in this specification are indicative of the level of ordinary skill in the art to which this invention pertains. All publications and patent applications are herein incorporated by reference to the same extent as if each individual publication or patent application was specifically and individually indicated by reference.
As used herein, the recitation of numerical ranges by endpoints shall include all numbers subsumed within that range (e.g., 2 to 8 includes 2.1, 2.8, 5.3, 7, etc.).
The headings used herein are provided for consistency with suggestions under 37 CFR 1.77 or otherwise to provide organizational cues. These headings shall not be viewed to limit or characterize the inventions) set out in any claims that may issue from this disclosure. As an example, although the headings refer to a “Field,” such claims should not be limited by the language chosen under this heading to describe the so-called technical field. Further, a description of a technology in the “Background” is not an admission that technology is prior art to any invention(s) in this disclosure. Neither is the “Summary” to be considered as a characterization of the invention(s) set forth in issued claims.
The embodiments described herein are not intended to be exhaustive or to limit the invention to the precise forms disclosed in the following detailed description. Rather, the embodiments are chosen and described so that others skilled in the art can appreciate and understand the principles and practices. As such, aspects have been described with reference to various specific and preferred embodiments and techniques. However, it should be understood that many variations and modifications may be made while remaining within the spirit and scope herein. Any of the methods or embodiments disclosed herein can be combined with any of the other methods or embodiments disclosed herein unless the context dictates otherwise.
This application is being filed as a PCT International Patent application on Nov. 11, 2021, in the name of Starkey Laboratories, Inc., a U.S. national corporation, applicant for the designation of all countries, and Amit Shahar, a. U.S. Citizen, and David Alan Fabry, a U.S. Citizen, inventor(s) for the designation of all countries, and claims priority to U.S. Provisional Patent Application No. 63/114,413, filed Nov. 16, 2020, the contents of which are herein incorporated by reference in its entirety.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2021/058971 | 11/11/2021 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 63114413 | Nov 2020 | US |
