Aspects of the present disclosure relate to determining or estimating a photoplethysmogram (PPG) of a subject based on signals received via a sensor on an in-ear audio device. As described herein, the PPG is used to determine or estimate a variety of biometric parameters. Any one of the determined biometric parameters are reported to the wearer or other individual, such as a physician, and/or used to create a closed-loop experience responsive to the determined parameter.
Monitoring an individual's health helps in preventative care and with the diagnosis and treatment of diseases. PPG sensors optically detect changes in the blood flow volume (i.e., changes in the detected light intensity) in the microvascular bed of tissue. PPG is detected via reflection from or transmission through the tissue. PPG sensors can be used to estimate a variety of biometric parameters. Currently, clinical-grade fingertip or earlobe PPG sensors collect signals to calculate a subject's PPG. Fingertip and earlobe measures are currently preferred; however, these locations may have limited blood perfusion. In addition, conventional fingertip or earlobe PPG sensors may not be ideal for taking measurements over a long period of time. While these methods may be sufficient for hospital settings, methods and apparatus to monitor and calculate PPG in non-hospital settings are desired.
All examples and features mentioned herein can be combined in any technically possible manner.
According to aspects, an in-ear audio device is configured to determine, estimate, or calculate a subject's PPG. Specifically, at least one sensor disposed on an earpiece of the audio device is configured to collect signals of a subject wearing the audio device. The signals are used to determine or estimate the subject's PPG. In aspects, a processor onboard the audio device determines or estimates the PPG. In other aspects, an external device, coupled to the audio device, determines or estimates the subject's PPG. In other aspects, the subject's PPG is determined or estimated in the cloud.
Certain aspects provide a method for determining a photoplethysmogram (PPG) of a subject comprising receiving signals via a PPG sensor disposed on an in-ear audio device inserted in an ear of the subject, and taking one or more actions to estimate the subject's PPG based on the received signals.
In aspects, the one or more actions comprises transmitting, by the in-ear audio device, information associated with the received signals to a device external to the in-ear audio device and receiving, by the in-ear audio device, the estimate of the subject's PPG.
In aspects, the method further comprises estimating based, at least in part, on the subject's estimated PPG, one or more biometrics associated with the subject. In aspects, the one or more biometrics associated with the subject comprise at least one of: heart rate, heart rate variability (HRV), respiration rate (RR), peripheral capillary oxygen saturation (SpO2) level, blood pressure, blood glucose level, or hemoglobin A1C level.
In aspects the one or more biometrics associated with the subject comprise: respiration rate (RR) and peripheral capillary oxygen saturation (SpO2) level and the method further comprises detecting a sleep apnea event based on the RR and the SpO2 level.
In aspects, the PPG sensor comprises a plurality of transmitters and emitters, each disposed on an earbud of the in-ear audio device.
In aspects, receiving the signals via the PPG sensor comprises continuously receiving the signals over a sleep period. In aspects, the method further comprises determining a continuous blood pressure based on the estimated PPG.
In aspects, the method further comprises determining the subject is stressed based on the estimated PPG and adjusting an audio output in an effort to decrease at least one of the subject's respiration rate (RR), heart rate, heart rate variability (HRV), or blood pressure.
In aspects, the method further comprises performing closed-respiration entrainment based on a respiration rate (RR) determined using the estimated PPG.
Certain aspects provide an in-ear earpiece configured to determine a photoplethysmogram (PPG) of a subject comprising a PPG sensor configured to receive signals from an ear canal of a subject and at least one processor configured to take one or more actions to estimate the subject's PPG.
In aspects, the PPG sensor is disposed on an earbud of the in-ear earpiece. In aspects, the PPG sensor comprises a plurality of transmitters and emitters disposed on the in-ear earpiece.
In aspects, the in-ear earpiece further comprises a transceiver configured to transmit information associated with the received signals to an external device, and receive the estimate of the subject's PPG.
In aspects, the at least one processor is configured to estimate based, at least in part, on the subject's estimated PPG, one or more biometrics associated with the subject.
In aspects, the one or more biometrics associated with the subject comprise at least one of: heart rate, heart rate variability (HRV), respiration rate (RR), peripheral capillary oxygen saturation (SpO2) level, blood pressure, blood glucose level, or hemoglobin A1C level.
In aspects, the one or more biometrics associated with the subject comprise: respiration rate (RR) and peripheral capillary oxygen saturation (SpO2) level and the at least one processor is configured to detect a sleep apnea event based on the RR and the SpO2 level.
In aspects, the in-ear earpiece is part of a sleep mask.
Certain aspects provide a method for non-invasively determining at least one biometric parameter comprising measuring changes in blood volume within a blood vessel of a subject using a light emitting diode (LED) and photodetector (PD) disposed in on an ear tip of an in-ear earpiece, estimating a photoplethysmogram (PPG) of the subject based on the measured changes, estimating the at least one biometric parameter based on the estimated PPG, and taking one or more actions based on the at least one estimated biometric parameter.
In aspects, measuring the changes comprises continuously measuring the changes over a sleep period.
Advantages of determining a subject's PPG using signals collected in-ear will be apparent from the description and the claims.
A PPG can be used to detect a variety of biometric parameters, including, but not limited to, heart rate, heart rate variability (HRV), respiration rate (RR), peripheral capillary oxygen saturation (SpO2) level, blood pressure, cholesterol, heart disease, blood glucose, stress, and hemoglobin A1C level. One or more of these parameters, such as RR and SpO2, or other characteristics of the signal are used to determine a sleep apnea event. In aspects, a machine learning algorithm is used to determine a biometric parameter from the PPG signal obtained in-ear by an audio device.
While a fingertip or earlobe PPG sensor may be sufficient for a hospital setting, these locations do not allow for ambulatory measurements within the home or over long periods of time, such as while a subject is sleeping. Accordingly, aspects describe an in-ear PPG sensor configured to collect signals used to determine a subject's PPG regardless of the subject's location and over long periods of time, such as over several hours. According to aspects, an in-ear PPG sensor is used to non-invasively and continuously determine the subject's PPG. The ear, specifically the ear canal, provides a stable environment, which naturally occludes motion and ambient light artifacts, and contains an abundance of blood vessels. These factors contribute to a more accurate measurement of PPG, as compared to a wrist-worn PPG sensor. The ear canal also provides a location where PPG may be monitored over long periods of time. In aspects, the in-ear device monitors the subject's PPG over a sleep period, a wake period, or a combination of sleep and wake period, any of which can last several hours. In aspects, the in-ear device monitors the subject's PPG during periods of activity.
The body 204 of the ear tip 200 is substantially elliptical or circular in shape. A substantially elliptical or circular shape is suited to align with typical ear geometries. The shape of the body 204 is configured to match the lower concha of a subject's ear. In an example, the body 204 houses an earbud including an acoustic driver module. The earbud may include a stem for positioning cabling and the like; however, some earbuds, and therefore earpieces, may lack the stem and may include electronic modules (not shown) for wirelessly communicating with external devices. Other earpieces may lack the stem and the acoustic driver module and may function as passive earplugs.
A nozzle 208 extends from the body 204 towards the ear canal of the subject's ear. The nozzle includes an acoustic passage to conduct sound waves to the ear canal of the subject.
The ear tip 202 provides enough surface area to contact the subject's skin when positioned in-ear. The soft, flexible material of the tip 202 helps the tip to conform to the subject's ear geometry and increases the surface area having contact with a subject's skin. Additionally, the flare of the umbrella shaped tip 202 provides some springiness so that some pressure is exerted by the tip 202 on the subject's skin.
The ear tip 202 includes at least one PPG sensor. In one aspect, the sensor includes an LED and a PD as shown in
The positioning and retaining structure 206 holds the earpiece in position in a subject's ear, without significant contribution from the portions of the ear tip that engage the ear canal and without any structure external to the ear tip. In an example, as shown in
In aspects, the earpiece 200 is connected, either via a wired connection or a wireless connection, to a second earpiece configured to fit in subject's right ear. In aspects, the earpiece is part of a wearable form factor, such as audio eyeglasses or a sleep mask.
In aspects, the earpiece 200 includes a PPG sensor, as described above, one or more of a memory and processor, communication unit, transceiver, and audio output transducer or speaker. In an aspect, any of the PPG sensor, memory and processor, communication unit, transceiver, and audio output transducer are configured to communicate with each other. In an example, all of these components are coupled to and communicate with each other.
The memory and processor control the operations of the earpiece 200. The memory stores program code for controlling the memory and processor. The memory may include Read Only Memory (ROM), a Random Access Memory (RAM), and/or a flash ROM. The processor controls the general operation of the earpiece 200. The processor performs process and control for audio and/or data communication. In some aspects, in addition to the general operation, the processor is configured to determine a subject's PPG and one or more biometric parameters associated with the subject based on the determined PPG. In aspects, the processor is configured to output the determined PPG and/or determined one or more biometric parameters determined from the PPG. In an example, the processor, in combination with one or more other components of the earpiece, perform the operations described with reference to
The communication unit facilitates a wireless connection with one or more other devices. For example, the communication unit may include one or more wireless protocol engines such as a Bluetooth engine. While Bluetooth is used as an example protocol, other communication protocols may also be used. Some examples include Bluetooth Low Energy (BLE), Near Field Communications (NFC), IEEE 802.11, or other local area network (LAN) or personal area network (PAN) protocols.
In an example, the communication unit wirelessly communicates with an external device, such as a bedside unit, a tablet, a cell phone, a smart device, or the cloud. In an example, the communication unit wirelessly communicates an indication of the collected PPG waveform. Any of the external devices or cloud may determine the subject's PPG from the waveform and a biometric parameter based, at least in part, on the PPG.
The transceiver transmits and receives information via one or more antennae to exchange information with one or more other devices. The transceiver is not necessarily a distinct component. The audio output transducer may be also known as a driver or speaker. In some examples, more than one output transducer is used. The transducer converts electrical signals into sound and converts sound into electrical signals. In aspects, the transducer adjusts an audio output by the earpiece 200 based on a determined biometric parameter.
The earpiece 200 is provided for illustrative purposes only. Aspects of the disclosure are not limited to the specific form factor illustrated in
In aspects, the one or more actions comprise transmitting, by the in-ear audio device, information associated with the received signals to a device external to the in-ear audio device and receiving, by the in-ear audio device, the estimate of the subject's PPG. In yet other aspects, the audio device itself determines the subject's PPG.
As described with reference to
In aspects, the PPG sensor comprises a plurality of transmitters and emitters, each disposed on an ear tip of the in-ear device. In aspects, one or more PPG sensors disposed on the in-ear device continuously receive the signals over a sleep period. Continuously receiving the signals over a period enables a non-invasive method for determining a continuous blood pressure based on the estimated PPG. The period of time may include several hours of sleeping, activity, or a combination of both. In an example, the subject's PPG is monitored overnight. In aspects, the PPG sensor measures changes in blood volume within a blood vessel of a subject using an LED and PD disposed on an ear tip of an in-ear earpiece.
In aspects, actions are taken based on the determined biometrics. The audio device may continuously calculate one or more of described biometrics based on a PPG signal collected in-ear. The audio device may continuously take action based on a determined state of the subject. For example, based on an elevated RR, heart rate, HRV, or blood pressure, the audio device may determine the subject is stressed. In response to determining the subject is stressed, the audio device adjusts an audio output to calm the subject in an effort to decrease the subject's RR, heart rate, HRV, or blood pressure. In another example, the audio device performs closed-loop respiration entrainment based on a RR determined using the estimated PPG. In closed-loop respiration entrainment, a subject is guided to a resting RR based on the subject's current RR. As used in herein, entrainment refers to guiding a user's respiration, breath, or breathing.
HRV refers to the variation in time between heart beats. Identifying peaks in the PPG waveform, as shown above in
The intensity of light absorbed, and consequently, the intensity of light returned to the PD varies depending on which area of the body is measured. Therefore, measuring in-ear requires a novel SpO2 algorithm.
Sleep apnea is defined the cessation of breathing during sleep for greater than 10 seconds despite continual effort to breathe. During an apnea event, respiration ceases and SpO2 falls by greater than approximately 3%. As described above, respiration and SpO2 can be extracted from a PPG signal. Accordingly, using an in-ear PPG sensor, SpO2 and RR is estimated and used to identify a sleep apnea event.
Continuous blood pressure is typically measured invasively, with electrodes directly placed on the artery. In contrast, a blood pressure cuff, which is considered non-invasive, does not allow for continuous measurements since it cuts off circulation to extremities during use. Continuous blood pressure is another biometric parameter that can be determined using a PPG signal obtained using an in-ear audio device. Specific characteristics of the PPG waveform, however, correlate to the arterial blood pressure waveform.
Each biometric parameter described herein and sleep apnea are determined based on a PPG signal contained in-ear. Any combination of signal processing methods including filtering, smoothing, derivations, maxima, and minima and machine learning algorithms, such as recurrent or temporal convolutional neural networks are used to determine both the subject's PPG and the biometrics described herein. The methods described enable continuous, non-invasive PPG and biometric estimation. PPG and biometric estimation can be used to monitor a subject's health and identify sleep apnea events. Accordingly, in-ear PPG measurements are used to increase awareness about a subject's health in a non-invasive manner. Medical professionals or the subject may use this information to increase awareness about the subject's health and/or to address health concerns. In aspects, the PPG and estimated biometrics create closed-loop experiences in an effort to adjust one or more estimated biometric parameters.
In the preceding, reference is made to aspects presented in this disclosure. However, the scope of the present disclosure is not limited to specific described aspects. Aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “component,” “circuit,” “module” or “system.” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a computer readable storage medium include: an electrical connection having one or more wires, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the current context, a computer readable storage medium may be any tangible medium that can contain or store a program.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products according to various aspects. In this regard, each block in the flowchart or block diagrams may represent a module, segment or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented by special-purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
This application claims priority to and benefit of U.S. Patent Application No. 62/789,345, filed Jan. 7, 2019, the contents of which are herein incorporated by reference in its entirety as fully set forth below.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2020/012341 | 1/6/2020 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62789345 | Jan 2019 | US |