This disclosure relates to systems and methods for measuring physiological information using a light source and image sensor of a computing device.
Many people suffering from cardio pulmonary diseases monitor blood vitals to track their condition. For example, acute asthma has been spreading rapidly in recent years. Oxygen levels in the blood, for example, may be indicative of underlying conditions. Pulse oximetry is a non-invasive method to measure peripheral oxygen saturation (SpO2). SpO2 approximates arterial oxygen saturation (SaO2) well enough to be a convenient and relatively accurate way to measure oxygen saturation. However, portable pulse oximetry devices tend to be relatively costly. The measurements from standalone portable pulse oximetry devices can also be erratic in some instances. Some portable pulse oximetry devices also rely on clamping interfaces that may be too small for pediatric applications.
Also, many people may benefit from improved access to their physiological information. Conventional systems, devices, and methods for detecting and/or measuring physiological information, such as oxygen, glucose, and/or urea levels, are not readily available to individual consumers.
Systems and methods for measuring physiological information and/or physiological parameters, such as oxygen saturation in blood, are disclosed herein. According to various embodiments, the systems include a computing device and an add-on device in electronic communication with the computing device. The computing device, according to various embodiments, includes a light source and an image sensor. In various embodiments, the add-on device includes a body and a first light filter retained in the body. The first light filter is configured to filter light emitted by the light source of the computing device, according to various embodiments. A lens may also be retained in the body proximate the first light filter. The lens directs light exiting the first light filter out a surface of the first lens, according to various embodiments. A second lens may be retained in the body and may receive light exiting the first lens via a surface of the second lens. In various embodiments, the surface of the first lens and the surface of the second lens are substantially coplanar. A second light filter may also be retained in the body proximate the second lens. The sensor is configured to detect the light exiting the second light filter, according to various embodiments.
Also disclosed herein, according to various embodiments, are methods for measuring physiological information and/or parameters, such as oxygen saturation in blood, that include the step of calculating a first mean value of light intensity detected by a first partition of an image sensor on the computing device at a first time for a red wavelength to generate a red Photoplethysmogram (PPG) signal. The method also includes calculating a second mean value of light intensity detected by a second partition of the image sensor on the computing device at the first time for an infrared wavelength to generate an infrared PPG signal, according to various embodiments. The red PPG signal and the infrared PPG signal may be filtered to allow frequencies ranging from 0.5 Hz to 4 Hz to pass. The method further includes calculating the absorptivity ratio from the filtered red PPG signal and the filtered infrared PPG signal, and calculating the oxygen levels based on the absorptivity ratio, according to various embodiments.
In various embodiments, the physiological information device includes a camera covering portion. The camera covering portion may include the second lens and the second filter. In various embodiments, the camera covering portion includes the second light filter and a third light filter. In various embodiments, the second light filter is a red filter and the third light filter is a green filter. In various embodiments, the device includes a light covering portion, wherein the light covering portion comprises the first light filter and the first lens. In various embodiments, the light covering portion comprises a plurality of apertures that limit an amount of light energy from the light source. In various embodiments, the body of the add-on physiological information device comprises a flexible material and a rigid material. The flexible material may be configured to absorb/damp vibrational movement.
The foregoing features and elements may be combined in various combinations without exclusivity, unless expressly indicated herein otherwise. These features and elements as well as the operation of the disclosed embodiments will become more apparent in light of the following description and accompanying drawings.
The subject matter of the present disclosure is particularly pointed out and distinctly claimed in the concluding portion of the specification. A more complete understanding of the present disclosure, however, may be obtained by referring to the detailed description and claims when considered in connection with the drawing figures, wherein like numerals denote like elements.
The detailed description of various embodiments refers to the accompanying drawings, which show various embodiments by way of illustration. While these various embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure, it should be understood that other embodiments may be realized and that logical and mechanical changes may be made without departing from the spirit and scope of the disclosure. Thus, the detailed description is presented for purposes of illustration only and not of limitation. For example, the steps recited in any of the method or process descriptions may be executed in any order and are not limited to the order presented. Moreover, any of the functions or steps may be outsourced to or performed by one or more third parties. Furthermore, any reference to singular includes plural embodiments, and any reference to more than one component may include a singular embodiment.
Disclosed herein, according to various embodiments, are devices, systems, and methods for determining and/or measuring physiological information/factors, such as oxygen saturation in the blood stream of a user. For example, the disclosed devices, systems, and methods may be implemented as an oxygen saturation measuring system and/or may be implemented to determine the levels of various compounds in the body or bloodstream of a user, such as glucose, urea, etc. Thus, while numerous details are included herein pertaining to oxygen saturation measurements, the scope of the present disclosure is not limited to oxygen saturation detection and the principles and features of the disclosed devices, systems, and methods may be utilized in various physiological detection implementations.
Generally, the physiological information detection system provided herein includes a portable device and an add-on device. The add-on device is configured to be in electronic communication with the portable device. The add-on may generate light or may redirect light from the portable device to shine into a finger or other body part of a user, and said light may be reflected into the camera of the portable device. In various embodiments, the light is filtered into predetermined wavelengths that result in accurate readings of physiological information, such as oxygen saturation levels, and is directed to partitioned portions of a camera sensor. Measurements taken using light with infrared and red wavelengths have improved accuracy versus measurements taken using the entire spectrum of electromagnetic radiation emitted by the flash on the portable device or other light source of the add-on device, according to various embodiments.
With reference to
Computing device 110 may include one or more cameras and/or flashes.
For example, the computing device 110 may take the form of a computer or processor, or a set of computers/processors, although other types of computing units or systems may be used. Exemplary computing devices 110 include smartphones, tablets, laptops, notebooks, hand held computers, personal digital assistants, cellular phones, smart phones (e.g., iPhone®, BlackBerry®, Android®, etc.), wearables (e.g., smart watches and smart glasses), Internet of things (IOT) devices or any other device capable of generating light and/or capturing red and infrared light. Although red and IR light are identified, other light channels may be used in the present device by using the corresponding light filters as described below. Each computing device 110 may run an application to interpret the red and infrared signals arriving at front-facing camera 112 and/or rear-facing camera 106. The application may use screen 116 to output results and receive input from a user.
Referring now to
Light 203 emitted from light source 202 passes through filter 208. Filter 208 removes electromagnetic radiation of undesired wavelengths. For example, filter 208 of add-on device 104 filters light 203 so that all visible light aside from red light is removed. Filter 208 may also filter ultraviolet light from light 203. Filter 208 may thus allow light from the infrared light and red light to pass through. The wavelength of infrared light ranges from about 800 nm to about 1 mm. The wavelength of red light begins at the border of infrared light and is generally about 650 nm. Red light has a wavelength ranging from about 800 nm to about 600 nm.
Light 203 passing through filter 208 enters lens 210 through surface 213. Lens 210 is a transparent or translucent material with a geometry and refractory index suitable to direct light 211 out of lens 210 at surface 215 and towards blood-rich portion 212 of body part 214. Body part 214 may be, for example, a finger, a hand, a forearm, an ear, or a neck. Light 211 may be filtered light containing electromagnetic radiation in the frequencies selected by filter 208. Lens 210 may be made of glass, polycarbonate, plastic, or other suitable lens material. Surfaces of lens 210 where light escaping is undesirable, such as surfaces 217, may be coated with a reflective material or a material of a different refractory index than lens 210 to reflect or otherwise alter the path of light 203 within lens 210. Lens 210 may thus tend to focus and direct light 211 towards body part 214 at an angle. The angle at which light 211 approaches body part 214 may be selected based on the distance between light source 202 and sensor 204 (of rear-facing camera 106, for example) so that suitable light levels reflect from body part 214 generally towards sensor 204. The angle at which light 211 approaches body part 214 may also be selected based on the distance between light source 202 or sensor 204 and body part 214 so that suitable light levels reflect from body part 214 generally towards sensor 204. Light 211 may thus travel in a u-shaped or v-shaped path from emission at the light source 202, into body part 214, and back to sensor 204.
Light 211 reflecting from blood-rich portion 212 of body part 214 enters lens 216. Body 206 may retain lens 216 relative to lens 210. Light 211 may enter lens 216 at surface 205. Surface 205 and surface 215 may be substantially coplanar such that body part 214 lays across and/or covers surface 215 as well as surface 205. Lens 216 may tend to guide light 211 towards infrared filter 218 and red filter 220. Body 206 may retain infrared filter 218 and red filter 220, which are described in greater detail below, relative to other components of add-on device 104. Lens 216 may be treated in a manner similar to lens 210 as described above to facilitate the transfer of infrared and red light components of light 211 towards infrared filter 218 and red filter 220.
Infrared filter 218 is a translucent or transparent material configured to remove wavelengths other than infrared from light 211. For example, infrared filter 218 may be configured to allow infrared light to pass and remove red light. Similarly, red filter 220 is a translucent or transparent material configured to remove wavelengths other than red from light 211. For example, red filter 220 may be configured to allow red light to pass and remove infrared light. The refractory index of infrared filter 218 and/or red filter 220 may be selected to direct light 211 exiting lens 216 towards sensor 204. Infrared light 219 may pass through infrared filter 218 towards a partition of sensor 204. Red light 221 may pass through red filter 220 towards a partition of sensor 204.
Sensor 204 may include partitions 222 with red light and infrared light captured at different partitions 222 of sensor 204. Sensor 204 may include partitions 222 that receive both red and infrared light. The partitions 222 that receive infrared and/or red light may be identified in the application running on computing device 110 and thus, according to various embodiments, may not be physical partitions but instead may be sections of the image captured/detected by the sensor 204. The resulting image may thus be analyzed to determine the light intensity of red light 221 and/or infrared light 219 detected at the partitions 222 of sensor 204 and the resulting images. The images may be a series of screen captures, a video image, and/or a still image. The application running on computing device 110 may analyze the resulting image to measure physiological/vital information, such as SpO2 levels and heart rate.
Referring now to
Captured signals 400 from the red channel (light at the red wavelength) and the infrared channel (light at the IR wavelength) are identified as signal 402 (red wavelength) and signal 404 (IR wavelength), respectively, and are shown in
rppg(t)=μ(lnpVid{r,t})
ippg(t)=μ(lnpVid{i,t})
The mean value of each frame “t” may be calculated by computing device 110 coupled to add-on device 104. Computing device 110 may then filter the signals using a bandpass filter which tends to allow only signals from 30 bpm (about 0.5 Hz) to 230 bpm (about 3.83 Hz) to pass (Step 304). The bandpass filter may be a Butterworth filter, for example, to have a flat frequency response in the pass band. Pulse oximetry techniques may adopt simple linear regression between absorptivity ratio and SpO2, as SpO2=−a*R+b. Referring to
Red channel 502 may have an “AC” and “DC” component, similar to those commonly described with reference to electrical signals. The AC component may be the waveform of increasing and decreasing values, and the DC component may be the offset from the value 0 to the lowest value of the AC component. Thus, the AC component of red channel 502 is the portion above DC-cutoff line 503, with the DC component being below DC-cutoff line 503. The DC component of red channel 502 is thus approximately 97.7, and the AC component of red channel 502 varies from about 99 to about 97.7. The AC and DC values of infrared channel 504 may be determined in a similar manner with reference to DC-cutoff line 505.
Computing device 110 may obtain the AC and DC values for light intensity of the red channel and the infrared channel as described above. Computing device 110 may then calculate the absorptivity ratio (R) using the below relationship (Step 306).
The extinction coefficients may be determined based on the relationship between wavelength and extinction coefficient by looking up the extinction coefficient using a wavelength. For example, for a red wavelength of approximately 620 nm, εHbO2(620) is approximately 0.1, and εHb(620) is approximately 0.05.
Computing device 110 may then calculate SpO2 levels (Step 308). Computing device 110 may calculate the SpO2 levels using the below relationship.
The SpO2 levels may be calculated at various times for a predetermined duration to generate plot 506 of SpO2 levels. For example, SpO2 levels may be calculated every second, every half second, for time intervals of a predetermined duration with the intervals overlapping, or over another suitable period. Computing device 110 may analyze resulting SpO2 values (e.g., in plot 506) to identify undesirable SpO2 levels. The resulting plot 506 and/or SpO2 levels may be stored for long-term monitoring.
In various embodiments, a prediction error may be caused by the high fluctuation of absorption ratio and may be caused by the difference levels of red color between each finger. An absorption ratio may be calculated as follows:
The absorption ratio may be used to compensate the effect of red skin color variance by reducing the reflection of red light. In this formula, rms(Red), rms(Green) are the root mean square of Red and Green PPG signal, (Red_R), μ(Red_G) are the mean value of red color channel in red and green region respectively and k is the control variable to adjust the level of compensation.
In various embodiments, and with reference to
In various embodiments, and with reference to
In various embodiments, an optical filter may be utilized to remove any remaining unwanted wavelengths of light, thereby leaving only the desired wavelengths. For example, in various embodiments, and with reference to
In various embodiments, and with reference to
In various embodiments, and with continued reference to
In various embodiments, and with continued reference to
In various embodiments, and with reference to
In an example embodiment, the filters are in the case surrounding the device. For example, the filters are in the phone case. In an example embodiment, the light is in the case surrounding the device. For example, the light may be in the phone case. In an example embodiment, the camera is in the case surrounding the device. For example, the camera may be in the phone case. In an example embodiment, the processor is in the case surrounding the device. For example, the processor may be in the phone case. In this embodiment, the processor may communicate via Bluetooth or otherwise with the phone or other nearby devices. In an example embodiment, the device does not use the proximity sensor to perform the computations described herein. In an example embodiment, the device described herein can be used to compute: oxygen saturation, pulse rate, perfusion index, photoplethysmogram, blood pressure index, blood hydration, and/or body fat content; using the system described herein.
The term “non-transitory” is to be understood to remove only propagating transitory signals per se from the claim scope and does not relinquish rights to all standard computer-readable media that are not only propagating transitory signals per se. Stated another way, the meaning of the term “non-transitory computer-readable medium” and “non-transitory computer-readable storage medium” should be construed to exclude only those types of transitory computer-readable media which were found in In Re Nuijten to fall outside the scope of patentable subject matter under 35 U.S.C. § 101.
Benefits, other advantages, and solutions to problems have been described herein with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any elements that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as critical, required, or essential features or elements of the disclosure. The scope of the disclosure is accordingly to be limited by nothing other than the appended claims, in which reference to an element in the singular is not intended to mean “one and only one” unless explicitly so stated, but rather “one or more.” Moreover, where a phrase similar to ‘at least one of A, B, and C’ or ‘at least one of A, B, or C’ is used in the claims or specification, it is intended that the phrase be interpreted to mean that A alone may be present in an embodiment, B alone may be present in an embodiment, C alone may be present in an embodiment, or that any combination of the elements A, B and C may be present in a single embodiment; for example, A and B, A and C, B and C, or A and B and C.
Although the disclosure includes a method, it is contemplated that it may be embodied as computer program instructions on a tangible computer-readable carrier, such as a magnetic or optical memory or a magnetic or optical disk. All structural, chemical, and functional equivalents to the elements of the above-described various embodiments that are known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the present claims. Moreover, it is not necessary for a device or method to address each and every problem sought to be solved by the present disclosure, for it to be encompassed by the present claims.
Any reference to attached, fixed, connected or the like may include permanent, removable, temporary, partial, full and/or any other possible attachment option. Additionally, any reference to without contact (or similar phrases) may also include reduced contact or minimal contact. Surface shading lines may be used throughout the figures to denote different parts or areas but not necessarily to denote the same or different materials. In some cases, reference coordinates may be specific to each figure. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. No claim element is intended to invoke 35 U.S.C. 112(f) unless the element is expressly recited using the phrase “means for.” As used herein, the terms “comprises”, “comprising”, or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US17/57465 | 10/19/2017 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62410299 | Oct 2016 | US |