Field of the Invention
The field of the invention is data processing, or, more specifically, methods, apparatus, and products for contactless blood pressure monitoring of a patient.
Description Of Related Art
Current medical technology for gathering various blood related metrics such as blood pressure, heart rate, and blood flow rate, generally require physical contact between a patient and a medical device. For example, blood pressure is generally measured with a sphygmomanometer (also called a blood pressure meter or monitor) that includes an inflatable cuff. Such a cuff constricts the blood flow through a patient's veins when inflated and contracts in a controlled manner to measure the blood pressure of the vein when constricted and when unconstricted. Such a constriction may be uncomfortable for many patients.
Methods, apparatus and products for A method of contactless blood pressure monitoring of a patient are disclosed in this specification. Such contactless blood pressure monitoring includes: illuminating, by a blood pressure monitoring system, a blood vessel of a patient with infrared (‘IR’) light; receiving, by an IR camera of the blood pressure monitoring system through a polarizing filter, IR light reflected by the patient; capturing at a time based on a heartrate of the patient, by the IR camera of the blood pressure monitoring system, a first IR image of the blood vessel of the patient when the blood vessel is distended; determining, by the blood pressure monitoring system from the first image, a maximum diameter of the blood vessel; capturing at a time based on the heartrate of the patient, by IR camera of the contactless blood pressure monitoring system, a second IR image of the blood vessel of the patient when the blood vessel is contracted; determining, by the blood pressure monitoring system from the second IR image, a minimum diameter of the blood vessel; and calculating, by the blood pressure monitoring system, blood pressure of the patient in dependence upon the maximum and minimum diameters of the blood vessel.
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of exemplary embodiments of the invention as illustrated in the accompanying drawings wherein like reference numbers generally represent like parts of exemplary embodiments of the invention.
Exemplary methods, apparatus, and products for contactless blood pressure monitoring of a patient in accordance with the present invention are described with reference to the accompanying drawings, beginning with
The example computer (152) of
Stored in RAM (168) is a blood pressure monitoring module (126), a module of computer program instructions for contactless blood pressure monitoring in accordance with embodiments of the present invention. To that end, the blood pressure monitoring module (126) may illuminate, through use of the IR light source (102), one or more blood vessels of a patient (100) with IR light. In some embodiments of the present invention, illuminating the patient (100) with IR light may include illuminating the patient's face. The face includes many blood vessels in the form of veins, capillaries, and so on as will occur to readers of skill in the art. A blood vessel, as the term is used in this specification, may refer to any or all of: a vein, a capillary, and an artery.
The blood pressure monitoring module (126) may also receive, by an IR camera (104) through a polarizing filter (108), IR light reflected (110) by the patient (100). The camera (104) in the example of
The blood pressure monitoring module (126), through the camera (104) may also capture at a time based on a heartrate of the patient a first IR image of the blood vessel of the patient when the blood vessel is distended—that is, fully dilated. Readers of skill in the art will recognize that such a ‘capture’ of an image may be carried out by capturing many images, by capturing a stream of frames in a digital video for example, and sampling the image data from the many images. In fact, each time the term ‘capture’ is used in this specification, readers of skill in the art will recognize that the term may refer to capturing many images and sampling the image data from those images.
A heart beat occurs in a cardiac cycle. The cardiac cycle begins in systole in which the ventricles of the heart contract, pumping blood out to the cardiovascular network. The cycle continues with an intervening pause, finally followed by diastole in which the ventricles of the heart relax. Responsive to the systole period in the cardiac cycle vessels experience increased pressure and thus distend. At this point, based on a known or calculated heart rate (described below), the blood pressure monitoring module captures an IR image of the blood vessel. Readers of skill in the art will recognize that capturing an IR image of a blood vessel refers generally to capturing an image of a portion of the vessel, rather than the entire vessel.
From the first IR image, the blood pressure monitoring module (126) may determine a maximum diameter of the blood vessel. The diameter may be calculated based on image processing of the image where edges of the vessels may be identified and the distance between the edges at the point of maximum distension may be calculated in a variety of ways.
The blood pressure monitoring module (126), through the camera (104), may then capture at a time based on the heartrate of the patient, a second IR image of the blood vessel of the patient when the blood vessel is contracted. The same portion of the blood vessel previously captured in an IR image when at full distension may be captured when the vessel is fully contracted, that is during the diastole period of the cardiac cycle of the heart. Likewise, the blood pressure monitoring may determine, from the second IR image, a minimum diameter of the blood vessel.
From these maximum diameters, the blood pressure monitoring module may then calculate blood pressure of the patient. Blood pressure is generally directly proportional to the product of the blood flow rate and total peripheral resistance. Total peripheral resistance is highly variable based on the radius of the blood vessel. The blood pressure monitoring module (126) may calculate blood pressure in a variety of ways. Blood pressure generally is measured at diastole and at systole. In some embodiments, the blood pressure monitoring module (126) may calculate the diastolic blood pressure by assuming or calculating a blood flow rate, approximating the total peripheral resistance based on the maximum diameter, and calculating the product of the two. The blood pressure monitoring module (126) may also calculate the systolic blood pressure by assuming or calculating a blood flow rate, approximating the total peripheral resistance based on the minimum diameter, and calculating the product of the two. Readers of skill in the art will recognize that this is but one way, among many possible ways, to calculate blood pressure from the maximum and minimum diameters of a blood vessel. Each such possible way is well within the scope of the present invention.
Readers of skill in the art will recognize the blood pressure monitoring system depicted in
Also stored in RAM (168) is an operating system (154). Operating systems useful in computers configured for contactless blood pressure monitoring of a patient according to embodiments of the present invention include UNIX™, Linux™, Microsoft Windows™, AIX™, IBM's i™ operating system, and others as will occur to those of skill in the art. The operating system (154) and blood pressure monitoring module (126) in the example of
The computer (152) of
The example computer (152) of
The exemplary computer (152) of
The arrangement of computer components, cameras, and light sources making up the exemplary system illustrated in
For further explanation,
The method of
The method of
The method of
The method of
The method of
The method of
For further explanation,
As mentioned above, the heartrate of the patient, which may be used to determine the timing of capturing the IR images of the patient's blood vessel at distension and contraction, may be assumed or otherwise calculated. To that end, the method of
The method of
The method of
When the heart beats, blood flows more quickly through the vessel, and the vessel distends. Upon doing so, the color of the vessel varies. The variation is periodic (or semi-periodic) based on the regular periodic heart beat of the patient. As such, the periodicity, or frequency, of the variance of the color may be utilized as the heartbeat.
Each image in the series of images includes a plurality of pixels. Each pixel is defined by intensity values for red, intensity values for green, and intensity values for blue. As the color of the vessel varies, the pixel in each image varies in intensity values. As such, identifying (408) maximum RGBa intensity values from the images may be carried out in a variety of ways. In one example, the blood pressure monitoring system may calculate for each of a number of pixels and for each color, average intensity values. The blood pressure monitoring may then calculate a score based on the sum of the average intensity values of the colors and compare those sums to sums of other images in the series. Those having the highest intensity values within a range of one another may be determined to be images containing maximum RGBa intensity values.
Not only may the heartrate of the patient be calculated for later use in capturing IR images for blood pressure calculation, but the heartrate may be a diagnostic provided to the patient or doctor.
For further explanation, the method of
The method of
Blood flow rate may be determined by the time it takes for blood to flow from one point, an upstream location, to a second point in the blood vessel, a downstream location. The blood pressure monitoring system may be configured or calculate a distance between the upstream and downstream location, then identify in the images when the blood flows through each location. The blood pressure monitoring may identify a time when the blood flows through a location as the time at which the vessel distends at that location. That is, at a first time, the blood flows through the upstream location, distending the vessel at that location. Later, at a second time, the blood flows through the downstream location distending the vessel at that location. The ratio of the difference in times between the two distensions and the distance between the two locations is the blood flow rate.
As mentioned above, the blood flow rate may be utilized in the calculation of blood pressure. To that end, calculating (224) blood pressure of the patient may be carried out by calculating (516) blood pressure of the patient in dependence upon the blood flow rate and the maximum and minimum diameters of the blood vessel.
For further explanation,
For further explanation, the method of
The method of
The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
It will be understood from the foregoing description that modifications and changes may be made in various embodiments of the present invention without departing from its true spirit. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present invention is limited only by the language of the following claims.
This application is a continuation application of and claims priority from U.S. patent application Ser. No. 15/349,428, filed on Nov. 11, 2016.
Number | Name | Date | Kind |
---|---|---|---|
5193548 | Miyawaki | Mar 1993 | A |
5598842 | Ishihara | Feb 1997 | A |
9622666 | Pahlevan | Apr 2017 | B2 |
9891044 | Tu | Feb 2018 | B2 |
20050228300 | Jaime et al. | Oct 2005 | A1 |
20130079649 | Mestha | Mar 2013 | A1 |
20130218028 | Mestha | Aug 2013 | A1 |
20130322729 | Mestha | Dec 2013 | A1 |
20140005554 | Das et al. | Jan 2014 | A1 |
20150057511 | Basu | Feb 2015 | A1 |
20150112214 | Mizukami | Apr 2015 | A1 |
20150216425 | Gladshtein et al. | Aug 2015 | A1 |
20160033319 | Kovacs | Feb 2016 | A1 |
20160106329 | Hoof | Apr 2016 | A1 |
20160262625 | Lawrenson et al. | Sep 2016 | A1 |
20170049377 | Littell | Feb 2017 | A1 |
Number | Date | Country |
---|---|---|
105011921 | Nov 2015 | CN |
Entry |
---|
Shiffman (Color, https://processing.org/tutorials/color/, Jun. 10, 2013). |
Zurek, Petr, Ondrej Krejcar, Marek Penhaker, Martin Cerny, and Robert Frischer. “Continuous noninvasive blood pressure measurement by near infra red CCD camera and pulse transmit time systems.” In Computer Engineering and Applications (ICCEA), 2010 Second International Conference on, vol. 2, pp. 449-453. IEEE, 2010. |
English language translation of Ding et al. (Chinese Pub. No. CN 105011921 A, Nov. 4, 2015). |
Chen, Hean C., Vinod Patel, Jutta Wiek, Salwan M. Rassam, and Eva M. Kohner. “Vessel diameter changes during the cardiac cycle.” Eye 8, No. 1 (1994): 97. |
Braverman, Irwin M. “The cutaneous microcirculation.” In Journal of Investigative Dermatology Symposium Proceedings, vol. 5, No. 1, pp. 3-9. Elsevier, 2000. |
Rogalski, A., P. Martyniuk, and M. Kopytko. “Challenges of small-pixel infrared detectors: a review.” Reports on Progress in Physics 79, No. 4 (2016): 046501. |
Seal, Ayan, Suranjan Ganguly, Debotosh Bhattacharjee, Mita Nasipuri, and Dipak Kumar Basu. “A Comparative Study of Human thermal face recognition based on Haar wavelet transform (HWT) and Local Binary Pattern (LBP).” arXiv preprint arXiv:1309.1009 (2013). |
Soleimani, Effat, Manijhe Mokhtari-Dizaji, Nasser Fatouraee, and Hazhir Saberi. “Assessing the blood pressure waveform of the carotid artery using an ultrasound image processing method.” Ultrasonography 36, No. 2 (2017): 144. Published online Sep. 20, 2016. doi: 10.14366/usg.16019. |
Tarassenko et al., Non-contact video-based vital sign monitoring using ambient light and auto-regressive models, Physiological Measurement, vol. 35, Mar. 28, 2014, pp. 807-31, Institute of Physics and Engineering in Medicine (online, iopscience.iop.org), URL: www.iopscience.iop.org/article/10.1088/0967-3334/35/5/807/pdf. |
Chowdhury et al., Noninvasive Cuffless Estimation of Blood Pressure using Photoplethesmography without Electrocardiograph Measurement, Conference Paper, IEEE Region 10 Technical Symposium, Apr. 2014, 3 pages, ResearchGate.org (online), URL: www.researchgate.net/publication/259579877_Noninvasive_Cuffless_Estimation_of_Blood_Pressure_using_Photoplethesmography_without_Electrocardiograph_Measurement. |
Jeong et al., Introducing Contactless Blood Pressure Assessment Using a High Speed Video Camera, Journal of Medical Systems, Apr. 2016, vol. 40, Issue 4, (abstract only) 2 Pages, US National Library of Medicine, National Institutes of Health, National Center for Biotechnology Information online (PubMed.gov), URL: www.ncbi.nlm.nih.gov/pubmed/26791993. |
Gu et al., A novel method for the contactless and continuous measurement of arterial blood pressure on a sleeping bed, Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Sep. 2009, (abstract only) 1 Page, US National Library of Medicine, National Institutes of Health, National Center for Biotechnology Information online (PubMed.gov), URL: www.ncbi.nlm.nih.gov/pubmed/19965255. |
Withings, Wireless Blood Pressure Monitor for Apple and Android, amazon.com (online), [accessed Oct. 27, 2016], 2 pages, URL: https://www.amazon.com/Withings-Wireless-Pressure-Monitor-Android/dp/B00H43WOAK/ref=as_li_ss_tl?s=hpc&ie=UTF8&qid=1475264507&sr=1-1&keywords=withings+blood+pressure+cuff&linkCode=sl1&tag=lrh01-20&linkId=63adfc09cd648078279d459487e0b412. |
Auralife, Instant Blood Pressure, accessed Dec. 6, 2016 [online], 7 pages, URL: www.instantbloodpressure.com. |
Wu et al., Contactless and Cuffless Monitoring of Blood Pressure on a Chair Using E-Textile Materials, Conference paper, 3rd IEEE/EMBS International Summer School on Medical Devices and Biosensors (abstract only), Oct. 2006, 1 page, ResearchGate.net [online], URL: www.researchgate.net/publication/224703767_Contactless_and_Cuffless_Monitoring_of Blood_Pressure_on_a_Chair Using_E-Textile_Materials. |
AUS920160617US2, Appendix P; List of IBM Patent or Applications Treated as Related, Aug. 1, 2017, 2 pages. |
Fuksis, R. et al., “Infrared Imaging System for Analysis of Blood Vessel Structure”, Institute of Electronics and Computer Science, Elektronika IR Elektrotechnika, Electronics and Electrical Engineering, vol. 1, No. 97, ISSN 1392-1215, Jan. 1, 2010, pp. 45-48. |
International Search Report and Written Opinion, PCT/EP2017/062425, dated Sep. 1, 2017, 16 pages. |
Number | Date | Country | |
---|---|---|---|
20180132797 A1 | May 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15349428 | Nov 2016 | US |
Child | 15493775 | US |