Patent Application
20230263408
The invention relates to the field of detecting breathing motion and cardiac motion of a patient and in particular to the detection of breathing motion and cardiac motion during medical imaging examinations or scan acquisitions.
The detection of breathing motion and cardiac motion of a patient has conventionally been done using sensors applied to the patient. Physiology signals for breathing and pulse may be provided by the analysis of a live video stream of a patient either in RGB or IR mode. For detection of breathing motion, visibility of the motion of the target body part such as the chest or the upper abdomen is required. In typical medical imaging scenarios coils, accessories, blankets or support devices may obstruct the view from a particular fixed view angle thus limiting the applicability of this technique. For non-obstructive remote cardiac physiology signal detection, also video data can be used to detect the color changes in the skin due to the pulsatile flow. The principle of measurement is then based on the pulse plethysmography principle. The signal strength may be reduced by different aspects, i.e. by the visibility of the skin due to top or facial hair or by the physiologic delay which may vary from patient to patient or for a single patient even over time. In general, video-based pulse plethysmography works well with a multi-spectral detector so that absorption and reflection properties of the skin can be self-calibrated for each video-frame. A preferred setup for such a technique is based on a visible RGB camera employing visible white light.
In Hu M, Zhai G, Li D, Fan Y, Duan H, Zhu W, et al. “Combination of near-infrared and thermal imaging techniques for the remote and simultaneous measurements of breathing and heart rates under sleep situation” in PLoS ONE 13(1) 2018 a far-infrared imager and an infrared camera equipped with IR-Cut lens and an infrared lighting array are described. The heart rate is detected by the infrared imaging system based on the absorption changes of the skin due to the blood flow in order to describe the quality of sleep.
The US patent application US2014/275832 discloses a device for obtaining vital signs information of an object (patient to be examined). The known device includes for example an infrared camera to acquire an image data set of the patient's skin portion. Vital sign information may then be derived from colour changes of the skin portion.
It is an object of the invention to provide a monitoring method and a monitoring system for detecting at least cardiac motion of a patient in an easy, versatile and reliable way, especially without the need of irradiating additional light.
According to the invention, this object is addressed by the subject matter of the independent claims. Preferred embodiments of the invention are described in the sub claims.
Therefore, according to the invention, a method for detecting at least one physiological signal of a patient is provided, wherein the method comprises the following method steps: monitoring at least a subsection of a patient's surface with a thermal camera which generates consecutive video frames with multiple pixels of the monitored subsection, wherein the subsection of a patient's surface includes at least a part of the mouth (including the lips) and/or nose area of the patient as a region of interest; generating time-resolved temperature values of at least one pixel of the region of interest; and generating a cardiac signal as the physiological signal based on the generated time-resolved temperature values.
If a cardiac signal is mentioned, a signal generated from the vibration wave following the contraction of the heart muscle in the chest is meant. The heart rate shown by the cardiac signal is the speed of the heartbeat which is typically measured by the number of heart beats per minute.
The method is adapted for generating a physiological signal based on temperature changes due to breathing air flow. That is why the region of interest includes the mouth and nose area or only the mouth or only the nose area.
The method concerns to generate a physiological signal based on temperature changes due to breathing air flow. This is done using a region of interest that includes the mouth and nose area or only the mouth or only the nose area. The thermal camera has a sensitivity range for wavelengths in the range of of 2-25 μm, i.e. well beyond the near-infrared and optical wavelength ranges. An insight of the invention is that nose and mouth have areas with mucous membranes which are typically more humid than normal skin. Airflow drastically changes the temperature of this surfaces resulting in a high SNR signal, representing both respiratory and cardiac activity. The respiratory signal is directly related to inspiration and expiration air flow. When the patient inhales the mucous surface is cooled and the temperature drops significantly and rises again on exhalation of warm air from inside generating the temporal signal.
According to a further aspect of the invention, the nose and mouth areas of the patient to be examined may be easily automatically recognised for example from the thermal video frames. The automatic recognition of the nose/and mouth area of may be done with simple commercially available face recognition software, which may be implemented on the basis of deep learning as often installed nowadays on mobile telephones with an integrated camera.
A broader insight of the present invention is that acquiring long wavelength infrared data from the nose and mouth area enables to derive accurate information on the patient cardiac and respiratory motion from the temperature variations represented in the long wavelength infrared data. In addition, workflow is made more efficient because the nose and mouth area are easily and accurately automatically identified or recognised from thermal or optical video frames.
According to a preferred embodiment of the invention, the method further comprises the method step of generating a respiration signal as an additional physiological signal based on the generated time-resolved temperature values.
If a respiration signal is mentioned, a signal generated from the inhalation and exhalation process of a patient's breathing is meant. The breathing rate is the number of breaths a person takes per time, e.g. per minute. During generating a respiration signal based on the generated temperature values, a low pixel temperature relative to the reference temperature indicates inhalation and a high pixel temperature relative to the reference temperature indicates exhalation.
According to a preferred embodiment of the invention, the method further comprises the method step of triggering and/or gating a scan acquisition based on the at least one physiological signal, wherein the scan acquisition is carried out during medical imaging examination with a medical imaging device and/or during medical therapy. Breathing and heart motions cause uncertainties during medical imaging examinations and/or during medical therapies, because organs, or ROIs in general, are moving during scan acquisition. The image data acquisition is triggered in dependence on the breathing motion and/or the cardiac motion, so that the uncertainties because of moving ROIs during scan acquisition are reduced. A medical imaging device can be for example MRI, CT, PET and a medical therapy can be for example radiotherapy.
A physiological signal is generated based on temperature changes due to breathing air flow. For generating temperature value variations due to breathing air flow, the region of interest includes the mouth and nose area or only the mouth or only the nose area. According to a preferred embodiment of the invention, the at least one pixel is from the pixels covering the patient's nostrils.
One advantage resides in providing a method, wherein in the step of generating time-resolved temperature values of at least one pixel of the region of interest one single pixel is used. Hence, it is not necessary to generate time-resolved values of all pixels of the region of interest. Time-resolved temperature values of only one single pixel may be sufficient to generate a physiological signal.
Further, according to the invention, a monitoring system for detecting at least one physiological signal of a patient is provided. The monitoring system comprises a thermal camera which is adapted for monitoring at least a subsection of a patient's surface. The thermal camera generates consecutive video frames with multiple pixels of the monitored subsection. The subsection of the patient's surface includes at least a part of the mouth and/or nose area of the patient as a region of interest. The monitoring system further comprises a signal processing unit which is adapted for generating time-resolved temperature values of at least one pixel of the region of interest and for generating a cardiac signal as the physiological signal based on the generated time-resolved temperature values.
According to a preferred embodiment of the invention, the monitoring system comprises a patient support which is adapted for holding the patient in such a way that the subsection of the patient's surface which may be monitored by the thermal camera comprises at least a part of the mouth and/or nose area of the patient. The patient support may be designed as a patient table that may be movable in all three spatial directions so that the positioning of the patient can be done very precisely. Additionally, also face and/or body tracking devices and algorithms can be used to further confine the region of interest. The camera itself may be such a device and known computer vision algorithms could be applied to determine e.g. facial or head area.
According to a preferred embodiment of the invention, the signal processing unit is adapted for generating a respiration signal based on the generated time-resolved temperature values as an additional physiological signal. For generating time-resolved temperature values, preferably a frequency range for the pulse is defined. The range may be for example between 40 and 300 beats per minute. For generating a second physiologically signal, preferably a range for respiration is defined. The range may be for example 10 to 20 breathing cycles per minute. By defining ranges, the contributions by band-passing may be separated. According to another preferred embodiment it is made use of the spatial shifting of the head due to the respiration which is larger than the pulse-induced motion. This shifting may be measured in order to get a clean respiration curve and to use its frequency to separate it in the thermal signal.
Further, according to the invention, a non-transitory computer-readable medium is provided which comprises instructions stored thereon, that when executed on a processor, induce a monitoring system with a thermal camera to perform the method a method for detecting at least one physiological signal of a patient.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter. Such an embodiment does not necessarily represent the full scope of the invention, however, and reference is made therefore to the claims and herein for interpreting the scope of the invention.
In the drawings:
A scan acquisition is carried out during medical imaging examination with a medical imaging device 11 and/or during medical therapy. Hence, it is possible to reduce uncertainties because of heart motions during medical imaging examinations and/or during medical therapies. Some regions are moving during scan acquisition because of the beating heart. The image data acquisition may be gated in dependence on the cardiac signal 9, so that the cardiac motion can be traced on medical images. Another opportunity is to trigger the image data acquisition in dependence on the cardiac signal 9, so that the image data acquisition is triggered every time the heart is in the same position. In
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope. Further, for the sake of clearness, not all elements in the drawings may have been supplied with reference signs.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20182416.6 | Jun 2020 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2021/066772 | 6/21/2021 | WO |
