The present disclosure relates to a photoacoustic and ultrasonic imaging device and a method of forming a photoacoustic image and an ultrasound image.
A peripheral vascular image is important for evaluating blood circulation in a patient with a peripheral arterial disease. Many vascular imaging technologies, such as a Doppler ultrasonic image, computed tomography (CT) or magnetic resonance (MR) angiography, are performed for clinical use but a spatial resolution for visualizing microvessels is generally low. CT and MR angiography are not suitable for a regular checkup because a contrast medium should be injected to obtain an image of blood vessels. Doppler ultrasonography is relatively safe but resolution is low.
Embodiments are directed to providing an image from a high-resolution dual-mode photoacoustic (PA) image/ultrasonic image on the basis of structural information of an ultrasonic image.
A photoacoustic and ultrasonic imaging device according to an embodiment includes a laser light source configured to generate a laser, an ultrasonic wave source configured to generate an ultrasonic wave generation signal, an imaging probe including a laser emitter configured to receive the laser and emit the laser to a target and an ultrasonic transducer configured to receive the ultrasonic wave generation signal, emit an ultrasonic wave to the target, and detect a photoacoustic signal and an ultrasonic signal generated and reflected from the target, and an operation unit configured to form an image of tissue in the target from the laser and an image of tissue in the target from the ultrasonic wave on the basis of the ultrasonic signal detected by the ultrasonic transducer.
According to an aspect of an embodiment, the imaging probe may emit the laser and the ultrasonic wave while moving along a contour profile of the target.
According to an aspect of an embodiment, the laser light source may form and provide laser having two or more different wavelengths.
According to an aspect of an embodiment, the image of the tissue in the target may be an image of blood vessels in the target.
According to an aspect of an embodiment, the image of the tissue in the target from the ultrasonic wave may include at least one of an image of blood vessels in the target, an image of the skin of the target, and an image of bones of the target.
According to an aspect of an embodiment, the ultrasonic transducer may include a plurality of transducers configured to provide the ultrasonic wave to the target and arranged in an array.
According to an aspect of an embodiment, the photoacoustic and ultrasonic wave imaging device may further include a distance sensor, and the distance sensor may form a contour profile of the target by detecting a distance to the target before the laser is emitted to the target.
According to an aspect of an embodiment, the ultrasonic wave source may control the laser light source and the ultrasonic transducer to emit the laser and the ultrasonic wave in synchronization with each other.
According to an aspect of an embodiment, the photoacoustic and ultrasonic imaging device may further include an examination table configured to place the target thereon, and the examination table may include a target fixing part configured to fix the target, a moving structure configured to place and move the imaging probe on the target, and a container filled with a medium for delivering an ultrasonic wave and a photoacoustic signal between the target and the imaging probe.
A method of forming a photoacoustic image and an ultrasonic image of a target according to an embodiment includes (a) forming a contour profile of the target, (b) providing laser light and an ultrasonic wave to the target according to the contour profile, and (c) forming a photoacoustic image and an ultrasonic image of the target by detecting a photoacoustic signal generated from the laser light and an ultrasonic signal generated from the ultrasonic wave.
According to an aspect of an embodiment, operation (a) may include forming the contour profile of the target by calculating a distance to the target using an ultrasonic transducer or a distance sensor.
According to an aspect of an embodiment, operation (b) may include maintaining a constant distance between the target and an ultrasonic transducer and a constant distance between the target and a laser emitter.
According to an aspect of an embodiment, operation (b) may be performed after the forming of the contour profile of the entire target.
According to an aspect of an embodiment, operation (a) may be performed on a certain area of the target, and operation (b) may be performed while moving along a contour profile of the area.
According to an aspect of an embodiment, the forming of the photoacoustic image of the target may include detecting a background signal for surrounding tissues, calculating a representative value of the background signal, and compensating an image of the target on the basis of the representative value of the background signal.
According to an aspect of an embodiment, the representative value may be the average brightness of the background signal.
According to an aspect of an embodiment, the compensating of the image of the target may include dividing the pixel intensity of the photoacoustic image by the representative value
According to an aspect of an embodiment, the ultrasonic wave and the laser may be emitted in synchronization with each other.
According to an aspect of an embodiment, operation (b) may be performed by two or more laser beams having different wavelengths, and operation (c) may include forming a photoacoustic image from the emitted two or more laser beams having different wavelengths.
According to an aspect of an embodiment, the method may further include (d) calculating a hemoglobin concentration, a blood oxygen saturation, a vessel distribution density and a vessel depth from the photoacoustic image and the ultrasonic image.
According to an aspect of an embodiment, the method may further include (d) calculating a hemoglobin concentration, a blood oxygen saturation, a vessel distribution density and a vessel depth from the photoacoustic image and the ultrasonic image.
Embodiments provide a multi-structure image extracted from a combination of images of various structures (e.g., skin, bones, and blood vessels) with a photoacoustic vascular image. In addition, the resolution of an image can be improved by performing scanning along a contour of a target using a contour scan technique.
Hereinafter, embodiments will be described with reference to the accompanying drawings.
Referring to
The ultrasonic unit 140 may include the ultrasonic wave source 142 and the operation unit 146 configured to receive a signal detected by the ultrasonic transducer 240 and perform imaging. In the embodiment shown in
The ultrasonic wave source 142 forms and provides an ultrasonic wave of a predetermined frequency. In an embodiment, the ultrasonic wave provided by the ultrasonic wave source 142 may be an ultrasonic wave having a center frequency of 5.5 MHz to 11.5 MHz. For example, the ultrasonic wave source 142 may be an ultrasonic system ECUBE 12R manufactured by Alpinion Medical Systems Co. Ltd.
When a laser has a pulse repetition rate of 10 Hz, one photoacoustic image can be obtained from one or more consecutive laser pulses and an available frame rate may be 10 Hz or less for both a photoacoustic image and an ultrasonic image (US). However, this is only an example, and an available frame rate may be higher or lower than 10 Hz.
The imaging probe 200 includes the laser emitter 220 configured to receive a laser and provide the laser to a target T and one or more ultrasonic transducers 240 configured to receive an ultrasonic wave and provide the ultrasonic wave to the target T. In an embodiment, the laser emitter 220 may include a plurality of optical fiber bundles connected to the laser light source 120, and emit a linear laser to the target T. The ultrasonic transducer 240 may include one or more transducers arranged in an array, e.g., 128 transducers arranged in an array. This is only exemplary. The ultrasonic transducer 240 receives an ultrasonic wave generation signal provided from the ultrasonic wave source 142, forms an ultrasonic wave corresponding to the ultrasonic wave generation signal, and provides the ultrasonic wave to the target T. The ultrasonic transducer 240 and the laser emitter 220 may each be moved by a motor drive (not shown) controlled by a controller.
The ultrasonic transducer 240 and the laser emitter 220 included in the imaging probe 200 are provided such that a laser beam from the laser emitter 220 and an ultrasonic wave from the ultrasonic transducer 240 match an image plane at a predetermined location below the imaging probe 200. In an embodiment, the laser beam and the ultrasonic wave are provided to coincide with each other 10 to 50 mm below the imaging probe 200 and may coincide with each other, for example, at a depth of 30 mm in the target T.
The ultrasonic wave from the ultrasonic transducer 240 is provided to the target T. An ultrasonic signal corresponding to the tissue and structure in the target T is generated from the provided ultrasonic wave and provided to the outside of the target T.
The laser light provided to the target T from the laser emitter 220 is absorbed into the tissue in the target T. A signal in an ultrasonic band corresponding to the tissue in the target T absorbing the laser light is formed and provided to the outside of the target T.
Ultrasonic signals provided from the target T are detected by the ultrasonic transducer 240. An ultrasonic signal detected by the ultrasonic transducer 240 is provided to the operation unit 146. The operation unit 146 detects a signal generated from a laser provided to the target T and forms a photoacoustic image using, for example, a Fourier domain reconstruction technique.
The operation unit 146 detects a signal, which is formed in the target T, from an ultrasonic wave provided to the target T and reconstructs an ultrasonic image by performing, for example, delay-and-sum beamforming. In an embodiment, a reconstructed photoacoustic image and ultrasonic image may each be generated, displayed and stored in the form of an image signal by the operation unit 146.
In an embodiment not shown herein, an imaging probe may further include a distance sensor configured to obtain a contour profile of a target by measuring a distance to the target.
An operation of the photoacoustic/ultrasonic imaging device 1 having the above configuration will be described below.
A contour of the target T is obtained by scanning the target T with the ultrasonic transducer 240. In an embodiment, an ultrasonic image of the skin is obtained using the ultrasonic transducer 240. A process of detecting the skin is preferably simplified to quickly perform a process of obtaining an image of the skin so as to obtain a contour. In an embodiment, the process of detecting the skin may be performed by setting a threshold according to the strength of an ultrasonic wave and performing a smoothing process using boxcar or median filtering. A contour profile corresponding to a height of the target T is obtained by selecting a median on the obtained ultrasonic image of the skin in an X-axis direction.
The obtained contour profile corresponding to the height of the target T is used for the imaging probe 200 to perform scanning at a constant speed in a Y-axis direction and control a motor drive (not shown) to be moved in a Z-axis direction according to the height of the target T.
The obtaining of the contour according to the embodiment may be performed before photoacoustic/ultrasonic imaging the target T. In an embodiment, the photoacoustic/ultrasonic imaging may be performed after the obtaining of the contour. That is, after the contour of the target T is obtained, the photoacoustic/ultrasonic imaging may be performed according to the obtained contour. In another embodiment, a contour of a predetermined portion of the target T may be obtained, photoacoustic/ultrasonic imaging may be performed on the predetermined portion according to the contour, and the obtaining of a contour and the performing of photoacoustic/ultrasonic imaging may be repeatedly performed. In an embodiment not shown herein, the obtaining of the contour may be performed by a distance sensor.
The target T may be placed on an examination table (not shown) to perform an imaging process on the target T. The examination table may include a target fixing part (not shown) for fixing the target T during the imaging process. The examination table may include a moving structure (not shown) including rails and a frame for allowing an imaging probe 200 to perform imaging while moving on the target T. The moving structure may be an electric moving structure for moving the imaging probe 200 in directions of X, Y, and Z axes.
The examination table may include a container (not shown) for immersing the target T into a medium, and the container is filled with a medium for delivering an ultrasonic wave and a photoacoustic signal. In an embodiment, the target fixing part may fix the target T by immersing the target T into the container, and a liquid into which the target T is immersed may be water.
In the embodiment of
A step size by which the imaging probe 200 is moved by an electric stage (not shown) in the Y-axis direction may be less than a −6 dB beam width of an ultrasonic transducer array. For example, a step size by which the imaging probe 200 moves in the Y-axis direction may be less than 0.5 mm.
A width w by which the imaging probe 200 scans the target T by providing a laser and an ultrasonic wave to the target T may be less than a width of the target T. In this case, a photoacoustic image and an ultrasonic image of the entire target T may be obtained by performing scanning a plurality of times while the target T is fixed.
As shown in
To obtain an image of the entire target T, scanning is performed and a photoacoustic image and an ultrasonic image obtained by scanning are merged by computer software to form a three-dimensional (3D) image. In an embodiment, an image of the entire target T may be obtained by performing scanning a plurality of times. In an embodiment, the 3D image may be obtained by computer software.
In an embodiment, in order to reconstruct structural information of an original contour of a photoacoustic/ultrasonic image obtained at the same height as the target T by scanning a contour, a height of this image may be adjusted according to a height of the contour and a plurality of scanning results may be merged by computer software.
A volumetric image may be obtained from the photoacoustic/ultrasonic image of the entire target T, and essential components of the target T are extracted. An ultrasonic volumetric image of a target shows a variety of structures, such as the skin (hyperechoic), bones (which is hyperechoic but a lower part thereof is non-echoic), and blood vessels (which are hyperechoic but the inside of which is non-echoic), according to brightness.
However, because the laser light provided to the target T may scatter and the intensity of the laser light decreases as a depth to which the laser light penetrates the skin increases, signal processing is performed on a background signal to form an image with sufficient signal intensity. A background signal of tissue around blood vessels is formed from the laser light provided to the target T, and it is expected that a laser forming the background signal will attenuate with the same tendency as a laser provided to the tissue around the blood vessels.
Therefore, a representative value may be calculated by extracting the background signal excluding a vascular signal, and a tendency in which light attenuates may be identified by identifying a tendency of a representative value of a position in the target T. For example, the representative value of the background signal may be an average value of an intensity of the background signal within a certain area.
Therefore, the tendency of the representative value corresponds to a tendency of attenuation of the laser light penetrating the target T, and an image formed by compensating an image of tissue in the target T is substantially the same as an image of blood vessels in the target T shown in
Experimental examples of an embodiment will be described with reference to the accompanying drawings below.
Therefore, it can be seen that a resolution and signal strength of an image of
A left diagram of
Referring to
For example, the total hemoglobin concentration HbT and the oxygen saturation sO2 were measured based on the fact that an optical absorption rate of oxidized or non-oxidized hemoglobin varies according to a laser wavelength. Oxidized/non-oxidized hemoglobin concentrations at pixels of a photoacoustic image formed and obtained by emitting laser light having two or more wavelengths (four wavelengths in an embodiment) may be calculated using a linear equation, the total hemoglobin concentration HbT may be calculated by adding the oxidized/non-oxidized hemoglobin concentrations, and the oxygen saturation sO2 may be calculated by dividing the oxidized hemoglobin concentration by the total hemoglobin concentration HbT.
For example, the subcutaneous blood vessel depth Depth may be calculated by detecting a position of the skin from an ultrasonic or photoacoustic image, a position of a pixel corresponding to each blood vessel may be calculated and expressed as a vertical distance from a position of a pixel of the skin, and when the position of the skin is detected from a photoacoustic image, the position of the skin may be detected from a melanin distribution form by calculating an optical absorption rate of the melanin component in the skin in a photoacoustic image, which is obtained from laser light having two or more wavelengths, using a linear equation, similar to the above description with respect to hemoglobin.
Referring to
As shown in
Although the present disclosure has been described above with reference to embodiments shown in the drawings to help understand the present disclosure, the embodiments are only exemplary and it will be understood by those of ordinary skill in the art that various modifications may be made and equivalent embodiments may be implemented. Therefore, the scope of the present disclosure should be defined by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2021-0105598 | Aug 2021 | KR | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/KR2021/011871 | 9/2/2021 | WO |