The present disclosure relates to photoacoustic spectroscopy, and particularly to a contrast improvement method and a contrast improvement system for photoacoustic imaging.
Photoacoustic spectroscopy (PAS) is based on absorption of electromagnetic radiation by a sample. The absorbed energy is measured by detecting pressure fluctuations in the form of sound waves or shock pulses. It is a non-destructive technique applicable to almost all types of samples. Therefore, PAS is widely used in analysis of biological media, such as blood, skin, and/or a tumor, for example.
The general biomedical use of PAS has been limited to relatively thin biological samples because of depth limitation of irradiation and attenuation of radiation signals. Photoacoustic contrast agents are used in measurement of blood flow, or detection and monitoring of cancer cells. Photoacoustic contrast agents can improve contrast between an artery or a tumor itself and its surroundings. However, because photoacoustic contrast agents have a limited concentration range, the degree of contrast improvement is also limited.
Therefore, a contrast improvement method for photoacoustic images is desirable to overcome the above-described deficiencies.
The present invention is to provide a contrast improvement method and a computing system for improving the degree of contrast.
The present invention provides a contrast improvement method for photoacoustic imaging. First, a photoacoustic image is retrieved from a storage device. Then, a set of filters are calculated.
Each filter is defined as H, and H=R−1Z(ZHR−1R)−1. Wherein, R is an expected value of x(n)xH(n), when a detected signal of the retrieved photoacoustic image being defined as x(n)=[x(n)x(n−1) . . . x(n−M+1)]T, where n=0, . . . , N−1 and M≦N. In addition, Z=[z(
From another viewpoint, the present invention also provides a computing system for improving the contrast of a photoacoustic image. The computing system has a storage device for storing a photoacoustic image, and a processor operable for executing a contrast improvement system. The processor has an image retrieving module operable to retrieve the photoacoustic image from the storage device, an image decomposing module operable to decompose the photoacoustic image into a plurality of subband images using a set of filters, and an image integrating module operable to integrate the subband images to form an integrated image. Wherein, the image decomposing module has a filter calculating unit for calculating the set of filters, where each filter is defined as H, and H=R−1Z(ZHR−1R)−1. R is an expected value of x(n)xH(n), when the detected signal of the retrieved photoacoustic image being defined as x(n)=[x(n)x(n−1) . . . x(n−M+1)]T, where n=0, . . . , N−1 and M≦N. In addition, Z=[z(
The present invention will become more readily apparent to those ordinarily skilled in the art after reviewing the following detailed description and accompanying drawings, in which:
The present invention will now be described more specifically with reference to the following embodiments. It is to be noted that the following descriptions of preferred embodiments of this invention are presented herein for purpose of illustration and description only. It is not intended to be exhaustive or to be limited to the precise form disclosed.
The system and the method described here below are based on medium with different absorption coefficients generating acoustic waves with different frequency contents. Generally, assuming all other conditions (e.g., sample geometry, radiation duration, or radiation area) remain the same, a high absorption medium generates acoustic waves with higher frequency components. Therefore, imaging contrast, as described below, can be improved by decomposing a photoacoustic image into a plurality of subband images using a set of filters, and appropriately selecting and combining the subband images.
The electronic device 1 includes a data storage device 2, a processor 3, and a monitor 4. The data storage device 2 is operable to store at least one photoacoustic image. The processor 3 executes one or more computerized operations for the contrast improvement system 100 to improve the contrast of photoacoustic images in the data storage device 2. The monitor 4 is configured for displaying the contrast improved photoacoustic images. The contrast improvement system 100 may be included in the data storage device 2 or other computer readable medium of the electronic device 1.
In the first embodiment, the contrast improvement system 100 may include an image retrieving module 11, an image decomposing module 12, an image weighting module 13, and an image integrating module 14. Each of the function modules 11-14 may comprise one or more computerized instructions that may be executed by the processor 3. The image retrieving module 11 is operable to retrieve a photoacoustic image from the data storage device 2 of the electronic device 1. The image decomposing module 12 is operable to decompose the photoacoustic image into a plurality of subband images using a set of nonoverlapping filters. The image weighting module 13 is operable to select a proper weight of each subband image. It may be understood that the weight is a coefficient assigned to the subband images in sequence in order to represent their relative importance. The image integrating module 14 is operable to integrate the subband images to form an integrated image by calculating a sum of the weighted subband images.
If the photoacoustic image is assumed to be X(t), then in block S11, the frequency spectrum of X(t) may be divided to N subband images (X1(t), X2(t), . . . XN(t)) with nonoverlapping frequency spectra using a set of filters. The combination of the frequency spectrum of each subband filter occupies the whole bandwidth of the frequency spectrum of the photoacoustic image. The selection of the passband and the center frequency of each of the filters can be selected according to a range of absorption coefficients of the biological medium, such as blood, skin, and/or a tumor, for example.
In block S12, envelope detection of N subband images (X1(t), X2(t), . . . XN(t)) with nonoverlapping frequency spectra is done. The envelope detection may be performed by a squaring and low pass-filtering method or a Hilbert transform method, or other suitable kind of envelope detection method as would be known to those of ordinary skill in the art.
In one exemplary embodiment, the squaring and low pass-filtering method works by squaring an input signal, such as one of the subband images (X1(t), X2(t), . . . XN(t)), and sending it through a low-pass filter.
In one exemplary embodiment, the Hilbert transform method creates an analytic signal of the input signal by using a Hilbert transform. It may be understood that an analytic signal is a complex signal, where the real part is the original signal and the imaginary part is the Hilbert transform of the original signal. The envelope of the signal can be found by taking the absolute value of the analytic signal.
In block S13, the subband images can be equally weighted or optimally weighted. The optimal weight of each subband image corresponds to a maximal contrast-to-noise (CNR) of two regions to be distinguished in the corresponding subband image.
In one embodiment, the CNR of the two regions to be distinguished in one subband image is defined as:
where wk is the weighting of the k-th subband image, ak and bk are the first and second regions in the k-th subband image, ā is the mean of a,
The CNR can be rewritten as
where w=[w1, w2, . . . , wn]T is the weighting vector for the n subband images, and c=[ā1−
The electronic device 1a may be similar to the electronic device 1 in the first embodiment, and includes the data storage device 2, the processor 3, and the monitor 4.
The contrast improvement system 100a may include the image retrieving module 11, the image decomposing module 12, an image coloring module 13a, and an image integrating module 14a. Each of the function modules (11, 12, 13a, 14a) may comprise one or more computerized instructions that may be executed by the processor 3. The functions of the image retrieving module 11 and the image decomposing module 12 are similar to those in the first embodiment. The image coloring module 13a is operable to pseudo color each subband image, where the pseudo-color of each subband image is different from another subband image. The image integrating module 14a is operable to integrate the subband images to form an integrated image by combining the pseudo colored subband images.
In block S20, a photoacoustic image may be retrieved from the data storage device 2, where the photoacoustic image is decomposed into a plurality of subband images using a set of filters (block S21). It may be understood that the blocks S20 and S21 are similar with the blocks S10 and S11 in the first embodiment.
In block S22, each subband image may be pseudo colored. The pseudo coloring of each subband image may be done by mapping pixel values of each subband image to a color according to a table or function. Examples of pseudo colored subband images are described below.
In block S23, the subband images are combined into a combination image. In one exemplary embodiment, the combination image may be formed by superimposing the pseudo colored subband images to form the combination image.
With reference to
In the experiment, the radiation source means 22 is a frequency-doubled Nd:YAG laser (LS-2132U, LOTIS TII, Minsk, Belarus) operating at 1064 nm with a pulse duration of 5 ns. The pulse repetition rate is 15 Hz. The projecting means 24 is a 1 mm fiber (FT-1.0-UMT, Thorlabs, Newton, N.J., USA). A laser beam emitted from the laser is coupled into the fiber to irradiate a circular area with a diameter of 3 mm, where the irradiated laser energy density is 4.72 mJ/cm2. The acoustical detecting means 32 is a hydrophone (MH28, Force Technology, Brondby, Denmark) with a flat frequency spectrum from 0 to 20 MHz was used for photoacoustic signal detection. The scanning means 28 is a precision ultrasonic motor (NR-8, Nanomotion, Yokneam, Israel) controlled by the personal computer. The precision ultrasonic motor is used for scanning with a step size of 0.1 mm.
The sample 30 is made of agar with acoustic characteristics similar to those of biological tissue with a sound velocity at 1500 m/s. The sample 30 is made by first preparing Pure 2% agar (0710, AMRESCO Inc. Solon, Ohio USA), which has an absorption coefficient close to 0 cm−1 at 1064 nm and is used as the background media. Subsequently, two objects whose absorption coefficients are 41.75 and 5.01 cm−1 are embedded in the background media. The sample 30 is immersed in a tank (not shown) filled with deionized water for photoacoustic measurements. The acoustic waveforms are amplified by the preamplifer 34 (5073PR, Panametrics, Waltham, Mass., USA) and then sampled by a data acquisition card (CompuScope 14200, Gage, Lachine, QC, Canada) at 200 MHz. The acquired data are stored in the personal computer for subsequent data processing, and the personal computer includes the contrast improvement system 100 and 100a.
The subband images are obtained using three nonoverlapping filters whose magnitude spectra shown in
Therefore, in some embodiments, the image decomposing module 12 (see
Assuming the detected signal of the retrieved photoacoustic image from the image retrieving module 11 is a consecutive samples, i.e.,
x(n)=[x(n)x(n−1) . . . x(n−M+1)]T,
with M≦N, with ()T denoting the transpose, and n=0, . . . , N−1. Next, let the output signal yl(n) of the lth filter having coefficients hl(n) as
y
l(n)=Σm=0M−1hl(m)x(n−m)=hlHx(n),
with ()H denoting the Hermitian transpose and hl=[hl(0) . . . hl(M−1)]H. The output power of the lth filter can be expressed as
E{|y
l(n)|2}=E{hlHx(n)xH(n)hl}=hlHRhl,
where E{} denotes the expected value and R=E{x(n)xH(n)} is the covariance matrix. The total output power of all the filters is
Σl=1LE{|yl(n)|2}=Σl=1LhlHRhl.
We define a matrix H=[hl . . . hL]. The total output power is therefore
The filter bank matrix H (i.e. the optimal filter) that could minimize the total energy can be given as
H=R
−1
Z(ZHR−1R)−1,
where ZεCM×L has a Vandermonde structure and is constructed from L complex sinusoidal vectors as
Z=[z(
with z(
0=arg max Tr[(ZHR−1R)−1],
which depends only on the covariance matrix and the Vandermonde matrix constructed for different candidate fundamental frequencies.
In
The lateral projections of the three subband images in
Finally, the effectiveness of optimal weighting is demonstrated in
The experiment shows that the contrast improvement methods disclosed above enhance the contrast between objects with different absorption coefficients. The contrast can be further improved by using optimal weighting or pseudo coloring.
It is understood that the results disclosed above are general. In other words, no assumptions were made regarding the nature of the images, so that the other kind of photoacoustic imaging setup can also be used to collect photoacoustic signals, and applications of photoacoustic contrast agents in the sample or the application of the arbitrary grayscale mapping or other processing can be employed to improve the contrast before processing of the photoacoustic signals using the contrast improvement system 100, 100a provided in the present disclosure.
While the invention has been described in terms of what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention needs not be limited to the disclosed embodiment. On the contrary, it is intended to cover various modifications and similar arrangements included within the spirit and scope of the appended claims which are to be accorded with the broadest interpretation so as to encompass all such modifications and similar structures.
The present application is a continuation-in-part application of U.S. patent application Ser. No. 12/545,085, which is filed Aug. 21, 2009 and now pending, contents of which are incorporated herein by reference in its entirety and made a part of this specification.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12545085 | Aug 2009 | US |
| Child | 13557202 | US |