Certain references are cited herein. These references are incorporated by reference herein.
Medical image composition is the act of joining image volumes from separate views from a medical image scanner into one consistent seamless whole volume. This is done via the method of composing (also called stitching or mosaicing).
In “stitching”, an algorithm is used to fill in the voxels of the output larger volume according to the locations computed by alignment. Where only one input volume overlaps an output voxel location, data is copied directly from the input to the output. Where two or more input volumes overlap at an output voxel, program logic is used to determine how to choose between the input datapoints, or to blend them together. Where no input volume overlaps the output, black voxels are used to fill.
The goals of blending the component volumes are to limit artifacts that can occur from image volume distortion or patent/anatomy motion. These include, (a) limiting visible seams or creases; (b) limiting contrast variation; and (c) limiting ghosting effects due to blending.
The increase of the field strength of newer MR imaging machines (such as the Siemens Trio) provides the opportunity for much improved image resolution and quality. A challenge with these systems is that the increased magnetic strength has resulted in magnifying B0 effects (a magnetic loading distortion effect). B0 effects present themselves as a localized distortion in the volume. B0 distortion can occur anywhere within the volume, but is most pronounced in the regions on the periphery of the iso-center of the volume. Much effort has been made to correct for these effects in the design of MRI installations [1].
Whole body scans of a patient can take up a plurality of 3-5 individual volume acquisitions which are then composed together in order to capture a complete scan of an individual. Since B0 effects are most evident in the leading or trailing edges of a MR volume, having sufficient volume overlap and discarding the leading or trailing regions is a possible solution. However, these kinds of solutions will inevitably result in the need for more volumes, and the more volumes that are required for an individual, the more time individual subject workflow takes which can cut into the efficiency of a MR installation. Also, there is no certainty as to the location(s) where B0 effects might occur in a volume. This makes narrowing the field of view of a volume an expensive and imprecise solution.
B0 effects are not the only artifacts that can interfere with successful composition. Movement of the patient or anatomy between scans can also interfere, and should also be taken into account.
The invention provides a method and system which uses a process of registration to develop a distortion field between the overlapping regions of two adjoining volumes. Then the method and system includes gradual displacement morphing, and intensity blending is performed to create a seamless transition between the two volumes.
The invention provides a method for composing image volumes obtained using a medical scanning device, comprising the steps of: using a medical scanning device to obtain data of at least two image volumes of a patient, said image volumes having an overlap region; processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
The invention provides an article of manufacture comprising a computer-usable medium having computer-readable program code embodied therein for composing a composite image from at least two smaller images, the computer-readable program code having instructions for performing the following steps: obtaining data of at least two image volumes of a patient, said image volumes having an overlap region; processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
The invention provides a system for composing an image from two smaller image volumes of data obtained using a medical scanning device, comprising: a scanner for obtaining image data for at least two image volumes of a patient, wherein the image volumes have an overlap region; a processor for: processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
A preferred embodiment of the invention will be described, but the invention is not limited to this embodiment.
The invention provides a method for composing image volumes obtained using a medical scanning device, comprising the steps of: using a medical scanning device to obtain data of at least two image volumes of a patient, said image volumes having an overlap region; processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
The medical scanning device may be selected from the group consisting of MRI, CT, Ultrasound, Radiography, and PET imagers. The elastic registration algorithm may be based on the maximization of an intensity-based similarity metric between the two image volumes. The metric may be selected from the group consisting of Local Cross Correlation and Mutual Information. The elastic registration algorithm may model the deformation as a smooth vector field that indicates, for each pixel in one of the image volumes, its corresponding pixel location in a second image in the other image volume. The deformation and its inverse may be estimated iteratively by maximizing an intensity-based similarity metric and are regularized using a low-pass filter. The method may include computing values of Im1 and Im2, according to the following equation:
I
m1
=I
1°(αøk)
I
m2
=I
2°((1−α)φk)
I
blend=(1−α)Im1+αIm2,
The invention provides an article of manufacture comprising a computer-usable medium having computer-readable program code embodied therein for composing a composite image from at least two smaller images, the computer-readable program code having instructions for performing the following steps: obtaining data of at least two image volumes of a patient, said image volumes having an overlap region; processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
The medical scanning device may be selected from the group consisting of MRI, CT, Ultrasound, Radiography, and PET imagers. The elastic registration algorithm may be based on the maximization of an intensity-based similarity metric between the two image volumes. The metric may be selected from the group consisting of Local Cross Correlation and Mutual Information. A deformation field may be determined by obtaining a smooth vector field that indicates for each pixel in one of the image volumes, its corresponding pixel location in a second image in the other image volume. The deformation and its inverse may be estimated iteratively by maximizing an intensity-based similarity matrix and are regularized using a low-pass filter. The instructions may include computing values of Im1 and Im2, according to the following equation:
I
m1
=I
1°(αøk)
I
m2
=I
2°((1−α)φk)
I
blend=(1−α)Im1αIm2,
The invention provides a system for composing an image from two smaller image volumes of data obtained using a medical scanning device, comprising: a scanner for obtaining image data for at least two image volumes of a patient, wherein the image volumes have an overlap region; a processor for: processing the data from the two image volumes to determine the overlap region and to register the two image volumes with each other using rigid registration; determining a non-rigid deformation between the two image volumes using an elastic registration algorithm; performing an alpha-morphing on each overlapping region of each image volume using the non-rigid deformation; and obtaining a blend region of the overlap region by performing an alpha-blending which blends the two image volumes by varying the relative contribution of the two image volumes using the results of alpha-morphing.
The medical scanning device may be selected from the group consisting of MRI, CT, Ultrasound, Radiography, and PET imagers. The elastic registration algorithm may be based on the maximization of an intensity-based similarity metric between the two image volumes. The metric may be selected from the group consisting of Local Cross Correlation and Mutual Information. The processor may determine a deformation field by obtaining a smooth vector field that indicates for each pixel in one of the image volumes, its corresponding pixel location in a second image in the other image volume. The deformation and its inverse may be estimated iteratively by maximizing an intensity-based similarity matrix and are regularized using a low-pass filter. The processor may perform an alpha-morphing by computing values of Im1 and Im2, according to the following equation:
I
m1
=I
1°(αøk)
I
m2
=I
2°((1−α)φk)
I
blend=(1−α)Im1+αIm2,
A method will be described using an example of two volume regions which overlap each other. As illustrated in
The next steps involve registration and deformation field determination. The base method used for determination of the deformation field is based on previous research [2] [3], and is as follows.
The correspondence between overlapping areas of an image pair is established via elastic registration. The algorithm estimates a deformation that maximizes the local cross-correlation between one of the images (arbitrarily defined as reference) and the second image. In our experiments, this criterion has proved quite robust to intensity changes, signal inhomogeneities, and noise. In addition, such intensity-based approach does not require the extraction of anatomical landmarks. The deformation is represented by a smooth vector field that gives for each pixel on the reference, its corresponding location on the second image. Due to the nature of the distortions expected at the boundary of the field of view, deformations are constrained along the read-out direction. The algorithm estimates simultaneously, the deformation and its inverse, by composition of small displacements, incrementally maximizing the similarity criterion. This process, which can be seen as the numerical implementation of a transport equation, provides a large capture range.
The smoothness of the deformation is imposed by applying a low-pass filter to the vector field increments. The process is implemented in a multi-scale approach, from coarse to fine resolution, which increases the speed and provides improved convergence.
The pseudo code which is used may have the following steps:
The method used for registration according to the invention varies from the prior known methods in at least two respects.
First, the method uses constraint deformation to better model B0 distortion which occurs mainly in the readout (horizontal direction). This has caused a substantial improvement in computation time, and quality of result.
Second, the method according to the invention simultaneously generates a compatible inverse deformation to assist in the alpha morphing stages.
In alpha morphing, the deformation field describes a one-to-one correspondence between voxels in the two overlap regions. However, in order to avoid seams in the blending area at the two interfaces (Volume 1<—>Blend Region, and Blend Region<—>Volume 2), the effects of blending should be gradual, because instantaneous changes will cause visible discontinuities at these interfaces:
I
m1
=I
1°(αøk)
I
m2
=I
2°((1−α)φk)
Alpha blending is a technique of combining two images (or volumes) by varying relative contributions over a blend region. This is used to finally combine the resultants from alpha morphing to create the final elastic blend region. Iblend is calculated using:
I
blend=(1−α)Im1+αIm2
The method according to the invention has been shown to result in significant improvement in the presence of many kinds of distortion and motion, not just B0-effects.
Two case examples were performed. The first example case is shown in
The invention also provides a system which practices the method, and a computer-readable storage medium having stored therein, computer executable instructions for practicing the method.
Although one preferred embodiment has been described, the invention is not limited to this embodiment, and the scope of the invention is defined by way of the following claims.
This application claims priority on provisional application Ser. No. 61/095,697 filed Sep. 10, 2008, which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61095697 | Sep 2008 | US |