The invention relates generally to the field of volume imaging and more particularly to a method for providing a motion image sequence of a 3-D volume image for diagnostic or other purposes.
3-D volume imaging has proved to be a valuable diagnostic tool that offers significant advantages over earlier 2-D radiographic imaging techniques for evaluating the condition of internal structures and organs. 3-D imaging of a patient or other subject has been made possible by a number of advancements, including the development of high-speed imaging detectors, such as digital radiography (DR) detectors that enable multiple images to be taken in rapid succession.
Cone beam computed tomography (CBCT) or cone beam CT technology offers considerable promise as one type of diagnostic tool for providing 3-D volume images. Cone beam CT systems capture volumetric data sets by using a high frame rate flat panel digital radiography (DR) detector and an x-ray source affixed to a gantry that rotates about the object to be imaged. The CBCT system captures projections throughout the rotation, for example, one 2-D projection image at every degree of rotation. The projections are then reconstructed into a 3D volume image using various techniques. Among the most common methods for reconstructing the 3-D volume image are filtered back projection approaches.
One limitation of CBCT and other volume imaging technologies is that, for most applications, these technologies provide only still images, that is, images with the patient or other subject held in a stationary position. For some medical applications, such as for diagnosing the condition of joints such as knees, shoulders, and ankles, for example, there would be significant clinical value in the capability to reconstruct the 3-D volume image in motion. Such an image would be used, for example, by an orthopaedic physician for diagnostic functions such as preoperative planning or for assessing healing and recovery after surgery. Other applications that would benefit from the capability to obtain 3-D volume images in motion include dental and veterinary imaging and non-destructive testing (NDT), for example. Currently there are no practical methods available for producing a radiographic motion sequence in three dimensions. Conventional methods such as continuously obtaining volume images of a moving subject not only require significant expenditure of equipment time and of computing and image processing resources, but these methods can cause movement to be artificially constrained, such as slowed to a very low speed. Furthermore, for medical diagnostic imaging, the cumulative radiation exposure levels needed to provide enough images for a 3-D motion image sequence can be unacceptable with such a continuous volume imaging approach.
Thus, while there is considerable value in conventional volume imaging using DR capabilities, there is a need for the enhanced capability to provide a time-sequenced fourth dimension that allows the diagnostician to view volume images of the patient in motion.
It is an object of the present invention to advance the art of diagnostic volume imaging by providing a motion sequence that includes a number of 3-D volume images, but without the requirement to obtain all of the 3-D volume images in the sequence using the full 3-D exposure and image processing procedure.
These objects are given only by way of illustrative example, and such objects may be exemplary of one or more embodiments of the invention. Other desirable objectives and advantages inherently achieved by the disclosed invention may occur or become apparent to those skilled in the art.
It is an advantage of the present invention that it provides a motion sequence that shows movement of a subject in 3-D, without requiring new hardware in addition to that already provided in existing volume imaging apparatus. Thus, the 3-D motion sequence is obtained using image processing software rather than using more costly imaging equipment.
According to one aspect of the present invention there is provided a method for obtaining a 3-D image, the method executed at least in part on a computer system and comprising: obtaining an initial volume image of a subject with the subject stationary and in a first pose; obtaining one or more 2-D images of the subject, as the subject is moving between the first pose and a second pose; obtaining an endpoint volume image of the subject with the subject stationary and in the second pose; modifying at least the initial volume image according to the one or more obtained 2-D images to form at least one intermediate volume image that is representative of the subject position between the first and second pose; and displaying the at least one intermediate volume image.
The foregoing and other objects, features, and advantages of the invention will be apparent from the following more particular description of the embodiments of the invention, as illustrated in the accompanying drawings. The elements of the drawings are not necessarily to scale relative to each other.
The following is a detailed description of the preferred embodiments of the invention, reference being made to the drawings in which the same reference numerals identify the same elements of structure in each of the several figures.
In the context of the present disclosure, the phrase “timed-sequence 4-D presentation” is functionally equivalent to the phrase “3-D motion image”. The three dimensions relate to the conventional orthogonal vectors used to define a volume 3-D image, typically expressed and represented along three orthogonal x, y, and z axes. The fourth dimension is time.
The apparatus and method of the present invention are described with reference to a CBCT imaging system and sequence. Advantageously, the method of the present invention can be carried out using existing CBCT imaging equipment, with some needed modifications to the conventional imaging sequence used for CBCT imaging. However, it must be emphasized that the methods and procedures described herein could be used in a similar way with other types of imaging systems that generate 3-D volume images. The method of the present invention combines 3-D volume image data obtained from an imaging system with 2-D image data obtained from the same system or obtained from alternate imaging systems and equipment. The 2-D image data provides time- and motion-related information that is used to modify the 3-D volume image data in order to provide a 3-D motion image. The resultant 3-D motion image is alternately termed a “4-D” image, wherein the fourth dimension relates to time.
CBCT imaging apparatus and the imaging algorithms used to obtain 3-D volume images using such systems are well known in the diagnostic imaging art and are, therefore, not described in detail in the present application. Some exemplary algorithms for forming 3-D volume images from the source 2-D images that are obtained in operation of the CBCT imaging apparatus can be found, for example, in U.S. Pat. No. 5,999,587 entitled “Method of and System for Cone-Beam Tomography Reconstruction” to Ning et al. and in U.S. Pat. No. 5,270,926 entitled “Method and Apparatus for Reconstructing a Three-Dimensional Computerized Tomography (CT) Image of an Object from Incomplete Cone Beam Data” to Tam. In typical applications, a computer or other type of dedicated logic processor for obtaining, processing, and storing image data is part of the CBCT system, along with one or more displays for viewing image results.
Advantageously, the method of the present invention does not require development of particular or CBCT systems or other imaging apparatus that are dedicated to the 4-D imaging function, but can be used with existing imaging systems of various types. The method of the present invention employs an enhanced imaging sequence in order to obtain the 3-D motion image, as described in more detail subsequently.
Referring to the schematic diagram of
As noted previously in the background section, the 3-D volume image that is conventionally obtained by the CBCT imaging apparatus is a still image. Subject 20 is in a fixed pose, constrained from any movement that would hinder the task of reconstructing the volume image from the numerous individual 2-D projection images.
The method of the present invention enhances the capability of the CBCT system to capture additional 2-D images that can then be used to reconstruct a 3-D motion image, thereby forming a 4-D image. Referring to the schematic diagram of
In the sequence of
The schematic diagram of
Following the sequence of
Once the intermediate volume images 36 are formed, image manipulation techniques can be used on the resulting 3-D volume data, such as digitally reconstructed radiography (DRR) that enables a 2-D image to be extracted from the reconstructed volume image. DRR methods and techniques for 2-D image extraction are familiar to those skilled in the volume imaging arts.
Advantageously, ordered sequence of 3-D images 54 consisting of initial volume image 30, the N+1 intermediate volume images 36 in order, and endpoint volume image 40, or a subset of these volume images, can be stored and played back and replayed at an appropriate speed, paused, and played in reverse. Initial and endpoint volume images 30 and 40 as well as the individual intermediate volume images 36 can be individually viewed at suitable angles and used for diagnostic purposes. Using the example of a knee as object 20, animated playback of the ordered sequence of 3-D images obtained as shown in
Referring back to
Given the data gathered using the sequence of steps in
It is to be noted that the logic flow shown in
It can be appreciated that the example arrangements of
As has been noted, CBCT imaging is only one type of image modality for which the 3-D motion sequence can be used. The 3-D volume data that is obtained for initial and endpoint images 30 and 40, as well as for any additional volume images 35, can alternately be obtained on some other type of volume imaging system, including an apparatus that uses Magnetic Resonance Imaging (MRI), ultrasound volume imaging, Positron Emission Tomography (PET), Magnetic Particle Imaging (MPI), Single Photon Emission Computed Tomography (SPECT), or some other volume imaging technique. With respect to
Similarly, a number of 2-D imaging modalities can be utilized in addition to the use of a digital radiography (DR) detector as with the CBCT system of
Various spatial reference points may also help in the task of volume image reconstruction from 2-D images 32.
Another helpful accessory for obtaining a 3-D motion sequence is a device for providing guidance so that movement is performed along a preferred path.
Perturbation of the 3-D volume images based on data obtained from 2-D projection images is an interpolation problem that can be addressed using various techniques known to those skilled in the 3-D image reconstruction art. As the sequence of
Various techniques can be used for correlating the 2-D image data to the 3-D image volume for performing the needed interpolation. For example, maximized mutual information is one approach used for relating a coordinate system of an image to a reference image, iteratively deforming the image until mutual information between it and the reference image is maximized. The use of mutual information for image registration is described, for example, in commonly assigned U.S. Pat. No. 7,263,243 entitled “METHOD OF IMAGE REGISTRATION USING MUTUAL INFORMATION” to Chen et al.
3-D image morphing utilities and techniques, familiar to those skilled in image metamorphosis, can be adapted to the problem of generating intermediate volume images 36 as a type of 3-D image morphing process. Among examples of tools and approaches for volume image morphing and warping are those described by researchers Apostolos Lerios, Chase D. Garfinkle, and Marc Levoy in “Feature-Based Volume Metamorphosis”, presented in the Proceedings of the 22nd annual Conference on Computer Graphics and Interactive Techniques (1995), pp 449-456. An example of techniques and approaches for volume morphing and deformation of a 3-D object when tracking the object in a sequence of images is given in U.S. Pat. No. 7,006,683 entitled “MODELING SHAPE, MOTION, AND FLEXION OF NON-RIGID 3D OBJECTS IN A SEQUENCE OF IMAGES” to Brand.
A considerable amount of data storage space can be required for storing the ordered sequence of 3-D images that have been obtained as described herein. Various image modeling techniques can be used to reduce the overall amount of data that would need to be stored in order to provide each of the N+3 volume images that are generated.
In the following description, a preferred embodiment of the present invention will be described as a software program. Those skilled in the art will recognize that the equivalent of such software may also be constructed in hardware. Because image manipulation algorithms and systems are well known, the present description will be directed in particular to algorithms and systems forming part of, or cooperating more directly with, the method in accordance with the present invention. Other aspects of such algorithms and systems, and hardware and/or software for producing and otherwise processing the image signals involved therewith, not specifically shown or described herein may be selected from such systems, algorithms, components and elements known in the art.
A computer program product may include one or more storage medium, for example; magnetic storage media such as magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such as optical disk, optical tape, or machine readable bar code; solid-state electronic storage devices such as random access memory (RAM), or read-only memory (ROM); or any other physical device or media employed to store a computer program having instructions for controlling one or more computers to practice the method according to the present invention.
The methods described above may be described with reference to a flowchart. Describing the methods by reference to a flowchart enables one skilled in the art to develop such programs, firmware, or hardware, including such instructions to carry out the methods on suitable computers, executing the instructions from computer-readable media. Similarly, the methods performed by the service computer programs, firmware, or hardware are also composed of computer-executable instructions.
The invention has been described in detail with particular reference to a presently preferred embodiment, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. The presently disclosed embodiments are therefore considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the appended claims, and all changes that come within the meaning and range of equivalents thereof are intended to be embraced therein.
Reference is made to and priority claimed from U.S. Ser. No. 61/296,898, provisionally filed on Jan. 21, 2010 and entitled: VIRTUAL FOUR DIMENSIONAL CONE BEAM COMPUTED TOMOGRAPHY SYSTEM, in the name of David H. Foos et al. Reference is made to and priority claimed U.S. Ser. No. 61/307,057, provisionally filed on Feb. 23, 2010 and entitled: FOUR-DIMENSIONAL VOLUME IMAGING SYSTEM, in the name of David H. Foos et al. Reference is made to and priority claimed U.S. Ser. No. 61/412,853, provisionally filed on Nov. 12, 2010 and entitled: FOUR-DIMENSIONAL VOLUME IMAGING SYSTEM, in the name of David H. Foos et al.
Number | Date | Country | |
---|---|---|---|
61296898 | Jan 2010 | US | |
61307057 | Feb 2010 | US | |
61412853 | Nov 2010 | US |