This invention concerns a system for combining 3D (three dimensional) medical image data with vessel blood flow information and providing a composite single displayed image including a vessel structure provided by the 3D image data and derived blood flow related information.
In diagnosing and treating patients with vascular problems or deficiencies, it is often necessary to examine both the morphologic and functional characteristics of vasculature. Morphologic information includes the size, geometry, number and placement of the vessels in the anatomy. For vascular anatomy, functional information pertains mainly to the flow of blood including transit times, blood flow, and perfusion. In a conventional angiography laboratory, information on vascular morphology and function are typically acquired and reviewed separately. Vascular morphology is accurately appreciated with a 3D (three dimensional) image acquired by a rotational acquisition and reconstructed using computed tomography techniques. Images are acquired with a contrast agent injection to highlight the vessels of interest allowing for direct measurement as well as qualitative evaluation of the individual vessels and entire vasculature. Information about the function of the vasculature is acquired via acquisition and review of digital subtraction angiography (DSA) images derived by subtraction of a mask image containing background detail from a contrast agent enhanced image. If the vessels in question are embedded in soft tissue, ultrasound may also be used to quantify vascular function. A user mentally assimilates and interprets the morphological and functional information from these multiple sources and uses the information in combination to diagnose, plan treatment, or engage in therapeutic activities.
Vascular anatomy can be complex, especially in sick patients, with vessels overlapping, branching, and running in directions perpendicular to standard angiographic viewing orientations. In a DSA image there is no depth information and vessels in the anatomy being imaged appear and disappear as a contrast agent flows through them. However, the process of mentally combining the morphologic and functional information identified in the 3D and DSA (Digital Subtraction Angiography) images requires a physician to correlate multiple overlapped vessels depicted in DSA images with the vasculature presented in a 3D image. The effectiveness of this correlation is dependant on the physician's ability to read a pair of DSA images and infer spatial placement and orientation of the vessels in 3D space. A system according to invention principles addresses these requirements and associated deficiencies and problems.
A system generates a visually coded 3D image that depicts both vascular morphology and function by visually (e.g. color) coding functional information (e.g. transit time of blood flow through the anatomy) directly on a 3D morphologic image of the vasculature. The functional information is acquired by iteratively computing and scaling transit time curves for individual voxels and minimizing the difference between transit time curves of pixels in a 2D (two dimensional) image to the calculated transit time curves of corresponding projections through a 3D volume. A system combines 3D medical image data with vessel blood flow information. The system uses at least one repository for storing, 3D image data representing a 3D imaging volume including vessels, in the presence of a contrast agent and 2D image data representing a 2D X-ray image through the imaging volume in the presence of a contrast agent. An image data processor uses the 3D image data and the 2D image data in deriving blood flow related information for the vessels. A display processor provides data representing a composite single displayed image including a vessel structure provided by the 3D image data and the derived blood flow related information.
A system generates a visually (e.g., color) coded 3D image that depicts 3D vascular function information including transit time of blood flow through the anatomy. A transit time curve identifies blood flow by tracking the flow of contrast agent through a region of the anatomy (tissue or vessel). The transit time curve itself plots the x-ray luminance of a pixel or region of pixels in a DSA sequence over the length of the DSA sequence: the amount of contrast in the region of interest over time. Since the blood is carrying the contrast agent, it is possible to obtain a functional measure of the time required for blood to flow through the vessel by examining the time to peak value or time to leading edge of the transit time curves at different locations in the vessel. The functional information is provided using multiple subtracted angiography acquisitions of patient anatomy, while a 3D image of the vasculature provides the morphology of the vascular anatomy. The functional information for each 3D element, or voxel, is determined by iteratively computing and scaling transit time curves for individual voxels. Individual iterations attempt to minimize a difference between transit time curves of pixels in a 2D image and the calculated transit time curves of corresponding projections through a 3D volume encompassing the 2D image.
The system displays information concerning vascular function in a 3D image by advantageously combining functional and geometric information of the vessels concerned and displaying the information in a single format. The functional information is obtained from digital subtraction angiography images and is overlaid onto a 3D image of the same vasculature. The system automatically merges morphologic and functional information provided by 3D images and angiographic images of vasculature into a single 3D display, enabling a user to view the combined information in a single view and from a user selectable orientation. The automated system enables a user to focus on interpreting the information instead of having to combine it.
A system advantageously depicts DSA images in which blood flow transit time information is displayed with varying colors that identify the time at which blood flow has achieved a desired characteristic. The system computes a transit time curve for each individual pixel in an image or region of interest in an image. A transit time curve identifies luminance intensity of contrast agent detected at a particular pixel location in an image as a function of time and represents blood flow at that pixel in the image. The system is capable of generating a transit time curve for each voxel (a 3D pixel) in a 3D volume. To make use of this information the system generates a 3D image volume colored to depict vascular flow information using the transit time curves computed for each voxel. The voxel transit time curves are computed using the spatial and temporal information provided by multiple DSA image sequences (at least 2) acquired at different imaging orientations.
One or more imaging devices 25 acquire image data representing a 3D imaging volume of interest of patient anatomy in the presence of a contrast agent and acquire multiple DSA sequential images (which may or may not be synchronized with ECG and respiratory signals) of a vessel structure in the presence of a contrast agent in the 3D volume interest. At least one repository 17 stores 3D image data representing a 3D imaging volume including vessels in the presence of a contrast agent. At least one repository 17 stores 2D image data representing 2D DSA X-ray images through the imaging volume in the presence of a contrast agent. Image data processor 15 uses the 3D image data and the 2D image data in deriving blood flow related information for the vessels. Display processor 19 provides data representing a composite single displayed image including a vessel structure provided by the 3D image data and the derived blood flow related information.
In order to localize the content of two-dimensional (2D) images within a 3D imaging volume acquired by imaging systems 25, at least two separate imaging plane orientations of the same object are used. System 10 generates a 3D image of vasculature with color coded functional information using at least two DSA images acquired by imaging systems 25. As in known 3D image reconstruction methods, the quality of image reconstruction is improved by acquiring additional images at different imaging orientations. System 10 may employ different combinations of multiple monoplane and/or biplane DSA image acquisitions as long as the contrast agent bolus geometry is the same and the DSA image sequences are synchronized to introduction of the contrast agent bolus into patient anatomy. Image data processor 15 adjusts and registers (aligns) a 3D image with 2D DSA images and generates a flow enhanced vascular 3D image. In another embodiment, the process of registering 2D and 3D images may be optional but the process adds flexibility to compensate for movement of the patient or patient support table between image acquisitions. If multiple DSA image acquisitions are used for image reconstruction, individual separately acquired DSA image acquisitions are registered with acquired 3D image volume data and registration adjustments are factored into projection calculations. Image data processor 15 uses 3D image data representing a 3D imaging volume including vessels in determining a transit time curve for an individual volume image element (e.g., a pixel) in a blood vessel. An individual transit time curve identifies imaging luminance content representative values of an individual image element (e.g., a pixel) over a time period. In response to image data processor 15 generating a flow enhanced vascular 3D image using transit time data, the transit time data used in deriving the flow enhanced vascular 3D image utilized is stored as a normal 3D raster image and color map, a 3D polygonal model, or in a proprietary format including the geometry and transit time curve information.
Image data processor 15 computes an initial transit time curve for individual voxels of a 3D imaging volume. This may involve Gaussian modeling of a transit time curve fitting a single Gaussian function to a pixel transit time curve as described later in connection with
Processor 15 manages and expedites these computations by generating a list of voxels comprising part of a vessel in 3D imaging volume 650 and stores data identifying voxel position for each voxel with an intensity value greater than a threshold (indicating the presence of a blood filled vessel). Processor 15 discards or unloads the imaging volume data to free up memory and generates a set of data elements (or pointers to data elements) for the pixels of each 2D DSA image taken through the volume. Processor 15 further: computes initial transit time curves for individual voxels in the list, identifies the per pixel scaling functions for individual pixels, and adjusts the transit time curves for individual voxels in the list. Processor 15 iteratively computes per pixel scaling functions and adjustment of the voxel transit time curves, until a completion criteria is reached. Processor 15 generates new color coded volume data using the transit time curve information to assign colors to the voxels identified in the list.
Processor 15 (
In one embodiment, processor 15 applies a mask to a transit time curve of a voxel to highlight a region of interest of the transit time curve and reduce influence of the remainder of the curve on further scaling and transit time curve calculations. Processor 15 adds a transit time curve luminance intensity value of a voxel to a sum function value of each pixel involved in the computation of the voxel transit time curve along the projection line. Processor 15 further computes scaling functions for pixels used in this process by dividing a transit time curve by a projection sum function and maintains an overall average scaling function for the pixels processed. The overall average scaling function is the average of the scaling functions for the pixels utilized in the process and is used as an overall indication of the progress of the iterative optimization and is also used to determine when no further iterations are required. Processor 15 re-initializes the projection sum function for each pixel after computing a scaling function and adjusts the transit time curves for each pixel.
For individual images processor 15 generates an average scaling function that is the average of the scaling functions for the pixels projecting to a selected voxel 671 or 673. This may be a direct average or a center weighted average of the scaling functions for the pixels projecting to a selected voxel 671 and 673. Processor 15 computes a voxel scaling function from the average scaling functions. Specifically, the average scaling functions are compared and the highest scaling value is used at each discrete time step. Processor 15 scales the voxel transit time curve by multiplying the voxel transit time curve by the voxel's scaling curve. The steps of generating and applying the scaling function may be iteratively repeated until the overall average scaling function is determined to be acceptable (e.g. to achieve a higher scaling function), or a predetermined number of iterations is reached. The optimum overall averaged scaling function is a horizontal line of value 1.0, indicating that no further scaling is required.
Processor 15 also tracks iteration completion criteria. The iteration completion criteria are a globalized measure of the voxel scaling functions (average, median, mode, maximum). In the case of an optimal embodiment, an acceptable termination criteria may be that the average (or minimum) value of the voxel scaling functions is greater than 0.90, for example. The iteration completion criteria can also have alternate exit criteria (e.g. a maximum number of iterations or time spent iterating).
Processor 15 further stores 3D enhanced vasculature data in a 3D imaging memory and discards or unloads pixel data to free up memory. Processor 15 analyzes transit time curves of voxels (pixels) in the list of voxels to identify the transit time values for voxels comprising a vessel and assigns a zero value to other voxels. Processor 15 analyzes transit time curves to identify characteristics including the time at which blood flow achieves a desired characteristic such as, first detected flow of contrast agent, peak contrast agent enhancement, or maximum gradient (change in rate of blood flow). Display processor 29 displays blood flow transit time characteristics with varying colors (or other visual attributes) on display 19. Other embodiments are used to improve performance or to reduce memory requirements. Specifically, in one embodiment if pixels on projection line 660 produce a summed transit time curve that equals (or is substantially close to) the transit time curve of pixel 675 acquired by X-ray imaging detector 657, the voxels along the projection line 665 are marked as completed and excluded in future iterative processing.
In another embodiment, a 2D color coded image of the vasculature is used to assign colors to a 3D image. The transit time curve for a pixel represents a summation of contrast agent flow through patient anatomy between the pixel and the X-ray source, which means that a transit time curve is not for one vessel but all vessels represented by the pixel. The occurrence of vessel overlap means that processor 15 employs additional logic in selecting a vessel to assign a color in a 2D image, e.g., by differentiating vessels in images in other orientations. Also the voxels for vessels that are not assigned a color need to be assigned a color, which involves identifying the path of the vessel containing the uncolored voxel and assigning color values interpolated from adjacently colored sections of the vessel. The system may combine morphologic and functional information or images into a single image or display for different applications such as combining 3D images and DSA images. The system advantageously displays blood flow information acquired from a DSA acquisition together with vascular morphology obtained by a 3D image acquisition as a single composite combined image.
The functional information for individual 3D image elements (e.g., pixels) is determined by processor 15 by assigning approximated transit time curves of a fundamental shape to each pixel and by making iterative adjustments to these approximated curves. Processor 15 iteratively minimizes a difference between the transit time curves of the pixels in an image acquired by X-ray imaging detector 653 and corresponding calculated (approximated) voxel transit time curves derived along corresponding projection lines (e.g., line 660) to the corresponding pixel 675. A contrast bolus introduced into a vessel is expected to flow through the vessel with a concentration that increases, reaches a maximum value, and decreases over time. In one embodiment, processor 15 models a transit time curve of a voxel as a Gaussian distribution. Other distributions may be employed in alternative embodiments. The presence of an aneurysm or collateral flow may disrupt blood flow dynamics causing the blood to mix, swirl, or flow unevenly, producing an asymmetric curve with multiple peaks. A Gaussian approximation may prove sufficient to model blood flow in the presence of disruptions if it adequately models the portion of the transit time curve of interest (e.g., a location of peak contrast enhancement).
As illustrated in
In one embodiment processor 15 (
Processor 15 further generates 3D imaging volume transit time image data comprising enhanced vasculature data by evaluating the generated transit time curves in the list of voxels to identify transit time values for voxels containing a vessel, and assigning a zero value to other voxels. Transit time curves are evaluated to indicate first detected contrast agent, peak contrast agent enhancement, or maximum contrast agent increase.
Processor 15 registers (aligns) the 3D volume imaging data with the generated 2D DSA images and confirms registration is accomplished. In an another embodiment registration is an optional step. If multiple acquired 2D DSA images are used in 3D imaging volume reconstruction, individual acquired 2D DSA images are registered to the 3D imaging volume and adjustments are factored into projection line associated calculations. In response to processor 15 generating 3D volume transit time image data, it is stored as a normal 3D raster image and color map, a 3D polygonal model, or in a proprietary format including geometry and transit time curve information. Processor 15 models a transit time curve of individual voxels using a Gaussian curve, though other different fundamental curve types may also be used. The Gaussian curves are iteratively adjusted to minimize difference between a transit time curve for pixel 675 and the summation of the Gaussian transit time curves for voxels along the pixel projection 665 (
System 10 employs a clinical workflow in combining 3D medical image data with vessel blood flow information in which a user acquires and reconstructs a 3D image of vascular anatomy of interest. The user acquires a biplane X-ray DSA image of the vascular anatomy and generates a color coded 2D image indicating blood flow characteristics for the acquired biplane DSA image. The user adjusts the color coded image parameters to highlight blood flow characteristics of interest including start time, duration, and type of enhancement (e.g. time to first contrast agent detection or time to peak vessel contrast enhancement). System 10 generates data representing a color coded 3D functional image using the parameters selected for the color coded 2D image and displays the colored 3D image on display 19. The user is able to examine and interact with the 3D functional image by adjusting viewing orientation, start time and duration. In response to a user selecting a position on a vessel in a 3D image presented on display 19, image data processor 15 initiates display of luminance intensity and transit time value for the selected position.
In step 920 processor 15 computes scaling functions for each pixel using the pixel projected transit time curve and transit time curve. The projected transit time curve is the sum of the transit time curve for the voxels in the 3D image that are crossed by the line connecting the pixel on the X-ray detector and the X-ray source. Specifically, processor 15 computes the pixel's projected transit time curve and uses it to create a scaling function for each pixel in addition to the pixel's transit time curve. In step 923 pixel scaling functions are used to derive and apply voxel scaling functions to the transit time curves of the voxels comprising the vessels. In step 927 processor 15 evaluates information collected concerning scaling functions calculated to determine if completion criteria has been reached. If the completion criteria have not been met, processor 15 repeats steps 920 and 923 until the completion criteria is satisfied. In step 929, display processor 29 provides data representing a composite single displayed image comprising a vessel structure including blood flow related information derived using the compensated transit time curves and the 3D image data. In one embodiment, the volume image element is a voxel and the derived blood flow related information is derived using the compensated luminance content representative distribution and the 3D image data. The process of
Image data processor 15 uses the 3D image data and the 2D image data in deriving blood flow related information for the vessels by determining and comparing luminance content representative values of an individual volume image element in the vessels in the imaging volume over a time period, in the presence of a contrast agent. Specifically, processor 15 processes the second luminance content representative distribution (second transit time curve) to compensate for difference between the first and second distributions (transit time curves) to provide a compensated distribution (transit time curve). In one embodiment, the luminance content representative distributions are represented by at least one approximating function comprising a Gaussian distribution representing a luminance content representative distribution with a mean value, standard deviation value and amplitude value. Further, image data processor 15 provides multiple compensated transit time curves for corresponding multiple individual image elements comprising the vessels using 2D image data representing multiple X-ray images through the 3D imaging volume. The multiple individual image elements comprising the vessels are pixels and the multiple X-ray images through the 3D imaging volume comprise two or more images having planes intersecting with an angle of separation derived by a biplane X-ray imaging system, for example.
In step 958 processor 15 compensates for difference between the first and second transit time curves by, in step 960 comparing first and second transit time curves of the individual volume image element, in step 963 deriving a scaling function for the individual volume image element in response to the comparison and in step 967 scaling the second transit time curve using the scaling function to provide a compensated transit time curve. In step 969, display processor 29 provides data representing a composite single displayed image comprising a vessel structure including blood flow related information derived using the compensated transit time curves and the 3D image data. In one embodiment, the volume image element is a voxel and the derived blood flow related information is derived using the compensated luminance content representative distribution and the 3D image data The process of
A pixel comprises one or more image elements in a 2D image and a voxel comprises one or more image elements in a 3D imaging volume. The terms pixel and voxel are used interchangeably herein as 2D images are encompassed within a 3D imaging volume and hence a pixel is typically the same as a voxel. A processor as used herein is a device for executing machine-readable instructions stored on a computer readable medium, for performing tasks and may comprise any one or combination of, hardware and firmware. A processor may also comprise memory storing machine-readable instructions executable for performing tasks. A processor acts upon information by manipulating, analyzing, modifying, converting or transmitting information for use by an executable procedure or an information device, and/or by routing the information to an output device. A processor may use or comprise the capabilities of a controller or microprocessor, for example, and is conditioned using executable instructions to perform special purpose functions not performed by a general purpose computer. A processor may be coupled (electrically and/or as comprising executable components) with any other processor enabling interaction and/or communication there-between. A user interface processor or generator is a known element comprising electronic circuitry or software or a combination of both for generating display images or portions thereof. A user interface comprises one or more display images enabling user interaction with a processor or other device.
An executable application, as used herein, comprises code or machine readable instructions for conditioning the processor to implement predetermined functions, such as those of an operating system, a context data acquisition system or other information processing system, for example, in response to user command or input. An executable procedure is a segment of code or machine readable instruction, sub-routine, or other distinct section of code or portion of an executable application for performing one or more particular processes. These processes may include receiving input data and/or parameters, performing operations on received input data and/or performing functions in response to received input parameters, and providing resulting output data and/or parameters. A graphical user interface (GUI), as used herein, comprises one or more display images, generated by a display processor and enabling user interaction with a processor or other device and associated data acquisition and processing functions.
The UI also includes an executable procedure or executable application. The executable procedure or executable application conditions the display processor to generate signals representing the UI display images. These signals are supplied to a display device which displays the image for viewing by the user. The executable procedure or executable application further receives signals from user input devices, such as a keyboard, mouse, light pen, touch screen or any other means allowing a user to provide data to a processor. The processor, under control of an executable procedure or executable application, manipulates the UI display images in response to signals received from the input devices. In this way, the user interacts with the display image using the input devices, enabling user interaction with the processor or other device. The functions and process steps (e.g., of
The system and processes of
This is a non-provisional application of provisional application Ser. No. 61/093,002 filed Aug. 29, 2008 and of provisional application Ser. No. 61/092,997 filed Aug. 29, 2008, by J. Baumgart et al.
Number | Date | Country | |
---|---|---|---|
61093002 | Aug 2008 | US | |
61092997 | Aug 2008 | US |