Patent Application
20080144901
This invention relates generally to computer-aided detection systems for analyzing medical images, and more particularly to methods and apparatus for emphasizing abnormalities in such systems.
At least one known computer-aided detection (CAD) system can analyze medical images to find abnormalities and report these findings to an attending radiologist. This report sometimes includes highlighting of images to draw the attention of the radiologist to areas that CAD software analysis indicated may be interesting. One example of such a system is found in U.S. Pat. Pub. No. 20020097902A1, Ser. No. 990,508, filed Nov. 21, 2001 by Roehrig, et al., and published Jul. 25, 2002, entitled “Method and system for the display of regions of interest in medical images.”
In virtual colonoscopy, reports can include coloring not only the image data itself, but also generating a 3-D surface from the image data. Three dimensional surface rendering is well-suited for applications such as magnetic resonance imaging (MRI), where segmentation of key structures is a necessary or desirable step for good visualization. A polygonal mesh can be wrapped around segmented structures to form a surface model. Surfaces can also be viewed using volume rendering, but volume rendering is only practicable for applications (e.g., computed tomographic [CT] data), for which assignment of color and opacity values is straightforward given the image voxel intensities. The assignment of color and opacity values is straightforward for CT data because there is a strong correlation between CT Hounsfield units and tissue types.
In shape analysis, surfaces of segmented anatomical structures can be colored in accordance with a deviation from a normal population.
There are many patents in the field of virtual endoscopy (U.S. Pat. No. 5,611,025, U.S. Pat. No. 5,782,762, U.S. Pat. No. 6,343,936), especially for generating dynamic views of static data. However, none of these references teach or suggest virtual endoscopy with dynamic data. Although U.S. Pat. No. 6,892,090 describes dynamic data coming from a tracking system, there is no teaching or suggestion of dynamic data coming from a surface of an organ.
In one aspect, some configurations of the present invention provide a method for displaying a medical image using a computer controlling a display. The method includes animating a stored medical image by smoothly altering properties of the stored medical image between at least a first image and a second image, not necessarily in that order, wherein the second image exaggerates an abnormal physiological characteristic represented in the stored medical image, and displaying the animated image.
In another aspect, some configurations of the present invention provide an apparatus for displaying medical images. The apparatus includes a computer and a controlled display. The computer is configured to animate a stored medical image by smoothly altering properties of the stored medical image between at least a first image and a second image, not necessarily in that order, wherein the second image exaggerates an abnormal physiological characteristic represented in the stored medical image, and to display the animated image on the controlled display.
It will be appreciated that some configurations of the present invention provides animated images in which subtle features become more apparent, in at least two ways. First, exaggeration makes features more pronounced. Misdiagnosis from simple exaggeration is prevented in various configurations of the present invention by using dynamic “cine” between realistic and exaggerated images. Second, morphing back and forth between realistic and exaggerated images exploits the strength of the human visual system for noticing changes. The viewer's attention is thereby drawn to important areas.
The foregoing summary, as well as the following detailed description of certain embodiments of the present invention, will be better understood when read in conjunction with the appended drawings. To the extent that the figures illustrate diagrams of the functional blocks of various embodiments, the functional blocks are not necessarily indicative of the division between hardware circuitry. Thus, for example, one or more of the functional blocks (e.g., processors or memories) may be implemented in a single piece of hardware (e.g., a general purpose signal processor or a block or random access memory, hard disk, or the like). Similarly, the programs may be stand alone programs, may be incorporated as subroutines in an operating system, may be functions in an installed software package, and the like. It should be understood that the various embodiments are not limited to the arrangements and instrumentality shown in the drawings.
As used herein, an element or step recited in the singular and proceeded with the word “a” or “an” should be understood as not excluding plural said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to “one embodiment” of the present invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Moreover, unless explicitly stated to the contrary, embodiments “comprising” or “having” an element or a plurality of elements having a particular property may include additional such elements not having that property.
Instead of rendering scenes of medical imagery with a static realism, some configurations of the present invention render the scenes dynamically such that the view oscillates between a realistic view and an exaggerated view. The effect is similar to that of cartoon animation in which objects are routinely stretched into unrealistic deformations, but only momentarily before reverting back to their original form. In some configurations, images are viewed using a 2-D display, and in another exemplary configuration described herein, image surfaces are viewed as 3-D renderings. In either case, the exaggerated view can include false or exaggerated colors and/or geometric deformations. In addition, the medical images can be either static images or cine images. Thus, distortions to aid recognition of abnormalities, such as color changes and/or geometric deformations, can be applied in some configurations even as the medical image changes for some other reason, such as the movement of a catheter through a lumen or the colon, or 3-D navigation through a set of images, such as live or stored computed tomographic (CT) images.
At least one known 2-D viewing system for medical images provides a window/level interface that allows a user to alter a transfer function that relates image pixel values with colors from a palette. However, many configurations of the present invention animate an image to be rendered with a transfer function that varies over time, alternating between, for example, a linear and an exponentially non-linear form. The effect produced by such embodiments exploits the skill of the human visual system for distinguishing change. Miniscule bright spots, such as small masses on mammography radiographs, are momentarily accentuated and de-accentuated by a dynamic display, resulting in a pulsating action that can lead to better lesion detection. See, for example,
For example, cartoon-like dynamics are applied to a coloring process, as described above, or to surface geometry, or both. For example, and referring to
In some further configurations, the coloring scheme dynamically alternates between a realistic coloring and a curvature-based coloring. Like a cartoon, the full cycle of blending from real to augmented, and back to real, can be made in one or two seconds. A similar pulsation could be used with deviation-based coloring, as in
In some configurations of the present invention and referring to
Morphing need not be limited to oscillating between realistic and exaggerated in configurations of the present invention. For example, morphing could vary from normal (as measured from a control population), to patient-specific, and then to exaggerated. Some configurations of the present invention avoid exaggeration altogether by varying between patient-specific and a control group. Configurations that vary between patient-specific and a control group can be used for comparing surface data for a specific patient with a healthy surface, or for comparing the patient's surface with one of various surfaces that are characteristic of various diseases. Although warping one anatomical surface into another is known, the use of a “cine” display as described here between a patient and a population is believed to be novel, as is the technique of highlighting deviations with coloring.
Computing a morphing that exaggerates deviations from a population is a bit more complicated than the case described earlier of morphing to exaggerate local curvature. However, there are several known algorithms for morphing between two different surfaces. By applying one of the known algorithms to move from one surface to the next, exaggeration can be achieved by extrapolating the final motions further along their trends. This technique can be applied to any two surfaces without having an understanding of the relationships between them. However, when some analysis has been performed, a more plausible morphing can be computed. Techniques for shape analysis sometimes involve performing principle component analysis (PCA) to find a population's modes of variation. In some configurations of the present invention, PCA is used to express a given surface as a linear combination of principle component surfaces, or “eigensurfaces”. In this representation, the deviation of a surface from a mean surface can be understood from the strength (weighing coefficient) assigned along each mode of variation. Then, an exaggerated surface can be computed by scaling these coefficients further.
The cartoon-like display renders views that dynamically flow, or morph, between two alternatives, such as, for example, the following pairs: (1) a 2-D image colored using linear transfer function to a 2-image colored using a non-linear transfer function; (2) a 3-D surface colored using a linear transfer function into a 3-D surface using a non-linear transfer function; (3) a 3-D surface with realistic geometry into a 3-D surface with exaggerated geometry; or (4) a 3-D surface from a specific patient to a 3-D surface of a population (normal or pathology).
Thus, and referring to
In some configurations of the present invention, the stored medical image is a 3-D medical image. In some configurations of the methods applied to 3-D images, the method may include using a transfer function 501 to 505 that varies over time to assign function values to pixel values of the stored medical image to animate the stored medical image. The method may also include using the time-varying transfer function to map colors to pixel values, and also displaying a window/level interface that allows a user to alter the time-varying transfer function, allowing the user to alter the time-varying transfer function, and using the altered time-varying transfer function to assign colors to the pixel values of the animated medical image.
In some configurations of methods applied to 3-D images and referring to
In some configurations of the present invention, the method is applied to deviations from a known population.
In various configurations of the present invention and referring to
In some configurations of the present invention, the stored medical image is a cine image, and the animation comprises smoothly altering properties of the stored cine medical image between at least a first cine image and a second cine image, not necessarily in that order, wherein the second cine image exaggerates an abnormal physiological characteristic represented in the stored cine medical image, and displaying the animated cine image.
Again referring to
In some configurations of the apparatus and referring to
In some configurations of the present invention, the apparatus is configured to smoothly alter properties of stored medical image 1 back and forth to include a normal image 101, a patient-specific image 113, and an exaggerated image 120.
The diagnostic advantage of configurations of the present invention is that subtle features become more apparent, in at least two ways. First, the exaggeration makes features more pronounced. Misdiagnosis from simple exaggeration is prevented in various configurations of the present invention by using dynamic “cine” between realistic and exaggerated images. Second, morphing back and forth between realistic and exaggerated images exploits the strength of the human visual system for noticing changes. The viewer's attention is thereby drawn to important areas.
While the invention has been described in terms of various specific embodiments, those skilled in the art will recognize that the invention can be practiced with modification within the spirit and scope of the claims.
