Patent Grant
8548566
The present invention finds particular application to medical imaging, and more particularly to the rendering of anatomical structures such as the colon. It also finds application in other imaging applications in which it is desirable to highlight regions of interest on a rendered image.
Virtual endoscopy has been used as an aid to visualizing the interior of a lumen such as the human colon or trachea. In imaging of the colon, for example, it is desirable to identify suspicious masses such as polyps which may be indicative of early stage cancers. Using data obtained from computed tomography (CT) scan or other scan of the colon, one or more three dimensional rendered views of the interior of the colon have been presented, typically from a number of viewpoints as the user navigates through the colon lumen. A clinician uses the rendered images to identify polyps or other suspicious masses.
Residual stool, liquids, or other materials remaining in the colon can sometimes be difficult to distinguish from colonic tissue. In CT imaging, for example, the residual materials can have radiation attenuation values similar to those of surrounding tissues. As a result, these residual materials can sometimes mimic or obscure polyps.
To address this issue, various bowel preparation techniques have been implemented. In the case of CT imaging, these techniques have typically included the administration of an oral contrast media containing a radio-opaque substance such as barium. The intention is that material remaining in the colon will be highlighted by the contrast material.
One type of bowel preparation is the so-call wet preparation, in which large amounts of residual fluids often remain. Another type of bowel preparation are so-called dry preparations, in which the residual material is dominated by opacified stool, often concentrated in balls or clumps near the colon wall.
In a wet preparation, the tagged fluid and stool can obscure polyps and other lesions. In a dry preparation, the tagged materials can mimic them. More particularly, the remaining stool can appear as polyp-like blobs in the rendered image. A scan may also include residual materials which obscure portions of the colon wall as well as residual materials which mimic polyps or lesions. In any case, their presence can lead to confusion and result in additional workload for the clinician, who must typically evaluate and discard them.
Aspects of the present invention address these matters, and others.
According to one aspect of the present invention, a method includes using volumetric data indicative of the interior of an object to render a surface, identifying a location in the volumetric data having a first parameter value, identifying a region of interest on the rendered surface as a function of the relative positions of the rendered surface and the identified location, and generating a human readable image of the rendered surface with the region of interest highlighted thereon.
According to another aspect of the invention, an apparatus includes means for using volumetric data indicative of the interior of an object to render a surface, means for identifying a location in the volumetric data having a first parameter value, means for identifying a region of interest on the rendered surface as a function of the relative positions of the rendered surface and the identified location, and means for generating a human readable image of the rendered surface (102) with the region of interest highlighted thereon.
According to another aspect of the invention, a computer readable storage medium contains instructions which, when executed by a computer, cause the computer to carry out a method including using volumetric data indicative of the interior anatomy of a human to render a surface indicative of an interior of the colon, identifying a region of the rendered surface which is suspected to include residual stool, and highlighting the identified region on an image of the rendered surface.
Those skilled in the art will appreciate still other aspects of the present invention upon reading and understanding the attached figures and description.
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
a and 1b are rendered views of the interior of the colon.
b depicts a second rendering of the same data set wherein the region 104, which is suspected of including a residual material, is electronically tagged or highlighted for presentation to the user. As illustrated, the region 104 is denoted by a contour-like line 105. In another example, the region 104 is displayed in a different color than the remainder of the colon 102. Of course, other colors or highlighting techniques may be used, for example the use of shading, surface texture, arrows or text, either individually or in various combinations. To simplify the task of viewing and evaluating the rendered image, it is generally desirable that the tagging draw the user's attention to the suspect area 104 without substantially obscuring it in the rendered image 102.
The rendering process will now be described in relation to
The data set 202 can be visualized as an x, y, z array of voxels containing information on one or more physical characteristics of the object, such as its radiation attenuation. Radiation attenuation is traditionally expressed in Hounsfield Units (HUs), in which air has a value of −1000 HU and water has a value of 0 HU. Still greater values represent still greater radiation attenuation values.
At 204, voxels suspected of containing residual materials are identified. This may be accomplished by segmenting the data set 202 according to voxel value to generate a segmented data set or binary volume 206. In an example suitable for imaging the colon, segmentation is performed via thresholding to identify voxels which could be expected to contain residual materials. In one example, the threshold is set at +200 HU.
To avoid highlighting noise or regions which are not of clinical interest, segmented regions smaller than a desired threshold size may be discarded. Thus, for example, if a segmented regions smaller than the lower bound of a clinically relevant polyp (approximately 5 mm diameter) can be discarded.
At 207, the segmented data set 206 is dilated to generate a dilated data set or binary volume 208. In one example, a third order dilation is performed. More particularly, background or unsegmented voxels that touch the segmented data set are added to the dilated data set 208. In a third order dilation, this process is repeated three times. As will be described below, lower or higher order dilations may also be performed.
At 210, the data set 202 is used to render the desired region of the colon 102 according to a suitable rendering technique, typically from a viewpoint located inside the colon lumen. Such locations will typically have Hounsfield values at or near the value for air. In one such technique, an explicit segmentation operation is performed on the data set 202 to generate a segmented data set. The segmented data is used to approximate a surface, which is typically represented as a polygonal mesh. An example of such a technique is presented in U.S. Pat. No. 6,083,162 to Vining, entitled Method and System for Producing Interactive, Three-Dimensional Renderings of Selected Body Organs Having Hollow Lumens to Enable Simulated Movement Through the Lumen. In another technique, the location of the isosurface is calculated directly during the rendering process. For a given ray passing through the data set, the location of the voxel at which the ray passes through the desired isosurface value is determined. The location and orientation of the isosurface is obtained by interpolating the values of the surrounding voxels. An example of such a technique is presented in U.S. Pat. No. 6,522,324 to Bosma, entitled Deriving an Iso-Surface in a Multi-Dimensional Data Field. In one embodiment, the colon 102 is rendered as a surface having a radiation attenuation value of −800 HU.
As noted above, the rendering process can cause residual opacified materials to mimic the appearance of the rendered surface 102. When viewed from the perspective of the viewpoint, voxels in the data set 202 containing residue will be found behind the rendered colon 102, with the distance depending largely on the radiation attenuation of residual material, the selected thresholds, and voxel size. Other relatively attenuative materials such as bone are located still farther from the colon 102.
The order or number of the dilations performed at 207 is selected so that voxels indicative of residue can be expected to intersect the rendered colon 102, while bone and other materials are not. Stated another way, voxels in the dilated data set 208 resulting from residual materials can be expected to be located at or in front of the rendered colon 102 when viewed from the perspective of the viewpoint. Regions at which the dilated data set 208 intersects the rendered colon 102 are highlighted, for example by displaying them in a different color.
In an implementation in which the colon 102 is rendered using a ray casting technique, a first set of visuals or display attributes 212 (for example, a first color or range of colors) is assigned to the voxels of the dilated data set 208. A second set of visuals 214 (for example a second color or range of colors) are assigned to the rendered colon 102. As each ray is traversed, the colon 102 is located and displayed using one of the visuals 212, 214. However, the visuals 212 indicative of the suspect voxels take priority over visuals 214 indicative of the rendered colon 102. Accordingly, areas in which the dilated data set 108 intersects the rendered colon 102 are displayed using the first set of visuals 212.
In another implementation, the desired visuals are predetermined prior to rendering. Of course, still other implementations are possible.
The rendered surface 102, together with the highlighted regions 104 are displayed on a human readable device such as a monitor or display. The rendering is typically performed from each of a plurality of viewpoints or locations as the user moves through the colon lumen.
As noted above, areas 104 suspected of containing residue can be identified using dilation technique. In an alternate technique, the distance between the rendered colon 102 and segmented data set 106 can be calculated directly, either prior to or concurrently with the rendering process. The desired visuals are applied the rendered colon 102 based on the calculated distance.
While the above discussion has focus on data sets generated by CT scanners, the technique can also be used in conjunction with data sets generated by other modalities, for example magnetic resonance imaging, ultrasound, single photon emission computed tomography (SPECT), positron emission tomography (PET), and the like. The techniques are also applicable to imaging of body parts other than the colon. They are also not limited to the highlighting of residual material, but can also be used in situations where material of interest is suspected of being obscured or mimicked by a rendered surface.
The described technique can be embodied in a computer readable instructions, using specialized hardware, or a combination of both. The instructions may be stored in one or more computer readable storage media, such as non-alterable or alterable read only memory (ROM), random access memory (RAM), alterable or non alterable compact disks, DVD, on a remote computer and conveyed to the host system by a communications medium such as the internet, phone lines, wireless communications, or the like. When executed by a computer, the instructions cause the processors to carry out the described technique.
Of course, modifications and alterations will occur to others upon reading and understanding the preceding description. It is intended that the invention be construed as including all such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
This application claims the benefit of U.S. provisional application Ser. No. 60/729,458 filed Oct. 21, 2005, which is incorporated herein by reference.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IB2006/053587 | 10/2/2006 | WO | 00 | 4/21/2008 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2007/046019 | 4/26/2007 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5782762 | Vining | Jul 1998 | A |
| 5891030 | Johnson et al. | Apr 1999 | A |
| 5920319 | Vining et al. | Jul 1999 | A |
| 5971767 | Kaufman et al. | Oct 1999 | A |
| 6083162 | Vining | Jul 2000 | A |
| 6272366 | Vining | Aug 2001 | B1 |
| 6331116 | Kaufmann et al. | Dec 2001 | B1 |
| 6343936 | Kaufman et al. | Feb 2002 | B1 |
| 6366800 | Vining et al. | Apr 2002 | B1 |
| 6514082 | Kaufman et al. | Feb 2003 | B2 |
| 6522324 | Bosma et al. | Feb 2003 | B1 |
| 6694163 | Vining | Feb 2004 | B1 |
| 6909913 | Vining | Jun 2005 | B2 |
| 7747055 | Vining et al. | Jun 2010 | B1 |
| 8031921 | Manduca et al. | Oct 2011 | B2 |
| 20020193687 | Vining et al. | Dec 2002 | A1 |
| Number | Date | Country |
|---|---|---|
| 1455307 | Sep 2004 | EP |
| 0178017 | Oct 2001 | WO |
| 03086172 | Oct 2003 | WO |
| Entry |
|---|
| U.S. Appl. No. 60/652,679, filed on Feb. 14, 2005. |
| Lakare S., et al., “3D Digital Cleansing Using Segmentation Rays,” Annual IEEE Conf. on Visualization, Los Alamitos, CA: IEEE Comp. Soc, US, 2000, pp. 37-44. |
| Zigang Wang, et al., “An Improved Electronic Colon Cleansing Method for Detection of Polyps by Virtual Colonoscopy,” Engineering in Medicine and Biology Society, 2005, IEEE-EMBS 2005. 27th Annual Intl Conf. of Shanghai China, pp. 6512-5=6515. |
| Dongqing Chen, et al., “A Novel Approach to Extract Colon Lumen from CT Images for Virtual Colonoscopy,” IEEE Transactions on Medical Imaging, IEEE Service Center, Piscataway, NJ, US 2000; 19(12) Abstract pp. 1222-1223. |
| Number | Date | Country | |
|---|---|---|---|
| 20080228067 A1 | Sep 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60729458 | Oct 2005 | US |
