This invention pertains in general to the field of Medical Image Analysis. More particularly the invention relates to inspection of medical three dimensional (3D) data image sets, and even more particularly to the examination of 3D data image sets with multiple views, which are linked.
In the medical world it is common practice to inspect information of a single source or multiple sources using multiple views on said single source. For instance the 3D data in MR and CT is commonly inspected with slice examination or an orthoviewer, which shows the data from different views, each view being, rotated 90 degrees with respect to the others (orthogonal).
The analysis of data is currently shifting rapidly from classic viewing on film of 2 dimensional slide(s) towards computer supported viewing of the 3D data sets. As the data sets continuously get larger it also becomes increasingly important to use efficient ways to inspect this data.
Mainly three categories of 3D data viewing are currently available to the physician: 3D viewing, subsequent 2D slice viewing, combined 2D slice viewing as in for instance an orthoviewer or multiplanar reformat views, etc.
The classic viewing of slices is a transposition of the film viewing to a computer, but viewing all slices is time consuming and a full 3D insight is hard to obtain from such subsequent slice viewing.
The three dimensional viewing method is for 3D insight the ultimate method, but it is difficult to perform measurements on 3D views and overlapping structures often obscure the structures of interest. Thus many times an additional, often difficult and cumbersome operation, such as segmentation, is required to allow a proper view of the structure of interest.
2D slice viewing is currently still the most common solution. The drawback of subsequent 2D slice viewing is that it becomes cumbersome with large data sets and a 3D insight is difficult to achieve through this method.
For instance, a method of viewing cross-sections of a colon along its longitudinal length, based on 3D data sets, is disclosed in U.S. Pat. No. 5,458,111. A computer program calculates several individual cross sections of the colon along its longitudinal length at distances of 1-10 mm and saves the cross-sections in a memory, which later may be presented to a user. However, the views offered by this method suffer from the drawbacks mentioned in the previous paragraph.
The combined slice viewing method, e.g. in orthoviewer, multiplanar reformat views, etc., improves the 3D insight and also speeds up the examination of volumes. However a disadvantage of this combined slice viewing method is that the visualized planes are always perpendicular to each other. This configuration is maintained when the planes are rotated or translated. An orthoviewer is limited to one dataset at a time. Major disadvantages of the orthoviewer are that there are always three views and that the views are always perpendicular to each other. If inspection of more than one dataset at the same time is required, the same number of orthoviewers is needed, each having three views displayed at the same time. It is obvious that this increase of the number of views is not practically implementable due to limited screen size and human perception capability.
The current imaging systems, such as MRI, CT, etc, are based on 3D data imaging including 3 orthogonal planes X, Y and Z. With current viewing/comparing systems it is possible to view subsequent 3D data images, each from one specific angle. A disadvantage of the current linked view methods, is that the geometrical relation between the viewed planes is a transformation matrix required to fit one dataset to the other. The current methods used assume that the viewed planes show the same cross-section through the data, despite of the fact that both have different geometries. This assumption results in undesired restrict ions.
Hence, there is a need for a new technical solution which improves the overall performance when viewing 3D data images, which are related to each other. More precisely, there is a need for a more advantageous method allowing for combined viewing of a plurality of 2D images derived from a 3D image data set. Advantageously, an arbitrary geometrical relation between the images is maintained. Further, it would be advantageous if some embodiments may provide further information derived from the plurality of 2D images.
Hence, an improved method of presenting a plurality of 2D images would be advantageous allowing for increased flexibility.
Accordingly, the present invention preferably seeks to mitigate, alleviate or eliminate one or more of the above-identified deficiencies in the art and disadvantages singly or in any combination and solves at least the above mentioned problems related to the above-mentioned prior art by providing a method, a computer-readable medium comprising a computer program, and a medical workstation according to the appended patent claims.
According to a first aspect of the invention, a method is provided for relating medical data image viewing planes to each other. The method comprises defining at least two non-orthogonal two-dimensional (2D) image viewing planes in at least one three-dimensional (3D) medical image data set, and linking said 2D image viewing planes to each other, such that when a first of said 2D image viewing planes is repositioned, each of said remaining 2D image viewing planes are automatically repositioned with reference to said repositioned first 2D image viewing plane.
According to a further aspect of the invention, a computer-readable medium having embodied thereon a computer program for relating medical data image viewing planes to each other for processing by a computer. The computer program comprises a first code segment for defining at least two non-orthogonal two-dimensional (2D) image viewing planes in at least one three-dimensional (3D) medical image data set, and a second code segment for linking said 2D image viewing planes to each other, such that when a first of said 2D image viewing planes is repositioned, each of said remaining 2D image viewing planes are automatically repositioned with reference to said repositioned first 2D image viewing plane.
According to yet another aspect of the invention, a medical workstation is provided. The medical workstation configured to perform the method according to a first aspect of the invention, and is adapted to relate medical data image viewing planes to each other. The medical workstation comprises means for defining at least two non-orthogonal two-dimensional (2D) image viewing planes in at least one three-dimensional (3D) medical image data set, and means for linking said 2D image viewing planes to each other, such that when a first of said 2D image viewing planes is repositioned, each of said remaining 2D image viewing planes are automatically repositioned with reference to said repositioned first 2D image viewing plane.
The present invention is advantageous over the prior art as it for instance enhances the inspection of data set(s) because the linked relation between 2D data sets drastically increases the flexibility for data inspection.
These and other aspects, features and advantages of which the invention is capable of will be apparent and elucidated from the following description of embodiments of the present invention, reference being made to the accompanying drawings, in which
The following description focuses on embodiments of the present invention applicable to specific examples for medical images, and in particular to a vessel region or a skull region. However, it will be appreciated that the invention is not limited to these specific applications but may be applied to many other applications, including for example intestinal regions etc.
The present invention provides an advantageous way of inspecting 3D image data sets with linked 2D views.
Moreover the present invention provides a convenient future-proof way of handling data sets as data sets are continuously getting larger and contain data from more and more different information sources.
Embodiments of the present method extend the relation nature of the different views on the data set(s) and are therefore an extension of combined slice viewing. Different additional transformations may be imposed according to different embodiments, in order to inspect data sets.
When the position or orientation of one of these registered viewing planes is modified, for instance translated, rotated, or zoomed, then the other viewing plane is automatically also repositioned to the corresponding position in the other dataset according to the used transformation matrix.
The disadvantage of these linked view methods is that the geometrical relation between the viewed planes is the transformation matrix required to fit one dataset to the other. The assumption in current linked view methods is that the viewed planes show the same cross-section through the data, despite of the fact that both datasets have different geometries.
The following description focuses on an embodiment of the present invention applicable to a 3D image analysis system and in particular to 3D data images within healthcare. However, it will be appreciated that the invention is not limited to this application but may be applied to many other 3D image analysis systems in other fields than healthcare.
An embodiment of the method of the present invention comprises an addition of a general transformation matrix, including translation, rotation, scaling, etc., between different views. This allows for instance to inspect a data set with two linked views which are translated to each other, rotated with arbitrary angle to each other, etc. The transformation matrix is further extended to arbitrary relations between different views, and it has capability to depend on information present in the images, location information, path information. The extension of the transformation matrix is valid for the examination of data from a single source as well as for data from multiple sources. The relation between the views is not necessarily the transformation between two similar but may be between geometrically different datasets, and the purpose is not to view the same or corresponding cross-sections in these linked views, but cross-sections that are linked in another way.
In a first embodiment of the invention according to
An example of an application which may benefit from the behavior of the above-described embodiment is the determination of a trajectory for intervention. One can freely move a cross-sectional plane around through a 3D dataset of the relevant volume and see not only the current cross-section but also one or more cross-sections which are located a certain distance ‘ahead’. For instance, when entering a surgical instrument through a keyhole during a minimal invasive procedure, often structures need to be avoided on the passage of the instrument into the body towards a target area. It is known to use X-Ray monitoring during insertion of such surgical instruments. In this case bones and instruments are visible on the X-Ray image. However, it is often more important to avoid other structures than bones, namely soft tissues that do not show up on X-Ray images, like blood vessels, for instance in the head. Hence, a position for the opening in the skull has to be determined such that a ‘safe’ path from the opening to the target area, for instance a tumor, is possible. While inserting the instruments, a continuous checking of the volume ahead of the instrument tip prevents serious damage that otherwise would be caused by collision with and possibly rupture of blood vessels. By visualizing a cross-section a certain distance ‘ahead’ in insertion direction of the instrument, such critical structures may be discovered before the instrument comes near the structure, and the structure may be circumvented by changing the insertion direction of the instrument. This ensures to safely reach the desired treatment site with the distal end of the surgical instrument inside the body.
In another embodiment of the present invention, instead of the two viewing planes being represented by the same dataset, the two viewing planes are represented by two different datasets.
In yet another embodiment of the present invention the number of viewing planes is represented by an equal number of datasets.
Another embodiment of the invention relates to determination of entry paths for instruments that need to be inserted with a preferred angle between them. The relation between two viewing planes is here a configuration in which two planes cross each other under a certain angle, which can be used to determine the entry paths for the instruments at the same time. For instance, an endoscope is introduced through a keyhole towards a treatment site, where e.g. a tumor is to be removed. A surgical instrument is introduced through another keyhole towards the treatment site, but at another angle than the endoscope. According to other embodiments different instruments than endoscopes might be visualized within the scope of the present invention.
The extended transformation matrix of some embodiments of the present invention, which provides new ways of relating the viewing planes, enables besides from a rigid relation, described in the above embodiments, relations which may also depend on other criteria. According to some embodiments, the criteria for the relation between viewing planes may have no relation to the geometry of the dataset(s) at all. An example of such a relation is for instance that two viewing planes are parallel to each other with a certain distance in between. This relation is maintained when one of the planes is repositioned.
Another embodiment of the present invention, illustrated with reference to
The method of the invention furthermore enables presenting the information on a human-readable device. The human-readable device is able to display the information from the investigated viewing planes and may include at least an additional view, in which image analysis calculations of the investigated viewing planes may be presented. Examples are given in
The image analysis calculations may include any common image analysis calculation such as, but not limited to, subtraction, filtering, intensity division, thresholding, edge detection, corner detection, structure identification, coloring, or any combination thereof. A subtraction image of the views gives a very clear indication whether the cross-sectional area of a tubular structure is constant, decreasing or increasing, and how fast the area changes when moving along the path, simply by the sign and magnitude of the local difference.
In
One possible application of embodiments of the present invention is for automized determination of pathological disorders. For instance, the above-mentioned stenosis detection may be automated. In this case the local curvature of the vessel is measured, which enables detection of the anatomical path of the vessel, and definition of a centerline through the vessel. Subsequently an automated analysis of the relation of two views along the centerline and perpendicular thereto may be performed. The difference (subtraction) between the views, i.e. the intensity (grey values) and density of the subtracted pixels thereof indicate the presence of a stenosis along the path of the vessel. This enables a closer examination of the identified stenosis.
The method of the invention may be implemented in any suitable form including hardware, software, firmware or any combination of these. However, preferably, the image analysis calculations, such as the transformation matrix, and the presenting of information is implemented as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.
Applications and use of the above-described method of relating medical 3D data image viewing planes in a new manner according to the invention are various and include all fields wherein medical 3D data is processed.
Although the present invention has been described above with reference to specific embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the invention is limited only by the accompanying claims and, other embodiments than the specific above are equally possible within the scope of these appended claims.
In the claims, the term “comprises/comprising” does not exclude the presence of other elements or steps. Furthermore, although individually listed, a plurality of means, elements or method steps may be implemented by e.g. a single unit or processor. Additionally, although individual features may be included in different claims, these may possibly advantageously be combined, and the inclusion in different claims does not imply that a combination of features is not feasible and/or advantageous. In addition, singular references do not exclude a plurality. The terms “a”, “an”, “first”, “second” etc do not preclude a plurality. Reference signs in the claims are provided merely as a clarifying example and shall not be construed as limiting the scope of the claims in any way.
Number | Date | Country | Kind |
---|---|---|---|
05112143.2 | Dec 2005 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2006/054633 | 12/6/2006 | WO | 00 | 11/11/2008 |