The present invention relates generally to the field of medical imaging, and, more particularly, to rib labeling for two-dimensional (“2D”) images.
High-resolution computed tomography (“CT”) volumes of the chest are commonly used to diagnose abnormalities in the ribs. Current technology provides CT volumes of the chest with up to several hundred 2D slices. Thorough evaluation of thoracic CT scans frequently requires physicians to identify and track the individual ribs structures in the volume data. This can be a tedious task as the ribs occupy multiple slices within the data. More precisely, the ribs typically cross through the axial planes at an oblique angle, thereby making their examination even more problematic. To analyze the CT volumes, the radiologist must scroll through all slices, and view the contents of the ribs while tracking the ribs through each slice. Moreover, given a rib in an arbitrary slice, the radiologist must scroll up and down to determine the number of the rib.
In at least one embodiment of the invention, a method of rib labeling for 2D images is disclosed. In at least one embodiment a corresponding computation unit, a system including a computation unit and a displaying unit, a medical imaging device, and a computer program are also disclosed. The 2D images are previously recorded by use of a medical imaging device, e.g. by use of a magnetic resonance imaging (“MRI”) system, an X-ray system, a positron emission tomography (“PET”) system or any other medical imaging device. In a preferable embodiment of the invention the 3D image data is previously recorded by way of a CT system. In further embodiments of the inventions contrast agents such as iodide-containing solution or radioactive tracers can be employed for recording measuring data. It is understood, that the term “2D images” refer to reconstructed images.
According to a first embodiment of the invention, the method of rib labeling comprises receiving a plurality of 2D images representing cross sections of a rib cage, each 2D image comprising cross sections of a plurality of ribs, and generating an anatomical label for each of the ribs in each of the 2D images, each anatomical label being placed radially outside the rib cage. Each anatomical label is placed in the vicinity of the cross section of the respective rib to provide a simple identification of the respective rib. By placing the ribs radially outside the rib cage an overlap between an anatomical label and the respective cross sections of a rib is prevented. Thus the invention allows labeling ribs without occluding valuable image information.
At least one embodiment of the invention can also be realized as a computation unit for rib labeling, comprising a program memory for storage of program code, the program code being present in the program memory and carrying out, when executed, receiving a plurality of two-dimensional images representing cross sections of a rib cage, each two-dimensional image comprising cross sections of a plurality of ribs, generating an anatomical label for each of the ribs in each of the two-dimensional images, each anatomical label being placed radially outside the rib cage. At least one embodiment of the invention can also be realized as medical imaging device comprising such a computation unit.
At least one embodiment of the invention can also be realized as a non-transitory computer readable medium including program segments for, when executed on a computer device, causing the computer device to carry out the inventive method. The invention can also be realized as a computer program product, comprising program code segments of a computer program stored on a non-transitory computer-readable data carrier to execute the inventive method when the computer program is executed on a computer.
At least one embodiment of the invention can also be realized as a system including a computation unit for rib labeling and a displaying unit for visualization of the rib labeling, wherein the computation unit comprises a program memory for storage of program code, the program code being present in the program memory and carrying out, when executed, receiving a plurality of two-dimensional images representing cross sections of a rib cage, each two-dimensional image comprising cross sections of a plurality of ribs, generating an anatomical label for each of the ribs in each of the two-dimensional images, each anatomical label being placed radially outside the rib cage. Such a computation unit can also be configured to obtain instructions via a user-interface. According to another embodiment of the invention, the computation unit is acting as a server and the displaying unit is acting as a client, wherein the displaying unit is configured to receive the labeled 2D image from the computation unit via a network connection.
The invention is explained in greater detail below on the basis of an example embodiment. Wherein:
The present invention will be further described in detail in conjunction with the accompanying drawings and embodiments. It should be understood that the particular embodiments described herein are only used to illustrate the present invention but not to limit the present invention.
Accordingly, while example embodiments of the invention are capable of various modifications and alternative forms, embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit example embodiments of the present invention to the particular forms disclosed. On the contrary, example embodiments are to cover all modifications, equivalents, and alternatives falling within the scope of the invention. Like numbers refer to like elements throughout the description of the figures.
Specific structural and functional details disclosed herein are merely representative for purposes of describing example embodiments of the present invention. This invention may, however, be embodied in many alternate forms and should not be construed as limited to only the embodiments set forth herein.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments of the present invention. As used herein, the term “and/or,” includes any and all combinations of one or more of the associated listed items.
It will be understood that when an element is referred to as being “connected,” or “coupled,” to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being “directly connected,” or “directly coupled,” to another element, there are no intervening elements present. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., “between,” versus “directly between,” “adjacent,” versus “directly adjacent,” etc.).
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments of the invention. As used herein, the singular forms “a,” “an,” and “the,” are intended to include the plural forms as well, unless the context clearly indicates otherwise. As used herein, the terms “and/or” and “at least one of” include any and all combinations of one or more of the associated listed items. It will be further understood that the terms “comprises,” “comprising,” “includes,” and/or “including,” when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be noted that in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may in fact be executed substantially concurrently or may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Spatially relative terms, such as “beneath”, “below”, “lower”, “above”, “upper”, and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, term such as “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein are interpreted accordingly.
Although the terms first, second, etc. may be used herein to describe various elements, components, regions, layers and/or sections, it should be understood that these elements, components, regions, layers and/or sections should not be limited by these terms. These terms are used only to distinguish one element, component, region, layer, or section from another region, layer, or section. Thus, a first element, component, region, layer, or section discussed below could be termed a second element, component, region, layer, or section without departing from the teachings of the present invention.
According to a first embodiment of the invention, the method of rib labeling comprises receiving a plurality of 2D images representing cross sections of a rib cage, each 2D image comprising cross sections of a plurality of ribs, and generating an anatomical label for each of the ribs in each of the 2D images, each anatomical label being placed radially outside the rib cage. Each anatomical label is placed in the vicinity of the cross section of the respective rib to provide a simple identification of the respective rib. By placing the ribs radially outside the rib cage an overlap between an anatomical label and the respective cross sections of a rib is prevented. Thus the invention allows labeling ribs without occluding valuable image information.
According to an embodiment of the invention, the method of rib labeling comprises receiving a centerline of each of the plurality of ribs, each anatomical label being placed based on a position of the centerline of the respective rib. The centerline of a rib describes the orientation and position of the respective rib with high precision in three-dimensional space. Furthermore the centerline of a rib can be used to determine the position of the cross section of the respective rib. Thus this aspect of the invention leads to a particularly precise location of the anatomical labels.
According to an embodiment of the invention, the method of rib labeling comprises receiving a position of a center point of the rib cage, each anatomical label being placed based on the distance between the position of the center point and of a position of the cross section of the respective rib. This embodiment of the invention can be realized by placing each anatomical label along the direction of the distance vector and yields, thus, a very regular and intuitive placement of the anatomical labels.
According to an embodiment of the invention, the method of rib labeling comprises receiving a centerline of each of the plurality of ribs, and determining the position of the cross section of the respective rib based on the position of the centerline of the respective rib. This embodiment of the invention allows determining the position of the cross section of a rib in a very precise and well defined manner. As a consequence the anatomical labels can be placed in a very precise and well defined manner, too.
According to an embodiment of the invention, each anatomical label is placed in a variable distance from the position of the cross section of the respective rib, wherein the variable distance depends on the distance between the position of the center point and of the position of the cross section of the respective rib. According to another embodiment of the invention, the method of rib labeling each anatomical label is placed in the same, fixed distance from the position of the cross section of the respective rib. Both aspects of the invention lead to a very regular placement of the anatomical labels and allow a very fast and simple identification of an individual rib by its anatomical label.
According to an embodiment of the invention, the 2D images are given by multiplanar reconstructions or by curved planar reconstructions. These reconstructions provide particularly relevant image information for diagnostic purposes.
According to an embodiment of the invention, the method comprises displaying simultaneously at least two different labeled 2D images, wherein the at least two labeled 2D images differ in perspective. This aspect allows looking at cross sections of a rib cage with consistently labeled ribs from different perspectives. Visual analysis of ribs becomes thus faster and more reliable.
According to an embodiment of the invention, the at least two labeled 2D images differ in the orientation of the sectional planes. This aspect of the invention allows viewing labeled cross sections of the rib cages in different sectional planes such as sagittal, transverse or frontal.
In an embodiment of the invention, the 2D images form a three-dimensional stack, wherein the position of a given anatomical label between adjacent 2D images changes based on the change of position of the cross section of the respective rib between adjacent 2D images. In another embodiment of the invention the method of rib labeling comprises receiving a centerline of each of the plurality of ribs, and determining the position of the cross section of the respective rib based on the position of the centerline of the respective rib. These aspects lead to a smooth and continuous change of the positions of the anatomical labels between adjacent planes. Therefore, these aspects are particularly helpful when scrolling through a stack of labeled 2D images.
According to a further embodiment of the invention the method of rib labeling comprises displaying sequentially the 2D images forming a three-dimensional stack.
At least one embodiment of the invention can also be realized as a computation unit for rib labeling, comprising a program memory for storage of program code, the program code being present in the program memory and carrying out, when executed, receiving a plurality of two-dimensional images representing cross sections of a rib cage, each two-dimensional image comprising cross sections of a plurality of ribs, generating an anatomical label for each of the ribs in each of the two-dimensional images, each anatomical label being placed radially outside the rib cage. At least one embodiment of the invention can also be realized as medical imaging device comprising such a computation unit.
At least one embodiment of the invention can also be realized as a non-transitory computer readable medium including program segments for, when executed on a computer device, causing the computer device to carry out the inventive method. At least one embodiment of the invention can also be realized as a computer program product, comprising program code segments of a computer program stored on a non-transitory computer-readable data carrier to execute at least one embodiment of the inventive method when the computer program is executed on a computer.
At least one embodiment of the invention can also be realized as a system including a computation unit for rib labeling and a displaying unit for visualization of the rib labeling, wherein the computation unit comprises a program memory for storage of program code, the program code being present in the program memory and carrying out, when executed, receiving a plurality of two-dimensional images representing cross sections of a rib cage, each two-dimensional image comprising cross sections of a plurality of ribs, generating an anatomical label for each of the ribs in each of the two-dimensional images, each anatomical label being placed radially outside the rib cage. Such a computation unit can also be configured to obtain instructions via a user-interface. According to another embodiment of the invention, the computation unit is acting as a server and the displaying unit is acting as a client, wherein the displaying unit is configured to receive the labeled 2D image from the computation unit via a network connection.
An embodiment of the invention comprises identifying each rib or each cross section of a rib in a 2D image. Identifying a rib or a cross section of a rib in a 2D image may comprise automated rib ordering and pairing of ribs. In the U.S. patent application Ser. No. 13/274,515 published as US 2012/0106810 A1 the entire contents of which are hereby incorporated herein by reference, a method for automated rib ordering and pairing is disclosed.
In an embodiment of the invention, the method for rib labeling comprises receiving a centerline of each of the plurality of ribs. The centerlines are typically obtained from three-dimensional (“3D”) image data. Different steps of image processing such as segmentation and rendering can be employed for extracting the centerlines based on the 3D image data by way of image processing. Typically several cross sections of different ribs appear in a 2D image due to the curved geometry of the ribs. The position of an individual cross section of a rib in the 2D image can be determined, e.g. based on the centerline of the respective rib. In an embodiment of the invention the position of the centerline in the sectional plane of the 2D image is identified with the position of the cross section of the respective rib in the 2D image.
An embodiment of the invention comprises receiving a position of a center point of the rib cage. The center point of the rib cage with respect to a 2D image can be determined by averaging the positions or the position vectors of the cross sections of all ribs represented in a 2D image. The averaging may include the weighting of the position or the position vectors of the cross section of individual ribs. The center point can be used for determining the distance between the position of the center point and of a position of a cross section of a rib. The radial placement of the anatomical labels can be realized by placing them along the direction of the distance vector. In an embodiment of the invention the position of an anatomical label depends on the absolute distance between the position of the center point and of the position of the cross section of the respective rib, e.g. by placing the label at a certain fraction of this absolute distance away from the position of the cross section of the respective rib.
In a further embodiment of the invention, a surface of the rib cage is defined, e.g. by interpolating the centerlines of the ribs. In such a case the radial placement of the anatomical labels can be realized by determining the position of the anatomical labels based on the surface of the rib cage, e.g. each anatomical label can be placed in a certain distance from the position of the cross section of the respective rib, wherein the distance vector is directed normal to the surface of the rib cage.
Directly placing the anatomical label over the intersection point of the respective rib would hide diagnostically relevant image information. In order to derive a more suitable position of the anatomical label a center point g of the rib cage can be derived. The center point g can be defined as the average of all rib centerline points in a given dataset. For each intersection point y between a rib centerline and an image plane a distance w=y−g can be determined. Accordingly a 3D distance vector can be determined. Such a 3D distance vector points from the center of the rib cage g radially outwards. The displacement vector can be projected into the image plane, wherein the projected distance is indicated as w′. An anatomical label can then be placed at the anchor point a=y+μw′, whereby μ is a scalar value for adjusting the distance between the rib intersection point y and the anatomical label.
Each of the 2D images shown in
The difference in perspective between at least two labeled 2D images can be realized by a different viewing angle. In one embodiment of the invention a second labeled 2D image can be generated by rotating a first labeled 2D image. In such a case the viewing angle between the first and the second labeled 2D image differs. The first labeled 2D image might be given by a multiplanar reconstruction with a transverse sectional plane. A second labeled 2D image can be generated by rotating the first labeled 2D image around its vertical axis. A rotation by 90° yields a multiplanar reconstruction with a frontal sectional plane. In an embodiment of the invention a plurality of labeled 2D images with different viewing angles are generated, wherein the viewing angles are regularly spaced, e.g. equidistantly. This embodiment allows rotating the rib cage while providing a reliable and consistent labeling.
The example embodiment or each example embodiment should not be understood as a restriction of the invention. Rather, numerous variations and modifications are possible in the context of the present disclosure, in particular those variants and combinations which can be inferred by the person skilled in the art with regard to achieving the object for example by combination or modification of individual features or elements or method steps that are described in connection with the general or specific part of the description and are contained in the claims and/or the drawings, and, by way of combinable features, lead to a new subject matter or to new method steps or sequences of method steps, including insofar as they concern production, testing and operating methods.
References back that are used in dependent claims indicate the further embodiment of the subject matter of the main claim by way of the features of the respective dependent claim; they should not be understood as dispensing with obtaining independent protection of the subject matter for the combinations of features in the referred-back dependent claims.
Furthermore, with regard to interpreting the claims, where a feature is concretized in more specific detail in a subordinate claim, it should be assumed that such a restriction is not present in the respective preceding claims.
Since the subject matter of the dependent claims in relation to the prior art on the priority date may form separate and independent inventions, the applicant reserves the right to make them the subject matter of independent claims or divisional declarations. They may furthermore also contain independent inventions which have a configuration that is independent of the subject matters of the preceding dependent claims.
Further, elements and/or features of different example embodiments may be combined with each other and/or substituted for each other within the scope of this disclosure and appended claims.
Still further, any one of the above-described and other example features of the present invention may be embodied in the form of an apparatus, method, system, computer program, tangible computer readable medium and tangible computer program product. For example, of the aforementioned methods may be embodied in the form of a system or device, including, but not limited to, any of the structure for performing the methodology illustrated in the drawings.
Example embodiments being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the present invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.
The present application is co-pending with U.S. application entitled “2D Visualization For Rib Analysis” to Gnanamani et al. (attorney docket number 32860-002208/US) filed on even date herewith on Nov. 12, 2013, the entire contents of which are hereby incorporated herein by reference.