The present invention relates to a system and a method for analysis of projection images. More specifically, the present invention relates to a system and method for decomposition of projection images using predefined classes.
Projection radiography is a widely adopted technique for medical diagnosis. It relies on projection images which are acquired from the patient. The projection images are generated using X-ray radiation which are emitted by an X-ray radiation source and which pass through a body portion of the patient. The X-ray radiation is attenuated by interaction with the different tissue types and bones of the body portion. A detector is arranged behind the body portion in relation to the X-ray radiation source. The detector absorbs the X-ray radiation remaining behind the patient and converts it into a projection image which is indicative of the X-ray attenuation caused by the patient.
A typical problem that arises when analyzing X-ray images is that the projection image of an anatomical or functional portion of the body, which is to be inspected, typically is obstructed due to other objects in an image, such as bones. This renders image analysis more difficult, often requiring profound expert knowledge and experience. By way of example, in the context of nodule detection using X-ray imaging, the radiologist conventionally has to consider that the appearance of a nodule in the image can be influenced by image contributions of the ribs, the spine, vasculature and other anatomical structures.
In view of this problem, the development of X-ray computer tomography has brought significant advances for X-ray based diagnosis. The computer tomography imaging system typically includes a motorized table which moves the patient through a rotating gantry on which a radiation source and a detector system are mounted. Data which is acquired from a single CT imaging procedure typically consist of either multiple contiguous scans or one helical scan. Using reconstruction algorithms volumetric (3D) representations of anatomical structures or cross-sectional images (“slices”) through the internal organs and tissues can be obtained from the CD imaging data.
However it has been shown that CT scans can deliver 100 to 1,000 times higher dose compared to the dose delivered when acquiring a single X-ray projection image.
Document US 2017/0178378 A1 relates to an apparatus which is configured to visualize previously suppressed image structures in a radiograph. A graphical indicator is superimposed on the radiograph to indicate the suppressed image structure. The apparatus is configured to allow toggling in our out the graphical indicator or to toggle between different graphical renderings thereof.
Accordingly, there is a need for a system and a method which allows for a more efficient diagnosis based on medical projection images.
This need is met by the subject-matter of the independent claims.
Embodiments of the present disclosure provide a system for image decomposition of an anatomical projection image, the system comprising a data processing system which implements a decomposition algorithm. The decomposition algorithm is configured to read projection image data representing a projection image generated by irradiating a subject with imaging radiation. An irradiated body portion of the subject is a three-dimensional attenuation structure of an attenuation of the imaging radiation. The attenuation structure represents a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure. The data processing system is further configured to decompose the projection image using the classification of the attenuation structure. The decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion of the subject to the projection image. The further body portion at least partially overlaps with the classified body portion in the projection image.
Thereby, based on a projection image, such as an X-ray projection image, a decomposition image of a body portion, such as the heart, can be obtained in which obstructing effects due to other body portions, such as the rib cage, are suppressed or even eliminated. Notably, in the field of X-ray analysis, this allows medical diagnosis based on low-dose projection radiology without the need to conduct complex and costly 3D X-ray reconstruction procedures. Such 3D X-ray reconstruction procedures require a complex CT-scanner, are time-consuming and cause a considerable amount of radiation exposure to the patient.
Accordingly, the proposed system allows decomposition of a 2D projection image into functionally meaningful constituents.
The data processing system may include a processor configured to perform the operations required to perform the separation algorithm. The data processing system may be a stand-alone data processing system, such as a stand-alone computer, or a distributed data processing system.
The projection image may be generated using projection imaging. In order to perform the projection imaging, a radiation source may be provided which is substantially a point source and which emits imaging radiation which traverses a part of the subject's body before being incident on a radiation detector which is configured to detect the imaging radiation. It is conceivable that more than one point sources are provided such as in scintigraphy. The intensity of each of the image points on the detector may depend on a line integral of local attenuation coefficients along a path of the incident ray. The line integral may represent an absorbance of the imaging radiation. Thereby, the projection image may be indicative of a two-dimensional absorbance distribution. The incident ray may travel substantially undeflected between the point source and the detector. The radiation source may be substantially a point source. It is conceivable that the radiation source is located within the subject's body, such as in scintigraphy.
The projection image may be generated using electromagnetic radiation (such as X-ray radiation and/or Gamma radiation). When X-ray radiography and/or scintigraphy is used for imaging, imaged body portions may attenuate the electromagnetic radiation used for generating the projection image. It is further conceivable that the projection image is generated using sound radiation as imaging radiation, in particular ultrasound radiation. A frequency of the ultrasound radiation may be within a range of between 0.02 and 1 GHz, in particular between 1 and 500 MHz. The imaging radiation may be generated using an acoustic transducer, such as a piezoelectric transducer.
The attenuation structure may be defined as a body portion, wherein within the body portion, the local absorbance is detectably different compared to adjacent body portions surrounding the attenuation structure. The attenuation structure may be defined by attenuation contrast. By way of example, at each point within the attenuation structure, the local attenuation exceeds the local attenuation of the adjacent body portions which surround the attenuation structure by a factor of more than 1.1 or by a factor of more than 1.2. Further by way of example, at each point within the attenuation structure, the local attenuation is less than the local attenuation of the adjacent body portions by a factor of less than 0.9 or by a factor of less than 0.8.
The data processing system may be configured to classify the body portion to obtain the classification. The data processing system may be configured to generate, using the projection image, one or more decomposition images. The decomposition images may represent a decomposition of the projection image into contributions of different body portions to the projection image. The different body portions may represent different classifications. Each of the decomposition images may show a contribution of a body portion, wherein a contribution of one or more other body portions is suppressed or eliminated.
According to an embodiment, the body portion is an anatomically and/or functionally defined portion of the body. An anatomically defined portion of the body may be a bone structure and/or a tissue structure of the body. A functionally defined portion of the body may be a portion of the body which performs an anatomical function.
According to a further embodiment, the decomposition of the projection image includes determining, for the projection image, a contribution image which is indicative of the contribution of the classified body portion to the projection image. The contribution image may represent a contribution of the body portion to the attenuation of the imaging intensity.
According to an embodiment, the decomposition of the projection image comprises generating a plurality of decomposition images, each of which being indicative of a two-dimensional absorbance distribution of the imaging radiation, which may be measured in an image plane of the projection image. For each point in the image plane, a sum of the absorbance distributions of the decomposition images may correspond to an absorbance distribution of the projection image within a predefined accuracy. The data processing system may be configured to check whether the sum corresponds to the absorbance distribution within the predefined accuracy.
According to a further embodiment, the decomposition algorithm includes a machine learning algorithm for performing the decomposition of the projection image using the classification of the body portion. The machine learning algorithm may be configured for supervised or unsupervised machine learning. In particular, the data processing system may be configured for user-interactive supervised machine learning.
According to a further embodiment, the decomposition algorithm includes a nearest neighbor classifier. The nearest neighbor classifier may be patch-based.
According to an embodiment, the data processing system is configured to train the machine learning algorithm using volumetric image data. The volumetric image data may be acquired using X-ray computer tomography.
According to an embodiment, the machine learning algorithm includes an artificial neural network (ANN). The ANN may include an input layer, an output layer and one or more intermediate layers. The ANN may include more than 5, more than 10, or more than 100 intermediate layers. The number of intermediate layers may be less than 500.
According to an embodiment, the data processing system is configured for semi-automatic or automatic segmentation of a portion of the volumetric image data. The segmented portion may represent the body portion which is to be classified. The data processing system may be configured to calculate, using the volumetric image data, a simulated projection image of the irradiated part of the subject and/or a simulated projection image of the segmented portion of the volumetric image data. The simulated projection images may be calculated using a ray casting algorithm. The semi-automatic segmentation may be user-interactive. The simulated projection images may be simulated based on a same position and/or orientation of the point source and the detector compared to the projection image.
According to a further embodiment, the data processing system is further configured to decompose the projection image depending on one or more further projection images. Each of the further projection images may be a projection image showing the classified body portion. The projection images may have mutually different projection axes.
Embodiments provide a method for image decomposition of an anatomical projection image using a data processing system. The data processing system implements a decomposition algorithm. The method comprises reading projection image data representing a projection image generated by irradiating a subject with imaging radiation. An irradiated body portion of the subject is a three-dimensional attenuation structure of an attenuation of the imaging radiation. The attenuation structure is a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure. The method further comprises decomposing the projection image using the classification of the attenuation structure. The decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion of the subject to the projection image. The further body portion at least partially overlaps with the classified body portion in the projection image.
According to a further embodiment, the method comprises training the decomposition algorithm. The training of the decomposition algorithm may be performed using volumetric image data.
According to a further embodiment, the method comprises segmenting the body portion to be classified from the volumetric image data. The method may further comprise calculating or simulating a projection image of the segmented body portion.
Embodiments of the present disclosure provide a program element for image decomposition of an anatomical projection image, which program element, when being executed by a processor, is adapted to carry out reading projection image data representing a projection image generated by irradiating a subject with imaging radiation. An irradiated body portion of the subject represents a three-dimensional attenuation structure which is a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure. The program element is further adapted to carry out decomposing the projection image using the classification of the attenuation structure. The decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion of the subject to the projection image. The further body portion at least partially overlaps with the classified body portion in the projection image.
Embodiments of the present disclosure provide a computer readable medium having stored the computer program element of the previously described program element.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
It is conceivable that the aspects and techniques of the present disclosure can be applied in conjunction with other imaging techniques which produce projection images, such as planar scintigraphy.
By way of example, the projection image of
However, it has been shown, that it is possible to decompose the projection image between the body portions. Thereby, for example, it is possible to obtain a contribution image showing the contribution of a single body portion to the projection image, wherein in the contribution image, the contributions of most or all of the remaining body portions are suppressed or even eliminated.
In order to perform the decomposition, a data processing system 6 (shown in
As will be explained in detail later, the decomposition algorithm uses one or a plurality of classes of three-dimensional attenuation structures. For the illustrated exemplary embodiment, examples for such classes include, but are not limited to, attenuation structures representing the heart, attenuation structures representing the rib cage and attenuation structures representing one or both lobes of the lung.
An example of a decomposition is described in the following with reference to
It is conceivable that the decomposition algorithm only provides one class, such as a class for attenuation structures of the heart, or more than two classes. Further, the decomposition algorithm may provide a class for remaining tissue portions of the irradiated part of the patient, which are not represented by other classes. Thereby, the classes may cover all body portions of the imaged part of the patient.
In the exemplary embodiment, the decomposition algorithm includes a machine learning algorithm for performing the decomposition of the protection image. The machine learning algorithm uses the classifications of the attenuation structures of one or more imaged body portions. In the exemplary embodiment, the machine learning algorithm is implemented using an artificial neural network (ANN). It is conceivable, however, that the decomposition is not a machine learning algorithm. The machine learning may be performed by supervised or unsupervised learning. Additionally or alternatively, it is conceivable that the decomposition algorithm includes a nearest neighbor classifier. The nearest neighbor classifier may be patch-based.
It has been shown that using the ANN 19, it is possible to efficiently and reliably classify three-dimensional attenuation structures which are visible in the projection image.
The ANN decomposes 120 the sample input image. Depending on a comparison between the decomposition images and reference decomposition images, it is determined whether the decomposition determined by the ANN has a required level of accuracy. If the decomposition has been achieved with a sufficient accuracy (150: YES), the training process 100 is ended 130. If the decomposition has not been achieved with sufficient accuracy (150: NO), the connection weights are adjusted 140. After adjustment of the connection weights, a further decomposition of the same or of different sample input images is performed as a next iteration.
An exemplary process of generating sample input images and their corresponding decomposition images is described in the following with reference to
As is illustrated in
Since in the exemplary embodiment, X-rays are used for generating the volumetric image data set 26, the volumetric image data show three-dimensional attenuation structures of an X-ray attenuation, such as the attenuation structure 28 (shown in
where x and y are coordinates on the detector, Ix,y is the intensity at the coordinates y and y and I0 is the intensity which is incident on the patient's body. Equation 1 assumes that the effect of beam spreading is negligible. Equation 1 can be adapted to configurations where the effect of beam spreading is not negligible. Thereby, the values of the line integral μx(x,y) on the detector represent an absorbance distribution in the image plane of the projection image. As such, based on the volumetric image data, a simulated projection image can be obtained from the volumetric image data set 26 using a ray casting algorithm.
As is illustrated in
The voxels of the three-dimensional scattering structure 28 may be determined using a segmentation of the volumetric image data set 26. The segmentation may be automatic or semi-automatic. In particular, the data processing system (denoted with reference numeral 6 in
Further, in a similar manner, simulated decomposition images of a plurality of further body portions, such as the rib cage and the lobes of the lung, can be obtained. In addition to these decomposition images, a further decomposition image which relates to all remaining portions of the body may be generated so that plurality of decomposition images are obtained, which cover each voxel in the volumetric data set 26 which has been traversed by X-rays.
Accordingly, for each point x, y on the detector screen, a pixel-wise sum of the absorbance distributions of the simulated decomposition images μs,i(x, y) (i=1, . . . n) yields the absorbance distribution of the simulated radiograph of the chest μs(x, y):
μs(x,y)=Σi=1nμs,i(x,y) Equation 2.
In the process 100 which is illustrated in
The decomposition of the sample input image (step 120 in
μs(x,y)=Σi=1nμd,i(x,y) Equation 3.
However, a deviation of the condition defined by Equation 3 by less than a preset level can still be regarded as acceptable in the assessment of accuracy in step 150 of
Additionally or alternatively, the determination of whether the accuracy of the decomposition is acceptable (step 150 in
The decomposition algorithm of the second exemplary embodiment is configured to perform the deposition depending on one or more further projection images. The first projection image and the one or more further projection images have mutually different imaging projection axes. The scenario for acquiring the projection images in the second exemplary embodiment is illustrated in
By way of example, the first imaging projection axis P1 and the second imaging projection axis P2 are angled relative to each other by about 10 degrees. In the first projection image, a portion of the heart is obstructed by ribs, whereas in the second projection image, this portion of the heart is not obstructed by ribs, allowing a finer analysis of the obstructed portion shown in the first projection image.
The decomposition of the projection image according to the second exemplary embodiment allows for a more reliable and a more precise decomposition of the first projection image. Furthermore, although multiple projection images are used by the data processing system, there is still a much lower radiation dose delivered to the patient, compared to conventional CT scans.
It is further to be noted that the orientation of the protection axes P1 and P2, as shown in
It has been shown that thereby, a system and a method is provided which allows for a more efficient diagnosis based on medical projection images.
The present disclosure relates to the following embodiments:
Item 1: A system for image decomposition of an anatomical projection image, the system comprising a data processing system (6) which implements a decomposition algorithm configured to: read projection image data representing a projection image generated by irradiating a part of a subject with imaging radiation; wherein a body portion within the irradiated part is a three-dimensional attenuation structure of an attenuation of the imaging radiation, wherein the attenuation structure represents a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure; wherein the data processing system (6) is further configured to decompose the projection image using the classification of the attenuation structure; and wherein the decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion in the irradiated part to the projection image, wherein the further body portion at least partially overlaps with the classified body portion in the projection image.
Item 2: The system of item 1, wherein the attenuation structure is an anatomically and/or functionally defined portion of the body.
Item 3: The system of item 1 or 2, wherein the decomposition of the projection image includes determining, for the projection image, a contribution image which is indicative of the contribution of the classified body portion to the projection image.
Item 4: The system of any one of the preceding items, wherein the decomposition of the projection image comprises generating a plurality of decomposition images (16, 17) , each of which being indicative of a two-dimensional absorbance distribution of the imaging radiation; wherein for each point in the image plane, a sum of the absorbance distributions of the decomposition images corresponds to an absorbance distribution of the projection image within a predefined accuracy.
Item 5: The system of any one of the preceding items, wherein the decomposition algorithm includes a machine learning algorithm for performing the decomposition of the projection image using the classification of the body portion.
Item 6: The system of item 5, wherein the machine learning algorithm includes an artificial neural network (ANN).
Item 7: The system of item 5 or 6, wherein the data processing system is configured to train the machine learning algorithm using volumetric image data.
Item 8: The system of item 7, wherein the data processing system is configured for semi-automatic or automatic segmentation of a portion of the volumetric image data representing the body portion, which is to be classified, from the volumetric image data and to calculate a simulated projection image of the segmented portion of the volumetric image data.
Item 9: The system of any one of the preceding items, wherein the data processing system is further configured to decompose the projection image depending on one or more further projection images, each of which being a projection image showing the classified body portion; wherein the projection images have mutually different projection axes.
Item 10: A method for image decomposition of an anatomical projection image using a data processing system (6) which implements a decomposition algorithm, the method comprising: reading (250) projection image data representing a projection image generated by irradiating a part of a subject with imaging radiation; wherein a body portion within the irradiated part is a three-dimensional attenuation structure of an attenuation of the imaging radiation, wherein the attenuation structure represents a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure; decomposing (260) the projection image using the classification of the attenuation structure; wherein the decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion in the irradiated part to the projection image, wherein the further body portion at least partially overlaps with the classified body portion in the projection image.
Item 11: The method of item 10, further comprising training (240) the decomposition algorithm.
Item 12: The method of item 11, wherein the training (240) of the decomposition algorithm is performed using volumetric image data.
Item 13: The method of item 12, further comprising segmenting (220) the body portion to be classified from the volumetric image data and calculating (230) a projection image of the segmented body portion.
Item 14: A program element for image decomposition of an anatomical projection image, which program element, when being executed by a processor, is adapted to carry out: reading (250) projection image data representing a projection image generated by irradiating a part of a subject with imaging radiation; wherein a body portion within the irradiated part is a three-dimensional attenuation structure of an attenuation of the imaging radiation, wherein the attenuation structure represents a member of a predefined class of attenuation structures of the decomposition algorithm, thereby representing a classification of the attenuation structure; decomposing (260) the projection image using the classification of the attenuation structure; wherein the decomposition of the projection image decomposes between a contribution of the classified body portion to the projection image and a contribution of a further body portion in the irradiated part to the projection image, wherein the further body portion at least partially overlaps with the classified body portion in the projection image.
Item 15: A computer readable medium having stored the computer program element of item 14.
The above embodiments as described are only illustrative, and not intended to limit the technique approaches of the present invention. Although the present invention is described in details referring to the preferable embodiments, those skilled in the art will understand that the technique approaches of the present invention can be modified or equally displaced without departing from the protective scope of the claims of the present invention. In particular, although the invention has been described based on a projection radiograph, it can be applied to any imaging technique which results in a projection image. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. Any reference signs in the claims should not be construed as limiting the scope.
Number | Date | Country | Kind |
---|---|---|---|
18152355.6 | Jan 2018 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2019/050359 | 1/9/2019 | WO | 00 |