The invention provides a computer-implemented method for image-processing of CT images, a method comprising the method for image processing, a data processing system, a system comprising the data processing system, a computer program product, and a computer readable medium.
While edge-preserving denoising allows for providing classic image texture and appearance by removing noise while preserving the underlying image details, it may lead to increased number of spikes, particularly when the noise distribution has a heavy tail. Heavy-tailed noise occurs in many situations, among others, in CT Photon Counting (PhC) systems and low does CT scans. More specifically, Photon Counting CT systems leverage direct conversion detector technology to acquire data at multiple energy levels. Therefore, such systems have the potential to provide more details and allow a more detailed quantification of the different x-ray interactions including photoelectric effect, Compton scattering and k-edge energy component.
Such system may also have improved signal to noise ratio (SNR) with respect to integrating detectors.
The noise on CT images is inversely proportional to the square root of the mean photon number. When the signal amplitude from electronic noise is of a magnitude comparable to that from the detected photons, the contributions to the signal from electronic noise become significant.
One of the advantages of the Photon Counting detector is that it significantly reduces electronic noise. This allows the dose to be reduced.
The improved SNR also allows for improved tissue differentiation and/or material labelling, and improved quantitative imaging with CT systems, and enables novel imaging techniques, e.g., k-edge imaging and reduction of beam hardening artifacts.
However, as briefly mentioned above, a challenge posed by PhC is the heavy-tailed noise characteristic.
For context, the concept of heavy-tailed noise is briefly outlined below. Noise may often only have an approximately Gaussian distribution. Specifically, even when the center of the distribution is approximately Gaussian, the tails may not be. The tails of a distribution are the areas of the density corresponding to large distribution arguments. Heavy tails mean that for large values of the density argument, the density approaches zero more slowly than the Gaussian.
Heavy-tailed noise characteristics lead to increased spike occurrence after denoising, particularly at low doses.
Addressing this issue by removing spikes often does not yield satisfactory results, as there are too many false-positive spike identifications, leading to actual texture and/or contrast getting lost, and accordingly, to artificially smooth surfaces that lack detail.
Therefore, it is an object of the invention to alleviate some of the problems outlined above, in particular to allow for improved image quality even in the context of challenging CT imaging scenarios, like PhC systems and low doses.
The invention provides a computer-implemented method for image-processing of CT images, a method comprising the method for image-processing, a data processing system for performing for image-processing of CT images, a system comprising the data processing system, a computer program product, and a computer readable medium according to the independent claims. Preferred embodiments are laid down in the dependent claims.
The invention provides a computer-implemented method for image-processing of CT images. The method comprises performing one or more pre-processing steps on a CT image so as to obtain a pre-processed CT image, wherein the one or more pre-processing steps comprise applying an edge-preserving denoising algorithm. The method further comprises performing an adaptive spike suppression algorithm on the pre-processed CT image to obtain a processed CT image. The adaptive spike suppression algorithm may, in particular, be an algorithm configured such that the processed CT image has a reduced number of spikes as compared to the pre-processed CT image.
The claimed method, due to performing spike suppression in an adaptive manner and on previously denoised image data with denoising that is edge preserving, allows for solving at least one of the above problems.
The claimed method allows for significant noise reduction, for example even up to equivalent 90% dose reduction, while effectively suppressing spike noise and maintaining texture.
The latter may provide classic CT image texture and appearance, e.g., avoid images having a plastic or artificial appearance. As such, the method renders results that are compatible with present procedures that rely on the classic CT image texture.
Denoising the data in the pre-processing step increases the signal to noise ratio of the spikes, which makes it is easier to identify and remove spikes.
The present disclosure provides an adaptive denoising algorithm. In other words, the algorithm performs adaptive spike noise suppression (aSNS).
The method according to the present disclosure allows and is suitable for denoising in PhC systems and low dose CT scans, particularly for providing significant noise reduction and suppression of spike noise, while maintaining image texture.
An adaptive algorithm means that a model used for the processing of the images may be adapted for each processed image depending on a determination as to whether the model meets certain criteria.
Any edge-preserving denoising algorithm known in the art may be applied in the pre-processing steps, for example, Philips iDose algorithm. Applying the denoising algorithm may comprise using a bilateral filter to fit data to linear or quadratic models. This allows for reliable removal of spikes and noise while preserving edges and texture.
As specified above, the term “spike suppression” refers to a reduced number of spikes in the processed image as compared to the pre-processed image. Pre-processing of images increases the signal to noise ratio (SNR) of spikes of the input CT image. The spike-reduction particularly aids in removing these spikes. The processed image may have, but does not necessarily have, a reduced number of spikes as compared to the image prior to pre-processing.
The CT images in the present disclosure may be photon counting CT images, particularly multiple-energy-level CT images.
The adaptive spike suppression algorithm may comprise fitting a model, in particular a linear model, for a three-dimensional neighborhood of a voxel of the pre-processed image.
This allows for reliable spike removal while preserving sharp edges.
Performing the adaptive spike suppression algorithm may comprise qualifying the model, for example the linear model. Qualifying the model may comprise checking whether the model meets one or more predetermined criteria. Performing the adaptive spike suppression algorithm may further comprise, in response to determining that the model does not meet the one or more predetermined criteria, adapting one or more model parameters of the model to obtain a modified model.
The above allows for applying the method under a wide range of different conditions, e.g., a wide range of input images, while still ensuring quality of results. Where the initial model is not suitable for a given condition, the features of the present disclosure allow for adjusting the model.
The criteria may comprise, for example that a voxel weight does not exceed a predetermined threshold and/or does not exceed weights of closest neighbor voxels by more than a predetermined amount and/or that the average weight of central voxels does not exceed a predetermined threshold.
Performing the spike suppression algorithm may comprise repeating the steps of qualifying the modified model and adapting one or model parameters until the modified model meets the predetermined criteria.
In other words, the model can be iteratively improved until it yields acceptable results. Such an iterative procedure allows for avoiding overcompensation when adapting the model, which would potentially lead to a model meeting the predetermined criteria, yet may at the same time result in loss of texture and/or contrast.
Performing the spike suppression algorithm may further comprise, in particular in response to determining that the model or the modified model meets the predetermined criteria, applying the model or the modified model for the voxel. That is, in response to determining that the model meets the predetermined criteria, the model may be applied for the voxel and/or, in response to determining that the modified model meets the predetermined criteria, the modified model may be applied for the voxel.
In other words, the voxel value will be corrected if necessary, i.e., if the voxel, based on the model, is determined to be part of a spike. This step may be performed for a plurality, in particular all, of the voxels in a sub-region of the image or the entire image. Thus the image will have a reduced number of spikes.
In the present disclosure, fitting the model may comprise, for each voxel, determining, for each of a plurality of closest-neighbor voxels, a weight factor, in particular, the weight factor incorporating at least one of a weight based on spatial distance between the voxel and the closest-neighbor voxel and a weight based on value-distance between the voxel and the closest-neighbor voxel. This allows for reliable identification and removal of spikes.
As mentioned above, in the present disclosure, performing the adaptive spike suppression algorithm may comprise qualifying the model and qualifying the model may comprise checking whether the model meets one or more predetermined criteria. Checking whether the model meets one or more predetermined criteria may comprise checking whether a/the weight factor of one or more voxels is within a predetermined range, in particular, remains below a predetermined threshold. Alternatively or in addition, checking whether the model meets one or more predetermined criteria may comprise checking whether a/the weight of one or more voxels exceeds the weight of the closest neighbor voxels by more than a predetermined amount and/or whether a/the average weight of several central voxels is within a predetermined range, in particular, remains below a predetermined threshold.
The above allows for reliably determining whether the model needs further adapting.
In the present disclosure, applying the model may comprise, for each voxel, performing weighted averaging using a/the weight factor or weight factors determined for each of a plurality of closest-neighbor voxels. This allows for reliable removal of spikes.
In the present disclosure, fitting the model for a three-dimensional neighborhood of a voxel of the pre-processed image may be performed using a filter and adapting one or more model parameters may comprise adapting filter parameters. This allows for reliable removal of spikes and noise while preserving edges and texture.
Adapting one or more model parameters may comprise adapting a parameter that determines aggressiveness of the weights, in particular adapting the parameter that determines aggressiveness of the weights so as to increase the aggressiveness of the weights.
The aggressiveness of the weights determines how sensitive the model is when it comes to identification of a spike. That is, with higher aggressiveness, more voxels will be identified as spikes and the overall image will be smoother after spike removal. Adjusting the aggressiveness allows for modifying the model so as to maintain texture while removing spikes reliably.
Alternatively or in addition, adapting one or more model parameters may comprise adapting a parameter that controls spatial weights, in particular adapting the parameter that controls spatial weights so as to increase the spatial weights.
Alternatively or in addition, adapting one or more model parameters may comprise adapting a parameter that determines the number of closest-neighbor voxels, in particular adapt the parameter that determines the number of closest-neighbor voxels so as to increase the number of closest-neighbor voxels.
Optionally, adapting one or more model parameters may comprise iteratively increasing the aggressiveness of the weights and/or iteratively increasing the spatial weights and/or iteratively increasing the number of closest-neighbor voxels. This allows for efficiently approaching model parameters that allow for reliably removing spikes and maintaining texture.
In the present disclosure, a/the weight based on spatial distance between the voxel Vi,j,k and the closest-neighbor voxel may, for example, be determined as follows:
Alternatively or in addition, in the present disclosure, a/the weight based on value-distance between the voxel Vi,j,k and the closest-neighbor voxel may be determined as follows:
In the present disclosure, applying the model may comprise applying weighted averaging as follows:
The present disclosure also provides a method comprising the method for image-processing according to the present disclosure.
The method may further comprise capturing the CT image by means of a photon counting CT imaging system, in particular by means of a low-dose CT scan. The CT imaging system may be a CT imaging system that detects radiation at multiple different energy levels.
Alternatively or in addition, the method may further comprise storing the processed CT image on a storage device and/or outputting the processed CT image, in particular on a display device. As such, the processed CT image can be used by computing components and/or by a user. For example, a computing component may access the processed CT image on the storage device for use in image-guided navigation and/or for computerized image recognition methods. Alternatively or in addition, a user may view the processed CT image on the display device for use in image-guided navigation and/or visual analysis.
Alternatively or in addition, the method may comprise using the processed CT image for image-guided navigation and/or for computerized image recognition methods.
A processed CT image according to the present disclosure will yield better results in all of these use cases, as spikes have been reliably removed and texture maintained.
The present disclosure also provides a data processing system configured to perform one or more pre-processing steps on a CT image so as to obtain a pre-processed CT image, wherein the one or more pre-processing steps comprise applying an edge-preserving denoising algorithm. The data processing system is further configured to perform an adaptive spike suppression algorithm on the pre-processed CT image to obtain a processed CT image. The adaptive spike suppression algorithm may, in particular, be configured such that the processed CT image has a reduced number of spikes as compared to the pre-processed CT image. In particular, the data processing system may be configured to carry out any of the method steps for image-processing of CT images of the present disclosure. In the context of the method steps, reference is made to the above disclosure and the method claims.
The present disclosure also provides a system comprising the data processing system of the present disclosure. The system may further comprise a CT imaging system configured to capture a/the CT image or images, in particular, wherein the CT imaging system is a photon counting CT imaging system. As mentioned above, the spike removal is particularly advantageous for photon counting CT images, which may otherwise yield poor image quality.
Alternatively or in addition, the system may comprise a display device configured to output the processed CT image. As mentioned above, this allows for a user to view the processed CT image on the display device, e.g., for use in image-guided navigation and/or visual analysis.
The present disclosure also provides a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the steps of performing one or more pre-processing steps on a CT image so as to obtain a pre-processed CT image, wherein the one or more pre-processing steps comprise applying an edge-preserving denoising algorithm, and performing an adaptive spike suppression algorithm on the pre-processed CT image to obtain a processed CT image. The adaptive spike suppression algorithm may, in particular, be configured such that the processed CT image has a reduced number of spikes as compared to the pre-processed CT image.
In particular, the instructions, when the program is executed by the computer, may cause the computer to carry out any of the methods for image-processing of CT images of the present disclosure.
The present disclosure also provides a computer readable medium comprising instructions which, when executed by a computer, cause the computer to carry out the steps of performing one or more pre-processing steps on a CT image so as to obtain a pre-processed CT image, wherein the one or more pre-processing steps comprise applying an edge-preserving denoising algorithm, and performing an adaptive spike suppression algorithm on the pre-processed CT image to obtain a processed CT image. The adaptive spike suppression algorithm may, in particular, be configured such that the processed CT image has a reduced number of spikes as compared to the pre-processed CT image.
In particular, the instructions, when executed by the computer, may cause the computer to carry out any of the methods for image-processing of CT images of the present disclosure.
The features and advantages outlined in the context of the method for image processing similarly apply to the method comprising the method for image processing, the data processing system, the system comprising the data processing system, the computer program product, and the computer readable medium of the present disclosure.
Further features, examples, and advantages will become apparent from the detailed description making reference to the accompanying drawings.
The method comprises the step S1 of performing one or more pre-processing steps to obtain a pre-processed image, more specifically, applying an edge-preserving denoising algorithm, for example Philips iDose algorithm. This algorithm, in order to remove noise, employs a model fitter that fits local structures to linear (constant) or nonlinear models. It allows for removing noise while preserving the underlying image details.
An example for such an edge-preserving denoising is provided below in the context of
The method further comprises the step S2 of performing an adaptive spike suppression algorithm on the pre-processed CT image to obtain a processed image. The adaptive spike suppression algorithm may be configured such that the processed CT image has a reduced number of spikes as compared to the pre-processed CT image.
An example of an adaptive spike suppression is provided below in the context of
The data processing system may, in particular, be configured to carry out any of the image processing methods of the present disclosure. The data processing system may be a computing device or it may be a distributed system of interconnected computing devices, optionally including cloud devices.
The system 1 shown in
The system 1 shown in
If the system comprises a CT imaging system 3 and a display device 4, as shown in
The data connections 5, 6, and 7 may each be wired connection or wireless data connections.
It is to be understood that the system need not comprise all of the above components and may comprise components not described above.
An example for adaptive spike suppression according to the present disclosure, which is applied on pre-processed, i.e., denoised, image data, obtained for example after applying iDose, is described below making reference to the flowchart shown in
As mentioned above, since the data is denoised, the signal to noise ratio of the spikes is higher and it is easier to identify and remove spikes. The adaptive spike suppression is also referred to as Adaptive Spike Noise Suppression (aSNS) hereinbelow. It is to be understood that the above steps are exemplary steps for illustrative purposes only.
As can be seen from the flow chart in
Examples for each of the components are presented below. Each of the components below is an exemplary component for illustrative purposes only.
The Linear Model Fitter component may be configured as follows. For each voxel Vik of the volume, weight factors for N closest neighbors are determined based on Equation 1:
The weights wspatiali′,j′,k′ for neighboring voxels according to their spatial distance can be determined based on Equation 2:
The Model Qualifier component may analyze the obtained weights Wyw to determine whether the model meets predetermined criteria. If the central voxel weight exceeds a predetermined threshold or exceeds the weights of closest neighbors by more than a predetermined amount or the average weight of central voxels exceeds a threshold, this may indicate that adaption of the model is required. For example, when a central voxel weight significantly exceeds the weights of the closest neighbors, this means that the voxel does not have sufficient support from neighboring voxels. If the model does not meet the criteria, the method proceeds to the step of adapting model parameters, e.g., by means of the Adapt Model Parameters component. Otherwise, the model is applied, e.g., by means of the Model Applier component.
The Adapt Model Parameters component may adapt the model by changing, particularly increasing, one or more of the following parameters:
It is noted that, according to the present disclosure, after adapting the model parameters, the Model Qualifier component may again qualify the adapted model. These steps of adapting and qualifying the model may be repeated until the Model Qualifier component determines that no more adaption is required. Subsequently, the model may be applied, e.g., by the Model Applier component.
The Model Applier component may apply the model by applying weighted averaging as shown in Equation 4:
A flowchart of an exemplary denoising algorithm that may be used for pre-processing the CT image according to the present disclosure is illustrated in
In the following, three examples illustrating the effect of the method of the present disclosure will be described, each illustrated in the
As an example for identifying a spike and its intensity, a Spike Threshold may be defined. To do so, for example, the median Q2, the first quartile Q1 and the third quartile Q3 may be determined and the interquartile range IQR=Q3−Q1 may be calculated for the square area. The spike threshold might then be defined as Spike Threshold Q=Q3−Q2+1.5*IQR for positive spike values, and Spike Threshold=Q2−Q1+1.5*IQR for negative spike values.
Any pixels wherein abs (Pixel Value−Local Median)>Spike Threshold, may be identified as a spike and the spike intensity may be defined as abs (Pixel Value−Local Median), wherein the Local Median may be calculated as a median in a 5×5 square of pixels.
The results of the three examples are summarized in Table 1 below, which shows that the spike suppression suppressed the number of spikes by 91-94% and suppressed the average of spike intensity by 19-36%.
Thus, it can be seen, both, from the images and the calculation, that the number of spikes and their intensity are noticeably improved.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered exemplary and not restrictive. The invention is not limited to the disclosed embodiments. In view of the foregoing description and drawings it will be evident to a person skilled in the art that various modifications may be made within the scope of the invention, as defined by the claims.
Number | Date | Country | Kind |
---|---|---|---|
21216190.5 | Dec 2021 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/086431 | 12/16/2022 | WO |