The current invention generally relates to an image processing method and system for substantially removing dot noise that is the remaining noise after some noise reduction processing in images of various modalities.
Dot noise is undesirably visible in the processed images. Dot noise usually is not always an outstanding single pixel, but includes a cluster of a small number of pixels that have noise values. In general, dot noise visually resembles salt-pepper noise and speckle noise, but dot noise is generated from a different origin.
Mostly, dot noise undesirably results from imperfect noise reduction. Due to predefined criteria, some outstanding noise peaks may be mistreated as signals and are either preserved or even enhanced. For these reasons, some outstanding noise peaks become more apparent in the noise reduced image than in an unprocessed image where they reside in a mass of other noisy pixels.
Dot noise is not easily removed by using conventional noise removing techniques such as a medial filter and a smoothing filter. One exemplary prior art noise removing technique is z-score method for detecting signal and removing outlier. Although z-score method may work on certain types of image noise such as salt-pepper noise and speckle noise, the use of Z-score alone may not be effective to dot noise removal.
In view of the prior art dot noise removal techniques, a method and a system of reliably removing dot noise is still desired.
According to one embodiment of the current invention, one technique performs noise removal on signals based upon pseudo-standard deviation (PSD). The embodiment of the current inventions performs noise removal on signals based upon Z-score. In general, the current invention includes both uniform and non-uniform kernels.
For the non-uniform kernels, the only requirement is that the sum of all elements is one. For example, non-uniform kernels include Gaussian kernel, triangle kernel, trapezoidal kernel, Hann kernel, Humming kernel, etc. Non-uniform kernels in which values of the elements are optionally selected based on their application needs.
The use of processed data has some practical advantages over the measured data according to some aspects of the current invention. Since the processed data such as images generally have pixel values and are not limited by the input devices such as detectors, the image data are more general and versatile than the measured data. At least for these reasons, the use of the processed data in the image domain is advantageous in implementing a fully automatic and functionally simple noise removal method. On the other hand, the current invention is not limited to using the processed data or the image data and is implemented using the measured data or the projection data.
Referring now to the drawings, wherein like reference numerals designate corresponding structures throughout the views, and referring in particular to
The multi-slice X-ray CT apparatus further includes a current regulator 113 and a high voltage generator 109 that applies a tube voltage to the X-ray tube 101 so that the X-ray tube 101 generates X ray. In one embodiment, the high voltage generator 109 is mounted on the frame 102. The X rays are emitted towards the subject S, whose cross sectional area is represented by a circle. The X-ray detector 103 is located at an opposite side from the X-ray tube 101 across the subject S for detecting the emitted X rays that have transmitted through the subject S.
Still referring to
The above described data is sent to a preprocessing device 106, which is housed in a console outside the gantry 100 through a non-contact data transmitter 105. The preprocessing device 106 performs certain corrections such as sensitivity correction on the raw data. A storage device 112 then stores the resultant data that is also called projection data at a stage immediately before reconstruction processing. The storage device 112 is connected to a system controller 110 through a data/control bus, together with a reconstruction device 114, a display device 116, an input device 115, and a scan plan support apparatus 200. The scan plan support apparatus 200 includes a function for supporting an imaging technician to develop a scan plan.
One embodiment of the current invention further includes a combination of various software modules and hardware components for implementing a noise removal device 117. In the current application, the noise removal device 117 performs predetermined functions for noise removal including dot noise removal, and the functions are associated with determining a noise index such as pseudo-standard deviation (PSD) or Z-score, comparing the noise index and adjusting the pixel values if necessary. Either one of PSD and Z-score of a given pixel is used as a noise index to determine as to whether or not the pixel value needs to be adjusted. PSD and Z-score will be further described in the current application with respect to the noise removal techniques according to the current invention.
The noise removal device 117 is connected to the reconstruction device 114 and the storage device 112 via the data/control bus. The reconstruction device 114 reconstructs an image or generates image data based upon the projection data that is optionally stored in the storage device 112. The projection data is generated from measured data via the data acquisition circuit or the Data Acquisition System (DAS) 104 and the processing device 106. The measured data or signals in turn are detected at the X-ray detector 103. For the purpose of the current application, the term, data such as in image data and measured data is interchangeably used with the term signal such as in image signal and measured signal. The term, signal itself broadly includes both image data and measured data.
In one embodiment, the noise removal device 117 receives the reconstructed image data from the reconstruction device 114 and or the storage device 112 in order to perform the tasks on the image data for substantially removing noise such as dot noise by adjusting pixel values. As described above, since the reconstructed image is in the image domain after reconstruction, the noise removal device 117 is advantageously free from additional processing or limitations that are necessary for further processing measured data in a noise index determination.
In another embodiment, the noise removal device 117 receives the measured data from the reconstruction device 114 and or the storage device 112 in order to perform the tasks on the measured data for determining the PSD as a noise index. As described above, since the measured data is in the data domain before reconstruction, the noise removal device 117 is not necessarily free from additional processing or limitations for further processing the measured data in the noise index determination.
In either embodiment, the noise removal device 117 performs a predetermined set of tasks on the received signals in determining a noise index such as PSD and calculates the associated Z-score. The automatic process or method is optionally controlled according to a predetermined set of parameters such as a threshold value or a scaling factor for removing undesirable noise such as dot noise. Furthermore, the parameters also include a size or characteristics of a kernel for filtering the signals or data in determining PSD as a noise index. The above described parameters are illustrative only and are not limited to the enumerated specific examples.
Now referring to
Now referring to
Still referring to
Now referring to
I(x,y)=I0(x,y)+n(x,y) (1)
where I0 is an original data or true signal and n is noise that has been added to the original image due to various sources. x and y are the 2D coordinates of a pixel. The steps involved in the flow chart of
where represents convolution operator and w(u, v) is a normalized uniform moving average kernel. The moving average inside brackets calculates the mean value of each pixel neighborhood while the one outside the brackets calculates the neighborhood averages of the mean-square-errors (MSE). Notice that the MSEs are calculated by subtracting the filtered samples instead of subtracting the single average value of the samples as standard deviation formulas normally do. The PSD approaches the “true” standard deviation when the assumptions to (1) are valid. PSD is used to improve computational efficiency of direct calculation of standard deviation (SD). Furthermore, to assure accurate noise assessment, multiple passes of above procedure are optionally performed in certain exemplary methods and systems of the current invention.
Still referring to
In contrast, referring to
In summary, the advantage of using the PSD over the normal SD is that PSD may reflect noise SD more accurately by not taking the edge variation as part of the standard deviation component. The PSD approaches the SD in the regions where image has constant or slow varying mean values.
Now referring to
Dot noise is usually not a single outstanding pixel. In this regard, dot noise is often a cluster or a small number of pixels. By selecting a proper size of neighborhood, the dot noise pixels become sufficiently identifiable as outstanding pixels. After identifying the dot noise pixels, the dot noise pixels are optionally reset to the predetermined local mean value. As a result, only the outliers of the dot noise pixels are modified and other pixel values are unchanged.
According to one exemplary process using a PSD approach for substantially removing noise including dot noise according the current invention, one implemented procedure includes the following steps. In a step S200, image volume V is inputted to be processed, and the inputted image volume is often not free from noise including dot noise. In a first implementation of a step S210, mean image volume Vm is determined based upon a predetermined convolution kernel h of a size such as 3×3×3 pixels as defined in the following equation.
Vm=Vh (3)
In the first implementation of a step S220, a difference image Vdiff is determined by subtracting the mean image volume Vm from a corresponding potion of the image volume V in the following equation.
Vdif=V−Vm (4)
The above determined difference image Vdiff is squared to generate squared difference image Vsq in a step S230 in the following equation.
Vsq=Vdif2 (5)
A PSD value is determined by taking a root square after the squared difference image Vsq is convoluted again with a predetermined convolution kernel h in a step S240 in the following equation.
The predetermined convolution kernel h in the step S240 is optionally the same as the predetermined convolution kernel h in the step S210 in a certain implementation. Alternatively, the predetermined convolution kernel h in the step S240 is optionally different from the predetermined convolution kernel h in the step S210 in another implementation. The PSD value is thus determined for a pixel at (x, y).
The above determined PSD value is scaled by a predetermined threshold value r to generate rPSD, and the scaled rPSD value is compared to a corresponding difference image Vdiff in a step S250. The predetermined threshold value r is specifically determined for substantially identifying dot noise rather than general noise. One exemplary predetermined threshold value r is 2 for substantially identifying dot noise. If the scaled rPSD value for a pixel at (x, y) is larger than the corresponding difference image Vdiff, the corresponding mean image volume Vm at the pixel (x, y) is outputted in a step S260. On the other hand, if the scaled rPSD value is equal to or smaller than the corresponding difference image Vdiff, the image volume V at the pixel (x, y) is outputted in the step S260.
The above described particular implementations are merely exemplary, and the current invention is not necessarily limited by the exact manner or steps as disclosed. For example, the PSD approach and the punctured approach are each optionally modified or combined with another approach or with each other.
Now referring to
z=(x−μ)/σ (6)
where x is the center pixel of a pixel neighborhood, is the mean of the neighborhood, and σ is the standard deviation (SD). It is determined as to whether or not the pixel value x is within a normal range by comparing the Z-score value of x to a preset ratio or threshold value (R) such as 2. If the Z-score value of x is below the preset ratio or threshold value (R) such as 2, the pixel x is not considered as an outlier and thus is not a noise pixel. On the other hand, if the Z-score value of x is outside of the a preset ratio or threshold value (R) such as 2, the pixel x is considered as an outlier and thus is some noise such as dot noise if the R is 2.
Dot noise is usually not a single outstanding pixel. In this regard, dot noise is often a cluster or a small number of pixels. By selecting a proper size of neighborhood, the dot noise pixels become sufficiently identifiable as outstanding pixels. After identifying the dot noise pixels, the dot noise pixels are optionally reset to the predetermined local mean value. As a result, only the outliers as dot noise pixels are modified and other pixel values are unchanged.
According to one exemplary process using a Z-score based the punctured approach for substantially removing noise including dot noise according the current invention, a center pixel is excluded in calculating a local mean value and a PSD in order to avoid the effect of a possible outlier to the mean and or SD calculation. In some details, one implemented procedure includes the following steps. In a step S100, image volume V is inputted to be processed, and the inputted image volume is often not free from noise including dot noise.
In a first implementation of a step S110, mean image volume Vm is determined based upon a predetermined mask size such as 3×3×3 pixels without using a central or reference pixel value in the predetermined mask. In other words, the predetermined mask selects neighborhood pixels. In the first implementation of the step S120, standard deviation σ is determined using the pixels in the selected neighborhood without using the central or reference pixel value. Based upon the above determined mean Vm and the standard deviation σ, a Z-score is determined for the central or reference pixel in the selected neighborhood according to Equation (6) in the first implementation of a step S130. The Z-score for the central or reference pixel is compared to a predetermined threshold value r in a step S140. The predetermined threshold value r is specifically determined for substantially identifying dot noise rather than general noise. One exemplary predetermined threshold value r is 2 for substantially identifying dot noise. If the Z-score for the central or reference pixel is larger than the predetermined threshold value, the central or reference pixel value is replaced by the mean value Vm in a step S150. On the other hand, if the Z-score for the central or reference pixel is equal to or smaller than the predetermined threshold value, the central or reference pixel value is unchanged in the step S150.
In another implementation, the punctured approach is used with PSD. In this implementation, convolution becomes explicit iterative calculations pixel by pixel. Since the kernel size is not large, the above calculation does not appear to increase the computational cost in a significant manner. For uniform kernel h, Equations (3) through (5) are optionally modified by extracting neighborhood of V so that V2=V̂2.
Vm=mean (extracted neighborhood), ignoring a center pixel of the neighborhood;
Vm2=Vm̂2;
V2m=mean (extracted neighborhood of V2), ignoring a center pixel;
Now referring to
Now referring to
It is to be understood, however, that even though numerous characteristics and advantages of the present invention have been set forth in the foregoing description, together with details of the structure and function of the invention, the disclosure is illustrative only, and that although changes may be made in detail, especially in matters of shape, size and arrangement of parts, as well as implementation in software, hardware, or a combination of both, the changes are within the principles of the invention to the full extent indicated by the broad general meaning of the terms in which the appended claims are expressed.