The present invention relates to a radiation imaging apparatus and a radiation imaging system.
There are widely used radiation imaging apparatuses including a flat type sensor panel having pixels arranged thereon in an array, the pixels being formed of a combination of photoelectric conversion elements and switching elements. Japanese Patent Laid-Open No. 2002-026302 describes using a fluorescent plate to convert incident radiation into light that can be detected by an imaging element formed on a semiconductor substrate.
There is a case where radiation transmits through a scintillator (fluorescent plate) without being converted into light that can be detected by an imaging element and, upon being incident on the imaging element, generates an electron-hole pair in the imaging element that received the incident radiation. Generation of the electron-hole pair may cause a bright spot pixel having an abnormally higher signal value than other pixels in the acquired image data. Such bright spot pixels appear at random as dots, both temporally and spatially.
Bright spot pixels, which occur at random while capturing and observing a video image, such as in fluoroscopic imaging, are annoying but may turn out to be negligible when observing an object. On the other hand, respective pixels on a sensor panel in a radiation imaging apparatus exhibit variation in operating characteristics for each pixel, and therefore a gain map is generated based on the image data acquired by irradiating radiation without placing an object, and a gain correction process is performed thereafter. In a case where bright spot pixels have mixed in the image data when generating the gain map, the bright spot pixels may affect the image data subjected to the gain correction process using the gain map having bright spot pixels mixed therein. Although it is necessary to reduce the effect of bright spot pixels in generation of the gain map, the demand for capturing and displaying an image (gain map generation) in real time may decrease in comparison with imaging for observing the object.
Some of the embodiments of the present invention provide an advantageous technique for reducing the effect of bright spot pixels in a radiation imaging apparatus.
According to some embodiments, a radiation imaging apparatus comprising: a scintillator; a plurality of pixels configured to respectively detect light converted by the scintillator from radiation; and a corrector configured to perform a correction process on signal data based on signals output from the plurality of pixels, wherein the corrector is configured to perform a first correction process for acquiring a gain map for gain correction without placing an object, and a second correction process including gain correction using the gain map, and correction processes performed on dotted noise that occur at random both temporally and spatially are different for the first correction process and the second correction process, is provided.
Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings).
Hereinafter, embodiments will be described in detail with reference to the attached drawings. Note, the following embodiments are not intended to limit the scope of the claimed invention. Multiple features are described in the embodiments, but limitation is not made to an invention that requires all such features, and multiple such features may be combined as appropriate. Furthermore, in the attached drawings, the same reference numerals are given to the same or similar configurations, and redundant description thereof is omitted.
In addition, radiation mentioned in the present invention may include α-rays, β-rays, γ-rays or the like, which are beams formed of particles (including photons) emitted by radioactive decay, and also include beams having a same or higher degree of energy with those beams such as, for example, X-rays, particle beams, or cosmic rays.
Referring to
The radiation imaging apparatus 100 may include a scintillator 105, a sensor array 101 having a plurality of pixels arranged thereon that respectively detect light converted by the scintillator 105 from radiation, and an integrated circuit (IC) 103 configured to control operation or the like of the sensor array 101. Furthermore, the radiation imaging apparatus 100 may include a memory 104. The IC 103, which will be described in detail below, includes a corrector configured to perform a correction process on signal data based on signals output from a plurality of pixels arranged on the sensor array 101.
When capturing a radiation image, an arrangement of the object 150 and the radiation imaging apparatus 100 is first determined so that the radiation 121 irradiated from the radiation source 120 is transmitted through the object 150 and projected on the radiation imaging apparatus 100. The radiation 121, a part of which being absorbed and shielded by the object 150, is incident on the scintillator 105 of the radiation imaging apparatus 100. The scintillator 105 emits light with a luminance corresponding to the radiation amount of the incident radiation 121. Although the sensor array 101 is illustrated in
The sensor array 101 has a plurality of pixels arranged thereon, as described above. Each of the plurality of pixels may include, for example, a photoelectric conversion element that detects light converted by the scintillator 105 from radiation, and a scanning switch for reading signals generated by the photoelectric conversion element. A semiconductor substrate, for example, may be used for the sensor array 101, the substrate having formed thereon a photodiode as the photoelectric conversion element, and a transistor as the scanning switch. In addition, a substrate made of glass or plastic, for example, may be used for the sensor array 101, the substrate having formed thereon a semiconductor layer. The semiconductor layer may have formed thereon a photodiode as the photoelectric conversion element, and a thin film transistor (TFT) as the scanning switch.
Signals for controlling operation of the sensor array 101, such as signals indicating switching of the scanning switch, may be generated by the IC 103 provided within the radiation imaging apparatus 100. With respect to the IC 103, a Field-Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC) or the like may be used therefor. Analog signals output from the sensor array 101 are converted into digital data by an AD converter (ADC) 102 and input to the IC 103. As such, the IC 103 causes the pixels arranged on the sensor array 101 to generate signals, and performs control of signal-reading scan and reception of digital data in parallel. Therefore, it is possible to recognize which position on the sensor array 101 the pixel corresponding to the received digital data is located, and generate image data for displaying a radiation image by aligning the digital data accordingly. The IC 103 may store the image data in a memory 104, or output it to the outside of the radiation imaging apparatus 100 via an image transmission IF 111. The image data output from the image transmission IF 111 is transferred to the image display apparatus 110 via an image reception IF 112, and displayed as a radiation image based on the image data.
For example, video image capturing can be performed by repeating, with a desired period, scanning by the sensor array 101, transfer of image data, and display of radiation image. When capturing a video image, a case is conceivable in which an operator may instruct the object to move, in accordance with the radiation image visually recognized by the operator. In such a case, real time performance is required, and digital data generated by the ADC 102 must be transferred to the image display apparatus 110 in a shorter time.
Restoration of the object image obj from the data obj×gain requires reverse conversion, i.e., division of the modulation process illustrated in
As illustrated in
When capturing an image of the object 150, the signal data (e. g., data obj×gain) subjected to analog-digital conversion by the ADC 102 is transferred to the corrector 301 of the IC 103, where a gain correction process 108 is performed. In the gain correction process 108, the gain map 104g is read from the memory 104 in response to transferring the data obj×gain from the ADC 102 to the corrector 301. Upon the data obj×gain and the gain map 104g corresponding to respective pixels of the sensor array 101 being transferred to the corrector 301, the corrector 301 divides the data obj×aain using the gain map 104g. Accordingly, it is possible to acquire the object image obj, for which modulation by a non-uniform sensitivity characteristics gain has been compensated, as image data. As has been described above, it is required in video image capturing or the like to reduce the time from when signal data is output from the ADC 102 to when it is transferred as image data to the image display apparatus 110. Therefore, the reading speed of the gain map 104g needs to be approximately the same as the speed of reading signal data from the ADC 102, in order to maintain the system operation speed of the radiation imaging system SYS (radiation imaging apparatus 100).
Next, there will be described a method (gain calibration) for acquiring the gain map 104g for gain correction. As has been described above, the signal data acquired from the ADC 102 turns out to be a multiplication of the distribution of the amount of radiation incident on the scintillator 105 (object image obj) and the sensitivity distribution gain of the pixels of the sensor array 101. Therefore, it turns out that, in principle, the signal data, which has been acquired in a state in which the distribution of the amount of radiation incident on the scintillator 105 has been maintained to be uniform without placing an object 150, may include as components thereof only the sensitivity distribution of the pixels of the sensor array 101. Normalizing the signal data acquired in this manner allows for acquisition of the gain map 104g.
However, the signal data acquired while actually irradiating the radiation uniformly may be mixed with elements other than the sensitivity distribution of the sensor array 101.
Therefore, let us consider a method for effectively removing bright spots, which are dotted noise, from the gain map. Bright spots, as illustrated in
First, imaging is performed while uniformly irradiating the radiation without placing the object, and signal data 104d1 to 104dn, which are output from the ADC 102 and are to be gain map original images, are stored in the memory 104. As illustrated in
Here, a memory bandwidth of the radiation imaging apparatus 100 required for gain calibration operation will be described. Storing of the signal data 104d1 to 104dn, which are gain map original images, in the memory 104 must be performed with an approximately same speed as the speed of reading the signal data from the ADC 102, in order to maintain the system operation speed of the radiation imaging system SYS (radiation imaging apparatus 100). Although there is a difference in the operation direction between writing the signal data to the memory 104 and reading the gain map 104g from the memory 104, the amount of data being handled is equivalent to those in the bandwidth required for the aforementioned gain correction process in that the data covers only a single system of an image.
Next, the data being handled when performing the temporal filtering 106 is a sum of reading all the gain map original images (signal data 104d1 to 104dn, described here as there are five systems of signal data 104d1 to 104d5), and writing of the gain map 104g4, which adds up to six systems. However, since there is usually no demand for observing the temporal filtering 106 in real time, the process is not required to be performed in real time, and there is almost no harm in performing the process slowly within an available range of memory bandwidths. The same goes for an increased number of gain map original images. Based on the foregoing description, it is possible to acquire the gain map 104g, which is close to the true sensitivity distribution gain, without increasing the bandwidth of the memory 104.
Subsequently, the temporal filtering 106 using a Hampel filter algorithm will be described, referring to
Following the calculation of the median Pm, distances (difference) D0 to D4 between all the signal values P0 to P4 and Pm is acquired. When there are no bright spots included therein, which are dotted noise, in the signal values P0 to P4, respective distances D0 to D4 are values close to each other. When a signal value due to a bright spot is included in the signal values P0 to P4, only the distance D of that signal value (e.g., any of D0 to D4) indicates an outstanding value. As a reference for determination thereof, a distance data median Dm is determined as a piece of data representative of the distances D0 to D4. Here, the distance data median Dm, which is the median, is used instead of the mean, in order to be less susceptible to outstanding distance data.
Next, the outstanding signal value is detected and replaced. The detection criteria for the outstanding point is on the basis that the distance D0 to D4 is larger than a value of Dm×determination reference coefficient. The determination reference coefficient may be preliminarily defined considering the random noise characteristics or the like of the sensor array 101. In the example illustrated in
Although the temporal filtering 106 in the corrector 301 is used to generate the gain map 104g, it is not used when imaging the object. This is mainly because whereas the sensitivity distribution of the sensor array 101 is less likely to temporarily change, the shape of the object may temporarily change. When an object image accompanied with motion is passed through the Hampel filter, the moving part is determined to be data indicating an outstanding signal value and excluded, and may be replaced by past data, resulting in occurrence of an after image. Therefore, the Hampel filter is not used when observing the object, and another correction process performs suppression of dotted noise such as bright spots that occur when imaging the object. In the correction process performed by the corrector 301 illustrated in
In the foregoing manner, the corrector 301 performs a correction process for acquiring the gain map 104g for gain correction used in the gain correction process 108 without placing the object, and a correction process including gain correction (gain correction process 108) using the gain map 104g. On this occasion, correction processes performed on dotted noise such as bright spots that occur at random both temporally and spatially are different for the correction process for acquiring the gain map 104g and the correction process including the gain correction process 108, for example, for when imaging the object. In the correction process for acquiring the gain map 104g on this occasion, the corrector 301 uses the signal data acquired in the plurality of frames. Additionally, in the correction process including the gain correction process 108, the corrector 301 uses the signal data acquired in at least one frame. For example, in a correction process for video image capturing, a correction process including the gain correction process 108 and the spatial filtering 109 may be performed using signal data acquired in one frame. As a result, the number of frames for acquiring signal data to be used in the correction process for acquiring the gain map 104g may exceed the number of frames for acquiring signal data to be used in the correction process including the gain correction process 108. Therefore, the processing speed of the correction process for acquiring the gain map 104g may become slower than the processing speed of the correction process including the gain correction process 108, for example, for when capturing video image. However, the process for acquiring the gain map 104g is performed during a calibration period when starting up the radiation imaging apparatus 100, for example, and therefore is less likely to affect the user experience of the operator.
As has been described above, the directional filtering in the present embodiment suppresses, by the temporal filtering 106, the effect of bright spots occurred by radiation directly incident on the sensor array without being converted into light by the scintillator 105, and acquires the gain map 104g. Therefore, it is possible to prevent, in the gain correction process 108, occurrence of constant dark spots in the acquired radiation image. In addition, when imaging the object, radiation images are provided by a different correction process path from the correction process for acquiring the gain map 104g, whereby object observation with less display delay can be realized. In addition, it is not necessary to enhance the bandwidth of the memory 104 of the radiation imaging apparatus 100, making the radiation imaging apparatus 100 inexpensively available.
In the process illustrated in
In addition, although the corrector 301 is illustrated in
Here, the memory bandwidth required by the memory 104 in the temporal filtering 106 will be described again. As illustrated in
As has been described above, the process need not be performed in real time, and therefore the increase in the number of systems of data does not immediately wreck the operation of the radiation imaging apparatus 100 as a system. However, when the number of gain map original images increases, there may arise a possibility of affecting user experience of the operator. For example, when the number of gain map original images increases from the aforementioned 5 to 30, the amount of data to be handled increases by the difference between 30+1=31 systems and 30×3+1=91 systems, requiring an extra amount of time as much as the difference to perform the temporal filtering 106. This may result in a standby period during which the operator cannot use the radiation imaging apparatus 100, which may need to be suppressed.
In view of the foregoing, the corrector 301 of the IC 103 in the present embodiment is configured as illustrated in
Subsequently, there will be described the operation of the microprocessor 702 and the cache memory 701 when performing the filter algorithm of the temporal filtering 106. The microprocessor 702, when performing the step of calculating the median Pm, issues a read request to read the gain map original images (signal data 104d1 to 104dn). When the data stored in a corresponding memory address is not held in the cache memory 701, the read request passes through the cache memory 701 and reaches the memory controller 703 via the on-chip bus 704. The memory controller 703 reads the data from the specified address of the memory 104 and returns the read-out data. The read-out data travels in the reverse direction along the path through which the read request has passed, and reaches the microprocessor 702. On this occasion, when the data read from the memory 104 passes through the cache memory 701, a combination of the reading address and the data is temporarily stored in the cache memory 701. The microprocessor 702 calculates the median Pm using the data of the received gain map original images, and subsequently performs a step of calculating the distance D (distances D0 to D4). In the step of calculating the distance D, the microprocessor 702 issues a read request for the same address as the step of calculating the median Pm again. The read request is not transferred to the memory controller 703 because corresponding data is held in the cache memory 701, and the cache memory 701 returns the corresponding data to the microprocessor 702. The microprocessor 702 uses the received data to calculate the distance D. Hereinafter, determination of the population of averaging is also performed in a similar manner, using the data returned from the cache memory 701. In the aforementioned series of operation, the cache memory 701 returns data in a shorter time than reading data from the memory 104, which allows for reducing the processing time in comparison with the configuration that reads data from the memory 104 each time.
Furthermore, the cache memory 701 may collectively manage signal values of successive, for example 16 pixels, instead of separately managing respective signal values of pixels arranged on the sensor array 101. The collection of signal values is referred to as a cache line. The cache memory 701 transfers, to the memory 104, a read request for the data of successive 16 pixels arranged in a manner filling a single cache line, at the time point when data of the signal value of one pixel is requested. Accordingly, the read request to the memory 104 turns out be a burst access, reducing the overhead of communication between the memory controller 703 and the memory 104. Also in such an aspect, the cache memory 701 contributes to increasing the speed of the temporal filtering 106 of the radiation imaging apparatus 100.
The cache memory 701 has a finite capacity and eventually reaches a time point of running out its capacity as the temporal filtering 106 proceeds while changing the position of the pixel of interest. On this occasion, the cache memory 701 secures available capacity by erasing the cache memory data in chronological order. Let us consider a case where the number of cache lines is smaller than the number of gain map original images, for example a case where there are four cache lines when using, for example, five gain map original images (five pieces of signal data) as described above. In such a case, the cache line including the signal value P0 is deleted at the time point when the microprocessor 702 requests the signal value P4, whereby it becomes necessary to acquire the signal value P0 from the memory 104 again, depriving the benefit of temporarily storing data (signal values) in the cache memory 701. In order to avoid this situation, the number of cache lines included in the cache memory 701 may be larger than the number of gain map original images. Accordingly, the effect of providing the cache memory 701 is enhanced.
Another configuration distinct from the configuration of providing the cache memory 701 with regard to the problem of increasing memory bandwidth will be further described, referring to
Since the process illustrated in
Having provided the foregoing description of the embodiments of the present disclosure, it goes without saying that the present embodiment is not limited to such embodiments, and the aforementioned embodiments can be modified or combined as appropriate to an extent not departing from the gist of the present invention. For example, all the processes in the present embodiments are implemented on the IC 103. The IC 103 may be implemented by a programmable circuit such as an FPGA, or may be realized as an ASIC which is a fixed circuit, or may be realized by a combination of a microprocessor which is a fixed circuit and software. In addition, although the foregoing description is based on using the Hampel filter algorithm in the temporal filtering 106, the present invention is not limited thereto. Any filtering process that temporally refers to data for a plurality of times and suppresses the effect of outstanding signal values (so-called outliers) can exert the effect of the present disclosure. For example, a method such as the 3σ method may be used for detecting outstanding signal values.
In addition, although the description using
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2021-034665, filed Mar. 4, 2021 which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2021-034665 | Mar 2021 | JP | national |