1. Field of the Invention
The present invention relates to a periodic pattern suppression method and apparatus that suppresses a spatial frequency component corresponding to a periodic pattern in an image signal.
2. Description of the Related Art
Conventionally, storable phosphors (photostimulable phosphors) have been used. When a storable phosphor is irradiated with radiation (X-rays, α-rays, β-rays, γ-rays, an electron beam, ultraviolet rays or the like), apart of radiation energy is stored in the storable phosphor. After then, when excitation light, such as visible light and a laser beam, is output to the storable phosphor, the storable phosphor emits photoluminescence corresponding to the radiation energy stored therein. For example, a radiographic image readout apparatus using the storable phosphor is widely used in CR (Computed Radiography). A storable phosphor sheet, in which the storable phosphor is deposited on a substrate, is irradiated with radiation that has passed through a subject, such as a human body, and radiographic information is temporarily stored and recorded on the storable phosphor sheet. Excitation light, such as a laser beam, is output to the storable phosphor sheet to induce photoluminescence. Further, photoelectric conversion is performed on the photoluminescence to obtain an image signal.
Here, when a radiographic image of a subject is imaged and recorded on the storable phosphor sheet or the like, imaging is performed by placing a grid between the subject and the sheet in some cases so that radiation scattered by the subject does not irradiate the sheet. For example, lead or the like, which does not pass radiation therethrough, and aluminum, wood or the like, which tends to pass radiation therethrough, are alternately arranged at a narrow pitch of 4 line/mm in the grid. When radiography is performed by using the grid, radiation scattered by the subject does not tend to irradiate the sheet. Therefore, it is possible to improve the contrast of the radiographic image of the subject. However, when the size of this image including the grid image is enlarged or reduced, aliasing due to folding occurs depending on the magnification or reduction ratio. Further, when aliasing overlaps with the spatial frequency of the grid image or the like, a narrow stripe pattern (moire) is generated, and observation of a regenerated image becomes difficult.
U.S. Patent Application Publication No. 20030091243 (Patent Document 1) discloses a method for removing a grid image, as a method for removing such a periodic pattern from an image. In the method for removing the grid image, one-dimensional high-pass filter processing is performed on the image in a direction in which the stripe pattern of the grid image is arranged. Further, one-dimensional low-pass filter processing is performed on the image in a direction parallel to the stripe pattern of the grid image. Accordingly, a spatial frequency component corresponding to the grid image is extracted from an original image, and the extracted spatial frequency component is subtracted from the original image.
Japanese Patent No. 3445258 (Patent Document 2) proposes a method for obtaining an image in which an artifact caused by a grid has been effectively removed in radiographic image processing, in which radiographic image data of a subject obtained by performing radiography using the grid for removing radiation scattered by the subject are processed. First, data (band component) representing a first image component, in other words, a grid component are extracted from radiographic image data of the subject including the grid component. Then, second image component data, which are caused by the grid included in the radiographic image data, are generated based on the first image component data. The generated second image component data, in other words, data of a component caused by the grid are removed from original radiographic image data, in other words, the whole image including the grid component.
Japanese Unexamined Patent Publication No. 2010-240259 (Patent Document 3) discloses a method for removing a grid. A band-pass grid image, which has been extracted from an original image by a band-pass filter, and a high-pass grid image, which has been extracted from the original image by a high-pass filter, are obtained to subtract a remaining grid image, which has not been removed as a grid image, from an original image. A difference grid image (a grid frequency component that has not been fully extracted by band-pass) is obtained by performing low-pass processing on a difference image, which is a difference between the two grid images, in a direction parallel to a grid pattern. An image obtained by adding the difference grid image and the band-pass grid image together is subtracted from the original image.
Here, there is a demand for removing a periodic pattern, such as moire, without removing a component representing a subject as possible to obtain a high quality image appropriate for diagnosis based on the image. However, in the methods disclosed in Patent Documents 1 through 3, when a detected spatial frequency component in a predetermined band corresponding to a periodic pattern is removed from an image, there has been a problem that a subject component representing a subject, and which is included in the predetermined band, is removed together. Especially, when a moire component caused by a grid is present in a low spatial frequency band including many subject components representing the subject, the quality of an image deteriorates significantly in the methods disclosed in Patent Documents 1 through 3.
In view of the foregoing circumstances, it is an object of the present invention to provide an image processing apparatus, an image processing method and an image processing program that can extract a subject component from a frequency component corresponding to a periodic pattern, and restore the extracted subject component to an original image.
An image processing apparatus of the present invention is an image processing apparatus that suppresses a spatial frequency component corresponding to a periodic pattern included in an image, the apparatus comprising:
a first processed signal extraction means that extracts a first processed signal by extracting an input spatial frequency component corresponding to the periodic pattern by performing filtering processing on the image signal;
a subject component extraction means that extracts, from the extracted first processed signal, a subject component of the image, and the subject component being included in the first processed signal; and
a second processed signal extraction means that extracts a second processed signal by subtracting the first processed signal from the image signal and also by adding the extracted subject component to the image signal.
An image processing method of the present invention is an image processing method that suppresses a spatial frequency component corresponding to a periodic pattern included in an image, the method comprising the steps of:
extracting a first processed signal by extracting an input spatial frequency component corresponding to the periodic pattern by performing filtering processing on the image signal;
extracting, from the extracted first processed signal, a subject component of the image, and the subject component being included in the first processed signal; and
extracting a second processed signal by subtracting the first processed signal from the image signal and also by adding the extracted subject component to the image signal.
An image processing program of the present invention is an image processing program that suppresses a spatial frequency component corresponding to a periodic pattern included in an image, the program causing a computer to function as:
a first processed signal extraction means that extracts a first processed signal by extracting an input spatial frequency component corresponding to the periodic pattern by performing filtering processing on the image signal;
a subject component extraction means that extracts, from the extracted first processed signal, a subject component of the image, and the subject component being included in the first processed signal; and
a second processed signal extraction means that extracts a second processed signal by subtracting the first processed signal from the image signal and also by adding the extracted subject component to the image signal.
The term “periodic pattern” means a noise having a periodic pattern included in an original image. For example, the periodic pattern means a grid image, moire or the like included in an original image when a radiographic image is imaged on a storable phosphor sheet by using the grid.
Further, the “input” spatial frequency component corresponding to the periodic pattern includes a spatial frequency component corresponding to the periodic pattern, and which has been input by any method. For example, a known spatial frequency component corresponding to a periodic pattern may be input by a user' s manual input. Alternatively, the image processing apparatus may further include a periodic pattern detection means that detects, in the image signal, a spatial frequency component corresponding to the periodic pattern, and that inputs the detected spatial frequency component to the first processed signal extraction means. Further, the spatial frequency component corresponding to the periodic pattern, and which has been detected by the periodic pattern detection means, may be input.
In the image processing apparatus of the present invention, it is desirable that the subject component extraction means extracts, from the first processed signal, a high contrast component exceeding a predetermined threshold, as the subject component.
Here, the term “contrast” means a difference in density values between a light part and a dark part in an image, and which are represented by density values of the image. The term “high contrast” means that the absolute value of a difference in density values from a neighboring pixel is greater than a predetermined threshold.
The threshold may differ depending on an imaged region or an imaging condition of the image. Here, an imaged region of an image and an imaging condition of the image may be obtained by using an imaging menu, such as information about the imaging condition and the imaged region, which is specified at an imaging apparatus of an original image. Alternatively, imaged region information, such as an organ of a subject and a lesion, which has been input by a user through his/her manual operation may be used. Further, an image processing apparatus of the present invention may further include a region extraction means that extracts an imaged region of the image from the image, and use the extracted imaged region information. For example, methods disclosed in Japanese Unexamined Patent Publication No. 2002-109548 and Japanese Unexamined Patent Publication No. 2003-006661, which are proposed by the applicant of the present application, may be used. In the methods, a thorax is automatically detected by performing template matching using a template that is substantially similar to the outline of an average cardiothorax, as reference.
The second processed signal extraction means in the image processing apparatus of the present invention may subtract the first processed signal from the image signal and also add the subject component to the image signal in an arbitrary order as long as the second processed signal, in which the first processed signal is subtracted from the image signal and the subject component is added to the image signal, is finally extractable. For example, the second processed signal extraction means may extract the second processed signal by subtracting the first processed signal from the image signal, and by adding the extracted subject component to the image signal after subtraction. Alternatively, the second processed signal extraction means may extract the second processed signal by subtracting the extracted subject component from the first processed signal to obtain a signal, and by subtracting the obtained signal from the image signal.
According to an image processing apparatus, an image processing method and an image processing program of the present invention, a first processed signal is extracted by extracting an input spatial frequency component corresponding to a periodic pattern by performing filtering processing on an image signal. Further, a subject component of an image, and the subject component being included in the first processed signal, is extracted from the extracted first processed signal. Further, a second processed signal is extracted by subtracting the first processed signal from the image signal and also by adding the extracted subject component to the image signal. Therefore, it is possible to extract a subject component from the frequency component corresponding to the periodic pattern, and to restore the subject component to the original image. Hence, it is possible to remove only the periodic pattern, such as moire, while a component representing the subject, which is important information for diagnosis, is maintained. Consequently, it is possible to obtain, as the second processed image, a high quality image appropriate for diagnosis based on the image.
Hereinafter, embodiments of the present invention will be described with reference to drawings. In the following embodiments, a case in which a periodic pattern suppression processing apparatus according to the present invention is used in a radiographic image readout apparatus will be described. Alternatively, the periodic pattern suppression processing apparatus may be used in an image processing apparatus or the like for suppressing a periodic pattern included in a photographic image that was obtained in ordinary photography using a digital camera or the like when photography was performed through a window screen, a blind or the like. Here, the radiographic image readout apparatus reads out, as a digital image signal, a radiographic image of a human body recorded on a storable phosphor sheet by scanning the radiographic image with a laser beam.
Therefore, the radiation 2 that has passed through the subject 3 is absorbed by the lead 4a, and does not reach the storable phosphor sheet 11. However, the radiation 2 passes through the aluminum 4b, and reaches the storable phosphor sheet 11. A grid image of a stripe pattern of 4 line/mm is recorded on the storable phosphor sheet 11 together with a subject image. Meanwhile, scattered radiation 2a, which is scattered in the subject 3, is absorbed by the lead 4a, which is set in such a manner to be inclined depending on its position, or reflected by the surface of the grid 4. Therefore, the scattered radiation 2a does not reach the storable phosphor sheet 11. Hence, the storable phosphor sheet 11 can record a sharp radiographic image with a little amount of scattered radiation 2a irradiating the storable phosphor sheet 11.
When the storable phosphor sheet 11 is illuminated with the light beam 17, stimulated emission light 21 in an amount corresponding to radiographic image information stored and recorded at an illuminated position of the storable phosphor sheet 11 is emitted from the position. The stimulated emission light 21 enters a light guide 22 from an incident end surface 22a of the light guide 22, and repeats total reflection in the light guide 22, and is output from an output end surface 22b of the light guide 22. The output stimulated emission light 21 is received by a photomultiplyer 23, and converted into analog image signal Sa by photoelectric conversion.
After the analog image signal Sa is logarithmically amplified by a log amplifier 26, the analog image signal Sa is sampled with a sampling interval corresponding to a spatial frequency of fs=10 cycle/mm and digitized by an A/D converter 28, and digital image signal Sd (hereinafter, simply referred to as “image signal Sd”) is output. The image signal Sd represents radiographic image information obtained by two-dimensionally scanning the storable phosphor sheet 11. As illustrated in
After the image signal Sd is temporarily stored in a storage unit 29, the image signal Sd is input to an image signal processing unit 30. The image signal processing unit 30 includes an image processing apparatus 40 for performing an image processing method in the present invention.
The image processing apparatus 40 in the embodiment of the present invention is an image processing apparatus that suppresses a spatial frequency component corresponding to a periodic pattern included in an image. The image processing apparatus 40 includes a periodic pattern detection means 41, a first processed signal extraction means 42, a subject component extraction means 43, and second processed signal extraction means 44, 45. The periodic pattern detection means 41 detects, in an image signal, a spatial frequency component corresponding to a periodic pattern. The first processed signal extraction means 42 extracts a first processed signal by extracting the detected spatial frequency component corresponding to the periodic pattern by performing filtering processing on the image signal. The subject component extraction means 43 extracts, from the extracted first processed signal, a subject component of the image, and the subject component being included in the first processed signal. The second processed signal extraction means 44, 45 extract a second processed signal by subtracting the first processed signal from the image signal and also by adding the extracted subject component to the image signal.
An image processing program in an embodiment of the present invention and data to which the image processing program refers are stored in the storage unit 29 when the image processing program is installed, and loaded in a memory included in the storage unit 29 when the image processing program is started. The image processing program defines periodic pattern detection processing, first processed signal extraction processing, subject component extraction processing and second processed signal extraction processing, as processing performed by a central processing unit of the image signal processing unit 30, which constitutes the image processing apparatus 40. The central processing unit executes each of the aforementioned kinds of processing based on the program. Accordingly, the central processing unit of the image signal processing unit 30 functions as the periodic pattern detection means 41, the first processed signal extraction means 42, the subject component extraction means 43, and the second processed signal extraction means 44, 45.
As illustrated in
The subject component extraction means 43 extracts, as the subject component, a high contrast component exceeding a predetermined threshold from first processed signal Sh. As will be described later, the subject component extraction means 43 obtains first processed signal Sh, and refers to lookup table fs[sc] based on contrast sc of the first processed signal Sh. The subject component extraction means 43 extracts, as the subject component, signal Sc representing a high contrast component from the first processed signal.
With reference to
The subject component extraction means 43 analyzes the contrast of first processed signal Sh, and performs, based on lookup table fs[sc], function processing corresponding to the contrast of the first processed signal Sh. The upper diagram of
The lower diagram of
In the embodiment of the present invention, lookup table fs[sc] illustrated in the lower diagram of
The second processed signal extraction means in the embodiment of the present invention includes a subtractor 44 and an adder 45. The subtractor 44 subtracts first processed signal Sh from image signal Sd. After then, the adder 45 adds signal Sc representing a high contrast component. Accordingly, the second processed signal extraction means extracts second processed signal Sp representing an image in which a periodic pattern has been suppressed. Here, Second Processed Signal Sp=(Image Signal Sd−First Processed Signal Sh+Signal Sc, which corresponds to a subject component in the first processed signal). Further, an image corresponding to the second processed signal Sp is displayed on a display means, such as a monitor (not illustrated), or output to an output means, such as a printer (not illustrated).
According to the embodiment of the present invention, it is possible to extract a subject component from the frequency component corresponding to the periodic pattern, and to restore the extracted subject component to the original image. Hence, it is possible to remove only the periodic pattern, such as moire, while a component that represents the subject, and that is included in the frequency band of the periodic pattern such as moire, is maintained. Consequently, it is possible to obtain, as the second processed image, a high quality image appropriate for diagnosis based on the image.
Patent Documents 1 through 3 in the related art disclose removal of a grid image extracted as a high frequency component. When these methods are applied to moire that is detected as a low frequency component, many subject components included in the low frequency component are removed together with the moire component. Therefore, the subject component in the image after processing deteriorates. Hence, it has been difficult to maintain an image quality appropriate for diagnosis based on the image. However, when the image processing method according to the embodiment of the present invention is applied to moire, which is detected as a low frequency component, it is possible to appropriately remove only the moire component while many subject components included in the low frequency component are maintained, compared with the techniques in the related art, because it is possible to generate a second processed image in which a component that represents a subject, and that is included in a frequency band of a periodic pattern, such as moire, is added.
Further, the inventor of the present invention has found, after diligent research, that the contrast of moire generated as a folding distortion of a periodic pattern of a grid tends to be relatively low, compared with that of a subject obtained by actual imaging. Therefore, according to the embodiment of the present invention, it is possible to remove only a low contrast component from a frequency component that corresponds to the periodic pattern, such as a moire stripe, which is a folding distortion, in an concentrated manner by using a high contrast component as a subject component. Accordingly, it is possible to obtain a high quality image in which the subject component is appropriately maintained.
A modified example of the embodiment of the present invention will be described.
In the embodiment of the present invention, subtraction processing by the subtractor 44 and addition processing by the adder 45 may be performed in any order as long as signal Sp, which is represented by Second Processed Signal Sp=(Image Signal Sd−First Processed Signal Sh+Signal Sc, which corresponds to a subject component in the first processed signal), is obtainable. Any method may be used to restore the signal Sc, which corresponds to the subject component in the first processed signal, to obtain the second processed signal Sp. For example, as in the aforementioned embodiment, the second processed signal extraction means may extract the second processed signal by subtracting the first processed signal from the image signal, and by adding the extracted subject component to the image signal after subtraction. Alternatively, for example, the second processed signal extraction means may include a subtractor 46 and a subtractor 47, as illustrated in
In lookup table fs in the aforementioned embodiment, the values of threshold ε1 and/or ε2 may be set at arbitrary values based on an imaged region, an imaging condition, or the like. For example, ε1 and ε2 may be set in such a manner that the upper (lower) N % (N=3, 5, or the like) of the histogram in the upper diagram of
In that case, it is possible to appropriately extract a subject component based on a threshold condition corresponding to the imaged region and the imaging condition. Therefore, it is possible to appropriately extract the second processed signal. Consequently, it is possible to generate a higher quality processed image.
In lookup table fs in the aforementioned embodiment, different lookup table fs may be used depending on the imaged region, the imaging condition or the like. For example, lookup table fs maybe selectable, based on the imaged region, the imaging condition, or the like, from plural functions (for example, function fs, function fs1, function fs2, and the like). In this case, the imaged region and the imaging condition of the image may be obtained by using an imaging menu, such as the imaging condition and information about the imaged region, which is specified at an imaging apparatus of the original image. Alternatively, imaged region information, such as an organ of the patient and a lesion, which has been input by a user through a manual operation may be used. Since it is possible to appropriately extract the subject component based on the lookup table corresponding to the imaged region and the imaging condition, it is possible to appropriately extract the second processed signal. Consequently, it is possible to generate a higher quality processed image.
Further, the image processing apparatus 40 may further include a region extraction means 48 that extracts an imaged region of an image, as illustrated in
In such a case, the subject component extraction means 43 does not need a user' s input operation of an imaged region, and can extract an imaged region based on the result of automatic extraction. Therefore, it is possible to appropriately extract a subject component based on the extracted imaged region. Hence, a user can easily generate a high quality processed image based on the imaged region. Further, when the subject component extraction means 43 automatically extracts an imaged region or an imaging condition from an imaging menu, and extracts a subject component based on the result of automatic extraction, the same effect is achievable.
In the embodiment of the present invention, the subject component may be any component besides the high contrast component as long as the subject component represents the component of a subject.
In the embodiments of the present invention, a case in which the present invention is applied to a radiographic image readout apparatus (CR: Computed Radiography) has been described. In the radiographic image readout apparatus, excitation light, such as a laser beam, is output to a storable phosphor sheet, and stimulated emission light is generated. Photoelectric conversion is performed on the stimulated emission light to obtain an image signal. The present invention is not limited to the aforementioned embodiments, and may be applied to any type of radiographic image readout apparatus using a grid. For example, the present invention may be applied to a radiographic image readout apparatus using a radiation solid-state detector (hereinafter referred to as a radiation solid-state detector of “light conversion type and indirect conversion type”), and in which plural photoelectric conversion elements, each corresponding to a pixel, are two-dimensionally formed on an insulation substrate. A phosphor layer (scintillator) that converts radiation carrying image information into visible light by irradiation with the radiation is deposited and constitutes the radiation solid-state detector formed on the radiation image readout apparatus. Further, the present invention may be applied to a radiography apparatus using a radiation solid-state detector (hereinafter referred to as a radiation solid-state detector of “direct conversion type”). Plural charge collecting electrodes, each corresponding to a pixel, are two-dimensionally formed on an insulation substrate in a radiographic image readout apparatus. A radiation conductor that generates charges carrying image information by irradiation with radiation carrying the image information is deposited, and constitutes the radiation solid-state detector formed on the two-dimensional image readout apparatus.
Further, the present invention may be applied to a radiographic image readout apparatus using various kinds of radiation solid-state detector. As a radiation solid-state detector of light conversion type, radiation solid-state detectors disclosed, for example, in Japanese Unexamined Patent Publication No. 59(1984)-211263, Japanese Unexamined Patent publication No. 2(1990)-164067, U.S. Pat. No. 5,187,369, L. E. Antonuk et al., “Signal, noise, and readout considerations in the development of amorphous silicon photodiode arrays for radiotherapy and diagnostic x-ray imaging”, Medical Imaging V: Image Physics, SPIE, Vol. 1443, pp. 108-119, 1991, and the like may be adopted.
Meanwhile, as a radiation solid-state detector of direct conversion type, radiation solid-state detectors disclosed for example in (i) a radiation solid-state detector, the thickness of which in the transmission direction of radiation is set about ten times as thick as an ordinary one (S. Quereshi et al., “MATERIAL PARAMETERS IN THICK HYDROGENATED AMORPHOUS SILICON RADIATION DETECTORS”, Journal of Non-Crystalline Solids, Vol. 114, Part 2, pp. 417-419, 1989), or (ii) a radiation solid-state detector, in which two or more layers are deposited in the transmission direction of radiation with a metal plate therebetween (Y. Naruse and T. Hatayama, “Metal/Amorphous Silicon Multilayer Radiation Detectors”, IEEE TRANSACTIONS ON NUCLEAR SCIENCE, Vol. 36, No. 2, pp. 1347-1352, 1989), or (iii) a radiation solid-state detector using CdTe or the like (Japanese Unexamined Patent Publication No. 1(1989)-216290) or the like may be adopted.
Each of the aforementioned embodiments is only an example, and all of the descriptions should not be used to interpret the technical scope of the present invention in a limited manner. Further, the system configuration, the hardware configuration, the process flow, the module configuration, the specific content of processing and the like may be modified in various manners without departing from the gist of the present invention. Such modifications remain in the technical scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2011-065511 | Mar 2011 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2012/002010 | Mar 2012 | US |
Child | 14033647 | US |