Patent Grant
7391928
The present invention relates to an image processing method, image processing apparatus, and image reading apparatus and, more particularly, to an image processing method, image processing apparatus, and image reading apparatus for correcting any defects of a read transparent document due to dust, scratches, and the like.
In this case, image reading in the sub-scan direction is done by mechanically moving the transparent document illumination lamp 144 and mirror 147 in the sub-scan direction with respect to the transparent document 142 while maintaining an identical velocity and phase, and making the inverted-V mirrors 148 track at the half scan velocity in the sub-scan direction so as to maintain a constant optical path length (conjugate relationship) from the transparent document 142 to the CCD 150. In this way, a two-dimensional image is read in combination with the process in the main scan direction.
The aforementioned transparent document image reading apparatus can read a so-called reflecting document which is described on an opaque material and is illuminated with light so as to process the light reflected by the material. In this case, a reflecting document is placed in place of the transparent document 142, and is illuminated with a direct light beam emitted by a reflecting document illumination lamp 145, which is turned on in place of the transparent document illumination lamp 144, and with a light beam reflected by a reflector 146. The light reflected by the reflecting document is read by the CCD 150, thus forming an image in the main scan direction as in the transparent document.
Especially, as a color reading method, a 3-line color image reading method is prevalent. That is, the reflecting document illumination lamp 145 uses a lamp having white spectral characteristics, and the CCD 150 uses a 3-line type CCD having R, G, and B color filters. Three colors (R, G, and B) of image information are simultaneously read by a single scan, and R, G, and B color signals on an identical line are superposed by an image processing circuit, thus forming a color image.
In order to correct any defects of an image due to dust, scratches, and the like on a transparent document in the aforementioned transparent document image reading apparatus, the only effective method is to retouch them using image edit software after the image is read. For this reason, a very long time is required to correct such defects.
In recent years, as such transparent document image reading apparatus, an image reading apparatus having a so-called dust/scratch reduction function of detecting dust present on a transparent document and scratches on a film surface (such detection will be referred to as “dust/scratch detection” hereinafter), and reducing the influences of such dust and scratches by an image process has been developed.
Referring to
The transparent document reading operation including dust/scratch reduction will be explained in detail below with reference to the flow chart shown in
In step S10, the reflecting document illumination lamp 145 and infrared lamp 151 in
In step S30 and subsequent steps, dust/scratch detection and correction are executed. The principle of dust/scratch detection will be described in detail below.
The threshold value 184 is held in advance in the threshold value holding unit 24. Therefore, the dust/scratch detection unit 25 reads out this threshold value 184 from the threshold value holding unit 24, and compares it with infrared image data in turn in step S30, thus detecting the defect region 185.
If the infrared image data is smaller than the threshold value 184 (NO in step S30), the influence of dust 182 is eliminated by executing, e.g., an interpolation process of the defect region 185 based on a normal region around it in step S40. The comparison process is executed for all infrared image data, and when any defect region is detected, the corresponding normal image data undergoes interpolation (step S50).
However, no prior art fully examines the ON/OFF sequences of a visible light source and an invisible light source such as an infrared source. A rise sequence has not been optimized for a combination between a visible light source which requires a relatively long rise time and an invisible light source which requires a relatively short rise time. The position of a lens which corrects the difference in optical path length between visible and invisible light shifts toward the optical axis, complicating the structure. No extensive studies have been made for a sequence of reading a film using visible and invisible light, detecting dust and scratches on a film on the basis of the read image using the invisible light (referred to as “invisible light image”, hereinafter), and correcting a portion of the read image using the visible light (referred to as “visible light image”, hereinafter) corresponding to the detected dust and scratches. A stable, high-precision dust/scratch reduction function is difficult to supply.
To detect dust and scratches based on an invisible light image, a single document must be read twice using invisible light and visible light. The document must be scanned by a scanning unit including at least some of a photoelectric converter, optical system, and processing circuit. This generates a shift due to a poor operation precision of the scanning unit between an image obtained by invisible light scan reading for detecting dust and scratches and an image obtained by visible light scan reading for acquiring actual image information. As a result, dust and scratches cannot be satisfactorily reduced.
Further, an invisible light image may be influenced by the shadow of a film holder. More specifically, a shadow portion of a visible light image that is not a defect by dust or a scratch may be erroneously corrected.
Furthermore, a document read at a high designated resolution provides large image data, which requires a very long time to detect the positions of dust and scratches on visible light and invisible light images.
Further, only a uniform setting of whether to perform dust/scratch reduction cannot achieve a process suitable for an individual film. In general, a scratch portion is higher in infrared transmittance than a dust portion. It is therefore difficult to set parameters for properly processing both scratches and dust. If a dust/scratch portion is to be interpolated by neighboring data within a range much larger than the dust/scratch portion so as to completely correct the dust/scratch portion, detailed data within the range other than the dust/scratch is undesirably lost, making the image look unnatural. In addition, the dust/scratch reduction range to be corrected should vary depending upon the resolution and is difficult to set the range to a detected dust/scratch portion plus a specific number of pixels surrounding the dust/scratch portion.
The present invention has been made in consideration of the above situation, and has as its object to optimize a rise sequence for visible and invisible light sources.
It is another object of the present invention to correct the difference in optical path length between visible and invisible light images with a simple structure using an optical member.
It is still another object of the present invention to supply a stable, high-precision dust/scratch reduction function.
It is still another object of the present invention to stably perform appropriate dust/scratch detection and correction even if a shift occurs between images obtained by a plurality of scanning operations when a document is read to achieve dust/scratch correction.
It is still another object of the present invention to reduce the influence of a shift from an ideal wavelength characteristic, the influence of the shadow of a film holder, and the like.
It is still another object of the present invention to achieve a high-speed dust/scratch reduction process without decreasing a dust/scratch reduction effect.
It is still another object of the present invention to enable changing the dust/scratch detection sensitivity in accordance with a document or user purpose.
According to the present invention, the foregoing objects are attained by providing a control method for an image reading apparatus having a visible light source that emits visible light, an invisible light source that emits invisible light, an imaging optical system adapted to irradiate a document by these light sources to form optical images of the document, and a photoelectric converter adapted to photoelectrically convert the optical images of the document, comprising: turning on the visible light source to acquire a visible light image signal by the photoelectric converter; turning on the invisible light source to acquire an invisible light image signal by the photoelectric converter; and turning off the invisible light source after the invisible light image signal is acquired, and turning on the visible light source regardless of whether to read the document.
According to the present invention, the foregoing objects are also attained by providing an image processing method of processing first and second image signals obtained by an image reading apparatus having a first light source that emits light within a first wavelength range, a second light source that emits light within a second wavelength range, an imaging optical system adapted to irradiate a document by these light sources to form optical images of the document, a photoelectric converter adapted to photoelectrically convert the optical images of the document, and an optical path length correction member adapted to correct a difference in imaging position between first image obtained by the photoelectric converter by turning on the first light source and a second image obtained by the photoelectric converter by turning on the second light source, comprising correcting magnifications of the first and second images after the first image signal is acquired.
Further, the foregoing objects are also attained by providing an image reading apparatus having a visible light source that emits visible light, an invisible light source that emits invisible light, an imaging optical system for irradiating a document by these light sources to form optical images of the document, and a photoelectric converter for photoelectrically converting the optical images of the document, comprising a controller adapted to turn on the invisible light source to acquire an invisible light image by the photoelectric converter, then turn off the invisible light source, and turn on the visible light source regardless of whether to read the document.
Furthermore, the foregoing objects are also attained by providing an image processing apparatus having a first light source that emits light within a first wavelength range, a second light source that emits light within a second wavelength range, an imaging optical system adapted to irradiate a document by these light sources to form optical images of the document, a photoelectric converter adapted to photoelectrically convert the optical images of the document, and an optical path length correction member adapted to correct a difference in imaging position between first image obtained by the photoelectric converter by turning on the first light source and a second image obtained by the photoelectric converter by turning on the second light source, comprising a magnification correction unit adapted to make image magnifications of first and second images coincide with each other.
Further, the foregoing objects are also attained by providing an image processing method of irradiating a document by a visible light source that emits visible light and an invisible light source that emits invisible light, and processing visible and invisible light image signals obtained by photoelectrically converting optical images of the document, comprising: generating a first dust/scratch image signal from the invisible light image signal by using a first threshold value; calculating a correlation between the visible light image signal and the first dust/scratch image signal; and changing a method of calculating the correlation in accordance with whether the document is a negative or positive image.
Further, the foregoing objects are also attained by providing an image processing method of irradiating a document by a visible light source that emits visible light and an invisible light source that emits invisible light, and processing visible and invisible light image signals obtained by photoelectrically converting optical images of the document, comprising: generating a first dust/scratch image signal from the invisible light image signal by using a first threshold value; generating a second dust/scratch image signal from the invisible light image signal by using a second threshold value; and correcting the visible light image signal by using the visible light image signal and the first and second dust/scratch image signals.
Further, the foregoing objects are also attained by providing an image processing method which has light sources that selectively emit visible light or invisible light, and processes a visible light image signal obtained by photoelectrically converting an optical image of a document irradiated by the light source, and an invisible light image signal different in resolution from the visible light image signal, comprising generating a first dust/scratch image signal from the invisible light image signal by using a first threshold value; detecting a positional shift amount between visible and invisible light images after the resolution of the visible light image signal and a resolution of the first dust/scratch image signal are made to coincide with each other; and correcting the visible light image signal by using the shift amount and the invisible light image signal.
Further, the foregoing objects are also attained by providing an image reading apparatus comprising: a visible light source that emits visible light; an invisible light source that emits invisible light; a photoelectric converter adapted to photoelectrically convert optical images of a document irradiated by the visible light source and the invisible light source; and a signal processor adapted to process a visible light image signal obtained by the photoelectric converter by irradiating the document by the visible light source, and an invisible light image signal obtained by the photoelectric converter by irradiating the document by the invisible light source, wherein the signal processor generates a first dust/scratch image signal from the invisible light image signal by using a first threshold value, calculates a correlation between the visible light image signal and the first dust/scratch image signal, and changes a method of calculating the correlation in accordance with whether the document is a negative or positive image.
Further, the foregoing objects are also attained by providing an image reading apparatus comprising: a visible light source that emits visible light; an invisible light source that emits invisible light; a photoelectric converter adapted to photoelectrically convert optical images of a document irradiated by the visible light source and the invisible light source; a signal processor adapted to process a visible light image signal obtained by the photoelectric converter by irradiating the document by the visible light source, and an invisible light image signal obtained by the photoelectric converter by irradiating the document by the invisible light source, the signal processor generates a first dust/scratch image signal from the invisible light image signal by using a first threshold value, and generates a second dust/scratch image signal from the invisible light image signal by using a second threshold value; and a correction unit adapted to correct the visible light image signal by using the visible light image signal and the first and second dust/scratch image signals.
Further, the foregoing objects are also attained by providing an image reading apparatus comprising: a visible light source that emits visible light; a invisible light source that emits invisible light; a photoelectric converter adapted to photoelectrically convert optical images of a document irradiated by the visible light source and the invisible light source; a signal processor adapted to process a visible light image signal obtained by the photoelectric converter by irradiating the document by the visible light source, and an invisible light image signal obtained by the photoelectric converter by irradiating the document by the invisible light source, the signal processor generates a first dust/scratch image signal from the invisible light image signal by using a first threshold value, makes resolutions of the visible light image signal and the first dust/scratch image signal coincide with each other, and then detects a positional shift amount between visible and invisible light images; and a correction unit adapted to correct the visible light image signal by using the shift amount and the invisible light image signal.
Further, the foregoing objects are also attained by providing an image processing apparatus for irradiating a document by a visible light source that emits visible light and an invisible light source that emits invisible light, and processing visible and invisible light image signals obtained by photoelectrically converting optical images of the document, thereby correcting the visible light image signal, comprising a setting unit for variably setting a sensitivity of correction.
Further, the foregoing objects are also attained by providing an image processing method including processing a visible light image signal obtained by photoelectrically converting an optical image of a document irradiated by a visible light source and an invisible light image signal obtained by photoelectrically converting an optical image of a document irradiated by an invisible light source, comprising variably setting a sensitivity of correction.
Further, the foregoing objects are also attained by providing an image reading system for irradiating a document by a visible light source that emits visible light and an invisible light source that emits invisible light, and processing visible and invisible light image signals obtained by photoelectrically converting optical images of the document, thereby correcting the visible light image signal, comprising a setting unit adapted to variably set a sensitivity of correction.
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Preferred embodiments of the present invention will be described in detail in accordance with the accompanying drawings.
Reference symbol B denotes an optical unit constituted on the scanner main body side; 107, 108, 109, 110, and 111, mirrors for reflecting light having passed through the transparent document 101 in predetermined directions; 112, an imaging lens for forming light having passed through the transparent document 101 into an optical image; 113, an optical axis extending through the center of the imaging lens; and 114, a glass plate for correcting the optical path length difference caused by the wavelength difference between visible light and infrared light. 114a shows a state wherein the glass plate 114 is placed so that the optical axis is substantially normal to the glass plate 114, and 114b shows a state wherein the glass plate 114 is rotated through almost 90.degree. and retracted outside the optical path of an optical image; and 115, a linear image sensor constituted by arraying photoelectric converters for outputting an optical image formed by the imaging lens 112 as electrical R, G, and B image signals. In this embodiment, the linear image sensor 115 is a 3-line linear sensor having color filters of three, R, G, and B colors. As the photoelectric converter, a known photoelectric converter, such as of a CCD type and MOS type, may be used. Reference numeral 117 denotes a motor for pivoting the glass plate 114; 118, an ON circuit for the cold cathode fluorescent lamps 102 and 103; and 119, an ON circuit for the infrared LED arrays 104 and 105.
Reference numeral 120 denotes an analog processing circuit for processing R, G, and B image signals output from the CCD linear image sensor 115; 121, an A (Analog)/D (Digital) conversion circuit; and 122, an image processing circuit for performing a necessary image process in the image reading apparatus. The image process is not directly relevant to the present invention, and a detailed description thereof will be omitted. Reference numeral 123 denotes an offset RAM (Random Access Memory) used in the image processing circuit 122; 124, an interface; 125, an external apparatus such as a personal computer; 126, a system controller; 127, a line buffer; and 128, a CPU (Central Processing Unit) bus. The interface 124 makes an output image signal from the image processing circuit 122 stored in the line buffer 127, and outputted to the signal to the personal computer 125. As shown in
In
An operation sequence of reducing effects of dust and scratches on the transparent document 101 from the image of the transparent document 101 by using the image reading apparatus 301 of the first embodiment with the above-described arrangement will be explained with reference to the flow chart of
In step S301, the cold cathode fluorescent lamps 102 and 103 are turned on in accordance with an instruction from the system controller 126. In step S302, the optical unit B moves from a predetermined standby position to the reading start position of the transparent document 101. In step S303, light from the cold cathode fluorescent lamps 102 and 103 that has passed through the transparent document 101 is read as a visible light image by the CCD image sensor 115. The image signal is sent to the personal computer 125 via the analog signal processing circuit 120, A/D conversion circuit 121, image processing circuit 122, line buffer 127, and interface 124. The image signal is saved in the visible light image memory 322. At this time, the glass plate 114 is set at the position 114a where the optical axis 113 is substantially normal to the glass plate 114.
In step S304, the optical unit B returns to the predetermined standby position. In step S305, the cold cathode fluorescent lamps 102 and 103 are turned off, and the infrared LED arrays 104 and 105 are turned on in accordance with instructions from the system controller 126. In step S306, the optical unit B moves to the reading start position of the transparent document 101. In step S307, light from the infrared LED arrays 104 and 105 that has passed through the transparent document 101 is read as an infrared image by the CCD image sensor 115. Similar to the visible light image, the image signal is sent to the personal computer 125 via the interface 124, and saved in the infrared image memory 323. At this time, the glass plate 114 is set at the position 114b and retracts outside the optical path.
In step S308, the infrared LED arrays 104 and 105 are turned off, and the cold cathode fluorescent lamps 102 and 103 are turned on. In step S309, the optical unit B returns to the predetermined standby position, and waits for reading operation of the next visible light image. In this manner, the cold cathode fluorescent lamps 102 and 103 are immediately turned on because a relatively long time is required until the light quantities of the cold cathode fluorescent lamps 102 and 103 settle to predetermined values after ON operation.
The glass plate 114 is used to correct the optical path length difference caused by the wavelength difference between visible light and infrared light. Letting t be the glass thickness and n be the refractive index (generally n=1.51), an optical path length difference .DELTA.L is given by
.DELTA.L=t.multidot.(n−1)/n
The glass thickness t is so determined as to make the optical path length difference .DELTA.L be equal to the optical path length difference caused by the wavelength difference between a main wavelength of about 550 nm for, e.g., a G image as a visible light wavelength and an infrared wavelength of about 880 nm.
In step S310, the read infrared image undergoes correction of the magnification difference of the imaging lens 112.
In step S311, the positional shift amount between the visible light image and the infrared image is corrected. The two images are read by separate reading operations, the positions of the images do not strictly coincide with each other in both the main scan direction and sub-scan direction, and a small positional shift occurs. The positional shift correction unit 332 executes an arithmetic process for accurately correcting such a positional shift. Detailed contents of this positional shift correction process are applied as Japanese Patent Application No. 2000-33919 (JPA 2001-223892) by the present applicant. In the present invention, the positional shift correction process between visible and infrared images is performed in the sub-scan direction, and then in the main scan direction owing to the following reason.
When an image is read several times under the same reading conditions, the direction in which the optical system moves, i.e., the reading position precision in the sub-scan direction varies more readily than in the main scan direction. This is because the reading start position is managed by, e.g., the moving amount of a motor (not shown) for moving the optical unit B, and no absolute position is measured. To the contrary, the position in the main scan direction is fixed by a shaft (not shown) in most scanners, so that the reading position precision is high. From this, the positional shift amount between a visible light image and an infrared image becomes larger in the sub-scan direction.
Hence, when positional shift correction is to be executed, a positional shift correction process is done in the sub-scan direction in which the positional shift amount is large, and then in the main scan direction in which the positional shift amount is small. This yields an accurate positional shift correction process.
In step S312, the visible light image is added/subtracted to/from the infrared image at a predetermined ratio. A color film generally exhibits the spectral transmittance characteristic of each dye, as shown in
In step S313, the dust/scratch detection unit 325 detects a dust/scratch portion from the infrared image. Details of the dust/scratch portion detection operation are described in Japanese Patent Application No. 2000-182905 (JPA 2002-84421, which corresponds to US 2002-0004801A1) by the present applicant.
In step S314, the dust/scratch reduction unit 326 reduces the dust/scratch portion of the visible light image.
All the process steps have sequentially been described. Alternatively, the flow may skip the processes in step S311 and S312 after performing the magnification correction process in step S310, and may advance to the dust/scratch detection process in step S313. Similarly, the flow may skip the processes in steps S310 and S312, perform the positional shift correction process in step S311, and advance to the dust/scratch detection process in step S313. Similarly, the flow may skip the processes in steps S310 and S311, perform reflection correction in step S312, and advance to the dust/scratch detection process in step S313.
Since the first embodiment adopts infrared light as invisible light, the glass plate is inserted in the optical path in reading a visible light image. If ultraviolet light is employed as invisible light, the glass plate can be inserted in the optical path in reading an ultraviolet image, and retracted from the optical path in reading a visible light image.
As described above, according to the first embodiment, the characteristics of a visible light source which requires a relatively long preparation time can be stabilized by devising the ON/OFF sequences of the visible and invisible light sources. The apparatus can prepare for the next scan operation immediately after the completion of the first scan operation.
Further, the optical path length difference can be corrected by a simple arrangement in which the glass plate as a means for correcting the optical path length difference between visible and invisible light images is inserted/retracted to/from the optical path.
Furthermore, the first embodiment defines the sequence of reading both visible and invisible light images, then detecting dust and scratches on a film on the basis of the invisible light image, and correcting a corresponding portion of the visible light image. The present invention can supply a high-precision dust/scratch reduction function.
The second embodiment will be described with reference to
In
Transparent document reading operation including dust/scratch reduction in the second embodiment will be explained in detail with reference to the flow chart of
In step S201, the reflecting document illumination lamp 145 and infrared lamp 151 in
In step S202, the reflecting document illumination lamp 145 and transparent document illumination lamp 144 in
In step S203, the threshold value determination/holding unit 32 calculates and holds a threshold value La to be used in step S204 by using the infrared image data temporarily stored in the infrared image memory 23. This calculation method will be explained later.
In step S204, the dust/scratch detection unit 25 reads out the threshold value La from the threshold value determination/holding unit 32, and reads out the infrared image data from the infrared image memory 23. The dust/scratch detection unit 25 compares the infrared image data with the threshold value La to detect a dust/scratch and generate a first dust/scratch position image. The first dust/scratch position image is temporarily stored in the infrared image memory 23.
In step S205, the positional shift amount detection unit 33 detects the positional shift amount between the no mal image stored in the image memory 22 and the first dust/scratch position image stored in the infrared image memory 23. Details of detection will be described later.
In step S206, the threshold value determination/holding unit 32 calculates and holds a threshold value Lb to be used in step S207 by using the infrared image data temporarily stored in the infrared image memory 23. The Lb calculation method will also be explained later.
In step S207, the dust/scratch detection unit 25 reads out the threshold value Lb from the threshold value determination/holding unit 32, and reads out the infrared image data from the infrared image memory 23. The dust/scratch detection unit 25 compares the infrared image data with the threshold value Lb to detect a dust/scratch and generate a second dust/scratch position image. The second dust/scratch position image is temporarily stored in the infrared image memory 23.
In step S208, the correction unit 26 reads out the dust/scratch position from the second dust/scratch position image stored in the infrared image memory 23, and shifts the position by the positional shift amount detected in step S205. Image data of the normal image stored in the image memory 22 that corresponds to the shifted position is determined as data of a defect region having a defect due to dust or a scratch. Data of the defect region of the normal image is interpolated from the peripheral non-defect region, thus reducing the dust/scratch influence. Image data of the normal image corresponding to the position shifted by the positional shift amount detected in step S205 is corrected for all the dust/scratch positions of the second dust/scratch position image. Accordingly, a normal image on which the dust/scratch influence is reduced can be attained.
Detection of the positional shift amount in step S205 and the calculation methods of the threshold values La and Lb in steps S203 and S206 will be described.
(Detection of Positional Shift Amount)
Detection of the positional shift amount between a normal image and the first dust/scratch position image by the positional shift amount detection unit 33 will be explained with reference to
On a normal image, the dust/scratch position image data is expressed at a low density value for a positive film or at a high density value for a negative film after reversal. The density values of pixels are obtained within a range of .+−.N pixels in the sub-scan direction from the coordinates of the dust/scratch pixel 403 on the normal image that correspond to the coordinates of the dust/scratch pixel 401 on the infrared image. Among the obtained (2N+1) pixels, a pixel having the lowest density value for a positive film or a pixel having the highest density value for a negative film is determined to be a pixel corresponding to dust or a scratch on the normal image. Then, the shift amount between the normal image and the infrared image can be calculated. However, if the shift amount is determined using only one pixel, a positional shift may be erroneously determined, and some dust/scratch pixels may not be detected. To prevent this, the positional shift determination precision is increased by calculating the sum of density values of pixels at the dust/scratch pixel positions on the normal image for each shift amount.
The example of
Alternatively, as shown in
(Calculation of Threshold Values La and Lb)
Calculation of the threshold values La and Lb used when the threshold value determination/holding unit 32 detects a dust/scratch position from an infrared image will be described.
To detect a dust/scratch position by reading a transparent document by infrared light, a threshold is obtained from the histogram of an infrared image. Pixels lower than the threshold value are determined as dust/scratch pixels, and pixels on a normal image corresponding to the determined pixels are corrected.
As a method of determining a threshold value, a value attained by subtracting the product of a standard deviation value by n times from an average value calculated from the histogram of the infrared image is set as a threshold value. Equation (1) represents this method:
Threshold=Average−SD.times.n (1)
Threshold: threshold value, Average: the average value of an infrared image, SD: the standard deviation of the infrared image, and n: coefficient
As is apparent from
The dust/scratch detection sensitivity can be adjusted by setting the coefficient n in equation (1) described above. For excessively large n, detection omission may occur; for small n, detection omission hardly occurs, but a reflection of dye on the infrared image will be more likely detected.
By setting the constant n to b for the second threshold value Tb for dust/scratch detection, setting the constant n to a for the first threshold value Ta, and setting the relation between the two coefficients to a>b, the threshold value for positional shift correction is always lower than the threshold value used for dust/scratch detection for correction by a predetermined value, and the influence of reflection can be reduced.
Threshold(.dwnarw..dwnarw.)=Average(.dwnarw.)−SD(.Arrow-up bold.).times.n (2)
In this case, the threshold value excessively decreases to the value 702 or 703 in
This can reduce the influence of reflection.
The third embodiment will be described with reference to
As shown in
That is, using an infrared image as shown in
Transparent document reading operation including dust/scratch reduction will be explained with reference to the flow chart of
In step S221, a reflecting document illumination lamp 145 and the infrared lamp 151 in
In step S222, the reflecting document illumination lamp 145 and transparent document illumination lamp 144 in
In step S223, the infrared image obtained in step S222 undergoes a magnification process by magnifying M times the predetermined resolution Rn to the designated resolution Rs. Note that M=Rs/Rn. This allows the infrared image to use a spatial distance at the same pixel unit as the designated resolution.
In step S224, a positional shift amount when dust/scratch positions shift depending on the scanning precisions of the normal and infrared images in S221 and S223, as shown in
In step S225, the dust/scratch image in the normal image is retouched. In this case, dust and scratches in pixels of the normal image that correspond to positions attained by shifting dust/scratch positions on the infrared image by the shift amount detected in step S224 are retouched. Then, the dust/scratch reduction process ends. This flow chart can increase the reading speed of the infrared image. The process speed can be increased without degrading the dust/scratch reduction performance.
The fourth embodiment will be described with reference to
Steps S101 and S102 are similar to steps S221 and S222 described in the third embodiment except that an image is read at the resolution Rs in step S1102, as in step S101. If the resolutions are very high, an infrared image may not be necessarily read at a resolution higher than a given one in order to specify dust/scratch positions, as described in the second embodiment with reference to
In step S103, whether the resolution of an infrared image attained in step S102 is lower than the predetermined resolution Rd is checked. If YES in step S103, the flow advances to steps S104 and S106 to detect the shift amount of a dust/scratch position every pixel. If NO in step S103, the flow advances to steps S105 and S106. For a very high designated resolution, sums of the densities of pixels on the normal image corresponding to dust/scratch pixels detected on the infrared image is calculated by shifting Rs/Rd pixels each time, which can increase the process speed, as shown in
In step S106, dust/scratch positions are corrected by the detected positional shift amount, and the dust/scratch portion in the normal image is retouched. Then, the dust/scratch reduction process ends. This flow chart can increase the speed of the dust/scratch alignment process between normal and infrared images for a very high designated resolution. As a result, the process speed can be increased without degrading the dust/scratch reduction performance.
If (Rs/Rd) is 2 in step S105 of
As described above, the image reading apparatuses described in the second to fourth embodiments can achieve dust/scratch correction without any problem by detecting a shift amount and performing shift correction even if a positional shift occurs between a visible light image by visible light and an invisible light image.
Further, the influence of reflection on an invisible light image can be reduced to prevent excessive image correction.
Furthermore, even when the image reading apparatus executes dust/scratch reduction using an image read with invisible light at a resolution lower than that of an image read with visible light, a dust/scratch position can be specified without degrading the dust/scratch reduction performance. The reading speed using invisible light can be optimized, thus increasing the speed of the dust/scratch reduction function.
If an image is read at a very high resolution in comparison with the size of dust or a scratch, the pixel unit at which images read with invisible light and visible light are processed can be decreased without degrading the dust/scratch reduction performance in order to specify a dust/scratch position on the image read with visible light. The dust/scratch position can be specified at a high speed, increasing the speed of the dust/scratch reduction function.
The operation of an image reading apparatus system in the fifth embodiment will be explained with reference to the flow chart of
In step S401, the user inputs via the input unit 27 a desired resolution of an image to be read. If the user does not input any value, the resolution set in previous scanning is displayed to urge the user to confirm it.
In step S402, the user inputs the dust/scratch reduction sensitivity via the input unit 27. In general, an optimal dust/scratch correction result varies depending upon the type of film, the dust/scratch size, or the subjective point of a person who observes an image. Only a uniform setting of whether to perform dust/scratch reduction cannot achieve a process suitable for an individual film. The fifth embodiment prepares three dust/scratch reduction levels “high, standard, and low”. Since some films do not require any dust/scratch reduction, “no” which means that no dust/scratch reduction is performed is also set to shorten the time until an image is acquired. These four levels are set via the input unit 27.
In step S403, a visible light image is read, similar to step S 10 of
In step S404, an infrared image is read, similar to step S20 of
In step S405, a dust/scratch position is detected from the infrared image read in step S404.
Detection of the dust/scratch position will be described with reference to
L1 in
The magnitude of .DELTA.L1 is set in accordance with the sensitivity input in step S402. For “high”, .DELTA.L1 is set small so as to detect many dust particles and scratches. For “low”, .DELTA.L1 is set large.
In step S406, a correction process is performed on a pixel or pixels of the visible light image corresponding to the dust/scratch portion detected in step S405 by interpolation using their peripheral normal pixel data.
In step S407, the visible light image having undergone the correction process is displayed on the display of the input unit 27. The user confirms the corrected state, and if he/she wants to change the sensitivity, changes the sensitivity via the input unit 27.
In a dust/scratch reduction process, such parameters as to reduce general dust and scratches in the “standard” mode are set. If a dust/scratch result is improper, the user changes the setting to “high”, “low”, or “no” on UI. The parameters need to be changed in the following cases.
Since a scratch portion generally has a high infrared transmittance in comparison with dust, scratches may not be fully reduced in standard settings. In this case, “high” is set on UI. At “high” parameters, the threshold value L2 used to detect dust or scratches is set high, i.e., the value .DELTA.L1 is set small. The range of the defect region 505 where dust and scratches are detected is widened. This enables detecting even scratches whose transmittance is higher than general dust. To the contrary, if an image becomes unnatural by processing an inconspicuous dust/scratch portion, “low” is set on UI. At “low” parameters, the threshold value L2 used to detect dust or scratches is set low, i.e., the value .DELTA.L1 is set large. The range of the defect region 505 where dust and scratches are detected is narrowed, and the correction range is also narrowed. This prevents generation of an unnatural image.
If the setting for the sensitivity is changed in step S408, processes in step S405 and subsequent steps are executed again in accordance with the changed sensitivity.
The sixth embodiment will be described.
In the fifth embodiment, the threshold value used to detect a dust/scratch region from an infrared image is set in accordance with a set dust/scratch reduction sensitivity. The sixth embodiment executes an enlargement process of enlarging a dust/scratch region detected by the threshold value in accordance with a set sensitivity. The operation except for step S406 in
In the case of
The seventh embodiment will be described.
In the sixth embodiment, the enlargement amount of a region after a dust/scratch region is detected from an infrared image is set in accordance with a set dust/scratch reduction sensitivity. In the seventh embodiment, a range where interpolation pixel data is searched for when dust/scratch reduction is executed by interpolation using image data of normal pixels around pixels to be corrected is set in accordance with a set dust/scratch reduction sensitivity.
The operation other than step S406 in
In
The above embodiments execute processes by determining the number of pixels subjected to an enlargement process or the maximum interpolation length of pattern interpolation as the above-described parameter in the three settings “high, standard, and low”. However, uniformly determining the number of pixels cannot achieve an optimal process because the number of pixels corresponding to dust or a scratch changes depending on the resolution though the size of the dust or scratch remains unchanged. To prevent this, the parameter is set in accordance with the resolution, which provides almost the same dust/scratch reduction effect regardless of the resolution.
A dust/scratch reduction parameter is set based on information about the resolution of an image input in step S401 of
1TABLE 1 Number of Enlargement Maximum Pattern Resolution Pixels Interpolation Count (dpi) Low Standard High Low Standard High 1200 0 1 2 6 8 10 2400 1 2 3 12 16 20 4800 2 4 6 24 32 40
<Modification>
The eighth embodiment shows the table of the number of enlargement pixels and the maximum pattern interpolation count in accordance with the resolution. Alternatively, the dust/scratch detection threshold value can be changed. The gray level difference of an interpolation pattern color described in the seventh embodiment may be set to “large, medium, and small” in accordance with the dust/scratch reduction sensitivity “high, standard, and low”.
In the fifth to eighth embodiments, “high, standard, and low” are set as dust/scratch reduction sensitivities. Alternatively, respective parameters may be directly set by numerical values such as the number of pixels, or set by percentage representation with respect to a standard value.
The present invention has exemplified a transparent document, but can also be applied to a reflecting document. The present invention has exemplified infrared light as invisible light as embodiments, but may use ultraviolet light depending on the feature of a document.
As has been described above, the present invention can realize appropriate dust/scratch reduction corresponding to the feature of a document in an image signal processing apparatus, image signal processing method, and image signal reading system for a document.
The present invention can be applied to a system constituted by a plurality of devices (e.g., host computer, interface, reader, printer) or to an apparatus comprising a single device (e.g., copying machine, facsimile machine).
Further, the object of the present invention can also be achieved by providing a storage medium storing program codes for performing the aforesaid processes to a computer system or apparatus (e.g., a personal computer), reading the program codes, by a CPU or MPU of the computer system or apparatus, from the storage medium, then executing the program.
In this case, the program codes read from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention.
Further, the storage medium, such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM can be used for providing the program codes.
Furthermore, besides aforesaid functions according to the above embodiments are realized by executing the program codes which are read by a computer, the present invention includes a case where an OS (operating system) or the like working on the computer performs a part or entire processes in accordance with designations of the program codes and realizes functions according to the above embodiments.
Furthermore, the present invention also includes a case where, after the program codes read from the storage medium are written in a function expansion card which is inserted into the computer or in a memory provided in a function expansion unit which is connected to the computer, CPU or the like contained in the function expansion card or unit performs a part or entire process in accordance with designations of the program codes and realizes functions of the above embodiments.
In a case where the present invention is applied to the aforesaid storage medium, the storage medium stores program codes corresponding to the flowcharts described in the embodiments.
The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore to apprise the public of the scope of the present invention, the following claims are made.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2001-074324 | Mar 2001 | JP | national |
| 2001-074325 | Mar 2001 | JP | national |
| 2001-074330 | Mar 2001 | JP | national |
This application is a divisional of U.S. patent application Ser. No. 11/197,709, now U.S. Pat. No. 7,245,784, filed Aug. 3, 2005, which is a continuation of Ser. No. 10/098,904, filed Mar. 13, 2002, now U.S. Pat. No. 7,006,705, to which priority under 35 U.S.C. § 120 is claimed.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4933983 | Hiramatsu et al. | Jun 1990 | A |
| 5335292 | Lovelady et al. | Aug 1994 | A |
| 5969372 | Stavely et al. | Oct 1999 | A |
| 6094281 | Nakai et al. | Jul 2000 | A |
| 6323967 | Fujinawa | Nov 2001 | B1 |
| 6380539 | Edgar | Apr 2002 | B1 |
| 6493061 | Arita et al. | Dec 2002 | B1 |
| 6753984 | Wada | Jun 2004 | B1 |
| 6826359 | Takeda | Nov 2004 | B1 |
| 6879730 | Hirakawa | Apr 2005 | B1 |
| 7113619 | Matama | Sep 2006 | B1 |
| 20020004801 | Todd | Jan 2002 | A1 |
| Number | Date | Country |
|---|---|---|
| 44 38 746 | May 1995 | DE |
| 0 597 696 | May 1994 | EP |
| 0 606 654 | Jul 1994 | EP |
| 0 893 914 | Jan 1999 | EP |
| 1 032 192 | Aug 2000 | EP |
| 2000-115462 | Apr 2000 | JP |
| 2000-270221 | Sep 2000 | JP |
| 2001-36811 | Feb 2001 | JP |
| 2001-223892 | Aug 2001 | JP |
| 2002-084421 | Mar 2002 | JP |
| 9834397 | Aug 1998 | WO |
| 9940729 | Aug 1999 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20070127841 A1 | Jun 2007 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11197709 | Aug 2005 | US |
| Child | 11671834 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10098904 | Mar 2002 | US |
| Child | 11197709 | US |
