Patent Grant
7113639
1. Field of the Invention
The present invention relates to an image processing apparatus and a processing method therefor, and more particularly to an image processing apparatus for classifying the input image and converting it into density characteristics suitable for the kind of the image, and a processing method therefor.
2. Related Background Art
As a process function of an image input apparatus or an original copying apparatus, it is commonly executed to classify the input image data according to the kind of the image, and to execute a filtering process, a γ correction etc. suitable for the property of the original image to be processed, thereby improving the quality of the image.
There have been conceived various processing methods for classifying the kinds of the images. In most of these methods, a feature amount corresponding to the kind of the image is extracted and is evaluated by an evaluation function or a discrimination function determined in advance, thereby determining the kind of the image. The feature amount is often the generation frequently of black pixels or edges within a predetermined block area in the image, a histogram of the density levels, a spatial frequency distribution, or a directional distribution of lines.
The filtering process is to enhance or improve a localized feature of the image thereby improving the image quality of the original image, and includes an integrating filter for alleviating noise texture, and a differential filter for enhancing the edges in the image thereby providing the image with a more vivid feeling.
The γ correction executes tonal correction for the image density. Examples of tonal correction for the image density include a process of uniformly extending or compressing the dynamic range of the density values, and a non-linear conversion of extending or compressing a particular density range in contrast to other ranges.
The object of the present invention is to provide an image processing apparatus and a processing method therefor, capable of classifying the kind of the input image based on the feature of the input image, and effecting density correction according to each kind.
To achieve the above object, the method of and the apparatus for reading images according to the present invention is constructed as follows.
An image processing method comprising the steps of:
detecting the density difference of each pixel in the input image from the adjacent pixels;
generating a histogram of the density differences detected in the density difference detecting step;
generating a function approximating the histogram generated in the histogram generation step; and
discriminating the kind of the input image from the coefficient of the function generated in the approximation function generating step.
An image processing method comprising the steps of:
reading an original and generating input image data;
calculating the sharpness of the input image from the input image data;
discriminating whether the original is a text original or a photograph original from the sharpness of the input image; and
applying, in case the original kind discrimination step discriminates that the original is a text original, a density correction process to the input image obtained by reading the original;
wherein the text image density correction step includes:
a density histogram generation step of generating a density histogram from the input image;
a density correction curve generation step of generating a density correction curve based on a ratio of the number of data close to the light and dark ends in the histogram to the total number of data in the histogram; and
a density correction step of executing density correction on the input image, based on the density correction curve generated in the density correction curve generation step.
An image processing method comprising the steps of:
reading an original with a first reading condition to generate input image data;
calculating the sharpness of the input image from the input image data;
discriminating whether the kind of the original is a text original or a photograph original, based on the sharpness of the input image; and
applying, in case the original kind discrimination step discriminates that the original is a photograph original, a density correction process to the input image obtained by reading the original;
wherein the photograph image density correction step includes:
a density histogram generation step of generating a density histogram from the input image;
a cumulative histogram generation step of cumulating the frequency of density level values in an increasing direction of the density level value, taking the minimum density level value of data of the density histogram obtained in the density histogram generation step as a reference and starting point of cumulating operation, thereby obtaining a cumulative histogram indicating the relationship between the density level value and the cumulated value;
a first γ value obtaining step of calculating an approximation exponential function approximating the density histogram and obtaining a first γ value indicating the density correction coefficient of the input image from the exponent of thus calculated function; and
a first density correction step of executing a density correction process of the input image, based on the first γ value.
Now the present invention will be clarified in detail by preferred embodiments thereof, with reference to the accompanying drawings.
At first there will be explained the outline of the operations of the image processing apparatus embodying the present invention according to flow charts, and then there will be explained a discrimination process for the kind of the original, constituting the main feature of the present invention.
Referring to
The electrical signal, obtained by photoelectric conversion in the image pickup device 204, is supplied to an electrical board 205 in an image reading apparatus 201. The electrical board 205 is provided with units 102˜105 shown in
A shading correction circuit 103 stores a reference level data prepared by reading a reference white board provided outside the original reading area with the image sensor 101, as shading correction data, and executes shading correction on the image data generated by reading the read original, utilizing such correction data. The shading correction data are stored, after the acquisition thereof, in an external memory apparatus 106, and the data required in the scanning operation are downloaded to the image reading apparatus of the present embodiment.
A data processing circuit 104 executes for example a packing process according to an image reading mode (for example binary or 24-bit multi-value) designated in advance from an external apparatus 106.
An interface circuit 105 executes exchange of control signals with or outputs an image signal to the external apparatus 106 such as a personal computer, constituting the host apparatus of the image reading apparatus of the present embodiment.
An external apparatus 106 is composed of a host computer, and is provided with a scanner driver for controlling the image reading apparatus. The external apparatus 106 and the image reading apparatus integrally constitute an image processing system.
The scanner driver is provided with a user interface for instructing the image reading mode, resolution, image reading area etc. and transmits control signals or a reading start command etc. based on such the instruction to the image reading apparatus through the interface circuit 105. The scanner driver also executes an image display, by processing in succession the image data read by the image reading apparatus according to the control signal. In such operation, the scanner driver executes a gamma correction process of the present embodiment.
The image processing apparatus of the present embodiment is provided with a function of discriminating, based on a preview image read with a low resolution, the kind of the original image as one of text original, photograph original and another original, then operating a density conversion table (hereinafter called γ table) prepared for each kind of the original, and optimizing the density of a main scan image to be read subsequently.
The image processing apparatus receives a preview image of a relatively low resolution, read for example with the image reading apparatus, and also receives, at the same time, a position on the preview image of a main scan reading area to be finally stored (step S301).
The image processing apparatus discriminates, by an image kind discriminating procedure to be explained later in more details, the kind of image of the designated reading area on the preview image as either one of text original, photograph original and another original (step S302). In case all the pixels in the designated area of the preview image have a same value, for example a solid white or black image, the discrimination is judged impossible. In such case the density distribution of the original is not adjusted and there is prepared a through γ-table (steps S303, S305). In such through γ-table, the input values directly become the output values.
In the discrimination of the kind of the image is completed in normal manner (step S304), there is executed an operation of generating a γ-table according to the result of such discrimination and the density distribution within the designated area in the preview image (step S306, S307, S308). The details of this operation will be explained later.
Then the γ-table, calculated from the image kind of the preview image and the density distribution, is used for executing density conversion of the preview image (step S309), and an image showing the result of such correction is displayed to the operator (step S310). If the image satisfies the intention of the operator, the sequence proceeds to a request for the main scan data, but, if necessary, there is executed a fine adjustment of the γ-table (step S312) and the preview image display is renewed again (step S310) to await a further instruction of the operator (step S311).
Subsequently, the image reading apparatus reads the original with a resolution instructed by the operator (step S310, main scanning operation). Upon receiving the original image (main scan image), the image processing apparatus executes optimization of the density distribution, utilizing the γ-table established in advance, thereby preparing image data subjected to adjustment of density gradation optimum to the content of the original image (step S314).
In the foregoing description, the optimization of the density distribution of the main scan image based on the γ-table is executed by the image processing apparatus, but, if the image reading apparatus is equipped with the γ-table and is capable of executing the density conversion process, there can also be adopted a configuration in which the γ-table is transferred from the image processing apparatus to the image reading apparatus prior to the main scanning operation and the optimization of density distribution is executed in the image reading apparatus.
Discrimination of Kind of Original
In the following the image kind discriminating procedure of the present embodiment will be explained in detail, with reference to a flow chart and an example of the frequency distribution.
As shown in the flow chart in
After the calculation of the frequency distribution of the density difference of all the pixels, the frequency of a density difference 0 is doubled. Since the density difference is calculated by the absolute value, so that the density difference of 1 or larger includes the density changes both in the positive and negative directions. In comparison, the probability of a density difference 0 becomes ½, and the above-mentioned doubling operation intends a correction for such difference in the probability.
The frequency distribution of density (for example for R color) and the frequency distribution of density difference (for example in X-direction in R color), prepared in the above-described procedure, assume forms as shown in
The present original kind discrimination process, utilizing the above-described feature in the frequency distribution of the density difference, approximates the central portion of such frequency distribution of density difference by a first-order function and adopts the inclination thereof as a feature amount parameter. The operation procedure will be explained in the following with reference to
At first there is calculated the total cumulative value of an area surrounded by the minimum value of the density difference frequency distribution (about −6 in
fRX(d)=KRX*d+BRX (1)
is operated by the least square method.
Similarly first-order functions representing the features of the density difference frequency distributions are calculated utilizing the density difference frequency distribution in the Y-direction and those of G and B colors to obtain inclination coefficients KRX, KGX, KBX, KRY, KGY, KBY (step S402).
The kind of the original is discriminated utilizing the feature amount parameters calculated in the above-explained procedure and referring to predetermined plural discrimination criteria (step S403). In the following there is shown an example of the discrimination criteria:
The original is discriminated as a photograph original if:
The original is discriminated as a text original if:
The original is discriminated as a text original if:
The original is discriminated as another original if none of these discrimination criteria is met.
In the foregoing, Tp1, Tp2, Tt1 are constants determined experimentally in advance.
The discrimination criterion 1 or 2 indicates the conditions that the feature amount parameters in all the colors and all the directions represent a photograph original or a text original. Also the discrimination criterion 3 provides composite conditions that none of the feature amount parameters is discriminated as a photograph original and any one of the colors is discriminated as a text original. This discrimination criterion is provided for detecting an original in which the text is represented in one color only, and the accuracy of discrimination can be improved by adding discrimination criteria according to the features of the existing originals.
In the following there will be explained the procedure of generating a density conversion table optimum for the original density distribution, with reference to the accompanying flow chart.
At first, a step S801 generates a histogram by synthesizing all the R, G and B colors in case of a color mode as shown in
Upon determination of the density correction coefficient D, a step S804 generates an S-shaped text original density correction curve which provides an output f(x)=m×(x/m)^(1/D) for the data x of the section [s, m] and an output g(x)=N−(N−m)×((N−x)^(1/D) for the data x of the section [m, h] (FIG. 10), wherein N indicates the number of gradation level bits of the pixel and can be represented by N=(2^n)−1. Note that an operator A^B means A to the power of B. N=255 for a number of gradation levels of 8 bits. With such tone curve, a weaker or stronger S-shaped density correction is applied on the original image data for a larger or smaller density correction coefficient D.
Upon determination of the text original density correction curve, a step S805 executes synthesis with a monitoring gamma correction curve (
Density conversion table for photograph original
Referring to
Then a step S1202 searches, from the side of the density 0 (namely black) in the synthesized density frequency distribution of all the colors, a minimum density value (hereinafter called shadow value) and a maximum density value (hereinafter called highlight value) at which the frequency distribution actually exists, and a step S1203 calculates the cumulative value of the frequencies of the respective densities, from the minimum value toward the maximum value, as a function of the density value. As a result, there is obtained a cumulative value h(d) as a function of the density value d.
Then a step S1204 compares the calculated cumulative value of the frequency of the density, or the curve h(d) represented by the cumulative value, with the value of the following function:
g(d)=M(d−shadow)^G
to determine the exponent G of an approximating exponential function by the least square method, and M is an arbitrary number used for matching the maximum value in approximation. As the curve h(d) represented by the cumulative value and to be actually compared with the aforementioned equation, in case of 8-bit representation, there is used h′(d) in which a range less than the shadow value is normalized to 0 and a range equal to or higher than the highlight value is normalized to 255.
In this manner there can be obtained an exponential function which uniquely converting the density distribution, namely γ-coefficient. However, since there may occur a case where the tonal gradation of the original image is lost depending on the content of the original image, a certain parameter T is employed to apply an operation on the preview image with:
Preview image γ-coefficient=(G^T), 0<T<1.0 The parameter T is to further control the level of density correction, in addition to the γ-coefficient calculated from the density distribution of the preview image. Such parameter T, in case of 1.0, provides a correction amount of zero by such parameter T, but provides a larger correction amount as the parameter T becomes closer to 0. In the entire correction amount, T=1 provides the largest correction and corrects the density distribution of the original in most uniform manner, while T=0.0 provides a zero correction amount and does not affect the input density distribution. The default value is T=1. In such case, the density conversion table directly adopting the calculated γ-coefficient is prepared and used.
The γ-table, based on thus obtained γ-coefficient, generally assumes a form shown in
The above-described algorithm of preparing the density conversion table allows to obtain a density conversion table capable of increasing the contrast of a density area (range) in which the frequency distribution is concentrated, thereby realizing conversion to an image with rectified gradation.
In the following there will be given a detailed explanation on the γ-coefficient calculating procedure for main scan in the present embodiment, with an example of a γ-coefficient reflection table corresponding to the resolution designated for the main scan and to be used for a photograph original in the step S114 in
At first, the resolution at the pre-scan operation and the resolution for main scan to be designated by the operator are entered into the conversion table shown in
G′=Kg×G
For the input image data in the main scan, a γ-table is prepared utilizing the γ-coefficient G′ for main scan in a similar manner as in the preparation of the preview γ-table, and thus prepared γ-table is used for executing the density conversion of the image read in the main scan to achieve optimum conversion of the density gradation optimum for the reading resolution.
As explained in the foregoing, the image processing apparatus of the present embodiment is capable of preparing a density conversion table optimum for the image and optimizing the density gradation, by determining the cumulative frequency distribution from the synthesized density frequency distribution in the designated area on the input original image, then calculating an exponential function approximating the cumulative frequency distribution, and calculating a γ-coefficient corresponding to the designated main scanning resolution from the exponent of the exponential function.
Blocks 910 to 913 process a pre-scan image obtained by pre-scan to obtain a tone correction coefficient suitable for the pre-scan image. In these blocks, the exponent of an approximation exponential function is finally obtained as a γ-value indicating the tone correction coefficient.
A block 910 receives the pre-scan image, determines the minimum and maximum values of the pixel data and calculates the density frequency distribution. The obtained minimum and maximum density values are supplied to a correction table preparation unit indicated by a block 920. Also the data of the density frequency distribution are subjected to the preparation of a cumulative frequency distribution in a block 911, and, since the minimum and maximum values of such cumulative frequency distribution are determined specifically for the original image and the pre-scan condition, there is prepared a cumulative frequency distribution normalized to a predetermined range, for example a range from a minimum value of 0 to a maximum value of 255. The data of such normalized cumulative frequency distribution are entered into an approximation level confirming block 913. Receiving the data from the block 911, the block 913 controls a block 912 for calculating an approximation exponential function and finally determines the exponent of the approximation exponential function, utilizing the least square method.
The exponent from the block 912 is supplied, as the tone correction coefficient or γ-coefficient, to a block 914 which corrects the γ-coefficient obtained from the pre-scan image under fine adjustment according to the instruction from the operator as explained in the foregoing. However, immediately after the pre-scan operation, the entered γ-coefficient is transferred to the block 920 without change, and then is used for preparing the correction table, in this case a correction table for pre-scan image, based on the input data from the block 910 including the minimum and maximum values of the density values. The prepared correction table is transmitted to the block 921 for executing the density conversion of the pre-scan image therein. The data after the density conversion, in case of a pre-scan image, are transferred to the display apparatus to be presented to the operator. The operator observes the presented image, and, if necessary, manipulates the block 914 to execute fine adjustment of the γ-coefficient value.
In the procedure explained in the foregoing, the blocks 920, 921 are used for processing the pre-scan image. When a main scan is instructed from the operator in response to the result of the above operation or process, the blocks 910, 920, 921 executes a process on the main scan image. At first, at the reception of the instruction for the main scan from the operator, the γ-coefficient for the pre-scan image, stored in the block 914, is the tone correction coefficient which has been confirmed for the pre-scan image by the operator on the display apparatus, or has been finally accepted by the operator after fine adjustment. Such tone correction coefficient (γ-coefficient) is entered into a block 930 for converting the γ-coefficient for main scan, which also receives the resolution at the pre-scan operation, the resolution at the main scan operation and the information on the kind of the original, and is converted into a γ-coefficient for main scan. At the main scan operation, the block 920 receives the γ-coefficient from the block 930.
At the same time, the scanner 900 scans the original image under the condition for the main scan, and stores the main scan image in the storage unit 901. Thereafter the block 910 reads the data from the storage unit, then acquires the minimum and maximum values of the density level and transmits these data to the block 920, as in the pre-scan operation.
Receiving the minimum/maximum values from the block 910 and the main scan γ-value from the block 930, the block 920 prepares a density correction table for density conversion of the main scan image. Thus prepared density correction table is used in the block 921 for the density conversion of the main scan image, and the converted main scan image is outputted for example to the printer or the storage apparatus.
In the block 920, the correction table is prepared in the following manner. For example, with the γ-coefficient alone from the block 914 or the block 930, there can only be obtained the conversion characteristics as shown in
In case the conversion table is prepared in the above-explained manner, the minimum density level, for example level 31, can be converted into an output density level 0. Thus, in such conversion, the density range can be expanded in comparison with the case of no conversion. It is also possible to execute the conversion in such a manner that the minimum density level after the conversion becomes equal to that before the conversion.
In the foregoing description, the density conversion of the main scan image is executed after the synthesis of the monitoring γ-characteristics only in case of a text original, but a similar process is applicable also to a photograph original, and the density conversion may also be executed without the synthesis of the γ-characteristics of a monitor device.
The present invention can naturally be attained also by supplying a system or an apparatus with a memory medium storing program codes of a software realizing the functions of the aforementioned embodiments and causing a computer (or CPU or MPU) of such system or apparatus to read and execute the program codes stored in the memory medium.
In such case, the program codes themselves read from the memory medium realize the novel functions of the present invention, and the memory medium storing the program codes constitutes the present invention.
The memory medium for supplying the program codes can be, for example, a floppy disk, a hard disk, a magnetooptical disk, an optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card or a ROM.
The functions of the aforementioned embodiments can be realized not only in a case where the computer executes the read program codes but also a case where an operating system or the like functioning on the computer executes all the actual processes or a part thereof under the instructions of the program codes, thereby realizing the functions of the aforementioned embodiments.
The functions of the aforementioned embodiments can also be realized in a case where the program codes read from the memory medium are once stored in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected thereto, and a CPU or the like provided on such function expansion board or function expansion unit executes all the actual processes or a part thereof under the instructions of such program codes.
The present invention is naturally further applicable to a case where the program codes realizing the novel functions of the aforementioned embodiments are distributed, from a memory medium storing such program codes, to a requesting person through a communication line.
Many widely different embodiments of the present invention may be constructed without departing from the spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific embodiments described in the specification, except as defined in the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2001/239139 | Aug 2001 | JP | national |
| 2001/239140 | Aug 2001 | JP | national |
| 2002/005181 | Jan 2002 | JP | national |
This application is a divisional of U.S. Ser. No. 10/211,520 filed Aug. 5, 2002, now U.S. Pat. No. 7,016,534.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4830501 | Terashita | May 1989 | A |
| 5048110 | Nakajima | Sep 1991 | A |
| 5123060 | Cho et al. | Jun 1992 | A |
| 5412737 | Govrin | May 1995 | A |
| 5596654 | Tanaka | Jan 1997 | A |
| 5696595 | Yamanishi | Dec 1997 | A |
| 5805723 | Fujiwara | Sep 1998 | A |
| 5937090 | Kim | Aug 1999 | A |
| 6009193 | Mita | Dec 1999 | A |
| 6026181 | Murakami | Feb 2000 | A |
| 6055331 | Nakamura | Apr 2000 | A |
| 6078410 | Adachi | Jun 2000 | A |
| 6198844 | Nomura | Mar 2001 | B1 |
| 6222642 | Farrell et al. | Apr 2001 | B1 |
| 6433898 | Bestmann | Aug 2002 | B1 |
| 6643397 | Kanamori | Nov 2003 | B1 |
| 7016086 | Honda | Mar 2006 | B1 |
| 7016534 | Fukawa et al. | Mar 2006 | B1 |
| 7019756 | Park et al. | Mar 2006 | B1 |
| 20030043410 | Fukawa et al. | Mar 2003 | A1 |
| 20060039604 | Fukawa et al. | Feb 2006 | A1 |
| Number | Date | Country |
|---|---|---|
| 0 389 811 | Oct 1990 | EP |
| 0 389 811 | Oct 1990 | EP |
| 0 866 601 | Sep 1998 | EP |
| 0 866 601 | Sep 1998 | EP |
| 1 079 601 | Feb 2001 | EP |
| Number | Date | Country | |
|---|---|---|---|
| 20060039604 A1 | Feb 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10211520 | Aug 2002 | US |
| Child | 11254639 | US |
