The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description taken with the accompanying drawings in which:
An embodiment of the present invention is explained in detail next with reference to accompanying drawings.
The MFP is an image processing apparatus comprising a digital multifunction machine for carrying out monitor display output of image data of an image read from an original, carrying out paper output, and carrying out a distribution application for distributing data to a terminal device via a network. In the MFP, the functions of the below-described various means are performed by carrying out an image processing method that comprises installing in a microcomputer a program for executing an image input procedure, a first image conversion procedure, an image storage procedure, an image edit procedure and a second image conversion procedure, and executing that program.
In the MFP, as illustrated in
As illustrated in
In the scanner γ correction unit 20 the device-specific RGB signal image data is corrected based on a reference table (Look-up table: LUT) of input 8-bit and output 8-bit for each RGB channel. In the filter processing unit 21 the image data is subjected to spatial filter processing based on a matrix of about 5×5. In the color correction unit 22, the inputted RGB image data is subjected to linear transformation, on the basis of a 3×3 matrix, into RGB image data for output. This conversion can also be carried out using a three-dimensional LUT. Standard RGB signal image data is then outputted to the image storage unit 3.
The image data is also inputted to an image area separation judging unit 23 where the image data is subjected to image area separation judging on the basis of an image area separation judgment algorithm.
In this image area separation judging process it is judged whether an object pixel in the image data is black or of a color other than black, and simultaneously, whether the object pixel is a character or non-character pixel (halftone dot, solid, background), such that a signal b(00) for black character, a signal b(01) for black non-character, a signal b(10) for color character, and a signal b(11) for color non-character are respectively outputted, as image area separation signals (image area separation information), to the image storage unit 3.
The device-specific RGB signal image data read by the image reading unit 1 is inputted to the first image correction unit 2 of
Standard RGB signal image data after this conversion is associated with the image area separation signal and both are stored in the image storage unit 3. The image storage unit 3 corresponds to the image storage means. The image storage unit 3 is a storage device comprising, for instance, a mass-storage device not shown in the figure, equipped with a compression-decompression device, a semiconductor memory, and a hard disk or the like. Such a storage device is well known, and hence a detailed description thereof will be omitted here.
Next, the image data and the image area separation signal are read out from the image storage unit 3 of
Since image edit processing is well known, a detailed explanation thereof is omitted here. In broad terms, however, image editing can be divided into adjustment of color, including density adjustment, color conversion and the like, and transformation of the image address, including image translation, rotation and the like. The process under consideration herein is image editing relating to color.
The image data and the image area separation signal outputted from the image editing unit 4 are sent respectively to the second image correction unit 5, the third image correction unit 6 and the fourth image correction unit 7, where they are converted into color spaces that conform to the devices that are the output destinations of the image data.
The second image correction unit 5 of
The resolution conversion process carried out in the resolution conversion unit 30 is a process comprising image expansion/contraction in accordance with a well-known technology such as three-dimensional function convolution.
The color correction process carried out in the color correction unit 31 comprises, for instance, conversion from a standard RGB color space to a color space that conforms to the display capabilities of the image display unit 8, using 3D-LUT color correction.
The third image correction unit 6 of
As illustrated in
The resolution conversion process carried out in the resolution conversion unit 40 comprises image expansion/contraction in accordance with a well-known technology such as three-dimensional function convolution. The color correction process carried out in the color correction unit 41 comprises conversion from a standard RGB color space to a color space that conforms to the image forming unit 9, in this case conversion to a CMYK signal. In the halftone process carried out in the halftone processing unit 43 is performed conversion to a low-bit signal for printing on paper, by means of a well-known technology such as error diffusion, dithering or the like.
The fourth image correction unit 7 illustrated in
The resolution conversion process carried out in the resolution conversion unit 50 comprises image expansion/contraction in accordance with a well-known technology such as three-dimensional function convolution. The color correction carried out in the color correction unit 51 comprises, for instance, conversion from a standard RGB color space to a color space conforming to the terminal device that is the output destination via the network I/F 10, using 3D-LUT color correction. This may be, for instance, conversion to sRGB signal image data.
Although the internal constitution of the second image correction unit 5 and the fourth image correction unit 7 as depicted are identical, there are differences in the details of their actual constitutions.
In the second image correction unit 5, image data is converted to image data that is displayed for pre-confirmation in the MFP, prior to output of the image data to the image forming unit 9 or a PC. In the fourth image correction unit 7, by contrast, it is assumed that the image data is transferred to a PC on a network, where it is used, on the assumption that image data is used in the PC at a relatively high resolution. Hence the required functionalities in these two image correction units are different.
In the MFP, the operative unit 11 instructs the content of the desired editing for the image data stored in the image storage unit 3. This instruction is forwarded to the image editing unit 4 via the control unit 12.
When an instruction from the operative unit 11 is a preview (pre-confirmation), the second image correction unit 5 causes to be displayed on the image display unit 8 an image that reflects the content of the edit process of the image editing unit 4. When the edit content is unsatisfactory, the user prompts preview through another instruction from the operative unit 11. When the edit content is satisfactory, the image data after editing is outputted to the image forming unit 9 based on an instruction from the operative unit 11 prompted by the user.
It becomes thus possible to store image data, edit the image data, and display the edited image data on the image display unit 8 prior to output of the edited image data to the image forming unit 9. Also, the image data after image edit can be used collectively for display, for output in the image forming unit 9, and for transmission to a scanner application, whereby image data can be printed or electronically distributed with the same image quality as viewed on the image display unit 8.
In the MFP, the image data after image editing may be stored again in the image storage unit 3. That is, the image data after being edited in the image editing unit 4 is stored in the image storage unit 3, as illustrated in
If the previewed image content is non-problematic, thus, the image data after editing, which is stored in the image storage unit 3, can be outputted without modification.
A substantial improvement in productivity can be achieved as a result, when that image editing is not processed in real time, as in a CPU or the like. Also, the content after editing stored in the image storage unit 3 can be repeatedly edited any number of times.
Storing again image data after image editing and displaying the image data on the image display unit enables thus repeated editing over several times and verification of the image content each time.
Since the image data after image editing is stored in the image storage unit 3, the image data after image editing can be processed and outputted by the third image correction unit 6 and the fourth image correction unit 7 without having to be edited again, affording thus high-speed processing.
The process of the above preview display operation is preferably completed quickly after an instruction by the user. That is because a rapid operation is required irrespective of the speed of original image reading in the image reading unit 1 or of the printing speed in the image forming unit 9. Hence, color correction in the above second image correction unit should be carried out speedily and using a simple constitution.
In this second image correction unit 5, there is provided a masking color correction unit 32 for color correction by a matrix operation using a matrix of about 3×3, instead of the above color correction unit 31, such that the image data edited by the image editing unit 4 is converted into image data that is color-corrected on the basis of the resolution to be used in the image display unit 8, which is the output destination, and on the basis of the masking computation.
Thus, the image data after resolution conversion by the resolution conversion unit 30 is subjected to color correction in a simple circuit having a high processing speed, or using an algorithm, which allows reducing the computational burden and displaying speedily a preview of the image. A constitution having a function for immediate display of an edited image can thus be realized at a low cost.
Ordinarily, color reproduction ranges differ for the image forming unit 9 and the sRGB signal image data.
In the second image correction unit 5, therefore, color conversion is carried out based on the color range that corresponds to the output destination, as instructed by the operative unit 11, to enable thereby a high-precision match between the printed or electronically distributed output image and the display image. Using 3D-LUT for color correction in the color correction unit 31 of the second image correction unit 5 allows converting image data to any color space simply by modifying the parameters of the 3D-LUT.
Accordingly, the output image and the display image can be matched by modifying the parameters of the 3D-LUT following an instruction by the operative unit 11.
Thus, the color of the display image, the color of the print image as well as the color of the display image or print image at the electronic distribution destination can be matched by modifying the color correction parameters of the color correction unit for display, depending on the output destinations, i.e. the image forming unit and the network I/F, and by performing color correction taking into account the color reproduction ranges of the devices that are the output destinations.
In the third image correction unit 6, ordinarily, the parameters of internal color conversion are modified depending on whether the judgment result of the image area separation judgment, based on the image separation signal bn, is a black character, a black non-character, a color character or a color non-character. That is because color characters are preferably reproduced vividly, but non-character portions are preferably reproduced in natural hues.
Therefore, the color conversion parameters must be changed in accordance with the image area separation signal bn, also during color conversion in the second image correction unit 5, in order to match the color of the image data of the image outputted to the image forming unit 9 or the network, with the color of the image of the image data outputted to the image display unit 8.
In the first color correction unit 33 and the second color correction unit 34 there are set different parameters, such that the first color correction unit 33 outputs first sRGB signal image data resulting from 3D-LUT conversion of the image data outputted from the resolution conversion unit 30, on the basis of first parameters (for instance, parameters of color character). The second color correction unit 34 outputs second sRGB signal image data resulting from 3D-LUT conversion of the image data outputted from the resolution conversion unit 30, on the basis of second parameters (for instance, parameters of color non-character).
Based on the content of the image area separation signal, the selector 35 outputs to the image display unit 8 either the first sRGB signal image data or the second sRGB signal image data, whereby the image data edited by the image editing unit 4 is converted to resolution for output in the image forming unit 9 or the network, and is converted into image data that is color-corrected based on the color correction parameters that differ for output to the image forming unit 9 and for output to the network.
In the third image correction unit 6, thus, the color correction parameters are switched based on the result of the image area separation signal, while in the second image correction unit 5, likewise, the color correction parameters for display are switched based on the image area separation signal. Accordingly, process carried out in accordance with the foregoing enables high-precision matching of the print image and the display image.
The above image display unit 8 has ordinarily a size of about 640×480 pixels. On the other hand, the stored image data has an A4 size with about 9000×7000 pixels. Thus, display is impossible unless the image data is subjected to resolution conversion with a large compression ratio. The stored image data, moreover, is the image data read by the image reading unit 1; accordingly, when there are halftone dot portions in the original, the relief of the halftone dots remains in the stored image data, so that compression by thinning of the unmodified image data can result in the occurrence of an extreme moiré effect.
Herein, strong smoothing may be carried out, although it is possible that the image may be blurred, allowing no crisp viewing, if the display area of the image display unit 8 is small.
This second image correction unit 5 comprises a smoothing filter 36 before the resolution conversion unit 30, such that respective interpolation coefficients of the smoothing filter 36 and the resolution conversion unit 30 are switched based on the image area separation signal. The image data edited by the image editing unit 4 is converted to image data having been subjected to smoothing filtering using an interpolation coefficient that is modified based on image area separation information corresponding to the image data, to resolution conversion using an interpolation coefficient modified based on the image area separation information, and to color correction.
This allows generating an image free of moiré patterns in the halftone dot portions of the image, and without loss of resolution in character portions.
Thus, modifying the interpolation coefficient in the resolution conversion unit based on the image area separation signal and on the conversion resolution allows generating, during expansion, a faithful image of portions judged to be non-character portions, and during compression, generating images with suppressed moiré effect, while preserving the resolution of portions judged to be character portions.
The occurrence of a moiré effect in halftone dots in the image is suppressed in the above process, although such a process may be impractical for characters, on account of character blurring or fading. Herein, the reduction operation method in the resolution conversion unit may be switched to another method based on the image area separation signal.
This second image correction unit 5 comprises a resolution conversion unit 37 for resolution conversion of the image data edited by the image editing unit 4, based on an image area separation signal, such that the image data edited by the image editing unit 4 is converted to image data having been subjected to resolution conversion using a resolution conversion method modified based on the image area separation information corresponding to that image data, and to color correction. In the resolution conversion unit 37, the image data is subjected to resolution conversion by switching between reduction operation methods on the basis of the image area separation signal.
The above reduction operation method has the problem of information loss through compression of portions in the image judged to be characters, and hence loss of characters and/or lines is prevented by carrying out OR processing among the pixels to be thinned, followed by pixel thinning.
An example of compression computation processing of image data will be explained next with reference to
In the case, for instance, of correction of the image data resolution from 600 dpi to 200 dpi, when both end pixels of three consecutive pixels are white pixels and the middle pixel is black, as illustrated by (i) in
Meanwhile, in the case of three consecutive pixels being all white, as illustrated b7 (i) in
For the non-character portions of the image, carrying out compression computation using a well-known technology such as three-dimensional function convolution allows generating a display image without information loss, even during compression of character portions.
During image display of image data compressed in the second image correction unit, thus, carrying out OR-thinning compression in character portions, and an ordinary interpolation computation in other portions, allows obtaining a display image having no loss in character portions and being faithful to the output image in other portions.
As explained above, thus, the image processing apparatus and image processing method according to the present invention allow providing an image processing apparatus in which an image obtained by image reading can be printed or used in another apparatus in a state identical to the appearance of the image when displayed. Also, the program according to the present invention allows realizing a function that enables printing, or using in another device, of an image in a state identical to the appearance of the image, obtained by image reading, when displayed on a computer.
Various modifications will become possible for those skilled in the art after receiving the teachings of the present disclosure without departing from the scope thereof.
Number | Date | Country | Kind |
---|---|---|---|
2006-197128 | Jul 2006 | JP | national |