The present invention relates to an image processing apparatus and image processing method and, more particularly, to an image processing apparatus and image processing method which suppress, at a low cost, jaggies in the edge portions of image which has undergone halftoning processing.
More specifically, the present invention is oriented to a copying machine or printer using an electrophotographic process but can also be applied to an apparatus using another process, like an inkjet printer or display.
Conventionally, several techniques have been proposed to cause an image processing apparatus to suppress jaggies generated in a low-resolution printer.
Referring to
In a conventional technique to suppress the jaggy, pattern matching is executed for jaggies. Pixel is added to each portion corresponding to the pattern, or pixel that causes the jaggy is removed, thereby suppressing the jaggies.
The pattern matching is a known technique, and a detailed description thereof will be omitted.
In the state shown in
In the state shown in
“Pixel division” is a technique of dividing one pixel of 300 dpi into a plurality of parts and a dot is assigned to each part. In this example, a pixel is vertically divided into two parts. The pixel division is also a known technique, and a detailed description thereof will be omitted.
As described above, an example of smoothing processing is implemented by adding a halftone dot or pixel-divided dot to each jaggy portion. As another possible processing, dark pixels in jaggy portions may be changed to light dots, i.e. halftone dots, or full dots in jaggy portions are converted into pixel-divided dots.
Japanese Patent Laid-Open No. 10-42141 discloses a technique of improving such problems in a conventional image processing apparatus of this type.
A technique shown in
More specifically, the jaggy portions shown in
As the printer resolution rises, the above-described jaggies caused by the printer resolution rarely pose problems. More specifically, when the printer resolution increases to, e.g. 600 dpi or 1,200 dpi, jaggies are rarely recognized by human eyes.
However, jaggies generated by the image transforming method such as screen processing can easily be recognized even at a higher printer resolution. In screen processing, pixels are formed by concentrating a plurality of dots by using a pattern generally called fattening, thereby expressing a pseudo screen resolution (number of lines). Hence, a screen resolution (number of lines) higher than the printer resolution is never used. When screen-processed image data is output by a printer having a resolution of, e.g., 600 dpi, the screen resolution (number of lines) is generally, about 133 to 175 lines and, at most, about 268 lines. If a screen with a larger number of lines than the above number of lines is used, no stable image quality can be obtained because of the characteristic of the electrophotographic printer. The unit of the number of lines is generally defined as LPI (Lines Per Inch).
To suppress jaggies generated by the latter image transforming method (screen processing), a method of assigning halftone dots to the above-described edge portions is used. However, this method requires complex operations and a large memory capacity. For this reason, an apparatus equipped with the technique to implement the method tends to be expensive. To equip an inexpensive electrophotographic printer or MFP with the technique, a method capable of suppress the above-described jaggies with a simpler arrangement is necessary.
It is a feature of the present invention to suppress jaggies generated by an image transforming method by a simple arrangement.
According to an aspect of the present invention, there is provided with an image processing apparatus for suppressing jaggies in second image data on the basis of first image data, the second image data obtained by executing halftoning processing for the first image data, and attribute data representing an attribute of each pixel contained in the first image data, comprising:
determination means for determining whether or not to execute smoothing processing on the basis of the attribute data, and outputting a judgment signal indicating the determination result;
edge correction generation means for generating edge correction data from the first image data by executing smoothing processing in accordance with the judgment signal; and
selection means for comparing pixel data of the second image data with pixel data of the edge correction data output by the edge correction generation means and selecting the pixel data having a higher density.
According to another aspect of the present invention, there is provided with an image processing method of suppressing jaggies in second image data on the basis of first image data, the second image data obtained by executing halftoning processing for the first image data, and attribute data representing an attribute of each pixel contained in the first image data, the method comprising:
a determination step of determining whether or not to execute smoothing processing on the basis of the attribute data, and outputting a judgment signal indicating the determination result;
an edge correction generation step of generating edge correction data from the first image data by executing smoothing processing in accordance with the judgment signal; and
a selection step of comparing pixel data of the second image data with pixel data of the edge correction data output in the edge correction generation step and outputting pixel data having a higher density.
According to the present invention, jaggies generated by halftoning processing can be suppressed with a simple arrangement.
This is effective for jaggies contained in image data, which has undergone image transformation such as screen processing, image data having a degradation in image quality in an edge portion as in JPEG, or image data which has undergone error diffusion processing so that any degradation in image quality can be prevented properly.
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Preferred embodiments of the present invention will now be described in detail in accordance with the accompanying drawings.
In the color scanner section A shown in
The reflected light incident in the CCD 209A is separated into three colors R (red), G (green), and B (blue) and read as a luminance signal for each color. The luminance signal of each color output from the CCD 209A is A/D-converted into digital image data of each color and input to an image processing section (304 in
In the printer section B shown in
A developing unit 203B applies toner serving as a developing substance to the latent image portion on the photosensitive drum 202B.
A printing paper sheet is fed from selected one of cassettes 204B and 205B at a timing synchronous with the start of above-described laser irradiation and conveyed to a transfer section 206B.
With this operation, the toner applied to the photosensitive drum 202B can be transferred to the printing paper sheet. The paper sheet on which the toner is transferred is conveyed to a fixing section 207B. The fixing section 207B fixes the toner on the paper sheet by heat and pressure. The paper sheet, which has passed through the fixing section 207B, is discharged by discharge rollers 208B. A sorter 220B sorts discharged paper sheets by storing them in predetermined bins.
Without sort setting, the sorter 220B stores the paper sheets in the uppermost bin. When double-sided printing is set, the paper sheet conveyed to the discharge rollers 208B is guided to the re-feed convey path through a flapper 209B by reversing the rotational direction of the discharge rollers 208B. When multi-overlay printing is set, the paper sheet is guided to a re-feed convey path 210B through the flapper 209B not to convey the paper sheet to the discharge rollers 208B. The paper sheet guided to the re-feed convey path is fed to the transfer section 206B at the above-described timing.
The latent image formation, developing processing, and fixing for the respective colors are implemented by repeating the latent image formation and the like four times (for Y, M, C, K) by using the above-described paper sheet conveyance mechanism, as is known.
With a network cable 314, a system generally called an Ethernet is formed. When a physical cable such as 10BaseT or 10Base5 and a protocol such as TCP/IP may be used, information transmission/reception or data transfer can be done between the connected units. The present invention is not limited to a wired system using a network cable. The same environment as described above can be built in a wireless network.
PDL data or a display list transmitted from the host computer through the network cable 314 is received by a network signal reception section 315 serving as an interface provided in the printer. The network signal reception section 315 includes a rasterize section (not shown) which interprets data transmitted from the host computer and generates bitmap data representing an image. PDL data or a display list holds data representing the attribute of each object such as a text (character), graphic, and image. A rasterize section generates image data and an image attribute signal of each pixel by using the attribute data. The image attribute signal will be described later in detail.
The image data generated by the rasterize section is input to the image processing section 304, as well as a case of image data input from an image reading section 309. The image data is input to a filter, as indicated by an arrow, so that necessary image processing is executed. The image attribute signal is input to a smoothing processor. For color image data, density data of each of the colors C, M, Y, and K is generated, and the processing of the succeeding stage is executed for the data of each color.
The rasterize section may be provided outside the network signal reception section 315. In this embodiment, an arrangement to process data received through the network cable 314 will be described later.
Referring to
The converted digital signal is processed in shading corrector 401, color correction processor 402, filter 403, γ-corrector 404, image transformer 405, and smoothing processor 406 in the image processing section 304 whose details are illustrated in
Processing operations except the smoothing processor 406 including the point of the present invention are also known, and a description thereof will be omitted.
Referring to
The printer 305 shown in
The CPU circuit 310 includes a CPU 306, ROM 307, and RAM 308. The CPU circuit 310 controls the image reading section 309, image processing section 304, printer section 305, and operation section 313 and systematically controls the sequence of the multi-functional device.
A RAM 311 and ROM 312 are prepared in the operation section 313 so that characters can be displayed on the UI, or information set by the user can be stored or displayed.
Information set by the user on the operation section 313 is sent to the image reading section 309, image processing section 304, or printer 305 through the CPU circuit 310.
The characteristic portion of the present embodiment is included in the processing of the image processing section 304. The smoothing processor 406 in the image processing section 304 will be described below. Constituent elements to be described below are implemented by software, i.e., programs created by the C language. However, equivalent functions may be implemented by hardware or firmware. That is, even when each or some of the constituent elements are formed by using dedicated hardware such as ASIC, the same effect as that of software can be obtained.
The smoothing processor 406 receives the upper 3-bit signal of N=8 bits of an image signal supplied from the γ-corrector 404, i.e., before image transformation (e.g., halftoning processing such as screen processing), a 4-bit image attribute signal representing the attribute of each pixel, and M=4 bits of an image signal which has undergone the image transformation. The image signal outputted from the γ-corrector 404 is expressed by ImageData (first image data); the image attribute signal, AttributeData (attribute data); and the image signal outputted from the image transformer 405, ScreenData (InDataS) (second image data).
The image attribute signal (AttributeData) is data representing the attribute of the image (i.e. whether the image is text (character), image (photo), graphic, or the other) formed by each pixel. This 4-bit signal is converted into an 8-bit image attribute signal by an attribute decoder 510, as will be described later.
A determination section (make_ZSG_sig) 501 serving as a determination means generates a judgment signal (OutDataZ) to be used to determine whether or not to execute smoothing processing. A processing execution section (make_AST_sig) 502 serving as an edge correction generation means executes smoothing processing corresponding to the judgment signal. A selector 503 serving as a selection means compares the output from the processing execution section 502 with ScreenData. Of the ScreenData and the value of pixel data, which has undergone the smoothing processing corresponding to the judgment signal, the pixel data having a larger-value is output as output data (OutputData).
Processing by each section in the above-described smoothing processor 406 will be described below in detail.
On the basis of these signals, the attribute decoder 510 generates an 8-bit signal. The table shown in
“REOS” in the table of
As described above, the attribute decoder 510 includes a conversion table, which converts a 4-bit input into an 8-bit output.
The operation of the determination section (make_ZSG_sig) 501 will be described next with reference to
As shown in
In a portion A shown in
The determination section 501 of this embodiment can execute not only the above-described control but also other several control operations. Switching of control is done in accordance with the signal from the above-described mode selector (register reg_atb).
For example, when reg_atb=1 in a portion C in
When reg_atb=2 in a portion D in
A portion E in
The processing execution section (make_AST_sig) 502 will be described next with reference to
As shown in
The judgment signal (OutDataZ) and the upper 3-bit signal (InData) are input to a reproduction section (Zexistence) 524 through the FiFo memories 521 and 522. Only the signal of the edge portion is regenerated. The selector 503 selects and outputs one of the 4-bit signal (InDataS) and the output signal from the reproduction section (Zexistence) in accordance with the output from a selection section (make_select_sig) 525. The selection section (make_select_sig) 525 generates the selection signal in accordance with the difference (density difference) between the upper 3-bit signal (InData) and the 4-bit signal (InDataS). In this embodiment, processing is simplified in this way, thereby reducing the cost. Details of processing will be described later.
The selection section (make_select_sig) 525 will be described with reference to
As described above, the selection section 525 receives InData and InDataS. The selection section 525 basically executes processing of comparing the signals and outputting “1” if InData is larger than InDataS, and “0” if InData is smaller than InDataS. Since the selection section 525 compares InData of 3-bit data with InDataS of 4-bit data, the bit-lengths of InData and IndataS have to be made uniform before the comparison, as described in the program example shown in
In this way, InData and InDataS are compared, and a signal with a higher density, i.e., a signal with a larger value is selected. With this processing, the degradation of the image quality due to a thin edge or low density can be prevented.
More specifically, when the edge signal reproduced by the reproduction section (Zexistence) 524 (to be described later) is smaller than the edge signal of the original InDataS, and the signal from the reproduction section is output, the edge portion becomes thin, as described above, and the image quality is lowered. To prevent this, the selection section (make_select_sig) 525 is provided.
Processing of the reproduction part (Zexistence) 524 as a characteristic feature of this embodiment will be described in detail with reference to the block diagram in
The reproduction section (Zexistence) 524 receives InData and OutDataZ of three lines and InDataS of the line of interest. The reproduction section (Zexistence) 524 incorporates a 3×3 smoothing processor (x3smooth) 5241, pattern matching processing section (miniSST) 5242, edge detection processing section (BorderCount&DensCheck) 5243, and adaptive smoothing processor (AdaptiveSmoothing) 5244. A 4-bit output signal is generated by the processing of the sections. The processing of the sections will be described below in turn.
The 3×3 smoothing processor (x3smooth) 5241 calculates an average of the densities of 3×3 pixels of a 3×3 pixel region contained in InData. Processing of calculating the average of density is known, and a detailed description thereof will be omitted. For example, the number of pixels (pixels to be printed) with a density of 1 of nine pixels is obtained and divided by 9. In this embodiment, however, to reduce the load on the operation processing section, after the number of pixels to be printed in the 3×3 pixel region is obtained, 3-bit shift (=+8) is executed to obtain the output signal (smoothData).
The pattern matching processing section (miniSST) 5242 executes smoothing processing to suppress jaggies depending on the printer resolution by pattern matching. When the printer resolution is, e.g., 300 dpi, jaggies depending on the printer resolution, i.e., the L-shaped portions shown in
On the other hand, the edge detection processing section (BorderCount&DensCheck) 5243 generates an edge detection signal by using the OutDataZ signal.
As shown in
In this case, if the density value stored in an arbitrary register (reg_Zcheck) is close to the density value of a pixel contained in InData (=data), and InData (=data)=0, the value sum obtained in the above-described manner is cleared (the value is substituted with zero). With this processing, in a region where the density gradually changes like gradation, a creation of an erroneous edge signal can be suppressed and the gray level can be prevented from being discontinuous. That is, when the processing A in
The adaptive smoothing processor (AdaptiveSmoothing) 5244 will be described finally in detail with reference to
The adaptive smoothing processor 5244 receives, as input signals, the above described PatternCK, InData, InDataS, and bc and outputs a 4-bit signal. More specifically, when a condition of “(bc==0∥bc>=astPower) and (InData!=0)” is satisfied, the signal InDataS supplied from the image transformer 405 is output as they are. Otherwise, when a condition of “ast_params->sstAllOffSW==0(register)” is satisfied, InDataS is output through a table LUTE. When neither conditions are satisfied, patternCK is output through the table LUTE.
LUTE is a lookup table formed by a memory and has a memory space with a 3-bit input and 4-bit output. The table is basically set to linearly convert the input signal to output as the output signal. The table may nonlinearly convert the input signal in accordance with the print characteristics of the printer. If the number of bits of an edge portion needs to be other than 4, the conversion can be executed by using this table.
In the above-described second condition, “astPower” indicates a register. As a characteristic feature of this embodiment, the substitution to the edge reprocess signal can be adjusted in accordance with the value of the register.
On the other hand, “ast_params->sstAllOffSW” in the second condition also indicates a register. When this register is set to 0, InData is output through LUTE. That is, smoothing can be executed without reflecting the processing result by the above-described pattern matching processing section (miniSST) 5242. According to the arrangement of not reflecting the result of the pattern matching processing section 5242, a smoothing processing can be omitted in an area of a resolution higher than the printer resolution.
A result obtained by processing by the above-described sections is output from the reproduction section (Zexistence) 524 shown in
As another characteristic feature, even in an image which has undergone lossy compression such as JPEG, the edge portion can be improved without any problem, although not illustrated.
The reason for this is as follows. In creating data for edge detection, a 1-bit image attribute signal is created from the upper 3-bit signal of 8-bit image data. Hence, subtle degraded information by compression can be removed.
As described above, according to this embodiment, not only jaggies depending on the printer resolution but also jaggies generated in an edge portion by halftoning processing using a screen with 175 lines or 133 lines can be suppressed. Such jaggies by the screen are generated at a resolution much lower than the printer resolution and therefore are very noticeable in a halftone character or line. The jaggies are suppressed in the embodiment such that a quality of printed image can be improved.
In addition, processing having flexibility can beimplemented by making the substitution range to an edge reprocess signal adjustable. When the substitution range is adjusted, the effect shown in
The second embodiment of the present invention will be described below. Characteristic parts of the second embodiment will mainly be described below without describing the same parts as in the first embodiment.
In the first embodiment, the resolution of an input image signal is 600 dpi. In the second embodiment, an input image signal is compatible with both 1,200 dpi and 600 dpi.
The smoothing processor 406′ shown in
By adding or modifying the sections, compatibility with 1,200 dpi is implemented by the same basic arrangement as in the first embodiment. As described above, this embodiment is compatible with both 600 dpi and 1,200 dpi by using the same hardware configuration.
The sections different from
Referring to
This is because to decrease the capacity of a FiFo memory (to be described later), the upper bits are used and the lower bits are masked in the 1,200-dpi mode. Because of the hardware configuration, the number of bits of signal lines to connect the sections equals the number of bits (4 bits) of 600 dpi. Hence, the number of output bits is four even in 1,200-dpi processing. The bit mask section is designed to decrease the effective data amount to be stored in the FiFo memory in 1,200-dpi processing.
As described in the first embodiment, the signal input to this section is quantized by screening or error diffusion processing.
The bit conversion section (bit32_conv) 1702 will be described next with reference to the
Referring to
Since the sections are common to those in the 600-dpi processing, the number of input/output bits is 3, as shown in
As for a judgment signal (OutDataZ), a 1-bit signal is delayed by two lines by a FiFo memory 521, as in the first embodiment, independently of the resolution of 1,200/600 dpi. Hence, even when 1,200-dpi processing is executed, the memory capacity does not increase.
A 4-bit signal InDataS is processed in the following way. In the 600-dpi processing, a 4-bit signal is delayed by one line. In the 1,200-dpi processing, a 2-bit signal is delayed by one line. More specifically, one FiFo memory is used as a memory 523 to delay a 4-bit signal by one line in the 600-dpi processing and as a memory 532′ to delay a 2-bit signal by one line in the 1,200-dpi processing. In the 1,200-dpi processing, the number of bits in the length direction (width) of the memory is doubled. However, the number of bits in the depth direction (height) is halved. Hence, the total memory capacity does not change. For InDataS, the total memory capacity need not be increased while implementing the 1,200-dpi processing.
A 1-bit signal of 1,200 dpi is input to this section when the parameter ast_params->bit_select is set to 3 in the bit mask section (ScreenBitMask) 1701, as described in association with
A FiFo memory 522′ for a 3-bit signal InData will be described next. In the 600-dpi processing, a 3-bit signal is delayed by two lines, as shown in
Referring to
The 1-bit and 2-bit signals are read from the FiFo memory 522′ and converted into each signal of 3-bits by an output conversion section 2102 including two modules bit21_conv and bit23_conv. Processing of the bit21_conv module is shown in the example described by the program language (C language) in
A bit shift section (ScreenBitShift) 2002 which bit-shifts the signal output from a FiFo memory 523 or 523′ will be described with reference to
Processing of the bit shift section 2002 is described in
As described above, according to the second embodiment, the processing at 1,200 dpi can be executed by using the same hardware configuration and a FiFo memory with the same capacity as in the first embodiment for the 600-dpi processing. That is, according to the second embodiment, both 600-dpi processing and 1,200-dpi processing can be implemented without increasing the cost.
As described above, as a characteristic feature of the present invention, correction faithful to image transformation can be performed because data, which has undergone image transformation is processed. That is, the present invention can also suitably be adapted to a printer such as a Fax with a low resolution. However, according to the present invention, output to compensate for a degradation in image quality of an edge portion can be done even for an image which has undergone lossy compression such as JPEG, unlike the conventional method.
In addition, the present invention is effective not only for an image in which screen processing has been undergone but also for an image in which an error diffusion processing has been undergone A halftone character or line which has undergone the error diffusion processing has jaggies. The present invention can also suppress them.
Furthermore, the present invention is also effective for mosquito noise in an edge portion, which is generated by lossy compression such as JPEG. That is, the present invention can restrain a degradation in edge portion caused by compression.
The present invention can be applied to a system comprising a plurality of devices or to an apparatus comprising a single device.
For example, when the present invention is applied to an image processing apparatus, the image quality of an edge portion can be improved in both an image read by a scanner and a PDL image transmitted from a computer device.
Furthermore, the invention can be implemented by supplying a software program, which implements the functions of the foregoing embodiments, directly or indirectly to a system or apparatus, reading the supplied program code with a computer of the system or apparatus, and then executing the program code. In this case, so long as the system or apparatus has the functions of the program, the mode of implementation need not rely upon a program. Further, it is possible to execute similar processing by a hardware designed on the basis of the above program, such as an ASIC.
Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the claims of the present invention also cover a computer program for the purpose of implementing the functions of the present invention.
In this case, so long as the system or apparatus has the functions of the program, the program may be executed in any form, such as an object code, a program executed by an interpreter, or scrip data supplied to an operating system.
Example of storage media that can be used for supplying the program are a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a magnetic tape, a non-volatile type memory card, a ROM, and a DVD (DVD-ROM and a DVD-R).
As for the method of supplying the program, a client computer can be connected to a website on the Internet using a browser of the client computer, and the computer program of the present invention or an automatically-installable compressed file of the program can be downloaded to a recording medium such as a hard disk. Further, the program of the present invention can be supplied by dividing the program code constituting the program into a plurality of files and downloading the files from different websites. In other words, a WWW (World Wide Web) server that downloads, to multiple users, the program files that implement the functions of the present invention by computer is also covered by the claims of the present invention.
It is also possible to encrypt and store the program of the present invention on a storage medium such as a CD-ROM, distribute the storage medium to users, allow users who meet certain requirements to download decryption key information from a website via the Internet, and allow these users to decrypt the encrypted program by using the key information, whereby the program is installed in the user computer.
Besides the cases where the aforementioned functions according to the embodiments are implemented by executing the read program by computer, an operating system or the like running on the computer may perform all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.
Furthermore, after the program read from the storage medium is written to a function expansion board inserted into the computer or to a memory provided in a function expansion unit connected to the computer, a CPU or the like mounted on the function expansion board or function expansion unit performs all or a part of the actual processing so that the functions of the foregoing embodiments can be implemented by this processing.
For instance, this is the case where these processing are executed by a driver of a printing apparatus to be installed in a personal computer. As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the claims.
This application claims priority from Japanese Patent Applications No. 2004-318239 filed on Nov. 1, 2004 and No. 2005-80592 filed on Mar. 18, 2005, which are hereby incorporated by references herein.
Number | Date | Country | Kind |
---|---|---|---|
2004-318239 | Nov 2004 | JP | national |
2005-080592 | Mar 2005 | JP | national |