1. Field of the Invention
The present disclosure relates to an image processing apparatus for inspecting a printed subject printed by a printing apparatus, an image processing method, and a medium storing a program.
2. Description of the Related Art
In general, a method for determining whether a color deviation has occurred using reading data obtained by reading a printed image has been used as a method for inspecting an image printed by a printing apparatus.
Japanese Patent Laid-Open No. 2003-244469 discloses a method for extracting a monochrome region utilizing saturation of image data and determining whether a color deviation has occurred in an image read by a scanner or the like in accordance with the correlation of saturation or color as a method for detecting random color unevenness included in a printed image.
However, when the method disclosed in Japanese Patent Laid-Open No. 2003-244469 is used, a large processing load is applied and a long period of time is required for a process of detecting a color deviation depending on a resolution used in the process of detecting a color deviation in an image.
The present disclosure provides an image processing apparatus which inspects an image printed, by printing heads having a plurality of nozzles which eject ink and which are arranged in a first direction, on a printing medium which is conveyed in a second direction which intersects with the first direction. The image processing apparatus includes a generation unit configured to generate judgment image data, used for inspection of printed image printed with a first resolution in the second direction, the judgment image data having a second resolution in the second direction which is lower than the first resolution, based on data on the image, and an inspecting unit configured to inspect the image by comparing, with the second resolution, the judgment image data with reading data obtained by reading the image printed with the first resolution in the second direction based on the data on the image.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
In this embodiment, an inkjet printer which prints an image by ejecting ink from nozzles formed on printing heads will be described as an example. The printer of this embodiment uses rolled continuous form paper as a printing medium. The printer of this embodiment is a high-speed line printer which may perform one-side printing and both-side printing and is suitable for a field of mass printing in print laboratories and the like.
The printing unit 101 forms an image on the printing medium 103 using the printing heads 102. The printing heads 102 include nozzle arrays formed thereon. Each of the nozzle arrays include a plurality of nozzles arranged in a Y direction in
The number of ink colors is not limited to four, that is, cyan, magenta, yellow, and black, and the number of printing heads is also not limited to four. Furthermore, a printing method to which the present disclosure is applicable is not limited to the thermal inkjet system, and a system using piezoelectric elements, a system using electrostatic elements, a system using MEMS elements, or the like may be employed.
The image reading unit 1213 optically reads an image and an examination pattern printed by the printing heads 102 on the printing medium 103 using a sensor 105, such as a scanner or a camera. The image reading unit 1213 is used to inspect ejection states of the nozzles of the printing heads 102, a conveying state of the printing medium, a position of the image, and the like.
A judgment image data generation unit 1215 reads the judgment high-resolution image data from the judgment high-resolution image data buffer 1207 and performs a resolution lowering process on the read data so as to generate judgment reference image data for inspection (hereinafter referred to as judgment reference image data”). Although described in detail hereinafter, the judgment image data generation unit 1215 generates judgment reference image data having a resolution in a conveying direction (X direction) of the printing medium lower than a printing resolution of an image. Thereafter, the generated judgment reference image data is stored in a judgment reference image data buffer 1216. A print controller 1210 generates printing data representing ejection or non-ejection of ink in response to a print timing signal which is generated by a motor/encoder 1208 and which is input from a motor/encoder controller 1209. The print controller 1210 transmits the printing data to the printing unit 101 so that an image is printed on the printing medium.
The reading unit 1213 processes a sensor signal obtained by reading the printed image by the sensor 105 and stores the sensor signal in a reading image data buffer 1214 as reading data. An image unit 1217 reads the judgment reference image data stored in the judgment reference image data buffer 1216 and the reading data stored in the reading image data buffer 1214 and compares them with each other. Thereafter, the image judgment unit 1217 determines whether color unevenness is included in the printed image in accordance with a result of the comparison and transmits a result of the judgment to the CPU 1218.
Note that the reception buffer 1203, the judgment high-resolution image data buffer 1207, the judgment reference image data buffer 1216, the printing data buffer 1206, and the reading image data buffer 1214 are part of a main memory, such as the DRAM 1204 in this system. However, not only the DRAM, but also other memories, such as an SRAM, may be employed as long as the memory belongs to definition of a RAM.
To address the color differences caused by the variation of ejection amounts, an HS processing unit 707 described below performs a correction process on image data to be printed. In this embodiment, the number of cyan dots is increased from 3 dots to 4 dots as denoted by a dot arrangement 305 of
Next, a process of generating a correction parameter used in the correction process will be described with reference to
Although a correction parameter may be generated for each nozzle, a correction parameter is generally generated for a plurality of nozzles. This is because, although printers have nozzles arranged for high resolution of approximately 1200 dpi in recent years, a proper color may be sufficiently reproduced without correction by each nozzle in terms of image formation taking a size of a color unevenness portion visually recognized and a processing load into consideration. Accordingly, the correction process is performed on image data to be printed with an appropriate resolution in which color unevenness is not visually recognized in order to realize reduction of the processing load and realization of a high-speed process. In this embodiment, a correction table is generated with a resolution of 300 dpi, that is, in a unit of four nozzles, and feedback is performed to the image data. Therefore, as illustrated in
On the other hand, in step S605, judgment reference image data is generated in parallel to the flow from step S602 to step S603. Resolution conversion (averaging) and accuracy conversion are performed based on the image data which has been subjected to the image process so that judgment reference image data is generated. These processes will be described hereinafter with reference to
In step S607, the reading unit 1213 reads the image printed on the printing medium when the printing medium passes the sensor 105. Although described in detail hereinafter, as for a reading resolution in reading of an image by the sensor 105, a reading resolution in the X direction is lower than a printing resolution for the image, that is, a resolution at a time when ink dots are ejected. In step S608, a resolution conversion process (averaging process), an accuracy conversion process, and a luminance density conversion process are performed on the read data so that reading image data is generated. Thereafter, the reading image data is transmitted to the image judgment unit 1217.
In step S609, the image judgment unit 1217 receives the judgment reference image data and the reading image data and compares the judgment reference image data with the reading image data so as to determine whether color unevenness is generated in the printed image. In step S610, a result of the judgment is supplied to the CPU 1218. By performing such a processing flow in a unit of image printed on the rolled continuous form paper, a unit of line, or a unit of rectangle, even color unevenness generated during consecutive printing of a plurality of images may be detected and a result of the detection may be informed.
The image processing unit 1205 reads the RGB input image data from the reception buffer 1203 and converts the RGB input image data into RGB data corresponding to a color space of a printer using a luminance conversion unit 703. This conversion is referred to as “color space conversion”. Next, a CS unit 704 reads a correction parameter from a color shading table buffer 705 and performs correction so that color unevenness is not generated. This correction is referred to as a “color shading process”. The color shading process is a method for performing a correction process in three dimensions of R, G, and B so that color unevenness is not generated even when a tint of a secondary color is changed as a result of increase or decrease of an ejection amount by the head shading. As with the case of the head shading, a unit of a plurality of nozzles in the Y direction in which the nozzles are arranged is used as a unit of processing and a correction parameter is provided in advance for each unit of processing. The number of nozzles in the unit of processing may be the same as that in the head shading or may be different from that in the head shading.
The image data which has been subjected to the color shading process is converted from the RGB data into data suitable for ink colors used for printing of an image by a luminance density conversion unit 706. In this embodiment, the RGB data is converted into CMYK data including four elements, that is, C, M, Y, and K since four color inks of C, M, Y, and K are used. Thereafter, the HS processing unit 707 reads a correction parameter from a head shading table buffer 708 and performs the head shading process. The head shading process is performed for each ink color and a single correction parameter is employed for a plurality of nozzles as described above.
Subsequently, a gamma conversion unit 709 performs gamma conversion. Next, a quantization unit 710 performs a quantization process of converting density data of C, M, Y, and K into data representing the number of ink dots ejected for printing. Quantization data obtained by the quantization is stored in the printing data buffer 1206. The generated quantization data has a resolution of 1200 dpi in the X direction and a resolution of 1200 dpi in the Y direction. Data developed as index data representing printing or non-printing of ink dots based on the quantization data is read from the printing data buffer 1206 in response to a print timing signal, not illustrated, and the data is transmitted to the printing unit 101 which prints an image. As a result, a printing resolution of the printed image is 1200 dpi in the X direction in which the printing medium is conveyed and 1200 dpi in the Y direction in which the nozzles are arranged. Note that the printing resolution in the Y direction is the same as nozzle arrangement density of the printing heads 102.
Next, a process of generating judgment reference image data, that is, the processes in step S605 and step S606, will be mainly described in detail with reference to
First, the judgment image data generation unit 1215 receives the image data which has been subjected to the various image processes from the gamma conversion unit 709 and stores the image data in the judgment high-resolution image data buffer 1207. The judgment high-resolution image data buffer 1207 may not be required if arrangement of image data transmitted from the gamma conversion unit 709 corresponds to a direction which intersects with the nozzle arrangement direction of pixels in the printed image (X direction). When the arrangement of the image data corresponds to the Y direction, the data is stored in the judgment high-resolution image data buffer 1207, and a process of sorting the data is required to be performed when the data is read so that the data is arranged in the X direction. In this embodiment, the judgment high-resolution image data buffer 1207 receives the data once.
Then the judgment image data generation unit 1215 reads the image data from the judgment high-resolution image data buffer 1207 in an order required for a process performed by the resolution conversion unit 801 and performs a resolution lowering process. In this embodiment, a resolution in the conveying direction (X direction) of the printing medium is converted from 1200 dpi to 300 dpi.
Subsequently, the accuracy conversion unit 802 performs a process of lowering bit accuracy of the image data to accuracy capable of detecting color unevenness. Although the image data transmitted from the host PC 1201 has R of 8 bits, G of 8 bits, and B of 8 bits (256 gradation levels), the number of gradation levels is reduced to 6 bits (64 gradation levels). By this, reduction of a processing load, reduction of a memory band, and reduction of a data amount at a time when the judgment reference image data and the reading data are compared with each other may be realized.
The judgment reference image data generated by the processes performed by the resolution conversion unit 801 and the accuracy conversion unit 802 is stored in the judgment reference image data buffer 1216. The judgment reference image data buffer 1216 may not be required for the same reason as the judgment high-resolution image data buffer 1207. When an order of the judgment reference image data is different from a pixel order determined by the image judgment unit 1217, the judgment reference image data is required to be stored once in the judgment reference image data buffer 1216. Thereafter, the judgment reference image data is transmitted to the image judgment unit 1217.
Here, the resolution conversion process performed on the judgment reference image data which is a characteristic configuration of this embodiment will be described with reference to
An example of a method for comparing the judgment reference image data with the reading image data and an example of a method for determining whether color unevenness is generated in accordance with a result of the comparison which are employed in the image comparison judgment unit 1104 will be described below. A difference between a pixel value of a target pixel of the reading data and a pixel value of a pixel of the judgment reference image data corresponding to the target pixel of the reading data is obtained, and in this way, difference values of all pixels included in a unit of processing for a judgment process, such as a unit of image, a unit of page, or the like, are obtained. In this embodiment, the judgment reference image data and the reading image data are both CMYK data of 6 bits, and differences in C, M, Y, and K are obtained. Thereafter, the obtained difference values are compared with predetermined threshold values. The judgment as to whether color unevenness is included in the printed image is made in accordance with results of the comparisons. Here, one of judgment methods below may be employed. For example, it is determined that color unevenness is generated if at least one of all the pixels included in the unit of processing for the judgment process has a difference value which exceeds a threshold value. Alternatively, it is determined that color unevenness is generated if a predetermined number of pixels have difference values which exceed respective threshold values.
Furthermore, one image may be more finely divided so that a smaller unit for the judgment process is obtained. For example, pixel arrays for one raster which are consecutively arranged in the X direction are set as a unit of processing for the judgment process, and if the number of pixels having difference values which exceed respective threshold values is equal to or larger than 1 or equal to or larger than a predetermined number in the pixel arrays for one raster, it is determined that color unevenness is included in the printed image. Alternatively, if at least a predetermined number of pixels having difference values which exceed respective threshold values are consecutively included in the pixel arrays for one raster, it may be determined that color unevenness is included in the printed image. In this way, information on a position where color unevenness is generated may be obtained by performing the judgment process for each raster including pixels which are consecutively arranged in the X direction. By this, by performing the correction parameter generation process after the judgment process, a processing load may be reduced such that a region in which a pattern is printed or measured is limited only to a position in which it is determined that color unevenness is generated or a proximal region of the position. Furthermore, since the judgment is performed for individual ink colors of C, M, Y, and K, a correction parameter is regenerated only for an ink color corresponding to the color unevenness, and accordingly, a processing load may be reduced when compared with a case where pattern printing and pattern measurement are performed for individual ink colors.
Furthermore, the reading image data buffer 1214 may not be required for the same reason as the judgment high-resolution image data buffer 1207. When color unevenness which is continued in the conveying direction (X direction in the drawings), such as a streak caused by defective ejection of the nozzles, is to be detected, image data items are stored in the reading image data buffer 1214 in a consecutive manner in the Y direction so that the resolution lowering processing is performed in the X direction. The data items may be consecutively read in the X direction if the data items are read after performing offset, and accordingly, high-speed processing and reduction of a memory band may be realized.
Although the printed image is read by the sensor 105 in a resolution of 1200 dpi in the X direction which is the same as a printing resolution and the resolution of 1200 dpi is converted into a resolution of 300 dpi by the resolution conversion unit 1102 of the image judgment unit 1217 in this embodiment, the present disclosure is not limited to this. The reading may be performed with a lower resolution as long as the sensor 105 is capable of performing reading with a resolution lower than the printing resolution. When the reading is performed with a low resolution, the conveying speed of the printing medium may be increased, and accordingly, throughput of the printing apparatus may be improved. Note that, in a case where the reading resolution is the same as the resolution of the judgment reference image data used for the judgment process, that is, the sensor 105 reads data in a reading resolution of 300 dpi in the X direction and a reading resolution of 1200 dpi in the Y direction, the resolution lowering process of the image judgment unit 1217 is not required.
For example, a comparison method in a case where data is read while a resolution in the X direction is lowered to 40 dpi for realizing a high speed process will be described with reference to
A flow until a detection of occurrence of ink non-ejection will be described taking a case where the ink non-ejection of a C ink occurs in a target printed material 1401 corresponding to input image data 901 as an example.
First, judgment reference image data 903 is generated from the input image data 901. Here, the judgment reference image data 903 has an RGB three-color data format, a resolution of 1200 dpi in the Y direction, and a resolution of 40 dpi in the X direction.
Furthermore, reading data 1402 is obtained by reading the printed material 1401 to be examined in the RGB three-color data format and with the resolution of 1200 dpi in the Y direction and the resolution of 40 dpi in the X direction.
The judgment reference image data 903 and the reading data 1402 are compared with each other so that a difference is extracted. In this way, an uneven pixel 1405 is specified.
In
When the graph corresponding to RGB data and the graph 1407 are compared with each other, a portion in which a value of an R channel is considerably different from a reference value is detected, and the portion may be specified as the uneven pixel 1405. Furthermore, since an output of the R channel is remarkably changed, it is estimated that an error occurs in the C ink which is a complementary color of the R ink.
In accordance with this result, an examination pattern for specifying a cause of a defect in detail may be printed so that detailed examination is performed and correction may be performed on printing to be subsequently performed based on the uneven pixel 1405.
As described above, according to this embodiment, the judgment reference image data and the reading data are generated with a resolution in the conveying direction lower than the printing resolution in accordance with the input image data and the image data obtained by reading the printed image, and a color unevenness judgment is performed. With this configuration, a processing load and an amount of data transfer at a time of the judgment process may be reduced and high-speed processing is realized, and accordingly, an image judgment in the entire system may be performed at high speed. Furthermore, since the reading resolution used when the sensor 105 reads the printed image is lower than the printing resolution, the printing medium may be conveyed at high speed and reduction of a processing load of the reading data and reduction of a data amount may be realized.
Furthermore, since color unevenness is determined using image data of an actual image which is not a maintenance pattern dedicated for a judgment of color unevenness and reading data of the printed image, consumption of the ink and the printing medium for printing the dedicated pattern may be reduced, and accordingly, running cost may be reduced.
Note that, in this embodiment, since the resolution in the direction in which the printing medium is conveyed, that is, the X direction, is lower than the printing resolution for printing the image, high-speed processing is realized without degrading accuracy of detection of color unevenness in a streak form. Furthermore, another resolution lowering process may be additionally performed on the two data items used in the judgment process so that the resolution in the direction in which the nozzles are arranged, that is, the Y direction, becomes lower than the resolution corresponding to pitch of nozzle arrangement in Y direction. By this, color unevenness generated due to a plurality of causes may be detected at high speed and at high accuracy when the image is read.
Embodiments of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions recorded on a storage medium (e.g., non-transitory computer-readable storage medium) to perform the functions of one or more of the above-described embodiment(s) of the present invention, and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more of a central processing unit (CPU), micro processing unit (MPU), or other circuitry, and may include a network of separate computers or separate computer processors. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD™), a flash memory device, a memory card, and the like.
Furthermore, the present disclosure may be realized by a process of supplying a program which realizes at least one of the functions of the foregoing embodiment to a system or an apparatus through a network or a storage medium and reading and executing the program using at least one processor included in a computer of the system or the apparatus. Furthermore, the present disclosure may be realized by a circuit which realizes at least one of the functions (ASIC, for example).
By the method described above, a color deviation may be detected based on image data and reading image data with a comparatively low processing load. Furthermore, high-speed processing and reduction of an amount of data transfer may be realized.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2014-157087, filed Jul. 31, 2014, which is hereby incorporated by reference herein in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2014-157087 | Jul 2014 | JP | national |