Patent Grant
8964192
This invention relates generally to the field of printing systems. More particularly, the invention relates to image processing in a printing system.
In the printing industry, it is sometimes necessary to process media multiple times in order to create a final product. For example, media such as paper may be pre-printed in an offset press, then run through a digital press/printer in order to add variable information. Examples of this type of printing include check printing, insurance policies, receipts, etc. Data printed on these forms is particularly important since the information is often used to guarantee traceability, facilitate record keeping, etc. In applications such as check printing, it is crucial that each individual document be readily identifiable and the correct number is printed in a proper location. Accordingly, it is desirable to quickly and easily verify defects in information printed on the medium.
Such printer defects are typically discovered using a print verification system (PVS). PVSs typically operate by digitizing printed pages using means such as photography, video, or scanning to generate test images. Subsequently, these test images are compared to source images that are known to be correct. The source images may be obtained from an input stream to be received at the printer, scanned after printing, or by a number of other methods.
However, current solutions to the problem of finding defects on pages outputted from a printer are limited in several ways. For instance, most approaches use a general pixel by pixel comparison. The drawback to such an approach is that no knowledge of individual objects on a page is used in the determination of whether or not a page is defective. Thus, there is an inability to identify incorrect placement of objects on a page.
Another limitation to current PVSs is a lack of a wider categorization of printed defects that includes a quality metric. For example, in some cases such as in the printing of Japanese Hiragana characters, pixel fidelity is required. However in other cases, such as in a jpeg compressed image, a more broad quality measure may be more appropriate.
Moreover, current PVSs assume that the system control unit is correct. Thus, there is no way to verify control unit errors. Also, generating application errors and operator errors (e.g., the wrong form being fed to the printer) cannot be detected in current PVS systems.
Accordingly, an improved printer verification mechanism is desired.
In one embodiment, a method is disclosed. The method includes reading image data from a print medium and performing image processing on the image data by querying a database to verify that each object to be included on the print medium appears on the medium in a manner in which it is supposed to appear.
In another embodiment, a print verification system includes one or more image readers to read image data from a print medium, a database including one or more objects that are to be included on the print medium and a processor to perform image processing on the read image data by querying the database to verify that each object to be included on the print medium appears on the print medium in a manner in which it is supposed to appear.
A better understanding of the present invention can be obtained from the following detailed description in conjunction with the following drawings, in which:
A print verification system is described. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. In other instances, well-known structures and devices are shown in block diagram form to avoid obscuring the underlying principles of the present invention.
Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
Print server 120 processes pages of output that mix all of the elements normally found in presentation documents (e.g., text in typographic fonts, electronic forms, graphics, image, lines, boxes, and bar codes). In one embodiment, the data stream is composed of architected, structured fields that describe each of these elements.
According to one embodiment, printer 130 includes a control unit 140, print engine 160 and print verification system (PVS) 180. In such an embodiment, print server 120 communicates with control unit 140 in order to integrate with the capabilities and command set of printer 130, and to facilitate interactive dialog between the print server 120 and printer 130. In one embodiment, the dialog between the print server 120 and printer 130 is provided according to a device-dependent bi-directional command/data stream.
Control unit 140 processes and renders objects received from print server 120 and provides sheet maps for printing to print engine 160. In such an embodiment, control unit 140 includes a multitude (e.g., ten) of compute node machines, with each node having two or more parallel page output handlers (POH's).
PVS 180 analyzes pages printed by print engine 160 in order to identify any defects on the page.
According to one embodiment, database 250 is implemented by PVS 180 to provide print verification. In such an embodiment, database 250 includes various objects, rules and criteria metrics. Specifically, database 250 stores objects that are to be applied on each printed page of a print job, rules for when, where and how the objects should appear, and a criteria metric for the desired quality of the printed objects. Thus, whenever an image from print engine 160 is being verified for correctness, each of the objects that are supposed to be on the page is queried from the database.
Database objects may include images, line art, barcodes, text, etc., while rules may include information regarding the placement of an object, object combinations (e.g., Object A and Object B always together), color (e.g., Object C has CMYK color values (33, 255, 255, 10)), etc.
The criteria metric may be represented in various ways. Examples include broad, detail and legibility quality descriptions. In the broad category, general properties of an object are examined such as proportion, color, sheet cuts, or shifted planes. In the detail category, single pixel precision can be the goal. This category is useful in certain fonts (e.g., Kanji) where a single pixel can change the meaning of a character. The legibility category would be useful in an application such as determining whether or not a barcode is likely to be readable by a scanning device.
In another embodiment, database 250 generation involves user-intervention. In this embodiment, a printer 130 operator assembles the database by locating important objects for verification, cropping them as necessary, and storing them. Corresponding rules and quality criteria for each object are also entered into the database by the operator.
At processing block 420, a print job is initiated, resulting in the production of print pages at print engine 160. At processing block 430, the printed pages are scanned by readers 210. At processing block 440, PVS 180 processes the images read by readers 210. According to one embodiment, image processing includes comparing the scanned images and source images by performing various operations on the images.
In a further embodiment, a normalization process may be implemented. For instance, there may be a difference in brightness between the scanned images and source images, thus normalization is performed to compensate for the differences. Additionally, paper stretching and compressing during the printing process. Therefore, an alignment process (e.g., coordinate transformation) may be implemented to normalize the scanned images and source images.
At processing block 450, database 250 is implemented to provide print verification. As discussed above, PVS 180 verifies each object on a page according to the rules and criteria specified in database 250. For example, PVS 180 may verify that the logo object is placed at coordinates (30, 10) of the verified page, that Object A and Object B are together on the page and/or, Object C has CMYK color values (33, 255, 255, 10)).
In further embodiment, database 250 may be used to verify the output of a printer simulator that produces digital copies of a page(s) on a digital print medium instead of pages printed on a physical medium, such as paper. In yet a further embodiment, processing blocks 440 and 450 may be performed as a combined process and/or the order of processing may be reversed.
Once database verification has been completed, one or more conventional verification processes may also be implemented to detect print page defects. For example, pixel by pixel comparison may be performed to detect excess or missing ink and stray marks, as well as an inspection of regions of variable content for which locations may vary on each print job.
The above-described PVS uses a catalog of objects that enables a discovery of information about a defective printed page. Thus the catalog may provide information, for example as to whether a particular object was printed, the object was positioned in an incorrect location on a page, the object colors are inaccurate and/or the object has been printed with desired quality, the legibility of an object such as a barcode, or whether the value encoded in the barcode matches the value in another object on the page.
Embodiments of the invention may include various steps as set forth above. The steps may be embodied in machine-executable instructions. The instructions can be used to cause a general-purpose or special-purpose processor to perform certain steps. Alternatively, these steps may be performed by specific hardware components that contain hardwired logic for performing the steps, or by any combination of programmed computer components and custom hardware components.
Elements of the present invention may also be provided as a machine-readable medium for storing the machine-executable instructions. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, propagation media or other type of media/machine-readable medium suitable for storing electronic instructions. For example, the present invention may be downloaded as a computer program which may be transferred from a remote computer (e.g., a server) to a requesting computer (e.g., a client) by way of data signals embodied in a carrier wave or other propagation medium via a communication link (e.g., a modem or network connection).
Throughout the foregoing description, for the purposes of explanation, numerous specific details were set forth in order to provide a thorough understanding of the invention. It will be apparent, however, to one skilled in the art that the invention may be practiced without some of these specific details. Accordingly, the scope and spirit of the invention should be judged in terms of the claims which follow.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5237394 | Eaton | Aug 1993 | A |
| 6501929 | Warbus et al. | Dec 2002 | B1 |
| 6678067 | Reda et al. | Jan 2004 | B1 |
| 7167580 | Klein et al. | Jan 2007 | B2 |
| 7440608 | Silverstein | Oct 2008 | B2 |
| 7590289 | Ishii et al. | Sep 2009 | B2 |
| 8120799 | Reddy et al. | Feb 2012 | B2 |
| 8270603 | Durst et al. | Sep 2012 | B1 |
| 20010042026 | Hinh et al. | Nov 2001 | A1 |
| 20040105122 | Schaeffer | Jun 2004 | A1 |
| 20050030588 | Reese et al. | Feb 2005 | A1 |
| 20050046889 | Braudaway | Mar 2005 | A1 |
| 20050226666 | Aoshima et al. | Oct 2005 | A1 |
| 20060072952 | Walmsley et al. | Apr 2006 | A1 |
| 20060080060 | Ternasky et al. | Apr 2006 | A1 |
| 20060126120 | Imafuku et al. | Jun 2006 | A1 |
| 20060170994 | MacKinnon et al. | Aug 2006 | A1 |
| 20070129957 | Elliott et al. | Jun 2007 | A1 |
| 20070226073 | Wang | Sep 2007 | A1 |
| 20080096486 | Whitten | Apr 2008 | A1 |
| 20090141717 | Cabeca et al. | Jun 2009 | A1 |
| 20090148002 | Spitzig | Jun 2009 | A1 |
| 20090199011 | Kawara | Aug 2009 | A1 |
| 20090259588 | Lindsay | Oct 2009 | A1 |
| 20090313060 | Evevsky | Dec 2009 | A1 |
| 20100095129 | Wilson | Apr 2010 | A1 |
| 20100123002 | Caporicci | May 2010 | A1 |
| 20100214582 | Iida | Aug 2010 | A1 |
| 20100231942 | Zhang et al. | Sep 2010 | A1 |
| 20100265534 | Prabhat et al. | Oct 2010 | A1 |
| 20110002699 | Aoki | Jan 2011 | A1 |
| 20110096349 | Braudaway | Apr 2011 | A1 |
| 20110116133 | Walker et al. | May 2011 | A1 |
| 20120095982 | Lennington et al. | Apr 2012 | A1 |
| 20120136700 | Evevsky | May 2012 | A1 |
| 20120293840 | Wilson | Nov 2012 | A1 |
| 20130128286 | Tamagawa | May 2013 | A1 |
| 20130159021 | Felsher | Jun 2013 | A1 |
| 20130298001 | Lundberg et al. | Nov 2013 | A1 |
| 20130336530 | Boncyk et al. | Dec 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 2000289310 | Oct 2000 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20130141767 A1 | Jun 2013 | US |
