Patent Application
20150116734
Reference is made to commonly assigned, co-pending U.S. patent application Ser. No. ______ (Docket K001641), entitled: “Printer with feedback correction of image displacements”, by Howard et al., and to commonly assigned, co-pending U.S. patent application Ser. No. ______ (Docket K001642), entitled: “Printer with feedback correction of image plane alignment”, by Howard et al., each of which is incorporated herein by reference.
This invention generally relates to a digital printing system, and more particularly to the correction of image plane displacement errors based on image comparisons made between the image data and a captured image of the printed output.
In multi-channel digital printing systems, images for a plurality of image channels are printed in alignment onto a receiver medium. In many such digital printing systems, a plurality of printing modules (e.g., inkjet printheads or electrophotographic print engines) are provided, one for each channel, and multi-channel images are printed by moving a receiver medium past each of the printing modules where the channels are printed in sequence. Typically, the different channels (i.e., “image planes”) are used to print different colorants (e.g., cyan, magenta, yellow and black). In some embodiments, a plurality of channels may be used to print a single colorant, or light and dark variations of the same colorant. For example a black colorant can be printed using two different printer channels to increase the density of the printed image. In some embodiments, a first set of channels can be used to print on one side of the receiver medium, and a second set of channels can be used to the print on the opposite side of the receiver medium (using the same or different colorants).
The printed item produced by the digital printing systems need not be restricted to an image printed on the receiver medium for viewing by an observer, but can also include items printed for a functional purpose such as printed circuitry. In this example, the different channels can correspond to different layers in a multi-layer circuit.
In some applications, the receiver medium may undergo changes between the printing of one channel and another. For example, when a multi-color image is printed by depositing ink on a paper-based receiver medium, the water in the ink printed for one channel can cause the receiver medium to expand before a subsequent channel is printed. The receiver medium could also undergo other processing steps between the printing of the image planes that could change the dimensions of the receiver medium. For example, the receiver medium could pass through a dryer (in case of printing with liquid inks) or a fusing step (in case of dry powder electrophotography) between the printing of the various channels, which can cause the receiver medium to shrink before the printing of a subsequent channel. The desired registration of one channel to another can be adversely affected by the dimensional changes of the receiver medium between the printing of the multiple channels. In many cases, the dimensional changes in the receiver medium may be a function of a variety of factors such as image content of the printed image, the drying steps along the printing process and environmental conditions.
In another example, a non-conductive layer can be applied over conductive traces for a layer of circuitry printed on a receiver medium before the printing of a subsequent image plane for another layer of circuitry, where the application of the non-conductive layer produces dimensional changes in the receiver medium (and the already printed image plane). In such systems, the desired registration of one image plane to another can be adversely affected by the dimensional changes of the receiver medium between the printing of the multiple layers.
In some cases, the printing modules used for printing the different channels may have some variation between them, so that there is a dimensional scaling or magnification change between the channels printed by the different printing modules.
In other applications, it may be necessary to adjust the dimensions of a document printed by a digital printing system even if it contains only a single channel. Such an adjustment may be necessary to match the dimensions of the printed document with the dimensions required by a downstream process. For example it may be necessary to adjust the print width of the printed document so that it correlates with the width of a downstream slitting, perforating, or folding operation.
A number of methods for using image capture devices to monitor the image quality of printed output have been described in prior art. Examples of such applications include vision capture systems that capture the printed output from printing systems such as offset printing devices and display the captured output to the operator to take recommended or necessary corrective actions.
U.S. Pat. No. 7,423,280 to Pearson et al., entitled “Web inspection module including contact image sensors,” discloses an image capture device having a light source, a contact image sensor and a gradient index lens array to image the printed output onto a sensor array. The image of the printed output is displayed for the operator together with color aim values for selected parts of the image and recommended correction values for the individual color separations. Also displayed are registration targets with suggested values for their corrections. The operator is expected to apply these corrections to the printing process and to observe their impact on the prints following this manual adjustment.
U.S. Patent Application Publication 2010/0123780 to Wiebe, entitled “Method and device for monitoring a printed image on a moving material web,” describes the display of a captured image of a printed output, together with a selected reference image. This enables an operator to monitor and assess the quality of the printing process by visual comparison on the display.
U.S. Pat. No. 8,197,022 to Saettel, entitled “Automated time of flight speed compensation,” discloses a printing system having multiple inkjet print modules. Each of the print modules is followed in the process direction by an image capture system. The image capture system evaluates the position of printed registration marks and determines a correction value for the associated print module to bring it into register with the first image plane. The correction value is used to advance or delay the ink drop generation such that the resulting registration mark on the receiver is in register with the registration mark of the first image plane.
U.S. Pat. No. 7,536,955 to Bernard et al., entitled “Method and device for influencing the fan-out effect,” teaches the use of a camera system in an offset printing press to determine the lateral distortion of the receiver web between print stations with respect to printed reference marks applied by the upstream print station. The measurement is converted to a control signal increasing or decreasing the output of a fan deflecting the web by impinging air to compensate for the lateral distortion of the web.
U.S. Pat. No. 7,650,019 to Türke et al., entitled “Method for the early identification of a deviation in the printed images that have been created by a printing press during continuous production,” describes an image quality control system that compares the color of a captured output image with the corresponding aim color of a reference image. Color comparisons are based on averages within a small image area (e.g., 8×8 pixels), and deviations from the aim color are averaged over a few successive prints. Detected deviations from the aim color are displayed for the operator to take corrective actions. Various modes of averaging are described to display a trend in color errors so that the operator is enabled to take corrective action before the color error is too large and the print production yields unacceptable poor print quality.
U.S. Pat. No. 6,068,362 to Dunand et al., entitled “Continuous multicolor ink jet press and synchronization process for this press,” discloses a printing system in which marks are evenly spaced along the web of paper in the in-track direction for the purpose of in-track registration control. The line-by-line output of the digital writing system is adjusted to make the in-track dimensions of all print planes identical.
U.S. Pat. No. 4,721,969 to Asano, entitled “Process of correcting for color misregistration in electrostatic color recording apparatus”, discloses a printing system employing marks on both side of the image to determine the displacement errors of the image during the printing process. An inferred shrinkage or elongation of the paper in the cross-track and in-track directions is assumed to be uniform. Magnification corrections in the cross-track direction are accomplished by omitting pixels or inserting dummy pixels for each line, whereas magnification corrections in in-track direction are applied by removing entire printed lines or modifying the transport speed.
The prior art methods typically evaluate displacement errors based on monitoring printed registration marks. In general, such printed registration marks are not desirable within the printed image, or anywhere within the finished product; therefore, they can only be placed outside the printed image in a portion of the receiver medium to be trimmed off in a finishing operation. The need for the trimming operations represents an extra step in the finishing operation, which has the disadvantage of wasting materials and adding cost. There remains a need for improved methods to correct for image plane displacement errors in a multi-channel printing system that does not rely on printed registration marks.
The present invention represents a printer for printing an image on a receiver medium moving along a transport path, comprising:
This invention has the advantage that the image alignment method does not require the use of specialized registration marks that must be located outside of the printed image region, and must be trimmed from the final printed product.
It has the additional advantage that the image planes in the printed image can be adjusted in real time to correct for distortions in the receiver medium.
It has the further advantage that the image displacement and the corresponding spatial adjustments can vary as a function of location within the printed image to compensate for non-uniform distortions of the receiver medium.
It is to be understood that the attached drawings are for purposes of illustrating the concepts of the invention and may not be to scale. Identical reference numerals have been used, where possible, to designate identical features that are common to the figures.
The present description will be directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with the present invention. It is to be understood that elements not specifically shown or described may take various forms well known to those skilled in the art.
In the following description, some aspects of the present invention will be described in terms that would ordinarily be implemented as software programs. Those skilled in the art will readily recognize that the equivalent of such software may also be constructed in hardware. Because image processing algorithms and systems are well known, the present description will be directed in particular to algorithms and systems forming part of, or cooperating more directly with, the method in accordance with the present invention. Other aspects of such algorithms and systems, together with hardware and software for producing and otherwise processing the image signals involved therewith, not specifically shown or described herein may be selected from such systems, algorithms, components, and elements known in the art. Given the system as described according to the invention in the following, software not specifically shown, suggested, or described herein that is useful for implementation of the invention is conventional and within the ordinary skill in such arts.
A computer program product can include one or more non-transitory, tangible, computer readable storage medium, for example; magnetic storage media such as magnetic disk (such as a floppy disk) or magnetic tape; optical storage media such as optical disk, optical tape, or machine readable bar code; solid-state electronic storage devices such as random access memory (RAM), or read-only memory (ROM); or any other physical device or media employed to store a computer program having instructions for controlling one or more computers to practice the method according to the present invention.
The invention is inclusive of combinations of the embodiments described herein. References to “a particular embodiment” and the like refer to features that are present in at least one embodiment of the invention. Separate references to “an embodiment” or “particular embodiments” or the like do not necessarily refer to the same embodiment or embodiments; however, such embodiments are not mutually exclusive, unless so indicated or as are readily apparent to one of skill in the art. The use of singular or plural in referring to the “method” or “methods” and the like is not limiting. It should be noted that, unless otherwise explicitly noted or required by context, the word “or” is used in this disclosure in a non-exclusive sense.
The present invention is well-suited for use in roll-fed inkjet printing systems that apply colorant (e.g., ink) to a web of continuously moving receiver medium (also known in the art as “print media”). In such systems a printhead selectively moistens at least some portion of the receiver medium as it moves through the printing system, but without the need to make contact with the receiver medium. While the present invention will be described within the context of a roll-fed inkjet printing system, it will be obvious to one skilled in the art that it can also be used for other types of printing systems such as sheet-fed printing systems and electrophotographic printing systems.
Although the present invention is applicable to any type of printing system that requires accurate image plane registration, it is of increasing value for printing systems where the receiver medium experiences significant dimensional changes during the printing process (e.g., due to expansion of the medium due to the absorption of ink). For example, significant deformations can occur if the web tension varies significantly as it moves from one printhead to another (particularly for thin media), if the time between the printing of the image planes is relatively large, or if the printed receiver medium undergoes some process or treatment, (e.g., drying, curing or fusing), between the printing of the image planes.
In the context of the present invention, the terms “web media” or “web of media” are interchangeable and relate to a receiver medium that is in the form of a continuous strip of media that passes through a web media transport system from an entrance to an exit thereof. The continuous web media serves as the receiver medium to which one or more colorants (e.g., inks or toners), or other coating liquids are applied. This is distinguished from various types of “continuous webs” or “belts” that are actually transport system components (as compared to the print receiving media) which are typically used to transport a cut sheet receiver medium in an electrophotographic or other printing system. The terms “upstream” and “downstream” are terms of art referring to relative positions along the transport path of a moving web; points on the web move from upstream to downstream.
Additionally, as described herein, the example embodiments of the present invention provide a printing system or printing system components typically used in inkjet printing systems. However, many other applications are emerging which use inkjet printheads to emit liquids (other than inks) that need to be finely metered and deposited with high spatial precision. As such, as described herein, the terms “liquid,” “ink,” “print,” and “printing” refer to any material that can be ejected by the liquid ejector, the liquid ejection system, or the liquid ejection system components described below.
The printing system 10 includes a plurality of printing modules 20 (sometimes referred to as marking units). The printing modules 20 are adapted to deposit a corresponding marking material onto the receiver medium 14 in accordance with image data 11 (sometimes called “print data”) received from a digital front end (not shown). The image data 11 is generally represented as an array of pixel values corresponding to an array of pixel position, where the pixel values specify a colorant amount to be printed at the corresponding pixel location.
In a preferred embodiment, the printing modules 20 are inkjet printing modules having printheads 12 (also known as marking units) adapted to print drops of ink onto the receiver medium 14 through an array of inkjet nozzles in accordance with image data 11. In other embodiments, the printing modules 20 can be electrophotographic printing modules that produce images by applying solid or liquid toner to the receiver medium 14. Alternately, the printing modules 20 can utilize any type of digital printing technology known in the art.
In a preferred embodiment, the printing system 10 is adapted to print a multi-color image that is intended to be viewed by an observer. In this case, the marking materials are colorants such as inks or toners. In other embodiments, the printing system 10 can be used to produce items printed for a functional purpose such as printed circuitry. In this example, the marking materials can correspond to the materials needed for the layers in a multi-layer circuit.
In the illustrated embodiment, four printing modules 20 are shown which print cyan (C), magenta (M), yellow (Y) and black (K) marking materials (e.g., inks or toners) onto the receiver medium 14 as it passes through the printing system along the transport path from an upstream position to a downstream position as defined by motion of the receiver medium 14. In other embodiments, the printing modules 20 can be adapted to print different numbers and types of marking materials. For example, additional printing modules 20 can be used to print specialty colorants, or extended gamut colorants. In some embodiments, a plurality of the printing modules 20 can be used to print the same marking materials (e.g., black ink), or density variations of the same color (e.g., gray and black inks). In some embodiments, the printing system 10 is adapted to print double-sided pages. In this case, one or more of the printing modules 20 can be arranged to print on a back side of the receiver medium 14. In some embodiments, the marking materials can also include other types of materials such as clear materials (e.g., for providing protective layers, gloss control layers or texture-forming layers), solvent materials, or functional materials (e.g., electrical conducting or insulating materials).
The exemplary printing system 10 also includes a dryer 18 with every printing module 20 for drying the ink applied by the printhead 12 to the receiver medium 14. While the exemplary embodiment illustrates a dryer 18 following each of the printheads 12, this is not a requirement. In some embodiments, a single dryer 18 may be used following the last printhead 12, or dryers 18 may only be provided following some subset of the printheads 12. Depending on the printing technology used in the printing modules 20, and the printing speed, it may not be necessary to use any dryers 18.
Each printing module includes a controller 15, which is a data processor adapted to control the associated printing module 20. All of the controllers 15, together with other data processors that may be associated with the printing system 10, make up the control system for the printing system 10. Typically, the printing system 10 is designed to print lines of image at a specified resolution (e.g., 600 lines per inch (lpi)). An encoder 22 located along the transport path before the first printing module 20 generates a master timing signal 19 (e.g., 600 pulses per inch) that is tied to the motion of the receiver medium 14. This master timing signal 19 is provided to the controller 15 in each printing module 20 to trigger the line-by line output of the printhead 12. The encoder 22 can generate the master timing signal 19 using any of the various contact or non-contact detection means that are known in the art, either by sensing the motion of the receiver medium 14, or a component such as a roller that moves with the receiver medium 14.
In accordance with the present invention, the printing system 10 includes at least one image capture system 13. In the embodiment shown in
Each image capture system 13 is connected to the controller 15, which is adapted to accept and analyze the captured image data to determine appropriate control signals. In accordance with the present invention, the controller 15 compares the image data 11 for one or more of the previously printed image planes with the captured image data from the image capture system 13 to determine a displacement between a nominal location of the printed image data and an actual location of the printed image data. The displacement is then used to determine appropriate spatial adjustment control signals 25 which specify spatial adjustments that can be applied to the image data 11 to reduce alignment errors between the printed image data for the previous image plane(s) and the printed image data for the current image plane. The spatial adjustments may include parameters specifying spatial shifts or resize factors to be applied in one or both of the cross-track and in-track dimensions. In the illustrated embodiment, the spatial adjustment control signals 25 are passed to the corresponding printhead 12, which includes a data processor which is adapted to apply the spatial adjustment control signals 25 to the image data 11 and then print the adjusted image data. In other embodiments, the spatial adjustment control signals 25 can be applied to the image data 11 in the controller 15, or in some other data processor, rather than in the printhead 12.
A capture image step 120 is used to capture an image of the printed first plane image 115 using the image capture system 13 (
The captured first plane image 125 provides a representation of the geometry of the printed image, which should nominally match the first plane image data 100. However, due to various reasons such as expansion or shrinkage of the receiver medium 14 (
The distortions in the geometry of the printed first plane image 115 can be characterized by using a compare images step 130 to compare the captured first plane image 125 with the first plane image data 100. The compare images step 130 determines an image displacement 135 which provides an indication of the geometric distortions introduced into the printed first plane image 115 (i.e., the differences between a nominal location of the printed image data as specified by the first plane image data 100 and an actual location of the printed image data as characterized by the captured first plane image 125). In some embodiments, the entire first plane image data 100 is compared to the entire captured first plane image 125 to determine the image displacement 135 in a single operation. In other cases, a subset of the first plane image data 100 (e.g., a single line, or a set of lines) is compared to a corresponding subset of the captured first plane image 125. For example, if the capture image step 120 uses a 1D line scanning system, the lines of the captured first plane image 125 can be compared to the first plane image data 100 on a line-by-line basis in real time as they are captured. For cases where the distance between the image capture system 13 and the printhead 12 is smaller than the size of the printed image, it is not possible to capture the entire captured first plane image 125 before it is necessary to apply the adjustments to the first part of the second plane image data 105. As a result, it is necessary to determine the image displacement 135 in real-time for a subset of the first plane image data 100, while the rest of the captured first plane image 125 is still being captured.
It should be noted that the printed first plane image 115 corresponds to the image content (e.g., text, graphics or photographic images) being printed for the printed product being produced by the printing system 10. The printed first plane image 115 should be distinguished from special-purpose registration marks that are sometimes formed along the edge of the receiver medium 14 during some printing processes for the specific purpose of detecting registration information. The present invention has the advantage that by using the actual image content of the printed first plane image 115 in the determination of the image displacement 135, it is possible to accurately align the image planes without needing to print registration features. Prior art systems that utilize registration marks to align the image planes typically trim off the portions of the receiver medium 14 having the printed registration marks, which adds cost and creates waste. The present invention has the additional advantage that using the actual image content of the printed first plane image 115 enables the image displacement 135 to be determined as a function of location within the printed image. For prior art systems that rely on registration marks, the image displacement can only be evaluated along the edges of the receiver medium 14 since it would not be desirable to include registration marks within the printed image content. As a result, the registration marks are not able to provide any information about local distortions of the receiver medium 14.
In some cases, the printed first plane image 115 will simply be shifted relative to the first plane image data 100. In this case, the image displacement 135 will be constant for all locations within the printed first plane image 115. More generally, the image displacement 135 will vary as a function of location within the printed first plane image 115. For example, if the receiver medium 14 expands as it absorbs the ink deposited in the print first plane step 110, image content on the left side of the receiver medium 14 can be displaced to the left, while image content on the right side of the receiver medium 14 can be displaced to the right. Typically, the image displacement 135 will be a function of the amount and distribution of marking material (e.g., ink) deposited during the print first plane step 110. For example, if the printed first plane image 115 includes a region of high ink lay-down (e.g., a photographic image), and another region of low ink lay-down, the receiver medium 14 may expand more in the region of high ink lay-down.
In various embodiments, the image displacement 135 can represent the displacement in the printed image data in a variety of different manners. For example, the image displacement 135 can be a set of parameters that characterize the geometric distortion of the printed first plane image 115. In some embodiments, the parameters can include some or all of a cross-track displacement parameter, an in-track displacement parameter, a cross-track magnification factor parameter, an in-track magnification factor parameter, and a skew angle parameter.
In other embodiments, the image displacement 135 can be represented using a parametric image displacement function with an appropriate functional form. For example, the image displacement 135 can be represented using cross-track and in-track displacement functions of the form:
Δx=fx(x,y)
Δy=fy(x,y) (1)
where fx(x,y) is the cross-track displacement function, fy(x,y) is the in-track displacement function, x and y are cross-track and in-track coordinates within the first plane image data 100, respectively, and Δx and Δy are the cross-track and in-track displacements, respectively.
In some embodiments, the cross-track and in-track displacement functions can be represented using parametric functions such as:
f
x(x,y)=A0+Axx+Ayy+Axxx2+Ayyy2+Axyxy
f
y(x,y)=B0+Bxx+Byy+Bxxx2+Byyy2+Bxyxy (2)
where A0, Ax, Ay, Axx, Ayy, Axy, B0, Bx, By, Bxx, Byy, and Bxy are fitting parameters determined by comparing the positions of the features (i.e., image content) in the first plane image data 100 to the positions of the corresponding features in the captured first plane image 125. The fitting parameters can be determined using any appropriate method known in the art. Functions of this type can be used to represent a wide variety of common image distortions including cross-track and in-track displacements and cross-track and in-track magnifications, as well as other more complex distortions such as skew and keystoning.
In an exemplary embodiment, the first plane image data 100 and the captured first plane image 125 are analyzed to determine a set of displacement vectors (sometimes called “motion vectors”) between corresponding features in the two images. The displacement vectors point from the expected location of the features in the first plane image data 100 to the corresponding position of the feature in the captured first plane image 125, thereby providing an indication of the displacement of the features. In some embodiments, the “images” that are analyzed can be the first plane image data 100 and the captured first plane image 125 for an entire page of the printed document. In other embodiments, a strip of image data corresponding to a subset of the page can be analyzed (e.g., a one inch tall strip across the width of the page).
Methods for determining displacement vectors are well-known in the image processing art. Typically, such methods involve using a feature matching algorithm to determine a set of corresponding features in a pair of images. The determined displacement vectors indicate the displacement (Δxi, Δyi) of the actual location of the ith feature in the captured first plane image 125 relative to its intended location (xi, yi) in the first plane image data 100.
In some cases, the first plane image data 100 may include text characters. In such cases, text detection/recognition algorithms can be used to determine the locations of the text characters. The text characters can then be used as features. The locations of the corresponding text characters in the first plane image data 100 and the captured first plane image 125 can then be used to define the displacement vectors.
In some cases, the first plane image data 100 may include graphical elements or photographic images. In such cases, edge detection algorithms can be used to detect the edges of these elements. The detected edges can then be used as features. The locations of the corresponding edges in the first plane image data 100 and the captured first plane image 125 can then be used to define the displacement vectors. For example, the rectangular boundary around a photographic image can be identified in the first plane image data 100 and the captured first plane image 125, and the difference in the locations of the boundary can be used to define the displacement vectors.
In some cases, the outer boundaries of the image content on a printed page (or in a region of the printed page) can be used to define the displacement vectors. The locations of the first and last image lines containing printed image data, and the locations of the left-most and right-most pixels containing printed image data on a particular line can be compared to their expected locations to determine corresponding displacement vectors.
Once the displacement vectors are determined for a set of features distributed at different locations within the image, then a data fitting algorithm (such as the well-known least-squares fitting algorithm) can be used to determine the values of the fitting parameters that best fit the motion vector data.
A simpler set of parametric functions for representing the cross-track and in-track displacement functions uses a smaller number of parameters:
f
x(x,y)=A0+Axx
f
y(x,y)=B0+Byy (3)
In this case, the A0 and B0 parameters are essentially cross-track and in-track displacement parameter, respectively, and the Ax and By parameters are essentially cross-track and in-track magnification factor parameters. While these functions do not provide any means for characterizing higher order distortions of the receiver medium 14, they are able to account for the most common displacements, and furthermore the associated spatial adjustments 145 will be more amenable to performing at high processing speeds.
In an even simpler arrangement, the cross-track and in-track displacement functions include only cross-track and in-track displacement parameters:
f
x(x,y)=A0
f
y(x,y)=B0 (4)
In this case, the cross-track and in-track displacement parameters can be determined by simply computing the average values of the cross-track and in-track components of the determined displacement vectors.
In some embodiments, the cross-track and in-track displacement functions can be represented using 2D look-up tables (2D LUTS), which indicate the displacement (Δx, Δy) for a lattice of (x,y) image positions. The 2D LUTS would typically be represented at a lower spatial resolution than the first plane image data 100. For example, in some embodiments, the 2D LUTS can specify displacements for a set of different cross-track intervals corresponding to segments of the printhead 12, and for a set of different in-track intervals. For example, displacements can be specified independently for a set of 40 cross-track intervals across the width of printhead 12, and for a set of 25 in-track intervals down the length of a page. In this example, the displacement function can be represented in a 2D LUT with 40×25 elements. The 2D LUT approach is the most flexible for accounting for more complex image distortions such as skew, keystoning or localized expansion/shrinkage of the receiver medium 14. However, it will require more storage memory and more processing power to apply the associated spatial adjustments, particularly for larger 2D LUT sizes.
There is no requirement that the cells of the 2D LUT be uniform in shape. For example, the LUT cells can be one pixel high in the in-track direction so that the displacement values can be specified independently on a line-by-line basis, while each image line can be sub-divided into segments that include hundreds of pixels. There is also no requirement that all of the cross-track intervals or all of the in-track intervals be of the same size. For example, the LUT cells can be larger in portions of the image where lower ink amounts are printed (e.g., along the margins of the page).
In some embodiment the 2D LUTS can store coefficients of an appropriate parametric displacement function in each LUT element. For example, each LUT element can store the A0 and B0 cross-track and in-track displacement parameters of Eq. (4) to define a displacement for each of the corresponding image regions. In some embodiments, a 2D interpolation process (e.g., bi-linear interpolation) can be used to determine a smooth displacement function by interpolating between the displacements stored in the 2D LUT. This has the advantage that it can eliminate any artifacts that could otherwise occur at boundaries between the LUT cells. Alternatively, each LUT element can store the coefficients for some other form of parametric displacement function (e.g., the A0 and B0 cross-track and in-track displacement parameters, and the Ax and By cross-track and in-track magnification factor parameters of Eq. (3)). In this case, the coefficients for each cell can be defined so as to satisfy the boundary condition that the displacements at the cell boundaries should be equal to within one quantization level (e.g., to within one pixel).
A determine spatial adjustments step 140 determines a set of spatial adjustments 145 appropriate to account for the determined image displacement 135. The goal is to distort the second plane image data 105 in the same way that the printed first plane image 115 was distorted so that the printed images will coincide with each other. The spatial adjustments 145 can take a variety of different forms depending on the nature of the image displacement 135, as well as the adjustment means that are available. For example, for the case where the image displacement 135 includes a cross-track and in-track displacement parameters, the spatial adjustments 145 can include corresponding cross-track and in-track shift values. Similarly, if the image displacement 135 includes cross-track and in-track magnification factor parameters, the spatial adjustments 145 can include corresponding cross-track and in-track resize factors, and if the image displacement 135 includes a skew angle parameter the spatial adjustments 145 can include a rotation angle shift. For cases where the image displacement 135 includes a more complex functional form as described above, the spatial adjustments 145 can include similar functions which compensate for the associated image distortions. In this case, a magnitude of the shifting, resizing and rotation (e.g., for skew correction) that is done to compensate for the determined image displacement 135 will generally vary as a function of location within the second plane image data 105.
An adjust second image plane step 150 is then used to apply the spatial adjustments 145 to the second plane image data 105 to determine adjusted second plane image data 155. The adjust second image plane step 150 can apply the spatial adjustments 145 in a variety of different ways depending on the nature of the spatial adjustments 145, as well as the adjustment means that are available. In some cases, some or all of the adjustments can be applied within the printhead 12 (
In some embodiments, if the spatial adjustments 145 include a cross-track shift value, the adjust second image plane step 150 can apply the shift value by simply laterally shifting each line of the image data relative to the array of nozzles in the printhead 12 (
Similarly, if the spatial adjustments 145 include an in-track shift value, the adjust second image plane step 150 can apply the shift value by retarding or advancing the time at which each line of image data is printed to adjust its in-track position on the receiver medium 14. For example, to shift the second plane image data forward in the in-track direction by a certain distance Δy, each line can be printed earlier by a corresponding time interval Δt=Δy/V, where V is the web velocity.
If the spatial adjustments 145 include a cross-track resize factor (e.g., the Ax parameter of Eq. (3)), the adjust second image plane step 150 can resize the image data by inserting or deleting pixels along the line of image data. For example, to increase the cross-track size of the image by 1% in a particular image region, one pixel of image data can be inserted for every 100 pixels in the line of image data. Similarly, to reduce the cross-track size of the image by 1% in a particular image region, one pixel of image data can be deleted for every 100 pixels in the line of image data. Since adjustments of the cross-track magnification can only be made by inserting or deleting pixels, the adjustments will be quantized to the size of a pixel. In order to avoid visible artifacts, the insertion of deletion of pixels has to be done with care, particularly in the case where the image data being adjusted has already been halftoned to a binary representation. In some embodiments, the spatial adjustments 145 for the cross-track shift value and the cross-track resize value can be done using the method described in commonly-assigned, co-pending U.S. patent application Ser. No. 13/599,067 to Enge et al., entitled “Aligning print data using matching pixel patterns,” which is incorporated herein by reference. This approach reduces image artifacts by inserting or deleting the image pixels based on predefined pixel patterns.
In some embodiments, if the spatial adjustments 145 include an in-track resize factor (e.g., the Bx parameter of Eq. (3)), the adjust second image plane step 150 can resize the image data by adjusting the timing at which the lines of image data are printed. For example, to increase the in-track size of the image by a certain percentage, the time interval between when consecutive image lines are printed can be increased by the same percentage. This can be done by adjusting a frequency generator associated with the printhead 12 which controls the firing frequency for the nozzles in the printhead 12. In some embodiments, the firing frequency can be adjusted by over-clocking the master timing signal 19 (e.g., by a factor of 40×), then adjusting the number of over-clocked pulses that are counted between the printing of consecutive image lines. In some embodiments, each time a line is printed, a firing counter is loaded with a delay value indicating the time delay until the next line is printed. The value of the firing counter can be changed according to in-track magnification value calculated in the displacement. For the case where the master timing signal 19 is over-clocked by a factor of 40×, a firing counter of 40 would deliver nominal in-track magnification of the printed image. Values smaller or larger than 40 would deliver smaller or larger in in-track magnifications. In some embodiments, separate firing counters can be provided for individual segments of the printhead to provide independent control of the resize factor. In order to achieve a smooth in-track magnification correction without visible image artifacts, the adjustment of the time intervals should generally be quasi-continuous. Similarly, since corrections for distortions such as skew and keystone can also be made by adjustment of the time intervals between lines, over-clocking the master timing signal 19 by a large factor (e.g., 40×) achieves a quasi-continuous adjustment of the time intervals between lines.
Commonly-assigned U.S. Pat. No. 6,817,295 to Metzler, entitled “Method and illustration device for register mark setting” describes a method for adjusting a firing counter to control the image size that can be used in accordance with the present invention. In the described embodiment, the size control of the image is used to compensate for runout of rotating image-forming members, however it will be obvious to one skilled in the art that the same method can be used to compensate for image magnification distortions that originate from other sources as well. A series of related disclosures (U.S. Pat. No. 6,836,635 to Metzler et al., entitled “Method and control device for preventing register errors,” U.S. Pat. No. 6,848,361 to Metzler, entitled “Control device and method to prevent register errors,” and U.S. Pat. No. 6,920,292 to Metzler, entitled “Method and control device for prevention of image plane registration errors”) describe additional details of how this approach can be used compensate for other mechanical effects, and how a closed-loop control process can be implemented.
For embodiments where the spatial adjustments 145 are limited to a cross-track displacement parameter, an in-track displacement parameter, a cross-track magnification factor parameter, an in-track magnification factor parameter, the adjustments can readily be applied to the second plane image data 105 using data processors and frequency generators associated with the printhead 12 as has been described above. These adjustments can be applied even in the case where the second plane image data 105 has been halftoned to two levels (or multitoned to a small number of levels).
For cases where the spatial adjustments 145 include a rotation angle shift (to adjust the skew angle) or a more complex spatial adjustment function, the amount of adjustment will generally need to vary as a function of location within the image. For example, to correct for skew the amount of in-track displacement needs to vary across the width of the printhead 12. In some embodiments, this can be accomplished by applying different adjustments for different segments of the printhead 12. For example, in some embodiments the printhead 12 can be segmented into a number cross-track intervals (e.g., 40 segments). By providing separate in-track shift values, cross-track shift values, cross-track magnification values, and in-track magnification values (e.g., firing counters), for each segment of the printhead 12, complex spatial adjustments 145 can be applied to the image. In some embodiments, the number of separately controllable printhead segments can be equal to the number of cross-track elements in a 2D LUT used to represent the image displacement 135. The control values for each segment can be updated at intervals corresponding to the number of in-track elements in the 2D LUT.
For cases where complex spatial adjustments 145 are applied, it will sometimes be more convenient to process the second plane image data 105 to apply the desired corrections to determine a modified image which can then be printed using the normal printing process (i.e., without adjusting firing counters or other printhead control parameters). For example, the second plane image data 105 can be resampled using a grid of sample points whose positions have been shifted according to the spatial adjustments 145. It is preferable to perform the resampling operations on the image data before it's halftoned (or multitoned) to reduce the susceptibility to forming sampling artifacts. However, this may not be practical in all systems depending on the workflow and the processing capabilities of the data processors associated with the printing system 10.
A print second plane step 160 then prints the adjusted second plane image data 155 using the second printing module 20 by depositing an associated marking material on the receiver medium 14 (
As will be well-known to those skilled in the control systems art, it will sometimes be desirable to determine the spatial adjustments 145 for a particular image based on a plurality of captured first plane images 125. For example, when a sequence of identical (or similar) images are printed, it may be desirable to perform a moving average of the spatial adjustments 145 determined from each of the individual images in order to reduce noise in the determined spatial adjustments.
Optionally, the determined image displacement 135 can also be used to adjust the first plane image data 100 for subsequently printed images. In this case, information related to the image displacement 135 determined in the second printing module 20 of
The process discussed relative to
In some embodiments, if the analysis of the images captured by the image capture system 13 in the third printing module 20 shows that the printed second plane image 165 is not perfectly aligned with the printed first plane image 115, then appropriate spatial adjustment control signals 27 can be fed back to the second printing module 20 and used to apply spatial adjustments to the second plane image data 105 for subsequent images. The residual alignment errors can result from additional distortions in the receiver medium 14 that occur between the image capture system 13 and the printhead 12 in the second printing module 20, or can result from inaccuracies in the determination of the image displacement 135 (e.g., due to misalignment of the image capture system 13). The spatial adjustment control signals 27 can be provided by determining an image displacement between the printed first plane image 115 and the printed second plane image 165 in the image captured by the image capture system 13 in the third printing module 20. In some embodiments, the spatial adjustment control signals 27 can be a representation of the residual displacement, which can be combined with the image displacement 135 determined using the method of
The present invention provides the advantage that the alignment characteristics of the printed images is evaluated in real-time, and used to provide rapid correction of any misalignment that is detected. This is important for printing systems 10 that are used to print variable image content where the amount and distribution of marking material (e.g., ink), and therefore the amount of distortion that is introduced to the receiver medium 14, can vary on a page-by-page basis. Since the misalignment of the first image plane is determined before the second image plane is printed, the distortions of the receiver medium 14 associated with the particular image content can be accurately accounted for when the second image plane is printed.
In some embodiments, a registration feature sensor 23 can be positioned along the transport path upstream of the printhead 12 in the first printing module 20 as shown in
The registration features can be any detectable markings that can be readily detected using an appropriate sensing means. Examples of registration features would be printed marks (visible of UV-fluorescent), holes formed through the media or embedded security bands. In some embodiments, the edge of the receiver medium 14 can be used as a registration feature. In other embodiments, a perforation of the receiver medium 14, or preprinted image content (e.g., pre-printed forms) can also be used as registration features. In some embodiments, the registration features can be formed using the method described in commonly-assigned, co-pending U.S. patent application Ser. No. 13/941,713 to Piatt et al., entitled “Media-tracking system using marking heat source,” which is incorporated herein by reference. This approach utilizes a small heat source which forms periodic marks on the receiver medium 14 by discoloring the receiver medium 14, altering a fluorescence of the receiver medium 14, or burning a hole through the receiver medium 14.
Typically, the registration features are formed at periodic intervals along one or both edges of the receiver medium 14. The registration features can be a series of small spots, or alternately can be reticules, or other geometric features.
In some embodiments, the registration feature sensor 23 can be a digital imaging system similar to (or even identical to) the image capture systems 13. Alternately, the registration feature sensor 23 can be any type of sensing system known in the art appropriate for detecting the position of registration features. For example, the registration feature sensor 23 can be a point sensor that detects when the registration feature passes by, or it can be an edge sensor that senses a location of a media edge. In some cases a plurality of registration feature sensors 23 can be used. For example, one the registration feature sensor 23 can be positioned to detect registration features along the left edge of the receiver medium 14, and a second registration feature sensor 23 can be positioned to detect registration features along the right edge of the receiver medium 14.
A compare locations step 220 compares the detected registration feature locations 215 to the corresponding nominal registration feature locations 205 to determine registration feature displacements 225. For example, the nominal registration feature locations 205 may indicate that the registration features are expected to be found at predefined in-track intervals along both edges of the receiver medium 14 at particular cross-track positions. If the registration feature displacements 225 are found to be non-zero, then this provides an indication that the receiver medium 14 has been displaced relative to its expected location (e.g., due to some or all of cross-track shift, in-track shift, in-track expansion/shrinkage or cross-track expansion/shrinkage). For example, if the registration features are all shifted to the right or the left in the cross-track direction this would indicate that a cross-track shift had occurred. Similarly, if the registration features are all shifted forward or backward in the in-track direction this would indicate that an in-track shift had occurred. If the registration features along the opposite edges of the receiver medium 14 are closer or farther apart than an expected distance this would indicate that a cross-track expansion/shrinkage had occurred. Similarly, if the periodic registration features along one of the edges are farther apart than an expected period this would indicate that an in-track expansion/shrinkage had occurred.
A determine spatial adjustments step 230 analyzes the registration feature displacements 225 to determine appropriate spatial adjustments 145 that can be applied to the first plane image data 100 in order to position the first image plane in a predefined location relative to the registration features 200.
As with the spatial adjustments 145 of
An adjust first image plane step 240 is then used to adjust the first plane image data 100 responsive to the determined spatial adjustments 145 to determine an adjusted first plane image data 245. The details of this step will be analogous to those that were discussed earlier with respect to the adjust second image plane step 150 (
Finally, print first plane step 110 is used to print the adjusted first plane image data 245 using the first printing module 20 (
An analogous process can be used for each of the subsequent image planes. In this case, the image capture systems 13 (
In some embodiments, if the analysis of the images captured by the image capture system 13 in the second printing module 20 shows that the printed first plane image 115 is not perfectly positioned at the desired predefined location relative to the registration features 200, then appropriate spatial adjustment control signals 27 can be fed back to the first printing module and used to apply spatial adjustments to the first plane image data 100 for subsequent images. The residual alignment errors can result from additional distortions in the receiver medium 14 that occur between the registration feature sensor 23 and the printhead 12 in the first printing module 20, or can result from inaccuracies in the determination of the registration feature displacement 225 (e.g., due to misalignment of the registration feature sensor 23). In some embodiments, the spatial adjustment control signals 27 can be representation of a residual error in the location of the printed first plane image 115 with respect to the locations of the registration features in the captured image, which can be combined with the registration features displacements 225 determined using the method of
The embodiments that have been discussed above have focused primarily on a “feed-forward” approach where spatial adjustments 145 (
According to the method shown in
Another feedback approach is illustrated in
According to the method of
The image capture system 13 (
A compare first plane images step 175 is used to compare the first plane image data 100 to the captured first plane image 125 to determine a first image displacement 180. Likewise, a compare second plane images step 185 is used to compare the second plane image data 105 to the captured second plane image 170 to determine a second image displacement 190. (The compare first plane images step 175 and the compare second plane images step 185 function in an analogous manner to the compare images step 130 that was discussed earlier with respect to
A determine spatial adjustments step 195 is then used to determine spatial adjustments 145 responsive to the first image displacement 180 and the second image displacement 190. The spatial adjustments 145 are appropriate to be applied to at least one of the first and second image planes of a subsequent image so as to provide reduced alignment errors between the printed image data for the first and second image planes in the subsequent image.
The determine spatial adjustments step 195 can determine the spatial adjustments 145 in various ways according to different embodiments. In an exemplary embodiment, the first image displacement 180 is compared to the second image displacement 190 to determine a relative displacement between the printed first plane image 115 and the printed second plane image 165. (For example, if Δx1 is a cross-track displacement for a particular pixel in the first plane image data 100 and Δx2 is a cross-track displacement for the corresponding pixel in the second plane image data 105, then the cross-track component of the relative displacement can be determined as Δxr=Δx2−Δx1.) The determined relative displacement can then be used to determine spatial adjustments that can be used to adjust the second plane image data 105 for the subsequent image so that the printed second plane image 165 of the subsequent image will have substantially the same displacement as the printed first plane image 115 of the subsequent image. (For example, the spatial adjustments 145 applied to the second plane image data 105 can be specified to be equal in magnitude and opposite in direction relative to the determined relative displacement.) In this way, the alignment errors between the printed first plane image 115 and the printed second plane image 165 will be reduced for the subsequent image. In some embodiments, the relative displacement can be determined directly by analyzing the captured first plane image 125 and the captured second plane image 170, rather than by explicitly determining the first image displacement 180 and the second image displacement 190.
In other embodiments, spatial adjustments 145 can be determined for adjusting both the first plane image data 100 and the second plane image data 105. For example, the first image displacement 180 can be used to determine spatial adjustments for the first plane image data 100 and the second image displacement 190 can be used to determine spatial adjustments for the second plane image data 105. In this way, the printed first plane image 115 and the printed second plane image 165 for the subsequent image will both have reduced alignment errors relative to their nominal locations.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
