Printed images may contain printing defects, and this is a known problem associated with printing processes. Examples of printing defects include scratches, spots, missing dot clusters, ink smears, streaks, and band defects.
Band defects (also known as mechanical bands) are visually noticeable tone fluctuations that usually appear as horizontal or vertical stripes across a printed sheet of paper (page). These bands, and other printing defects, can be caused in printing processes as a result of process speed variations, machine vibrations, drum impact, and other mechanical, physical, chemical, environmental, and algorithmic instabilities. Printing defects are undesirable as they can degrade the perceived quality of the prints. Therefore, there is a requirement to evaluate the severity of printing defects such that corrective measures may be taken to improve the quality of the prints. Furthermore, it is desirable to be able to identify bands and in particular the most problematic bands, so that the cause of these bands may be identified and corrected as a priority.
The severity of bands is currently evaluated manually, by human observers. However, this evaluation is subjective since different observers will have contradicting opinions regarding the severity of the same bands. In addition, human observers' opinions are not reliable and reproducible because many different factors will affect the way humans capture band severity. As a result, a committee of human evaluators is used to define the relative perceptual severity of the bands. In a large committee, conflicts between the opinions of the different observers cancel out, giving a more stable result. However, gathering a committee is often not practical and, as a result, evaluation may typically be carried out by just a few human observers.
An additional disadvantage is that evaluating bands is a difficult, subjective task for the human observer. In addition, it takes the evaluation of many sheets to characterize the state of the printing process, this evaluation task is also time consuming and tedious. Furthermore, in real time applications, such as diagnostic routines which automatically identify problems in a printing press, including identifying the source of a print quality problem on the press, manual evaluation of bands is not practical.
Embodiments of the invention will now be described, by way of non-limiting example, with reference to the accompanying diagrammatic drawings, in which:
a is a basic printed test pattern containing bands;
b is a replication of the printed test pattern of
c is a is a replication of the printed test pattern of
d is an example of a printed test pattern showing exaggerated bands;
a and 2b are examples of mean grey level profiles highlighting the differences in features of two different bands;
a and 6b are examples of different kernels showing the second derivative of a Gaussian function;
a and 7b are illustrations of the convolution responses when there are no neighbouring bands (
a is a test pattern of a grey image comprising horizontal lines being approximately 100 microns thick. The printed test pattern is a uniform grey tone. This test pattern is used for visual band assessment because it enhances the visibility of otherwise less noticeable bands, and any bands generated by the printing process will appear as different grey tones in the printed image.
Bands, as shown in
d is a representation of a printed test sheet showing a plurality of exaggerated bands (light and dark). This image is exaggerated for the purpose of reproduction/publication of this document. However, a person skilled in the art will appreciate that in real-life the bands are more subtle than those shown in
As shown in
Furthermore, in order to be able to identify and rank the severity of the bands it is important to determine which of the various bands' features influence human ranking, and how that ranking is affected. Perceptual band severity is defined by human observers, who sub-consciously capture the many features of the band, and compare them, in order to rank them in order of severity. Due to the subjective nature of band evaluation, identifying the most problematic bands, and therefore the bands which are of a highest priority to remedy, is a not a trivial task.
As a first step to determining the various bands' features it is possible to obtain a profile of one or more printed sheets. Each printed sheet is scanned and analysed independently. Results for a plurality of printed and scanned sheets may be collated after analysis in order to provide further evaluation of the presence of bands, for example, to gain a measure for the percentage of sheets in a group which have a noticeable band in a particular location.
After a page is printed and scanned a mean grey value for each location along the sheet is generated by averagingthegrey-scale intensity alongtheband direction (see ArrowA in
a and 2b demonstrate the factors which influence the complexity of the task of understanding the features which influence the severity of the bands.
While the severity of those bands is deemed to be equivalent, their features seem to have nothing in common. Band K is wide and isolated (i.e. there are no bands in the neighborhood of Band K and the band appears to be relatively wide), while B and H is thin and surrounded by other bands. It is the combination of the different features that makes those bands equivalent in terms of severity to the human observer. It is desirable to be able to identify bands with different features, but which are of seemingly equivalent severity.
It is also desirable to be able to identify individual bands and define their approximate boundaries. This task is difficult because some bands that appear to be separated when viewed under close examination can appear to be a single band when viewed at a greater distance. Other bands have vague boundaries making it hard to distinguish them. It is desirable to be able to identify the individual bands such that they can be investigated and corrected.
From the examples in
One aspect of the present invention resides in a band measurement (MBM) tool for analyzing the severity of the identified bands, in order to produce a ranked list of the bands to be investigated and corrected.
The MBM tool enables analysis of features of the bands by looking at the profile of the printed page at different scales (i.e. equivalent to viewing the profile at different scales). The features of a band are comparatively assessed at different scales and may be comparatively assessed in relation to other bands in the printed sheet.
The MBM tool may have many possible applications, for example during research and development of printing processes, testing of printing presses, or within a printing press diagnosis or a print quality inspection system. As such, the output of the MBM tool may be tailored depending on the particular application. For example, the MBM tool may produce a list of bands in descending severity, and/or a list of locations where the bands are above pre-defined threshold. The MBM tool may also provide the location and severity of the most severe band (also known as the worth band) in the page.
A schematic block diagram of an MBM tool 10 is shown in
Due to variations in printed sheets 14, it is desirable to print, scan and analyse a plurality of sheets 14, for example upwards of thirty sheets. However, for simplicity, the method described below relates to the analysis of one printed sheet.
A test pattern is printed, using the printing press under test, and is captured, using for example an appropriate scanning device 12. The scanner 12 may be a near line scanner, or a scan bar incorporated in the printing press under test. The scanned image is stored in a memory store 18 for future analysis.
A schematic block diagram of the BSA 16 of
As part of the scanning process, it is possible that the test pattern in the scanned image is at an angle, i.e. the edge of the test pattern is not aligned with the edge of the scanned image. Therefore, the scanned image may be rotated, by the profile generator 26, such that the bands align with and are parallel to the edge of the test pattern.
The BSA 16 in
By analyzing the profile in different scales it is possible to look at features, which belong to a particular band, in each of the different scales. The features of the band throughout the different scales can be compared and a predominant feature is used to determine a severity rating for that band. Repeating this for each of the bands enables determination of a comparative rating for each band in the printed sheet.
The technique described below, using a linear scale-space representation and linear kernels, is one example of the analysis which may occur at the plurality of different scales. However, a person skilled in the art will appreciate that other techniques may be suitable.
For a given image profile f(x) its linear scale-space representation is a family of derived signals L(x,t) defined by the convolution of f(x) with a linear kernel in different scales, K(t).
An overview of the method steps for analyzing the image profile to determine a severity rating of bands in printed sheets is described with reference to
A profile of a printed and captured (e.g. scanned) sheet comprising a test pattern is generated, at step 30 by the profile generator 26. This profile is extracted, at step 32, into the scale-space. In one embodiment of the present, this is achieved by convolving the profile with the at least one kernel in a plurality of scales. The kernel may be a second derivative of a Gaussian function. However, other kernels may be used.
a and 6b show examples of kernels which are second derivatives of a Gaussian function for use in the convolution process at different scales.
Other kernels may be used in other embodiments of the present invention. Some examples for such kernels include: a matching filter which may be tailored to a specific defect by averaging many appearances of the defect; a gabor filter, sine and cosine filters and any type of high pass and band pass filters.
In one embodiment, two or more kernels may be used. For example, a first kernel may be the second derivative of a Gaussian function, and a second kernel may be the inverse of the first kernel (i.e. the second derivative of a Gaussian flipped about the x-axis). The first kernel is used in the detection of light bands, and the second kernel is used in the detection of dark bands. It is advantageous to be able to detect both light bands and dark bands independently because the perceived severity of these bands is subjective, and varies between human observers.
By identifying the zero crossings in the derivative of the results of the convolution, it is possible to identify the local maximum for a given band. This can be repeated at each of the plurality of scales. It is desirable to be able to identify the local maxima of each band at each scale because the inventors have found that variations in the attributes of the local maxima (i.e. the value of the local maxima) may be used in the determination of the severity rating for that band.
The local maxima for each band at each scale are determined, at step 34, by identifying the zero-crossing points of the derivative of the convolution results.
It is possible to link all of the identified local maxima for a particular band in each of the plurality of scales through reference to the location of each of the identified local maxima in each scale, and determining whether the local maxima belongs to the same band.
The kernel width W is the distance from the location of the maximum of the kernel, to the location of the minimum of the kernel, multiplied by a constant, for example 0.6. A local maxima (zero-crossing of the derivative) identified at location LOC in one scale, may be linked with local maxima identified in the region [LOC−W, LOC+W] in other scales.
As noted above, the profile is convolved with the kernel at a plurality of scales. A first convolution step, at a first scale (the coarsest scale), yields a first value for the identified maxima (i.e. at the zero-crossing). This is achieved for each band (i.e. for each identified zero crossing) in the printed sheet.
For each band, the first values of the identified maxima are stored, at step 36, as an indication of a first severity rating for each band, together with position information for each band. Subsequent convolution steps, at progressively finer scales, yield subsequent values for the identified maxima in each scale. As described above, the local maxima which are identified at each of the plurality of scales may be attributed to a particular band in dependence on the position of the local maxima in each scale.
In one embodiment of the present invention, all of the identified maxima for each band at each scale are stored. After gathering all local maxima and related features of all bands, the identified maxima that correspond to the same band are compared to determine which of the stored maxima is the representative of this band. In other words, the corresponding weighted convolution at the maximum's location has the greatest value. The representative maximum and related features are stored as an indication of the severity rating for that band.
In an alternative embodiment, a comparison is carried out at each of the plurality of scales. For example, after the first value is stored at step 36, a second convolution process at a second (finer) scale yields, at step 38, a second value for the identified maxima. This second value is compared, at step 42, with the first stored value, and if the second value is greater than the first stored value, the first stored value is over-written, at step 42, with the second value. This comparison occurs at each scale, such that at the end of the process, the stored value of the identified maxima is the greatest value of each identified maxima at each scale. It is this stored value which becomes the indication of the severity rating for that band.
The number of scales at which the convolution occurs may vary depending upon the application of the MBM tool 10. The number of scales may be selected depending upon the printing process under test. However, it is to be appreciated that the present invention does not reside in the number of scales used, rather that the analysis is performed at a plurality of scales.
As discussed above in relation to
The effect of neighbouring bands is shown in
The reduction in the convolution response is compensated for, at step 40, prior to the comparing and overwriting the stored values, at step 42. One example of a method for compensating includes multiplying the resultant convolution response for a local portion of the profile by a compensation function, r(t,d), and this compensation function depends on the present scale of the convolution, t, and on the determined distance between the current band and the closest neighbouring band, d. One example of a suitable r(t,d) is a Gaussian function.
It is possible to fine tune the MBM tool by applying weighting functions at each of the plurality of scales. The inventors of the present invention identified through a training set of data that initial results obtained by the MBM tool differed slightly from results obtained by human observers. Since the invention is concerned with the perceptual severity of the bands, the results of the human observers are definitive, and the results of the MBM tool should be consistent with the human observer results. The inventors devised a plurality of weighting functions, which when applied to the convolution results, made the overall MBM results more consistent with those of the human observers.
In one embodiment, the weightings are applied, at step 44, in each scale, after the convolution and compensations steps. In other words, the stored values are the maximal weighted values and the comparison between values is between a weighted convolution value at current local maxima in a current scale, and a stored maximal weighted value for the same band.
Alternatively, the weighting functions may be applied after all of the maxima in each scale have been identified. The determination of the maximal weighted value is evaluated after the weighting functions have been applied.
In either case, the BSA determines, at step 46, a maximal weighted value for each band for use in reporting the results of the analysis.
With reference to
The BSA 16 may also comprise: a compensator 58, for compensating for neighbouring bands by multiplying the convolution results by the compensation factor (r(t,d)) to obtain compensated convolution results; and a weighting module 60, for applying an appropriate weighting function to the identified local maxima at each of the plurality of scales, wherein the determined maximum value is the maximal weighted value for that band.
The memory store 18 may be arranged to store a plurality of profiles, maxima values and locations for those profiles, compensation factors, and weighting functions.
In each scale different weighting functions are added to the features of the band. In one embodiment of the present invention, the weighting functions are determined on the basis of human visual models in the frequency domain (MTF). The inventors have found that variations of known MTFs, which are originally extracted for harmonic bands, do not match human perception of singular bands. As a result, a specific human visual function was developed in order to weight the relative severity of the band as a function of band width. These weighting functions were developed by the present inventors through a process of trial and error on the training set of data, and a representation of the weighting function is shown in
Also shown in
A plurality of independent tests, one of which is detailed in the below, showed that these weightings hold true not just for the training set but for real-life data sets.
The results are values/scores that describe the severity of the band that might exist in each location along the print. Those scores are relative to other scores for the print, and are not given in absolute terms.
A comparison of the MBM results and the human observer results for the same printed sheet shows that there is an overall agreement between the relative marks given to the bands by the tool and by the human evaluator. For example, the three bands (numbered 1, 2, and 3), corresponding to bands in
The tool is more exact than the human observer because there is a limitation in the number of severity ratings which a human observer can distinguish between: this is not a limitation in the MBM tool. For example, a human observer may be able to attribute a severity rating from 0 to 5 for each band, where 0 indicates no band, and 5 indicates the most severe rating for a band. The MBM tool is able to attribute a finer scale for the severity rating and so it is possible for the tool to distinguish that band 3 is more severe than bands 1 and 2. The reason for this is that the MBM tool is not limited to providing integer levels of severity. Rather the MBM tool calculates a score for each band, and the higher the score, the more severe the band.
Also shown in
The threshold value may be set during calibration of the MBM tool. Alternatively, this level may be set by a committee of human observers who decide which bands are acceptable and which are not.
To evaluate the effectiveness of the tool, a perceptual test is used, to corroborate that the results given by the MBM tool can be trusted. An overview of a suitable test is provided below.
The test printed sheet contains seventeen bands which represent a variety of bands resulting from a printing process under test. The seventeen bands are printed in eight sheets, where some of the sheets contain more than one band, and where there are up to four bands per sheet. The seventeen bands are identified by alphanumeric letters (see Table 1 below). Thirty human observers (numbered 1 to 30) volunteered to take part in the test, all of them experienced in bands evaluation for the printing process under test. During the test, each of the thirty observers ranked the bands from “1” (the least disturbing band) to “17” (the most disturbing band). The ranking was done in normal work environment conditions.
Table 1 below shows the ranks given to the bands by each of the human evaluators. These results are collated to give a committee result for each band. This may be simply the average rank from all of the observer ranks (i.e. the sum of all rankings divided by the number of human observers). However, it is to be appreciated that there are other ways in which a committee score may be derived from the results in Table 1.
When a committee rank is known, it is possible to evaluate a particular ranking using a Rank Agreement Measure (RAM) which is used to denote the agreement between this particular rank and the committee rank. There are many ways to evaluate RAM, as will be appreciated by a person skilled in the art. One example is the mean value of a Spearman Rank Correlation, which is used to denote the correlation between the particular rank and each of the committee ranked-votes.
A RAM value is attributed to each of the observer's ranks, as shown by the round dots in
Using the MBM tool 10 to analyze the bands in the same printed sheets as above, the tool gives a mark (score) to each of the seventeen bands, as detailed in Table 2.
The bands are ordered on the basis of their scores, in terms of their relative severity, and are assigned a relative rank (also known as an MBA rank) from 0 to 17.
Tying these results together, Table 2 shows Band B having the highest mark, and therefore being the most severe. This corresponds with the results for Band B in Table 1, which the vast majority of human observers ranking Band B as a rank 16 or 17 band.
The RAM of the MBM tool results (also obtained using the mean Spearman Rank Correlation) is denoted by a triangle symbol in
The MBM tool may be tuned and tested for bands that appear in Hewlett-Packard® Indigo print presses. However, it is to be appreciated that the tool may be tuned for other presses and printers as well.
A person skilled in the art will appreciate that there are other methods for tuning or calibrating the MBM tool, for example non-parametric search methods, such as Gauss Newton, steepest decent, design of experiment, genetic algorithms, simulated annealing, neural networks, and other additional optimization/search methods. The basic requirements for these methods is to sample the parameter space, and for each set of parameters to calculate the “cost function” which is the agreement between tool's scores to human scores until you find the optimal set of parameters. The methods differ in the way they choose which set of parameters to check. However, they provide a suitable method for calibrating the MBM tool to the printing process being tested.
Number | Name | Date | Kind |
---|---|---|---|
6157735 | Holub | Dec 2000 | A |
6165170 | Wynne et al. | Dec 2000 | A |
RE38716 | Caspi et al. | Mar 2005 | E |
7133070 | Wheeler et al. | Nov 2006 | B2 |
20020035461 | Chang et al. | Mar 2002 | A1 |
20020171697 | Gargir et al. | Nov 2002 | A1 |
20030095197 | Wheeler et al. | May 2003 | A1 |
20030156733 | Zeller et al. | Aug 2003 | A1 |
20080013848 | Wu et al. | Jan 2008 | A1 |
20080079959 | Yamazaki | Apr 2008 | A1 |
20080309959 | Martinez et al. | Dec 2008 | A1 |
20090028585 | Guo et al. | Jan 2009 | A1 |
20100021001 | Honsinger et al. | Jan 2010 | A1 |
20100232652 | Yeh et al. | Sep 2010 | A1 |
20110221936 | Steinberg et al. | Sep 2011 | A1 |
Number | Date | Country |
---|---|---|
WO 2007045277 | Apr 2007 | WO |
Number | Date | Country | |
---|---|---|---|
20100303305 A1 | Dec 2010 | US |