This invention relates to a method and apparatus for rendering color images. More specifically, this invention relates to a method for half-toning color images in situations where a limited set of primary colors are available, and this limited set may not be well structured. This method may mitigate the effects of pixelated panel blooming (i.e., the display pixels not being the intended color because that pixel is interacting with nearby pixels), which can alter the appearance of a color electro-optic (e.g., electrophoretic) or similar display in response to changes in ambient surroundings, including temperature, illumination, or power level. This invention also relates to a methods for estimating the gamut of a color display.
The term “pixel” is used herein in its conventional meaning in the display art to mean the smallest unit of a display capable of generating all the colors which the display itself can show.
Half-toning has been used for many decades in the printing industry to represent gray tones by covering a varying proportion of each pixel of white paper with black ink. Similar half-toning schemes can be used with CMY or CMYK color printing systems, with the color channels being varied independently of each other.
However, there are many color systems in which the color channels cannot be varied independently of one another, in as much as each pixel can display any one of a limited set of primary colors (such systems may hereinafter be referred to as “limited palette displays” or “LPD's”); the ECD patent color displays are of this type. To create other colors, the primaries must be spatially dithered to produce the correct color sensation.
Standard dithering algorithms such as error diffusion algorithms (in which the “error” introduced by printing one pixel in a particular color which differs from the color theoretically required at that pixel is distributed among neighboring pixels so that overall the correct color sensation is produced) can be employed with limited palette displays. There is an enormous literature on error diffusion; for a review see Pappas, Thrasyvoulos N. “Model-based halftoning of color images,” IEEE Transactions on Image Processing 6.7 (1997): 1014-1024.
ECD systems exhibit certain peculiarities that must be taken into account in designing dithering algorithms for use in such systems. Inter-pixel artifacts are a common feature in such systems. One type of artifact is caused by so-called “blooming”; in both monochrome and color systems, there is a tendency for the electric field generated by a pixel electrode to affect an area of the electro-optic medium wider than that of the pixel electrode itself so that, in effect, one pixel's optical state spreads out into parts of the areas of adjacent pixels. Another kind of crosstalk is experienced when driving adjacent pixels brings about a final optical state, in the area between the pixels that differs from that reached by either of the pixels themselves, this final optical state being caused by the averaged electric field experienced in the inter-pixel region. Similar effects are experienced in monochrome systems, but since such systems are one-dimensional in color space, the inter-pixel region usually displays a gray state intermediate the states of the two adjacent pixel, and such an intermediate gray state does not greatly affect the average reflectance of the region, or it can easily be modeled as an effective blooming. However, in a color display, the inter-pixel region can display colors not present in either adjacent pixel.
The aforementioned problems in color displays have serious consequences for the color gamut and the linearity of the color predicted by spatially dithering primaries. Consider using a spatially dithered pattern of saturated Red and Yellow from the primary palette of an ECD display to attempt to create a desired orange color. Without crosstalk, the combination required to create the orange color can be predicted perfectly in the far field by using linear additive color mixing laws. Since Red and Yellow are on the color gamut boundary, this predicted orange color should also be on the gamut boundary. However, if the aforementioned effects produce (say) a blueish band in the inter-pixel region between adjacent Red and Yellow pixels, the resulting color will be much more neutral than the predicted orange color. This results in a “dent” in the gamut boundary, or, to be more accurate since the boundary is actually three-dimensional, a scallop. Thus, not only does a naïve dithering approach fail to accurately predict the required dithering, but it may as in this case attempt to produce a color which is not available since it is outside the achievable color gamut.
Ideally, one would like to be able to predict the achievable gamut by extensive measurement of patterns or advanced modeling. This may be not be feasible if the number of device primaries is large, or if the crosstalk errors are large compared to the errors introduced by quantizing pixels to a primary colors. The present invention provides a dithering method that incorporates a model of blooming/crosstalk errors such that the realized color on the display is closer to the predicted color. Furthermore, the method stabilizes the error diffusion in the case that the desired color falls outside the realizable gamut, since normally error diffusion will produce unbounded errors when dithering to colors outside the convex hull of the primaries.
ei,j=ui,j−y′i,j
The error values ei,j are then fed to the error filter 106, which serves to distribute the error values over one or more selected pixels. For example, if the error diffusion is being carried out on pixels from left to right in each row and from top to bottom in the image, the error filter 106 might distribute the error over the next pixel in the row being processed, and the three nearest neighbors of the pixel being processed in the next row down. Alternatively, the error filter 106 might distribute the error over the next two pixels in the row being processed, and the nearest neighbors of the pixel being processed in the next two rows down. It will be appreciated that the error filter need not apply the same proportion of the error to each of the pixels over which the error is distributed; for example when the error filter 106 distributes the error over the next pixel in the row being processed, and the three nearest neighbors of the pixel being processed in the next row down, it may be appropriate to distribute more of the error to the next pixel in the row being processed and to the pixel immediately below the pixel being processed, and less of the error to the two diagonal neighbors of the pixel being processed.
Unfortunately, when conventional error diffusion methods (e.g.,
The present invention seeks to provide a method of rendering color images which reduces or eliminates the problems of instability caused by such conventional error diffusion methods. The present invention provides an image processing method designed to decrease dither noise while increasing apparent contrast and gamut-mapping for color displays, especially color electrophoretic displays, so as to allow a much broader range of content to be shown on the display without serious artifacts.
This invention also relates to a hardware system for rendering images on an electronic paper device, in particular color images on an electrophoretic display, e.g., a four particle electrophoretic display with an active matrix backplane. By incorporating environmental data from the electronic paper device, a remote processor can render image data for optimal viewing. The system additionally allows the distribution of computationally-intensive calculations, such as determining a color space that is optimum for both the environmental conditions and the image that will be displayed.
Electronic displays typically include an active matrix backplane, a master controller, local memory and a set of communication and interface ports. The master controller receives data via the communication/interface ports or retrieves it from the device memory. Once the data is in the master controller, it is translated into a set of instruction for the active matrix backplane. The active matrix backplane receives these instructions from the master controller and produces the image. In the case of a color device, on-device gamut computations may require a master controller with increased computational power. As indicated above, rendering methods for color electrophoretic displays are often computational intense, and although, as discussed in detail below, the present invention itself provides methods for reducing the computational load imposed by rendering, both the rendering (dithering) step and other steps of the overall rendering process may still impose major loads on device computational processing systems.
The increased computational power required for image rendering diminishes the advantages of electrophoretic displays in some applications. In particular, the cost of manufacturing the device increases, as does the device power consumption, when the master controller is configured to perform complicated rendering algorithms. Furthermore, the extra heat generated by the controller requires thermal management. Accordingly, at least in some cases, as for example when very high resolution images, or a large number of images need to be rendered in a short time, it may be desirable to move many of the rendering calculations off the electrophoretic device itself.
Accordingly, in one aspect this invention provides a system for producing a color image. The system includes an electro-optic display having pixels and a color gamut including a palette of primaries; and a processor in communication with the electro-optic display. The processor is configured to render color images for the electro-optic device by performing the following steps: a) receiving first and second sets of input values representing colors of first and second pixels of an image to be displayed on the electro-optic display; b) equating the first set of input values to a first modified set of input values; c) projecting the first modified set of input value on to the color gamut to produce a first projected modified set of input values when the first modified set of input values produced in step b is outside the color gamut; d) comparing the first modified set of input values from step b or the first projected modified set of input values from step c to a set of primary values corresponding to the primaries of the palette, selecting the set of primary values corresponding to the primary with the smallest error, thereby defining a first best primary value set, and outputting the first best primary value set as the color of the first pixel; e) replacing the first best primary value set in the palette with the first modified set of input values from step b or the first projected modified set of input values from step c to produce a modified palette; f) calculating a difference between the first modified set of input values from step b or the first projected modified set of input values from step c and the first best primary value set from step e to derive a first error value; g) adding to the second set of input values the first error value to create a second modified set of input values; h) projecting the second modified set of input value on to the color gamut to produce a second projected modified set of input values when the second modified set of input values produced in step g is outside the color gamut; i) comparing the second modified set of input values from step g or the second projected modified set of input values from step h to the set of primary values corresponding to the primaries of the modified palette, selecting the set of primary values corresponding to the primary from the modified palette with the smallest error, thereby defining a second best primary value set, and outputting the second best primary value set as the color of the second pixel. In some embodiments, the processor additionally j) replaces the second best primary value set in the modified palette with the second modified set of input values from step g or the second projected modified set of input values from step h to produce a second modified palette. The processor is configured to hand off the best primary values for the respective pixels to a controller of the electro-optic display, whereby those colors are shown at the respective pixels of the electro-optic display.
In another aspect, this invention provides a method of rendering color images on an output device having a color gamut derived from a palette of primary colors, the method comprising:
The method of the present invention may further comprise displaying at least a portion of the primary outputs as an image on a display device having the color gamut used in the method.
In one form of the present method, the projection in step c is effected along lines of constant brightness and hue in a linear RGB color space on to a nominal gamut. The comparison (“quantization”) in step e may be effected using a minimum Euclidean distance quantizer in a linear RGB space. Alternatively, the comparison may be effected by barycentric thresholding (choosing the primary associated with the largest barycentric coordinate) as described in the aforementioned application Ser. No. 15/592,515. If, however, barycentric thresholding is employed, the color gamut used in step c of the method should be that of the modified palette used in step e of the method lest the barycentric thresholding give unpredictable and unstable results.
In one form of the present method, the input values are processed in an order corresponding to a raster scan of the pixels, and in step d the modification of the palette allows for the output values corresponding to the pixel in the previously-processed row which shares an edge with the pixel corresponding to the input value being processed, and the previously-processed pixel in the same row which shares an edge with the pixel corresponding to the input value being processed.
The variant of the present method using barycentric quantization may be summarized as follows:
This variant of the present method, however, has the disadvantages of requiring both the Delaunay triangulation and the convex hull of the color space to be calculated, and these calculations make extensive computational demands, to the extent that, in the present state of technology, the variant is in practice impossible to use on a stand-alone processor. Furthermore, image quality is compromised by using barycentric quantization inside the color gamut hull. Accordingly, there is a need for a further variant of the present method which is computationally more efficient and exhibits improved image quality by choice of both the projection method used for colors outside the gamut hull and the quantization method used for colors within the gamut hull.
Using the same format as above, this further variant of the method of the present invention (which may hereinafter be referred to as the “triangle barycentric” or “TB” method may be summarized as follows:
In other words, the triangle barycentric variant of the present method effects step c of the method by computing the intersection of the projection with the surface of the gamut, and then effects step e in two different ways depending upon whether the EMIC (the product of step b) is inside or outside the color gamut. If the EMIC is outside the gamut, the triangle which encloses the aforementioned intersection is determined, the barycentric weights for each vertex of this triangle is determined, and the output from step e is the triangle vertex having largest barycentric weight. If, however, the EMIC is within the gamut, the output from step e is the nearest primary calculated by Euclidean distance.
As may be seen from the foregoing summary, the TB method differs from the variants of the present method previously discussed by using differing dithering methods depending upon whether the EMIC is inside or outside the gamut. If the EMIC is inside the gamut, a nearest neighbor method is used to find the dithered color; this improves image quality because the dithered color can be chosen from any primary, not simply from the four primaries which make up the enclosing tetrahedron, as in previous barycentric quantizing methods. (Note that, because the primaries are often distributed in a highly irregular manner, the nearest neighbor may well be a primary which is not a vertex of the enclosing tetrahedron.)
If, on the other hand, the EMIC is outside the gamut, projection is effected back along some line until the line intersects the convex hull of the color gamut. Since only the intersection with the convex hull is considered, and not the Delaunay triangulation of the color space, it is only necessary to compute the intersection of the projection line with the triangles that comprise the convex hull. This substantially reduces the computational burden of the method and ensures that colors on the gamut boundary are now represented by at most three dithered colors.
The TB method is preferably conducted in an opponent-type color space so that the projection on to the color gamut is guaranteed to preserve the EMIC hue angle; this represents an improvement over the '291 method. Also, for best results the calculation of the Euclidian distance (to identify the nearest neighbor for EMIC lying within the color gamut) should be calculated using a perceptually-relevant color space. Although use of a (non-linear) Munsell color space might appear desirable, the required transformations of the linear blooming model, pixel values and nominal primaries adds unnecessary complexity. Instead, excellent results can be obtained by performing a linear transformation to an opponent-type space in which lightness L and the two chromatic components (O1, O2) are independent. The linear transformation from linear RGB space is given by:
In this embodiment, the line along which project is effected in Step 2(a) can be defined as a line which connects the input color u and Vy, where:
Vy=w+α(w−b) (2)
and w, b are the respective white point and black point in opponent space. The scalar α is found from
where the subscript L refers to the lightness component. In other words, the projection line used is that which connects the EMIC to a point on the achromatic axis which has the same lightness. If the color space is properly chosen, this projection preserves the hue angle of the original color; the opponent color space fulfils this requirement.
It has, however, been found empirically that even the presently preferred embodiment of the TB method (described below with reference to Equations (4) to (18)) still leaves some image artifacts. These artifacts, which are typically referred to as “worms”, have horizontal or vertical structures that are introduced by the error-accumulation process inherent in error diffusion schemes such as the TB method. Although these artifacts can be removed by adding a small amount of noise to the process which chooses the primary output color (so-called “threshold modulation”), this can result in an unacceptably grainy image.
As described above, the TB method uses a dithering algorithm which differs depending upon whether or not an EMIC lies inside or outside the gamut convex hull. The majority of the remaining artifacts arise from the barycentric quantization for EMIC outside the convex hull, because the chosen dithering color can only be one of the three associated with the vertices of the triangle enclosing the projected color; the variance of the resulting dithering pattern is accordingly much larger than for EMIC within the convex hull, where the dithered color can be chosen from any one of the primaries, which are normally substantially greater than three in number.
Accordingly, the present invention provides a further variant of the TB method to reduce or eliminate the remaining dithering artifacts. This is effected by modulating the choice of dithering color for EMIC outside the convex hull using a blue-noise mask that is specially designed to have perceptually pleasing noise properties. This further variant may hereinafter for convenience be referred to as the “blue noise triangle barycentric” or “BNTB” variant of the method of the present invention.
Thus, the present invention also provides a method of the invention wherein step c is effected by computing the intersection of the projection with the surface of the gamut and step e is effected by (i) if the output of step b is outside the gamut, the triangle which encloses the aforementioned intersection is determined, the barycentric weights for each vertex of this triangle are determined, and the barycentric weights thus calculated are compared with the value of a blue-noise mask at the pixel location, the output from step e being the color of the triangle vertex at which the cumulative sum of the barycentric weights exceeds the mask value; or (ii) if the output of step b is within the gamut, the output from step e is the nearest primary calculated by Euclidean distance.
In essence, the BNTB variant applies threshold modulation to the choice of dithering colors for EMIC outside the convex hull, while leaving the choice of dithering colors for EMIC inside the convex hull unchanged. Threshold modulation techniques other than the use of a blue noise mask may be useful. Accordingly, the following description will concentrate on the changes in the treatment of EMIC outside the convex hull leaving the reader to refer to the preceding discussion for details of the other steps in the method. It has been found that the introduction of threshold modulation by means of a blue-noise mask removes the image artifacts visible in the TB method, resulting in excellent image quality.
The blue-noise mask used in the present method may be of the type described in Mitsa, T., and Parker, K. J., “Digital halftoning technique using a blue-noise mask,” J. Opt. Soc. Am. A, 9(11), 1920 (November 1992), and especially
While the BNTB method significantly reduces the dithering artifacts experienced with the TB, it has been found empirically that some of the dither patterns are still rather grainy and certain colors, such as those found in skin tones, are distorted by the dithering process. This is a direct result of using a barycentric technique for the EMIC lying outside the gamut boundary. Since the barycentric method only allows a choice of at most three primaries, the dither pattern variance is high, and this shows up as visible artifacts; furthermore, because the choice of primaries is inherently restricted, some colors become artificially saturated. This has the effect of spoiling the hue-preserving property of the projection operator defined by Equations (2) and (3) above.
Accordingly, a further variant of the method of the present invention further modifies the TB method to reduce or eliminate the remaining dithering artifacts. This is effected by abandoning the use of barycentric quantization altogether and quantizing the projected color used for EMIC outside the convex hull by a nearest neighbor approach using gamut boundary colors only. This variant of the present method may hereinafter for convenience be referred to as the “nearest neighbor gamut boundary color” or “NNGBC” variant.
Thus, in the NNGBC variant, step c of the method of the invention is effected by computing the intersection of the projection with the surface of the gamut and step e is effected by (i) if the output of step b is outside the gamut, the triangle which encloses the aforementioned intersection is determined, the primary colors which lie on the convex hull are determined, and the output from step e is the closest primary color lying on the convex hull calculated by Euclidian distance; or (ii) if the output of step b is within the gamut, the output from step e is the nearest primary calculated by Euclidean distance.
In essence, the NNGBC variant applies “nearest neighbor” quantization to both colors within the gamut and the projections of colors outside the gamut, except that in the former case all the primaries are available, whereas in the latter case only the primaries on the convex hull are available.
It has been found that the error diffusion used in the rendering method of the present invention can be used to reduce or eliminate defective pixels in a display, for example pixels which refuse to change color even when the appropriate waveform is repeatedly applied. Essentially, this is effected by detecting the defective pixels and then over-riding the normal primary color output selection and setting the output for each defective pixel to the output color which the defective pixel actually exhibits. The error diffusion feature of the present rendering method, which normally operates upon the difference between the selected output primary color and the color of the image at the relevant pixel, will in the case of the defective pixels operate upon the difference between the actual color of the defective pixel and the color of the image at the relevant pixel, and disseminates this difference to adjacent pixels in the usual way. It has been found that this defect-hiding technique greatly reduces the visual impact of defective pixels.
Accordingly, the present invention also provides a variant (hereinafter for convenience referred to as the “defective pixel hiding” or “DPH” variant) of the rendering methods already described, which further comprises:
It will be apparent that the method of the present invention relies upon an accurate knowledge of the color gamut of the device for which the image is being rendered. As discussed in more detail below, an error diffusion algorithm may lead to colors in the input image that cannot be realized. Methods, such as some variants of the TB, BNTB and NNGBC methods of the present invention, which deal with out-of-gamut input colors by projecting the error-modified input values back on to the nominal gamut to bound the growth of the error value, may work well for small differences between the nominal and realizable gamut. However, for large differences, visually disturbing patterns and color shifts can occur in the output of the dithering algorithm. There is, thus, a need for a better, non-convex estimate of the achievable gamut when performing gamut mapping of the source image, so that the error diffusion algorithm can always achieve its target color.
Thus, a further aspect of the present invention (which may hereinafter for convenience be referred to as the “gamut delineation” or “GD” method of the invention) provides an estimate of the achievable gamut.
The GD method for estimating an achievable gamut may include five steps, namely: (1) measuring test patterns to derive information about cross-talk among adjacent primaries; (2) converting the measurements from step (1) to a blooming model that predicts the displayed color of arbitrary patterns of primaries; (3) using the blooming model derived in step (2) to predict actual display colors of patterns that would normally be used to produce colors on the convex hull of the primaries (i.e. the nominal gamut surface); (4) describing the realizable gamut surface using the predictions made in step (3); and (5) using the realizable gamut surface model derived in step (4) in the gamut mapping stage of a color rendering process which maps input (source) colors to device colors.
The color rendering process of step (5) of the GD process may be any color rendering process of the present invention.
It will be appreciated that the color rendering methods previously described may form only part (typically the final part) of an overall rendering process for rendering color images on a color display, especially a color electrophoretic display. In particular, the method of the present invention may be preceded by, in this order, (i) a degamma operation; (ii) HDR-type processing; (iii) hue correction; and (iv) gamut mapping. The same sequence of operations may be used with dithering methods other than those of the present invention. This overall rendering process may hereinafter for convenience be referred to as the “degamma/HDR/hue/gamut mapping” or “DHHG” method of the present invention.
A further aspect of the present invention provides a solution to the aforementioned problems caused by excessive computational demands on the electrophoretic device by moving many of the rendering calculations off the device itself. Using a system in accordance with this aspect of the invention, it is possible to provide high-quality images on electronic paper while only requiring the resources for communication, minimal image caching, and display driver functionality on the device itself. Thus, the invention greatly reduces the cost and bulk of the display. Furthermore, the prevalence of cloud computing and wireless networking allow systems of the invention to be deployed widely with minimal upgrades in utilities or other infrastructure.
Accordingly, in a further aspect this invention provides an image rendering system including an electro-optic display comprising an environmental condition sensor; and a remote processor connected to the electro-optic display via a network, the remote processor being configured to receive image data, and to receive environmental condition data from the sensor via the network, render the image data for display on the electro-optic display under the received environmental condition data, thereby creating rendered image data, and to transmit the rendered image data to the electro-optic display via the network.
This aspect of the present invention (including the additional image rendering system and docking station discussed below) may hereinafter for convenience be referred to as the “remote image rendering system” or “RIRS”. The electro-optic display may comprises a layer of electrophoretic display material comprising electrically charged particles disposed in a fluid and capable of moving through the fluid on application of an electric field to the fluid, the electrophoretic display material being disposed between first and second electrodes, at least one of the electrodes being light-transmissive. The electrophoretic display material may comprise four types of charged particles having differing colors.
This invention further provides an image rendering system including an electro-optic display, a local host, and a remote processor, all connected via a network, the local host comprising an environmental condition sensor, and being configured to provide environmental condition data to the remote processor via the network, and the remote processor being configured to receive image data, receive the environmental condition data from the local host via the network, render the image data for display on the electronic paper display under the received environmental condition data, thereby creating rendered image data, and to transmit the rendered image data. The environmental condition data may include temperature, humidity, luminosity of the light incident on the display, and the color spectrum of the light incident on the display.
In any of the above image rendering systems, the electro-optic display may comprise a layer of electrophoretic display material comprising electrically charged particles disposed in a fluid and capable of moving through the fluid on application of an electric field to the fluid, the electrophoretic display material being disposed between first and second electrodes, at least one of the electrodes being light-transmissive. Additionally, in the systems above, a local host may transmit image data to a remote processor.
This invention also provides a docking station comprising an interface for coupling with an electro-optic display, the docking station being configured to receive rendered image data via a network and to update on an image on an electro-optic display coupled to the docking station. This docking station may further comprise a power supply arranged to provide a plurality of voltages to an electro-optic display coupled to the docking station.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
As already mentioned,
A preferred embodiment of the method of the invention is illustrated in
As noted in the aforementioned Pappas paper, one well-known issue in model-based error diffusion is that the process can become unstable, because the input image is assumed to lie in the (theoretical) convex hull of the primaries (i.e. the color gamut), but the actual realizable gamut is likely smaller due to loss of gamut because of dot overlap. Therefore, the error diffusion algorithm may be trying to achieve colors which cannot actually be achieved in practice and the error continues to grow with each successive “correction”. It has been suggested that this problem be contained by clipping or otherwise limiting the error, but this leads to other errors.
The present method suffers from the same problem. The ideal solution would be to have a better, non-convex estimate of the achievable gamut when performing gamut mapping of the source image, so that the error diffusion algorithm can always achieve its target color. It may be possible to approximate this from the model itself, or determine it empirically. However neither of the correction methods is perfect, and hence a gamut projection block (gamut projector 206) is included in preferred embodiments of the present method. This gamut projector 206 is similar to that proposed in the aforementioned application Ser. No. 15/592,515, but serves a different purpose; in the present method, the gamut projector is used to keep the error bounded, but in a more natural way than truncating the error, as in the prior art. Instead, the error modified image is continually clipped to the nominal gamut boundary.
The gamut projector 206 is provided to deal with the possibility that, even though the input values xi,j are within the color gamut of the system, the modified inputs ui,j may not be, i.e., that the error correction introduced by the error filter 106 may take the modified inputs ui,j outside the color gamut of the system. In such a case, the quantization effected later in the method may produce unstable results since it is not be possible generate a proper error signal for a color value which lies outside the color gamut of the system. Although other ways of this problem can be envisioned, the only one which has been found to give stable results is to project the modified value ui,j on to the color gamut of the system before further processing. This projection can be done in numerous ways; for example, projection may be effected towards the neutral axis along constant lightness and hue, thus preserving chrominance and hue at the expense of saturation; in the L*a*b* color space this corresponds to moving radially inwardly towards the L* axis parallel to the a*b* plane, but in other color spaces will be less straightforward. In the presently preferred form of the present method, the projection is along lines of constant brightness and hue in a linear RGB color space on to the nominal gamut. (But see below regarding the need to modify this gamut in certain cases, such as use of barycentric thresholding.) Better and more rigorous projection methods are possible. Note that although it might at first appear that the error value ei,j (calculated as described below) should be calculated using the original modified input ui,j rather than the projected input (designated u′i,j in
The modified input values are fed to a quantizer 208, which also receives a set of primaries; the quantizer 208 examines the primaries for the effect that choosing each would have on the error, and the quantizer chooses the primary with the least (by some metric) error if chosen. However, in the present method, the primaries fed to the quantizer 208 are not the natural primaries of the system, {Pk}, but are an adjusted set of primaries, {P˜k}, which allow for the colors of at least some neighboring pixels, and their effect on the pixel being quantized by virtue of blooming or other inter-pixel interactions.
The currently preferred embodiment of the method of the invention uses a standard Floyd-Steinberg error filter and processes pixels in raster order. Assuming, as is conventional, that the display is treated top-to-bottom and left-to-right, it is logical to use the above and left cardinal neighbors of pixel being considered to compute blooming or other inter-pixel effects, since these two neighboring pixels have already been determined. In this way, all modeled errors caused by adjacent pixels are accounted for since the right and below neighbor crosstalk is accounted for when those neighbors are visited. If the model only considers the above and left neighbors, the adjusted set of primaries must be a function of the states of those neighbors and the primary under consideration. The simplest approach is to assume that the blooming model is additive, i.e. that the color shift due to the left neighbor and the color shift due to the above neighbor are independent and additive. In this case, there are only “N choose 2” (equal to N*(N−1)/2) model parameters (color shifts) that need to be determined. For N=64 or less, these can be estimated from colorimetric measurements of checkerboard patterns of all these possible primary pairs by subtracting the ideal mixing law value from the measurement.
To take a specific example, consider the case of a display having 32 primaries. If only the above and left neighbors are considered, for 32 primaries there are 496 possible adjacent sets of primaries for a given pixel. Since the model is linear, only these 496 color shifts need to be stored since the additive effect of both neighbors can be produced during run time without much overhead. So for example if the unadjusted primary set comprises (P1 . . . P32) and your current up, left neighbors are P4 and P7, the modified primaries (P˜1 . . . P˜32), the adjusted primaries fed to the quantizer are given by:
P˜1=P1+dP(1,4)+dP(1,7);
P˜32=P32+dP(32,4)+dP(32,7),
where dP(ij) are the empirically determined values in the color shift table.
More complicated inter-pixel interaction models are of course possible, for example nonlinear models, models taking account of corner (diagonal) neighbor, or models using a non-causal neighborhood for which the color shift at each pixel is updated as more of its neighbors are known.
The quantizer 208 compares the adjusted inputs u′i,j with the adjusted primaries {P˜k} and outputs the most appropriate primary yi,k to an output. Any appropriate method of selecting the appropriate primary may be used, for example a minimum Euclidean distance quantizer in a linear RGB space; this has the advantage of requiring less computing power than some alternative methods. Alternatively, the quantizer 208 may effect barycentric thresholding (choosing the primary associated with the largest barycentric coordinate), as described in the aforementioned application Ser. No. 15/592,515. It should be noted, however, that if barycentric thresholding is employed, the adjusted primaries {P˜k} must be supplied not only to the quantizer 208 but also to the gamut projector 206 (as indicated by the broken line in
The yi,k output values from the quantizer 208 are fed not only to the output but also to a neighborhood buffer 210, where they are stored for use in generating adjusted primaries for later-processed pixels. The modified input u′i,j values and the output yi,j values are both supplied to a processor 212, which calculates:
ei,j=u′i,j−yi,j
and passes this error signal on to the error filter 106 in the same way as described above with reference to
TB Method
As indicated above, the TB variant of the present method may be summarized as follows:
A preferred method for implementing this three-step algorithm in a computationally-efficient, hardware-friendly will now be described, though by way of illustration only since numerous variations of the specific method described will readily be apparent to those skilled in the digital imaging art.
As already noted, Step 1 of the algorithm is to determine whether the EMIC (hereinafter denoted u), is inside or outside the convex hull of the color gamut. For this purpose, consider a set of adjusted primaries PPk, which correspond to the set of nominal primaries P modified by a blooming model; as discussed above with reference to
·(u−vk1)<0,∀k (4)
where “·” represents the (vector) dot product and wherein normal vectors “” are defined as pointing inwardly. Crucially, the vertices vk and normal vectors can be precomputed and stored ahead of time. Furthermore, Equation (4) can readily be computer calculated in a simple manner by
where “º” is the Hadamard (element-by-element) product.
If u is found to be outside the convex hull, it is necessary to define the projection operator which projects u back on to the gamut surface. The preferred projection operator has already been defined by Equations (2) and (3) above. As previously noted, this projection line is that which connects u and a point on the achromatic axis which has the same lightness. The direction of this line is
d=u−Vy (6)
so that the equation of the projection line can be written as
u=Vy+(1−t)d (7)
where 0≤t≤1. Now, consider the kth triangle in the convex hull and express the location of some point xk within that triangle in terms of its edges ek1 and ek2
xk=vk1+ek1pk+ek2qk (8)
where ek1=vk1−vk2 and ek1=vk1−vk3 and pk, qk are barycentric coordinates. Thus, the representation of xk in barycentric coordinates (pk, qk) is
xk=vk1(1−pk−qk)+vk2pk+vk3qk (9)
From the definitions of barycentric coordinates and the line length t, the line intercepts the kth triangle in the convex hull if and only if:
0≤tk≤1
pk≥0
qk≥0
pk+qk≤1 (10)
If a parameter L is defined as:
then the distance tk is simply given by
Thus, the parameter used in Equation (4) above to determine whether the EMIC is inside or outside the convex hull can also be used to determine the distance from the color to the triangle which is intercepted by the projection line.
The barycentric coordinates are only slightly more difficult to compute. From simple geometry:
where
pk′=(u−vk1)×ek2
qk′=(u−vk1)×ek1 (14)
and “x” is the (vector) cross product.
In summary, the computations necessary to implement the preferred form of the three-step algorithm previously described are:
If the opponent-like color space defined by Equation (1) is adopted, u consists of one luminance component and two chrominance components, u=[uL, uO1, uO2], and under the projection operation of Equation (16), d=[0, uO1, uO2], since the projection is effected directly towards the achromatic axis.
tk=(u−vk1)=[tk1,tk2,tk3],
ek1=[ek11,ek12,ek13]
ek2=[ek21,ek22,ek23]
ek3=[ek31,ek32,ek33] (17)
By expanding the cross product and dropping terms that evaluate to zero, it is found that
pk′=[tk3ºek21−tk1ºek23,tk1ºek22−tk2ºek21]
qk′=[tk3ºek11−tk1ºek13,tk1ºek12−tk2ºek11] (18)
Equation (18) is trivial to compute in hardware, since it only requires multiplications and subtractions.
Accordingly, an efficient, hardware-friendly dithering TB method of the present invention can be summarized as follows:
From the foregoing, it will be seen that the TB variant of the present method imposes much lower computations requirements than the variants previously discussed, thus allowing the necessary dithering to be deployed in relatively modest hardware.
However, further computational efficiencies are possible as follows:
The condition for a point u to be outside the convex hull has already been given in Equation (4) above. As already noted, the vertices vk and normal vectors can be precomputed and stored ahead of time. Equation (5) above can alternatively be written:
t′k=·(u−vk) (5A)
and hence we know that only triangles k for which t′k<0 correspond to a u which is out of gamut. If all tk>0, then u is in gamut.
The distance from a point u to the point where it intersects a triangle k is given by tk, where tk is given by Equation (12) above, with L being defined by Equation (11) above. Also, as discussed above, if u is outside the convex hull, it is necessary to define the projection operator which moves the point u back to the gamut surface The line along which we project in step 2(a) can be defined as a line which connects the input color u and Vy, where
Vy=w+α(w−b) (50)
and w, b are the respective white point and black point in opponent space. The scalar α is found from
where the subscript L refers to the lightness component. In other words, the line is defined as that which connects the input color and a point on the achromatic axis which has the same lightness. The direction of this line is given by Equation (6) above and the equation of the line can be written by Equation (7) above. The expression of a point within a triangle on the convex hull, the barycentric coordinates of such a point and the conditions for the projection line to intercept a particular triangle have already been discussed with reference to Equations (9)-(14) above.
For reasons already discussed, it is desirable to avoid working with Equation (13) above since this requires a division operation. Also as already mentioned, u is out if gamut if any one of the k triangles has t′k<0, and, further, that since t′k<0 for triangles where u might be out of gamut, then Lk must be always less than zero to allow 0<t′k<1 as required by condition (10). Where this condition holds, there is one, and only one, triangle for which the barycentric conditions hold. Therefore fork such that t′k<0 we must have
0>p′k≥Lk,0>qk′≥Lk0>p′k+qk′≥Lk (52)
and
pk=−d·pk′
qk=d·qk′ (53)
which significantly reduces the decision logic compared to previous methods because the number of candidate triangles for which t′k<0 is small.
In summary, then, an optimized method finds the k triangles where t′k<0 using Equation (5A), and only these triangles need to be tested further for intersection by Equation (52). For the triangle where Equation (52) holds, we test we calculate the new projected color u′ by Equation (15) where
which is a simple scalar division. Further, only the largest barycentric weight, max(αu) is of interest, from Equation (16):
max(αu)=min([Lj−d·p′j−d·p′j,d·p′j,d·q′j]) (55)
and use this to select the vertex of the triangle j corresponding to the color to be output.
If all t′k>0, then u is in-gamut, and above it was proposed o use a “nearest-neighbor” method to compute the primary output color. However, if the display has N primaries, the nearest neighbor method requires N computations of a Euclidean distance, which becomes a computational bottleneck.
This bottleneck can be alleviated, if not eliminated by precompute a binary space partition for each of the blooming-modified primary spaces PP, then using a binary tree structure to determine the nearest primary to u in PP. Although this requires some upfront effort and data storage, it reduces the nearest-neighbor computation time from O(N) to O(log N).
Thus, a highly efficient, hardware-friendly dithering method can be summarized (using the same nomenclature as previously) as:
BNTB Method
As already mentioned, the BNTB method differs from the TB described above by applies threshold modulation to the choice of dithering colors for EMIC outside the convex hull, while leaving the choice of dithering colors for EMIC inside the convex hull unchanged.
A preferred form of the BNTB method a modification of the four-step preferred TB method described above; in the BNTB modification, Step 3c is replaced by Steps 3c and 3d as follows:
As is well known to those skilled in the imaging art, threshold modulation is simply a method of varying the choice of dithering color by applying a spatially-varying randomization to the color selection method. To reduce or prevent grain in the processed image, it is desirable to apply noise with preferentially shaped spectral characteristics, as for example in the blue-noise dither mask Tmn shown in
m=mod(x−1,M)+1
n=mod(y−1,M)+1 (19)
so that the dither mask is effectively tiled across the image.
The threshold modulation exploits the fact that barycentric coordinates and probability density functions, such as a blue-noise function, both sum to unity. Accordingly, threshold modulation using a blue-noise mask may be effected by comparing the cumulative sum of the barycentric coordinates with the value of the blue-noise mask at a given pixel value to determine the triangle vertex and thus the dithered color.
As noted above, the barycentric weights corresponding to the triangle vertices are given by:
αu=[1−pj−qj,pj,qj] (16)
so that the cumulative sum, denoted “CDF”, of these barycentric weights is given by:
CDF=[1−pj−qj,1−qj,1] (20)
and the vertex v, and corresponding dithered color, for which the CDF first exceeds the mask value at the relevant pixel, is given by:
v={v;CDF(v)≥Tmn} (21)
It is desirable that the BNTB method of the present invention be capable of being implemented efficiently on standalone hardware such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), and for this purpose it is important to minimize the number of division operations required in the dithering calculations. For this purpose, Equation (16) above may be rewritten:
and Equation (20) may be rewritten:
or, to eliminate the division by Lj:
CDF′=[Lj−d·p′j−d·q′j,Lj−d·q′j,Lj] (24)
Equation (21) for selecting the vertex v, and the corresponding dithered color, at which the CDF first exceeds the mask value at the relevant pixel, becomes:
v={v;CDF′(v)≥TmnLj} (25)
Use of Equation (25) is only slightly complicated by the fact that both CDF′ and Lj are now signed numbers. To allow for this complication, and for the fact that Equation (25) only requires two comparisons (since the last element of the CDF is unity, if the first two comparisons fail, the third vertex of the triangle must be chosen), Equation (25) can be implemented in a hardware-friendly manner using the following pseudo-code:
The improvement in image quality which can be effected using the method of the present invention may readily be seen by comparison of
From the foregoing, it will be seen that the BNTB provides a dithering method for color displays which provides better dithered image quality than the TB method and which can readily be effected on an FPGA, ASIC or other fixed-point hardware platform.
NNGBC Method
As already noted, the NNGBC method quantizes the projected color used for EMIC outside the convex hull by a nearest neighbor approach using gamut boundary colors only, while quantizing EMIC inside the convex hull by a nearest neighbor approach using all the available primaries.
A preferred form of the NNGBC method can be described as a modification of the four-step TB method set out above. Step 1 is modified as follows:
The preferred form of the method of the present invention follows very closely the preferred four-step TB method described above, except that the barycentric weights do not need to be calculated using Equation (16). Instead, the dithered color v is chosen as the boundary color in the set Pb that minimizes the Euclidean norm with u′, that is:
v=arg minv{∥u′−Pb(v)∥} (26)
Since the number of boundary colors M is usually much smaller than the total number of primaries N, the calculations required by Equation (26) are relatively fast.
As with the TB and BNTB methods of the present invention, it is desirable that the NNGBC method be capable of being implemented efficiently on standalone hardware such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), and for this purpose it is important to minimize the number of division operations required in the dithering calculations. For this purpose, Equation (16) above may be rewritten in the form of Equation (22) as already described, and Equation (26)
may treated in a similar manner.
The improvement in image quality which can be effected using the method of the present invention may readily be seen by comparison of accompanying
From the foregoing, it will be seen that the NNGBC method provides a dithering method for color displays which in general provides better dithered image quality that the TB method and can readily be effected on an FPGA, ASIC or other fixed-point hardware platform.
DPH Method
As already mentioned, the present invention provides a defective pixel hiding or DPH of the rendering methods already described, which further comprises:
Since spatial dithering methods such as those of the present invention seek to deliver the impression of an average color given a set of discrete primaries, deviations of a pixel from its expected color can be compensated by appropriate modification of its neighbors. Taking this argument to its logical conclusion, it is clear that defective pixels (such as pixels stuck in a particular color) can also be compensated by the dithering method in a very straightforward manner. Hence, rather than set the output color associated with the pixel to the color determined by the dithering method, the output color is set to the actual color of the defective pixel so that the dithering method automatically account for the defect at that pixel by propagating the resultant error to the neighboring pixels. This variant of the dithering method can be coupled with an optical measurement to comprise a complete defective pixel measurement and repair process, which may be summarized as follows.
First, optically inspect the display for defects; this may be as simple as taking a high-resolution photograph with some registration marks, and from the optical measurement, determine the location and color of the defective pixels. Pixels stuck in white or black colors may be located simply by inspecting the display when set to solid black and white respectively. More generally, however, one could measure each pixel when the display is set to solid white and solid black and determine the difference for each pixel. Any pixel for which this difference is below some predetermined threshold can be regarded as “stuck” and defective. To locate pixels in which one pixel is “locked” to the state of one of its neighbors, set the display to a pattern of one-pixel wide lines of black and white (using two separate images with the lines running along the row and columns respectively) and look for error in the line pattern.
Next, build a lookup table of the defective pixels and their colors, and transfer this LUT to the dithering engine; for present purposes, it makes no difference whether the dithering method is performed in software or hardware. The dithering engine performs gamut mapping and dithering in the standard way, except that output colors corresponding to the locations of the defective pixels are forced to their defective colors. The dithering algorithm then automatically, and by definition, compensates for their presence.
GD Method
As already mentioned, the present invention provides a gamut delineation method for estimating an achievable gamut comprising five steps, namely: (1) measuring test patterns to derive information about cross-talk among adjacent primaries; (2) converting the measurements from step (1) to a blooming model that predicts the displayed color of arbitrary patterns of primaries; (3) using the blooming model derived in step (2) to predict actual display colors of patterns that would normally be used to produce colors on the convex hull of the primaries (i.e. the nominal gamut surface); (4) describing the realizable gamut surface using the predictions made in step (3); (5) using the realizable gamut surface model derived in step (4) in the gamut mapping stage of a color rendering process which maps input (source) colors to device colors.
Steps (1) and (2) of this method may follow the process described above in connection with the basic color rendering method of the present invention. Specifically, for N primaries, “N choose 2” number of checkerboard patterns are displayed and measured. The difference between the nominal value expected from ideal color mixing laws and the actual measured value is ascribed to the edge interactions. This error is considered to be a linear function of edge density. By this means, the color of any pixel patch of primaries can be predicted by integrating these effects over all edges in the pattern.
Step (3) of the method considers dither patterns one may expect on the gamut surface and computes the actual color predicted by the model. Generally speaking, a gamut surface is composed of triangular facets where the vertices are colors of the primaries in a linear color space. If there were no blooming, these colors in each of these triangles could then be reproduced by an appropriate fraction of the three associated vertex primaries. However, there are many patterns that can be made that have such a correct fraction of primaries, but which pattern is used is critical for the blooming model since primary adjacency types need to be enumerated. To understand this, consider these two extreme cases of using 50% of P1 and 50% of P2. At one extreme a checkerboard pattern of P1 and P2 can be used, in which case the P1|P2 edge density is maximal leading to the most possible deviation from ideal mixing. At another extreme is two very large patches, one of P1 and one of P2, which has a P1|P2 adjacency density that tends towards zero with increasing patch size. This second case will reproduce the nearly correct color even in the presence of blooming but will be visually unacceptable because of the coarseness of the pattern. If the half-toning algorithm used in capable of clustering pixels having the same color, it might be reasonable to choose some compromise between these extremes as the realizable color. However, in practice when using error diffusion this type of clustering leads to bad wormy artifacts, and furthermore the resolution of most limited palette displays, especially color electrophoretic displays, is such that clustering becomes obvious and distracting. Accordingly, it is generally desirable to use the most dispersed pattern possible even if that means eliminating some colors that could be obtained via clustering. Improvements in displays technology and half-toning algorithms may eventually render less conservative pattern models useful.
In one embodiment, let P1, P2, P3 be the colors of three primaries that define a triangular facet on the surface of the gamut. Any color on this facet can be represented field by the linear combination
∝1P1+∝2P2+∝3P3
Now let Δ1,2, Δ1,3, Δ2,3 be the model for the color deviation due to blooming if all primary adjacencies in the pattern are of the numbered type, i.e. a checkerboard pattern of P1, P2 pixels is predicted to have the color
C=½P1+½P2+Δ1,2
Without loss of generality, assume
∝1≥∝2≥∝3
which defines a sub-triangle on the facet with corners
(1,0,0),(½,½,0),(⅓,⅓,⅓)
For maximally dispersed pixel populations of the primaries we can evaluate the predicted color at each of those corners to be
P1
½P1+½P2+Δ1,2
⅓(P1+P2+P3+Δ12+Δ13+Δ2,3)
By assuming our patterns can be designed to alter the edge density linearly between these corners, we now have a model for a sub-facet of the gamut boundary. Since there are 6 ways of ordering ∝1, ∝2, ∝3, there are six such sub-facets that replace each facet of the nominal gamut boundary description.
It should appreciated that other approaches may be adopted. For example, a random primary placement model could be used, which is less dispersed that the one mentioned above. In this case the fraction of edges of each type is proportional to their probabilities, i.e. the fraction of P1|P2 edges is given by the product ∝1∝2. Since this is nonlinear in the ∝i, the new surface representing the gamut boundary would need to be triangulated or passed to subsequent steps as a parameterization.
Another approach, which does not follow the paradigm just delineated, is an empirical approach—to actually use the blooming compensated dithering algorithm (using the model from steps 1,2) to determine which colors should be excluded from the gamut model. This can be accomplished by turning off the stabilization in the dithering algorithm and then trying to dither a constant patch of a single color. If an instability criterion is met (i.e. run-away error terms), then this color is excluded from the gamut. By starting with the nominal gamut, a divide and conquer approach could be used to determine the realizable gamut.
In step (4) of the GD method, each of these sub-facets is represented as a triangle, with the vertices ordered such that the right-hand rule will point the normal vector according to a chosen convention for inside/outside facing. The collection of all these triangles forms a new continuous surface representing the realizable gamut.
In some cases, the model will predict that new colors not in the nominal gamut can be realized by exploiting blooming; however, most effects are negative in the sense of reducing the realizable gamut. For example, the blooming model gamut may exhibit deep concavities, meaning that some colors deep inside the nominal gamut cannot in fact be reproduced on the display, as illustrated for example in
This may lead to some quandaries for gamut mapping, as described below. Also, the gamut model produced can be self-intersecting and thus not have simple topological properties. Since the method described above only operates on the gamut boundary, it does not allow for cases where colors inside the nominal gamut (for example an embedded primary) appear outside the modeled gamut boundary, when in fact they are realizable. To solve this problem, it may be necessary to consider all tetrahedra in the gamut and how their sub-tetrahedra are mapped under the blooming model.
In step (5) the realizable gamut surface model generated in step (4) is used in the gamut mapping stage of a color image rendering process, one may follow a standard gamut mapping procedure that is modified in one or more steps to account for the non-convex nature of the gamut boundary.
The GD method is desirably carried out in a three-dimensional color space in which hue (h*), lightness (L*) and chroma (C*) are independent. Since this is not the case for the L*a*b* color space, the (L*, a*, b*) samples derived from the gamut model should be transformed to a hue-linearized color space such as the CIECAM or Munsell space. However, the following discussion will maintain the (L*, a*, b*) nomenclature with
C*=√{square root over (a*2+b*2)} and
h*=a tan(b*/a*).
A gamut delineated as described above may then be used for gamut mapping. In an appropriate color space, source colors may be mapped to destination (device) colors by considering the gamut boundaries corresponding to a given hue angle h*. This can be achieved by computing the intersection of a plane at angle h* with the gamut model as shown in
In standard gamut mapping schemes, a source color is mapped to a point on or inside the destination gamut boundary. There are many possible strategies for achieving this mapping, such as projecting along the C* axis or projecting towards a constant point on the L* axis, and it is not necessary to discuss this matter in greater detail here. However, since the boundary of the destination gamut may now be highly irregular (see
This smoothing operation may begin by inflating the source gamut boundary. To do this, define a point R on the L* axis, which is taken to be the mean of the L* values of the source gamut. The Euclidean distance D between points on the gamut and R, the normal vector d, and the maximum value of D which we denote Dmax, may then be calculated. One can then calculate
where γ is a constant to control the degree of smoothing; the new C* and L* points corresponding to the inflated gamut boundary are then
C*′=D′d and
L*′=R+D′d.
If we now take the convex hull of the inflated gamut boundary, and then effect a reverse transformation to obtain C* and L*, a smoothed gamut boundary is produced. As illustrated in
The mapped color may now be calculated by:
a*=C*cos(h*) and
b*=C*cos(h*)
and the (L*, a*, b*) coordinates can if desired be transformed back to the sRGB system.
This gamut mapping process is repeated for all colors in the source gamut, so that one can obtain a one-to-one mapping for source to destination colors. Preferably, one may sample 9×9×9=729 evenly-spaced colors in the sRGB source gamut; this is simply a convenience for hardware implementation.
DHHG Method
A DHHG method according to one embodiment of the present invention is illustrated in
1. Degamma Operation
In a first step of the method, a degamma operation (1) is applied to remove the power-law encoding in the input data associated with the input image (6), so that all subsequent color processing operations apply to linear pixel values. The degamma operation is preferably accomplished by using a 256-element lookup table (LUT) containing 16-bit values, which is addressed by an 8-bit sRGB input which is typically in the sRGB color space. Alternatively, if the display processor hardware allows, the operation could be performed by using an analytical formula. For example, the analytic definition of the sRGB degamma operation is
where a=0.055, C corresponds to red, green or blue pixel values and C′ are the corresponding de-gamma pixel values.
2. HDR-Type Processing
For color electrophoretic displays having a dithered architecture, dither artifacts at low greyscale values are often visible. This may be exacerbated upon application of a degamma operation, because the input RGB pixel values are effectively raised to an exponent of greater than unity by the degamma step. This has the effect of shifting pixel values to lower values, where dither artifacts become more visible.
To reduce the impact of these artifacts, it is preferable to employ tone-correction methods that act, either locally or globally, to increase the pixel values in dark areas. Such methods are well known to those of skill in the art in high-dynamic range (HDR) processing architectures, in which images captured or rendered with a very wide dynamic range are subsequently rendered for display on a low dynamic range display. Matching the dynamic range of the content and display is achieved by tone mapping, and often results in brightening of dark parts of the scene in order to prevent loss of detail.
Thus, it is an aspect of the HDR-type processing step (2) to treat the source sRGB content as HDR with respect to the color electrophoretic display so that the chance of objectionable dither artifacts in dark areas is minimized. Further, the types of color enhancement performed by HDR algorithms may provide the added benefit of maximizing color appearance for a color electrophoretic display.
As noted above, HDR rendering algorithms are known to those skilled in the art. The HDR-type processing step (2) in the methods according to the various embodiments of the present invention preferably contains as its constituent parts local tone mapping, chromatic adaptation, and local color enhancement. One example of an HDR rendering algorithm that may be employed as an HDR-type processing step is a variant of iCAM06, which is described in Kuang, Jiangtao et al. “iCAM06: A refined image appearance model for HDR image rendering.” J. Vis. Commun. Image R. 18 (2007): 406-414, the entire contents of which are incorporated herein by reference.
It is typical for HDR-type algorithms to employ some information about the environment, such as scene luminance or viewer adaptation. As illustrated in
3. Hue Correction
Because HDR rendering algorithms may employ physical visual models, the algorithms can be prone to modifying the hue of the output image, such that it substantially differs from the hue of the original input image. This can be particularly noticeable in images containing memory colors. To prevent this effect, the methods according to the various embodiments of the present invention may include a hue correction stage (3) to ensure that the output of the HDR-type processing (2) has the same hue angle as the sRGB content of the input image (6). Hue correction algorithms are known to those of skill in the art. One example of a hue correction algorithm that may be employed in the hue correction stage (3) in the various embodiments of the present invention is described by Pouli, Tania et al. “Color Correction for Tone Reproduction” CIC21: Twenty-first Color and Imaging Conference, page 215-220-November 2013, the entire contents of which are incorporated herein by reference.
4. Gamut Mapping
Because the color gamut of a color electrophoretic display may be significantly smaller than the sRGB input of the input image (6), a gamut mapping stage (4) is included in the methods according the various embodiments of the present invention to map the input content into the color space of the display. The gamut mapping stage (4) may comprise a chromatic adaptation model (9) in which a number of nominal primaries (10) are assumed to constitute the gamut or a more complex model (11) involving adjacent pixel interaction (“blooming”).
In one embodiment of the present invention, a gamut-mapped image is preferably derived from the sRGB-gamut input by means of a three-dimensional lookup table (3D LUT), such as the process described in Henry Kang, “Computational color technology”, SPIE Press, 2006, the entire contents of which are incorporated herein by reference. Generally, the Gamut mapping stage (4) may be achieved by an offline transformation on discrete samples defined on source and destination gamuts, and the resulting transformed values are used to populate the 3D LUT. In one implementation, a 3D LUT which is 729 RGB elements long and uses a tetrahedral interpolation technique may be employed, such as the following example.
To obtain the transformed values for the 3D LUT, an evenly spaced set of sample points (R, G, B) in the source gamut is defined, where each of these (R, G, B) triples corresponds to an equivalent triple, (R′, G′, B′), in the output gamut. To find the relationship between (R, G, B) and (R′, G′, B′) at points other than the sampling points, i.e. “arbitrary points”, interpolation may be employed, preferably tetrahedral interpolation as described in greater detail below.
For example, referring to
Interpolation within a subcube can be achieved by a number of methods. In a preferred method according to an embodiment of the present invention tetrahedral interpolation is utilized. Because a cube can be constructed from six tetrahedrons (see
The barycentric representation of a three-dimensional point in a tetrahedron with vertices v1,2,3,4 is found by computing weights α1,2,3,4/α0 where
and |·| is the determinant. Because α0=1, the barycentric representation is provided by Equation (33)
Equation (33) provides the weights used to express RGB in terms of the tetrahedron vertices of the input gamut. Thus, the same weights can be used to interpolate between the R′G′B′ values at those vertices. Because the correspondence between the RGB and R′G′B′ vertex values provides the values to populate the 3D LUT, Equation (33) may be converted to Equation (34):
where LUT(v1,2,3,4) are the RGB values of the output color space at the sampling vertices used for the input color space.
For hardware implementation, the input and output color spaces are sampled using n3 vertices, which requires (n−1)3 unit cubes. In a preferred embodiment, n=9 to provide a reasonable compromise between interpolation accuracy and computational complexity. The hardware implementation may proceed according to the following steps:
1.1 Finding the Subcube
First, the enclosing subcube triple, RGB0, is found by computing
where RGB is the input RGB triple and └·┘ the floor operator and 1≤i≤3. The offset within the cube, rgb, is then found from
wherein, 0≤RGB0(i)≤7 and 0≤rgb(i)≤31, if n=9.
1.2 Barycentric Computations
Because the tetrahedron vertices v1,2,3,4 are known in advance, Equations (28)-(34) may be simplified by computing the determinants explicitly. Only one of six cases needs to be computed:
rgb(1)>rgb(2) and rgb(3)>rgb(1)
α=[32−rgb(3)rgb(3)−rgb(1)rgb(1)−rgb(2)rgb(2)]
v1=[0 0 0]
v2=[0 0 1]
v3=[1 0 1]
v4=[1 1 1] (37)
rgb(1)>rgb(2) and rgb(3)>rgb(2)
α=[32−rgb(1)rgb(1)−rgb(3)rgb(3)−rgb(2)rgb(2)]
v1=[0 0 0]
v2=[1 0 0]
v3=[1 0 1]
v4=[1 1 1] (38)
rgb(1)>rgb(2) and rgb(3)<rgb(2)
α=[32−rgb(1)rgb(1)−rgb(2)rgb(2)−rgb(3)rgb(3)]
v1=[0 0 0]
v2=[1 0 0]
v3=[1 1 0]
v4=[1 1 1] (39)
rgb(1)<rgb(2) and rgb(1)>rgb(3)
α=[32−rgb(2)rgb(2)−rgb(1)rgb(1)−rgb(3)rgb(3)]
v1=[0 0 0]
v2=[0 1 0]
v3=[0 1 1]
v4=[1 1 1] (40)
rgb(1)<rgb(2) and rgb(3)>rgb(2)
α=[32−rgb(3)rgb(3)−rgb(1)rgb(2)−rgb(1)rgb(1)]
v1=[0 0 0]
v2=[0 0 1]
v3=[0 1 1]
v4=[1 1 1] (41)
rgb(1)<rgb(2) and rgb(2)>rgb(3)
α=[32−rgb(2)rgb(2)−rgb(3)rgb(3)−rgb(1)rgb(1)]
v1=[0 0 0]
v2=[0 1 0]
v3=[0 1 1]
v4=[1 1 1] (42)
1.3 LUT Indexing
Because the input color space samples are evenly spaced, the corresponding destination color space samples contained in the 3D LUT, LUT(v1,2,3,4), are provided according to Equations (43),
LUT(v1)=LUT(81×RGB0(1)+9×RGB0(2)+RGB0(3)
LUT(v2)=LUT(81×(RGB0(1)+v2(1))+9×(RGB0(2)+v2(2))+(RG
LUT(v3)=LUT(81×(RGB0(1)+v3(1))+9×(RGB0(2)+v3(2))+(RG
LUT(v4)=LUT(81×(RGB0(1)+v4(1))+9×(RGB0(2)+v4(2))+(RG (43)
1.4 Interpolation
In a final step, the R′ G′ B′ values may be determined from Equation (17),
As noted above, a chromatic adaptation step (9) may also be incorporated into the processing pipeline to correct for display of white levels in the output image. The white point provided by the white pigment of a color electrophoretic display may be significantly different from the white point assumed in the color space of the input image. To address this difference, the display may either maintain the input color space white point, in which case the white state is dithered, or shift the color space white point to that of the white pigment. The latter operation is achieved by chromatic adaptation, and may substantially reduce dither noise in the white state at the expense of a white point shift.
The Gamut mapping stage (4) may also be parameterized by the environmental conditions in which the display is used. The CIECAM color space, for example, contains parameters to account for both display and ambient brightness and degree of adaptation. Therefore, in one implementation, the Gamut mapping stage (4) may be controlled by environmental conditions data (8) from an external sensor.
5. Spatial Dither
The final stage in the processing pipeline for the production of the output image data (12) is a spatial dither (5). Any of a number of spatial dithering algorithms known to those of skill in the art may be employed as the spatial dither stage (5) including, but not limited to those described above. When a dithered image is viewed at a sufficient distance, the individual colored pixels are merged by the human visual system into perceived uniform colors. Because of the trade-off between color depth and spatial resolution, dithered images, when viewed closely, have a characteristic graininess as compared to images in which the color palette available at each pixel location has the same depth as that required to render images on the display as a whole. However, dithering reduces the presence of color-banding which is often more objectionable than graininess, especially when viewed at a distance.
Algorithms for assigning particular colors to particular pixels have been developed in order to avoid unpleasant patterns and textures in images rendered by dithering. Such algorithms may involve error diffusion, a technique in which error resulting from the difference between the color required at a certain pixel and the closest color in the per-pixel palette (i.e., the quantization residual) is distributed to neighboring pixels that have not yet been processed. European Patent No. 0677950 describes such techniques in detail, while U.S. Pat. No. 5,880,857 describes a metric for comparison of dithering techniques. U.S. Pat. No. 5,880,857 is incorporated herein by reference in its entirety.
From the foregoing, it will be seen that DHHG method of the present invention differs from previous image rendering methods for color electrophoretic displays in at least two respects. Firstly, rendering methods according to the various embodiments of the present invention treat the image input data content as if it were a high dynamic range signal with respect to the narrow-gamut, low dynamic range nature of the color electrophoretic display so that a very wide range of content can be rendered without deleterious artifacts. Secondly, the rendering methods according to the various embodiments of the present invention provide alternate methods for adjusting the image output based on external environmental conditions as monitored by proximity or luminance sensors. This provides enhanced usability benefits—for example, the image processing is modified to account for the display being near/far to the viewer's face or the ambient conditions being dark or bright.
Remote Image Rendering System
As already mentioned, this invention provides an image rendering system including an electro-optic display (which may be an electrophoretic display, especially an electronic paper display) and a remote processor connected via a network. The display includes an environmental condition sensor, and is configured to provide environmental condition information to the remote processor via the network. The remote processor is configured to receive image data, receive environmental condition information from the display via the network, render the image data for display on the display under the reported environmental condition, thereby creating rendered image data, and transmit the rendered image data. In some embodiments, the image rendering system includes a layer of electrophoretic display material disposed between first and second electrodes, wherein at least one of the electrodes being light transmissive. The electrophoretic display medium typically includes charged pigment particles that move when an electric potential is applied between the electrodes. Often, the charged pigment particles comprise more than on color, for example, white, cyan, magenta, and yellow charged pigments. When four sets of charged particles are present, the first and third sets of particles may have a first charge polarity, and the second and fourth sets may have a second charge polarity. Furthermore, the first and third sets may have different charge magnitudes, while the second and fourth sets have different charge magnitudes.
The invention is not limited to four particle electrophoretic displays, however. For example, the display may comprises a color filter array. The color filter array may be paired with a number of different media, for example, electrophoretic media, electrochromic media, reflective liquid crystals, or colored liquids, e.g., an electrowetting device. In some embodiments, an electrowetting device may not include a color filter array, but may include pixels of colored electrowetting liquids.
In some embodiments, the environmental condition sensor senses a parameter selected from temperature, humidity, incident light intensity, and incident light spectrum. In some embodiments, the display is configured to receive the rendered image data transmitted by the remote processor and update the image on the display. In some embodiments, the rendered image data is received by a local host and then transmitted from the local host to the display. Sometimes, the rendered image data is transmitted from the local host to the electronic paper display wirelessly. Optionally, the local host additionally receives environmental condition information from the display wirelessly. In some instances, the local host additionally transmits the environmental condition information from the display to the remote processor. Typically, the remote processor is a server computer connected to the internet. In some embodiments, the image rendering system also includes a docking station configured to receive the rendered image data transmitted by the remote processor and update the image on the display when the display and the docking station are in contact.
It should be noted that the changes in the rendering of the image dependent upon an environmental temperature parameter may include a change in the number of primaries with which the image is rendered. Blooming is a complicated function of the electrical permeability of various materials present in an electro-optic medium, the viscosity of the fluid (in the case of electrophoretic media) and other temperature-dependent properties, so, not surprisingly, blooming itself is strongly temperature dependent. It has been found empirically that color electrophoretic displays can operate effectively only within limited temperature ranges (typically of the order of 50 C.°) and that blooming can vary significantly over much smaller temperature intervals.
It is well known to those skilled in electro-optic display technology that blooming can give rise to a change in the achievable display gamut because, at some spatially intermediate point between adjacent pixels using different dithered primaries, blooming can give rise to a color which deviates significantly from the expected average of the two. In production, this non-ideality can be handled by defining different display gamuts for different temperature range, each gamut accounting for the blooming strength at that temperature range. As the temperature changes and a new temperature range is entered, the rendering process should automatically re-render the image to account for the change in display gamut.
As operating temperature increases, the contribution from blooming may become so severe that it is not possible to maintain adequate display performance using the same number of primaries as at lower temperature. Accordingly, the rendering methods and apparatus of the present invention may be arranged to that, as the sensed temperature varies, not only the display gamut but also the number of primaries is varied. At room temperature, for example, the methods may render an image using 32 primaries because the blooming contribution is manageable; at higher temperatures, for example, it may only be possible to use 16 primaries.
In practice, a rendering system of the present invention can be provided with a number of differing pre-computed 3D lookup tables (3D LUTs) each corresponding to a nominal display gamut in a given temperature range, and for each temperature range with a list of P primaries, and a blooming model having P×P entries. As a temperature range threshold is crossed, the rendering engine is notified and the image is re-rendered according to the new gamut and list of primaries. Since the rendering method of the present invention can handle an arbitrary number of primaries, and any arbitrary blooming model, the use of multiple lookup tables, list of primaries and blooming models depending upon temperature provides an important degree of freedom for optimizing performance on rendering systems of the invention.
Also as already mentioned, the invention provides an image rendering system including an electro-optic display, a local host, and a remote processor, wherein the three components are connected via a network. The local host includes an environmental condition sensor, and is configured to provide environmental condition information to the remote processor via the network. The remote processor is configured to receive image data, receive environmental condition information from the local host via the network, render the image data for display on the display under the reported environmental condition, thereby creating rendered image data, and transmit the rendered image data. In some embodiments, the image rendering system includes a layer of electrophoretic display medium disposed between first and second electrodes, at least one of the electrodes being light transmissive. In some embodiments, the local host may also send the image data to the remote processor.
Also as already mentioned, the invention includes a docking station comprising an interface for coupling with an electro-optic display. The docking station is configured to receive rendered image data via a network and to update an image on the display with the rendered image data. Typically, the docking station includes a power supply for providing a plurality of voltages to an electronic paper display. In some embodiments, the power supply is configured to provide three different magnitudes of positive and of negative voltage in addition to a zero voltage.
Thus, the invention provides a system for rendering image data for presentation on a display. Because the image rendering computations are done remotely (e.g., via a remote processor ore server, for example in the cloud) the amount of electronics needed for image presentation is reduced. Accordingly, a display for use in the system needs only the imaging medium, a backplane including pixels, a front plane, a small amount of cache, some power storage, and a network connection. In some instances, the display may interface through a physical connection, e.g., via a docking station or dongle. The remote processor will receive information about the environment of the electronic paper, for example, temperature. The environmental information is then input into a pipeline to produce a primary set for the display. Images received by the remote processor is then rendered for optimum viewing, i.e., rendered image data. The rendered image data are then sent to the display to create the image thereon.
In a preferred embodiment, the imaging medium will be a colored electrophoretic display of the type described in U.S. Patent Publication Nos. 2016/0085132 and 2016/0091770, which describe a four particle system, typically comprising white, yellow, cyan, and magenta pigments. Each pigment has a unique combination of charge polarity and magnitude, for example +high, +low, −low, and −high. As shown in
More specifically, when the cyan, magenta and yellow particles lie below the white particles (Situation [A] in
It is possible that one subtractive primary color could be rendered by a particle that scatters light, so that the display would comprise two types of light-scattering particle, one of which would be white and another colored. In this case, however, the position of the light-scattering colored particle with respect to the other colored particles overlying the white particle would be important. For example, in rendering the color black (when all three colored particles lie over the white particles) the scattering colored particle cannot lie over the non-scattering colored particles (otherwise they will be partially or completely hidden behind the scattering particle and the color rendered will be that of the scattering colored particle, not black).
Methods for electrophoretically arranging a plurality of different colored particles in “layers” as shown in
A second phenomenon that may be employed to control the motion of a plurality of particles is hetero-aggregation between different pigment types; see, for example, US 2014/0092465. Such aggregation may be charge-mediated (Coulombic) or may arise as a result of, for example, hydrogen bonding or van der Waals interactions. The strength of the interaction may be influenced by choice of surface treatment of the pigment particles. For example, Coulombic interactions may be weakened when the closest distance of approach of oppositely-charged particles is maximized by a steric barrier (typically a polymer grafted or adsorbed to the surface of one or both particles). In media used in the systems of the present invention, such polymeric barriers are used on the first and second types of particles, and may or may not be used on the third and fourth types of particles.
A third phenomenon that may be exploited to control the motion of a plurality of particles is voltage- or current-dependent mobility, as described in detail in the aforementioned application Ser. No. 14/277,107.
The driving mechanisms to create the colors at the individual pixels are not straightforward, and typically involve a complex series of voltage pulses (a.k.a. waveforms) as shown in
The greatest positive and negative voltages (designated ±Vmax in
From these blue, yellow, black or white optical states, the other four primary colors may be obtained by moving only the second particles (in this case the cyan particles) relative to the first particles (in this case the white particles), which is achieved using the lowest applied voltages (designated ±Vmin in
While these general principles are useful in the construction of waveforms to produce particular colors in displays of the present invention, in practice the ideal behavior described above may not be observed, and modifications to the basic scheme are desirably employed.
A generic waveform embodying modifications of the basic principles described above is illustrated in
There are four distinct phases in the generic waveform illustrated in
The waveform shown in
As described above, the generic waveform is intrinsically DC balanced, and this may be preferred in certain embodiments of the invention. Alternatively, the pulses in phase A may provide DC balance to a series of color transitions rather than to a single transition, in a manner similar to that provided in certain black and white displays of the prior art; see for example U.S. Pat. No. 7,453,445.
In the second phase of the waveform (phase B in
As described above, white may be rendered by a pulse or a plurality of pulses at −Vmid. In some cases, however, the white color produced in this way may be contaminated by the yellow pigment and appear pale yellow. In order to correct this color contamination, it may be necessary to introduce some pulses of a positive polarity. Thus, for example, white may be obtained by a single instance or a repetition of instances of a sequence of pulses comprising a pulse with length T1 and amplitude +Vmax or +Vmid followed by a pulse with length T2 and amplitude −Vmid, where T2>T1. The final pulse should be a negative pulse. In
As described above, black may be obtained by a rendered by a pulse or a plurality of pulses (separated by periods of zero voltage) at +Vmid.
As described above, magenta may be obtained by a single instance or a repetition of instances of a sequence of pulses comprising a pulse with length T3 and amplitude +Vmax or +Vmid, followed by a pulse with length T4 and amplitude −Vmid, where T4>T3. To produce magenta, the net impulse in this phase of the waveform should be more positive than the net impulse used to produce white. During the sequence of pulses used to produce magenta, the display will oscillate between states that are essentially blue and magenta. The color magenta will be preceded by a state of more negative a* and lower L* than the final magenta state.
As described above, red may be obtained by a single instance or a repetition of instances of a sequence of pulses comprising a pulse with length T5 and amplitude +Vmax or +Vmid, followed by a pulse with length T6 and amplitude −Vmax or −Vmid. To produce red, the net impulse should be more positive than the net impulse used to produce white or yellow. Preferably, to produce red, the positive and negative voltages used are substantially of the same magnitude (either both Vmax or both Vmid), the length of the positive pulse is longer than the length of the negative pulse, and the final pulse is a negative pulse. During the sequence of pulses used to produce red, the display will oscillate between states that are essentially black and red. The color red will be preceded by a state of lower L*, lower a*, and lower b* than the final red state.
Yellow may be obtained by a single instance or a repetition of instances of a sequence of pulses comprising a pulse with length T7 and amplitude +Vmax or +Vmid, followed by a pulse with length T8 and amplitude −Vmax. The final pulse should be a negative pulse. Alternatively, as described above, the color yellow may be obtained by a single pulse or a plurality of pulses at −Vmax.
In the third phase of the waveform (phase C in
Typically, cyan and green will be produced by a pulse sequence in which +Vmin must be used. This is because it is only at this minimum positive voltage that the cyan pigment can be moved independently of the magenta and yellow pigments relative to the white pigment. Such a motion of the cyan pigment is necessary to render cyan starting from white or green starting from yellow.
Finally, in the fourth phase of the waveform (phase D in
Although the display shown in
In general, light colors are obtained in the same manner as dark colors, but using waveforms having slightly different net impulse in phases B and C. Thus, for example, light red, light green and light blue waveforms have a more negative net impulse in phases B and C than the corresponding red, green and blue waveforms, whereas dark cyan, dark magenta, and dark yellow have a more positive net impulse in phases B and C than the corresponding cyan, magenta and yellow waveforms. The change in net impulse may be achieved by altering the lengths of pulses, the number of pulses, or the magnitudes of pulses in phases B and C.
Gray colors are typically achieved by a sequence of pulses oscillating between low or mid voltages.
It will be clear to one of ordinary skill in the art that in a display of the invention driven using a thin-film transistor (TFT) array the available time increments on the abscissa of
The generic waveform illustrated in
Since the changes to the voltages supplied to the source drivers affect every pixel, the waveform needs to be modified accordingly, so that the waveform used to produce each color must be aligned with the voltages supplied. The addition of dithering and grayscales further complicates the set of image data that must be generated to produce the desired image.
An exemplary pipeline for rendering image data (e.g., a bitmap file) has been described above with reference to
A variety of alternative architectures are available, as evidenced by
A “real world” embodiment is shown in
When users decide to display an image on the “client” (the display), they open an application on their “host” (mobile device) and pick out the image they wish to display and the specific “client” they want to display it on. The “host” then polls that particular “client” for its unique device ID and metadata. As mentioned above, this transaction may be over a short range power sipping protocol like Bluetooth 4. Once the “host” has the device ID and metadata, it combines that with the user's authentication, and the image ID and sends it to the “print server” over a wireless connection.
Having received the authentication, the image ID, the client ID and metadata, the “print server” then retrieves the image from a database. This database could be a distributed storage volume (like another cloud) or it could be internal to the “print server”. Images might have been previously uploaded to the image database by the user, or may be stock images or images available for purchase. Having retrieved the user-selected image from storage, the “print server” performs a rendering operation which modifies the retrieved image to display correctly on the “client”. The rendering operation may be performed on the “print server” or it may be accessed via a separate software protocol on a dedicated cloud based rendering server (offering a “rendering service”). It may also be resource efficient to render all the user's images ahead of time and store them in the image database itself. In that case the “print server” would simply have a LUT indexed by client metadata and retrieve the correct pre-rendered image. Having procured a rendered image, the “print server” will send this data back to the “host” and the “host” will communicate this information to the “client” via the same power sipping communication protocol described earlier.
In the case of the four color electrophoretic system described with respect to
On the “client” an image controller will take the processed image data, where it may be stored, placed into a queue for display, or directly displayed on the ACeP screen. After the display “printing” is complete the “client” will communicate appropriate metadata with the “host” and the “host” will relay that to the “print server”. All metadata will be logged in the data volume that stores the images.
A variation on this embodiment which may be more suitable for electronic signage or shelf label applications revolves around removing the “host” from the transactions. In this embodiment the “print server” will communicate directly with the “client” over the internet.
Certain specific embodiments will now be described. In one of these embodiments, the color information associated with particular waveforms that is an input to the image processing (as described above) will vary, as the waveforms that are chosen may depend upon the temperature of the ACeP module. Thus, the same user-selected image may result in several different processed images, each appropriate to a particular temperature range. One option is for the host to convey to the print server information about the temperature of the client, and for the client to receive only the appropriate image. Alternatively, the client might receive several processed images, each associated with a possible temperature range. Another possibility is that a mobile host might estimate the temperature of a nearby client using information extracted from its on-board temperature sensors and/or light sensors.
In another embodiment, the waveform mode, or the image rendering mode, might be variable depending on the preference of the user. For example, the user might choose a high-contrast waveform/rendering option, or a high-speed, lower-contrast option. It might even be possible that a new waveform mode becomes available after the ACeP module has been installed. In these cases, metadata concerning waveform and/or rendering mode would be sent from the host to the print server, and once again appropriately processed images, possibly accompanied by waveforms, would be sent to the client.
The host would be updated by a cloud server as to the available waveform modes and rendering modes.
The location where ACeP module-specific information is stored may vary. This information may reside in the print server, indexed by, for example, a serial number that would be sent along with an image request from the host. Alternatively, this information may reside in the ACeP module itself.
The information transmitted from the host to the print server may be encrypted, and the information relayed from the server to the rendering service may also be encrypted. The metadata may contain an encryption key to facilitate encryption and decryption.
From the foregoing, it will be seen that the present invention can provide improved color in limited palette displays with fewer artifacts than are obtained using conventional error diffusion techniques. The present invention differs fundamentally from the prior art in adjusting the primaries prior to the quantization, whereas the prior art (as described above with reference to
For further details of color display systems to which the present invention can be applied, the reader is directed to the aforementioned ECD patents (which also give detailed discussions of electrophoretic displays) and to the following patents and publications: U.S. Pat. Nos. 6,017,584; 6,545,797; 6,664,944; 6,788,452; 6,864,875; 6,914,714; 6,972,893; 7,038,656; 7,038,670; 7,046,228; 7,052,571; 7,075,502; 7,167,155; 7,385,751; 7,492,505; 7,667,684; 7,684,108; 7,791,789; 7,800,813; 7,821,702; 7,839,564; 7,910,175; 7,952,790; 7,956,841; 7,982,941; 8,040,594; 8,054,526; 8,098,418; 8,159,636; 8,213,076; 8,363,299; 8,422,116; 8,441,714; 8,441,716; 8,466,852; 8,503,063; 8,576,470; 8,576,475; 8,593,721; 8,605,354; 8,649,084; 8,670,174; 8,704,756; 8,717,664; 8,786,935; 8,797,634; 8,810,899; 8,830,559; 8,873,129; 8,902,153; 8,902,491; 8,917,439; 8,964,282; 9,013,783; 9,116,412; 9,146,439; 9,164,207; 9,170,467; 9,182,646; 9,195,111; 9,199,441; 9,268,191; 9,285,649; 9,293,511; 9,341,916; 9,360,733; 9,361,836; and 9,423,666; and U.S. Patent Applications Publication Nos. 2008/0043318; 2008/0048970; 2009/0225398; 2010/0156780; 2011/0043543; 2012/0326957; 2013/0242378; 2013/0278995; 2014/0055840; 2014/0078576; 2014/0340736; 2014/0362213; 2015/0103394; 2015/0118390; 2015/0124345; 2015/0198858; 2015/0234250; 2015/0268531; 2015/0301246; 2016/0011484; 2016/0026062; 2016/0048054; 2016/0116816; 2016/0116818; and 2016/0140909.
It will be apparent to those skilled in the art that numerous changes and modifications can be made in the specific embodiments of the invention described above without departing from the scope of the invention. Accordingly, the whole of the foregoing description is to be interpreted in an illustrative and not in a limitative sense.
This application is a continuation of U.S. application Ser. No. 16/576,350 (Publication No. 2020/0020301; now U.S. Pat. No. 11,094,288) filed on Sep. 19, 2019, which is a division of U.S. application Ser. No. 15/910,081 (Publication No. 2018/0254020; now U.S. Pat. No. 10,467,984) filed on Mar. 2, 2018, which claims the benefit of: 1. Provisional Application Ser. No. 62/467,291, filed Mar. 6, 2017; 2. Provisional Application Ser. No. 62/509,031, filed May 19, 2017; 3. Provisional Application Ser. No. 62/509,087, filed May 20, 2017; 4. Provisional Application Ser. No. 62/585,614, filed Nov. 14, 2017; 5. Provisional Application Ser. No. 62/585,692, filed Nov. 14, 2017; 6. Provisional Application Ser. No. 62/585,761, filed Nov. 14, 2017; and 7. Provisional Application Ser. No. 62/591,188, filed Nov. 27, 2017. The entire contents of all of the aforementioned applications and patents are incorporated by reference herein. This application is related to application Ser. No. 14/277,107, filed May 14, 2014 (Publication No. 2014/0340430, now U.S. Pat. No. 9,697,778); application Ser. No. 14/866,322, filed Sep. 25, 2015 (Publication No. 2016/0091770); U.S. Pat. Nos. 9,383,623 and 9,170,468, application Ser. No. 15/427,202, filed Feb. 8, 2017 (Publication No. 2017/0148372) and application Ser. No. 15/592,515, filed May 11, 2017 (Publication No. 2017/0346989). The entire contents of these applications and patents (which may hereinafter be referred to the “electrophoretic color display” or “ECD” patents), and of all other U.S. patents and published and applications mentioned below, are incorporated by reference herein. This application is also related to U.S. Pat. Nos. 5,930,026; 6,445,489; 6,504,524; 6,512,354; 6,531,997; 6,753,999; 6,825,970; 6,900,851; 6,995,550; 7,012,600; 7,023,420; 7,034,783; 7,061,166; 7,061,662; 7,116,466; 7,119,772; 7,177,066; 7,193,625; 7,202,847; 7,242,514; 7,259,744; 7,304,787; 7,312,794; 7,327,511; 7,408,699; 7,453,445; 7,492,339; 7,528,822; 7,545,358; 7,583,251; 7,602,374; 7,612,760; 7,679,599; 7,679,813; 7,683,606; 7,688,297; 7,729,039; 7,733,311; 7,733,335; 7,787,169; 7,859,742; 7,952,557; 7,956,841; 7,982,479; 7,999,787; 8,077,141; 8,125,501; 8,139,050; 8,174,490; 8,243,013; 8,274,472; 8,289,250; 8,300,006; 8,305,341; 8,314,784; 8,373,649; 8,384,658; 8,456,414; 8,462,102; 8,514,168; 8,537,105; 8,558,783; 8,558,785; 8,558,786; 8,558,855; 8,576,164; 8,576,259; 8,593,396; 8,605,032; 8,643,595; 8,665,206; 8,681,191; 8,730,153; 8,810,525; 8,928,562; 8,928,641; 8,976,444; 9,013,394; 9,019,197; 9,019,198; 9,019,318; 9,082,352; 9,171,508; 9,218,773; 9,224,338; 9,224,342; 9,224,344; 9,230,492; 9,251,736; 9,262,973; 9,269,311; 9,299,294; 9,373,289; 9,390,066; 9,390,661; and 9,412,314; and U.S. Patent Applications Publication Nos. 2003/0102858; 2004/0246562; 2005/0253777; 2007/0091418; 2007/0103427; 2007/0176912; 2008/0024429; 2008/0024482; 2008/0136774; 2008/0291129; 2008/0303780; 2009/0174651; 2009/0195568; 2009/0322721; 2010/0194733; 2010/0194789; 2010/0220121; 2010/0265561; 2010/0283804; 2011/0063314; 2011/0175875; 2011/0193840; 2011/0193841; 2011/0199671; 2011/0221740; 2012/0001957; 2012/0098740; 2013/0063333; 2013/0194250; 2013/0249782; 2013/0321278; 2014/0009817; 2014/0085355; 2014/0204012; 2014/0218277; 2014/0240210; 2014/0240373; 2014/0253425; 2014/0292830; 2014/0293398; 2014/0333685; 2014/0340734; 2015/0070744; 2015/0097877; 2015/0109283; 2015/0213749; 2015/0213765; 2015/0221257; 2015/0262255; 2015/0262551; 2016/0071465; 2016/0078820; 2016/0093253; 2016/0140910; and 2016/0180777. These patents and applications may hereinafter for convenience collectively be referred to as the “MEDEOD” (MEthods for Driving Electro-Optic Displays) applications.
Number | Name | Date | Kind |
---|---|---|---|
3383993 | Yeh | May 1968 | A |
4418346 | Batchelder | Nov 1983 | A |
5455600 | Friedman et al. | Oct 1995 | A |
5649083 | Barkans et al. | Jul 1997 | A |
5760761 | Sheridon | Jun 1998 | A |
5777782 | Sheridon | Jul 1998 | A |
5808783 | Crowley | Sep 1998 | A |
5872552 | Gordon, II et al. | Feb 1999 | A |
5880857 | Shiau et al. | Mar 1999 | A |
5930026 | Jacobson et al. | Jul 1999 | A |
6017584 | Albert et al. | Jan 2000 | A |
6054071 | Mikkelsen, Jr. | Apr 2000 | A |
6055091 | Sheridon et al. | Apr 2000 | A |
6097531 | Sheridon | Aug 2000 | A |
6128124 | Silverman | Oct 2000 | A |
6130774 | Albert et al. | Oct 2000 | A |
6137467 | Sheridon et al. | Oct 2000 | A |
6144361 | Gordon, II et al. | Nov 2000 | A |
6147791 | Sheridon | Nov 2000 | A |
6184856 | Gordon, II et al. | Feb 2001 | B1 |
6225971 | Gordon, II et al. | May 2001 | B1 |
6241921 | Jacobson et al. | Jun 2001 | B1 |
6271823 | Gordon, II et al. | Aug 2001 | B1 |
6301038 | Fitzmaurice et al. | Oct 2001 | B1 |
6445489 | Jacobson et al. | Sep 2002 | B1 |
6504524 | Gates et al. | Jan 2003 | B1 |
6512354 | Jacobson et al. | Jan 2003 | B2 |
6531997 | Gates et al. | Mar 2003 | B1 |
6545797 | Chen et al. | Apr 2003 | B2 |
6664944 | Albert et al. | Dec 2003 | B1 |
6672921 | Liang et al. | Jan 2004 | B1 |
6704133 | Gates et al. | Mar 2004 | B2 |
6753999 | Zehner et al. | Jun 2004 | B2 |
6788449 | Liang et al. | Sep 2004 | B2 |
6788452 | Liang et al. | Sep 2004 | B2 |
6825970 | Goenaga et al. | Nov 2004 | B2 |
6866760 | Paolini, Jr. et al. | Mar 2005 | B2 |
6870657 | Fitzmaurice et al. | Mar 2005 | B1 |
6900851 | Morrison et al. | May 2005 | B2 |
6922276 | Zhang et al. | Jul 2005 | B2 |
6950220 | Abramson et al. | Sep 2005 | B2 |
6982178 | LeCain et al. | Jan 2006 | B2 |
6995550 | Jacobson et al. | Feb 2006 | B2 |
7002728 | Pullen et al. | Feb 2006 | B2 |
7012600 | Zehner et al. | Mar 2006 | B2 |
7023420 | Comiskey et al. | Apr 2006 | B2 |
7034783 | Gates et al. | Apr 2006 | B2 |
7038656 | Liang et al. | May 2006 | B2 |
7038670 | Liang et al. | May 2006 | B2 |
7046228 | Liang et al. | May 2006 | B2 |
7052571 | Wang et al. | May 2006 | B2 |
7061166 | Kuniyasu | Jun 2006 | B2 |
7061662 | Chung et al. | Jun 2006 | B2 |
7072095 | Liang et al. | Jul 2006 | B2 |
7075502 | Drzaic et al. | Jul 2006 | B1 |
7116318 | Amundson et al. | Oct 2006 | B2 |
7116466 | Whitesides et al. | Oct 2006 | B2 |
7119772 | Amundson et al. | Oct 2006 | B2 |
7144942 | Zang et al. | Dec 2006 | B2 |
7167155 | Albert et al. | Jan 2007 | B1 |
7170670 | Webber | Jan 2007 | B2 |
7177066 | Chung et al. | Feb 2007 | B2 |
7193625 | Danner et al. | Mar 2007 | B2 |
7202847 | Gates | Apr 2007 | B2 |
7236291 | Kaga et al. | Jun 2007 | B2 |
7242514 | Chung et al. | Jul 2007 | B2 |
7259744 | Arango et al. | Aug 2007 | B2 |
7263382 | Chandhok et al. | Aug 2007 | B2 |
7312784 | Baucom et al. | Dec 2007 | B2 |
7321459 | Masuda et al. | Jan 2008 | B2 |
7327511 | Whitesides et al. | Feb 2008 | B2 |
7330193 | Bhattacharjya | Feb 2008 | B2 |
7339715 | Webber et al. | Mar 2008 | B2 |
7385751 | Chen et al. | Jun 2008 | B2 |
7408699 | Wang et al. | Aug 2008 | B2 |
7411719 | Paolini, Jr. et al. | Aug 2008 | B2 |
7420549 | Jacobson et al. | Sep 2008 | B2 |
7453445 | Amundson | Nov 2008 | B2 |
7492339 | Amundson | Feb 2009 | B2 |
7492505 | Liang et al. | Feb 2009 | B2 |
7528822 | Amundson et al. | May 2009 | B2 |
7535624 | Amundson et al. | May 2009 | B2 |
7561324 | Duthaler et al. | Jul 2009 | B2 |
7583251 | Arango et al. | Sep 2009 | B2 |
7602374 | Zehner et al. | Oct 2009 | B2 |
7612760 | Kawai | Nov 2009 | B2 |
7667684 | Jacobson et al. | Feb 2010 | B2 |
7679599 | Kawai | Mar 2010 | B2 |
7679814 | Paolini, Jr. et al. | Mar 2010 | B2 |
7683606 | Kang et al. | Mar 2010 | B2 |
7715088 | Liang et al. | May 2010 | B2 |
7725559 | Landis et al. | May 2010 | B2 |
7773769 | Rattan et al. | Aug 2010 | B2 |
7800813 | Wu et al. | Sep 2010 | B2 |
7839564 | Whitesides et al. | Nov 2010 | B2 |
7859742 | Chiu et al. | Dec 2010 | B1 |
7910175 | Webber | Mar 2011 | B2 |
7952557 | Amundson | May 2011 | B2 |
7952790 | Honeyman | May 2011 | B2 |
7982479 | Wang et al. | Jul 2011 | B2 |
7982941 | Lin et al. | Jul 2011 | B2 |
7984108 | Landis et al. | Jul 2011 | B2 |
7999787 | Amundson et al. | Aug 2011 | B2 |
8040594 | Paolini, Jr. et al. | Oct 2011 | B2 |
8054526 | Bouchard | Nov 2011 | B2 |
8077141 | Duthaler et al. | Dec 2011 | B2 |
8098418 | Paolini, Jr. et al. | Jan 2012 | B2 |
8125501 | Amundson et al. | Feb 2012 | B2 |
8139050 | Jacobson et al. | Mar 2012 | B2 |
8159636 | Sun et al. | Apr 2012 | B2 |
8174490 | Whitesides et al. | May 2012 | B2 |
8243013 | Sprague et al. | Aug 2012 | B1 |
8274472 | Wang et al. | Sep 2012 | B1 |
8289250 | Zehner et al. | Oct 2012 | B2 |
8300006 | Zhou et al. | Oct 2012 | B2 |
8314784 | Ohkami et al. | Nov 2012 | B2 |
8319759 | Jacobson et al. | Nov 2012 | B2 |
8355169 | Hersch et al. | Jan 2013 | B2 |
8363299 | Paolini, Jr. et al. | Jan 2013 | B2 |
8373649 | Low et al. | Feb 2013 | B2 |
8384658 | Albert et al. | Feb 2013 | B2 |
8422116 | Sprague et al. | Apr 2013 | B2 |
8456414 | Lin et al. | Jun 2013 | B2 |
8462102 | Wong et al. | Jun 2013 | B2 |
8503063 | Sprague | Aug 2013 | B2 |
8514168 | Chung et al. | Aug 2013 | B2 |
8537105 | Chiu et al. | Sep 2013 | B2 |
8558783 | Wilcox et al. | Oct 2013 | B2 |
8558786 | Lin | Oct 2013 | B2 |
8558855 | Sprague et al. | Oct 2013 | B2 |
8576164 | Sprague et al. | Nov 2013 | B2 |
8576259 | Lin et al. | Nov 2013 | B2 |
8576470 | Paolini, Jr. et al. | Nov 2013 | B2 |
8576475 | Huang et al. | Nov 2013 | B2 |
8576476 | Telfer et al. | Nov 2013 | B2 |
8605032 | Liu et al. | Dec 2013 | B2 |
8605354 | Zhang et al. | Dec 2013 | B2 |
8649084 | Wang et al. | Feb 2014 | B2 |
8649785 | Durand et al. | Feb 2014 | B2 |
8665206 | Lin et al. | Mar 2014 | B2 |
8670174 | Sprague et al. | Mar 2014 | B2 |
8681191 | Yang et al. | Mar 2014 | B2 |
8704756 | Lin | Apr 2014 | B2 |
8717664 | Wang et al. | May 2014 | B2 |
8780133 | Jeong et al. | Jul 2014 | B2 |
8786935 | Sprague | Jul 2014 | B2 |
8797634 | Paolini, Jr. et al. | Aug 2014 | B2 |
8804196 | Kuno | Aug 2014 | B2 |
8810525 | Sprague | Aug 2014 | B2 |
8873129 | Paolini, Jr. et al. | Oct 2014 | B2 |
8902153 | Bouchard et al. | Dec 2014 | B2 |
8902491 | Wang et al. | Dec 2014 | B2 |
8917439 | Wang et al. | Dec 2014 | B2 |
8928562 | Gates et al. | Jan 2015 | B2 |
8928641 | Chiu et al. | Jan 2015 | B2 |
8964282 | Wang et al. | Feb 2015 | B2 |
8976444 | Zhang et al. | Mar 2015 | B2 |
9013394 | Lin | Apr 2015 | B2 |
9013783 | Sprague | Apr 2015 | B2 |
9019197 | Lin | Apr 2015 | B2 |
9019198 | Lin et al. | Apr 2015 | B2 |
9019318 | Sprague et al. | Apr 2015 | B2 |
9082352 | Cheng et al. | Jul 2015 | B2 |
9116412 | Lin | Aug 2015 | B2 |
9129547 | Zeng | Sep 2015 | B2 |
9146439 | Zhang | Sep 2015 | B2 |
9170468 | Lin et al. | Oct 2015 | B2 |
9182646 | Paolini, Jr. et al. | Nov 2015 | B2 |
9195111 | Anseth et al. | Nov 2015 | B2 |
9199441 | Danner | Dec 2015 | B2 |
9218773 | Sun et al. | Dec 2015 | B2 |
9224338 | Chan et al. | Dec 2015 | B2 |
9224342 | Sprague et al. | Dec 2015 | B2 |
9224344 | Chung et al. | Dec 2015 | B2 |
9230492 | Harrington et al. | Jan 2016 | B2 |
9251736 | Lin et al. | Feb 2016 | B2 |
9251802 | Crockett et al. | Feb 2016 | B2 |
9262973 | Wu et al. | Feb 2016 | B2 |
9279906 | Kang | Mar 2016 | B2 |
9285649 | Du et al. | Mar 2016 | B2 |
9293511 | Jacobson et al. | Mar 2016 | B2 |
9299294 | Lin et al. | Mar 2016 | B2 |
9360733 | Wang et al. | Jun 2016 | B2 |
9361836 | Telfer et al. | Jun 2016 | B1 |
9383623 | Lin et al. | Jul 2016 | B2 |
9390066 | Smith et al. | Jul 2016 | B2 |
9390661 | Chiu et al. | Jul 2016 | B2 |
9423666 | Wang et al. | Aug 2016 | B2 |
9459510 | Lin | Oct 2016 | B2 |
9460666 | Sprague et al. | Oct 2016 | B2 |
9495918 | Harrington et al. | Nov 2016 | B2 |
9501981 | Lin et al. | Nov 2016 | B2 |
9509935 | Wilson et al. | Nov 2016 | B2 |
9513527 | Chan et al. | Dec 2016 | B2 |
9513743 | Sjodin et al. | Dec 2016 | B2 |
9514667 | Lin | Dec 2016 | B2 |
9541814 | Lin et al. | Jan 2017 | B2 |
9612502 | Danner et al. | Apr 2017 | B2 |
9620048 | Sim et al. | Apr 2017 | B2 |
9671668 | Chan et al. | Jun 2017 | B2 |
9672766 | Sjodin | Jun 2017 | B2 |
9691333 | Cheng et al. | Jun 2017 | B2 |
9697778 | Telfer et al. | Jul 2017 | B2 |
9721495 | Harrington et al. | Aug 2017 | B2 |
9759980 | Du et al. | Sep 2017 | B2 |
9792861 | Chang et al. | Oct 2017 | B2 |
9792862 | Hung et al. | Oct 2017 | B2 |
9812073 | Lin et al. | Nov 2017 | B2 |
9921451 | Telfer et al. | Mar 2018 | B2 |
9934595 | Safaee-Rad et al. | Apr 2018 | B2 |
10089960 | Greenebaum et al. | Oct 2018 | B2 |
10162242 | Wang et al. | Dec 2018 | B2 |
10209556 | Rosenfeld et al. | Feb 2019 | B2 |
10229641 | Yang et al. | Mar 2019 | B2 |
10270939 | Crounse | Apr 2019 | B2 |
10306233 | Damkat et al. | May 2019 | B2 |
10319313 | Harris et al. | Jun 2019 | B2 |
10339876 | Lin et al. | Jul 2019 | B2 |
10353266 | Bouchard et al. | Jul 2019 | B2 |
10372008 | Telfer et al. | Aug 2019 | B2 |
10467784 | Buck | Nov 2019 | B2 |
10672350 | Amundson et al. | Jun 2020 | B2 |
11094288 | Buckley | Aug 2021 | B2 |
20030102858 | Jacobson et al. | Jun 2003 | A1 |
20040174597 | Craig | Sep 2004 | A1 |
20040246562 | Chung et al. | Dec 2004 | A1 |
20050253777 | Zehner et al. | Nov 2005 | A1 |
20070081739 | Wilbrink et al. | Apr 2007 | A1 |
20070103427 | Zhou et al. | May 2007 | A1 |
20070176912 | Beames et al. | Aug 2007 | A1 |
20070223079 | Honeyman | Sep 2007 | A1 |
20080024429 | Zehner | Jan 2008 | A1 |
20080024482 | Gates et al. | Jan 2008 | A1 |
20080043318 | Whitesides et al. | Feb 2008 | A1 |
20080136774 | Harris et al. | Jun 2008 | A1 |
20080303780 | Sprague et al. | Dec 2008 | A1 |
20090174651 | Jacobson et al. | Jul 2009 | A1 |
20100105329 | Durand | Apr 2010 | A1 |
20100156780 | Jacobson et al. | Jun 2010 | A1 |
20100194733 | Lin et al. | Aug 2010 | A1 |
20100194789 | Lin et al. | Aug 2010 | A1 |
20100220121 | Zehner et al. | Sep 2010 | A1 |
20100265561 | Gates et al. | Oct 2010 | A1 |
20110043543 | Chen et al. | Feb 2011 | A1 |
20110063314 | Chiu et al. | Mar 2011 | A1 |
20110175875 | Lin et al. | Jul 2011 | A1 |
20110221740 | Yang et al. | Sep 2011 | A1 |
20120001957 | Liu et al. | Jan 2012 | A1 |
20120098740 | Chiu et al. | Apr 2012 | A1 |
20130063333 | Arango et al. | Mar 2013 | A1 |
20130249782 | Wu et al. | Sep 2013 | A1 |
20140055840 | Zang et al. | Feb 2014 | A1 |
20140078576 | Sprague | Mar 2014 | A1 |
20140176730 | Kaji et al. | Jun 2014 | A1 |
20140204012 | Wu et al. | Jul 2014 | A1 |
20140240210 | Wu et al. | Aug 2014 | A1 |
20140253425 | Zalesky et al. | Sep 2014 | A1 |
20140293398 | Wang et al. | Oct 2014 | A1 |
20140362213 | Tseng | Dec 2014 | A1 |
20150243243 | Greenebaum et al. | Aug 2015 | A1 |
20150262255 | Khajehnouri et al. | Sep 2015 | A1 |
20150268531 | Wang et al. | Sep 2015 | A1 |
20150287354 | Wang et al. | Oct 2015 | A1 |
20150301246 | Zang et al. | Oct 2015 | A1 |
20160180777 | Lin et al. | Jun 2016 | A1 |
20160275879 | Hodges et al. | Sep 2016 | A1 |
20160309420 | Verma | Oct 2016 | A1 |
20170148372 | Emelie et al. | May 2017 | A1 |
20190011703 | Robaina | Jan 2019 | A1 |
Number | Date | Country |
---|---|---|
2005039413 | Feb 2005 | JP |
2013081885 | Jun 2013 | WO |
2015036358 | Mar 2015 | WO |
Entry |
---|
Wood, D., “An Electrochromic Renaissance?” Information Display, 18(3), 24 (Mar. 2002). |
O'Regan, B. et al., “A Low Cost, High-efficiency Solar Cell Based on Dye-sensitized colloidal TiO2 Films”, Nature, vol. 353, pp. 737-740 (Oct. 24, 1991). |
Bach, Udo. et al., “Nanomaterials-Based Electrochromics for Paper-Quality Displays”, Adv. Mater, vol. 14, No. 11, pp. 845-848, (Jun. 5, 2002). |
Hayes, R.A. et al., “Video-Speed Electronic Paper Based on Electrowetting”, Nature, vol. 425, No. 25, pp. 383-385 (Sep. 2003). |
Kitamura, T. et al., “Electrical toner movement for electronic paper-like display”, Asia Display/IDW '01, pp. 1517-1520, Paper HCS1-1 (2001). |
Yamaguchi, Y. et al., “Toner display using insulative particles charged triboelectrically”, Asia Display/IDW '01, pp. 1729-1730, Paper AMD4-4 (2001). |
Pappas, Thrasyvoulos N. “Model-based halftoning of color images.” IEEE Transactions on image processing 6.7 (1997): 1014-1024. |
Mitsa, T. et al., “Digital halftoning technique using a blue-noise mask”, J. Opt. Soc. Am. A, vol. 9, No. 11, p. 1920, (Nov. 1992). |
Kuang, Jiangtao et al. “iCAM06: A refined image appearance model for HDR image rendering.” J. Vis. Commun. Image R. 18 (2007) 406-414. |
Pouli, Tania et al. “Color Correction for Tone Reproduction” CIC21: Twenty-first Color and Imaging Conference, Albuquerque, New Mexico, USA, (Nov. 2013), pp. 215-220. |
Kang, Henry, “Computational Color Technology”, SPIE Press, 2006. |
Balasubramanian, Raja et al., “Method for Quantifying the Color Gamut of an Output Device”, SPIE Proceedings vol. 3018, (Apr. 4, 1997). |
European Patent Office, PCT/US2018/020588, International Search Report and Written Opinion, dated Jul. 9, 2018. |
Number | Date | Country | |
---|---|---|---|
20210358452 A1 | Nov 2021 | US |
Number | Date | Country | |
---|---|---|---|
62591188 | Nov 2017 | US | |
62585692 | Nov 2017 | US | |
62585761 | Nov 2017 | US | |
62585614 | Nov 2017 | US | |
62509087 | May 2017 | US | |
62509031 | May 2017 | US | |
62467291 | Mar 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15910081 | Mar 2018 | US |
Child | 16576350 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16576350 | Sep 2019 | US |
Child | 17388525 | US |