Patent Grant
8952981
When text and graphics are displayed on a computer screen, anti-aliasing is commonly used to improve clarity of the displayed image. The anti-aliasing helps to reduce jagged edges in the displayed text and graphics. The jagged edges are a distortion in the displayed image that typically occurs when a high resolution image is displayed at a lower resolution.
One form of anti-aliasing reduces image distortion by highlighting selective subpixels of the displayed image and adjusting a color value and opacity for the selected subpixels. By varying a color value of the subpixels and by adjusting opacity of the subpixels, the clarity of the displayed image can be improved. However, when using this form of anti-aliasing to display moving images on transparent backgrounds on a computer screen, performance issues may occur when providing anti-aliasing for the moving image.
Embodiments of the disclosure are directed to a method for displaying a rendered image on an electronic computing device. The method comprises rendering a first image on the electronic computing device. The first image is rendered on a white background. A second image is rendered on the electronic computing device. The second image is rendered on a black background. The first image, the second image and a background image are combined to produce a third image. The third image is a composite of the first image, the second image and the background image. The third image is displayed on a display screen of the electronic computing device. The third image includes anti-aliasing for a plurality of subpixels of the third image.
This Summary is provided to introduce a selection of concepts, in a simplified form, that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in any way to limit the scope of the claimed subject matter.
The present application is directed to systems and methods for subpixel compositing on transparent display screen backgrounds. The systems and methods provide for rendering two images of an object and providing the two images to a compositor. The compositor produces a composite image that may be displayed on a display screen of a computing device. The compositor uses information stored in the two rendered images to calculate an opacity for each subpixel in the composite image. The calculation of the opacity for each subpixel permits a method of anti-aliasing to be used with the compositor. The anti-aliasing helps to improve the clarity of the image on the display screen.
In examples, a display screen is comprised of a plurality of pixels. Each pixel is further comprised of three subpixels. Each subpixel represents a different primary color—red, green and blue. When text or graphics are displayed on the display screen, the displayed text or graphics may include jagged edges that may make the displayed text or graphics appear distorted. The jagged images are typically caused by the nature of the pixel display. For example, pixels typically appear as small square areas on the display screen. When a curved or slanted character, such as the number 3 or a slanted line is displayed, the square display of the pixels typically do not provide the needed resolution to display the number 3 or the slanted line without including jagged edges.
One example method of anti-aliasing that may be used to improve the resolution of displayed images is the ClearType® subpixel rendering technology from Microsoft Corporation of Redmond, Wash. Using the ClearType® subpixel rendering technology, an opacity is determined for each subpixel of a displayed image. By determining values for both opacity and intensity, subpixels adjacent to jagged edges in a display image may be adjusted to a degree of highlighting such that the jagged edges appear softened and less apparent to a viewer.
When displaying moving or static objects on a display screen a compositor is often used to improve display performance. Examples of a moving object on a display screen include a transition or animation in a slide show application. Other examples include a moving object in other animation applications. For static images, caching and redrawing the static image may improve display performance. The systems and methods in this disclosure may be used to improve display performance of both moving and static objects.
The compositor combines separate visual images into a single image. For example, an animation is typically formed from separate image layers that are combined into a single image. For text objects that are displayed during a slide show animation, for example a fly-in of a text object, the compositor may be used to combine the text object with a background image on the display screen. In examples, text objects may be shown with different transparencies and background colors. When a text object moves on the display screen during the animation, opacity values may need to be adjusted for each subpixel to maintain a uniform transparency of the text object as the text object moves on the display screen.
For performance reasons, when displaying a moving object on a display screen, it is usually more efficient to render an image on the display screen and then move the rendered image on the display screen. This is typically more efficient than rendering the image at each position as the image is moved on the display screen. When an image is stored, a data value representing color and opacity is typically stored for each pixel in the image. The data value, often known as an RGBA value, indicates a color value for R (red), G (green) and B (blue) subpixels of the pixel and an opacity value A for the pixel. In examples each color value for red, green and blue is a number from 0 to 1, where 1 represents full color and 0 represents no color. The opacity value is typically a number from 0 to 1 that translates to a percent of opacity. For example, a value of 1 represents maximum opacity, corresponding to zero transparency. A value of zero represents minimum opacity, corresponding to the pixel being 100% transparent. A value of 0.5 represents 50% transparency.
In order to provide anti-aliasing for the moving object similar to anti-aliasing provided for a static object using the ClearType® subpixel rendering technology, an opacity is provided for each subpixel of the moving object. However, as discussed earlier, when an image is stored, opacity is only stored for each pixel of the image (via RGBA) but opacity is not stored for each subpixel of the image.
Using the systems and methods described herein, two images are stored for an object and an opacity is calculated for each subpixel of the image using RGB values for the two images stored. One image that is stored is based on rendering an image of the object against a white background and another image that is stored is based on rendering the image of the object against a black background. The two images are then provided to the compositor. As described in detail herein, an opacity for each subpixel of the image is calculated by subtracting a rendered output for the subpixel on the black background from a rendered output for the subpixel on a white background.
The example compositor 106 receives the two images and uses the RGBA information for the two images in conjunction with a background image on the display screen to calculate the opacity for each subpixel in the rendered image. When the opacity for each subpixel in the rendered image is calculated, the image may be moved on the computer screen without needing to re-render the image multiple times as the image is moved. Moving the image without re-rendering the image improves application performance. For example, generating a fly-in animation for a word or phrase on a Powerpoint® slideshow presentation is done more efficiently and less expensively by moving a rendered image than re-rendering the image multiple times as the image moves across the display screen.
The example display module 108 displays rendered images on the display screen of client computer 102.
When an image is rendered on a display screen, a background pattern on the display screen and a transparency of the image need to be taken into account. An image may be displayed with varying degrees of transparency. When an image is completely opaque (having zero transparency), the background beneath the object cannot be seen. Similarly, when the image is completely transparent (having zero opacity), the background can be seen but the object is invisible. When an image has an opacity between zero and one, part of the image can be seen and part of the background can be seen. When a black image having an opacity of 1 (zero transparency) is viewed against a black background, the image is blended into the background and cannot be seen. However, when a black image having the same opacity is viewed on a white background or when a black image having an opacity of zero (fully transparent) is viewed on a black background, the image is fully visible.
The display of an object (for example a word of text) on a background blends a color of the object with a color of the background. In computer graphics, the output of an object against a background is given be the following equation:
output=background*(1−α)+color*α (1)
where,
When text is rendered on a white background, equation 1 may be re-written as
W=1*(1−α)+color*α (2)
For the case of text rendered on a white background, because the background is white, the background term in the equation has a value of 1. The output W represents an output color value for the object rendered on a white background.
When text is rendered on a black background, equation 1 may be re-written as
B=0*(1−α)+color*α=color*α (3)
For the case of text rendered on a black background, because the background is black, the background term in the equation has a value of 0. The output B represents an output color value for the object rendered on a black background.
When equation (3) is subtracted from equation (2), the result is
W−B=1−α
Thus the opacity α for a subpixel may be calculated from the W−B term.
Substituting (W−B) for (1−α) in equation (1) and substituting B for color*α (per equation 3), output equation 1 may be re-written as:
output=background*(W−B)+B (1a)
Thus, using rendered images for an object against a white and black background, the subpixel opacity processing module 202 calculates an opacity for each subpixel in a rendered image by performing a W−B subtraction for each subpixel in the rendered image. The opacity of each subpixel is not needed in the calculation for the output (equation 1a) and therefore does not need to be stored.
The example background processing module 204 calculates a color value for a background image for each subpixel on the display screen. The color value is a number between zero and one. For example, each subpixel can have a value between 0 and 1, zero representing no color and 1 representing full color, i.e. maximum values of red, blue or green.
If the subpixel has full color, the value is 1. If the subpixel has no color, the value is zero. For subpixels that have intermediate values of red, blue or green, the background color value is determined by dividing the color value by 1. For example if a subpixel has a color value of 0.5, the background value is 0.5/1 or 0.5. The background color value is used in equation 1a to determine an output value for a subpixel of a rendered image on the display screen. A background color value is calculated for each subpixel of the rendered image on the display screen.
The example compositing processing module 206 receives the two rendered images of the object and the background image on the display screen and generates a composite image of the object against the background. The composite image is generated for each subpixel of the object using equation 1a. Thus, at each position at which the object is displayed on the display screen, for each subpixel in the rendered image of the object and for one or more additional subpixels adjacent to the rendered image, the background value for the subpixel, as calculated in the background processing module 204, is multiplied by (W−B) and added to B.
The result is a color value of the subpixel that takes into account the background image and that takes into account a transparency for the subpixel. The transparency is taken into account via the opacity (α), which although not explicitly included in equation 1a, is implicitly included because of the (W−B) term. As discussed, the W and B terms result from rendering the object against white and black backgrounds using the ClearType® subpixel rendering technology. This technology uses subpixel opacities. The one or more additional subpixels adjacent to the rendered image correspond to subpixels used as part of the ClearType® subpixel rendering technology to improve clarity for the rendered image.
At operation 306, the text is rendered on a black background on the client computer. At operation 308, a color value is calculated and stored for each subpixel in the text rendered on the black background. The color value represents a color intensity for the subpixel. In examples, the color value may be a decimal number between zero and one, with one representing a maximum color value.
At operation 310, a color value is calculated for each subpixel of a background image on the display screen. In examples the background image may be a solid color or a pattern. The background image may be a static image or the background image may be a dynamic image which changes over time.
At operation 312, the rendered images and the background image are applied to a compositor. The compositor uses the stored color values for the rendered images and the background image to calculate color values for a composite image. The composite image includes antialiasing information. At operation 314, the composite image is displayed on the display screen.
At operation 402, subpixel color values for an image rendered on a black background are subtracted from subpixel color values for the image rendered on a white background. A color value for each subpixel color value for the image rendered on the black background is subtracted from a color value for a corresponding subpixel for the image rendered on the white background.
At operation 404, for each subtraction in operation 402, the result of the subtraction for a subpixel is multiplied by a color value in a background image on the display screen at a corresponding subpixel location. For example, for each subpixel in the composite image, the result of the subtraction operation for the subpixel at operation 402 is multiplied by the color value of the background image at the same subpixel location in the composite image.
At operation 406, for each subpixel location in the composite image, the result of operation 404 is added to the color value for the image rendered on the black background. The result of performing operation 406 for each subpixel in the composite image is an image that includes anti-aliasing for each subpixel in the composite image.
With reference to
In a basic configuration, client computer 102 typically includes at least one processing unit 502 and system memory 504. Depending on the exact configuration and type of computing device, the system memory 504 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two. System memory 504 typically includes an operating system 506 suitable for controlling the operation of a client computer. The system memory 504 may also include one or more software applications 808 and may include program data.
The client computer 102 may have additional features or functionality. For example, client computer 102 may also include computer readable media. Computer readable media can include both computer readable storage media and communication media.
Computer readable storage media is physical media, such as data storage devices (removable and/or non-removable) including magnetic disks, optical disks, or tape. Such additional storage is illustrated in
Consistent with embodiments of the present disclosure, the input device(s) 514 may comprise any motion detection device capable of detecting the movement or gesture of a user. For example, the input device(s) 514 may comprise a Kinect® motion capture device, from Microsoft Corporation, comprising a plurality of cameras and a plurality of microphones.
The client computer 102 may also contain communication connections 518 that allow the device to communicate with other computing devices 520, such as over a network in a distributed computing environment, for example, an intranet or the Internet. Communication connections 518 are one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.
Embodiments of the present disclosure may be practiced via a system-on-a-chip (SOC) where each or many of the components illustrated in
The various embodiments described above are provided by way of illustration only and should not be construed to limiting. Various modifications and changes that may be made to the embodiments described above without departing from the true spirit and scope of the disclosure.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4908780 | Priem et al. | Mar 1990 | A |
| 5940080 | Ruehle et al. | Aug 1999 | A |
| 6894702 | Stamm et al. | May 2005 | B2 |
| 7222306 | Kaasila et al. | May 2007 | B2 |
| 7230624 | Lengyel | Jun 2007 | B2 |
| 7280120 | Ecob et al. | Oct 2007 | B2 |
| 7580039 | Dowling et al. | Aug 2009 | B2 |
| 8314812 | Eckel | Nov 2012 | B1 |
| 20050110804 | Hancock et al. | May 2005 | A1 |
| 20050253865 | Proteau | Nov 2005 | A1 |
| 20100079480 | Murtagh | Apr 2010 | A1 |
| Entry |
|---|
| Duff et al., “Compositing Digital Images,” Jul. 1984, Computer Graphics, v. 18, No. 3, pp. 253-259. |
| Sneath,Tim; “A-Guided-Tour-of-Windows-Presentation-Foundation”—Microsoft Corporation, Sep. 2005, 36 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20130135339 A1 | May 2013 | US |
