Patent Application
20190266954
Embodiments of the present invention relate generally to display devices and display technology and, more specifically, to parallel pipelines for computing backlight illumination fields in high dynamic range display devices.
A conventional liquid-crystal display (LCD) usually includes an array of ight-emitting diodes (LEDs) coupled to an array of LCD pixels. The array of LEDs is commonly known as the “backlight.” In operation, the backlight emits light to the array of LCD pixels with a brightness that can vary across different LCD pixels. A given LCD pixel includes a set of filters that modifies the color of the light received from the backlight in order to emit light having a specific color value.
In a typical system, a display controller coordinates the operations of the backlight and the array of LCD pixels to cause an image to be displayed via the LCD. In so doing, the display controller determines the brightness of each LED included in the backlight based on the image to be displayed and then sets the current supplied to each LED to achieve the determined brightness. The display controller also configures each LCD pixel to emit light having a color value that represents a specific portion or pixel of the image being displayed. To configure a given LCD pixel to emit light having a specific color value, the display controller first estimates the total intensity of light received at the given LCD pixel from some or all LEDs included in the backlight. The display controller then divides the desired color value by that total intensity to produce percentages of red, green, and blue light the given LCD pixel should filter when displaying the image. Finally, the display controller configures the given LCD pixel according to these percentages.
When performing the above operations, the display controller usually estimates the total intensity of light received at a given LCD pixel by accumulating the individual light contributions from each LED to the given LCD pixel. Based on the accumulated light contributions, the display controller generates an entry in a backlight illumination field (BLIF) corresponding to the given LCD pixel. The light contribution from any given LED to a given LCD pixel can be estimated by evaluating a point-spread function (PSF). A PSF is a mapping that indicates the intensity of light at different distances from an LED. When computing an entry in the BLIF for a given LCD pixel, the display controller evaluates the PSF across all LEDs that contribute light to the given LCD pixel and then accumulates the results of those evaluations. The display controller performs these steps across all LCD pixels to fully populate the BLIF with a different entry for each LCD pixel. The display controller typically generates a new BLIF each time the LCD refreshes. Notably, this approach for generating BLIFs, is not feasible for certain types of display devices.
In particular, for high resolution display devices with densely populated backlights that operate at high refresh rates, the above computations have to be performed an excessive number of times in order to configure each LCD pixel. For example, in a 4K high dynamic range (HDR) display with a 24×16 matrix backlight operating at a 1440 Hz refresh rate, the display controller would need to evaluate the PSF approximately 300 billion times per second. Conventional display controllers simply do not operate not fast enough to complete all of the necessary computations and still maintain appropriate refresh rates. Consequently, conventional display controllers oftentimes make tradeoffs between computational accuracy and refresh rate when generating BLIFs for high resolution display devices. However, in specific high performance applications, such as gaming applications, sacrificing either computational accuracy or refresh rate can diminish the overall user experience.
As the foregoing illustrates, what is needed in the art are more effective techniques for computing BLIFs when configuring LCD pixels to display images.
Various embodiments include a computer-implemented method for displaying an image, including generating a first sample associated with a first light source based on a first dataset, where the first dataset includes a first plurality of luminance values indexed by a first set of distances, generating a second sample associated with the first light source based on a second dataset, where the second dataset includes a second plurality of luminance values indexed by a second set of distances, combining the first sample with the second sample to determine a first luminance value associated with light that is contributed to a first screen pixel by the first light source, and configuring the first screen pixel to output light associated with a first portion of the image based on the first luminance value.
At least one technological advantage of the disclosed techniques is that the display controller generates a full resolution BLIF with high accuracy and with far fewer computations compared to conventional approaches.
So that the manner in which the above recited features of the various embodiments can be understood in detail, a more particular description of the inventive concepts, briefly summarized above, may be had by reference to various embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only typical embodiments of the inventive concepts and are therefore not to be considered limiting of scope in any way, and that there are other equally effective embodiments.
In the following description, numerous specific details are set forth to provide a more thorough understanding of the various embodiments. However, it will be apparent to one skilled in the art that the inventive concepts may be practiced without one or more of these specific details.
As noted above, a conventional display controller performs a lengthy series of complex computations in order to compute a backlight illumination field (BLIF) when configuring LCD pixels to display an image. In particular, the display controller evaluates a PSF for each LCD pixel across all LEDs and then accumulates the results to produce a single entry in the BLIF. The display controller repeats these steps across all LCD pixels to fully populate the BLIF. The display controller generates a new BLIF each time the display device refreshes. With high resolution display devices having densely populated backlights, the number of computations needed to generate a BLIF can become excessive. Conventional display controllers do not operate with sufficient speed to generate BLIFs at very high refresh rates. Consequently, conventional display controllers cannot be implemented in display devices designed for gaming or other high performance applications that demand very high refresh rates.
To address these issues, embodiments of the invention include a display controller that generates a BLIF based on a coarse PSF and a correction PSF. The display controller samples the coarse PSF to accumulate light contributions from a larger neighborhood of LEDs around a given LCD pixel. The display controller samples the correction PSF to generate correction factors for a smaller neighborhood of LEDs around the given LCD pixel. The display controller interpolates samples drawn from the coarse PSF and samples drawn from the correction PSF and then combines the interpolated samples to generate a full resolution BLIF.
At least one technological advantage of the disclosed techniques is that the display controller generates a full resolution BLIF with high accuracy and with far fewer computations compared to conventional approaches. Because fewer computations are needed, the disclosed display controller can generate BLIFs much faster than conventional display controllers. The disclosed display controller can therefore support high resolution display devices that include densely populated backlights and operate with high refresh rates. Accordingly, the disclosed display controller is especially useful for display devices designed for gaming and other high performance applications. For these reasons, the disclosed techniques represent a significant technological advancement compared to previous approaches.
Computing device 120 includes a processor 122, a graphics processor 124, input/output (I/O) devices 126, and memory 128, coupled together. Processor 122 includes any technically feasible set of hardware units configured to process data and execute software applications. For example, processor 122 could include one or more central processing units (CPUs). Graphics processor 124 includes any technically feasible set of hardware units configured to process graphics data and execute graphics applications. For example, graphics processor 124 could include one or more graphics processing units (GPUs). I/O devices 126 include any technically feasible set of devices configured to perform input and/or output operations, including, for example, a universal serial bus (USB) port, among others. Memory 128 includes any technically feasible storage media configured to store data and software applications, such as, for example, a hard disk and/or a random-access memory (RAM) module, among others. Memory 128 includes a device driver 130 and a software application 132.
Device driver 130 includes program code that is executed by processor 122 to coordinate the operation of graphics processor 124. During execution, device driver 130 acts as an interface to graphics processor 124. Software application 132 includes program code that is executed by processor 122 to generate graphics processing tasks to be performed by graphics processor 124. In operation, software application 132 transmits these graphics processing tasks to device driver 130, and device driver 130 generates machine code that can be executed by graphics processor 124 to perform the graphics processing tasks. The graphics processing tasks could include, for example, graphics rendering operations, encoding operations, decoding operations, and so forth.
When performing graphics rendering operations, graphics processor 124 generates images on behalf of software application 132 and then causes display device 110 to display those images. For example, software application 132 could be a video game that leverages graphics processor 124 to render images depicting a simulating environment. Display device 110 could display these images to the user via display screen 112. Display screen 112 is described in greater detail below in conjunction with
Display controller 114 controls the brightness of LEDs 202 by supplying varying levels of current to each LED 202. For example, display controller 114 could cause an LED 202 to output light with an elevated brightness by supplying an elevated current level to that LED. Display controller 114 controls the color of light emitted by LCD pixel 222 by setting different percentages with which valves 300 should filter red, green, and blue light. For example, display controller 114 could cause LCD pixel 222 to output a purely blue light by setting valves 300(0) and 300(1) to filter 100% of red light and 100% of green light and filter 0% of blue light, thereby allowing only the blue component of light 210 to pass through LCD pixel 222 relatively unfiltered. As a general matter, display controller 114 controls the operation of LEDs 202 and LCD pixels 222 based on the image to be displayed, as described in greater detail below in conjunction with
When generating LCD valve settings 420 for image 400, display controller 114 maps each LCD pixel 222 to a different portion or pixel of image 400 to determine a target RGB color value for each LCD pixel 222. Display controller 114 also accumulates luminance contributions 402 provided by some or all LEDs 202 to each LCD pixel 222 to generate a backlight illumination field (BLIF) 430. BLIF 430 is an array of values that indicates the total luminance received at each LCD pixel 222 when some or all LEDs 202 emit light based on the target brightness settings. Display controller 114 determines LCD valve settings 420 for LCD pixels 222 by dividing the target RGB color values by corresponding values included in BLIF 430.
Display controller 114 generates BLIF 430 for image 400 by approximating a point-spread function (PSF). The PSF indicates the luminance of light emitted by an LED 202 at different distances from the LED 202. Luminance generally decreases over distance. Accordingly, PSF can be visualized as a bell-shaped curve centered at the position of the LED 202. The luminance contributed by a given LED 202 to a given LCD pixel 222 can be estimated by evaluating the PSF based on the distance between the given LED 202 and the given LCD pixel 222. The total luminance contributed by multiple LEDs 202 to the given LCD pixel 222 can be estimated by accumulating the results of multiple PSF evaluations across multiple LEDs 202. In operation, display controller 114 approximates the PSF via a coarse PSF look-up table (LUT) 440 and correction PSF LUT 450. Each of these LUTs includes a set of luminance values or luminance difference values indexed by distance. Display controller 114 generates highly accurate approximations to the PSF based on coarse PSF LUT 440 and correction PSF LUT 450, as described in greater detail below in conjunction with
As shown in
For example, PSF 500(0) could be evaluated based on the distance between LED 202(0) and LCD pixel 222 to generate contribution value 502(0). Similarly, PSF 500(1) could be evaluated based on the distance between LED 202(1) and LCD pixel 222 to generate contribution value 502(1), and PSF 500(2) could be evaluated based on the distance between LED 202(2) and LCD pixel 222 to generate contribution value 502(2). These contribution values 502 can be scaled based on the brightness settings of LEDs 202 and then accumulated to determine the total luminance received at LCD pixel 222. For example, contribution values 502(0), 502(1), and 502(2) could be scaled according to the brightness settings of LEDs 202(0), 202(1), and 202(2), respectively, and the results of this scaling could then be accumulated to determine the total luminance received at LCD pixel 222 from LEDs 202. This total luminance represents a BLIF value corresponding to LCD pixel 222.
Display controller 114 does not directly perform the above computations with PSFs 500, however. Again, PSFs 500 are idealized curves presented here for illustrative purposes. Instead, display controller 114 implements coarse PSF LUT 440 and correction PSF LUT 450, as mentioned above in conjunction with
As shown in
Display controller 114 scales samples 512 from this baseline brightness setting relative to the actual brightness setting of LED 202(1). Display controller 114 then performs a linear interpolation between samples 512 to generate coarse curve 510. Coarse curve 510 models PSF 500(1) with reasonable accuracy towards the outer fringes of PSF 500(1) where curvature is low. However, towards the center of PSF 500(1), coarse curve 510 is relatively inaccurate because curvature is higher. Display controller 114 corrects for these inaccuracies using correction PSF LUT 450, as described below in conjunction with
As shown in
Correction PSF LUT 450 includes samples of luminance difference values that are indexed based on a second set of distances, where the resolution of those distances depends on the resolution of the associated samples. A given sample included in correction PSF LUT 450 is generated based on the difference between samples included in coarse PSF LUT 440 and corresponding values of PSF 500.
Similar to samples 510 of PSF LUT 440, samples 522 of correction PSF LUT 450 are defined relative to a baseline LED brightness setting. Accordingly, display controller 114 scales samples 522 relative to the configured brightness setting of LED 202(1). Display controller 114 then performs a linear interpolation between samples 522 to generate correction curve 520. Correction curve 520 models PSF 500(1) with high accuracy towards the center of PSF 500(1) where curvature is high but does not model PSF 500(1) accurately (or at all) towards the outer fringes of PSF 500(1). Display controller 114 combines a portion of coarse curve 510 with a portion of correction curve 520 to generate a highly accurate approximate sample of PSF 500, as described below in conjunction with
As shown in
Because display controller 114 combines specific portions of coarse curve 510 and correction curve 520 in the manner described, neither coarse curve 510 nor correction curve 520 necessarily need to track the contour of PSF 500(1) or align with actual sub-sampled locations of PSF 500(1). As a general matter, because display controller 114 applies corrections to coarse curve 510, coarse curve 510 can have a multitude of shapes and/or values in regions where display controller 114 applies those corrections. For example, interpolated sample 514 could lie above PSF 500(1), and interpolated sample 524 could be a negative value that reduces interpolated sample 514 when combined with interpolated sample 514. Display controller 114 repeats the techniques described above relative to LED 202(1) to approximate PSFs 500(0) and 500(2) and generate corresponding estimates of contribution values 502(0) and 502(1), as described below in conjunction with
As shown in
Referring generally to
As general matter, display controller 114 can perform the techniques described above with any number of LEDs 202 positioned and/or arranged in any technically feasible configuration to generate a BLIF value for a given LCD pixel 222. For example, display controller 114 could generate a BLIF value for a given LCD pixel 222 by approximating the luminance contributions from LEDs 202 within a 5×5 neighborhood of LEDs around the given LCD pixel. In practice, display controller 114 implements two separate neighborhoods of LEDs when approximating luminance contributions, as described in greater detail below in conjunction with
More specifically, display controller 114 generates approximate contributions 532 for LEDs 202 that reside in coarse neighborhood 600 based only on samples drawn from coarse PSF LUT 440. Because LEDs 202 included in coarse neighborhood 600 are relatively far away from LCD pixel 222, the luminance contributions from these LEDs 202 vary approximately linearly with distance. Accordingly, the luminance contributions at LCD pixel 222 may be adequately modeled with coarse PSF LUT 440 alone.
Conversely, display controller 114 generates approximate contributions 532 for LEDs 202 that reside in correction neighborhood 610 based on samples drawn from coarse PSF LUT 440 as well as samples drawn from PSF LUT 450. Because LEDs 202 included in correction neighborhood 610 are relatively close to LCD pixel 222, the luminance contributions from these LEDs 202 vary non-linearly. Accordingly, the luminance contributions at LCD pixel 222 may need to be corrected based on samples drawn from correction PSF LUT 540.
As a general matter, the particular sizes of coarse neighborhood 600 and correction neighborhood 610 can be determined in a manner that achieves a specific accuracy for approximate contributions 532. In one embodiment, display controller 114 only implements one of the two neighborhoods shown. In another embodiment, display controller implements three or more neighborhoods and generates approximate contributions 532 for the LEDs 202 within each neighborhood based on a different combination of samples drawn from three or more PSF LUTs. In yet another embodiment, display controller 114 generates approximate contributions 532 in a manner that accounts for reflections caused by LEDs 202 that reside at or near an edge of display screen 112. This particular embodiment is described below in conjunction with
Simulated border regions B0′ and B1′ include simulated LEDs 202′ that mirror LEDs 202 included in corresponding border regions B0 and B1. When generating approximate contributions 532 for an LCD pixel 222 within border regions B0 and B1, display controller 114 also generates approximate contributions from simulated LEDs 202′ included in simulated border regions B0′ and B1′. Display controller 114 implements special indexing to replicate brightness settings associated with LEDs 202 when determining approximate contributions for simulated LEDs 202′. Display controller 114 also evaluates the geometry of display screen 112 in conjunction with the geometry of border regions B0′ and B1′ to determine various distances between simulated LEDs 202′ and LCD pixel 222.
When generating approximate contributions 532 for simulated LEDs 202′, display controller 114 implements a technique that differs only slightly from that described above in conjunction with
Referring generally to
Coarse sample pipeline 810 generally performs the operations described above in conjunction with
Based on the generated indices, coarse PSF LUT 440 outputs a set of coarse samples indicating luminance contributions provided to the given LCD pixel 222 by the set of LEDs 202. In one embodiment, coarse PSF LUT 440 rounds distance values associated with the generated indices according to the resolution of coarse PSF LUT 440. Each coarse sample is generally defined relative to a baseline LED brightness setting and needs to be scaled according to an actual brightness setting of a corresponding LED 202. LED brightness settings 804 include the current brightness settings for each LED 202. Multiply-accumulate 814 multiplies each coarse sample by a scaling factor that is derived from the brightness setting 804 of the corresponding LED 202 to generate a set of scaled coarse samples. For example, multiply-accumulate 814 could generate samples 512 shown in
Coarse sample interpolation 816 performs a linear interpolation operation with the scaled coarse samples to generate a set of interpolated coarse samples associated with the set of LEDs 202. The interpolated coarse samples could include, for example, interpolated sample 514 that resides along coarse curve 510, as shown in
Correction sample pipeline 820 generally performs the operations described above in conjunction with
Based on the generated indices, correction PSF LUT 450 outputs a set of correction samples. In one embodiment, correction PSF LUT 450 rounds distance values associated with the indices according to the resolution of correction PSF LUT 450. Multiply-accumulate 814 multiplies each correction sample by a scaling factor that is derived from the brightness setting 804 of the corresponding LED 202 to generate a set of scaled correction samples. For example, multiply-accumulate 824 could generate samples 522 shown in
Merge 800 receives interpolated coarse samples from coarse sample pipeline 810 and interpolated correction samples from correction sample pipeline 820 and then adds corresponding interpolated samples together, in like fashion as illustrated in
In one embodiment, display controller 114 may replicate LCD pixel values associated with LCD pixels 222 that reside alongside or close to edge 700 of display screen 112 to other LCD pixels 222 that reside alongside or close to edge 700 of display screen. This approach can be implemented to address manufacturing techniques that modify the positions of LEDs 202, potentially altering the expected number of LCD pixel rows or columns. Display controller 114 may adjust these replicated pixel values based on attenuation factor to account for distance variations between these LCD pixels 222 and LEDs 202.
Advantageously, display controller 114 generates BLIF 430 at full resolution, with high accuracy, and with far fewer computations compared to conventional approaches. Because display controller 114 combines samples derived from coarse PSF LUT 440 with samples derived from correction PSF LUT 450, display controller can avoid evaluating a high-resolution PSF for each LCD pixel across all LEDs, as implemented by conventional display controllers. Thus, display controller 114 can generate BLIFs at high speed, and is therefore suitable for display devices designed for high performance applications such as gaming. As discussed, display controller 114 implements two separate pipelines when generating BLIF 430.
As shown, a method 900 begins at 902, where display controller determines a neighborhood around an LCD pixel 222. The determined neighborhood defines a region that includes LEDs 202 to be considered when accumulating luminance contributions. The neighborhood could be, for example, coarse neighborhood 600 or correction neighborhood 610. In one embodiment, display controller 114 configures neighborhood sizes to achieve a desired BLIF accuracy.
At step 904, display controller 114 generates indices associated with the neighborhood determined at step 902. Display controller 114 generates indices based on the distance between the LCD pixel 222 and each LED 202 included in the contribution neighborhood. Display controller 114 generates indices based on screen geometry 802 shown in
At step 906, display controller 114 extracts luminance contributions from a PSF LUT using the indices determined at step 904. The PSF LUT could be either coarse PSF LUT 440 or correction PSF LUT 450 of
At step 908, display controller 114 scales the luminance contributions extracted from the PSF LUT based on brightness settings associated with the LEDs 202 included in the neighborhood. The PSF LUT defines luminance contributions relative to a baseline LED brightness setting. Accordingly, these contributions need to be scaled up based on the actual brightness settings of corresponding LEDs 202. In one embodiment, display controller 114 may perform step 908 via one or more multiply-accumulate operations.
At step 910, display controller 114 interpolates the scaled luminance contributions generated at step 908 to generate a partial BLIF value. The partial BLIF value could be one of interpolated samples 514 or 524 shown in
In sum, a display controller generates a BLIF based on a coarse PSF and a correction PSF. The display controller samples the coarse PSF to accumulate light contributions from a larger neighborhood of LEDs around a given LCD pixel. The display controller samples the correction PSF to generate correction factors for a smaller neighborhood of LEDs around the given LCD pixel. The display controller interpolates samples drawn from the coarse PSF and samples drawn from the correction PSF and then combines the interpolated samples to generate a full resolution BLIF.
At least one technological advantage of the disclosed techniques is that the display controller generates a full resolution BLIF with high accuracy and with far fewer computations compared to conventional approaches. Because fewer computations are needed, the disclosed display controller can generate BLIFs much faster than conventional display controllers. The disclosed display controller can therefore support high resolution display devices that include densely populated backlights and operate with high refresh rates. Accordingly, the disclosed display controller is especially useful for display devices designed for gaming and other high performance applications. For these reasons, the disclosed techniques represent a significant technological advancement compared to previous approaches.
1. Some embodiments include a computer-implemented method for displaying an image, the method comprising generating a first sample associated with a first light source based on a first dataset, wherein the first dataset includes a first plurality of luminance values indexed by a first set of distances, generating a second sample associated with the first light source based on a second dataset, wherein the second dataset includes a second plurality of luminance values indexed by a second set of distances, combining the first sample with the second sample to determine a first luminance value associated with light that is contributed to a first screen pixel by the first light source, and configuring the first screen pixel to output light associated with a first portion of the image based on the first luminance value.
2. The computer-implemented method of clause 1, further comprising determining a first distance between the first light source and the first screen pixel based on geometry data associated with a display screen that includes the first light source and the first screen pixel.
3. The computer-implemented method of any of clauses 1-2, wherein generating the first sample comprises extracting a first subset of luminance samples from the first dataset based on the first distance, and wherein generating the second sample comprises extracting a second subset of luminance samples from the second dataset based on the first distance.
4. The computer-implemented method of any of clauses 1-3, wherein generating the first sample further comprises scaling the first subset of luminance samples based on a brightness setting associated with the first light source, and wherein generating the second sample further comprises scaling the second subset of luminance samples based on a brightness setting associated with the first light source.
5. The computer-implemented method of any of clauses 1-4, wherein generating the first sample further comprises interpolating between at least two samples included in the first subset of samples to generate a first interpolated sample, and wherein generating the second sample further comprises interpolating between at least two samples included in the second subset of samples to generate a second interpolated sample,
6. The computer-implemented method of any of clauses 1-5, wherein combining the first sample with the second sample comprises adding a first interpolated sample to a second interpolated sample to generate the first luminance value,
7. The computer-implemented method of any of clauses 1-6, wherein the first data set defines a coarse approximation of a point-spread function associated with the first light source, and wherein the second data set defines a set of correction factors for refining the coarse approximation of the point-spread function.
8. The computer-implemented method of any of clauses 1-7, wherein the first sample and the second sample are generated at least partially in parallel with one another.
9. The computer-implemented method of any of clauses 1-8, wherein the first data set includes M samples, the second data set includes N samples, N and M are integer values, and N is greater than M.
10. The computer-implemented method of any of clauses 1-9, further comprising determining that the first light source resides outside of a boundary that surrounds a second screen pixel, determining a first distance between the first light source and the second screen pixel, generating a third sample associated with the first light source based on the first data set, determining a second luminance value associated with light that is contributed to the second screen pixel by the first light source based on the third sample, and configuring the second screen pixel to output light associated with a second portion of the image based on the second luminance value.
11. Some embodiments include a display device, comprising a display screen, and a display controller that causes the display screen to display an image by performing the steps of generating a first sample associated with a first light source based on a first dataset, wherein the first dataset includes a first plurality of luminance values indexed by a first set of distances, generating a second sample associated with the first light source based on a second dataset, wherein the second dataset includes a second plurality of luminance values indexed by a second set of distances, combining the first sample with the second sample to determine a first luminance value associated with light that is contributed to a first screen pixel by the first light source, and configuring the first screen pixel to output light associated with a first portion of the image based on the first luminance value.
12. The display device of clause 11, wherein the display controller performs the additional step of determining a first distance between the first light source and the first screen pixel based on geometry data associated with the display screen, wherein the display screen includes the first light source and the first screen pixel.
13. The display device of any of clauses 11-12, wherein the display controller performs the step of generating the first sample by extracting a first subset of luminance samples from the first dataset based on the first distance, wherein the display controller performs the step of generating the second sample by extracting a second subset of luminance samples from the second dataset based on the first distance, and wherein the first subset of luminance samples and the second subset of luminance samples are extracted at least partially in parallel with one another.
14. The display device of any of clauses 11-13, wherein the display controller further performs the step of generating the first sample by scaling the first subset of luminance samples based on a brightness setting associated with the first light source, wherein the display controller further performs the step of generating the second sample by scaling the second subset of luminance samples based on a brightness setting associated with the first light source, and wherein the first sample and the second sample are generated at least partially in parallel with one another.
15. The display device of any of clauses 11-14, wherein the display controller further performs the step of generating the first sample by interpolating between at least two samples included in the first subset of samples to generate a first interpolated sample, wherein the display controller further performs the step of generating the second sample by interpolating between at least two samples included in the second subset of samples to generate a second interpolated sample, and wherein the first interpolated sample and the second interpolated sample are generated at least partially in parallel with one another.
16. The display device of any of clauses 11-15, wherein the display controller performs the step of combining the first sample with the second sample by adding a first interpolated sample to a second interpolated sample to generate the first luminance value.
17. The display device of any of clauses 11-16, wherein the first data set defines a coarse approximation of a point-spread function associated with the first light source and includes M samples, wherein the second data set defines a set of correction factors for refining the coarse approximation of the point-spread function and includes N samples, and wherein M and N comprise different integer values.
18. The display device of any of clauses 11-17, wherein the display controller performs the additional steps of determining that the first light source resides outside of a boundary that surrounds a second screen pixel, determining a first distance between the first light source and the second screen pixel, generating a third sample associated with the first light source based on the first data set, determining a second luminance value associated with light that is contributed to the second screen pixel by the first light source based on the third sample, and configuring the second screen pixel to output light associated with a second portion of the image based on the second luminance value.
19. The display device of any of clauses 11-18, wherein the display controller performs the additional steps of generating a third sample associated with a simulated version of the first light source based on the first dataset, generating a fourth sample associated with the simulated version of the first light source based on the second dataset, combining the third sample with the fourth sample to determine a second luminance value associated with light that is reflected to the first screen pixel by an edge of the display screen and derived from the first light source, and configuring the first screen pixel to output light associated with the first portion of the image based further on the second luminance value.
20. Some embodiments include a subsystem for displaying an image, the subsystem comprising a first sample pipeline that generates a first sample associated with a first light source based on a first dataset, wherein the first dataset includes a first plurality of luminance values indexed by a first set of distances, a second sample pipeline that operates in parallel with the first sample pipeline to generate a second sample associated with the first light source based on a second dataset, wherein the second dataset includes a second plurality of luminance values indexed by a second set of distances, a combiner that is coupled to the first sample pipeline and to the second sample pipeline and that combines the first sample with the second sample to determine a first luminance value associated with light that is contributed to a first screen pixel by the first light source, wherein the first screen pixel outputs light associated with a first portion of the image based on the first luminance value.
Any and all combinations of any of the claim elements recited in any of the claims and/or any elements described in this application, in any fashion, fall within the contemplated scope of the present invention and protection.
The descriptions of the various embodiments have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments.
Aspects of the present embodiments may be embodied as a system, method or computer program product. Accordingly, aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “module” or “system” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine. The instructions, when executed via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such processors may be, without limitation, general purpose processors, special-purpose processors, application-specific processors, or field-programmable gate arrays.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
While the preceding is directed to embodiments of the present disclosure, other and further embodiments of the disclosure may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.
This application claims the priority benefit of the U.S. provisional patent application Ser. No. 62/636,129, titled, “Backlight Illumination Field Computation Pipeline for HDR Displays,” filed on Feb. 27, 2018. The subject matter of this related application is hereby incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62636129 | Feb 2018 | US |
